[2022-07-12 19:17:13,990][27935] Experiment dir ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0 already exists! [2022-07-12 19:17:13,990][27935] Resuming existing experiment from ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0... [2022-07-12 19:17:13,990][27935] Saving configuration to ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0/cfg.json... [2022-07-12 19:17:14,008][27935] Environment var CUDA_VISIBLE_DEVICES is 0 [2022-07-12 19:17:17,267][27935] Rollout worker 0 uses device cpu [2022-07-12 19:17:17,267][27935] Rollout worker 1 uses device cpu [2022-07-12 19:17:17,267][27935] Rollout worker 2 uses device cpu [2022-07-12 19:17:17,268][27935] Rollout worker 3 uses device cpu [2022-07-12 19:17:17,268][27935] Rollout worker 4 uses device cpu [2022-07-12 19:17:17,268][27935] Rollout worker 5 uses device cpu [2022-07-12 19:17:17,268][27935] Rollout worker 6 uses device cpu [2022-07-12 19:17:17,268][27935] Rollout worker 7 uses device cpu [2022-07-12 19:17:17,269][27935] Rollout worker 8 uses device cpu [2022-07-12 19:17:17,269][27935] Rollout worker 9 uses device cpu [2022-07-12 19:17:17,269][27935] Rollout worker 10 uses device cpu [2022-07-12 19:17:17,269][27935] Rollout worker 11 uses device cpu [2022-07-12 19:17:17,269][27935] Rollout worker 12 uses device cpu [2022-07-12 19:17:17,270][27935] Rollout worker 13 uses device cpu [2022-07-12 19:17:17,270][27935] Rollout worker 14 uses device cpu [2022-07-12 19:17:17,270][27935] Rollout worker 15 uses device cpu [2022-07-12 19:17:17,270][27935] Rollout worker 16 uses device cpu [2022-07-12 19:17:17,270][27935] Rollout worker 17 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 18 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 19 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 20 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 21 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 22 uses device cpu [2022-07-12 19:17:17,271][27935] Rollout worker 23 uses device cpu [2022-07-12 19:17:17,272][27935] Rollout worker 24 uses device cpu [2022-07-12 19:17:17,272][27935] Rollout worker 25 uses device cpu [2022-07-12 19:17:17,272][27935] Rollout worker 26 uses device cpu [2022-07-12 19:17:17,272][27935] Rollout worker 27 uses device cpu [2022-07-12 19:17:17,272][27935] Rollout worker 28 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 29 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 30 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 31 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 32 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 33 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 34 uses device cpu [2022-07-12 19:17:17,273][27935] Rollout worker 35 uses device cpu [2022-07-12 19:17:17,294][27935] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2022-07-12 19:17:17,294][27935] InferenceWorker_p0-w0: min num requests: 12 [2022-07-12 19:17:17,443][27935] Starting all processes... [2022-07-12 19:17:17,443][27935] Starting process learner_proc0 [2022-07-12 19:17:17,493][27935] Starting process inference_proc0-0 [2022-07-12 19:17:17,543][27935] Starting process rollout_proc0 [2022-07-12 19:17:17,593][27935] Starting process rollout_proc1 [2022-07-12 19:17:17,643][27935] Starting process rollout_proc2 [2022-07-12 19:17:17,693][27935] Starting process rollout_proc3 [2022-07-12 19:17:17,743][27935] Starting process rollout_proc4 [2022-07-12 19:17:17,793][27935] Starting process rollout_proc5 [2022-07-12 19:17:17,843][27935] Starting process rollout_proc6 [2022-07-12 19:17:17,893][27935] Starting process rollout_proc7 [2022-07-12 19:17:17,943][27935] Starting process rollout_proc8 [2022-07-12 19:17:17,993][27935] Starting process rollout_proc9 [2022-07-12 19:17:18,043][27935] Starting process rollout_proc10 [2022-07-12 19:17:18,093][27935] Starting process rollout_proc11 [2022-07-12 19:17:18,143][27935] Starting process rollout_proc12 [2022-07-12 19:17:18,193][27935] Starting process rollout_proc13 [2022-07-12 19:17:18,243][27935] Starting process rollout_proc14 [2022-07-12 19:17:18,293][27935] Starting process rollout_proc15 [2022-07-12 19:17:18,343][27935] Starting process rollout_proc16 [2022-07-12 19:17:18,393][27935] Starting process rollout_proc17 [2022-07-12 19:17:18,443][27935] Starting process rollout_proc18 [2022-07-12 19:17:18,493][27935] Starting process rollout_proc19 [2022-07-12 19:17:18,543][27935] Starting process rollout_proc20 [2022-07-12 19:17:18,593][27935] Starting process rollout_proc21 [2022-07-12 19:17:18,643][27935] Starting process rollout_proc22 [2022-07-12 19:17:18,693][27935] Starting process rollout_proc23 [2022-07-12 19:17:18,743][27935] Starting process rollout_proc24 [2022-07-12 19:17:18,793][27935] Starting process rollout_proc25 [2022-07-12 19:17:18,843][27935] Starting process rollout_proc26 [2022-07-12 19:17:18,893][27935] Starting process rollout_proc27 [2022-07-12 19:17:18,943][27935] Starting process rollout_proc28 [2022-07-12 19:17:18,989][27935] Starting process rollout_proc29 [2022-07-12 19:17:18,999][27935] Starting process rollout_proc30 [2022-07-12 19:17:19,045][27935] Starting process rollout_proc31 [2022-07-12 19:17:19,093][27935] Starting process rollout_proc32 [2022-07-12 19:17:19,143][27935] Starting process rollout_proc33 [2022-07-12 19:17:19,193][27935] Starting process rollout_proc34 [2022-07-12 19:17:19,243][27935] Starting process rollout_proc35 [2022-07-12 19:17:27,960][27935] Inference worker 0-0 is ready! [2022-07-12 19:17:27,960][27935] All inference workers are ready! Signal rollout workers to start! [2022-07-12 19:19:28,989][27935] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 3072. Throughput: 0: nan. Samples: 12516. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2022-07-12 19:19:33,991][27935] Fps is (10 sec: 2251.7, 60 sec: 2251.7, 300 sec: 2251.7). Total num frames: 14336. Throughput: 0: 6785.5. Samples: 46460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2022-07-12 19:19:38,989][27935] Fps is (10 sec: 3584.0, 60 sec: 3584.0, 300 sec: 3584.0). Total num frames: 38912. Throughput: 0: 6407.6. Samples: 76592. Policy #0 lag: (min: 0.0, avg: 6.1, max: 16.0) [2022-07-12 19:19:43,989][27935] Fps is (10 sec: 5018.8, 60 sec: 4096.0, 300 sec: 4096.0). Total num frames: 64512. Throughput: 0: 8401.9. Samples: 138544. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-12 19:19:43,989][27935] Avg episode reward: [(0, '-53.621')] [2022-07-12 19:19:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4249.6, 300 sec: 4249.6). Total num frames: 88064. Throughput: 0: 9311.0. Samples: 198736. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:19:48,989][27935] Avg episode reward: [(0, '-63.133')] [2022-07-12 19:19:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4505.6, 300 sec: 4505.6). Total num frames: 115712. Throughput: 0: 8649.5. Samples: 228752. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 19:19:53,989][27935] Avg episode reward: [(0, '-66.924')] [2022-07-12 19:19:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4539.7, 300 sec: 4539.7). Total num frames: 139264. Throughput: 0: 9206.6. Samples: 288712. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:19:58,989][27935] Avg episode reward: [(0, '-69.335')] [2022-07-12 19:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4593.4, 300 sec: 4593.4). Total num frames: 163840. Throughput: 0: 9487.9. Samples: 344592. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:20:03,989][27935] Avg episode reward: [(0, '-71.579')] [2022-07-12 19:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4582.4, 300 sec: 4582.4). Total num frames: 186368. Throughput: 0: 9039.8. Samples: 374108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:20:08,989][27935] Avg episode reward: [(0, '-76.336')] [2022-07-12 19:20:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4619.4, 300 sec: 4619.4). Total num frames: 210944. Throughput: 0: 9358.5. Samples: 433648. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 19:20:13,989][27935] Avg episode reward: [(0, '-78.663')] [2022-07-12 19:20:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4689.9, 300 sec: 4689.9). Total num frames: 237568. Throughput: 0: 9921.1. Samples: 492884. Policy #0 lag: (min: 1.0, avg: 10.8, max: 22.0) [2022-07-12 19:20:18,989][27935] Avg episode reward: [(0, '-80.359')] [2022-07-12 19:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4691.8, 300 sec: 4691.8). Total num frames: 261120. Throughput: 0: 9918.0. Samples: 522900. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:20:23,989][27935] Avg episode reward: [(0, '-81.867')] [2022-07-12 19:20:28,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4727.2, 300 sec: 4727.2). Total num frames: 286720. Throughput: 0: 9872.4. Samples: 582836. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 19:20:28,993][27935] Avg episode reward: [(0, '-83.093')] [2022-07-12 19:20:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.5, 300 sec: 4741.9). Total num frames: 311296. Throughput: 0: 9854.9. Samples: 642204. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 19:20:33,989][27935] Avg episode reward: [(0, '-86.107')] [2022-07-12 19:20:38,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4949.3, 300 sec: 4754.3). Total num frames: 335872. Throughput: 0: 9833.8. Samples: 671272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 19:20:38,989][27935] Avg episode reward: [(0, '-89.753')] [2022-07-12 19:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4765.0). Total num frames: 360448. Throughput: 0: 9809.2. Samples: 730124. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 19:20:43,989][27935] Avg episode reward: [(0, '-92.823')] [2022-07-12 19:20:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4787.2). Total num frames: 386048. Throughput: 0: 9889.1. Samples: 789604. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:20:48,989][27935] Avg episode reward: [(0, '-97.314')] [2022-07-12 19:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4782.7). Total num frames: 409600. Throughput: 0: 9908.4. Samples: 819988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 19:20:53,989][27935] Avg episode reward: [(0, '-101.677')] [2022-07-12 19:20:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4801.4). Total num frames: 435200. Throughput: 0: 9910.1. Samples: 879600. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:20:58,989][27935] Avg episode reward: [(0, '-102.139')] [2022-07-12 19:21:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4785.9). Total num frames: 457728. Throughput: 0: 9831.2. Samples: 935288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:21:03,989][27935] Avg episode reward: [(0, '-101.407')] [2022-07-12 19:21:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4802.6). Total num frames: 483328. Throughput: 0: 9825.4. Samples: 965044. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:21:08,989][27935] Avg episode reward: [(0, '-100.947')] [2022-07-12 19:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4807.9). Total num frames: 507904. Throughput: 0: 9831.7. Samples: 1025228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:21:13,989][27935] Avg episode reward: [(0, '-100.815')] [2022-07-12 19:21:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4812.8). Total num frames: 532480. Throughput: 0: 9827.4. Samples: 1084436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:21:18,989][27935] Avg episode reward: [(0, '-101.029')] [2022-07-12 19:21:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4817.3). Total num frames: 557056. Throughput: 0: 9850.2. Samples: 1114532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 19:21:23,989][27935] Avg episode reward: [(0, '-101.550')] [2022-07-12 19:21:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.5, 300 sec: 4821.3). Total num frames: 581632. Throughput: 0: 9877.3. Samples: 1174604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-12 19:21:28,990][27935] Avg episode reward: [(0, '-101.847')] [2022-07-12 19:21:33,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4932.3, 300 sec: 4833.3). Total num frames: 607232. Throughput: 0: 9864.4. Samples: 1233504. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 19:21:33,989][27935] Avg episode reward: [(0, '-102.123')] [2022-07-12 19:21:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4844.3). Total num frames: 632832. Throughput: 0: 9851.7. Samples: 1263316. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:21:38,989][27935] Avg episode reward: [(0, '-103.353')] [2022-07-12 19:21:43,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4932.3, 300 sec: 4839.4). Total num frames: 656384. Throughput: 0: 9858.7. Samples: 1323244. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:21:43,989][27935] Avg episode reward: [(0, '-103.242')] [2022-07-12 19:21:48,998][27935] Fps is (10 sec: 4910.5, 60 sec: 4931.5, 300 sec: 4849.0). Total num frames: 681984. Throughput: 0: 9941.3. Samples: 1382740. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-12 19:21:48,999][27935] Avg episode reward: [(0, '-103.474')] [2022-07-12 19:21:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4851.6). Total num frames: 706560. Throughput: 0: 9952.4. Samples: 1412900. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-12 19:21:53,989][27935] Avg episode reward: [(0, '-103.159')] [2022-07-12 19:21:58,989][27935] Fps is (10 sec: 4919.9, 60 sec: 4932.3, 300 sec: 4853.8). Total num frames: 731136. Throughput: 0: 9933.7. Samples: 1472244. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 19:21:58,989][27935] Avg episode reward: [(0, '-102.383')] [2022-07-12 19:22:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4915.2, 300 sec: 4835.9). Total num frames: 752640. Throughput: 0: 9821.2. Samples: 1526388. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:22:03,989][27935] Avg episode reward: [(0, '-102.752')] [2022-07-12 19:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4915.2, 300 sec: 4844.8). Total num frames: 778240. Throughput: 0: 9788.2. Samples: 1555000. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:22:08,989][27935] Avg episode reward: [(0, '-102.585')] [2022-07-12 19:22:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4840.7). Total num frames: 801792. Throughput: 0: 9778.8. Samples: 1614652. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:22:13,989][27935] Avg episode reward: [(0, '-102.249')] [2022-07-12 19:22:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4842.9). Total num frames: 826368. Throughput: 0: 9792.3. Samples: 1674156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:22:18,989][27935] Avg episode reward: [(0, '-101.655')] [2022-07-12 19:22:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4856.7). Total num frames: 852992. Throughput: 0: 9798.0. Samples: 1704228. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:22:23,989][27935] Avg episode reward: [(0, '-101.532')] [2022-07-12 19:22:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4858.3). Total num frames: 877568. Throughput: 0: 9798.8. Samples: 1764192. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 19:22:28,989][27935] Avg episode reward: [(0, '-101.959')] [2022-07-12 19:22:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4859.9). Total num frames: 902144. Throughput: 0: 9807.7. Samples: 1823992. Policy #0 lag: (min: 0.0, avg: 10.8, max: 23.0) [2022-07-12 19:22:33,989][27935] Avg episode reward: [(0, '-102.107')] [2022-07-12 19:22:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4866.7). Total num frames: 927744. Throughput: 0: 9798.6. Samples: 1853836. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 19:22:38,989][27935] Avg episode reward: [(0, '-102.188')] [2022-07-12 19:22:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4867.9). Total num frames: 952320. Throughput: 0: 9791.5. Samples: 1912860. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 19:22:43,990][27935] Avg episode reward: [(0, '-101.919')] [2022-07-12 19:22:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4916.0, 300 sec: 4869.1). Total num frames: 976896. Throughput: 0: 9915.5. Samples: 1972584. Policy #0 lag: (min: 0.0, avg: 11.2, max: 24.0) [2022-07-12 19:22:48,989][27935] Avg episode reward: [(0, '-102.243')] [2022-07-12 19:22:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4870.2). Total num frames: 1001472. Throughput: 0: 9953.2. Samples: 2002892. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 19:22:53,989][27935] Avg episode reward: [(0, '-102.167')] [2022-07-12 19:22:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4881.1). Total num frames: 1028096. Throughput: 0: 9965.7. Samples: 2063108. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 19:22:58,989][27935] Avg episode reward: [(0, '-101.790')] [2022-07-12 19:23:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4867.6). Total num frames: 1049600. Throughput: 0: 9893.5. Samples: 2119364. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:23:03,989][27935] Avg episode reward: [(0, '-101.642')] [2022-07-12 19:23:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4873.3). Total num frames: 1075200. Throughput: 0: 9889.0. Samples: 2149232. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:23:08,989][27935] Avg episode reward: [(0, '-101.024')] [2022-07-12 19:23:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4878.8). Total num frames: 1100800. Throughput: 0: 9897.2. Samples: 2209568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-12 19:23:13,989][27935] Avg episode reward: [(0, '-102.223')] [2022-07-12 19:23:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4879.6). Total num frames: 1125376. Throughput: 0: 9902.7. Samples: 2269616. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 19:23:18,989][27935] Avg episode reward: [(0, '-102.857')] [2022-07-12 19:23:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4880.3). Total num frames: 1149952. Throughput: 0: 9913.7. Samples: 2299952. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:23:23,989][27935] Avg episode reward: [(0, '-103.039')] [2022-07-12 19:23:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4885.3). Total num frames: 1175552. Throughput: 0: 9932.9. Samples: 2359840. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:23:28,989][27935] Avg episode reward: [(0, '-102.667')] [2022-07-12 19:23:33,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4966.4, 300 sec: 4885.9). Total num frames: 1200128. Throughput: 0: 9913.3. Samples: 2418684. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:23:33,990][27935] Avg episode reward: [(0, '-103.503')] [2022-07-12 19:23:38,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4949.3, 300 sec: 4886.5). Total num frames: 1224704. Throughput: 0: 9901.1. Samples: 2448444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:23:38,990][27935] Avg episode reward: [(0, '-102.690')] [2022-07-12 19:23:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4887.1). Total num frames: 1249280. Throughput: 0: 9896.8. Samples: 2508464. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 19:23:43,989][27935] Avg episode reward: [(0, '-101.685')] [2022-07-12 19:23:48,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4966.4, 300 sec: 4891.6). Total num frames: 1274880. Throughput: 0: 9970.9. Samples: 2568056. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 19:23:48,990][27935] Avg episode reward: [(0, '-102.020')] [2022-07-12 19:23:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4892.0). Total num frames: 1299456. Throughput: 0: 9981.5. Samples: 2598400. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 19:23:53,989][27935] Avg episode reward: [(0, '-101.636')] [2022-07-12 19:23:58,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4932.3, 300 sec: 4892.4). Total num frames: 1324032. Throughput: 0: 9982.5. Samples: 2658780. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:23:58,989][27935] Avg episode reward: [(0, '-102.012')] [2022-07-12 19:24:03,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4983.2, 300 sec: 4892.8). Total num frames: 1348608. Throughput: 0: 9910.0. Samples: 2715604. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:24:03,993][27935] Avg episode reward: [(0, '-102.035')] [2022-07-12 19:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4889.6). Total num frames: 1372160. Throughput: 0: 9905.4. Samples: 2745696. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:24:08,990][27935] Avg episode reward: [(0, '-101.146')] [2022-07-12 19:24:13,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4966.4, 300 sec: 4897.2). Total num frames: 1398784. Throughput: 0: 9900.0. Samples: 2805340. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:24:13,989][27935] Avg episode reward: [(0, '-101.705')] [2022-07-12 19:24:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4894.0). Total num frames: 1422336. Throughput: 0: 9916.8. Samples: 2864940. Policy #0 lag: (min: 0.0, avg: 7.1, max: 17.0) [2022-07-12 19:24:18,989][27935] Avg episode reward: [(0, '-102.522')] [2022-07-12 19:24:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4897.8). Total num frames: 1447936. Throughput: 0: 9916.7. Samples: 2894692. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:24:23,989][27935] Avg episode reward: [(0, '-102.592')] [2022-07-12 19:24:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4939.5). Total num frames: 1471488. Throughput: 0: 9903.7. Samples: 2954132. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:24:28,989][27935] Avg episode reward: [(0, '-101.701')] [2022-07-12 19:24:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 1498112. Throughput: 0: 9902.3. Samples: 3013660. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 19:24:33,989][27935] Avg episode reward: [(0, '-101.493')] [2022-07-12 19:24:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.4, 300 sec: 4939.5). Total num frames: 1521664. Throughput: 0: 9887.5. Samples: 3043336. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 19:24:38,989][27935] Avg episode reward: [(0, '-102.180')] [2022-07-12 19:24:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 1547264. Throughput: 0: 9886.7. Samples: 3103680. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 19:24:43,990][27935] Avg episode reward: [(0, '-102.611')] [2022-07-12 19:24:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4936.0). Total num frames: 1571840. Throughput: 0: 9957.3. Samples: 3163644. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 19:24:48,989][27935] Avg episode reward: [(0, '-101.562')] [2022-07-12 19:24:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4946.4). Total num frames: 1598464. Throughput: 0: 9955.7. Samples: 3193700. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-12 19:24:53,991][27935] Avg episode reward: [(0, '-101.586')] [2022-07-12 19:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4939.5). Total num frames: 1620992. Throughput: 0: 9954.4. Samples: 3253288. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:24:58,989][27935] Avg episode reward: [(0, '-101.343')] [2022-07-12 19:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.6, 300 sec: 4946.4). Total num frames: 1645568. Throughput: 0: 9879.6. Samples: 3309524. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:25:03,989][27935] Avg episode reward: [(0, '-101.254')] [2022-07-12 19:25:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 1670144. Throughput: 0: 9877.1. Samples: 3339160. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 19:25:08,990][27935] Avg episode reward: [(0, '-100.974')] [2022-07-12 19:25:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4936.0). Total num frames: 1693696. Throughput: 0: 9885.3. Samples: 3398972. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-12 19:25:13,990][27935] Avg episode reward: [(0, '-100.301')] [2022-07-12 19:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 1720320. Throughput: 0: 9884.9. Samples: 3458480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 19:25:18,989][27935] Avg episode reward: [(0, '-99.700')] [2022-07-12 19:25:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 1744896. Throughput: 0: 9888.6. Samples: 3488324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 19:25:23,990][27935] Avg episode reward: [(0, '-99.414')] [2022-07-12 19:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4943.0). Total num frames: 1769472. Throughput: 0: 9883.2. Samples: 3548424. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-12 19:25:28,989][27935] Avg episode reward: [(0, '-99.129')] [2022-07-12 19:25:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4943.0). Total num frames: 1794048. Throughput: 0: 9866.6. Samples: 3607640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:25:33,989][27935] Avg episode reward: [(0, '-99.657')] [2022-07-12 19:25:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 1818624. Throughput: 0: 9858.9. Samples: 3637352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:25:38,989][27935] Avg episode reward: [(0, '-100.001')] [2022-07-12 19:25:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 1844224. Throughput: 0: 9884.5. Samples: 3698092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-12 19:25:43,989][27935] Avg episode reward: [(0, '-99.958')] [2022-07-12 19:25:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4949.9). Total num frames: 1869824. Throughput: 0: 9974.3. Samples: 3758368. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-12 19:25:48,989][27935] Avg episode reward: [(0, '-100.092')] [2022-07-12 19:25:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 1893376. Throughput: 0: 9983.7. Samples: 3788428. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-12 19:25:53,991][27935] Avg episode reward: [(0, '-100.057')] [2022-07-12 19:25:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 1920000. Throughput: 0: 9995.4. Samples: 3848764. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 19:25:58,990][27935] Avg episode reward: [(0, '-100.245')] [2022-07-12 19:26:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 1942528. Throughput: 0: 9934.2. Samples: 3905520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:26:03,989][27935] Avg episode reward: [(0, '-100.398')] [2022-07-12 19:26:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4949.9). Total num frames: 1968128. Throughput: 0: 9935.9. Samples: 3935440. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:26:08,989][27935] Avg episode reward: [(0, '-99.488')] [2022-07-12 19:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 1991680. Throughput: 0: 9928.5. Samples: 3995208. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 19:26:13,990][27935] Avg episode reward: [(0, '-100.150')] [2022-07-12 19:26:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4953.4). Total num frames: 2018304. Throughput: 0: 9932.6. Samples: 4054608. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:26:18,989][27935] Avg episode reward: [(0, '-100.425')] [2022-07-12 19:26:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4953.4). Total num frames: 2042880. Throughput: 0: 9935.7. Samples: 4084460. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:26:23,996][27935] Avg episode reward: [(0, '-100.039')] [2022-07-12 19:26:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4949.9). Total num frames: 2067456. Throughput: 0: 9921.2. Samples: 4144548. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:26:28,989][27935] Avg episode reward: [(0, '-100.009')] [2022-07-12 19:26:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 2092032. Throughput: 0: 9903.2. Samples: 4204012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 19:26:33,990][27935] Avg episode reward: [(0, '-100.164')] [2022-07-12 19:26:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4953.4). Total num frames: 2117632. Throughput: 0: 9894.1. Samples: 4233664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 19:26:38,989][27935] Avg episode reward: [(0, '-100.008')] [2022-07-12 19:26:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4950.1). Total num frames: 2142208. Throughput: 0: 9889.8. Samples: 4293804. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:26:43,989][27935] Avg episode reward: [(0, '-100.532')] [2022-07-12 19:26:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 2168832. Throughput: 0: 9955.5. Samples: 4353516. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:26:48,989][27935] Avg episode reward: [(0, '-100.494')] [2022-07-12 19:26:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4949.9). Total num frames: 2191360. Throughput: 0: 9957.0. Samples: 4383504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:26:53,989][27935] Avg episode reward: [(0, '-98.854')] [2022-07-12 19:26:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4960.3). Total num frames: 2215936. Throughput: 0: 9943.8. Samples: 4442680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 19:26:58,989][27935] Avg episode reward: [(0, '-98.921')] [2022-07-12 19:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4953.4). Total num frames: 2239488. Throughput: 0: 9860.2. Samples: 4498316. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 19:27:03,989][27935] Avg episode reward: [(0, '-98.536')] [2022-07-12 19:27:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4960.3). Total num frames: 2265088. Throughput: 0: 9859.1. Samples: 4528120. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 19:27:08,989][27935] Avg episode reward: [(0, '-98.631')] [2022-07-12 19:27:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4960.3). Total num frames: 2289664. Throughput: 0: 9866.5. Samples: 4588540. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 19:27:13,989][27935] Avg episode reward: [(0, '-98.317')] [2022-07-12 19:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4956.9). Total num frames: 2315264. Throughput: 0: 9885.9. Samples: 4648876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 17.0) [2022-07-12 19:27:18,989][27935] Avg episode reward: [(0, '-99.014')] [2022-07-12 19:27:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4956.9). Total num frames: 2339840. Throughput: 0: 9905.1. Samples: 4679396. Policy #0 lag: (min: 0.0, avg: 8.5, max: 17.0) [2022-07-12 19:27:23,989][27935] Avg episode reward: [(0, '-98.924')] [2022-07-12 19:27:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4960.3). Total num frames: 2365440. Throughput: 0: 9916.3. Samples: 4740036. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:27:28,989][27935] Avg episode reward: [(0, '-99.227')] [2022-07-12 19:27:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4956.9). Total num frames: 2390016. Throughput: 0: 9922.7. Samples: 4800040. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:27:33,989][27935] Avg episode reward: [(0, '-98.669')] [2022-07-12 19:27:38,999][27935] Fps is (10 sec: 5115.0, 60 sec: 4982.7, 300 sec: 4963.6). Total num frames: 2416640. Throughput: 0: 9923.8. Samples: 4830172. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:27:38,999][27935] Avg episode reward: [(0, '-98.601')] [2022-07-12 19:27:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4960.3). Total num frames: 2440192. Throughput: 0: 9923.6. Samples: 4889240. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 19:27:43,989][27935] Avg episode reward: [(0, '-97.714')] [2022-07-12 19:27:48,989][27935] Fps is (10 sec: 4920.0, 60 sec: 4949.3, 300 sec: 4963.8). Total num frames: 2465792. Throughput: 0: 10024.9. Samples: 4949436. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:27:48,989][27935] Avg episode reward: [(0, '-98.151')] [2022-07-12 19:27:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 2490368. Throughput: 0: 10034.3. Samples: 4979664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:27:53,989][27935] Avg episode reward: [(0, '-98.659')] [2022-07-12 19:27:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4967.3). Total num frames: 2514944. Throughput: 0: 10020.7. Samples: 5039472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:27:58,989][27935] Avg episode reward: [(0, '-98.466')] [2022-07-12 19:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 4956.9). Total num frames: 2537472. Throughput: 0: 9944.7. Samples: 5096388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:28:03,989][27935] Avg episode reward: [(0, '-99.042')] [2022-07-12 19:28:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4956.9). Total num frames: 2563072. Throughput: 0: 9905.4. Samples: 5125140. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-12 19:28:08,989][27935] Avg episode reward: [(0, '-98.746')] [2022-07-12 19:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4953.4). Total num frames: 2586624. Throughput: 0: 9867.2. Samples: 5184060. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-12 19:28:13,989][27935] Avg episode reward: [(0, '-99.124')] [2022-07-12 19:28:18,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4949.0, 300 sec: 4956.8). Total num frames: 2612224. Throughput: 0: 9866.2. Samples: 5244052. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-12 19:28:18,993][27935] Avg episode reward: [(0, '-99.985')] [2022-07-12 19:28:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4956.9). Total num frames: 2637824. Throughput: 0: 9871.8. Samples: 5274308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 19:28:23,989][27935] Avg episode reward: [(0, '-99.840')] [2022-07-12 19:28:28,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4949.3, 300 sec: 4956.9). Total num frames: 2662400. Throughput: 0: 9894.1. Samples: 5334476. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 19:28:28,989][27935] Avg episode reward: [(0, '-99.607')] [2022-07-12 19:28:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4953.4). Total num frames: 2685952. Throughput: 0: 9867.1. Samples: 5393456. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 19:28:33,989][27935] Avg episode reward: [(0, '-99.299')] [2022-07-12 19:28:38,998][27935] Fps is (10 sec: 4910.5, 60 sec: 4915.2, 300 sec: 4956.7). Total num frames: 2711552. Throughput: 0: 9844.7. Samples: 5422768. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 19:28:38,999][27935] Avg episode reward: [(0, '-98.958')] [2022-07-12 19:28:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4953.4). Total num frames: 2736128. Throughput: 0: 9822.6. Samples: 5481488. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 19:28:43,989][27935] Avg episode reward: [(0, '-98.315')] [2022-07-12 19:28:48,989][27935] Fps is (10 sec: 5022.4, 60 sec: 4932.3, 300 sec: 4956.9). Total num frames: 2761728. Throughput: 0: 9873.8. Samples: 5540708. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-12 19:28:48,989][27935] Avg episode reward: [(0, '-98.589')] [2022-07-12 19:28:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4956.9). Total num frames: 2786304. Throughput: 0: 9899.9. Samples: 5570636. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-12 19:28:53,989][27935] Avg episode reward: [(0, '-98.359')] [2022-07-12 19:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4953.4). Total num frames: 2809856. Throughput: 0: 9906.0. Samples: 5629832. Policy #0 lag: (min: 0.0, avg: 7.6, max: 21.0) [2022-07-12 19:28:58,989][27935] Avg episode reward: [(0, '-98.616')] [2022-07-12 19:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4953.4). Total num frames: 2833408. Throughput: 0: 9824.2. Samples: 5686104. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-12 19:29:03,989][27935] Avg episode reward: [(0, '-99.267')] [2022-07-12 19:29:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4949.9). Total num frames: 2859008. Throughput: 0: 9813.6. Samples: 5715920. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-12 19:29:08,989][27935] Avg episode reward: [(0, '-100.102')] [2022-07-12 19:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4949.9). Total num frames: 2882560. Throughput: 0: 9795.9. Samples: 5775292. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-12 19:29:13,989][27935] Avg episode reward: [(0, '-100.401')] [2022-07-12 19:29:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.4, 300 sec: 4943.0). Total num frames: 2906112. Throughput: 0: 9789.5. Samples: 5833984. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-12 19:29:18,989][27935] Avg episode reward: [(0, '-100.463')] [2022-07-12 19:29:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4946.4). Total num frames: 2930688. Throughput: 0: 9801.6. Samples: 5863748. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 19:29:23,989][27935] Avg episode reward: [(0, '-100.781')] [2022-07-12 19:29:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4946.4). Total num frames: 2957312. Throughput: 0: 9821.3. Samples: 5923448. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:29:28,990][27935] Avg episode reward: [(0, '-101.091')] [2022-07-12 19:29:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4949.9). Total num frames: 2981888. Throughput: 0: 9829.1. Samples: 5983016. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:29:33,989][27935] Avg episode reward: [(0, '-100.920')] [2022-07-12 19:29:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4916.0, 300 sec: 4946.4). Total num frames: 3006464. Throughput: 0: 9823.0. Samples: 6012672. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:29:38,990][27935] Avg episode reward: [(0, '-100.855')] [2022-07-12 19:29:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4946.4). Total num frames: 3031040. Throughput: 0: 9829.8. Samples: 6072172. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:29:43,989][27935] Avg episode reward: [(0, '-100.860')] [2022-07-12 19:29:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 3056640. Throughput: 0: 9905.0. Samples: 6131828. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-12 19:29:48,989][27935] Avg episode reward: [(0, '-100.437')] [2022-07-12 19:29:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4949.9). Total num frames: 3081216. Throughput: 0: 9912.9. Samples: 6162000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:29:53,989][27935] Avg episode reward: [(0, '-98.898')] [2022-07-12 19:29:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4953.4). Total num frames: 3106816. Throughput: 0: 9921.6. Samples: 6221764. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:29:58,989][27935] Avg episode reward: [(0, '-99.393')] [2022-07-12 19:30:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 3128320. Throughput: 0: 9878.1. Samples: 6278500. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 19:30:03,989][27935] Avg episode reward: [(0, '-99.598')] [2022-07-12 19:30:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4915.2, 300 sec: 4949.9). Total num frames: 3153920. Throughput: 0: 9873.8. Samples: 6308068. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 19:30:08,996][27935] Avg episode reward: [(0, '-99.562')] [2022-07-12 19:30:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 3179520. Throughput: 0: 9874.0. Samples: 6367780. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:30:13,989][27935] Avg episode reward: [(0, '-99.359')] [2022-07-12 19:30:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 3204096. Throughput: 0: 9882.2. Samples: 6427716. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:30:18,989][27935] Avg episode reward: [(0, '-99.677')] [2022-07-12 19:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 3228672. Throughput: 0: 9892.1. Samples: 6457816. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-12 19:30:23,989][27935] Avg episode reward: [(0, '-100.379')] [2022-07-12 19:30:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4949.9). Total num frames: 3254272. Throughput: 0: 9893.8. Samples: 6517392. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:30:28,991][27935] Avg episode reward: [(0, '-100.774')] [2022-07-12 19:30:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4946.4). Total num frames: 3277824. Throughput: 0: 9875.5. Samples: 6576224. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:30:33,989][27935] Avg episode reward: [(0, '-101.050')] [2022-07-12 19:30:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4943.0). Total num frames: 3302400. Throughput: 0: 9857.4. Samples: 6605584. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-12 19:30:38,990][27935] Avg episode reward: [(0, '-100.761')] [2022-07-12 19:30:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 3328000. Throughput: 0: 9855.8. Samples: 6665276. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-12 19:30:43,989][27935] Avg episode reward: [(0, '-100.371')] [2022-07-12 19:30:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4949.9). Total num frames: 3353600. Throughput: 0: 9926.8. Samples: 6725208. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 19:30:48,992][27935] Avg episode reward: [(0, '-100.655')] [2022-07-12 19:30:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 3378176. Throughput: 0: 9945.9. Samples: 6755632. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 19:30:53,989][27935] Avg episode reward: [(0, '-100.648')] [2022-07-12 19:30:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4949.9). Total num frames: 3402752. Throughput: 0: 9954.8. Samples: 6815744. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:30:58,990][27935] Avg episode reward: [(0, '-100.507')] [2022-07-12 19:31:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4946.4). Total num frames: 3427328. Throughput: 0: 9879.4. Samples: 6872288. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:31:03,991][27935] Avg episode reward: [(0, '-99.910')] [2022-07-12 19:31:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 3450880. Throughput: 0: 9881.2. Samples: 6902472. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 19:31:08,991][27935] Avg episode reward: [(0, '-99.970')] [2022-07-12 19:31:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4939.5). Total num frames: 3475456. Throughput: 0: 9855.2. Samples: 6960876. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:31:13,989][27935] Avg episode reward: [(0, '-98.848')] [2022-07-12 19:31:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 3501056. Throughput: 0: 9863.1. Samples: 7020064. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:31:18,991][27935] Avg episode reward: [(0, '-98.398')] [2022-07-12 19:31:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4946.4). Total num frames: 3526656. Throughput: 0: 9882.5. Samples: 7050296. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:31:23,989][27935] Avg episode reward: [(0, '-97.980')] [2022-07-12 19:31:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 3551232. Throughput: 0: 9889.0. Samples: 7110280. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:31:28,989][27935] Avg episode reward: [(0, '-97.626')] [2022-07-12 19:31:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4943.0). Total num frames: 3575808. Throughput: 0: 9883.5. Samples: 7169964. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:31:33,989][27935] Avg episode reward: [(0, '-97.676')] [2022-07-12 19:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4943.0). Total num frames: 3600384. Throughput: 0: 9868.1. Samples: 7199696. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:31:38,989][27935] Avg episode reward: [(0, '-97.345')] [2022-07-12 19:31:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4936.0). Total num frames: 3624960. Throughput: 0: 9866.3. Samples: 7259728. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:31:43,989][27935] Avg episode reward: [(0, '-97.051')] [2022-07-12 19:31:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 3650560. Throughput: 0: 9944.4. Samples: 7319788. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:31:48,989][27935] Avg episode reward: [(0, '-97.640')] [2022-07-12 19:31:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4943.0). Total num frames: 3674112. Throughput: 0: 9933.5. Samples: 7349480. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 19:31:53,989][27935] Avg episode reward: [(0, '-97.252')] [2022-07-12 19:31:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4946.4). Total num frames: 3698688. Throughput: 0: 9958.9. Samples: 7409028. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 19:31:58,989][27935] Avg episode reward: [(0, '-97.411')] [2022-07-12 19:32:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4943.0). Total num frames: 3723264. Throughput: 0: 9877.4. Samples: 7464548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-12 19:32:03,989][27935] Avg episode reward: [(0, '-97.473')] [2022-07-12 19:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4939.5). Total num frames: 3746816. Throughput: 0: 9858.5. Samples: 7493928. Policy #0 lag: (min: 0.0, avg: 11.4, max: 27.0) [2022-07-12 19:32:08,989][27935] Avg episode reward: [(0, '-97.117')] [2022-07-12 19:32:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4936.0). Total num frames: 3771392. Throughput: 0: 9848.6. Samples: 7553468. Policy #0 lag: (min: 0.0, avg: 11.4, max: 27.0) [2022-07-12 19:32:13,989][27935] Avg episode reward: [(0, '-96.189')] [2022-07-12 19:32:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4939.5). Total num frames: 3796992. Throughput: 0: 9853.6. Samples: 7613376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:32:18,989][27935] Avg episode reward: [(0, '-96.321')] [2022-07-12 19:32:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4939.5). Total num frames: 3822592. Throughput: 0: 9869.7. Samples: 7643832. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:32:23,989][27935] Avg episode reward: [(0, '-96.606')] [2022-07-12 19:32:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4943.0). Total num frames: 3848192. Throughput: 0: 9892.6. Samples: 7704896. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:32:28,990][27935] Avg episode reward: [(0, '-96.773')] [2022-07-12 19:32:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4936.2). Total num frames: 3872768. Throughput: 0: 9873.4. Samples: 7764092. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:32:33,989][27935] Avg episode reward: [(0, '-96.893')] [2022-07-12 19:32:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4939.5). Total num frames: 3897344. Throughput: 0: 9871.9. Samples: 7793716. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:32:38,989][27935] Avg episode reward: [(0, '-97.156')] [2022-07-12 19:32:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4936.0). Total num frames: 3921920. Throughput: 0: 9880.5. Samples: 7853652. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:32:43,989][27935] Avg episode reward: [(0, '-97.703')] [2022-07-12 19:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4932.6). Total num frames: 3945472. Throughput: 0: 9308.8. Samples: 7883444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:32:48,989][27935] Avg episode reward: [(0, '-97.709')] [2022-07-12 19:32:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4943.0). Total num frames: 3973120. Throughput: 0: 9996.0. Samples: 7943748. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:32:53,989][27935] Avg episode reward: [(0, '-96.719')] [2022-07-12 19:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4983.5, 300 sec: 4949.9). Total num frames: 3997696. Throughput: 0: 10004.3. Samples: 8003660. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 19:32:58,989][27935] Avg episode reward: [(0, '-96.091')] [2022-07-12 19:33:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4939.5). Total num frames: 4020224. Throughput: 0: 9922.5. Samples: 8059888. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 19:33:03,989][27935] Avg episode reward: [(0, '-96.240')] [2022-07-12 19:33:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4946.4). Total num frames: 4045824. Throughput: 0: 9915.1. Samples: 8090012. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:33:08,990][27935] Avg episode reward: [(0, '-96.102')] [2022-07-12 19:33:13,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4966.1, 300 sec: 4939.5). Total num frames: 4069376. Throughput: 0: 9898.1. Samples: 8150344. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:33:13,993][27935] Avg episode reward: [(0, '-95.764')] [2022-07-12 19:33:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4943.0). Total num frames: 4096000. Throughput: 0: 9913.7. Samples: 8210208. Policy #0 lag: (min: 0.0, avg: 9.4, max: 18.0) [2022-07-12 19:33:18,989][27935] Avg episode reward: [(0, '-95.869')] [2022-07-12 19:33:23,989][27935] Fps is (10 sec: 5224.3, 60 sec: 4983.5, 300 sec: 4946.4). Total num frames: 4121600. Throughput: 0: 9936.2. Samples: 8240844. Policy #0 lag: (min: 0.0, avg: 9.4, max: 18.0) [2022-07-12 19:33:23,989][27935] Avg episode reward: [(0, '-96.166')] [2022-07-12 19:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 4145152. Throughput: 0: 9933.4. Samples: 8300656. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 19:33:28,989][27935] Avg episode reward: [(0, '-96.608')] [2022-07-12 19:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4946.6). Total num frames: 4170752. Throughput: 0: 10598.9. Samples: 8360396. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 19:33:33,989][27935] Avg episode reward: [(0, '-95.710')] [2022-07-12 19:33:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4949.9). Total num frames: 4196352. Throughput: 0: 9923.7. Samples: 8390312. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 19:33:38,989][27935] Avg episode reward: [(0, '-95.756')] [2022-07-12 19:33:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4943.0). Total num frames: 4219904. Throughput: 0: 9925.8. Samples: 8450320. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 19:33:43,989][27935] Avg episode reward: [(0, '-96.097')] [2022-07-12 19:33:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4946.4). Total num frames: 4245504. Throughput: 0: 9993.6. Samples: 8509600. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:33:48,989][27935] Avg episode reward: [(0, '-96.379')] [2022-07-12 19:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4946.4). Total num frames: 4269056. Throughput: 0: 9983.2. Samples: 8539256. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:33:53,990][27935] Avg episode reward: [(0, '-96.774')] [2022-07-12 19:33:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4956.9). Total num frames: 4295680. Throughput: 0: 9961.5. Samples: 8598576. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 19:33:58,989][27935] Avg episode reward: [(0, '-97.311')] [2022-07-12 19:34:03,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4966.1, 300 sec: 4946.4). Total num frames: 4318208. Throughput: 0: 9857.3. Samples: 8653820. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 19:34:03,993][27935] Avg episode reward: [(0, '-97.222')] [2022-07-12 19:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4932.3, 300 sec: 4946.4). Total num frames: 4341760. Throughput: 0: 9835.5. Samples: 8683440. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-12 19:34:08,989][27935] Avg episode reward: [(0, '-97.638')] [2022-07-12 19:34:13,989][27935] Fps is (10 sec: 4712.0, 60 sec: 4932.6, 300 sec: 4946.4). Total num frames: 4365312. Throughput: 0: 9789.8. Samples: 8741196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-12 19:34:13,989][27935] Avg episode reward: [(0, '-97.913')] [2022-07-12 19:34:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4946.4). Total num frames: 4389888. Throughput: 0: 9779.8. Samples: 8800488. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:34:18,989][27935] Avg episode reward: [(0, '-97.124')] [2022-07-12 19:34:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4943.0). Total num frames: 4415488. Throughput: 0: 9779.5. Samples: 8830388. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:34:23,989][27935] Avg episode reward: [(0, '-96.479')] [2022-07-12 19:34:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4946.4). Total num frames: 4441088. Throughput: 0: 9771.1. Samples: 8890020. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:34:28,990][27935] Avg episode reward: [(0, '-96.089')] [2022-07-12 19:34:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4946.4). Total num frames: 4465664. Throughput: 0: 9797.8. Samples: 8950500. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:34:33,995][27935] Avg episode reward: [(0, '-95.734')] [2022-07-12 19:34:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4946.4). Total num frames: 4490240. Throughput: 0: 9811.4. Samples: 8980768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 19:34:38,989][27935] Avg episode reward: [(0, '-96.088')] [2022-07-12 19:34:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4943.0). Total num frames: 4514816. Throughput: 0: 9837.4. Samples: 9041260. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 19:34:43,989][27935] Avg episode reward: [(0, '-96.267')] [2022-07-12 19:34:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4946.4). Total num frames: 4540416. Throughput: 0: 9949.7. Samples: 9101520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 19:34:48,989][27935] Avg episode reward: [(0, '-96.557')] [2022-07-12 19:34:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4946.4). Total num frames: 4566016. Throughput: 0: 9954.8. Samples: 9131408. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 19:34:53,989][27935] Avg episode reward: [(0, '-97.004')] [2022-07-12 19:34:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4960.3). Total num frames: 4591616. Throughput: 0: 10015.3. Samples: 9191884. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:34:58,989][27935] Avg episode reward: [(0, '-97.367')] [2022-07-12 19:35:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.6, 300 sec: 4949.9). Total num frames: 4614144. Throughput: 0: 9966.5. Samples: 9248980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:35:03,989][27935] Avg episode reward: [(0, '-98.680')] [2022-07-12 19:35:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4949.9). Total num frames: 4639744. Throughput: 0: 9965.8. Samples: 9278848. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 19:35:08,989][27935] Avg episode reward: [(0, '-98.421')] [2022-07-12 19:35:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4949.9). Total num frames: 4664320. Throughput: 0: 9977.5. Samples: 9339008. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 19:35:13,989][27935] Avg episode reward: [(0, '-98.435')] [2022-07-12 19:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4953.4). Total num frames: 4689920. Throughput: 0: 9975.0. Samples: 9399376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 19:35:18,989][27935] Avg episode reward: [(0, '-97.958')] [2022-07-12 19:35:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4949.9). Total num frames: 4714496. Throughput: 0: 9981.2. Samples: 9429920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 19:35:23,989][27935] Avg episode reward: [(0, '-97.454')] [2022-07-12 19:35:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 4740096. Throughput: 0: 9975.1. Samples: 9490140. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 19:35:28,989][27935] Avg episode reward: [(0, '-96.899')] [2022-07-12 19:35:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 4764672. Throughput: 0: 9959.7. Samples: 9549704. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 19:35:33,989][27935] Avg episode reward: [(0, '-95.754')] [2022-07-12 19:35:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4960.3). Total num frames: 4791296. Throughput: 0: 9963.9. Samples: 9579784. Policy #0 lag: (min: 0.0, avg: 7.2, max: 18.0) [2022-07-12 19:35:38,989][27935] Avg episode reward: [(0, '-95.681')] [2022-07-12 19:35:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4953.4). Total num frames: 4814848. Throughput: 0: 9963.7. Samples: 9640252. Policy #0 lag: (min: 0.0, avg: 7.2, max: 18.0) [2022-07-12 19:35:43,990][27935] Avg episode reward: [(0, '-95.360')] [2022-07-12 19:35:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4953.4). Total num frames: 4839424. Throughput: 0: 10029.5. Samples: 9700308. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:35:48,989][27935] Avg episode reward: [(0, '-94.200')] [2022-07-12 19:35:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 4865024. Throughput: 0: 10032.6. Samples: 9730316. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 19:35:53,990][27935] Avg episode reward: [(0, '-94.228')] [2022-07-12 19:35:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4960.3). Total num frames: 4890624. Throughput: 0: 10029.7. Samples: 9790344. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:35:58,989][27935] Avg episode reward: [(0, '-94.295')] [2022-07-12 19:36:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 4953.4). Total num frames: 4912128. Throughput: 0: 9944.1. Samples: 9846860. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:36:03,991][27935] Avg episode reward: [(0, '-93.474')] [2022-07-12 19:36:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4963.8). Total num frames: 4939776. Throughput: 0: 9931.7. Samples: 9876844. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:36:08,989][27935] Avg episode reward: [(0, '-93.474')] [2022-07-12 19:36:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4960.3). Total num frames: 4964352. Throughput: 0: 9940.0. Samples: 9937440. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 19:36:13,989][27935] Avg episode reward: [(0, '-93.258')] [2022-07-12 19:36:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4960.3). Total num frames: 4989952. Throughput: 0: 9948.4. Samples: 9997384. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 19:36:18,991][27935] Avg episode reward: [(0, '-93.900')] [2022-07-12 19:36:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4960.3). Total num frames: 5014528. Throughput: 0: 9951.1. Samples: 10027584. Policy #0 lag: (min: 1.0, avg: 9.4, max: 20.0) [2022-07-12 19:36:23,989][27935] Avg episode reward: [(0, '-93.465')] [2022-07-12 19:36:28,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5000.5, 300 sec: 4963.8). Total num frames: 5040128. Throughput: 0: 9957.7. Samples: 10088352. Policy #0 lag: (min: 1.0, avg: 9.4, max: 20.0) [2022-07-12 19:36:28,990][27935] Avg episode reward: [(0, '-92.930')] [2022-07-12 19:36:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4960.3). Total num frames: 5063680. Throughput: 0: 9952.8. Samples: 10148184. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:36:33,989][27935] Avg episode reward: [(0, '-93.323')] [2022-07-12 19:36:38,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4949.3, 300 sec: 4960.3). Total num frames: 5088256. Throughput: 0: 9952.4. Samples: 10178172. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:36:38,989][27935] Avg episode reward: [(0, '-92.867')] [2022-07-12 19:36:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4963.8). Total num frames: 5114880. Throughput: 0: 9963.9. Samples: 10238720. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-12 19:36:43,989][27935] Avg episode reward: [(0, '-93.136')] [2022-07-12 19:36:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4967.3). Total num frames: 5139456. Throughput: 0: 10046.4. Samples: 10298948. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-12 19:36:48,989][27935] Avg episode reward: [(0, '-92.630')] [2022-07-12 19:36:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4977.7). Total num frames: 5167104. Throughput: 0: 10054.4. Samples: 10329292. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:36:53,990][27935] Avg episode reward: [(0, '-92.967')] [2022-07-12 19:36:58,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5000.2, 300 sec: 4974.2). Total num frames: 5190656. Throughput: 0: 10049.0. Samples: 10389680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:36:59,002][27935] Avg episode reward: [(0, '-93.341')] [2022-07-12 19:37:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 5000.5, 300 sec: 4967.3). Total num frames: 5212160. Throughput: 0: 9396.2. Samples: 10420212. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 19:37:03,989][27935] Avg episode reward: [(0, '-93.015')] [2022-07-12 19:37:08,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4983.5, 300 sec: 4974.2). Total num frames: 5238784. Throughput: 0: 9982.8. Samples: 10476812. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 19:37:08,989][27935] Avg episode reward: [(0, '-92.577')] [2022-07-12 19:37:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4970.7). Total num frames: 5263360. Throughput: 0: 9966.8. Samples: 10536856. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 19:37:13,989][27935] Avg episode reward: [(0, '-92.511')] [2022-07-12 19:37:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4970.7). Total num frames: 5288960. Throughput: 0: 9950.2. Samples: 10595944. Policy #0 lag: (min: 1.0, avg: 9.4, max: 20.0) [2022-07-12 19:37:18,989][27935] Avg episode reward: [(0, '-91.749')] [2022-07-12 19:37:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4963.8). Total num frames: 5312512. Throughput: 0: 9958.7. Samples: 10626316. Policy #0 lag: (min: 1.0, avg: 9.4, max: 20.0) [2022-07-12 19:37:23,989][27935] Avg episode reward: [(0, '-91.974')] [2022-07-12 19:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4967.3). Total num frames: 5338112. Throughput: 0: 9954.0. Samples: 10686652. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:37:28,990][27935] Avg episode reward: [(0, '-92.253')] [2022-07-12 19:37:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4970.7). Total num frames: 5363712. Throughput: 0: 9937.7. Samples: 10746144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:37:33,989][27935] Avg episode reward: [(0, '-92.798')] [2022-07-12 19:37:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4970.7). Total num frames: 5388288. Throughput: 0: 9924.3. Samples: 10775888. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 19:37:38,989][27935] Avg episode reward: [(0, '-92.715')] [2022-07-12 19:37:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4977.7). Total num frames: 5413888. Throughput: 0: 9898.3. Samples: 10835068. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 19:37:43,989][27935] Avg episode reward: [(0, '-92.597')] [2022-07-12 19:37:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4960.3). Total num frames: 5436416. Throughput: 0: 10551.4. Samples: 10895024. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 19:37:48,989][27935] Avg episode reward: [(0, '-93.434')] [2022-07-12 19:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4967.3). Total num frames: 5463040. Throughput: 0: 9967.2. Samples: 10925336. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 19:37:53,989][27935] Avg episode reward: [(0, '-93.778')] [2022-07-12 19:37:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.7, 300 sec: 4977.7). Total num frames: 5488640. Throughput: 0: 9980.6. Samples: 10985984. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 19:37:58,989][27935] Avg episode reward: [(0, '-93.838')] [2022-07-12 19:38:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4967.3). Total num frames: 5511168. Throughput: 0: 9928.1. Samples: 11042708. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-12 19:38:03,989][27935] Avg episode reward: [(0, '-94.120')] [2022-07-12 19:38:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4974.3). Total num frames: 5536768. Throughput: 0: 9932.6. Samples: 11073284. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-12 19:38:08,989][27935] Avg episode reward: [(0, '-93.866')] [2022-07-12 19:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4967.3). Total num frames: 5561344. Throughput: 0: 9927.4. Samples: 11133384. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:38:13,990][27935] Avg episode reward: [(0, '-94.110')] [2022-07-12 19:38:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4974.2). Total num frames: 5588992. Throughput: 0: 9942.8. Samples: 11193572. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:38:18,989][27935] Avg episode reward: [(0, '-94.342')] [2022-07-12 19:38:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4974.2). Total num frames: 5612544. Throughput: 0: 9961.4. Samples: 11224152. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 19:38:23,989][27935] Avg episode reward: [(0, '-94.050')] [2022-07-12 19:38:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4970.7). Total num frames: 5637120. Throughput: 0: 9994.5. Samples: 11284820. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 19:38:28,989][27935] Avg episode reward: [(0, '-94.184')] [2022-07-12 19:38:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4970.7). Total num frames: 5662720. Throughput: 0: 10000.3. Samples: 11345036. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-12 19:38:33,989][27935] Avg episode reward: [(0, '-93.840')] [2022-07-12 19:38:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4974.2). Total num frames: 5687296. Throughput: 0: 9990.8. Samples: 11374920. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-12 19:38:38,989][27935] Avg episode reward: [(0, '-95.258')] [2022-07-12 19:38:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4977.7). Total num frames: 5713920. Throughput: 0: 9993.2. Samples: 11435680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-12 19:38:43,989][27935] Avg episode reward: [(0, '-95.868')] [2022-07-12 19:38:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4977.7). Total num frames: 5737472. Throughput: 0: 10080.1. Samples: 11496312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:38:48,989][27935] Avg episode reward: [(0, '-95.832')] [2022-07-12 19:38:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4974.2). Total num frames: 5763072. Throughput: 0: 10051.3. Samples: 11525592. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:38:53,989][27935] Avg episode reward: [(0, '-96.364')] [2022-07-12 19:38:58,990][27935] Fps is (10 sec: 5017.0, 60 sec: 4983.4, 300 sec: 4981.2). Total num frames: 5787648. Throughput: 0: 10048.1. Samples: 11585560. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 19:38:58,990][27935] Avg episode reward: [(0, '-96.454')] [2022-07-12 19:39:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 5811200. Throughput: 0: 9950.7. Samples: 11641352. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 19:39:03,989][27935] Avg episode reward: [(0, '-96.222')] [2022-07-12 19:39:08,989][27935] Fps is (10 sec: 4915.8, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 5836800. Throughput: 0: 9937.1. Samples: 11671324. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 19:39:08,989][27935] Avg episode reward: [(0, '-95.440')] [2022-07-12 19:39:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 5861376. Throughput: 0: 9920.9. Samples: 11731260. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 19:39:13,989][27935] Avg episode reward: [(0, '-94.512')] [2022-07-12 19:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4981.2). Total num frames: 5884928. Throughput: 0: 9917.1. Samples: 11791304. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 19:39:18,989][27935] Avg episode reward: [(0, '-95.694')] [2022-07-12 19:39:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 5911552. Throughput: 0: 9931.1. Samples: 11821820. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-12 19:39:23,989][27935] Avg episode reward: [(0, '-95.384')] [2022-07-12 19:39:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 5936128. Throughput: 0: 9921.2. Samples: 11882136. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-12 19:39:28,989][27935] Avg episode reward: [(0, '-95.550')] [2022-07-12 19:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 5960704. Throughput: 0: 9912.6. Samples: 11942380. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:39:33,989][27935] Avg episode reward: [(0, '-95.650')] [2022-07-12 19:39:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4988.1). Total num frames: 5986304. Throughput: 0: 9928.2. Samples: 11972360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:39:38,989][27935] Avg episode reward: [(0, '-96.380')] [2022-07-12 19:39:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4984.6). Total num frames: 6010880. Throughput: 0: 9933.9. Samples: 12032576. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:39:43,989][27935] Avg episode reward: [(0, '-96.719')] [2022-07-12 19:39:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 6037504. Throughput: 0: 10023.2. Samples: 12092396. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 19:39:48,989][27935] Avg episode reward: [(0, '-96.824')] [2022-07-12 19:39:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 6061056. Throughput: 0: 10040.4. Samples: 12123140. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 19:39:53,989][27935] Avg episode reward: [(0, '-97.060')] [2022-07-12 19:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.6, 300 sec: 4991.6). Total num frames: 6086656. Throughput: 0: 10036.7. Samples: 12182912. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:39:58,989][27935] Avg episode reward: [(0, '-97.499')] [2022-07-12 19:40:03,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 6110208. Throughput: 0: 9967.7. Samples: 12239848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:40:03,989][27935] Avg episode reward: [(0, '-97.355')] [2022-07-12 19:40:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4988.1). Total num frames: 6135808. Throughput: 0: 9961.8. Samples: 12270100. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:40:08,989][27935] Avg episode reward: [(0, '-97.777')] [2022-07-12 19:40:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 6160384. Throughput: 0: 9959.1. Samples: 12330296. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:40:13,989][27935] Avg episode reward: [(0, '-97.270')] [2022-07-12 19:40:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 6183936. Throughput: 0: 9886.2. Samples: 12387260. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:40:18,989][27935] Avg episode reward: [(0, '-97.014')] [2022-07-12 19:40:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4977.7). Total num frames: 6208512. Throughput: 0: 9887.3. Samples: 12417288. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 19:40:23,989][27935] Avg episode reward: [(0, '-96.547')] [2022-07-12 19:40:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 6234112. Throughput: 0: 9889.4. Samples: 12477600. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 19:40:28,989][27935] Avg episode reward: [(0, '-96.705')] [2022-07-12 19:40:33,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4966.4, 300 sec: 4974.2). Total num frames: 6258688. Throughput: 0: 9894.7. Samples: 12537656. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:40:33,989][27935] Avg episode reward: [(0, '-96.037')] [2022-07-12 19:40:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 6285312. Throughput: 0: 9876.5. Samples: 12567584. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:40:38,989][27935] Avg episode reward: [(0, '-95.879')] [2022-07-12 19:40:43,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 6308864. Throughput: 0: 9877.6. Samples: 12627404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:40:43,989][27935] Avg episode reward: [(0, '-96.817')] [2022-07-12 19:40:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 6335488. Throughput: 0: 9952.7. Samples: 12687720. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 19:40:48,989][27935] Avg episode reward: [(0, '-96.951')] [2022-07-12 19:40:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 6360064. Throughput: 0: 9955.4. Samples: 12718092. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 19:40:53,989][27935] Avg episode reward: [(0, '-97.472')] [2022-07-12 19:40:58,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4966.2, 300 sec: 4991.5). Total num frames: 6384640. Throughput: 0: 9967.5. Samples: 12778852. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:40:58,991][27935] Avg episode reward: [(0, '-97.414')] [2022-07-12 19:41:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4977.7). Total num frames: 6408192. Throughput: 0: 9375.3. Samples: 12809148. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:41:03,989][27935] Avg episode reward: [(0, '-98.388')] [2022-07-12 19:41:08,989][27935] Fps is (10 sec: 4608.8, 60 sec: 4915.2, 300 sec: 4970.7). Total num frames: 6430720. Throughput: 0: 9965.7. Samples: 12865744. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:41:08,989][27935] Avg episode reward: [(0, '-98.498')] [2022-07-12 19:41:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 6460416. Throughput: 0: 9964.1. Samples: 12925984. Policy #0 lag: (min: 0.0, avg: 7.0, max: 19.0) [2022-07-12 19:41:13,989][27935] Avg episode reward: [(0, '-98.100')] [2022-07-12 19:41:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 6483968. Throughput: 0: 9964.8. Samples: 12986072. Policy #0 lag: (min: 0.0, avg: 7.0, max: 19.0) [2022-07-12 19:41:18,989][27935] Avg episode reward: [(0, '-98.032')] [2022-07-12 19:41:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4977.7). Total num frames: 6508544. Throughput: 0: 9974.7. Samples: 13016448. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:41:23,989][27935] Avg episode reward: [(0, '-97.781')] [2022-07-12 19:41:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 6533120. Throughput: 0: 9985.2. Samples: 13076740. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:41:28,989][27935] Avg episode reward: [(0, '-96.787')] [2022-07-12 19:41:33,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5000.3, 300 sec: 4984.6). Total num frames: 6558720. Throughput: 0: 9967.0. Samples: 13136256. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:41:33,992][27935] Avg episode reward: [(0, '-96.458')] [2022-07-12 19:41:38,989][27935] Fps is (10 sec: 5120.1, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 6584320. Throughput: 0: 9957.7. Samples: 13166188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:41:38,989][27935] Avg episode reward: [(0, '-96.716')] [2022-07-12 19:41:43,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4983.5, 300 sec: 4977.7). Total num frames: 6607872. Throughput: 0: 9945.0. Samples: 13226360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:41:43,989][27935] Avg episode reward: [(0, '-96.997')] [2022-07-12 19:41:48,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4966.4, 300 sec: 4970.7). Total num frames: 6633472. Throughput: 0: 10615.5. Samples: 13286844. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:41:48,989][27935] Avg episode reward: [(0, '-96.339')] [2022-07-12 19:41:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4977.7). Total num frames: 6659072. Throughput: 0: 10036.9. Samples: 13317404. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:41:53,989][27935] Avg episode reward: [(0, '-96.717')] [2022-07-12 19:41:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.7, 300 sec: 4991.6). Total num frames: 6684672. Throughput: 0: 10036.4. Samples: 13377620. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:41:58,989][27935] Avg episode reward: [(0, '-96.783')] [2022-07-12 19:42:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 6708224. Throughput: 0: 9962.1. Samples: 13434368. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:42:03,991][27935] Avg episode reward: [(0, '-96.841')] [2022-07-12 19:42:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5017.6, 300 sec: 4977.7). Total num frames: 6731776. Throughput: 0: 9965.9. Samples: 13464912. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:42:08,990][27935] Avg episode reward: [(0, '-97.277')] [2022-07-12 19:42:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4977.7). Total num frames: 6757376. Throughput: 0: 9966.0. Samples: 13525212. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 19:42:13,989][27935] Avg episode reward: [(0, '-97.117')] [2022-07-12 19:42:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 6782976. Throughput: 0: 9970.2. Samples: 13584896. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 19:42:18,989][27935] Avg episode reward: [(0, '-96.362')] [2022-07-12 19:42:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 6808576. Throughput: 0: 9986.8. Samples: 13615596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 19:42:23,989][27935] Avg episode reward: [(0, '-96.543')] [2022-07-12 19:42:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 6833152. Throughput: 0: 9980.5. Samples: 13675484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:42:28,989][27935] Avg episode reward: [(0, '-96.429')] [2022-07-12 19:42:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.6, 300 sec: 4981.2). Total num frames: 6857728. Throughput: 0: 9970.6. Samples: 13735520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:42:33,989][27935] Avg episode reward: [(0, '-95.477')] [2022-07-12 19:42:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 6884352. Throughput: 0: 9954.7. Samples: 13765364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:42:38,989][27935] Avg episode reward: [(0, '-96.076')] [2022-07-12 19:42:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 6907904. Throughput: 0: 9942.8. Samples: 13825044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:42:43,989][27935] Avg episode reward: [(0, '-95.463')] [2022-07-12 19:42:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 6933504. Throughput: 0: 10034.4. Samples: 13885916. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 19:42:48,992][27935] Avg episode reward: [(0, '-95.472')] [2022-07-12 19:42:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4977.7). Total num frames: 6957056. Throughput: 0: 10028.3. Samples: 13916184. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 19:42:53,989][27935] Avg episode reward: [(0, '-95.493')] [2022-07-12 19:42:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4998.5). Total num frames: 6985728. Throughput: 0: 10030.3. Samples: 13976576. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 19:42:58,989][27935] Avg episode reward: [(0, '-95.028')] [2022-07-12 19:43:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 7006208. Throughput: 0: 9959.9. Samples: 14033092. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-12 19:43:03,989][27935] Avg episode reward: [(0, '-95.796')] [2022-07-12 19:43:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 7032832. Throughput: 0: 9954.0. Samples: 14063524. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-12 19:43:08,990][27935] Avg episode reward: [(0, '-96.213')] [2022-07-12 19:43:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4974.2). Total num frames: 7056384. Throughput: 0: 9961.9. Samples: 14123772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-12 19:43:13,989][27935] Avg episode reward: [(0, '-96.091')] [2022-07-12 19:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 7081984. Throughput: 0: 9954.7. Samples: 14183480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-12 19:43:18,990][27935] Avg episode reward: [(0, '-96.733')] [2022-07-12 19:43:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 7107584. Throughput: 0: 9967.2. Samples: 14213888. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-12 19:43:23,989][27935] Avg episode reward: [(0, '-96.824')] [2022-07-12 19:43:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4977.7). Total num frames: 7131136. Throughput: 0: 9966.3. Samples: 14273528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-12 19:43:28,989][27935] Avg episode reward: [(0, '-96.495')] [2022-07-12 19:43:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 7157760. Throughput: 0: 9913.8. Samples: 14332036. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:43:33,989][27935] Avg episode reward: [(0, '-96.212')] [2022-07-12 19:43:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4970.7). Total num frames: 7180288. Throughput: 0: 9910.6. Samples: 14362160. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-12 19:43:38,989][27935] Avg episode reward: [(0, '-95.149')] [2022-07-12 19:43:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 7206912. Throughput: 0: 9917.7. Samples: 14422872. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:43:43,989][27935] Avg episode reward: [(0, '-95.226')] [2022-07-12 19:43:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4977.7). Total num frames: 7231488. Throughput: 0: 9995.9. Samples: 14482908. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:43:48,989][27935] Avg episode reward: [(0, '-94.479')] [2022-07-12 19:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4977.7). Total num frames: 7256064. Throughput: 0: 9987.3. Samples: 14512952. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:43:53,989][27935] Avg episode reward: [(0, '-93.899')] [2022-07-12 19:43:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4988.1). Total num frames: 7282688. Throughput: 0: 9993.1. Samples: 14573460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:43:58,989][27935] Avg episode reward: [(0, '-94.474')] [2022-07-12 19:44:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4977.7). Total num frames: 7305216. Throughput: 0: 9915.6. Samples: 14629684. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:44:03,989][27935] Avg episode reward: [(0, '-94.618')] [2022-07-12 19:44:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4977.7). Total num frames: 7329792. Throughput: 0: 9907.6. Samples: 14659728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 19:44:08,989][27935] Avg episode reward: [(0, '-94.868')] [2022-07-12 19:44:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 7355392. Throughput: 0: 9922.5. Samples: 14720040. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:44:13,989][27935] Avg episode reward: [(0, '-95.566')] [2022-07-12 19:44:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 7380992. Throughput: 0: 9963.9. Samples: 14780412. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:44:18,989][27935] Avg episode reward: [(0, '-95.509')] [2022-07-12 19:44:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 7405568. Throughput: 0: 9969.2. Samples: 14810772. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:44:23,989][27935] Avg episode reward: [(0, '-94.749')] [2022-07-12 19:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 7430144. Throughput: 0: 9972.2. Samples: 14871620. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:44:28,989][27935] Avg episode reward: [(0, '-95.033')] [2022-07-12 19:44:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 7455744. Throughput: 0: 9982.9. Samples: 14932140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:44:33,989][27935] Avg episode reward: [(0, '-95.153')] [2022-07-12 19:44:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4984.6). Total num frames: 7481344. Throughput: 0: 9984.6. Samples: 14962260. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:44:38,989][27935] Avg episode reward: [(0, '-95.081')] [2022-07-12 19:44:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 7506944. Throughput: 0: 9988.9. Samples: 15022960. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:44:43,989][27935] Avg episode reward: [(0, '-94.576')] [2022-07-12 19:44:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 7531520. Throughput: 0: 10090.5. Samples: 15083756. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:44:48,989][27935] Avg episode reward: [(0, '-95.049')] [2022-07-12 19:44:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4984.6). Total num frames: 7557120. Throughput: 0: 10097.1. Samples: 15114096. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:44:53,989][27935] Avg episode reward: [(0, '-95.036')] [2022-07-12 19:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 7583744. Throughput: 0: 10112.5. Samples: 15175104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:44:58,989][27935] Avg episode reward: [(0, '-94.336')] [2022-07-12 19:45:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4984.6). Total num frames: 7606272. Throughput: 0: 10032.7. Samples: 15231884. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:45:03,989][27935] Avg episode reward: [(0, '-94.270')] [2022-07-12 19:45:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 4988.1). Total num frames: 7631872. Throughput: 0: 10026.8. Samples: 15261980. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:45:08,996][27935] Avg episode reward: [(0, '-94.220')] [2022-07-12 19:45:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 7656448. Throughput: 0: 10025.1. Samples: 15322752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:45:13,989][27935] Avg episode reward: [(0, '-94.624')] [2022-07-12 19:45:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 7681024. Throughput: 0: 10027.4. Samples: 15383372. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:45:18,989][27935] Avg episode reward: [(0, '-94.263')] [2022-07-12 19:45:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 7707648. Throughput: 0: 10032.4. Samples: 15413720. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:45:23,989][27935] Avg episode reward: [(0, '-94.570')] [2022-07-12 19:45:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 7731200. Throughput: 0: 10027.7. Samples: 15474208. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:45:28,989][27935] Avg episode reward: [(0, '-94.460')] [2022-07-12 19:45:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 7757824. Throughput: 0: 9999.6. Samples: 15533736. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 19:45:33,989][27935] Avg episode reward: [(0, '-94.586')] [2022-07-12 19:45:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 7782400. Throughput: 0: 9993.4. Samples: 15563800. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 19:45:38,992][27935] Avg episode reward: [(0, '-94.291')] [2022-07-12 19:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 7809024. Throughput: 0: 9980.3. Samples: 15624216. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 19:45:43,989][27935] Avg episode reward: [(0, '-94.093')] [2022-07-12 19:45:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 7831552. Throughput: 0: 10054.2. Samples: 15684324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:45:48,989][27935] Avg episode reward: [(0, '-94.472')] [2022-07-12 19:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4995.1). Total num frames: 7858176. Throughput: 0: 10063.4. Samples: 15714832. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:45:53,992][27935] Avg episode reward: [(0, '-94.765')] [2022-07-12 19:45:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 5002.0). Total num frames: 7883776. Throughput: 0: 10061.9. Samples: 15775536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 19:45:58,989][27935] Avg episode reward: [(0, '-94.795')] [2022-07-12 19:46:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5002.0). Total num frames: 7906304. Throughput: 0: 9983.5. Samples: 15832628. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 19:46:03,989][27935] Avg episode reward: [(0, '-95.006')] [2022-07-12 19:46:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 7931904. Throughput: 0: 9982.2. Samples: 15862920. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 19:46:08,989][27935] Avg episode reward: [(0, '-95.157')] [2022-07-12 19:46:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 7956480. Throughput: 0: 9990.4. Samples: 15923776. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 19:46:13,989][27935] Avg episode reward: [(0, '-95.887')] [2022-07-12 19:46:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 7982080. Throughput: 0: 9976.3. Samples: 15982668. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:46:18,989][27935] Avg episode reward: [(0, '-95.592')] [2022-07-12 19:46:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 8006656. Throughput: 0: 9950.1. Samples: 16011556. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 19:46:23,989][27935] Avg episode reward: [(0, '-95.289')] [2022-07-12 19:46:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 4984.7). Total num frames: 8029184. Throughput: 0: 9942.8. Samples: 16071644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 19:46:28,989][27935] Avg episode reward: [(0, '-94.850')] [2022-07-12 19:46:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 8055808. Throughput: 0: 9941.5. Samples: 16131692. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 19:46:33,990][27935] Avg episode reward: [(0, '-94.850')] [2022-07-12 19:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 8081408. Throughput: 0: 9931.8. Samples: 16161764. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 19:46:38,989][27935] Avg episode reward: [(0, '-95.586')] [2022-07-12 19:46:43,996][27935] Fps is (10 sec: 5116.2, 60 sec: 4965.8, 300 sec: 4994.9). Total num frames: 8107008. Throughput: 0: 9921.7. Samples: 16222088. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:46:43,997][27935] Avg episode reward: [(0, '-94.792')] [2022-07-12 19:46:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 8131584. Throughput: 0: 9983.4. Samples: 16281880. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:46:48,989][27935] Avg episode reward: [(0, '-95.878')] [2022-07-12 19:46:53,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 8156160. Throughput: 0: 9983.7. Samples: 16312188. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:46:53,989][27935] Avg episode reward: [(0, '-95.824')] [2022-07-12 19:46:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4995.0). Total num frames: 8181760. Throughput: 0: 9975.4. Samples: 16372668. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 19:46:58,989][27935] Avg episode reward: [(0, '-96.491')] [2022-07-12 19:47:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 8205312. Throughput: 0: 9938.2. Samples: 16429888. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 19:47:03,989][27935] Avg episode reward: [(0, '-96.654')] [2022-07-12 19:47:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 8230912. Throughput: 0: 9974.4. Samples: 16460404. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 19:47:08,989][27935] Avg episode reward: [(0, '-96.720')] [2022-07-12 19:47:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4995.0). Total num frames: 8256512. Throughput: 0: 9993.4. Samples: 16521348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:47:13,989][27935] Avg episode reward: [(0, '-96.691')] [2022-07-12 19:47:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 8281088. Throughput: 0: 9986.6. Samples: 16581088. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:47:18,990][27935] Avg episode reward: [(0, '-96.520')] [2022-07-12 19:47:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 8305664. Throughput: 0: 9998.9. Samples: 16611716. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:47:23,990][27935] Avg episode reward: [(0, '-96.940')] [2022-07-12 19:47:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 8332288. Throughput: 0: 10010.7. Samples: 16672496. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 19:47:28,989][27935] Avg episode reward: [(0, '-96.436')] [2022-07-12 19:47:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 8356864. Throughput: 0: 10032.2. Samples: 16733328. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 19:47:33,990][27935] Avg episode reward: [(0, '-96.636')] [2022-07-12 19:47:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4998.5). Total num frames: 8382464. Throughput: 0: 10027.0. Samples: 16763404. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 19:47:38,989][27935] Avg episode reward: [(0, '-96.595')] [2022-07-12 19:47:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4984.1, 300 sec: 4991.6). Total num frames: 8406016. Throughput: 0: 10006.3. Samples: 16822952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 19:47:43,989][27935] Avg episode reward: [(0, '-96.595')] [2022-07-12 19:47:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4998.5). Total num frames: 8431616. Throughput: 0: 10081.0. Samples: 16883532. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 19:47:48,989][27935] Avg episode reward: [(0, '-96.402')] [2022-07-12 19:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 8458240. Throughput: 0: 10075.3. Samples: 16913792. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 19:47:53,989][27935] Avg episode reward: [(0, '-96.690')] [2022-07-12 19:47:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5002.0). Total num frames: 8481792. Throughput: 0: 10078.1. Samples: 16974864. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:47:58,989][27935] Avg episode reward: [(0, '-97.065')] [2022-07-12 19:48:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 8506368. Throughput: 0: 10017.3. Samples: 17031864. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:48:03,989][27935] Avg episode reward: [(0, '-97.501')] [2022-07-12 19:48:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4998.5). Total num frames: 8530944. Throughput: 0: 10016.7. Samples: 17062468. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:48:08,993][27935] Avg episode reward: [(0, '-97.865')] [2022-07-12 19:48:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5002.0). Total num frames: 8557568. Throughput: 0: 10020.3. Samples: 17123408. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:48:13,989][27935] Avg episode reward: [(0, '-98.621')] [2022-07-12 19:48:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4998.5). Total num frames: 8582144. Throughput: 0: 10014.6. Samples: 17183984. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 19:48:18,989][27935] Avg episode reward: [(0, '-98.164')] [2022-07-12 19:48:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5002.0). Total num frames: 8606720. Throughput: 0: 10015.1. Samples: 17214084. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:48:23,989][27935] Avg episode reward: [(0, '-97.756')] [2022-07-12 19:48:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5002.0). Total num frames: 8633344. Throughput: 0: 10053.7. Samples: 17275368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:48:28,989][27935] Avg episode reward: [(0, '-97.358')] [2022-07-12 19:48:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 8657920. Throughput: 0: 10038.7. Samples: 17335272. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 19:48:33,989][27935] Avg episode reward: [(0, '-97.413')] [2022-07-12 19:48:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 8683520. Throughput: 0: 10046.3. Samples: 17365876. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 19:48:38,989][27935] Avg episode reward: [(0, '-96.064')] [2022-07-12 19:48:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5005.4). Total num frames: 8708096. Throughput: 0: 10041.1. Samples: 17426712. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 19:48:43,989][27935] Avg episode reward: [(0, '-95.637')] [2022-07-12 19:48:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 8734720. Throughput: 0: 10129.3. Samples: 17487684. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 19:48:48,989][27935] Avg episode reward: [(0, '-96.022')] [2022-07-12 19:48:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 8759296. Throughput: 0: 10136.0. Samples: 17518588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:48:53,989][27935] Avg episode reward: [(0, '-97.254')] [2022-07-12 19:48:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5019.3). Total num frames: 8785920. Throughput: 0: 10131.8. Samples: 17579340. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:48:58,989][27935] Avg episode reward: [(0, '-98.545')] [2022-07-12 19:49:03,991][27935] Fps is (10 sec: 4812.0, 60 sec: 5017.5, 300 sec: 5008.9). Total num frames: 8807424. Throughput: 0: 10059.2. Samples: 17636664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:49:03,991][27935] Avg episode reward: [(0, '-99.098')] [2022-07-12 19:49:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5015.9). Total num frames: 8835072. Throughput: 0: 10072.4. Samples: 17667340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 19:49:08,990][27935] Avg episode reward: [(0, '-99.345')] [2022-07-12 19:49:13,989][27935] Fps is (10 sec: 5223.3, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 8859648. Throughput: 0: 10063.4. Samples: 17728220. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 19:49:13,989][27935] Avg episode reward: [(0, '-100.450')] [2022-07-12 19:49:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 8884224. Throughput: 0: 10060.5. Samples: 17787996. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 19:49:18,989][27935] Avg episode reward: [(0, '-100.180')] [2022-07-12 19:49:23,990][27935] Fps is (10 sec: 4914.5, 60 sec: 5034.5, 300 sec: 5012.4). Total num frames: 8908800. Throughput: 0: 10036.1. Samples: 17817516. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 19:49:23,991][27935] Avg episode reward: [(0, '-99.373')] [2022-07-12 19:49:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5012.4). Total num frames: 8934400. Throughput: 0: 10013.2. Samples: 17877308. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 19:49:28,989][27935] Avg episode reward: [(0, '-98.595')] [2022-07-12 19:49:33,989][27935] Fps is (10 sec: 5018.4, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 8958976. Throughput: 0: 9989.0. Samples: 17937188. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 19:49:33,989][27935] Avg episode reward: [(0, '-98.109')] [2022-07-12 19:49:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 8984576. Throughput: 0: 9968.8. Samples: 17967184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 19:49:38,989][27935] Avg episode reward: [(0, '-98.034')] [2022-07-12 19:49:43,989][27935] Fps is (10 sec: 4915.1, 60 sec: 5000.5, 300 sec: 5005.4). Total num frames: 9008128. Throughput: 0: 9976.0. Samples: 18028260. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:49:43,990][27935] Avg episode reward: [(0, '-97.620')] [2022-07-12 19:49:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5008.9). Total num frames: 9034752. Throughput: 0: 10063.1. Samples: 18089484. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:49:48,989][27935] Avg episode reward: [(0, '-97.099')] [2022-07-12 19:49:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 9060352. Throughput: 0: 10062.8. Samples: 18120164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:49:53,989][27935] Avg episode reward: [(0, '-97.451')] [2022-07-12 19:49:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5019.3). Total num frames: 9086976. Throughput: 0: 10054.5. Samples: 18180672. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:49:58,989][27935] Avg episode reward: [(0, '-97.488')] [2022-07-12 19:50:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.7, 300 sec: 5005.5). Total num frames: 9108480. Throughput: 0: 9988.9. Samples: 18237496. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:50:03,989][27935] Avg episode reward: [(0, '-96.828')] [2022-07-12 19:50:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5012.4). Total num frames: 9135104. Throughput: 0: 10005.9. Samples: 18267768. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 19:50:08,989][27935] Avg episode reward: [(0, '-97.266')] [2022-07-12 19:50:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5017.6, 300 sec: 5015.9). Total num frames: 9160704. Throughput: 0: 10024.3. Samples: 18328404. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:50:13,989][27935] Avg episode reward: [(0, '-97.005')] [2022-07-12 19:50:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 5002.0). Total num frames: 9183232. Throughput: 0: 10043.7. Samples: 18389156. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:50:18,989][27935] Avg episode reward: [(0, '-96.965')] [2022-07-12 19:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.7, 300 sec: 5012.4). Total num frames: 9209856. Throughput: 0: 10055.2. Samples: 18419668. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 19:50:23,992][27935] Avg episode reward: [(0, '-96.154')] [2022-07-12 19:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 9235456. Throughput: 0: 10035.6. Samples: 18479860. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:50:28,989][27935] Avg episode reward: [(0, '-95.294')] [2022-07-12 19:50:33,995][27935] Fps is (10 sec: 5116.6, 60 sec: 5034.1, 300 sec: 5012.3). Total num frames: 9261056. Throughput: 0: 10020.4. Samples: 18540468. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:50:33,996][27935] Avg episode reward: [(0, '-95.313')] [2022-07-12 19:50:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5002.0). Total num frames: 9284608. Throughput: 0: 10013.3. Samples: 18570764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:50:38,989][27935] Avg episode reward: [(0, '-94.560')] [2022-07-12 19:50:43,989][27935] Fps is (10 sec: 4918.4, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 9310208. Throughput: 0: 10011.7. Samples: 18631200. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:50:43,989][27935] Avg episode reward: [(0, '-94.762')] [2022-07-12 19:50:48,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 9335808. Throughput: 0: 10075.9. Samples: 18690912. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:50:48,989][27935] Avg episode reward: [(0, '-95.264')] [2022-07-12 19:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5005.5). Total num frames: 9360384. Throughput: 0: 10065.2. Samples: 18720704. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:50:53,989][27935] Avg episode reward: [(0, '-96.203')] [2022-07-12 19:50:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5015.9). Total num frames: 9385984. Throughput: 0: 10043.8. Samples: 18780372. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:50:58,989][27935] Avg episode reward: [(0, '-96.482')] [2022-07-12 19:51:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 5002.0). Total num frames: 9407488. Throughput: 0: 9953.1. Samples: 18837044. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:51:03,989][27935] Avg episode reward: [(0, '-96.476')] [2022-07-12 19:51:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5012.4). Total num frames: 9435136. Throughput: 0: 9956.3. Samples: 18867700. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 19:51:08,989][27935] Avg episode reward: [(0, '-96.336')] [2022-07-12 19:51:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5005.4). Total num frames: 9458688. Throughput: 0: 9975.9. Samples: 18928776. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 19:51:13,989][27935] Avg episode reward: [(0, '-96.785')] [2022-07-12 19:51:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 9485312. Throughput: 0: 9975.9. Samples: 18989316. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 19:51:18,989][27935] Avg episode reward: [(0, '-96.348')] [2022-07-12 19:51:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5019.3). Total num frames: 9509888. Throughput: 0: 9979.8. Samples: 19019852. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 19:51:23,989][27935] Avg episode reward: [(0, '-96.489')] [2022-07-12 19:51:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5015.9). Total num frames: 9535488. Throughput: 0: 9999.6. Samples: 19081180. Policy #0 lag: (min: 1.0, avg: 9.0, max: 21.0) [2022-07-12 19:51:28,989][27935] Avg episode reward: [(0, '-96.133')] [2022-07-12 19:51:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5001.1, 300 sec: 5015.9). Total num frames: 9561088. Throughput: 0: 10015.5. Samples: 19141612. Policy #0 lag: (min: 1.0, avg: 9.0, max: 21.0) [2022-07-12 19:51:33,989][27935] Avg episode reward: [(0, '-96.004')] [2022-07-12 19:51:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5012.5). Total num frames: 9585664. Throughput: 0: 10030.9. Samples: 19172096. Policy #0 lag: (min: 1.0, avg: 9.0, max: 21.0) [2022-07-12 19:51:38,989][27935] Avg episode reward: [(0, '-95.570')] [2022-07-12 19:51:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5019.3). Total num frames: 9612288. Throughput: 0: 10065.1. Samples: 19233300. Policy #0 lag: (min: 1.0, avg: 9.0, max: 21.0) [2022-07-12 19:51:43,989][27935] Avg episode reward: [(0, '-94.829')] [2022-07-12 19:51:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5019.3). Total num frames: 9636864. Throughput: 0: 10161.2. Samples: 19294296. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 19:51:48,989][27935] Avg episode reward: [(0, '-94.907')] [2022-07-12 19:51:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5019.3). Total num frames: 9662464. Throughput: 0: 10151.8. Samples: 19324532. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 19:51:53,989][27935] Avg episode reward: [(0, '-94.294')] [2022-07-12 19:51:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5026.3). Total num frames: 9688064. Throughput: 0: 10138.1. Samples: 19384992. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 19:51:58,989][27935] Avg episode reward: [(0, '-93.977')] [2022-07-12 19:52:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5019.3). Total num frames: 9711616. Throughput: 0: 10066.2. Samples: 19442296. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 19:52:03,989][27935] Avg episode reward: [(0, '-94.313')] [2022-07-12 19:52:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5019.3). Total num frames: 9737216. Throughput: 0: 10062.2. Samples: 19472652. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 19:52:08,989][27935] Avg episode reward: [(0, '-94.432')] [2022-07-12 19:52:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5019.3). Total num frames: 9761792. Throughput: 0: 10043.0. Samples: 19533116. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 19:52:13,990][27935] Avg episode reward: [(0, '-95.066')] [2022-07-12 19:52:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5019.3). Total num frames: 9786368. Throughput: 0: 10041.5. Samples: 19593480. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:18,989][27935] Avg episode reward: [(0, '-95.165')] [2022-07-12 19:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5008.9). Total num frames: 9809920. Throughput: 0: 10024.6. Samples: 19623204. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:23,989][27935] Avg episode reward: [(0, '-95.225')] [2022-07-12 19:52:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5019.3). Total num frames: 9837568. Throughput: 0: 9960.4. Samples: 19681516. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:28,989][27935] Avg episode reward: [(0, '-95.696')] [2022-07-12 19:52:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5005.5). Total num frames: 9859072. Throughput: 0: 9948.2. Samples: 19741964. Policy #0 lag: (min: 0.0, avg: 10.9, max: 21.0) [2022-07-12 19:52:33,989][27935] Avg episode reward: [(0, '-94.809')] [2022-07-12 19:52:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5022.8). Total num frames: 9887744. Throughput: 0: 9952.2. Samples: 19772380. Policy #0 lag: (min: 0.0, avg: 10.9, max: 21.0) [2022-07-12 19:52:38,989][27935] Avg episode reward: [(0, '-94.135')] [2022-07-12 19:52:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4983.5, 300 sec: 5015.9). Total num frames: 9911296. Throughput: 0: 9922.1. Samples: 19831488. Policy #0 lag: (min: 0.0, avg: 10.9, max: 21.0) [2022-07-12 19:52:43,989][27935] Avg episode reward: [(0, '-94.051')] [2022-07-12 19:52:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 5008.9). Total num frames: 9935872. Throughput: 0: 9988.1. Samples: 19891760. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:48,989][27935] Avg episode reward: [(0, '-93.560')] [2022-07-12 19:52:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5012.4). Total num frames: 9960448. Throughput: 0: 9991.1. Samples: 19922252. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:53,989][27935] Avg episode reward: [(0, '-93.476')] [2022-07-12 19:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5012.4). Total num frames: 9985024. Throughput: 0: 9970.9. Samples: 19981804. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:52:58,989][27935] Avg episode reward: [(0, '-92.672')] [2022-07-12 19:53:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5012.4). Total num frames: 10009600. Throughput: 0: 9879.1. Samples: 20038040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 19:53:03,989][27935] Avg episode reward: [(0, '-93.443')] [2022-07-12 19:53:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5005.5). Total num frames: 10034176. Throughput: 0: 9891.1. Samples: 20068304. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:53:08,989][27935] Avg episode reward: [(0, '-93.312')] [2022-07-12 19:53:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5008.9). Total num frames: 10059776. Throughput: 0: 9933.8. Samples: 20128536. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:53:13,989][27935] Avg episode reward: [(0, '-91.916')] [2022-07-12 19:53:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5008.9). Total num frames: 10084352. Throughput: 0: 9939.3. Samples: 20189232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:53:18,989][27935] Avg episode reward: [(0, '-91.856')] [2022-07-12 19:53:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 10110976. Throughput: 0: 9941.6. Samples: 20219752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:53:23,989][27935] Avg episode reward: [(0, '-91.202')] [2022-07-12 19:53:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5008.9). Total num frames: 10135552. Throughput: 0: 9976.6. Samples: 20280436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:53:28,989][27935] Avg episode reward: [(0, '-90.905')] [2022-07-12 19:53:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 10160128. Throughput: 0: 9980.3. Samples: 20340872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:53:33,989][27935] Avg episode reward: [(0, '-90.579')] [2022-07-12 19:53:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5005.5). Total num frames: 10184704. Throughput: 0: 9976.6. Samples: 20371200. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:53:38,990][27935] Avg episode reward: [(0, '-89.901')] [2022-07-12 19:53:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 10212352. Throughput: 0: 10011.6. Samples: 20432328. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:53:43,989][27935] Avg episode reward: [(0, '-90.092')] [2022-07-12 19:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 10236928. Throughput: 0: 10126.8. Samples: 20493748. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:53:48,989][27935] Avg episode reward: [(0, '-90.047')] [2022-07-12 19:53:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 10262528. Throughput: 0: 10133.1. Samples: 20524292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 19:53:53,989][27935] Avg episode reward: [(0, '-89.845')] [2022-07-12 19:53:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5022.8). Total num frames: 10289152. Throughput: 0: 10152.4. Samples: 20585392. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:53:58,989][27935] Avg episode reward: [(0, '-89.323')] [2022-07-12 19:54:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 10311680. Throughput: 0: 10056.5. Samples: 20641772. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:54:03,989][27935] Avg episode reward: [(0, '-89.169')] [2022-07-12 19:54:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5008.9). Total num frames: 10337280. Throughput: 0: 10052.4. Samples: 20672112. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:54:08,989][27935] Avg episode reward: [(0, '-89.551')] [2022-07-12 19:54:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5008.9). Total num frames: 10361856. Throughput: 0: 10040.5. Samples: 20732260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:13,989][27935] Avg episode reward: [(0, '-89.457')] [2022-07-12 19:54:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 10387456. Throughput: 0: 10046.8. Samples: 20792980. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:18,989][27935] Avg episode reward: [(0, '-89.557')] [2022-07-12 19:54:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 10412032. Throughput: 0: 10051.5. Samples: 20823516. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:23,990][27935] Avg episode reward: [(0, '-89.965')] [2022-07-12 19:54:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 10437632. Throughput: 0: 10034.9. Samples: 20883900. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:54:28,990][27935] Avg episode reward: [(0, '-89.915')] [2022-07-12 19:54:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 10461184. Throughput: 0: 9324.3. Samples: 20913340. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:54:33,989][27935] Avg episode reward: [(0, '-90.250')] [2022-07-12 19:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 10486784. Throughput: 0: 9963.6. Samples: 20972656. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:54:38,989][27935] Avg episode reward: [(0, '-89.974')] [2022-07-12 19:54:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5008.9). Total num frames: 10512384. Throughput: 0: 9938.2. Samples: 21032612. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 19:54:43,989][27935] Avg episode reward: [(0, '-89.788')] [2022-07-12 19:54:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5005.5). Total num frames: 10536960. Throughput: 0: 10015.6. Samples: 21092472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:48,989][27935] Avg episode reward: [(0, '-89.133')] [2022-07-12 19:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4998.5). Total num frames: 10561536. Throughput: 0: 10013.0. Samples: 21122696. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:53,989][27935] Avg episode reward: [(0, '-89.202')] [2022-07-12 19:54:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5008.9). Total num frames: 10586112. Throughput: 0: 10009.8. Samples: 21182700. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 19:54:58,990][27935] Avg episode reward: [(0, '-88.747')] [2022-07-12 19:55:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4998.5). Total num frames: 10609664. Throughput: 0: 9898.4. Samples: 21238408. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:55:03,989][27935] Avg episode reward: [(0, '-88.176')] [2022-07-12 19:55:08,993][27935] Fps is (10 sec: 4811.0, 60 sec: 4949.0, 300 sec: 4995.0). Total num frames: 10634240. Throughput: 0: 9887.4. Samples: 21268488. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:55:08,993][27935] Avg episode reward: [(0, '-86.931')] [2022-07-12 19:55:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5005.5). Total num frames: 10659840. Throughput: 0: 9878.8. Samples: 21328444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:55:13,989][27935] Avg episode reward: [(0, '-87.480')] [2022-07-12 19:55:18,989][27935] Fps is (10 sec: 5019.5, 60 sec: 4949.3, 300 sec: 4998.5). Total num frames: 10684416. Throughput: 0: 10563.7. Samples: 21388708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 19:55:18,989][27935] Avg episode reward: [(0, '-87.911')] [2022-07-12 19:55:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4998.5). Total num frames: 10710016. Throughput: 0: 9918.5. Samples: 21418988. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 19:55:23,989][27935] Avg episode reward: [(0, '-88.578')] [2022-07-12 19:55:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4995.1). Total num frames: 10734592. Throughput: 0: 9914.7. Samples: 21478772. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 19:55:28,989][27935] Avg episode reward: [(0, '-89.325')] [2022-07-12 19:55:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4998.5). Total num frames: 10759168. Throughput: 0: 9909.8. Samples: 21538412. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 19:55:33,989][27935] Avg episode reward: [(0, '-89.208')] [2022-07-12 19:55:38,995][27935] Fps is (10 sec: 5014.3, 60 sec: 4965.9, 300 sec: 4998.4). Total num frames: 10784768. Throughput: 0: 9905.0. Samples: 21568488. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:55:38,996][27935] Avg episode reward: [(0, '-89.812')] [2022-07-12 19:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4995.0). Total num frames: 10809344. Throughput: 0: 9906.7. Samples: 21628500. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:55:43,989][27935] Avg episode reward: [(0, '-90.414')] [2022-07-12 19:55:48,989][27935] Fps is (10 sec: 5020.9, 60 sec: 4966.4, 300 sec: 4998.5). Total num frames: 10834944. Throughput: 0: 10006.4. Samples: 21688696. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:55:48,989][27935] Avg episode reward: [(0, '-89.322')] [2022-07-12 19:55:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4995.0). Total num frames: 10859520. Throughput: 0: 10010.4. Samples: 21718920. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 19:55:53,989][27935] Avg episode reward: [(0, '-88.611')] [2022-07-12 19:55:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5008.9). Total num frames: 10885120. Throughput: 0: 10009.9. Samples: 21778888. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:55:58,989][27935] Avg episode reward: [(0, '-88.348')] [2022-07-12 19:56:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 10907648. Throughput: 0: 9912.1. Samples: 21834752. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:56:03,989][27935] Avg episode reward: [(0, '-87.710')] [2022-07-12 19:56:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.7, 300 sec: 4995.0). Total num frames: 10932224. Throughput: 0: 9902.0. Samples: 21864576. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 19:56:08,989][27935] Avg episode reward: [(0, '-87.677')] [2022-07-12 19:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4998.5). Total num frames: 10959872. Throughput: 0: 9906.3. Samples: 21924556. Policy #0 lag: (min: 0.0, avg: 7.6, max: 20.0) [2022-07-12 19:56:13,989][27935] Avg episode reward: [(0, '-87.317')] [2022-07-12 19:56:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 10982400. Throughput: 0: 9905.1. Samples: 21984140. Policy #0 lag: (min: 0.0, avg: 7.6, max: 20.0) [2022-07-12 19:56:18,989][27935] Avg episode reward: [(0, '-86.698')] [2022-07-12 19:56:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4988.1). Total num frames: 11006976. Throughput: 0: 9907.6. Samples: 22014264. Policy #0 lag: (min: 0.0, avg: 7.6, max: 20.0) [2022-07-12 19:56:23,989][27935] Avg episode reward: [(0, '-86.711')] [2022-07-12 19:56:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4984.6). Total num frames: 11031552. Throughput: 0: 9910.9. Samples: 22074488. Policy #0 lag: (min: 0.0, avg: 7.6, max: 20.0) [2022-07-12 19:56:28,989][27935] Avg episode reward: [(0, '-85.819')] [2022-07-12 19:56:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 11058176. Throughput: 0: 9903.3. Samples: 22134344. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-12 19:56:33,989][27935] Avg episode reward: [(0, '-85.609')] [2022-07-12 19:56:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4967.0, 300 sec: 4984.6). Total num frames: 11082752. Throughput: 0: 9897.6. Samples: 22164312. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-12 19:56:38,989][27935] Avg episode reward: [(0, '-85.241')] [2022-07-12 19:56:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 11107328. Throughput: 0: 9916.6. Samples: 22225136. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-12 19:56:43,989][27935] Avg episode reward: [(0, '-85.838')] [2022-07-12 19:56:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 11132928. Throughput: 0: 10021.9. Samples: 22285736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:56:48,989][27935] Avg episode reward: [(0, '-86.348')] [2022-07-12 19:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 11159552. Throughput: 0: 10035.8. Samples: 22316188. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:56:53,989][27935] Avg episode reward: [(0, '-85.273')] [2022-07-12 19:56:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 11184128. Throughput: 0: 10044.4. Samples: 22376556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:56:58,989][27935] Avg episode reward: [(0, '-85.422')] [2022-07-12 19:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 11206656. Throughput: 0: 9974.3. Samples: 22432984. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 19:57:03,989][27935] Avg episode reward: [(0, '-85.308')] [2022-07-12 19:57:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 11231232. Throughput: 0: 9975.4. Samples: 22463156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:57:08,989][27935] Avg episode reward: [(0, '-85.041')] [2022-07-12 19:57:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4984.6). Total num frames: 11256832. Throughput: 0: 9990.2. Samples: 22524048. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:57:13,989][27935] Avg episode reward: [(0, '-83.673')] [2022-07-12 19:57:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 11282432. Throughput: 0: 9993.4. Samples: 22584048. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 19:57:18,989][27935] Avg episode reward: [(0, '-83.862')] [2022-07-12 19:57:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 11307008. Throughput: 0: 10000.4. Samples: 22614328. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:57:23,989][27935] Avg episode reward: [(0, '-84.421')] [2022-07-12 19:57:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 11332608. Throughput: 0: 9981.8. Samples: 22674316. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:57:28,989][27935] Avg episode reward: [(0, '-83.715')] [2022-07-12 19:57:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 11357184. Throughput: 0: 9959.3. Samples: 22733904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:57:33,989][27935] Avg episode reward: [(0, '-84.075')] [2022-07-12 19:57:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 11382784. Throughput: 0: 9957.6. Samples: 22764280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 19:57:38,989][27935] Avg episode reward: [(0, '-83.632')] [2022-07-12 19:57:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 11408384. Throughput: 0: 9948.2. Samples: 22824224. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:57:43,989][27935] Avg episode reward: [(0, '-83.975')] [2022-07-12 19:57:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4988.1). Total num frames: 11431936. Throughput: 0: 10046.7. Samples: 22885084. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:57:48,990][27935] Avg episode reward: [(0, '-83.685')] [2022-07-12 19:57:53,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4966.2, 300 sec: 4991.5). Total num frames: 11457536. Throughput: 0: 10048.0. Samples: 22915340. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 19:57:53,992][27935] Avg episode reward: [(0, '-83.905')] [2022-07-12 19:57:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 11483136. Throughput: 0: 10048.0. Samples: 22976208. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:57:58,989][27935] Avg episode reward: [(0, '-84.580')] [2022-07-12 19:58:03,989][27935] Fps is (10 sec: 5018.9, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 11507712. Throughput: 0: 9983.3. Samples: 23033296. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:58:03,989][27935] Avg episode reward: [(0, '-84.161')] [2022-07-12 19:58:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 11532288. Throughput: 0: 9988.3. Samples: 23063800. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:58:08,989][27935] Avg episode reward: [(0, '-84.069')] [2022-07-12 19:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4998.5). Total num frames: 11558912. Throughput: 0: 9995.6. Samples: 23124116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 19:58:13,989][27935] Avg episode reward: [(0, '-85.033')] [2022-07-12 19:58:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 11583488. Throughput: 0: 10023.8. Samples: 23184976. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:58:18,989][27935] Avg episode reward: [(0, '-84.436')] [2022-07-12 19:58:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 11608064. Throughput: 0: 10026.8. Samples: 23215488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:58:23,989][27935] Avg episode reward: [(0, '-84.254')] [2022-07-12 19:58:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 11632640. Throughput: 0: 10029.3. Samples: 23275544. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:58:28,989][27935] Avg episode reward: [(0, '-84.308')] [2022-07-12 19:58:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 11657216. Throughput: 0: 9979.8. Samples: 23334176. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 19:58:33,989][27935] Avg episode reward: [(0, '-83.941')] [2022-07-12 19:58:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 11683840. Throughput: 0: 9980.7. Samples: 23364444. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:58:38,989][27935] Avg episode reward: [(0, '-83.286')] [2022-07-12 19:58:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 11707392. Throughput: 0: 9985.3. Samples: 23425544. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:58:43,989][27935] Avg episode reward: [(0, '-82.660')] [2022-07-12 19:58:48,990][27935] Fps is (10 sec: 4914.5, 60 sec: 5017.5, 300 sec: 4984.6). Total num frames: 11732992. Throughput: 0: 10068.4. Samples: 23486388. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 19:58:48,991][27935] Avg episode reward: [(0, '-81.876')] [2022-07-12 19:58:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.8, 300 sec: 4981.2). Total num frames: 11758592. Throughput: 0: 10064.3. Samples: 23516696. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:58:53,989][27935] Avg episode reward: [(0, '-82.269')] [2022-07-12 19:58:58,989][27935] Fps is (10 sec: 5018.3, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 11783168. Throughput: 0: 10067.0. Samples: 23577132. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:58:58,989][27935] Avg episode reward: [(0, '-83.085')] [2022-07-12 19:59:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4981.2). Total num frames: 11806720. Throughput: 0: 9973.6. Samples: 23633788. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:59:03,989][27935] Avg episode reward: [(0, '-82.065')] [2022-07-12 19:59:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 11832320. Throughput: 0: 9972.3. Samples: 23664240. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 19:59:08,989][27935] Avg episode reward: [(0, '-83.063')] [2022-07-12 19:59:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 11857920. Throughput: 0: 9995.7. Samples: 23725352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 18.0) [2022-07-12 19:59:13,989][27935] Avg episode reward: [(0, '-83.753')] [2022-07-12 19:59:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 11884544. Throughput: 0: 10037.4. Samples: 23785860. Policy #0 lag: (min: 0.0, avg: 10.0, max: 18.0) [2022-07-12 19:59:18,989][27935] Avg episode reward: [(0, '-84.835')] [2022-07-12 19:59:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 11908096. Throughput: 0: 10050.1. Samples: 23816700. Policy #0 lag: (min: 0.0, avg: 10.0, max: 18.0) [2022-07-12 19:59:23,990][27935] Avg episode reward: [(0, '-84.405')] [2022-07-12 19:59:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 11932672. Throughput: 0: 10044.2. Samples: 23877532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 18.0) [2022-07-12 19:59:28,994][27935] Avg episode reward: [(0, '-84.020')] [2022-07-12 19:59:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 11959296. Throughput: 0: 10032.1. Samples: 23937816. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:59:33,989][27935] Avg episode reward: [(0, '-84.739')] [2022-07-12 19:59:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 11983872. Throughput: 0: 10023.6. Samples: 23967756. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:59:38,989][27935] Avg episode reward: [(0, '-83.891')] [2022-07-12 19:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 12008448. Throughput: 0: 10004.4. Samples: 24027328. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 19:59:43,989][27935] Avg episode reward: [(0, '-83.482')] [2022-07-12 19:59:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.7, 300 sec: 4991.6). Total num frames: 12034048. Throughput: 0: 10075.5. Samples: 24087184. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:59:48,989][27935] Avg episode reward: [(0, '-82.401')] [2022-07-12 19:59:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 12059648. Throughput: 0: 10082.3. Samples: 24117944. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:59:53,989][27935] Avg episode reward: [(0, '-83.340')] [2022-07-12 19:59:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4998.5). Total num frames: 12084224. Throughput: 0: 10058.7. Samples: 24177992. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 19:59:58,989][27935] Avg episode reward: [(0, '-82.623')] [2022-07-12 20:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 12106752. Throughput: 0: 9960.6. Samples: 24234088. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:00:03,989][27935] Avg episode reward: [(0, '-81.853')] [2022-07-12 20:00:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 12132352. Throughput: 0: 9942.0. Samples: 24264088. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:00:08,989][27935] Avg episode reward: [(0, '-81.862')] [2022-07-12 20:00:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 12156928. Throughput: 0: 9913.0. Samples: 24323616. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:00:13,989][27935] Avg episode reward: [(0, '-80.829')] [2022-07-12 20:00:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 12182528. Throughput: 0: 9898.8. Samples: 24383264. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:00:18,989][27935] Avg episode reward: [(0, '-80.815')] [2022-07-12 20:00:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 12207104. Throughput: 0: 9900.6. Samples: 24413284. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:00:23,989][27935] Avg episode reward: [(0, '-81.474')] [2022-07-12 20:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 12230656. Throughput: 0: 9908.5. Samples: 24473212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:00:28,989][27935] Avg episode reward: [(0, '-80.226')] [2022-07-12 20:00:33,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4949.3, 300 sec: 4988.2). Total num frames: 12256256. Throughput: 0: 9899.2. Samples: 24532652. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:00:33,990][27935] Avg episode reward: [(0, '-80.152')] [2022-07-12 20:00:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 12281856. Throughput: 0: 9870.8. Samples: 24562132. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:00:38,989][27935] Avg episode reward: [(0, '-79.698')] [2022-07-12 20:00:43,989][27935] Fps is (10 sec: 5017.8, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 12306432. Throughput: 0: 9865.2. Samples: 24621928. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:00:43,989][27935] Avg episode reward: [(0, '-79.551')] [2022-07-12 20:00:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4988.1). Total num frames: 12331008. Throughput: 0: 9947.0. Samples: 24681704. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:00:48,989][27935] Avg episode reward: [(0, '-79.335')] [2022-07-12 20:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4988.1). Total num frames: 12356608. Throughput: 0: 9955.6. Samples: 24712088. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:00:53,989][27935] Avg episode reward: [(0, '-78.392')] [2022-07-12 20:00:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4995.0). Total num frames: 12381184. Throughput: 0: 9965.3. Samples: 24772056. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:00:58,989][27935] Avg episode reward: [(0, '-77.648')] [2022-07-12 20:01:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 12404736. Throughput: 0: 9872.3. Samples: 24827516. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:01:03,989][27935] Avg episode reward: [(0, '-77.777')] [2022-07-12 20:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4977.7). Total num frames: 12428288. Throughput: 0: 9867.5. Samples: 24857320. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:01:08,990][27935] Avg episode reward: [(0, '-78.122')] [2022-07-12 20:01:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 12454912. Throughput: 0: 9874.6. Samples: 24917568. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:01:13,989][27935] Avg episode reward: [(0, '-76.520')] [2022-07-12 20:01:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4988.1). Total num frames: 12478464. Throughput: 0: 9876.2. Samples: 24977076. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:01:18,989][27935] Avg episode reward: [(0, '-76.912')] [2022-07-12 20:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 4988.1). Total num frames: 12503040. Throughput: 0: 9893.2. Samples: 25007328. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:01:23,989][27935] Avg episode reward: [(0, '-77.181')] [2022-07-12 20:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 12528640. Throughput: 0: 9907.3. Samples: 25067756. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:01:28,989][27935] Avg episode reward: [(0, '-78.932')] [2022-07-12 20:01:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 12554240. Throughput: 0: 9896.3. Samples: 25127036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:01:33,989][27935] Avg episode reward: [(0, '-80.473')] [2022-07-12 20:01:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4988.1). Total num frames: 12578816. Throughput: 0: 9874.5. Samples: 25156440. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:01:38,989][27935] Avg episode reward: [(0, '-81.168')] [2022-07-12 20:01:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 12604416. Throughput: 0: 9894.4. Samples: 25217304. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:01:43,989][27935] Avg episode reward: [(0, '-80.052')] [2022-07-12 20:01:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 12628992. Throughput: 0: 10006.1. Samples: 25277792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:01:48,990][27935] Avg episode reward: [(0, '-80.732')] [2022-07-12 20:01:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 12654592. Throughput: 0: 10024.4. Samples: 25308416. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:01:53,989][27935] Avg episode reward: [(0, '-80.421')] [2022-07-12 20:01:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 12680192. Throughput: 0: 10036.3. Samples: 25369200. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:01:58,989][27935] Avg episode reward: [(0, '-78.982')] [2022-07-12 20:02:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4988.1). Total num frames: 12702720. Throughput: 0: 9975.4. Samples: 25425968. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:02:03,989][27935] Avg episode reward: [(0, '-77.900')] [2022-07-12 20:02:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 12728320. Throughput: 0: 9971.0. Samples: 25456024. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:02:08,989][27935] Avg episode reward: [(0, '-77.737')] [2022-07-12 20:02:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4988.1). Total num frames: 12753920. Throughput: 0: 9969.0. Samples: 25516360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:02:13,989][27935] Avg episode reward: [(0, '-78.141')] [2022-07-12 20:02:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 12777472. Throughput: 0: 9981.2. Samples: 25576188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:02:18,989][27935] Avg episode reward: [(0, '-77.326')] [2022-07-12 20:02:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 12804096. Throughput: 0: 10003.7. Samples: 25606608. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:02:23,989][27935] Avg episode reward: [(0, '-76.440')] [2022-07-12 20:02:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 12827648. Throughput: 0: 9994.0. Samples: 25667032. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:02:28,989][27935] Avg episode reward: [(0, '-76.050')] [2022-07-12 20:02:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 12855296. Throughput: 0: 9319.6. Samples: 25697176. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:02:33,989][27935] Avg episode reward: [(0, '-76.054')] [2022-07-12 20:02:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 12878848. Throughput: 0: 9974.5. Samples: 25757268. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:02:38,989][27935] Avg episode reward: [(0, '-76.667')] [2022-07-12 20:02:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4949.3, 300 sec: 4981.2). Total num frames: 12901376. Throughput: 0: 9928.0. Samples: 25815960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:02:43,989][27935] Avg episode reward: [(0, '-76.800')] [2022-07-12 20:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 12929024. Throughput: 0: 10028.9. Samples: 25877268. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:02:48,989][27935] Avg episode reward: [(0, '-78.748')] [2022-07-12 20:02:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 12955648. Throughput: 0: 10046.0. Samples: 25908096. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:02:53,989][27935] Avg episode reward: [(0, '-79.375')] [2022-07-12 20:02:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 12980224. Throughput: 0: 10063.4. Samples: 25969212. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:02:58,989][27935] Avg episode reward: [(0, '-80.810')] [2022-07-12 20:03:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 13002752. Throughput: 0: 10011.1. Samples: 26026688. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-12 20:03:03,989][27935] Avg episode reward: [(0, '-81.011')] [2022-07-12 20:03:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4984.6). Total num frames: 13029376. Throughput: 0: 10005.3. Samples: 26056848. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-12 20:03:08,989][27935] Avg episode reward: [(0, '-82.595')] [2022-07-12 20:03:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 13053952. Throughput: 0: 10027.7. Samples: 26118280. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-12 20:03:13,989][27935] Avg episode reward: [(0, '-81.345')] [2022-07-12 20:03:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4988.1). Total num frames: 13079552. Throughput: 0: 10711.8. Samples: 26179208. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-12 20:03:18,989][27935] Avg episode reward: [(0, '-80.734')] [2022-07-12 20:03:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 13106176. Throughput: 0: 10057.1. Samples: 26209836. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 20:03:23,989][27935] Avg episode reward: [(0, '-81.121')] [2022-07-12 20:03:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4995.0). Total num frames: 13130752. Throughput: 0: 10101.0. Samples: 26270504. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 20:03:28,989][27935] Avg episode reward: [(0, '-80.274')] [2022-07-12 20:03:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 13157376. Throughput: 0: 10085.2. Samples: 26331104. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 20:03:33,989][27935] Avg episode reward: [(0, '-80.350')] [2022-07-12 20:03:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 13180928. Throughput: 0: 10068.9. Samples: 26361196. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 20:03:38,989][27935] Avg episode reward: [(0, '-79.982')] [2022-07-12 20:03:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 4995.1). Total num frames: 13206528. Throughput: 0: 10067.4. Samples: 26422244. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-12 20:03:43,989][27935] Avg episode reward: [(0, '-79.456')] [2022-07-12 20:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 13231104. Throughput: 0: 10147.9. Samples: 26483344. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-12 20:03:48,989][27935] Avg episode reward: [(0, '-78.662')] [2022-07-12 20:03:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4998.5). Total num frames: 13257728. Throughput: 0: 10160.1. Samples: 26514052. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-12 20:03:53,989][27935] Avg episode reward: [(0, '-78.540')] [2022-07-12 20:03:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5005.5). Total num frames: 13283328. Throughput: 0: 10167.7. Samples: 26575824. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-12 20:03:58,989][27935] Avg episode reward: [(0, '-78.270')] [2022-07-12 20:04:03,996][27935] Fps is (10 sec: 5013.8, 60 sec: 5085.2, 300 sec: 5001.9). Total num frames: 13307904. Throughput: 0: 10096.7. Samples: 26633636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:04:03,997][27935] Avg episode reward: [(0, '-79.455')] [2022-07-12 20:04:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 13332480. Throughput: 0: 10089.7. Samples: 26663872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:04:08,989][27935] Avg episode reward: [(0, '-80.231')] [2022-07-12 20:04:13,989][27935] Fps is (10 sec: 4918.9, 60 sec: 5051.7, 300 sec: 4991.6). Total num frames: 13357056. Throughput: 0: 10075.5. Samples: 26723900. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:04:13,989][27935] Avg episode reward: [(0, '-81.668')] [2022-07-12 20:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 13381632. Throughput: 0: 10055.9. Samples: 26783620. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:04:18,989][27935] Avg episode reward: [(0, '-82.165')] [2022-07-12 20:04:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5002.0). Total num frames: 13408256. Throughput: 0: 10069.6. Samples: 26814328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:04:23,989][27935] Avg episode reward: [(0, '-82.013')] [2022-07-12 20:04:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 13431808. Throughput: 0: 10070.1. Samples: 26875400. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:04:28,989][27935] Avg episode reward: [(0, '-81.356')] [2022-07-12 20:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4995.0). Total num frames: 13457408. Throughput: 0: 10005.5. Samples: 26933592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:04:33,989][27935] Avg episode reward: [(0, '-80.756')] [2022-07-12 20:04:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 13481984. Throughput: 0: 9982.9. Samples: 26963284. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:04:38,989][27935] Avg episode reward: [(0, '-79.873')] [2022-07-12 20:04:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 13507584. Throughput: 0: 9966.7. Samples: 27024328. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-12 20:04:43,989][27935] Avg episode reward: [(0, '-79.639')] [2022-07-12 20:04:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 13533184. Throughput: 0: 10036.4. Samples: 27085196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-12 20:04:48,989][27935] Avg episode reward: [(0, '-77.180')] [2022-07-12 20:04:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4995.0). Total num frames: 13557760. Throughput: 0: 10033.1. Samples: 27115360. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-12 20:04:53,989][27935] Avg episode reward: [(0, '-76.482')] [2022-07-12 20:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 13584384. Throughput: 0: 10051.5. Samples: 27176216. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-12 20:04:58,990][27935] Avg episode reward: [(0, '-75.154')] [2022-07-12 20:05:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4984.1, 300 sec: 4998.5). Total num frames: 13606912. Throughput: 0: 9992.7. Samples: 27233292. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-12 20:05:03,989][27935] Avg episode reward: [(0, '-74.514')] [2022-07-12 20:05:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5002.0). Total num frames: 13632512. Throughput: 0: 9986.1. Samples: 27263700. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-12 20:05:08,989][27935] Avg episode reward: [(0, '-74.324')] [2022-07-12 20:05:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5002.0). Total num frames: 13658112. Throughput: 0: 9987.7. Samples: 27324848. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-12 20:05:13,989][27935] Avg episode reward: [(0, '-74.727')] [2022-07-12 20:05:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 13683712. Throughput: 0: 10053.6. Samples: 27386004. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-12 20:05:18,989][27935] Avg episode reward: [(0, '-74.171')] [2022-07-12 20:05:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 5005.5). Total num frames: 13707264. Throughput: 0: 10070.0. Samples: 27416436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-12 20:05:23,989][27935] Avg episode reward: [(0, '-73.782')] [2022-07-12 20:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 13732864. Throughput: 0: 10075.5. Samples: 27477724. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-12 20:05:28,989][27935] Avg episode reward: [(0, '-74.647')] [2022-07-12 20:05:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5008.9). Total num frames: 13759488. Throughput: 0: 10063.6. Samples: 27538056. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-12 20:05:33,989][27935] Avg episode reward: [(0, '-74.190')] [2022-07-12 20:05:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 13785088. Throughput: 0: 10061.3. Samples: 27568120. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-12 20:05:38,989][27935] Avg episode reward: [(0, '-74.508')] [2022-07-12 20:05:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 13810688. Throughput: 0: 10060.5. Samples: 27628936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:05:43,989][27935] Avg episode reward: [(0, '-75.432')] [2022-07-12 20:05:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 13834240. Throughput: 0: 10145.4. Samples: 27689836. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:05:48,989][27935] Avg episode reward: [(0, '-75.225')] [2022-07-12 20:05:53,992][27935] Fps is (10 sec: 5016.1, 60 sec: 5051.5, 300 sec: 5015.8). Total num frames: 13860864. Throughput: 0: 10151.1. Samples: 27720528. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:05:53,992][27935] Avg episode reward: [(0, '-74.693')] [2022-07-12 20:05:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5019.3). Total num frames: 13885440. Throughput: 0: 10154.9. Samples: 27781816. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:05:58,989][27935] Avg episode reward: [(0, '-75.125')] [2022-07-12 20:06:03,989][27935] Fps is (10 sec: 4916.7, 60 sec: 5051.7, 300 sec: 5022.8). Total num frames: 13910016. Throughput: 0: 10077.4. Samples: 27839488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:03,989][27935] Avg episode reward: [(0, '-75.031')] [2022-07-12 20:06:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5019.3). Total num frames: 13935616. Throughput: 0: 10082.5. Samples: 27870148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:08,989][27935] Avg episode reward: [(0, '-75.135')] [2022-07-12 20:06:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5026.3). Total num frames: 13961216. Throughput: 0: 10079.6. Samples: 27931308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:13,989][27935] Avg episode reward: [(0, '-73.981')] [2022-07-12 20:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5029.7). Total num frames: 13986816. Throughput: 0: 10091.6. Samples: 27992180. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:18,989][27935] Avg episode reward: [(0, '-74.111')] [2022-07-12 20:06:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5033.2). Total num frames: 14013440. Throughput: 0: 10114.4. Samples: 28023268. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:06:23,989][27935] Avg episode reward: [(0, '-73.677')] [2022-07-12 20:06:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5029.7). Total num frames: 14038016. Throughput: 0: 10127.1. Samples: 28084656. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:06:28,989][27935] Avg episode reward: [(0, '-73.602')] [2022-07-12 20:06:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5029.7). Total num frames: 14062592. Throughput: 0: 10130.5. Samples: 28145708. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:06:33,989][27935] Avg episode reward: [(0, '-72.958')] [2022-07-12 20:06:38,998][27935] Fps is (10 sec: 4910.9, 60 sec: 5033.9, 300 sec: 5026.1). Total num frames: 14087168. Throughput: 0: 10120.4. Samples: 28176004. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:06:38,998][27935] Avg episode reward: [(0, '-72.847')] [2022-07-12 20:06:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 14113792. Throughput: 0: 10114.6. Samples: 28236972. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:06:43,992][27935] Avg episode reward: [(0, '-72.347')] [2022-07-12 20:06:48,989][27935] Fps is (10 sec: 5227.0, 60 sec: 5085.9, 300 sec: 5033.2). Total num frames: 14139392. Throughput: 0: 10191.7. Samples: 28298116. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:48,989][27935] Avg episode reward: [(0, '-71.766')] [2022-07-12 20:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5069.1, 300 sec: 5033.2). Total num frames: 14164992. Throughput: 0: 10187.6. Samples: 28328588. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:53,996][27935] Avg episode reward: [(0, '-71.661')] [2022-07-12 20:06:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 14189568. Throughput: 0: 10178.0. Samples: 28389316. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:06:58,989][27935] Avg episode reward: [(0, '-71.154')] [2022-07-12 20:07:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 14214144. Throughput: 0: 10099.5. Samples: 28446656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:07:03,989][27935] Avg episode reward: [(0, '-72.502')] [2022-07-12 20:07:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 14238720. Throughput: 0: 10093.9. Samples: 28477492. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:07:08,989][27935] Avg episode reward: [(0, '-72.979')] [2022-07-12 20:07:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 14264320. Throughput: 0: 10075.6. Samples: 28538060. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:07:13,989][27935] Avg episode reward: [(0, '-72.919')] [2022-07-12 20:07:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 14289920. Throughput: 0: 10081.6. Samples: 28599380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:07:18,989][27935] Avg episode reward: [(0, '-73.144')] [2022-07-12 20:07:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5034.7, 300 sec: 5043.6). Total num frames: 14315520. Throughput: 0: 10093.5. Samples: 28630124. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:07:23,989][27935] Avg episode reward: [(0, '-73.899')] [2022-07-12 20:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 14342144. Throughput: 0: 10099.8. Samples: 28691464. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:07:28,989][27935] Avg episode reward: [(0, '-73.628')] [2022-07-12 20:07:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 14366720. Throughput: 0: 10081.0. Samples: 28751760. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:07:33,989][27935] Avg episode reward: [(0, '-74.124')] [2022-07-12 20:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5069.5, 300 sec: 5050.6). Total num frames: 14391296. Throughput: 0: 10081.2. Samples: 28782240. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:07:38,989][27935] Avg episode reward: [(0, '-74.809')] [2022-07-12 20:07:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14416896. Throughput: 0: 10059.2. Samples: 28841980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:07:43,989][27935] Avg episode reward: [(0, '-73.771')] [2022-07-12 20:07:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 14442496. Throughput: 0: 10137.7. Samples: 28902852. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:07:48,989][27935] Avg episode reward: [(0, '-74.117')] [2022-07-12 20:07:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14468096. Throughput: 0: 10138.5. Samples: 28933724. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:07:53,989][27935] Avg episode reward: [(0, '-73.323')] [2022-07-12 20:07:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 14491648. Throughput: 0: 10150.4. Samples: 28994828. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:07:58,989][27935] Avg episode reward: [(0, '-73.446')] [2022-07-12 20:08:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14517248. Throughput: 0: 10060.5. Samples: 29052104. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:08:03,989][27935] Avg episode reward: [(0, '-72.937')] [2022-07-12 20:08:08,995][27935] Fps is (10 sec: 5014.2, 60 sec: 5051.2, 300 sec: 5043.5). Total num frames: 14541824. Throughput: 0: 10059.0. Samples: 29082848. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:08:08,996][27935] Avg episode reward: [(0, '-72.399')] [2022-07-12 20:08:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14567424. Throughput: 0: 10053.0. Samples: 29143848. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:08:13,989][27935] Avg episode reward: [(0, '-71.587')] [2022-07-12 20:08:18,989][27935] Fps is (10 sec: 5021.0, 60 sec: 5034.7, 300 sec: 5036.7). Total num frames: 14592000. Throughput: 0: 10061.3. Samples: 29204520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:08:18,989][27935] Avg episode reward: [(0, '-72.630')] [2022-07-12 20:08:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 14617600. Throughput: 0: 10067.7. Samples: 29235284. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:08:23,989][27935] Avg episode reward: [(0, '-72.899')] [2022-07-12 20:08:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 14643200. Throughput: 0: 10087.9. Samples: 29295936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:08:28,989][27935] Avg episode reward: [(0, '-73.335')] [2022-07-12 20:08:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5043.6). Total num frames: 14668800. Throughput: 0: 10092.3. Samples: 29357004. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 20:08:33,989][27935] Avg episode reward: [(0, '-73.215')] [2022-07-12 20:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14694400. Throughput: 0: 10083.7. Samples: 29387488. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 20:08:38,990][27935] Avg episode reward: [(0, '-72.234')] [2022-07-12 20:08:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 14720000. Throughput: 0: 10092.3. Samples: 29448980. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 20:08:43,989][27935] Avg episode reward: [(0, '-72.060')] [2022-07-12 20:08:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 14744576. Throughput: 0: 10171.7. Samples: 29509832. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 20:08:48,989][27935] Avg episode reward: [(0, '-72.109')] [2022-07-12 20:08:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 14771200. Throughput: 0: 10178.1. Samples: 29540796. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 20:08:53,989][27935] Avg episode reward: [(0, '-72.111')] [2022-07-12 20:08:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5047.2). Total num frames: 14796800. Throughput: 0: 10178.1. Samples: 29601864. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 20:08:58,989][27935] Avg episode reward: [(0, '-71.073')] [2022-07-12 20:09:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 14819328. Throughput: 0: 10107.1. Samples: 29659340. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 20:09:03,989][27935] Avg episode reward: [(0, '-70.428')] [2022-07-12 20:09:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5035.2, 300 sec: 5040.2). Total num frames: 14843904. Throughput: 0: 10095.1. Samples: 29689564. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 20:09:08,989][27935] Avg episode reward: [(0, '-70.309')] [2022-07-12 20:09:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 14871552. Throughput: 0: 10103.4. Samples: 29750588. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-12 20:09:13,989][27935] Avg episode reward: [(0, '-70.598')] [2022-07-12 20:09:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 14896128. Throughput: 0: 10088.5. Samples: 29810988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:09:18,989][27935] Avg episode reward: [(0, '-70.554')] [2022-07-12 20:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 14920704. Throughput: 0: 10100.3. Samples: 29842000. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:09:23,989][27935] Avg episode reward: [(0, '-70.414')] [2022-07-12 20:09:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 14947328. Throughput: 0: 10092.9. Samples: 29903160. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:09:28,989][27935] Avg episode reward: [(0, '-70.471')] [2022-07-12 20:09:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 14970880. Throughput: 0: 10093.2. Samples: 29964028. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:09:33,989][27935] Avg episode reward: [(0, '-70.181')] [2022-07-12 20:09:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 14997504. Throughput: 0: 10076.2. Samples: 29994224. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 20:09:38,989][27935] Avg episode reward: [(0, '-70.367')] [2022-07-12 20:09:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 15023104. Throughput: 0: 10069.0. Samples: 30054968. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 20:09:43,989][27935] Avg episode reward: [(0, '-71.379')] [2022-07-12 20:09:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 15047680. Throughput: 0: 10145.2. Samples: 30115872. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 20:09:48,989][27935] Avg episode reward: [(0, '-71.508')] [2022-07-12 20:09:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 15073280. Throughput: 0: 10153.9. Samples: 30146488. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 20:09:53,989][27935] Avg episode reward: [(0, '-70.987')] [2022-07-12 20:09:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 15098880. Throughput: 0: 10145.2. Samples: 30207120. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 20:09:58,989][27935] Avg episode reward: [(0, '-71.096')] [2022-07-12 20:10:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 15122432. Throughput: 0: 10067.6. Samples: 30264028. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:10:03,989][27935] Avg episode reward: [(0, '-71.025')] [2022-07-12 20:10:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 15148032. Throughput: 0: 10058.1. Samples: 30294616. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:10:08,989][27935] Avg episode reward: [(0, '-71.086')] [2022-07-12 20:10:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 15173632. Throughput: 0: 10054.7. Samples: 30355620. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:10:13,989][27935] Avg episode reward: [(0, '-70.593')] [2022-07-12 20:10:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 15199232. Throughput: 0: 10060.4. Samples: 30416748. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:10:18,989][27935] Avg episode reward: [(0, '-70.762')] [2022-07-12 20:10:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 15223808. Throughput: 0: 10076.6. Samples: 30447672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:10:23,989][27935] Avg episode reward: [(0, '-71.029')] [2022-07-12 20:10:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 15250432. Throughput: 0: 10090.7. Samples: 30509048. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:10:28,989][27935] Avg episode reward: [(0, '-70.716')] [2022-07-12 20:10:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 15275008. Throughput: 0: 10070.7. Samples: 30569052. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:10:33,989][27935] Avg episode reward: [(0, '-71.159')] [2022-07-12 20:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5043.6). Total num frames: 15298560. Throughput: 0: 10021.1. Samples: 30597436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:10:38,990][27935] Avg episode reward: [(0, '-72.041')] [2022-07-12 20:10:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5047.1). Total num frames: 15323136. Throughput: 0: 9997.9. Samples: 30657028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:10:43,989][27935] Avg episode reward: [(0, '-71.900')] [2022-07-12 20:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5043.7). Total num frames: 15348736. Throughput: 0: 10068.6. Samples: 30717116. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:10:48,989][27935] Avg episode reward: [(0, '-72.015')] [2022-07-12 20:10:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5047.1). Total num frames: 15374336. Throughput: 0: 10060.6. Samples: 30747344. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:10:53,990][27935] Avg episode reward: [(0, '-71.079')] [2022-07-12 20:10:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5047.1). Total num frames: 15398912. Throughput: 0: 10045.9. Samples: 30807684. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:10:58,989][27935] Avg episode reward: [(0, '-71.735')] [2022-07-12 20:11:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5040.2). Total num frames: 15422464. Throughput: 0: 9930.7. Samples: 30863628. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 20:11:03,989][27935] Avg episode reward: [(0, '-72.212')] [2022-07-12 20:11:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4949.3, 300 sec: 5029.7). Total num frames: 15444992. Throughput: 0: 9917.2. Samples: 30893948. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 20:11:08,989][27935] Avg episode reward: [(0, '-72.636')] [2022-07-12 20:11:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5036.7). Total num frames: 15472640. Throughput: 0: 9895.8. Samples: 30954360. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 20:11:13,991][27935] Avg episode reward: [(0, '-71.309')] [2022-07-12 20:11:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 5029.7). Total num frames: 15497216. Throughput: 0: 9230.1. Samples: 30984408. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 20:11:18,989][27935] Avg episode reward: [(0, '-71.476')] [2022-07-12 20:11:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5036.7). Total num frames: 15523840. Throughput: 0: 9957.1. Samples: 31045504. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-12 20:11:23,989][27935] Avg episode reward: [(0, '-71.362')] [2022-07-12 20:11:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5036.7). Total num frames: 15548416. Throughput: 0: 9983.3. Samples: 31106276. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 20:11:28,990][27935] Avg episode reward: [(0, '-71.728')] [2022-07-12 20:11:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5040.3). Total num frames: 15574016. Throughput: 0: 9985.5. Samples: 31166464. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 20:11:33,989][27935] Avg episode reward: [(0, '-71.991')] [2022-07-12 20:11:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5033.2). Total num frames: 15598592. Throughput: 0: 9994.0. Samples: 31197072. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 20:11:38,989][27935] Avg episode reward: [(0, '-72.083')] [2022-07-12 20:11:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5033.2). Total num frames: 15624192. Throughput: 0: 10012.0. Samples: 31258224. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 20:11:43,989][27935] Avg episode reward: [(0, '-71.716')] [2022-07-12 20:11:48,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5017.6, 300 sec: 5033.2). Total num frames: 15649792. Throughput: 0: 10127.8. Samples: 31319380. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-12 20:11:48,989][27935] Avg episode reward: [(0, '-71.806')] [2022-07-12 20:11:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 15675392. Throughput: 0: 10128.4. Samples: 31349724. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:11:53,989][27935] Avg episode reward: [(0, '-71.774')] [2022-07-12 20:11:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 15699968. Throughput: 0: 10156.2. Samples: 31411392. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:11:58,990][27935] Avg episode reward: [(0, '-72.045')] [2022-07-12 20:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 15725568. Throughput: 0: 10769.2. Samples: 31469020. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:12:03,989][27935] Avg episode reward: [(0, '-71.213')] [2022-07-12 20:12:08,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5102.9, 300 sec: 5040.2). Total num frames: 15751168. Throughput: 0: 10101.3. Samples: 31500064. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:12:08,989][27935] Avg episode reward: [(0, '-70.631')] [2022-07-12 20:12:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 15775744. Throughput: 0: 10115.9. Samples: 31561492. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:12:13,989][27935] Avg episode reward: [(0, '-70.795')] [2022-07-12 20:12:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5040.2). Total num frames: 15802368. Throughput: 0: 10128.9. Samples: 31622264. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:12:18,989][27935] Avg episode reward: [(0, '-70.593')] [2022-07-12 20:12:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 15826944. Throughput: 0: 10133.4. Samples: 31653076. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:12:23,989][27935] Avg episode reward: [(0, '-70.590')] [2022-07-12 20:12:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 15852544. Throughput: 0: 10139.1. Samples: 31714484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:12:28,989][27935] Avg episode reward: [(0, '-69.905')] [2022-07-12 20:12:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 15877120. Throughput: 0: 10134.4. Samples: 31775424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:12:33,989][27935] Avg episode reward: [(0, '-70.008')] [2022-07-12 20:12:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5040.2). Total num frames: 15903744. Throughput: 0: 10142.4. Samples: 31806132. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 20:12:38,989][27935] Avg episode reward: [(0, '-69.634')] [2022-07-12 20:12:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 15927296. Throughput: 0: 10103.7. Samples: 31866056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 20:12:43,989][27935] Avg episode reward: [(0, '-69.066')] [2022-07-12 20:12:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 15953920. Throughput: 0: 10180.6. Samples: 31927148. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 20:12:48,989][27935] Avg episode reward: [(0, '-69.167')] [2022-07-12 20:12:53,991][27935] Fps is (10 sec: 5323.6, 60 sec: 5085.7, 300 sec: 5047.1). Total num frames: 15980544. Throughput: 0: 10170.0. Samples: 31957736. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 20:12:53,992][27935] Avg episode reward: [(0, '-68.526')] [2022-07-12 20:12:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 16004096. Throughput: 0: 10165.2. Samples: 32018928. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 20:12:58,989][27935] Avg episode reward: [(0, '-68.738')] [2022-07-12 20:13:03,989][27935] Fps is (10 sec: 4813.9, 60 sec: 5051.7, 300 sec: 5040.3). Total num frames: 16028672. Throughput: 0: 10097.2. Samples: 32076640. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 20:13:03,989][27935] Avg episode reward: [(0, '-68.686')] [2022-07-12 20:13:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5036.7). Total num frames: 16053248. Throughput: 0: 10091.9. Samples: 32107212. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 20:13:08,989][27935] Avg episode reward: [(0, '-68.682')] [2022-07-12 20:13:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 16079872. Throughput: 0: 10097.4. Samples: 32168868. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 20:13:13,989][27935] Avg episode reward: [(0, '-68.508')] [2022-07-12 20:13:18,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 16105472. Throughput: 0: 10103.7. Samples: 32230092. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-12 20:13:18,989][27935] Avg episode reward: [(0, '-68.872')] [2022-07-12 20:13:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 16131072. Throughput: 0: 10099.9. Samples: 32260628. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 20:13:23,989][27935] Avg episode reward: [(0, '-69.554')] [2022-07-12 20:13:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 16156672. Throughput: 0: 10135.0. Samples: 32322132. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 20:13:28,989][27935] Avg episode reward: [(0, '-69.480')] [2022-07-12 20:13:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 16182272. Throughput: 0: 10138.5. Samples: 32383380. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 20:13:33,989][27935] Avg episode reward: [(0, '-69.689')] [2022-07-12 20:13:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 16207872. Throughput: 0: 10125.5. Samples: 32413360. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 20:13:38,989][27935] Avg episode reward: [(0, '-69.909')] [2022-07-12 20:13:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 16232448. Throughput: 0: 10134.4. Samples: 32474976. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 20:13:43,989][27935] Avg episode reward: [(0, '-70.148')] [2022-07-12 20:13:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 16258048. Throughput: 0: 10215.9. Samples: 32536356. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:13:48,989][27935] Avg episode reward: [(0, '-69.849')] [2022-07-12 20:13:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.9, 300 sec: 5040.2). Total num frames: 16283648. Throughput: 0: 10215.3. Samples: 32566900. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:13:53,989][27935] Avg episode reward: [(0, '-69.939')] [2022-07-12 20:13:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 16310272. Throughput: 0: 10213.8. Samples: 32628488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:13:58,989][27935] Avg episode reward: [(0, '-70.388')] [2022-07-12 20:14:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 16332800. Throughput: 0: 10131.6. Samples: 32686016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:14:03,989][27935] Avg episode reward: [(0, '-71.061')] [2022-07-12 20:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 16357376. Throughput: 0: 10137.7. Samples: 32716824. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:14:08,989][27935] Avg episode reward: [(0, '-71.710')] [2022-07-12 20:14:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 16384000. Throughput: 0: 10136.1. Samples: 32778256. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:14:13,989][27935] Avg episode reward: [(0, '-71.837')] [2022-07-12 20:14:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 16409600. Throughput: 0: 10147.7. Samples: 32840028. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:14:18,989][27935] Avg episode reward: [(0, '-71.547')] [2022-07-12 20:14:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 16437248. Throughput: 0: 10167.6. Samples: 32870900. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:14:23,989][27935] Avg episode reward: [(0, '-71.773')] [2022-07-12 20:14:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5054.0). Total num frames: 16461824. Throughput: 0: 10176.1. Samples: 32932900. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:14:28,989][27935] Avg episode reward: [(0, '-70.703')] [2022-07-12 20:14:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 16487424. Throughput: 0: 10169.1. Samples: 32993964. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:14:33,989][27935] Avg episode reward: [(0, '-69.743')] [2022-07-12 20:14:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 16513024. Throughput: 0: 10178.5. Samples: 33024936. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:14:38,989][27935] Avg episode reward: [(0, '-69.368')] [2022-07-12 20:14:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 16537600. Throughput: 0: 10178.3. Samples: 33086512. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:14:43,989][27935] Avg episode reward: [(0, '-68.618')] [2022-07-12 20:14:48,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5120.0, 300 sec: 5057.5). Total num frames: 16565248. Throughput: 0: 10269.4. Samples: 33148140. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:14:48,989][27935] Avg episode reward: [(0, '-68.749')] [2022-07-12 20:14:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 16589824. Throughput: 0: 10264.5. Samples: 33178728. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:14:53,989][27935] Avg episode reward: [(0, '-68.637')] [2022-07-12 20:14:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5064.5). Total num frames: 16616448. Throughput: 0: 10265.8. Samples: 33240216. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:14:58,989][27935] Avg episode reward: [(0, '-68.706')] [2022-07-12 20:15:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 16638976. Throughput: 0: 10157.6. Samples: 33297120. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:15:03,989][27935] Avg episode reward: [(0, '-69.342')] [2022-07-12 20:15:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 16663552. Throughput: 0: 10154.2. Samples: 33327840. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:15:08,989][27935] Avg episode reward: [(0, '-69.315')] [2022-07-12 20:15:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 16690176. Throughput: 0: 10130.7. Samples: 33388780. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:15:13,989][27935] Avg episode reward: [(0, '-68.955')] [2022-07-12 20:15:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 16715776. Throughput: 0: 9448.3. Samples: 33419136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:15:18,992][27935] Avg episode reward: [(0, '-69.094')] [2022-07-12 20:15:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 16740352. Throughput: 0: 10132.9. Samples: 33480916. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:15:23,989][27935] Avg episode reward: [(0, '-69.034')] [2022-07-12 20:15:28,997][27935] Fps is (10 sec: 5116.0, 60 sec: 5085.2, 300 sec: 5057.4). Total num frames: 16766976. Throughput: 0: 10129.5. Samples: 33542420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:15:28,997][27935] Avg episode reward: [(0, '-69.206')] [2022-07-12 20:15:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 16791552. Throughput: 0: 10112.8. Samples: 33603216. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:15:33,989][27935] Avg episode reward: [(0, '-68.796')] [2022-07-12 20:15:38,989][27935] Fps is (10 sec: 5021.5, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 16817152. Throughput: 0: 10113.3. Samples: 33633828. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:15:38,989][27935] Avg episode reward: [(0, '-68.745')] [2022-07-12 20:15:43,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 16842752. Throughput: 0: 10098.0. Samples: 33694628. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 20:15:43,989][27935] Avg episode reward: [(0, '-69.427')] [2022-07-12 20:15:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 16869376. Throughput: 0: 10195.8. Samples: 33755932. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:15:48,989][27935] Avg episode reward: [(0, '-69.240')] [2022-07-12 20:15:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 16894976. Throughput: 0: 10189.6. Samples: 33786372. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:15:53,989][27935] Avg episode reward: [(0, '-69.132')] [2022-07-12 20:15:58,990][27935] Fps is (10 sec: 4914.4, 60 sec: 5034.5, 300 sec: 5071.4). Total num frames: 16918528. Throughput: 0: 10195.7. Samples: 33847604. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:15:58,991][27935] Avg episode reward: [(0, '-68.896')] [2022-07-12 20:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 16942080. Throughput: 0: 10796.7. Samples: 33904988. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:16:03,989][27935] Avg episode reward: [(0, '-69.384')] [2022-07-12 20:16:08,989][27935] Fps is (10 sec: 5018.4, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 16968704. Throughput: 0: 10102.6. Samples: 33935532. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:16:08,989][27935] Avg episode reward: [(0, '-69.519')] [2022-07-12 20:16:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 16994304. Throughput: 0: 10086.4. Samples: 33996228. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:16:13,989][27935] Avg episode reward: [(0, '-69.259')] [2022-07-12 20:16:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 17017856. Throughput: 0: 10081.0. Samples: 34056864. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:16:18,989][27935] Avg episode reward: [(0, '-69.082')] [2022-07-12 20:16:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 17044480. Throughput: 0: 10078.7. Samples: 34087372. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:16:23,989][27935] Avg episode reward: [(0, '-68.674')] [2022-07-12 20:16:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5035.3, 300 sec: 5067.9). Total num frames: 17069056. Throughput: 0: 10077.4. Samples: 34148112. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:16:28,989][27935] Avg episode reward: [(0, '-69.406')] [2022-07-12 20:16:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 17094656. Throughput: 0: 10066.7. Samples: 34208932. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:16:33,989][27935] Avg episode reward: [(0, '-69.614')] [2022-07-12 20:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 17119232. Throughput: 0: 10074.0. Samples: 34239700. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:16:38,989][27935] Avg episode reward: [(0, '-69.488')] [2022-07-12 20:16:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 17144832. Throughput: 0: 10014.3. Samples: 34298232. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:16:43,989][27935] Avg episode reward: [(0, '-69.560')] [2022-07-12 20:16:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5064.5). Total num frames: 17169408. Throughput: 0: 10098.4. Samples: 34359416. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:16:48,989][27935] Avg episode reward: [(0, '-69.518')] [2022-07-12 20:16:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 17196032. Throughput: 0: 10105.3. Samples: 34390268. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 20:16:53,989][27935] Avg episode reward: [(0, '-70.156')] [2022-07-12 20:16:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.9, 300 sec: 5071.4). Total num frames: 17221632. Throughput: 0: 10119.0. Samples: 34451584. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:16:58,989][27935] Avg episode reward: [(0, '-69.930')] [2022-07-12 20:17:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 17245184. Throughput: 0: 10051.4. Samples: 34509176. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:17:03,989][27935] Avg episode reward: [(0, '-70.514')] [2022-07-12 20:17:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 17270784. Throughput: 0: 10066.0. Samples: 34540340. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:17:08,989][27935] Avg episode reward: [(0, '-69.689')] [2022-07-12 20:17:13,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 17296384. Throughput: 0: 10086.5. Samples: 34602004. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:17:13,989][27935] Avg episode reward: [(0, '-69.510')] [2022-07-12 20:17:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 17320960. Throughput: 0: 10096.1. Samples: 34663256. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:17:18,989][27935] Avg episode reward: [(0, '-70.254')] [2022-07-12 20:17:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 17348608. Throughput: 0: 10105.6. Samples: 34694452. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 20:17:23,989][27935] Avg episode reward: [(0, '-70.546')] [2022-07-12 20:17:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 17374208. Throughput: 0: 10161.0. Samples: 34755476. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 20:17:28,989][27935] Avg episode reward: [(0, '-70.572')] [2022-07-12 20:17:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 17398784. Throughput: 0: 10172.7. Samples: 34817188. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 20:17:33,989][27935] Avg episode reward: [(0, '-70.207')] [2022-07-12 20:17:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 17424384. Throughput: 0: 10175.3. Samples: 34848156. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 20:17:38,989][27935] Avg episode reward: [(0, '-70.093')] [2022-07-12 20:17:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 17449984. Throughput: 0: 10145.6. Samples: 34908136. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 20:17:43,989][27935] Avg episode reward: [(0, '-70.630')] [2022-07-12 20:17:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 17474560. Throughput: 0: 10230.5. Samples: 34969548. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:17:48,989][27935] Avg episode reward: [(0, '-69.500')] [2022-07-12 20:17:53,990][27935] Fps is (10 sec: 5016.8, 60 sec: 5068.7, 300 sec: 5071.4). Total num frames: 17500160. Throughput: 0: 10222.5. Samples: 35000368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:17:53,991][27935] Avg episode reward: [(0, '-70.234')] [2022-07-12 20:17:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 17526784. Throughput: 0: 10213.8. Samples: 35061624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:17:58,989][27935] Avg episode reward: [(0, '-71.368')] [2022-07-12 20:18:03,989][27935] Fps is (10 sec: 5018.4, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 17550336. Throughput: 0: 10125.0. Samples: 35118880. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:18:03,989][27935] Avg episode reward: [(0, '-70.532')] [2022-07-12 20:18:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 17573888. Throughput: 0: 10120.5. Samples: 35149876. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:18:08,989][27935] Avg episode reward: [(0, '-70.577')] [2022-07-12 20:18:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 17602560. Throughput: 0: 10134.9. Samples: 35211548. Policy #0 lag: (min: 1.0, avg: 9.7, max: 21.0) [2022-07-12 20:18:13,989][27935] Avg episode reward: [(0, '-69.438')] [2022-07-12 20:18:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 17625088. Throughput: 0: 10115.9. Samples: 35272404. Policy #0 lag: (min: 1.0, avg: 9.7, max: 21.0) [2022-07-12 20:18:18,989][27935] Avg episode reward: [(0, '-68.695')] [2022-07-12 20:18:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 17652736. Throughput: 0: 10113.0. Samples: 35303240. Policy #0 lag: (min: 1.0, avg: 9.7, max: 21.0) [2022-07-12 20:18:23,989][27935] Avg episode reward: [(0, '-68.419')] [2022-07-12 20:18:28,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5051.4, 300 sec: 5067.9). Total num frames: 17677312. Throughput: 0: 10149.9. Samples: 35364916. Policy #0 lag: (min: 1.0, avg: 9.7, max: 21.0) [2022-07-12 20:18:28,993][27935] Avg episode reward: [(0, '-67.434')] [2022-07-12 20:18:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 17703936. Throughput: 0: 10142.7. Samples: 35425968. Policy #0 lag: (min: 1.0, avg: 9.7, max: 21.0) [2022-07-12 20:18:33,989][27935] Avg episode reward: [(0, '-66.334')] [2022-07-12 20:18:38,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 17728512. Throughput: 0: 10140.5. Samples: 35456676. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:18:38,989][27935] Avg episode reward: [(0, '-66.291')] [2022-07-12 20:18:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 17754112. Throughput: 0: 10147.4. Samples: 35518256. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:18:43,989][27935] Avg episode reward: [(0, '-66.342')] [2022-07-12 20:18:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 17779712. Throughput: 0: 10217.8. Samples: 35578680. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:18:48,989][27935] Avg episode reward: [(0, '-66.857')] [2022-07-12 20:18:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.0, 300 sec: 5067.9). Total num frames: 17805312. Throughput: 0: 10215.3. Samples: 35609564. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:18:53,989][27935] Avg episode reward: [(0, '-66.973')] [2022-07-12 20:18:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 17831936. Throughput: 0: 10214.7. Samples: 35671208. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:18:58,989][27935] Avg episode reward: [(0, '-66.860')] [2022-07-12 20:19:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 17853440. Throughput: 0: 10126.5. Samples: 35728096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 20:19:03,989][27935] Avg episode reward: [(0, '-67.228')] [2022-07-12 20:19:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 17881088. Throughput: 0: 10123.1. Samples: 35758780. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 20:19:08,989][27935] Avg episode reward: [(0, '-67.468')] [2022-07-12 20:19:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 17905664. Throughput: 0: 10120.7. Samples: 35820312. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 20:19:13,989][27935] Avg episode reward: [(0, '-67.859')] [2022-07-12 20:19:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5064.5). Total num frames: 17931264. Throughput: 0: 10137.9. Samples: 35882172. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 20:19:18,990][27935] Avg episode reward: [(0, '-68.430')] [2022-07-12 20:19:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 17956864. Throughput: 0: 10141.1. Samples: 35913024. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 20:19:23,989][27935] Avg episode reward: [(0, '-68.429')] [2022-07-12 20:19:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.2, 300 sec: 5067.9). Total num frames: 17982464. Throughput: 0: 10144.9. Samples: 35974776. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:28,989][27935] Avg episode reward: [(0, '-68.902')] [2022-07-12 20:19:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 18008064. Throughput: 0: 9466.7. Samples: 36004680. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:33,989][27935] Avg episode reward: [(0, '-69.182')] [2022-07-12 20:19:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 18033664. Throughput: 0: 10140.3. Samples: 36065876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:38,989][27935] Avg episode reward: [(0, '-69.042')] [2022-07-12 20:19:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 18057216. Throughput: 0: 10122.9. Samples: 36126740. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:43,989][27935] Avg episode reward: [(0, '-69.025')] [2022-07-12 20:19:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 18084864. Throughput: 0: 10209.7. Samples: 36187532. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:48,989][27935] Avg episode reward: [(0, '-68.589')] [2022-07-12 20:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 18109440. Throughput: 0: 10205.4. Samples: 36218024. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:19:53,989][27935] Avg episode reward: [(0, '-68.905')] [2022-07-12 20:19:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 18136064. Throughput: 0: 10193.1. Samples: 36279000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 20:19:58,989][27935] Avg episode reward: [(0, '-68.136')] [2022-07-12 20:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 18157568. Throughput: 0: 10085.4. Samples: 36336016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 20:20:03,989][27935] Avg episode reward: [(0, '-67.890')] [2022-07-12 20:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 18183168. Throughput: 0: 10081.2. Samples: 36366680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 20:20:08,989][27935] Avg episode reward: [(0, '-66.971')] [2022-07-12 20:20:13,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5034.5, 300 sec: 5057.5). Total num frames: 18207744. Throughput: 0: 10057.4. Samples: 36427380. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 20:20:13,991][27935] Avg episode reward: [(0, '-66.909')] [2022-07-12 20:20:18,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 18235392. Throughput: 0: 10741.2. Samples: 36488032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-12 20:20:18,989][27935] Avg episode reward: [(0, '-65.982')] [2022-07-12 20:20:23,989][27935] Fps is (10 sec: 5121.0, 60 sec: 5034.7, 300 sec: 5057.7). Total num frames: 18258944. Throughput: 0: 10051.1. Samples: 36518176. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:20:23,989][27935] Avg episode reward: [(0, '-65.590')] [2022-07-12 20:20:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 18284544. Throughput: 0: 10027.3. Samples: 36577968. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:20:28,990][27935] Avg episode reward: [(0, '-66.317')] [2022-07-12 20:20:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 18309120. Throughput: 0: 10004.9. Samples: 36637752. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:20:33,990][27935] Avg episode reward: [(0, '-65.771')] [2022-07-12 20:20:38,990][27935] Fps is (10 sec: 5017.1, 60 sec: 5017.5, 300 sec: 5057.5). Total num frames: 18334720. Throughput: 0: 9995.2. Samples: 36667816. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:20:38,990][27935] Avg episode reward: [(0, '-66.424')] [2022-07-12 20:20:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 18361344. Throughput: 0: 9996.6. Samples: 36728848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:20:43,989][27935] Avg episode reward: [(0, '-66.797')] [2022-07-12 20:20:49,004][27935] Fps is (10 sec: 4908.4, 60 sec: 4982.2, 300 sec: 5046.9). Total num frames: 18383872. Throughput: 0: 10082.1. Samples: 36789860. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:20:49,004][27935] Avg episode reward: [(0, '-66.864')] [2022-07-12 20:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 18410496. Throughput: 0: 10084.1. Samples: 36820464. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:20:53,990][27935] Avg episode reward: [(0, '-67.384')] [2022-07-12 20:20:58,989][27935] Fps is (10 sec: 5332.7, 60 sec: 5017.6, 300 sec: 5067.9). Total num frames: 18437120. Throughput: 0: 10094.8. Samples: 36881628. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:20:58,989][27935] Avg episode reward: [(0, '-67.191')] [2022-07-12 20:21:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5054.0). Total num frames: 18459648. Throughput: 0: 10021.9. Samples: 36939016. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:21:03,989][27935] Avg episode reward: [(0, '-67.044')] [2022-07-12 20:21:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5054.0). Total num frames: 18485248. Throughput: 0: 10025.9. Samples: 36969340. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:21:08,989][27935] Avg episode reward: [(0, '-67.731')] [2022-07-12 20:21:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.9, 300 sec: 5061.0). Total num frames: 18510848. Throughput: 0: 10060.7. Samples: 37030700. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 20:21:13,989][27935] Avg episode reward: [(0, '-67.531')] [2022-07-12 20:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 18536448. Throughput: 0: 10093.8. Samples: 37091972. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 20:21:18,989][27935] Avg episode reward: [(0, '-68.126')] [2022-07-12 20:21:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 18561024. Throughput: 0: 10105.1. Samples: 37122536. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 20:21:23,989][27935] Avg episode reward: [(0, '-67.870')] [2022-07-12 20:21:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 18586624. Throughput: 0: 10110.0. Samples: 37183800. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 20:21:28,989][27935] Avg episode reward: [(0, '-68.386')] [2022-07-12 20:21:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 18612224. Throughput: 0: 9432.4. Samples: 37214180. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-12 20:21:33,989][27935] Avg episode reward: [(0, '-68.406')] [2022-07-12 20:21:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.8, 300 sec: 5061.0). Total num frames: 18637824. Throughput: 0: 10075.6. Samples: 37273868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:21:38,989][27935] Avg episode reward: [(0, '-68.396')] [2022-07-12 20:21:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5061.0). Total num frames: 18662400. Throughput: 0: 10075.8. Samples: 37335040. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:21:43,989][27935] Avg episode reward: [(0, '-69.110')] [2022-07-12 20:21:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5070.0, 300 sec: 5057.5). Total num frames: 18688000. Throughput: 0: 10162.4. Samples: 37396324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:21:48,989][27935] Avg episode reward: [(0, '-69.017')] [2022-07-12 20:21:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 18714624. Throughput: 0: 10176.6. Samples: 37427288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:21:53,991][27935] Avg episode reward: [(0, '-70.106')] [2022-07-12 20:21:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 18739200. Throughput: 0: 10162.7. Samples: 37488020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-12 20:21:58,989][27935] Avg episode reward: [(0, '-69.818')] [2022-07-12 20:22:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 18763776. Throughput: 0: 10063.4. Samples: 37544824. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:03,989][27935] Avg episode reward: [(0, '-70.005')] [2022-07-12 20:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5017.6, 300 sec: 5050.6). Total num frames: 18786304. Throughput: 0: 10051.6. Samples: 37574860. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:08,989][27935] Avg episode reward: [(0, '-69.280')] [2022-07-12 20:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5054.0). Total num frames: 18811904. Throughput: 0: 10009.1. Samples: 37634208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:13,989][27935] Avg episode reward: [(0, '-68.327')] [2022-07-12 20:22:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 18838528. Throughput: 0: 10667.1. Samples: 37694200. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:18,989][27935] Avg episode reward: [(0, '-67.809')] [2022-07-12 20:22:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5043.6). Total num frames: 18862080. Throughput: 0: 10003.8. Samples: 37724040. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:23,989][27935] Avg episode reward: [(0, '-67.341')] [2022-07-12 20:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5047.1). Total num frames: 18887680. Throughput: 0: 9990.8. Samples: 37784624. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:22:28,989][27935] Avg episode reward: [(0, '-66.738')] [2022-07-12 20:22:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5043.6). Total num frames: 18912256. Throughput: 0: 9973.1. Samples: 37845112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:22:33,989][27935] Avg episode reward: [(0, '-66.721')] [2022-07-12 20:22:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 18939904. Throughput: 0: 9963.0. Samples: 37875624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:22:38,989][27935] Avg episode reward: [(0, '-66.741')] [2022-07-12 20:22:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5043.6). Total num frames: 18962432. Throughput: 0: 9930.9. Samples: 37934912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:22:43,989][27935] Avg episode reward: [(0, '-66.667')] [2022-07-12 20:22:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4966.4, 300 sec: 5036.7). Total num frames: 18985984. Throughput: 0: 9960.2. Samples: 37993032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:22:48,989][27935] Avg episode reward: [(0, '-66.870')] [2022-07-12 20:22:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5036.7). Total num frames: 19012608. Throughput: 0: 9955.6. Samples: 38022864. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:22:53,989][27935] Avg episode reward: [(0, '-66.259')] [2022-07-12 20:22:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5040.2). Total num frames: 19037184. Throughput: 0: 9996.9. Samples: 38084068. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 20:22:58,989][27935] Avg episode reward: [(0, '-66.665')] [2022-07-12 20:23:03,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4966.3, 300 sec: 5043.6). Total num frames: 19061760. Throughput: 0: 9939.1. Samples: 38141472. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 20:23:03,991][27935] Avg episode reward: [(0, '-66.386')] [2022-07-12 20:23:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5029.8). Total num frames: 19086336. Throughput: 0: 9961.2. Samples: 38172296. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 20:23:08,989][27935] Avg episode reward: [(0, '-66.458')] [2022-07-12 20:23:13,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4983.5, 300 sec: 5036.7). Total num frames: 19110912. Throughput: 0: 9976.1. Samples: 38233548. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 20:23:13,989][27935] Avg episode reward: [(0, '-66.548')] [2022-07-12 20:23:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5033.2). Total num frames: 19137536. Throughput: 0: 9988.2. Samples: 38294580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 20:23:18,989][27935] Avg episode reward: [(0, '-67.163')] [2022-07-12 20:23:23,991][27935] Fps is (10 sec: 5221.5, 60 sec: 5017.4, 300 sec: 5036.7). Total num frames: 19163136. Throughput: 0: 9996.0. Samples: 38325464. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:24,001][27935] Avg episode reward: [(0, '-67.526')] [2022-07-12 20:23:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5029.8). Total num frames: 19187712. Throughput: 0: 10038.2. Samples: 38386632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:28,989][27935] Avg episode reward: [(0, '-68.111')] [2022-07-12 20:23:33,996][27935] Fps is (10 sec: 5117.0, 60 sec: 5034.0, 300 sec: 5036.6). Total num frames: 19214336. Throughput: 0: 10105.1. Samples: 38447840. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:33,997][27935] Avg episode reward: [(0, '-67.340')] [2022-07-12 20:23:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 5036.7). Total num frames: 19239936. Throughput: 0: 10126.7. Samples: 38478564. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:38,989][27935] Avg episode reward: [(0, '-67.162')] [2022-07-12 20:23:43,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 19265536. Throughput: 0: 10128.6. Samples: 38539856. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:43,989][27935] Avg episode reward: [(0, '-67.183')] [2022-07-12 20:23:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5033.2). Total num frames: 19290112. Throughput: 0: 10214.8. Samples: 38601124. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:23:48,991][27935] Avg episode reward: [(0, '-67.739')] [2022-07-12 20:23:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5029.7). Total num frames: 19315712. Throughput: 0: 10207.4. Samples: 38631628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:23:53,989][27935] Avg episode reward: [(0, '-67.205')] [2022-07-12 20:23:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 19343360. Throughput: 0: 10208.8. Samples: 38692944. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:23:58,989][27935] Avg episode reward: [(0, '-67.509')] [2022-07-12 20:24:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.8, 300 sec: 5029.7). Total num frames: 19364864. Throughput: 0: 10132.1. Samples: 38750524. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:24:03,989][27935] Avg episode reward: [(0, '-68.084')] [2022-07-12 20:24:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5033.2). Total num frames: 19390464. Throughput: 0: 10114.9. Samples: 38780616. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:24:08,989][27935] Avg episode reward: [(0, '-68.425')] [2022-07-12 20:24:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5036.7). Total num frames: 19417088. Throughput: 0: 10124.0. Samples: 38842212. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:24:13,990][27935] Avg episode reward: [(0, '-68.035')] [2022-07-12 20:24:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 19442688. Throughput: 0: 10126.7. Samples: 38903464. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:24:18,991][27935] Avg episode reward: [(0, '-67.696')] [2022-07-12 20:24:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5069.0, 300 sec: 5033.2). Total num frames: 19467264. Throughput: 0: 10123.9. Samples: 38934140. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:24:23,990][27935] Avg episode reward: [(0, '-67.174')] [2022-07-12 20:24:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5036.7). Total num frames: 19493888. Throughput: 0: 10125.7. Samples: 38995512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:24:28,990][27935] Avg episode reward: [(0, '-66.035')] [2022-07-12 20:24:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5086.5, 300 sec: 5036.7). Total num frames: 19519488. Throughput: 0: 10118.7. Samples: 39056464. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:24:33,989][27935] Avg episode reward: [(0, '-66.186')] [2022-07-12 20:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 19543040. Throughput: 0: 10125.1. Samples: 39087256. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-12 20:24:38,989][27935] Avg episode reward: [(0, '-65.590')] [2022-07-12 20:24:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 19570688. Throughput: 0: 10131.1. Samples: 39148844. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:24:43,990][27935] Avg episode reward: [(0, '-65.816')] [2022-07-12 20:24:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5033.2). Total num frames: 19594240. Throughput: 0: 10230.6. Samples: 39210900. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:24:48,989][27935] Avg episode reward: [(0, '-65.950')] [2022-07-12 20:24:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5036.7). Total num frames: 19621888. Throughput: 0: 10249.2. Samples: 39241832. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:24:53,990][27935] Avg episode reward: [(0, '-65.247')] [2022-07-12 20:24:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 19647488. Throughput: 0: 10252.5. Samples: 39303572. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:24:58,989][27935] Avg episode reward: [(0, '-65.623')] [2022-07-12 20:25:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5043.6). Total num frames: 19671040. Throughput: 0: 10171.0. Samples: 39361160. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:25:03,989][27935] Avg episode reward: [(0, '-66.678')] [2022-07-12 20:25:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5047.1). Total num frames: 19696640. Throughput: 0: 10166.9. Samples: 39391652. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-12 20:25:08,990][27935] Avg episode reward: [(0, '-66.658')] [2022-07-12 20:25:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 19721216. Throughput: 0: 10171.5. Samples: 39453228. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 20:25:13,989][27935] Avg episode reward: [(0, '-66.462')] [2022-07-12 20:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5043.6). Total num frames: 19746816. Throughput: 0: 10184.3. Samples: 39514756. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 20:25:18,989][27935] Avg episode reward: [(0, '-66.473')] [2022-07-12 20:25:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 19772416. Throughput: 0: 10189.8. Samples: 39545796. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 20:25:23,990][27935] Avg episode reward: [(0, '-67.397')] [2022-07-12 20:25:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 19800064. Throughput: 0: 10171.2. Samples: 39606548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 20:25:28,990][27935] Avg episode reward: [(0, '-67.373')] [2022-07-12 20:25:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 19823616. Throughput: 0: 10132.8. Samples: 39666876. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 20:25:33,989][27935] Avg episode reward: [(0, '-67.613')] [2022-07-12 20:25:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5040.2). Total num frames: 19848192. Throughput: 0: 10126.7. Samples: 39697532. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:25:38,989][27935] Avg episode reward: [(0, '-65.915')] [2022-07-12 20:25:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5054.3). Total num frames: 19874816. Throughput: 0: 10103.6. Samples: 39758236. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:25:43,989][27935] Avg episode reward: [(0, '-65.568')] [2022-07-12 20:25:48,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 19900416. Throughput: 0: 10177.7. Samples: 39819156. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:25:48,991][27935] Avg episode reward: [(0, '-65.664')] [2022-07-12 20:25:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 19926016. Throughput: 0: 10192.7. Samples: 39850324. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:25:53,989][27935] Avg episode reward: [(0, '-65.078')] [2022-07-12 20:25:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 19950592. Throughput: 0: 10201.6. Samples: 39912300. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:25:58,989][27935] Avg episode reward: [(0, '-64.901')] [2022-07-12 20:26:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5054.0). Total num frames: 19976192. Throughput: 0: 9510.3. Samples: 39942720. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:26:03,989][27935] Avg episode reward: [(0, '-64.678')] [2022-07-12 20:26:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5054.0). Total num frames: 20001792. Throughput: 0: 10109.9. Samples: 40000740. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:08,989][27935] Avg episode reward: [(0, '-64.687')] [2022-07-12 20:26:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 20026368. Throughput: 0: 10136.7. Samples: 40062700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:13,989][27935] Avg episode reward: [(0, '-64.737')] [2022-07-12 20:26:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 20052992. Throughput: 0: 10166.9. Samples: 40124388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:18,989][27935] Avg episode reward: [(0, '-64.963')] [2022-07-12 20:26:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 20078592. Throughput: 0: 10182.1. Samples: 40155728. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:23,989][27935] Avg episode reward: [(0, '-65.841')] [2022-07-12 20:26:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 20104192. Throughput: 0: 10201.7. Samples: 40217312. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:28,989][27935] Avg episode reward: [(0, '-66.223')] [2022-07-12 20:26:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5054.0). Total num frames: 20128768. Throughput: 0: 10198.3. Samples: 40278080. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:26:33,989][27935] Avg episode reward: [(0, '-66.971')] [2022-07-12 20:26:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 20154368. Throughput: 0: 10190.7. Samples: 40308904. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:26:38,989][27935] Avg episode reward: [(0, '-66.854')] [2022-07-12 20:26:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5064.5). Total num frames: 20182016. Throughput: 0: 10203.2. Samples: 40371444. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:26:43,989][27935] Avg episode reward: [(0, '-67.465')] [2022-07-12 20:26:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 20206592. Throughput: 0: 10915.2. Samples: 40433904. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:26:48,989][27935] Avg episode reward: [(0, '-67.455')] [2022-07-12 20:26:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5061.0). Total num frames: 20232192. Throughput: 0: 10309.1. Samples: 40464648. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:26:53,989][27935] Avg episode reward: [(0, '-67.425')] [2022-07-12 20:26:58,989][27935] Fps is (10 sec: 5222.0, 60 sec: 5137.0, 300 sec: 5067.9). Total num frames: 20258816. Throughput: 0: 10321.4. Samples: 40527172. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:26:58,990][27935] Avg episode reward: [(0, '-67.273')] [2022-07-12 20:27:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 20282368. Throughput: 0: 10239.3. Samples: 40585156. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:03,989][27935] Avg episode reward: [(0, '-67.122')] [2022-07-12 20:27:08,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5137.1, 300 sec: 5078.3). Total num frames: 20310016. Throughput: 0: 10232.9. Samples: 40616208. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:08,989][27935] Avg episode reward: [(0, '-67.247')] [2022-07-12 20:27:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5120.0, 300 sec: 5067.9). Total num frames: 20333568. Throughput: 0: 10227.4. Samples: 40677544. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:13,989][27935] Avg episode reward: [(0, '-67.346')] [2022-07-12 20:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 20360192. Throughput: 0: 10254.9. Samples: 40739552. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:18,989][27935] Avg episode reward: [(0, '-67.522')] [2022-07-12 20:27:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 20385792. Throughput: 0: 10262.1. Samples: 40770696. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:23,989][27935] Avg episode reward: [(0, '-66.714')] [2022-07-12 20:27:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 20411392. Throughput: 0: 10245.0. Samples: 40832468. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-12 20:27:28,989][27935] Avg episode reward: [(0, '-67.076')] [2022-07-12 20:27:33,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5137.1, 300 sec: 5074.9). Total num frames: 20436992. Throughput: 0: 10233.9. Samples: 40894432. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:27:33,989][27935] Avg episode reward: [(0, '-67.899')] [2022-07-12 20:27:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5088.8). Total num frames: 20463616. Throughput: 0: 10232.1. Samples: 40925092. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:27:38,989][27935] Avg episode reward: [(0, '-68.049')] [2022-07-12 20:27:43,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 20488192. Throughput: 0: 10178.1. Samples: 40985180. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:27:43,989][27935] Avg episode reward: [(0, '-67.695')] [2022-07-12 20:27:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5092.2). Total num frames: 20514816. Throughput: 0: 10271.7. Samples: 41047384. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:27:48,989][27935] Avg episode reward: [(0, '-67.071')] [2022-07-12 20:27:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5092.2). Total num frames: 20539392. Throughput: 0: 10273.6. Samples: 41078520. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 20:27:53,989][27935] Avg episode reward: [(0, '-67.187')] [2022-07-12 20:27:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.1, 300 sec: 5099.2). Total num frames: 20566016. Throughput: 0: 10294.8. Samples: 41140808. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:27:58,989][27935] Avg episode reward: [(0, '-66.964')] [2022-07-12 20:28:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5095.7). Total num frames: 20589568. Throughput: 0: 10212.8. Samples: 41199128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:28:03,989][27935] Avg episode reward: [(0, '-66.403')] [2022-07-12 20:28:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 20617216. Throughput: 0: 10208.4. Samples: 41230072. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:28:08,989][27935] Avg episode reward: [(0, '-65.955')] [2022-07-12 20:28:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 20641792. Throughput: 0: 10203.7. Samples: 41291636. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:28:13,989][27935] Avg episode reward: [(0, '-65.579')] [2022-07-12 20:28:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5092.3). Total num frames: 20665344. Throughput: 0: 10198.8. Samples: 41353376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:28:18,989][27935] Avg episode reward: [(0, '-66.099')] [2022-07-12 20:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5106.1). Total num frames: 20694016. Throughput: 0: 10210.7. Samples: 41384576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 20:28:23,989][27935] Avg episode reward: [(0, '-65.805')] [2022-07-12 20:28:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5095.8). Total num frames: 20717568. Throughput: 0: 10252.8. Samples: 41446556. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:28,989][27935] Avg episode reward: [(0, '-65.480')] [2022-07-12 20:28:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5099.2). Total num frames: 20744192. Throughput: 0: 10241.9. Samples: 41508268. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:33,990][27935] Avg episode reward: [(0, '-66.025')] [2022-07-12 20:28:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5102.6). Total num frames: 20770816. Throughput: 0: 10240.4. Samples: 41539340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:38,989][27935] Avg episode reward: [(0, '-65.861')] [2022-07-12 20:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5106.1). Total num frames: 20796416. Throughput: 0: 10241.8. Samples: 41601688. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:43,989][27935] Avg episode reward: [(0, '-66.094')] [2022-07-12 20:28:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5102.6). Total num frames: 20820992. Throughput: 0: 10283.4. Samples: 41661880. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:48,989][27935] Avg episode reward: [(0, '-66.389')] [2022-07-12 20:28:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 20847616. Throughput: 0: 10260.6. Samples: 41691800. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:28:53,989][27935] Avg episode reward: [(0, '-66.263')] [2022-07-12 20:28:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 20871168. Throughput: 0: 10261.0. Samples: 41753380. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:28:58,989][27935] Avg episode reward: [(0, '-66.007')] [2022-07-12 20:29:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5102.6). Total num frames: 20895744. Throughput: 0: 10183.5. Samples: 41811632. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:29:03,989][27935] Avg episode reward: [(0, '-66.306')] [2022-07-12 20:29:08,990][27935] Fps is (10 sec: 5016.8, 60 sec: 5068.7, 300 sec: 5099.1). Total num frames: 20921344. Throughput: 0: 10180.2. Samples: 41842700. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:29:08,991][27935] Avg episode reward: [(0, '-65.589')] [2022-07-12 20:29:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5102.9, 300 sec: 5102.6). Total num frames: 20947968. Throughput: 0: 10176.9. Samples: 41904516. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:29:13,989][27935] Avg episode reward: [(0, '-64.449')] [2022-07-12 20:29:18,989][27935] Fps is (10 sec: 5325.6, 60 sec: 5154.1, 300 sec: 5109.6). Total num frames: 20974592. Throughput: 0: 9490.5. Samples: 41935340. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:29:18,989][27935] Avg episode reward: [(0, '-64.465')] [2022-07-12 20:29:23,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5085.6, 300 sec: 5102.6). Total num frames: 20999168. Throughput: 0: 10190.1. Samples: 41997932. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:29:23,993][27935] Avg episode reward: [(0, '-64.311')] [2022-07-12 20:29:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5106.1). Total num frames: 21025792. Throughput: 0: 10183.4. Samples: 42059940. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:29:28,989][27935] Avg episode reward: [(0, '-64.353')] [2022-07-12 20:29:33,991][27935] Fps is (10 sec: 5223.0, 60 sec: 5119.8, 300 sec: 5113.0). Total num frames: 21051392. Throughput: 0: 10231.0. Samples: 42122300. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:29:33,992][27935] Avg episode reward: [(0, '-64.893')] [2022-07-12 20:29:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 21076992. Throughput: 0: 10261.5. Samples: 42153568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:29:38,989][27935] Avg episode reward: [(0, '-63.608')] [2022-07-12 20:29:43,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 21103616. Throughput: 0: 10256.8. Samples: 42214936. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:29:43,989][27935] Avg episode reward: [(0, '-65.339')] [2022-07-12 20:29:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 21128192. Throughput: 0: 10334.3. Samples: 42276676. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:29:48,989][27935] Avg episode reward: [(0, '-66.362')] [2022-07-12 20:29:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 21153792. Throughput: 0: 10326.5. Samples: 42307376. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:29:53,989][27935] Avg episode reward: [(0, '-67.022')] [2022-07-12 20:29:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5116.5). Total num frames: 21180416. Throughput: 0: 10325.5. Samples: 42369164. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:29:58,989][27935] Avg episode reward: [(0, '-67.179')] [2022-07-12 20:30:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 21202944. Throughput: 0: 10929.9. Samples: 42427184. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:30:03,989][27935] Avg episode reward: [(0, '-67.531')] [2022-07-12 20:30:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.2, 300 sec: 5113.1). Total num frames: 21229568. Throughput: 0: 10232.5. Samples: 42458356. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:30:08,989][27935] Avg episode reward: [(0, '-68.347')] [2022-07-12 20:30:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 21255168. Throughput: 0: 10226.0. Samples: 42520108. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:30:13,989][27935] Avg episode reward: [(0, '-67.377')] [2022-07-12 20:30:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21280768. Throughput: 0: 10216.0. Samples: 42581996. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:30:18,989][27935] Avg episode reward: [(0, '-67.082')] [2022-07-12 20:30:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.3, 300 sec: 5106.1). Total num frames: 21306368. Throughput: 0: 10208.3. Samples: 42612940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:23,989][27935] Avg episode reward: [(0, '-67.103')] [2022-07-12 20:30:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21331968. Throughput: 0: 10223.0. Samples: 42674972. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:28,989][27935] Avg episode reward: [(0, '-67.115')] [2022-07-12 20:30:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.3, 300 sec: 5123.5). Total num frames: 21359616. Throughput: 0: 10211.1. Samples: 42736176. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:33,989][27935] Avg episode reward: [(0, '-66.566')] [2022-07-12 20:30:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21383168. Throughput: 0: 10213.2. Samples: 42766968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:38,989][27935] Avg episode reward: [(0, '-67.195')] [2022-07-12 20:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5113.1). Total num frames: 21408768. Throughput: 0: 10202.3. Samples: 42828268. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:43,989][27935] Avg episode reward: [(0, '-67.230')] [2022-07-12 20:30:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21434368. Throughput: 0: 10271.8. Samples: 42889416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 20:30:48,989][27935] Avg episode reward: [(0, '-67.615')] [2022-07-12 20:30:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5113.1). Total num frames: 21458944. Throughput: 0: 10270.5. Samples: 42920528. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:30:53,989][27935] Avg episode reward: [(0, '-67.345')] [2022-07-12 20:30:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 21487616. Throughput: 0: 10278.8. Samples: 42982652. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:30:58,989][27935] Avg episode reward: [(0, '-67.465')] [2022-07-12 20:31:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 21509120. Throughput: 0: 10197.7. Samples: 43040892. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:31:03,989][27935] Avg episode reward: [(0, '-67.279')] [2022-07-12 20:31:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 21536768. Throughput: 0: 10197.9. Samples: 43071848. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:31:08,989][27935] Avg episode reward: [(0, '-66.948')] [2022-07-12 20:31:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21561344. Throughput: 0: 10178.0. Samples: 43132984. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:31:13,989][27935] Avg episode reward: [(0, '-66.643')] [2022-07-12 20:31:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 21587968. Throughput: 0: 10167.4. Samples: 43193712. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-12 20:31:18,990][27935] Avg episode reward: [(0, '-66.630')] [2022-07-12 20:31:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 21613568. Throughput: 0: 10182.5. Samples: 43225180. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:23,989][27935] Avg episode reward: [(0, '-66.491')] [2022-07-12 20:31:28,995][27935] Fps is (10 sec: 5116.8, 60 sec: 5119.5, 300 sec: 5119.9). Total num frames: 21639168. Throughput: 0: 10196.0. Samples: 43287152. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:28,996][27935] Avg episode reward: [(0, '-66.560')] [2022-07-12 20:31:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 21664768. Throughput: 0: 10208.0. Samples: 43348776. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:33,989][27935] Avg episode reward: [(0, '-67.109')] [2022-07-12 20:31:38,989][27935] Fps is (10 sec: 5225.7, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 21691392. Throughput: 0: 10203.1. Samples: 43379668. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:38,989][27935] Avg episode reward: [(0, '-66.734')] [2022-07-12 20:31:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 21715968. Throughput: 0: 10210.4. Samples: 43442120. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:43,989][27935] Avg episode reward: [(0, '-66.876')] [2022-07-12 20:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 21742592. Throughput: 0: 10281.5. Samples: 43503560. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-12 20:31:48,989][27935] Avg episode reward: [(0, '-67.100')] [2022-07-12 20:31:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 21767168. Throughput: 0: 10287.8. Samples: 43534800. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:31:53,989][27935] Avg episode reward: [(0, '-67.289')] [2022-07-12 20:31:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 21793792. Throughput: 0: 10287.3. Samples: 43595912. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:31:58,989][27935] Avg episode reward: [(0, '-66.932')] [2022-07-12 20:32:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 21816320. Throughput: 0: 10228.9. Samples: 43654012. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:32:03,989][27935] Avg episode reward: [(0, '-66.894')] [2022-07-12 20:32:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 21842944. Throughput: 0: 10211.4. Samples: 43684692. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:32:08,989][27935] Avg episode reward: [(0, '-67.342')] [2022-07-12 20:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 21868544. Throughput: 0: 10223.8. Samples: 43747160. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:32:13,989][27935] Avg episode reward: [(0, '-66.792')] [2022-07-12 20:32:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 21894144. Throughput: 0: 10212.1. Samples: 43808320. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 20:32:18,989][27935] Avg episode reward: [(0, '-66.885')] [2022-07-12 20:32:24,001][27935] Fps is (10 sec: 5216.3, 60 sec: 5119.0, 300 sec: 5116.3). Total num frames: 21920768. Throughput: 0: 10221.1. Samples: 43839736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:24,001][27935] Avg episode reward: [(0, '-66.109')] [2022-07-12 20:32:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.5, 300 sec: 5113.1). Total num frames: 21945344. Throughput: 0: 10213.7. Samples: 43901736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:28,992][27935] Avg episode reward: [(0, '-66.551')] [2022-07-12 20:32:33,989][27935] Fps is (10 sec: 5126.0, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 21971968. Throughput: 0: 10216.1. Samples: 43963284. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:33,989][27935] Avg episode reward: [(0, '-66.770')] [2022-07-12 20:32:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 21999616. Throughput: 0: 10210.8. Samples: 43994288. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:38,989][27935] Avg episode reward: [(0, '-66.933')] [2022-07-12 20:32:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 22022144. Throughput: 0: 10235.2. Samples: 44056496. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:43,990][27935] Avg episode reward: [(0, '-66.882')] [2022-07-12 20:32:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 22049792. Throughput: 0: 10314.8. Samples: 44118176. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-12 20:32:48,989][27935] Avg episode reward: [(0, '-67.170')] [2022-07-12 20:32:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 22074368. Throughput: 0: 10329.2. Samples: 44149508. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:32:53,989][27935] Avg episode reward: [(0, '-66.721')] [2022-07-12 20:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 22102016. Throughput: 0: 10327.0. Samples: 44211872. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:32:58,989][27935] Avg episode reward: [(0, '-66.620')] [2022-07-12 20:33:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5113.1). Total num frames: 22125568. Throughput: 0: 10259.1. Samples: 44269980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:33:03,989][27935] Avg episode reward: [(0, '-66.198')] [2022-07-12 20:33:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 22151168. Throughput: 0: 10256.7. Samples: 44301168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:33:08,989][27935] Avg episode reward: [(0, '-66.395')] [2022-07-12 20:33:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 22177792. Throughput: 0: 10259.4. Samples: 44363408. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:33:13,989][27935] Avg episode reward: [(0, '-66.074')] [2022-07-12 20:33:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 22202368. Throughput: 0: 10263.8. Samples: 44425156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 20:33:18,989][27935] Avg episode reward: [(0, '-66.465')] [2022-07-12 20:33:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5138.1, 300 sec: 5123.5). Total num frames: 22228992. Throughput: 0: 10274.1. Samples: 44456624. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:23,989][27935] Avg episode reward: [(0, '-66.074')] [2022-07-12 20:33:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 22254592. Throughput: 0: 10282.0. Samples: 44519188. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:28,989][27935] Avg episode reward: [(0, '-66.016')] [2022-07-12 20:33:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 22280192. Throughput: 0: 10278.6. Samples: 44580712. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:33,989][27935] Avg episode reward: [(0, '-65.776')] [2022-07-12 20:33:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 22306816. Throughput: 0: 10278.2. Samples: 44612028. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:38,989][27935] Avg episode reward: [(0, '-65.491')] [2022-07-12 20:33:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5123.5). Total num frames: 22332416. Throughput: 0: 10275.6. Samples: 44674276. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:43,989][27935] Avg episode reward: [(0, '-65.262')] [2022-07-12 20:33:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 22358016. Throughput: 0: 10341.7. Samples: 44735356. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 20:33:48,989][27935] Avg episode reward: [(0, '-65.352')] [2022-07-12 20:33:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 22383616. Throughput: 0: 10332.9. Samples: 44766148. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:33:53,989][27935] Avg episode reward: [(0, '-65.043')] [2022-07-12 20:33:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 22409216. Throughput: 0: 10321.6. Samples: 44827880. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:33:58,989][27935] Avg episode reward: [(0, '-65.398')] [2022-07-12 20:34:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 22432768. Throughput: 0: 10239.5. Samples: 44885932. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:34:03,989][27935] Avg episode reward: [(0, '-65.838')] [2022-07-12 20:34:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 22459392. Throughput: 0: 10230.8. Samples: 44917008. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:34:08,989][27935] Avg episode reward: [(0, '-65.444')] [2022-07-12 20:34:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 22486016. Throughput: 0: 10225.0. Samples: 44979312. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:34:13,989][27935] Avg episode reward: [(0, '-64.933')] [2022-07-12 20:34:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 22510592. Throughput: 0: 10232.7. Samples: 45041184. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 20:34:18,989][27935] Avg episode reward: [(0, '-65.008')] [2022-07-12 20:34:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 22536192. Throughput: 0: 10233.9. Samples: 45072552. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:23,989][27935] Avg episode reward: [(0, '-64.322')] [2022-07-12 20:34:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5127.0). Total num frames: 22563840. Throughput: 0: 10233.3. Samples: 45134776. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:28,989][27935] Avg episode reward: [(0, '-65.139')] [2022-07-12 20:34:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 22588416. Throughput: 0: 10247.2. Samples: 45196480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:33,989][27935] Avg episode reward: [(0, '-65.388')] [2022-07-12 20:34:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 22615040. Throughput: 0: 10256.4. Samples: 45227688. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:38,989][27935] Avg episode reward: [(0, '-65.197')] [2022-07-12 20:34:43,996][27935] Fps is (10 sec: 5116.2, 60 sec: 5119.4, 300 sec: 5123.3). Total num frames: 22639616. Throughput: 0: 10257.0. Samples: 45289524. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:43,997][27935] Avg episode reward: [(0, '-65.093')] [2022-07-12 20:34:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 22666240. Throughput: 0: 10342.0. Samples: 45351324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:34:48,989][27935] Avg episode reward: [(0, '-64.389')] [2022-07-12 20:34:53,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 22690816. Throughput: 0: 10312.0. Samples: 45381048. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:34:53,989][27935] Avg episode reward: [(0, '-65.304')] [2022-07-12 20:34:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 22716416. Throughput: 0: 10269.2. Samples: 45441424. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:34:58,989][27935] Avg episode reward: [(0, '-64.717')] [2022-07-12 20:35:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 22739968. Throughput: 0: 10177.8. Samples: 45499184. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:35:03,989][27935] Avg episode reward: [(0, '-63.958')] [2022-07-12 20:35:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 22765568. Throughput: 0: 10166.1. Samples: 45530028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:35:08,989][27935] Avg episode reward: [(0, '-63.771')] [2022-07-12 20:35:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 22791168. Throughput: 0: 10155.4. Samples: 45591768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:35:13,989][27935] Avg episode reward: [(0, '-63.885')] [2022-07-12 20:35:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 22816768. Throughput: 0: 10146.8. Samples: 45653084. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 20:35:18,989][27935] Avg episode reward: [(0, '-63.950')] [2022-07-12 20:35:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 22843392. Throughput: 0: 10136.9. Samples: 45683848. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:23,989][27935] Avg episode reward: [(0, '-63.605')] [2022-07-12 20:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 22868992. Throughput: 0: 10147.7. Samples: 45746096. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:28,989][27935] Avg episode reward: [(0, '-63.428')] [2022-07-12 20:35:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 22893568. Throughput: 0: 10142.7. Samples: 45807744. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:33,989][27935] Avg episode reward: [(0, '-63.372')] [2022-07-12 20:35:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5123.5). Total num frames: 22920192. Throughput: 0: 10165.9. Samples: 45838512. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:38,989][27935] Avg episode reward: [(0, '-64.844')] [2022-07-12 20:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5103.6, 300 sec: 5123.5). Total num frames: 22945792. Throughput: 0: 10203.5. Samples: 45900580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:43,989][27935] Avg episode reward: [(0, '-65.324')] [2022-07-12 20:35:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5123.5). Total num frames: 22970368. Throughput: 0: 10273.4. Samples: 45961488. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:35:48,989][27935] Avg episode reward: [(0, '-65.164')] [2022-07-12 20:35:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5113.1). Total num frames: 22995968. Throughput: 0: 10272.0. Samples: 45992268. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:35:53,989][27935] Avg episode reward: [(0, '-65.003')] [2022-07-12 20:35:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 23022592. Throughput: 0: 10265.4. Samples: 46053712. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:35:58,989][27935] Avg episode reward: [(0, '-65.111')] [2022-07-12 20:36:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 23046144. Throughput: 0: 10185.5. Samples: 46111432. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:36:03,989][27935] Avg episode reward: [(0, '-65.489')] [2022-07-12 20:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 23072768. Throughput: 0: 10192.8. Samples: 46142524. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:36:08,989][27935] Avg episode reward: [(0, '-65.438')] [2022-07-12 20:36:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 23097344. Throughput: 0: 10195.4. Samples: 46204888. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:36:13,989][27935] Avg episode reward: [(0, '-65.090')] [2022-07-12 20:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 23123968. Throughput: 0: 10194.2. Samples: 46266484. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:36:18,989][27935] Avg episode reward: [(0, '-65.253')] [2022-07-12 20:36:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5120.1). Total num frames: 23149568. Throughput: 0: 10194.5. Samples: 46297264. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 20:36:23,989][27935] Avg episode reward: [(0, '-65.572')] [2022-07-12 20:36:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 23174144. Throughput: 0: 10189.1. Samples: 46359088. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:28,989][27935] Avg episode reward: [(0, '-65.598')] [2022-07-12 20:36:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 23200768. Throughput: 0: 10187.2. Samples: 46419912. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:33,989][27935] Avg episode reward: [(0, '-65.593')] [2022-07-12 20:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 23226368. Throughput: 0: 10185.7. Samples: 46450624. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:38,989][27935] Avg episode reward: [(0, '-65.852')] [2022-07-12 20:36:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 23252992. Throughput: 0: 10209.7. Samples: 46513148. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:43,989][27935] Avg episode reward: [(0, '-65.488')] [2022-07-12 20:36:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 23278592. Throughput: 0: 10307.4. Samples: 46575264. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:48,990][27935] Avg episode reward: [(0, '-65.753')] [2022-07-12 20:36:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 23303168. Throughput: 0: 10302.0. Samples: 46606112. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 20:36:53,989][27935] Avg episode reward: [(0, '-65.699')] [2022-07-12 20:36:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 23330816. Throughput: 0: 10299.8. Samples: 46668376. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:36:58,989][27935] Avg episode reward: [(0, '-66.060')] [2022-07-12 20:37:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 23353344. Throughput: 0: 10237.1. Samples: 46727156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:37:03,989][27935] Avg episode reward: [(0, '-65.609')] [2022-07-12 20:37:08,992][27935] Fps is (10 sec: 4913.4, 60 sec: 5119.7, 300 sec: 5123.4). Total num frames: 23379968. Throughput: 0: 10242.3. Samples: 46758204. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:37:08,993][27935] Avg episode reward: [(0, '-65.451')] [2022-07-12 20:37:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 23406592. Throughput: 0: 10260.4. Samples: 46820808. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:37:13,989][27935] Avg episode reward: [(0, '-65.119')] [2022-07-12 20:37:18,992][27935] Fps is (10 sec: 5120.4, 60 sec: 5119.8, 300 sec: 5120.2). Total num frames: 23431168. Throughput: 0: 10286.2. Samples: 46882820. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:37:18,993][27935] Avg episode reward: [(0, '-66.326')] [2022-07-12 20:37:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 23458816. Throughput: 0: 10296.9. Samples: 46913984. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 20:37:23,989][27935] Avg episode reward: [(0, '-66.492')] [2022-07-12 20:37:28,989][27935] Fps is (10 sec: 5223.9, 60 sec: 5154.1, 300 sec: 5123.5). Total num frames: 23483392. Throughput: 0: 10297.4. Samples: 46976528. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:28,989][27935] Avg episode reward: [(0, '-66.307')] [2022-07-12 20:37:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 23508992. Throughput: 0: 10277.0. Samples: 47037728. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:33,989][27935] Avg episode reward: [(0, '-66.215')] [2022-07-12 20:37:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 23535616. Throughput: 0: 10277.6. Samples: 47068604. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:38,989][27935] Avg episode reward: [(0, '-66.479')] [2022-07-12 20:37:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 23559168. Throughput: 0: 10244.1. Samples: 47129360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:43,989][27935] Avg episode reward: [(0, '-66.094')] [2022-07-12 20:37:48,992][27935] Fps is (10 sec: 5015.9, 60 sec: 5119.7, 300 sec: 5123.4). Total num frames: 23585792. Throughput: 0: 10310.2. Samples: 47191148. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:48,993][27935] Avg episode reward: [(0, '-65.889')] [2022-07-12 20:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 23611392. Throughput: 0: 10311.0. Samples: 47222160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 20:37:53,989][27935] Avg episode reward: [(0, '-65.760')] [2022-07-12 20:37:58,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 23638016. Throughput: 0: 10298.1. Samples: 47284220. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:37:58,989][27935] Avg episode reward: [(0, '-65.455')] [2022-07-12 20:38:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 23661568. Throughput: 0: 10215.4. Samples: 47342484. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:03,989][27935] Avg episode reward: [(0, '-64.713')] [2022-07-12 20:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.4, 300 sec: 5120.0). Total num frames: 23688192. Throughput: 0: 10208.8. Samples: 47373380. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:08,989][27935] Avg episode reward: [(0, '-65.185')] [2022-07-12 20:38:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 23712768. Throughput: 0: 10212.8. Samples: 47436104. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:13,989][27935] Avg episode reward: [(0, '-65.147')] [2022-07-12 20:38:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.3, 300 sec: 5120.0). Total num frames: 23739392. Throughput: 0: 10222.7. Samples: 47497748. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:18,989][27935] Avg episode reward: [(0, '-65.709')] [2022-07-12 20:38:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 23764992. Throughput: 0: 10227.4. Samples: 47528840. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:23,989][27935] Avg episode reward: [(0, '-65.811')] [2022-07-12 20:38:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 23790592. Throughput: 0: 10248.4. Samples: 47590540. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-12 20:38:28,996][27935] Avg episode reward: [(0, '-66.003')] [2022-07-12 20:38:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 23817216. Throughput: 0: 10243.7. Samples: 47652080. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:33,989][27935] Avg episode reward: [(0, '-66.292')] [2022-07-12 20:38:38,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 23842816. Throughput: 0: 10249.8. Samples: 47683400. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:38,990][27935] Avg episode reward: [(0, '-66.314')] [2022-07-12 20:38:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 23868416. Throughput: 0: 10258.6. Samples: 47745856. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:43,989][27935] Avg episode reward: [(0, '-66.405')] [2022-07-12 20:38:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.3, 300 sec: 5120.0). Total num frames: 23894016. Throughput: 0: 10347.5. Samples: 47808124. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:48,989][27935] Avg episode reward: [(0, '-65.086')] [2022-07-12 20:38:53,991][27935] Fps is (10 sec: 5118.7, 60 sec: 5136.8, 300 sec: 5120.0). Total num frames: 23919616. Throughput: 0: 10354.3. Samples: 47839352. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:53,992][27935] Avg episode reward: [(0, '-65.196')] [2022-07-12 20:38:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 23946240. Throughput: 0: 10338.1. Samples: 47901320. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 20:38:58,989][27935] Avg episode reward: [(0, '-64.001')] [2022-07-12 20:39:03,989][27935] Fps is (10 sec: 5018.9, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 23969792. Throughput: 0: 10261.8. Samples: 47959528. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:03,989][27935] Avg episode reward: [(0, '-64.017')] [2022-07-12 20:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 23995392. Throughput: 0: 10261.3. Samples: 47990600. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:08,989][27935] Avg episode reward: [(0, '-64.014')] [2022-07-12 20:39:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5123.5). Total num frames: 24022016. Throughput: 0: 10270.6. Samples: 48052720. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:13,989][27935] Avg episode reward: [(0, '-63.915')] [2022-07-12 20:39:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 24046592. Throughput: 0: 10275.6. Samples: 48114484. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:18,989][27935] Avg episode reward: [(0, '-64.387')] [2022-07-12 20:39:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 24074240. Throughput: 0: 10269.3. Samples: 48145516. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:23,989][27935] Avg episode reward: [(0, '-64.899')] [2022-07-12 20:39:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 24098816. Throughput: 0: 10258.4. Samples: 48207484. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:28,989][27935] Avg episode reward: [(0, '-64.949')] [2022-07-12 20:39:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 24125440. Throughput: 0: 10256.6. Samples: 48269672. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 20:39:33,990][27935] Avg episode reward: [(0, '-64.901')] [2022-07-12 20:39:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5123.6). Total num frames: 24151040. Throughput: 0: 10255.1. Samples: 48300804. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:39:38,989][27935] Avg episode reward: [(0, '-64.859')] [2022-07-12 20:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 24176640. Throughput: 0: 10281.4. Samples: 48363984. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:39:43,990][27935] Avg episode reward: [(0, '-63.811')] [2022-07-12 20:39:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5130.4). Total num frames: 24204288. Throughput: 0: 10377.1. Samples: 48426496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:39:48,989][27935] Avg episode reward: [(0, '-64.201')] [2022-07-12 20:39:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.4, 300 sec: 5126.9). Total num frames: 24228864. Throughput: 0: 10371.6. Samples: 48457324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:39:53,989][27935] Avg episode reward: [(0, '-63.202')] [2022-07-12 20:39:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 24254464. Throughput: 0: 10381.3. Samples: 48519876. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:39:58,989][27935] Avg episode reward: [(0, '-63.286')] [2022-07-12 20:40:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 24280064. Throughput: 0: 10309.0. Samples: 48578388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 20:40:03,989][27935] Avg episode reward: [(0, '-63.552')] [2022-07-12 20:40:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 24306688. Throughput: 0: 10316.5. Samples: 48609760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:08,989][27935] Avg episode reward: [(0, '-64.235')] [2022-07-12 20:40:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 24330240. Throughput: 0: 10312.3. Samples: 48671536. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:13,989][27935] Avg episode reward: [(0, '-64.839')] [2022-07-12 20:40:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5133.9). Total num frames: 24357888. Throughput: 0: 10320.1. Samples: 48734076. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:18,989][27935] Avg episode reward: [(0, '-64.524')] [2022-07-12 20:40:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 24383488. Throughput: 0: 10328.4. Samples: 48765580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:23,989][27935] Avg episode reward: [(0, '-65.116')] [2022-07-12 20:40:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 24408064. Throughput: 0: 10308.3. Samples: 48827856. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:28,991][27935] Avg episode reward: [(0, '-65.618')] [2022-07-12 20:40:33,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 24435712. Throughput: 0: 9589.4. Samples: 48858020. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:33,989][27935] Avg episode reward: [(0, '-65.528')] [2022-07-12 20:40:38,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5153.8, 300 sec: 5133.8). Total num frames: 24460288. Throughput: 0: 10266.6. Samples: 48919360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 20:40:38,993][27935] Avg episode reward: [(0, '-64.744')] [2022-07-12 20:40:43,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 24485888. Throughput: 0: 10255.8. Samples: 48981388. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:40:43,989][27935] Avg episode reward: [(0, '-65.133')] [2022-07-12 20:40:48,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 24510464. Throughput: 0: 10345.2. Samples: 49043920. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:40:48,989][27935] Avg episode reward: [(0, '-64.769')] [2022-07-12 20:40:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5140.8). Total num frames: 24539136. Throughput: 0: 10337.1. Samples: 49074932. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:40:53,989][27935] Avg episode reward: [(0, '-64.779')] [2022-07-12 20:40:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 24561664. Throughput: 0: 10277.4. Samples: 49134020. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:40:58,989][27935] Avg episode reward: [(0, '-65.007')] [2022-07-12 20:41:03,992][27935] Fps is (10 sec: 4606.4, 60 sec: 5085.6, 300 sec: 5126.9). Total num frames: 24585216. Throughput: 0: 10173.9. Samples: 49191936. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:41:03,993][27935] Avg episode reward: [(0, '-65.632')] [2022-07-12 20:41:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5130.4). Total num frames: 24610816. Throughput: 0: 10152.1. Samples: 49222424. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 20:41:08,989][27935] Avg episode reward: [(0, '-65.592')] [2022-07-12 20:41:13,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 24638464. Throughput: 0: 10153.7. Samples: 49284772. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:13,989][27935] Avg episode reward: [(0, '-65.512')] [2022-07-12 20:41:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 24664064. Throughput: 0: 10842.0. Samples: 49345912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:18,989][27935] Avg episode reward: [(0, '-65.037')] [2022-07-12 20:41:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5133.9). Total num frames: 24688640. Throughput: 0: 10180.6. Samples: 49377452. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:23,989][27935] Avg episode reward: [(0, '-64.971')] [2022-07-12 20:41:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 24715264. Throughput: 0: 10191.5. Samples: 49440008. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:28,989][27935] Avg episode reward: [(0, '-64.873')] [2022-07-12 20:41:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5133.9). Total num frames: 24740864. Throughput: 0: 10186.9. Samples: 49502332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:33,989][27935] Avg episode reward: [(0, '-64.516')] [2022-07-12 20:41:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.3, 300 sec: 5133.9). Total num frames: 24767488. Throughput: 0: 10196.7. Samples: 49533784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:38,989][27935] Avg episode reward: [(0, '-64.264')] [2022-07-12 20:41:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 24793088. Throughput: 0: 10270.5. Samples: 49596192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 20:41:43,989][27935] Avg episode reward: [(0, '-64.798')] [2022-07-12 20:41:48,992][27935] Fps is (10 sec: 5220.8, 60 sec: 5153.9, 300 sec: 5140.8). Total num frames: 24819712. Throughput: 0: 10339.4. Samples: 49657204. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:41:48,992][27935] Avg episode reward: [(0, '-65.868')] [2022-07-12 20:41:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 24845312. Throughput: 0: 10340.6. Samples: 49687752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:41:53,989][27935] Avg episode reward: [(0, '-65.429')] [2022-07-12 20:41:58,989][27935] Fps is (10 sec: 5019.1, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 24869888. Throughput: 0: 10313.0. Samples: 49748856. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:41:58,989][27935] Avg episode reward: [(0, '-65.516')] [2022-07-12 20:42:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5137.4, 300 sec: 5130.5). Total num frames: 24893440. Throughput: 0: 10270.4. Samples: 49808080. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:42:03,989][27935] Avg episode reward: [(0, '-65.476')] [2022-07-12 20:42:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 24921088. Throughput: 0: 10265.2. Samples: 49839388. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:42:08,989][27935] Avg episode reward: [(0, '-64.983')] [2022-07-12 20:42:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 24946688. Throughput: 0: 10273.6. Samples: 49902320. Policy #0 lag: (min: 0.0, avg: 9.1, max: 22.0) [2022-07-12 20:42:13,989][27935] Avg episode reward: [(0, '-65.011')] [2022-07-12 20:42:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 24973312. Throughput: 0: 10274.2. Samples: 49964672. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:18,989][27935] Avg episode reward: [(0, '-64.029')] [2022-07-12 20:42:23,993][27935] Fps is (10 sec: 5117.9, 60 sec: 5153.8, 300 sec: 5133.8). Total num frames: 24997888. Throughput: 0: 10274.8. Samples: 49996192. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:23,994][27935] Avg episode reward: [(0, '-64.497')] [2022-07-12 20:42:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 25024512. Throughput: 0: 10260.8. Samples: 50057928. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:28,990][27935] Avg episode reward: [(0, '-63.988')] [2022-07-12 20:42:33,989][27935] Fps is (10 sec: 5327.0, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 25051136. Throughput: 0: 10301.5. Samples: 50120740. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:33,989][27935] Avg episode reward: [(0, '-64.698')] [2022-07-12 20:42:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 25076736. Throughput: 0: 10314.7. Samples: 50151912. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:38,989][27935] Avg episode reward: [(0, '-64.913')] [2022-07-12 20:42:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5144.4). Total num frames: 25103360. Throughput: 0: 10358.5. Samples: 50214988. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:43,989][27935] Avg episode reward: [(0, '-65.171')] [2022-07-12 20:42:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.5, 300 sec: 5147.8). Total num frames: 25129984. Throughput: 0: 10454.0. Samples: 50278512. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 20:42:48,989][27935] Avg episode reward: [(0, '-65.266')] [2022-07-12 20:42:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5147.8). Total num frames: 25156608. Throughput: 0: 10458.3. Samples: 50310012. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:42:53,989][27935] Avg episode reward: [(0, '-65.696')] [2022-07-12 20:42:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 25181184. Throughput: 0: 10458.9. Samples: 50372972. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:42:58,989][27935] Avg episode reward: [(0, '-65.344')] [2022-07-12 20:43:03,996][27935] Fps is (10 sec: 5013.8, 60 sec: 5221.7, 300 sec: 5147.6). Total num frames: 25206784. Throughput: 0: 10395.1. Samples: 50432528. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:43:03,997][27935] Avg episode reward: [(0, '-65.168')] [2022-07-12 20:43:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5154.7). Total num frames: 25233408. Throughput: 0: 10398.5. Samples: 50464080. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:43:08,989][27935] Avg episode reward: [(0, '-65.424')] [2022-07-12 20:43:13,989][27935] Fps is (10 sec: 5226.3, 60 sec: 5205.3, 300 sec: 5151.2). Total num frames: 25259008. Throughput: 0: 10421.2. Samples: 50526884. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:43:13,989][27935] Avg episode reward: [(0, '-64.964')] [2022-07-12 20:43:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5154.7). Total num frames: 25285632. Throughput: 0: 10416.9. Samples: 50589500. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:43:18,989][27935] Avg episode reward: [(0, '-65.116')] [2022-07-12 20:43:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.8, 300 sec: 5158.2). Total num frames: 25312256. Throughput: 0: 10430.6. Samples: 50621288. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:43:23,989][27935] Avg episode reward: [(0, '-64.133')] [2022-07-12 20:43:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5154.7). Total num frames: 25337856. Throughput: 0: 10434.1. Samples: 50684524. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:28,989][27935] Avg episode reward: [(0, '-64.435')] [2022-07-12 20:43:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5158.2). Total num frames: 25364480. Throughput: 0: 10414.6. Samples: 50747168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:33,989][27935] Avg episode reward: [(0, '-64.454')] [2022-07-12 20:43:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5158.2). Total num frames: 25390080. Throughput: 0: 10410.5. Samples: 50778484. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:38,989][27935] Avg episode reward: [(0, '-64.855')] [2022-07-12 20:43:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5161.7). Total num frames: 25416704. Throughput: 0: 10422.6. Samples: 50841988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:43,989][27935] Avg episode reward: [(0, '-64.869')] [2022-07-12 20:43:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5165.2). Total num frames: 25443328. Throughput: 0: 10495.3. Samples: 50904736. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:48,989][27935] Avg episode reward: [(0, '-65.155')] [2022-07-12 20:43:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5158.2). Total num frames: 25467904. Throughput: 0: 10491.8. Samples: 50936212. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:53,989][27935] Avg episode reward: [(0, '-65.263')] [2022-07-12 20:43:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5172.1). Total num frames: 25495552. Throughput: 0: 10482.0. Samples: 50998572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 20:43:58,989][27935] Avg episode reward: [(0, '-65.272')] [2022-07-12 20:44:03,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5188.6, 300 sec: 5161.6). Total num frames: 25518080. Throughput: 0: 10409.2. Samples: 51057952. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:03,993][27935] Avg episode reward: [(0, '-65.029')] [2022-07-12 20:44:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 25545728. Throughput: 0: 10380.3. Samples: 51088404. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:08,989][27935] Avg episode reward: [(0, '-64.925')] [2022-07-12 20:44:13,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 25571328. Throughput: 0: 10384.5. Samples: 51151828. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:13,989][27935] Avg episode reward: [(0, '-64.917')] [2022-07-12 20:44:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 25597952. Throughput: 0: 10387.6. Samples: 51214612. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:18,990][27935] Avg episode reward: [(0, '-64.354')] [2022-07-12 20:44:23,990][27935] Fps is (10 sec: 5324.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 25624576. Throughput: 0: 10398.5. Samples: 51246424. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:23,990][27935] Avg episode reward: [(0, '-64.255')] [2022-07-12 20:44:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 25650176. Throughput: 0: 10392.1. Samples: 51309632. Policy #0 lag: (min: 0.0, avg: 10.5, max: 20.0) [2022-07-12 20:44:28,990][27935] Avg episode reward: [(0, '-63.960')] [2022-07-12 20:44:33,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 25675776. Throughput: 0: 10381.3. Samples: 51371896. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:33,989][27935] Avg episode reward: [(0, '-64.244')] [2022-07-12 20:44:38,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5205.0, 300 sec: 5172.0). Total num frames: 25702400. Throughput: 0: 10372.9. Samples: 51403028. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:38,993][27935] Avg episode reward: [(0, '-64.521')] [2022-07-12 20:44:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 25728000. Throughput: 0: 10392.0. Samples: 51466212. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:43,989][27935] Avg episode reward: [(0, '-64.730')] [2022-07-12 20:44:48,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 25755648. Throughput: 0: 10484.9. Samples: 51529736. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:48,989][27935] Avg episode reward: [(0, '-64.745')] [2022-07-12 20:44:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 25781248. Throughput: 0: 10512.1. Samples: 51561448. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:53,989][27935] Avg episode reward: [(0, '-64.967')] [2022-07-12 20:44:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 25808896. Throughput: 0: 10507.7. Samples: 51624676. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:44:59,003][27935] Avg episode reward: [(0, '-64.867')] [2022-07-12 20:45:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.7, 300 sec: 5168.6). Total num frames: 25831424. Throughput: 0: 10431.2. Samples: 51684016. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 20:45:03,989][27935] Avg episode reward: [(0, '-65.011')] [2022-07-12 20:45:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 25859072. Throughput: 0: 10426.4. Samples: 51715604. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:08,989][27935] Avg episode reward: [(0, '-64.602')] [2022-07-12 20:45:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5179.0). Total num frames: 25885696. Throughput: 0: 10426.4. Samples: 51778820. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:13,989][27935] Avg episode reward: [(0, '-64.316')] [2022-07-12 20:45:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 25911296. Throughput: 0: 10436.5. Samples: 51841540. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:18,990][27935] Avg episode reward: [(0, '-64.535')] [2022-07-12 20:45:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5182.5). Total num frames: 25936896. Throughput: 0: 10457.5. Samples: 51873580. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:23,989][27935] Avg episode reward: [(0, '-65.563')] [2022-07-12 20:45:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 25964544. Throughput: 0: 10469.2. Samples: 51937324. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:28,989][27935] Avg episode reward: [(0, '-65.877')] [2022-07-12 20:45:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 25989120. Throughput: 0: 10447.3. Samples: 51999864. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:33,989][27935] Avg episode reward: [(0, '-65.769')] [2022-07-12 20:45:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.8, 300 sec: 5189.4). Total num frames: 26016768. Throughput: 0: 10443.4. Samples: 52031400. Policy #0 lag: (min: 0.0, avg: 7.9, max: 20.0) [2022-07-12 20:45:38,989][27935] Avg episode reward: [(0, '-66.099')] [2022-07-12 20:45:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 26042368. Throughput: 0: 10437.1. Samples: 52094348. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:45:43,990][27935] Avg episode reward: [(0, '-66.390')] [2022-07-12 20:45:48,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5222.1, 300 sec: 5185.9). Total num frames: 26068992. Throughput: 0: 10528.6. Samples: 52157840. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:45:48,993][27935] Avg episode reward: [(0, '-66.333')] [2022-07-12 20:45:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 26094592. Throughput: 0: 10525.3. Samples: 52189244. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:45:53,992][27935] Avg episode reward: [(0, '-64.663')] [2022-07-12 20:45:58,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 26121216. Throughput: 0: 10517.9. Samples: 52252124. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:45:58,989][27935] Avg episode reward: [(0, '-64.725')] [2022-07-12 20:46:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 26145792. Throughput: 0: 10429.7. Samples: 52310876. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:46:03,989][27935] Avg episode reward: [(0, '-64.718')] [2022-07-12 20:46:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 26172416. Throughput: 0: 10416.0. Samples: 52342300. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:46:08,989][27935] Avg episode reward: [(0, '-64.437')] [2022-07-12 20:46:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 26198016. Throughput: 0: 10381.4. Samples: 52404488. Policy #0 lag: (min: 0.0, avg: 10.4, max: 24.0) [2022-07-12 20:46:13,989][27935] Avg episode reward: [(0, '-63.888')] [2022-07-12 20:46:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 26223616. Throughput: 0: 10361.2. Samples: 52466116. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:18,990][27935] Avg episode reward: [(0, '-64.016')] [2022-07-12 20:46:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 26249216. Throughput: 0: 10366.1. Samples: 52497876. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:23,989][27935] Avg episode reward: [(0, '-64.364')] [2022-07-12 20:46:28,990][27935] Fps is (10 sec: 5221.5, 60 sec: 5188.1, 300 sec: 5203.3). Total num frames: 26275840. Throughput: 0: 10370.1. Samples: 52561020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:28,991][27935] Avg episode reward: [(0, '-64.201')] [2022-07-12 20:46:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 26301440. Throughput: 0: 10332.9. Samples: 52622784. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:33,989][27935] Avg episode reward: [(0, '-64.047')] [2022-07-12 20:46:38,989][27935] Fps is (10 sec: 5223.2, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 26328064. Throughput: 0: 10328.3. Samples: 52654020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:38,989][27935] Avg episode reward: [(0, '-64.269')] [2022-07-12 20:46:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.9). Total num frames: 26353664. Throughput: 0: 10329.8. Samples: 52716964. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:43,989][27935] Avg episode reward: [(0, '-64.121')] [2022-07-12 20:46:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.6, 300 sec: 5206.8). Total num frames: 26381312. Throughput: 0: 10459.0. Samples: 52781532. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 20:46:48,989][27935] Avg episode reward: [(0, '-63.708')] [2022-07-12 20:46:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 26407936. Throughput: 0: 10479.3. Samples: 52813868. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:46:53,989][27935] Avg episode reward: [(0, '-63.287')] [2022-07-12 20:46:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 26433536. Throughput: 0: 10510.0. Samples: 52877436. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:46:58,989][27935] Avg episode reward: [(0, '-62.959')] [2022-07-12 20:47:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 26456064. Throughput: 0: 9808.0. Samples: 52907476. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:47:03,989][27935] Avg episode reward: [(0, '-63.173')] [2022-07-12 20:47:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 26484736. Throughput: 0: 10427.1. Samples: 52967096. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:47:08,989][27935] Avg episode reward: [(0, '-63.128')] [2022-07-12 20:47:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 26510336. Throughput: 0: 10421.5. Samples: 53029972. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:47:13,989][27935] Avg episode reward: [(0, '-62.823')] [2022-07-12 20:47:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.3). Total num frames: 26536960. Throughput: 0: 10457.1. Samples: 53093356. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:47:18,989][27935] Avg episode reward: [(0, '-63.273')] [2022-07-12 20:47:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 26563584. Throughput: 0: 10469.7. Samples: 53125156. Policy #0 lag: (min: 0.0, avg: 8.8, max: 23.0) [2022-07-12 20:47:23,989][27935] Avg episode reward: [(0, '-63.708')] [2022-07-12 20:47:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.6, 300 sec: 5217.2). Total num frames: 26590208. Throughput: 0: 10483.0. Samples: 53188700. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:28,989][27935] Avg episode reward: [(0, '-64.061')] [2022-07-12 20:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 26615808. Throughput: 0: 10448.6. Samples: 53251720. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:33,989][27935] Avg episode reward: [(0, '-63.629')] [2022-07-12 20:47:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 26641408. Throughput: 0: 10432.6. Samples: 53283336. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:38,989][27935] Avg episode reward: [(0, '-64.293')] [2022-07-12 20:47:43,994][27935] Fps is (10 sec: 5219.7, 60 sec: 5239.0, 300 sec: 5213.6). Total num frames: 26668032. Throughput: 0: 10397.8. Samples: 53345392. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:43,995][27935] Avg episode reward: [(0, '-64.629')] [2022-07-12 20:47:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 26695680. Throughput: 0: 11145.6. Samples: 53409028. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:48,989][27935] Avg episode reward: [(0, '-64.312')] [2022-07-12 20:47:53,989][27935] Fps is (10 sec: 5327.6, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 26721280. Throughput: 0: 10537.2. Samples: 53441272. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:53,989][27935] Avg episode reward: [(0, '-64.340')] [2022-07-12 20:47:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5224.3). Total num frames: 26747904. Throughput: 0: 10551.6. Samples: 53504792. Policy #0 lag: (min: 0.0, avg: 7.9, max: 17.0) [2022-07-12 20:47:58,989][27935] Avg episode reward: [(0, '-64.095')] [2022-07-12 20:48:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 26772480. Throughput: 0: 10470.8. Samples: 53564540. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:03,989][27935] Avg episode reward: [(0, '-63.760')] [2022-07-12 20:48:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 26799104. Throughput: 0: 10472.3. Samples: 53596408. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:08,989][27935] Avg episode reward: [(0, '-63.588')] [2022-07-12 20:48:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 26826752. Throughput: 0: 10472.2. Samples: 53659948. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:13,989][27935] Avg episode reward: [(0, '-64.110')] [2022-07-12 20:48:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 26850304. Throughput: 0: 10483.4. Samples: 53723472. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:18,989][27935] Avg episode reward: [(0, '-64.820')] [2022-07-12 20:48:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 26878976. Throughput: 0: 10490.8. Samples: 53755420. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:23,989][27935] Avg episode reward: [(0, '-64.696')] [2022-07-12 20:48:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 26904576. Throughput: 0: 10531.9. Samples: 53819272. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:28,989][27935] Avg episode reward: [(0, '-64.990')] [2022-07-12 20:48:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 26931200. Throughput: 0: 10516.6. Samples: 53882276. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 20:48:33,989][27935] Avg episode reward: [(0, '-66.073')] [2022-07-12 20:48:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 26957824. Throughput: 0: 10500.1. Samples: 53913776. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:48:38,989][27935] Avg episode reward: [(0, '-65.606')] [2022-07-12 20:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5257.0, 300 sec: 5220.7). Total num frames: 26983424. Throughput: 0: 10491.2. Samples: 53976896. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:48:43,989][27935] Avg episode reward: [(0, '-65.950')] [2022-07-12 20:48:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 27010048. Throughput: 0: 10572.9. Samples: 54040320. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:48:48,989][27935] Avg episode reward: [(0, '-65.685')] [2022-07-12 20:48:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 27037696. Throughput: 0: 10571.7. Samples: 54072136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:48:53,989][27935] Avg episode reward: [(0, '-65.245')] [2022-07-12 20:48:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.1). Total num frames: 27063296. Throughput: 0: 10567.2. Samples: 54135472. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:48:58,989][27935] Avg episode reward: [(0, '-65.259')] [2022-07-12 20:49:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 27086848. Throughput: 0: 10476.8. Samples: 54194928. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:49:03,989][27935] Avg episode reward: [(0, '-65.227')] [2022-07-12 20:49:08,992][27935] Fps is (10 sec: 5118.3, 60 sec: 5256.3, 300 sec: 5231.0). Total num frames: 27114496. Throughput: 0: 10464.7. Samples: 54226364. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 20:49:08,992][27935] Avg episode reward: [(0, '-64.937')] [2022-07-12 20:49:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 27140096. Throughput: 0: 10458.3. Samples: 54289896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:13,989][27935] Avg episode reward: [(0, '-64.515')] [2022-07-12 20:49:18,989][27935] Fps is (10 sec: 5224.1, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 27166720. Throughput: 0: 10456.6. Samples: 54352824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:18,989][27935] Avg episode reward: [(0, '-63.874')] [2022-07-12 20:49:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 27193344. Throughput: 0: 10459.0. Samples: 54384432. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:23,989][27935] Avg episode reward: [(0, '-65.031')] [2022-07-12 20:49:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 27218944. Throughput: 0: 10455.2. Samples: 54447380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:28,989][27935] Avg episode reward: [(0, '-65.794')] [2022-07-12 20:49:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.7). Total num frames: 27244544. Throughput: 0: 10444.6. Samples: 54510328. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:33,989][27935] Avg episode reward: [(0, '-65.276')] [2022-07-12 20:49:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 27273216. Throughput: 0: 10431.9. Samples: 54541572. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:38,989][27935] Avg episode reward: [(0, '-64.938')] [2022-07-12 20:49:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 27296768. Throughput: 0: 10432.8. Samples: 54604948. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-12 20:49:43,989][27935] Avg episode reward: [(0, '-65.488')] [2022-07-12 20:49:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 27324416. Throughput: 0: 10522.5. Samples: 54668440. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:49:48,989][27935] Avg episode reward: [(0, '-65.801')] [2022-07-12 20:49:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 27351040. Throughput: 0: 10530.1. Samples: 54700184. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:49:53,989][27935] Avg episode reward: [(0, '-65.969')] [2022-07-12 20:49:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 27376640. Throughput: 0: 10522.7. Samples: 54763416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:49:58,989][27935] Avg episode reward: [(0, '-65.836')] [2022-07-12 20:50:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 27400192. Throughput: 0: 10423.6. Samples: 54821884. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:50:03,989][27935] Avg episode reward: [(0, '-66.304')] [2022-07-12 20:50:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.7, 300 sec: 5227.6). Total num frames: 27427840. Throughput: 0: 10426.6. Samples: 54853628. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:50:08,989][27935] Avg episode reward: [(0, '-66.319')] [2022-07-12 20:50:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 27453440. Throughput: 0: 10427.4. Samples: 54916612. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:50:13,989][27935] Avg episode reward: [(0, '-66.256')] [2022-07-12 20:50:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 27482112. Throughput: 0: 10441.3. Samples: 54980184. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:50:18,989][27935] Avg episode reward: [(0, '-66.224')] [2022-07-12 20:50:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 27506688. Throughput: 0: 10466.0. Samples: 55012544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 20:50:23,989][27935] Avg episode reward: [(0, '-66.202')] [2022-07-12 20:50:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 27533312. Throughput: 0: 10473.7. Samples: 55076264. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:28,989][27935] Avg episode reward: [(0, '-65.844')] [2022-07-12 20:50:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 27559936. Throughput: 0: 10461.0. Samples: 55139184. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:33,989][27935] Avg episode reward: [(0, '-65.557')] [2022-07-12 20:50:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 27584512. Throughput: 0: 10459.2. Samples: 55170848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:38,989][27935] Avg episode reward: [(0, '-65.476')] [2022-07-12 20:50:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5238.1). Total num frames: 27614208. Throughput: 0: 10460.3. Samples: 55234128. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:43,989][27935] Avg episode reward: [(0, '-65.675')] [2022-07-12 20:50:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 27638784. Throughput: 0: 10568.2. Samples: 55297452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:48,989][27935] Avg episode reward: [(0, '-66.217')] [2022-07-12 20:50:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 27665408. Throughput: 0: 10577.3. Samples: 55329608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:53,989][27935] Avg episode reward: [(0, '-65.434')] [2022-07-12 20:50:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 27692032. Throughput: 0: 10599.8. Samples: 55393604. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 20:50:58,989][27935] Avg episode reward: [(0, '-64.845')] [2022-07-12 20:51:03,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5307.5, 300 sec: 5241.4). Total num frames: 27718656. Throughput: 0: 10523.0. Samples: 55453744. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:03,992][27935] Avg episode reward: [(0, '-64.339')] [2022-07-12 20:51:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 27744256. Throughput: 0: 10520.7. Samples: 55485976. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:08,989][27935] Avg episode reward: [(0, '-64.273')] [2022-07-12 20:51:13,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5290.7, 300 sec: 5245.0). Total num frames: 27770880. Throughput: 0: 10532.9. Samples: 55550244. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:13,990][27935] Avg episode reward: [(0, '-64.265')] [2022-07-12 20:51:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 27796480. Throughput: 0: 10531.3. Samples: 55613092. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:18,991][27935] Avg episode reward: [(0, '-64.145')] [2022-07-12 20:51:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5248.5). Total num frames: 27824128. Throughput: 0: 10538.3. Samples: 55645072. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:23,990][27935] Avg episode reward: [(0, '-64.038')] [2022-07-12 20:51:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 27848704. Throughput: 0: 10528.2. Samples: 55707896. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:28,990][27935] Avg episode reward: [(0, '-64.063')] [2022-07-12 20:51:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 27875328. Throughput: 0: 10518.7. Samples: 55770796. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 20:51:33,990][27935] Avg episode reward: [(0, '-64.129')] [2022-07-12 20:51:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5248.4). Total num frames: 27901952. Throughput: 0: 10501.4. Samples: 55802172. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:51:38,990][27935] Avg episode reward: [(0, '-64.452')] [2022-07-12 20:51:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 27929600. Throughput: 0: 10489.3. Samples: 55865624. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:51:43,989][27935] Avg episode reward: [(0, '-64.239')] [2022-07-12 20:51:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 27955200. Throughput: 0: 10570.5. Samples: 55929392. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:51:48,989][27935] Avg episode reward: [(0, '-63.444')] [2022-07-12 20:51:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 27981824. Throughput: 0: 10571.1. Samples: 55961676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:51:53,989][27935] Avg episode reward: [(0, '-64.650')] [2022-07-12 20:51:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 28008448. Throughput: 0: 10567.0. Samples: 56025760. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:51:58,989][27935] Avg episode reward: [(0, '-64.771')] [2022-07-12 20:52:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.8, 300 sec: 5255.4). Total num frames: 28035072. Throughput: 0: 10499.2. Samples: 56085556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:52:03,989][27935] Avg episode reward: [(0, '-64.555')] [2022-07-12 20:52:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 28059648. Throughput: 0: 10502.0. Samples: 56117660. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:52:08,989][27935] Avg episode reward: [(0, '-64.270')] [2022-07-12 20:52:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 28086272. Throughput: 0: 10524.4. Samples: 56181492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 20:52:13,989][27935] Avg episode reward: [(0, '-64.034')] [2022-07-12 20:52:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 28113920. Throughput: 0: 10540.2. Samples: 56245104. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:18,989][27935] Avg episode reward: [(0, '-63.863')] [2022-07-12 20:52:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 28139520. Throughput: 0: 10554.5. Samples: 56277124. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:23,996][27935] Avg episode reward: [(0, '-63.970')] [2022-07-12 20:52:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 28164096. Throughput: 0: 10563.5. Samples: 56340980. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:28,989][27935] Avg episode reward: [(0, '-63.604')] [2022-07-12 20:52:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5262.3). Total num frames: 28193792. Throughput: 0: 10553.6. Samples: 56404304. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:33,989][27935] Avg episode reward: [(0, '-63.984')] [2022-07-12 20:52:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5255.5). Total num frames: 28218368. Throughput: 0: 10541.6. Samples: 56436048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:38,989][27935] Avg episode reward: [(0, '-63.935')] [2022-07-12 20:52:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 28243968. Throughput: 0: 10487.9. Samples: 56497716. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:43,989][27935] Avg episode reward: [(0, '-64.335')] [2022-07-12 20:52:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 28271616. Throughput: 0: 10566.2. Samples: 56561036. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-12 20:52:48,989][27935] Avg episode reward: [(0, '-63.802')] [2022-07-12 20:52:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 28297216. Throughput: 0: 10560.0. Samples: 56592860. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:52:53,989][27935] Avg episode reward: [(0, '-64.083')] [2022-07-12 20:52:58,990][27935] Fps is (10 sec: 5221.9, 60 sec: 5256.5, 300 sec: 5258.8). Total num frames: 28323840. Throughput: 0: 10544.2. Samples: 56655988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:52:58,990][27935] Avg episode reward: [(0, '-63.967')] [2022-07-12 20:53:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5248.4). Total num frames: 28347392. Throughput: 0: 10412.4. Samples: 56713664. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:53:03,989][27935] Avg episode reward: [(0, '-63.620')] [2022-07-12 20:53:08,989][27935] Fps is (10 sec: 4915.6, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 28372992. Throughput: 0: 10366.4. Samples: 56743612. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:53:08,989][27935] Avg episode reward: [(0, '-63.722')] [2022-07-12 20:53:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5248.4). Total num frames: 28398592. Throughput: 0: 10334.7. Samples: 56806044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:53:13,989][27935] Avg episode reward: [(0, '-64.127')] [2022-07-12 20:53:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5238.0). Total num frames: 28424192. Throughput: 0: 10311.2. Samples: 56868308. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:53:18,989][27935] Avg episode reward: [(0, '-64.259')] [2022-07-12 20:53:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5234.5). Total num frames: 28448768. Throughput: 0: 10307.2. Samples: 56899872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-12 20:53:23,999][27935] Avg episode reward: [(0, '-64.079')] [2022-07-12 20:53:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 28478464. Throughput: 0: 10329.2. Samples: 56962532. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:28,989][27935] Avg episode reward: [(0, '-63.471')] [2022-07-12 20:53:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5234.5). Total num frames: 28502016. Throughput: 0: 10304.7. Samples: 57024748. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:33,989][27935] Avg episode reward: [(0, '-63.937')] [2022-07-12 20:53:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5234.5). Total num frames: 28527616. Throughput: 0: 10292.3. Samples: 57056012. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:38,989][27935] Avg episode reward: [(0, '-62.942')] [2022-07-12 20:53:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 28555264. Throughput: 0: 10264.3. Samples: 57117872. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:43,989][27935] Avg episode reward: [(0, '-62.414')] [2022-07-12 20:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5227.6). Total num frames: 28579840. Throughput: 0: 10369.9. Samples: 57180308. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:48,989][27935] Avg episode reward: [(0, '-62.501')] [2022-07-12 20:53:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5234.5). Total num frames: 28607488. Throughput: 0: 10406.6. Samples: 57211908. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:53,989][27935] Avg episode reward: [(0, '-62.485')] [2022-07-12 20:53:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.2, 300 sec: 5241.5). Total num frames: 28633088. Throughput: 0: 10414.2. Samples: 57274684. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:53:58,989][27935] Avg episode reward: [(0, '-62.752')] [2022-07-12 20:54:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5227.7). Total num frames: 28656640. Throughput: 0: 10325.1. Samples: 57332936. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-12 20:54:03,989][27935] Avg episode reward: [(0, '-63.274')] [2022-07-12 20:54:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5231.1). Total num frames: 28683264. Throughput: 0: 10327.1. Samples: 57364592. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:08,989][27935] Avg episode reward: [(0, '-63.689')] [2022-07-12 20:54:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 28708864. Throughput: 0: 10328.0. Samples: 57427292. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:13,989][27935] Avg episode reward: [(0, '-63.963')] [2022-07-12 20:54:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 28736512. Throughput: 0: 10347.3. Samples: 57490376. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:18,989][27935] Avg episode reward: [(0, '-63.875')] [2022-07-12 20:54:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 28761088. Throughput: 0: 10356.2. Samples: 57522040. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:23,989][27935] Avg episode reward: [(0, '-63.910')] [2022-07-12 20:54:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5231.1). Total num frames: 28787712. Throughput: 0: 10388.8. Samples: 57585368. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:28,989][27935] Avg episode reward: [(0, '-63.396')] [2022-07-12 20:54:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 28815360. Throughput: 0: 10401.5. Samples: 57648376. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:33,989][27935] Avg episode reward: [(0, '-63.407')] [2022-07-12 20:54:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 28839936. Throughput: 0: 10398.2. Samples: 57679828. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 20:54:38,989][27935] Avg episode reward: [(0, '-63.336')] [2022-07-12 20:54:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 28866560. Throughput: 0: 10402.2. Samples: 57742784. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:54:43,989][27935] Avg episode reward: [(0, '-63.542')] [2022-07-12 20:54:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 28893184. Throughput: 0: 10508.2. Samples: 57805804. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:54:48,989][27935] Avg episode reward: [(0, '-63.642')] [2022-07-12 20:54:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 28918784. Throughput: 0: 10505.6. Samples: 57837344. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:54:53,989][27935] Avg episode reward: [(0, '-63.796')] [2022-07-12 20:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 28945408. Throughput: 0: 10510.4. Samples: 57900260. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:54:58,989][27935] Avg episode reward: [(0, '-64.325')] [2022-07-12 20:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 28968960. Throughput: 0: 10413.7. Samples: 57958992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:55:03,989][27935] Avg episode reward: [(0, '-64.373')] [2022-07-12 20:55:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 28995584. Throughput: 0: 10410.6. Samples: 57990516. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:55:08,989][27935] Avg episode reward: [(0, '-64.315')] [2022-07-12 20:55:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 29023232. Throughput: 0: 10410.5. Samples: 58053840. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:55:13,989][27935] Avg episode reward: [(0, '-63.760')] [2022-07-12 20:55:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 29048832. Throughput: 0: 10399.0. Samples: 58116332. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 20:55:18,989][27935] Avg episode reward: [(0, '-63.825')] [2022-07-12 20:55:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 29074432. Throughput: 0: 10400.4. Samples: 58147844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:23,992][27935] Avg episode reward: [(0, '-64.044')] [2022-07-12 20:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 29101056. Throughput: 0: 10399.1. Samples: 58210744. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:28,989][27935] Avg episode reward: [(0, '-63.926')] [2022-07-12 20:55:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 29127680. Throughput: 0: 10381.4. Samples: 58272968. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:33,989][27935] Avg episode reward: [(0, '-64.010')] [2022-07-12 20:55:38,997][27935] Fps is (10 sec: 5218.3, 60 sec: 5221.7, 300 sec: 5217.1). Total num frames: 29153280. Throughput: 0: 10377.0. Samples: 58304392. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:38,997][27935] Avg episode reward: [(0, '-64.210')] [2022-07-12 20:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 29177856. Throughput: 0: 10372.7. Samples: 58367032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:43,990][27935] Avg episode reward: [(0, '-64.620')] [2022-07-12 20:55:48,989][27935] Fps is (10 sec: 5226.5, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 29205504. Throughput: 0: 10461.3. Samples: 58429752. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:48,989][27935] Avg episode reward: [(0, '-64.593')] [2022-07-12 20:55:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 29232128. Throughput: 0: 10470.3. Samples: 58461680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 20:55:53,998][27935] Avg episode reward: [(0, '-64.926')] [2022-07-12 20:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 29257728. Throughput: 0: 10460.6. Samples: 58524568. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:55:58,989][27935] Avg episode reward: [(0, '-64.678')] [2022-07-12 20:56:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 29281280. Throughput: 0: 10373.8. Samples: 58583152. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:03,989][27935] Avg episode reward: [(0, '-64.405')] [2022-07-12 20:56:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 29306880. Throughput: 0: 10362.3. Samples: 58614148. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:08,989][27935] Avg episode reward: [(0, '-64.314')] [2022-07-12 20:56:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 29334528. Throughput: 0: 10359.7. Samples: 58676932. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:13,989][27935] Avg episode reward: [(0, '-64.141')] [2022-07-12 20:56:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 29359104. Throughput: 0: 10346.8. Samples: 58738576. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:18,989][27935] Avg episode reward: [(0, '-63.910')] [2022-07-12 20:56:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 29385728. Throughput: 0: 10342.6. Samples: 58769728. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:23,989][27935] Avg episode reward: [(0, '-64.370')] [2022-07-12 20:56:28,991][27935] Fps is (10 sec: 5221.0, 60 sec: 5171.0, 300 sec: 5206.7). Total num frames: 29411328. Throughput: 0: 10331.8. Samples: 58831988. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:28,992][27935] Avg episode reward: [(0, '-63.819')] [2022-07-12 20:56:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 29436928. Throughput: 0: 10284.7. Samples: 58892564. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 20:56:33,989][27935] Avg episode reward: [(0, '-64.600')] [2022-07-12 20:56:38,989][27935] Fps is (10 sec: 5121.4, 60 sec: 5154.8, 300 sec: 5196.4). Total num frames: 29462528. Throughput: 0: 10260.8. Samples: 58923416. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:56:38,989][27935] Avg episode reward: [(0, '-64.508')] [2022-07-12 20:56:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 29487104. Throughput: 0: 10237.6. Samples: 58985260. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:56:43,989][27935] Avg episode reward: [(0, '-64.525')] [2022-07-12 20:56:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 29514752. Throughput: 0: 10320.1. Samples: 59047556. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:56:48,989][27935] Avg episode reward: [(0, '-64.833')] [2022-07-12 20:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5189.4). Total num frames: 29539328. Throughput: 0: 10331.4. Samples: 59079060. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:56:53,989][27935] Avg episode reward: [(0, '-64.270')] [2022-07-12 20:56:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 29565952. Throughput: 0: 10330.4. Samples: 59141800. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:56:58,989][27935] Avg episode reward: [(0, '-64.190')] [2022-07-12 20:57:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 29590528. Throughput: 0: 10252.4. Samples: 59199936. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:57:03,989][27935] Avg episode reward: [(0, '-63.319')] [2022-07-12 20:57:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 29615104. Throughput: 0: 10257.8. Samples: 59231328. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:57:08,989][27935] Avg episode reward: [(0, '-63.157')] [2022-07-12 20:57:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 29642752. Throughput: 0: 10270.5. Samples: 59294136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-12 20:57:13,989][27935] Avg episode reward: [(0, '-62.555')] [2022-07-12 20:57:18,996][27935] Fps is (10 sec: 5423.1, 60 sec: 5170.5, 300 sec: 5185.8). Total num frames: 29669376. Throughput: 0: 10301.7. Samples: 59356220. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:18,997][27935] Avg episode reward: [(0, '-61.781')] [2022-07-12 20:57:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 29694976. Throughput: 0: 10313.2. Samples: 59387508. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:23,989][27935] Avg episode reward: [(0, '-61.579')] [2022-07-12 20:57:28,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5154.4, 300 sec: 5175.5). Total num frames: 29720576. Throughput: 0: 10341.5. Samples: 59450628. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:28,989][27935] Avg episode reward: [(0, '-62.082')] [2022-07-12 20:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 29746176. Throughput: 0: 10344.0. Samples: 59513036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:33,989][27935] Avg episode reward: [(0, '-62.252')] [2022-07-12 20:57:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 29771776. Throughput: 0: 10345.8. Samples: 59544620. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:38,989][27935] Avg episode reward: [(0, '-63.301')] [2022-07-12 20:57:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 29798400. Throughput: 0: 10311.9. Samples: 59605836. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:43,989][27935] Avg episode reward: [(0, '-63.771')] [2022-07-12 20:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 29824000. Throughput: 0: 10383.9. Samples: 59667212. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 20:57:48,989][27935] Avg episode reward: [(0, '-64.149')] [2022-07-12 20:57:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5175.6). Total num frames: 29850624. Throughput: 0: 10381.4. Samples: 59698488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:57:53,989][27935] Avg episode reward: [(0, '-64.423')] [2022-07-12 20:57:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 29875200. Throughput: 0: 10375.1. Samples: 59761016. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:57:58,989][27935] Avg episode reward: [(0, '-64.803')] [2022-07-12 20:58:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 29899776. Throughput: 0: 10286.0. Samples: 59819012. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:03,989][27935] Avg episode reward: [(0, '-64.562')] [2022-07-12 20:58:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 29925376. Throughput: 0: 10283.5. Samples: 59850268. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:08,989][27935] Avg episode reward: [(0, '-64.106')] [2022-07-12 20:58:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 29952000. Throughput: 0: 10259.9. Samples: 59912324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:13,989][27935] Avg episode reward: [(0, '-64.161')] [2022-07-12 20:58:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.7, 300 sec: 5179.0). Total num frames: 29976576. Throughput: 0: 10254.9. Samples: 59974508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:18,990][27935] Avg episode reward: [(0, '-63.850')] [2022-07-12 20:58:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 30004224. Throughput: 0: 10244.4. Samples: 60005616. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:23,989][27935] Avg episode reward: [(0, '-64.165')] [2022-07-12 20:58:28,993][27935] Fps is (10 sec: 5322.7, 60 sec: 5153.8, 300 sec: 5178.9). Total num frames: 30029824. Throughput: 0: 10272.0. Samples: 60068116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 20:58:28,994][27935] Avg episode reward: [(0, '-64.079')] [2022-07-12 20:58:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5172.1). Total num frames: 30053376. Throughput: 0: 10281.4. Samples: 60129876. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:33,989][27935] Avg episode reward: [(0, '-63.394')] [2022-07-12 20:58:38,989][27935] Fps is (10 sec: 5122.0, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 30081024. Throughput: 0: 10281.6. Samples: 60161160. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:38,989][27935] Avg episode reward: [(0, '-63.173')] [2022-07-12 20:58:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5172.1). Total num frames: 30105600. Throughput: 0: 10284.4. Samples: 60223816. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:43,990][27935] Avg episode reward: [(0, '-63.406')] [2022-07-12 20:58:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 30133248. Throughput: 0: 10394.7. Samples: 60286776. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:48,989][27935] Avg episode reward: [(0, '-63.535')] [2022-07-12 20:58:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 30159872. Throughput: 0: 10394.3. Samples: 60318012. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:53,989][27935] Avg episode reward: [(0, '-62.633')] [2022-07-12 20:58:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 30186496. Throughput: 0: 10416.0. Samples: 60381044. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:58:58,989][27935] Avg episode reward: [(0, '-62.740')] [2022-07-12 20:59:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 30210048. Throughput: 0: 10326.1. Samples: 60439184. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:59:03,989][27935] Avg episode reward: [(0, '-62.253')] [2022-07-12 20:59:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 30235648. Throughput: 0: 10324.6. Samples: 60470224. Policy #0 lag: (min: 0.0, avg: 10.1, max: 22.0) [2022-07-12 20:59:08,989][27935] Avg episode reward: [(0, '-62.510')] [2022-07-12 20:59:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 30261248. Throughput: 0: 10289.6. Samples: 60531108. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:13,989][27935] Avg episode reward: [(0, '-62.636')] [2022-07-12 20:59:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 30284800. Throughput: 0: 10247.7. Samples: 60591024. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:18,989][27935] Avg episode reward: [(0, '-62.537')] [2022-07-12 20:59:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5165.1). Total num frames: 30311424. Throughput: 0: 10230.8. Samples: 60621544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:23,989][27935] Avg episode reward: [(0, '-62.489')] [2022-07-12 20:59:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5120.3, 300 sec: 5158.2). Total num frames: 30337024. Throughput: 0: 10209.7. Samples: 60683252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:28,989][27935] Avg episode reward: [(0, '-62.315')] [2022-07-12 20:59:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 30363648. Throughput: 0: 10184.9. Samples: 60745096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:33,989][27935] Avg episode reward: [(0, '-62.605')] [2022-07-12 20:59:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5154.7). Total num frames: 30387200. Throughput: 0: 10182.9. Samples: 60776240. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:38,992][27935] Avg episode reward: [(0, '-62.570')] [2022-07-12 20:59:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 30414848. Throughput: 0: 10172.7. Samples: 60838816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:43,989][27935] Avg episode reward: [(0, '-61.965')] [2022-07-12 20:59:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 30441472. Throughput: 0: 10274.5. Samples: 60901536. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 20:59:48,989][27935] Avg episode reward: [(0, '-62.391')] [2022-07-12 20:59:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5158.2). Total num frames: 30467072. Throughput: 0: 10277.2. Samples: 60932696. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:59:53,989][27935] Avg episode reward: [(0, '-62.582')] [2022-07-12 20:59:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5165.1). Total num frames: 30492672. Throughput: 0: 10319.9. Samples: 60995504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 20:59:58,990][27935] Avg episode reward: [(0, '-63.039')] [2022-07-12 21:00:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5158.2). Total num frames: 30517248. Throughput: 0: 10285.4. Samples: 61053868. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:03,989][27935] Avg episode reward: [(0, '-63.098')] [2022-07-12 21:00:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 30543872. Throughput: 0: 10298.1. Samples: 61084960. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:08,989][27935] Avg episode reward: [(0, '-63.080')] [2022-07-12 21:00:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 30569472. Throughput: 0: 10320.5. Samples: 61147676. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:13,989][27935] Avg episode reward: [(0, '-63.627')] [2022-07-12 21:00:18,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 30595072. Throughput: 0: 10332.3. Samples: 61210052. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:18,989][27935] Avg episode reward: [(0, '-63.428')] [2022-07-12 21:00:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 30620672. Throughput: 0: 10323.7. Samples: 61240808. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:23,989][27935] Avg episode reward: [(0, '-63.665')] [2022-07-12 21:00:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 30648320. Throughput: 0: 10323.0. Samples: 61303352. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-12 21:00:28,989][27935] Avg episode reward: [(0, '-63.560')] [2022-07-12 21:00:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5147.9). Total num frames: 30671872. Throughput: 0: 9614.5. Samples: 61334188. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:33,989][27935] Avg episode reward: [(0, '-64.023')] [2022-07-12 21:00:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5151.2). Total num frames: 30697472. Throughput: 0: 10300.1. Samples: 61396200. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:38,989][27935] Avg episode reward: [(0, '-63.850')] [2022-07-12 21:00:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 30726144. Throughput: 0: 10278.3. Samples: 61458028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:43,989][27935] Avg episode reward: [(0, '-63.585')] [2022-07-12 21:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 30749696. Throughput: 0: 10352.5. Samples: 61519732. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:48,989][27935] Avg episode reward: [(0, '-63.630')] [2022-07-12 21:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 30776320. Throughput: 0: 10353.2. Samples: 61550852. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:53,989][27935] Avg episode reward: [(0, '-63.111')] [2022-07-12 21:00:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 30802944. Throughput: 0: 10350.8. Samples: 61613460. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:00:58,989][27935] Avg episode reward: [(0, '-62.790')] [2022-07-12 21:01:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 30826496. Throughput: 0: 10236.6. Samples: 61670696. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:01:03,989][27935] Avg episode reward: [(0, '-62.805')] [2022-07-12 21:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 30850048. Throughput: 0: 10246.3. Samples: 61701892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 21:01:08,989][27935] Avg episode reward: [(0, '-62.858')] [2022-07-12 21:01:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 30878720. Throughput: 0: 10248.7. Samples: 61764544. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:13,989][27935] Avg episode reward: [(0, '-62.445')] [2022-07-12 21:01:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 30903296. Throughput: 0: 10946.4. Samples: 61826776. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:18,989][27935] Avg episode reward: [(0, '-63.073')] [2022-07-12 21:01:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 30928896. Throughput: 0: 10263.4. Samples: 61858052. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:23,989][27935] Avg episode reward: [(0, '-62.547')] [2022-07-12 21:01:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 30955520. Throughput: 0: 10265.6. Samples: 61919980. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:28,989][27935] Avg episode reward: [(0, '-63.621')] [2022-07-12 21:01:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 30980096. Throughput: 0: 10257.6. Samples: 61981324. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:33,989][27935] Avg episode reward: [(0, '-63.637')] [2022-07-12 21:01:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 31006720. Throughput: 0: 10254.1. Samples: 62012288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:38,989][27935] Avg episode reward: [(0, '-64.404')] [2022-07-12 21:01:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 31033344. Throughput: 0: 10253.6. Samples: 62074872. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:43,989][27935] Avg episode reward: [(0, '-64.804')] [2022-07-12 21:01:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 31058944. Throughput: 0: 10364.9. Samples: 62137116. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 21:01:48,989][27935] Avg episode reward: [(0, '-64.371')] [2022-07-12 21:01:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 31084544. Throughput: 0: 10366.6. Samples: 62168388. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:01:53,989][27935] Avg episode reward: [(0, '-64.558')] [2022-07-12 21:01:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 31111168. Throughput: 0: 10366.7. Samples: 62231044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:01:58,989][27935] Avg episode reward: [(0, '-64.771')] [2022-07-12 21:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 31134720. Throughput: 0: 10271.9. Samples: 62289012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:03,989][27935] Avg episode reward: [(0, '-64.395')] [2022-07-12 21:02:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 31160320. Throughput: 0: 10270.0. Samples: 62320204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:08,989][27935] Avg episode reward: [(0, '-64.156')] [2022-07-12 21:02:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.4). Total num frames: 31186944. Throughput: 0: 10258.2. Samples: 62381600. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:13,989][27935] Avg episode reward: [(0, '-63.985')] [2022-07-12 21:02:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 31211520. Throughput: 0: 10274.4. Samples: 62443672. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:18,989][27935] Avg episode reward: [(0, '-64.497')] [2022-07-12 21:02:23,989][27935] Fps is (10 sec: 5222.0, 60 sec: 5171.1, 300 sec: 5147.8). Total num frames: 31239168. Throughput: 0: 10279.7. Samples: 62474880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:23,990][27935] Avg episode reward: [(0, '-65.083')] [2022-07-12 21:02:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 31263744. Throughput: 0: 10273.2. Samples: 62537168. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 21:02:28,989][27935] Avg episode reward: [(0, '-64.366')] [2022-07-12 21:02:33,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 31290368. Throughput: 0: 10260.3. Samples: 62598828. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:33,989][27935] Avg episode reward: [(0, '-64.208')] [2022-07-12 21:02:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 31315968. Throughput: 0: 10261.0. Samples: 62630132. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:38,989][27935] Avg episode reward: [(0, '-64.990')] [2022-07-12 21:02:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 31340544. Throughput: 0: 10211.6. Samples: 62690568. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:43,989][27935] Avg episode reward: [(0, '-65.012')] [2022-07-12 21:02:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 31367168. Throughput: 0: 10301.5. Samples: 62752580. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:48,989][27935] Avg episode reward: [(0, '-65.279')] [2022-07-12 21:02:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 31392768. Throughput: 0: 10303.5. Samples: 62783860. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:53,989][27935] Avg episode reward: [(0, '-64.216')] [2022-07-12 21:02:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 31418368. Throughput: 0: 10317.1. Samples: 62845868. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:02:58,990][27935] Avg episode reward: [(0, '-64.606')] [2022-07-12 21:03:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 31441920. Throughput: 0: 10224.3. Samples: 62903768. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:03:03,989][27935] Avg episode reward: [(0, '-63.972')] [2022-07-12 21:03:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 31468544. Throughput: 0: 10225.4. Samples: 62935016. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:03:08,989][27935] Avg episode reward: [(0, '-64.223')] [2022-07-12 21:03:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 31494144. Throughput: 0: 10219.3. Samples: 62997036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:13,989][27935] Avg episode reward: [(0, '-63.710')] [2022-07-12 21:03:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 31519744. Throughput: 0: 10225.0. Samples: 63058952. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:18,989][27935] Avg episode reward: [(0, '-63.932')] [2022-07-12 21:03:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5134.0). Total num frames: 31544320. Throughput: 0: 10222.3. Samples: 63090136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:23,989][27935] Avg episode reward: [(0, '-63.915')] [2022-07-12 21:03:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 31571968. Throughput: 0: 10249.8. Samples: 63151808. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:28,989][27935] Avg episode reward: [(0, '-63.443')] [2022-07-12 21:03:33,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5085.6, 300 sec: 5133.8). Total num frames: 31595520. Throughput: 0: 10167.1. Samples: 63210136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:33,993][27935] Avg episode reward: [(0, '-63.965')] [2022-07-12 21:03:38,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4915.2, 300 sec: 5102.6). Total num frames: 31610880. Throughput: 0: 9895.7. Samples: 63229164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:38,989][27935] Avg episode reward: [(0, '-63.747')] [2022-07-12 21:03:43,989][27935] Fps is (10 sec: 3585.3, 60 sec: 4846.9, 300 sec: 5078.3). Total num frames: 31631360. Throughput: 0: 9538.0. Samples: 63275076. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:43,989][27935] Avg episode reward: [(0, '-63.747')] [2022-07-12 21:03:48,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4761.6, 300 sec: 5061.0). Total num frames: 31652864. Throughput: 0: 9355.9. Samples: 63324784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:03:48,989][27935] Avg episode reward: [(0, '-63.790')] [2022-07-12 21:03:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 5047.1). Total num frames: 31675392. Throughput: 0: 9273.1. Samples: 63352304. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:03:53,989][27935] Avg episode reward: [(0, '-62.994')] [2022-07-12 21:03:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 5050.6). Total num frames: 31699968. Throughput: 0: 9134.4. Samples: 63408084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:03:58,989][27935] Avg episode reward: [(0, '-62.436')] [2022-07-12 21:04:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 5033.2). Total num frames: 31720448. Throughput: 0: 8920.8. Samples: 63460388. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:03,989][27935] Avg episode reward: [(0, '-62.751')] [2022-07-12 21:04:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 5026.3). Total num frames: 31744000. Throughput: 0: 8836.3. Samples: 63487768. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:08,989][27935] Avg episode reward: [(0, '-62.691')] [2022-07-12 21:04:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4556.8, 300 sec: 5026.3). Total num frames: 31767552. Throughput: 0: 8701.0. Samples: 63543352. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:13,989][27935] Avg episode reward: [(0, '-63.015')] [2022-07-12 21:04:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4471.5, 300 sec: 5005.5). Total num frames: 31788032. Throughput: 0: 8493.6. Samples: 63592316. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:18,989][27935] Avg episode reward: [(0, '-62.960')] [2022-07-12 21:04:23,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4403.2, 300 sec: 4988.1). Total num frames: 31808512. Throughput: 0: 8638.9. Samples: 63617916. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:23,989][27935] Avg episode reward: [(0, '-63.379')] [2022-07-12 21:04:28,990][27935] Fps is (10 sec: 4505.2, 60 sec: 4351.9, 300 sec: 4981.1). Total num frames: 31833088. Throughput: 0: 8886.8. Samples: 63674988. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-12 21:04:28,990][27935] Avg episode reward: [(0, '-64.044')] [2022-07-12 21:04:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4386.4, 300 sec: 4988.1). Total num frames: 31858688. Throughput: 0: 9160.5. Samples: 63737008. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:33,989][27935] Avg episode reward: [(0, '-63.857')] [2022-07-12 21:04:38,989][27935] Fps is (10 sec: 4608.4, 60 sec: 4471.5, 300 sec: 4963.8). Total num frames: 31879168. Throughput: 0: 9106.8. Samples: 63762108. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:38,989][27935] Avg episode reward: [(0, '-63.548')] [2022-07-12 21:04:43,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4522.7, 300 sec: 4953.4). Total num frames: 31902720. Throughput: 0: 9033.5. Samples: 63814592. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:43,989][27935] Avg episode reward: [(0, '-63.605')] [2022-07-12 21:04:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4590.9, 300 sec: 4953.4). Total num frames: 31928320. Throughput: 0: 8553.2. Samples: 63845284. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:48,989][27935] Avg episode reward: [(0, '-63.606')] [2022-07-12 21:04:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4625.1, 300 sec: 4949.9). Total num frames: 31952896. Throughput: 0: 9242.4. Samples: 63903676. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:53,989][27935] Avg episode reward: [(0, '-64.127')] [2022-07-12 21:04:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4642.1, 300 sec: 4953.4). Total num frames: 31978496. Throughput: 0: 9387.6. Samples: 63965796. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:04:58,989][27935] Avg episode reward: [(0, '-63.462')] [2022-07-12 21:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4936.0). Total num frames: 32000000. Throughput: 0: 9542.5. Samples: 64021728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:05:03,989][27935] Avg episode reward: [(0, '-63.342')] [2022-07-12 21:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4932.6). Total num frames: 32024576. Throughput: 0: 9623.6. Samples: 64050980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:05:08,989][27935] Avg episode reward: [(0, '-62.820')] [2022-07-12 21:05:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4932.6). Total num frames: 32050176. Throughput: 0: 9630.9. Samples: 64108372. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:05:13,989][27935] Avg episode reward: [(0, '-62.724')] [2022-07-12 21:05:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4929.1). Total num frames: 32074752. Throughput: 0: 9561.8. Samples: 64167292. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:18,990][27935] Avg episode reward: [(0, '-62.626')] [2022-07-12 21:05:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4922.1). Total num frames: 32100352. Throughput: 0: 9675.8. Samples: 64197520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:23,989][27935] Avg episode reward: [(0, '-61.924')] [2022-07-12 21:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.0, 300 sec: 4922.1). Total num frames: 32123904. Throughput: 0: 9861.2. Samples: 64258348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:28,989][27935] Avg episode reward: [(0, '-61.687')] [2022-07-12 21:05:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4922.1). Total num frames: 32149504. Throughput: 0: 10535.1. Samples: 64319364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:33,989][27935] Avg episode reward: [(0, '-61.876')] [2022-07-12 21:05:38,992][27935] Fps is (10 sec: 5221.0, 60 sec: 4949.1, 300 sec: 4915.2). Total num frames: 32176128. Throughput: 0: 9916.9. Samples: 64349964. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:38,992][27935] Avg episode reward: [(0, '-61.539')] [2022-07-12 21:05:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4983.5, 300 sec: 4922.1). Total num frames: 32201728. Throughput: 0: 9893.1. Samples: 64410988. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:43,989][27935] Avg episode reward: [(0, '-61.821')] [2022-07-12 21:05:48,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4932.3, 300 sec: 4908.3). Total num frames: 32224256. Throughput: 0: 10007.0. Samples: 64472044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:48,990][27935] Avg episode reward: [(0, '-61.934')] [2022-07-12 21:05:53,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5000.5, 300 sec: 4915.2). Total num frames: 32252928. Throughput: 0: 10041.1. Samples: 64502832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:05:54,000][27935] Avg episode reward: [(0, '-62.075')] [2022-07-12 21:05:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4983.5, 300 sec: 4918.7). Total num frames: 32277504. Throughput: 0: 10093.2. Samples: 64562564. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:05:58,989][27935] Avg episode reward: [(0, '-62.561')] [2022-07-12 21:06:03,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4983.5, 300 sec: 4911.7). Total num frames: 32299008. Throughput: 0: 10015.2. Samples: 64617976. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:03,989][27935] Avg episode reward: [(0, '-62.634')] [2022-07-12 21:06:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4949.3, 300 sec: 4890.9). Total num frames: 32321536. Throughput: 0: 9936.3. Samples: 64644652. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:08,989][27935] Avg episode reward: [(0, '-62.646')] [2022-07-12 21:06:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 4894.4). Total num frames: 32347136. Throughput: 0: 9876.6. Samples: 64702796. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:13,989][27935] Avg episode reward: [(0, '-62.680')] [2022-07-12 21:06:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4890.9). Total num frames: 32371712. Throughput: 0: 9864.8. Samples: 64763280. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:18,989][27935] Avg episode reward: [(0, '-62.946')] [2022-07-12 21:06:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4890.9). Total num frames: 32398336. Throughput: 0: 9837.3. Samples: 64792616. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:23,989][27935] Avg episode reward: [(0, '-62.772')] [2022-07-12 21:06:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4887.4). Total num frames: 32421888. Throughput: 0: 9842.0. Samples: 64853876. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:28,990][27935] Avg episode reward: [(0, '-62.843')] [2022-07-12 21:06:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4887.4). Total num frames: 32448512. Throughput: 0: 9829.9. Samples: 64914388. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-12 21:06:33,989][27935] Avg episode reward: [(0, '-62.654')] [2022-07-12 21:06:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.5, 300 sec: 4877.0). Total num frames: 32472064. Throughput: 0: 9827.5. Samples: 64945068. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:06:38,989][27935] Avg episode reward: [(0, '-63.282')] [2022-07-12 21:06:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4880.5). Total num frames: 32498688. Throughput: 0: 9836.9. Samples: 65005224. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:06:43,989][27935] Avg episode reward: [(0, '-63.053')] [2022-07-12 21:06:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4877.0). Total num frames: 32523264. Throughput: 0: 9942.6. Samples: 65065392. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:06:48,989][27935] Avg episode reward: [(0, '-63.407')] [2022-07-12 21:06:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4870.1). Total num frames: 32547840. Throughput: 0: 10033.2. Samples: 65096144. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:06:53,989][27935] Avg episode reward: [(0, '-63.361')] [2022-07-12 21:06:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 32572416. Throughput: 0: 10093.9. Samples: 65157020. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:06:58,989][27935] Avg episode reward: [(0, '-63.801')] [2022-07-12 21:07:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 32592896. Throughput: 0: 9876.5. Samples: 65207724. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:07:03,990][27935] Avg episode reward: [(0, '-63.886')] [2022-07-12 21:07:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4915.2, 300 sec: 4845.8). Total num frames: 32616448. Throughput: 0: 9779.1. Samples: 65232676. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:07:08,990][27935] Avg episode reward: [(0, '-63.795')] [2022-07-12 21:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4849.2). Total num frames: 32642048. Throughput: 0: 9762.4. Samples: 65293184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:07:13,989][27935] Avg episode reward: [(0, '-63.815')] [2022-07-12 21:07:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4842.3). Total num frames: 32667648. Throughput: 0: 9791.6. Samples: 65355012. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:07:18,989][27935] Avg episode reward: [(0, '-63.454')] [2022-07-12 21:07:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4949.3, 300 sec: 4852.7). Total num frames: 32695296. Throughput: 0: 9808.3. Samples: 65386440. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:23,989][27935] Avg episode reward: [(0, '-63.804')] [2022-07-12 21:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 4845.8). Total num frames: 32719872. Throughput: 0: 9844.2. Samples: 65448212. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:28,989][27935] Avg episode reward: [(0, '-63.573')] [2022-07-12 21:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4845.8). Total num frames: 32745472. Throughput: 0: 9844.7. Samples: 65508404. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:33,989][27935] Avg episode reward: [(0, '-63.824')] [2022-07-12 21:07:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4845.8). Total num frames: 32770048. Throughput: 0: 9844.1. Samples: 65539128. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:38,989][27935] Avg episode reward: [(0, '-63.537')] [2022-07-12 21:07:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4838.8). Total num frames: 32794624. Throughput: 0: 9841.2. Samples: 65599872. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:43,989][27935] Avg episode reward: [(0, '-62.867')] [2022-07-12 21:07:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4842.3). Total num frames: 32821248. Throughput: 0: 10076.0. Samples: 65661144. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:48,989][27935] Avg episode reward: [(0, '-62.233')] [2022-07-12 21:07:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4983.5, 300 sec: 4842.3). Total num frames: 32846848. Throughput: 0: 10201.0. Samples: 65691720. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:53,989][27935] Avg episode reward: [(0, '-62.500')] [2022-07-12 21:07:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4845.8). Total num frames: 32871424. Throughput: 0: 10225.9. Samples: 65753348. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-12 21:07:58,989][27935] Avg episode reward: [(0, '-62.865')] [2022-07-12 21:08:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4838.8). Total num frames: 32896000. Throughput: 0: 10125.7. Samples: 65810668. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:03,989][27935] Avg episode reward: [(0, '-62.330')] [2022-07-12 21:08:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4835.4). Total num frames: 32920576. Throughput: 0: 10107.1. Samples: 65841260. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:08,989][27935] Avg episode reward: [(0, '-62.494')] [2022-07-12 21:08:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4838.8). Total num frames: 32947200. Throughput: 0: 10107.7. Samples: 65903060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:13,989][27935] Avg episode reward: [(0, '-62.693')] [2022-07-12 21:08:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4835.4). Total num frames: 32970752. Throughput: 0: 10083.2. Samples: 65962148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:18,989][27935] Avg episode reward: [(0, '-62.885')] [2022-07-12 21:08:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4831.9). Total num frames: 32997376. Throughput: 0: 10071.4. Samples: 65992340. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:23,989][27935] Avg episode reward: [(0, '-63.011')] [2022-07-12 21:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5068.8, 300 sec: 4842.4). Total num frames: 33024000. Throughput: 0: 10091.6. Samples: 66053996. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:28,989][27935] Avg episode reward: [(0, '-62.394')] [2022-07-12 21:08:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4873.5). Total num frames: 33048576. Throughput: 0: 10094.1. Samples: 66115376. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:33,989][27935] Avg episode reward: [(0, '-62.497')] [2022-07-12 21:08:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4887.4). Total num frames: 33073152. Throughput: 0: 10098.8. Samples: 66146168. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:38,989][27935] Avg episode reward: [(0, '-62.101')] [2022-07-12 21:08:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4904.8). Total num frames: 33099776. Throughput: 0: 10098.8. Samples: 66207796. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:08:43,989][27935] Avg episode reward: [(0, '-62.102')] [2022-07-12 21:08:48,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5068.8, 300 sec: 4915.2). Total num frames: 33125376. Throughput: 0: 10174.0. Samples: 66268504. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:08:48,990][27935] Avg episode reward: [(0, '-61.630')] [2022-07-12 21:08:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4915.2). Total num frames: 33149952. Throughput: 0: 10177.5. Samples: 66299248. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:08:53,989][27935] Avg episode reward: [(0, '-61.480')] [2022-07-12 21:08:58,989][27935] Fps is (10 sec: 5017.8, 60 sec: 5068.8, 300 sec: 4932.6). Total num frames: 33175552. Throughput: 0: 10164.2. Samples: 66360448. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:08:58,989][27935] Avg episode reward: [(0, '-61.659')] [2022-07-12 21:09:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4932.6). Total num frames: 33199104. Throughput: 0: 10120.2. Samples: 66417556. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:03,989][27935] Avg episode reward: [(0, '-61.858')] [2022-07-12 21:09:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4939.5). Total num frames: 33224704. Throughput: 0: 10127.0. Samples: 66448056. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:08,989][27935] Avg episode reward: [(0, '-62.442')] [2022-07-12 21:09:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4953.4). Total num frames: 33249280. Throughput: 0: 10117.8. Samples: 66509296. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:13,989][27935] Avg episode reward: [(0, '-62.396')] [2022-07-12 21:09:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 4970.7). Total num frames: 33274880. Throughput: 0: 10116.4. Samples: 66570616. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:18,989][27935] Avg episode reward: [(0, '-62.301')] [2022-07-12 21:09:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 4977.7). Total num frames: 33301504. Throughput: 0: 10125.2. Samples: 66601800. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:23,989][27935] Avg episode reward: [(0, '-62.812')] [2022-07-12 21:09:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 4977.7). Total num frames: 33327104. Throughput: 0: 10121.0. Samples: 66663240. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:28,989][27935] Avg episode reward: [(0, '-62.775')] [2022-07-12 21:09:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4995.0). Total num frames: 33352704. Throughput: 0: 10121.7. Samples: 66723976. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:33,989][27935] Avg episode reward: [(0, '-62.512')] [2022-07-12 21:09:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5002.0). Total num frames: 33378304. Throughput: 0: 10126.0. Samples: 66754920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:38,990][27935] Avg episode reward: [(0, '-62.489')] [2022-07-12 21:09:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5005.5). Total num frames: 33404928. Throughput: 0: 10132.7. Samples: 66816420. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:43,989][27935] Avg episode reward: [(0, '-62.523')] [2022-07-12 21:09:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5005.5). Total num frames: 33429504. Throughput: 0: 10222.8. Samples: 66877584. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:48,990][27935] Avg episode reward: [(0, '-62.325')] [2022-07-12 21:09:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5005.5). Total num frames: 33455104. Throughput: 0: 10216.3. Samples: 66907788. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:53,989][27935] Avg episode reward: [(0, '-62.256')] [2022-07-12 21:09:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 33478656. Throughput: 0: 10129.7. Samples: 66965132. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:09:58,989][27935] Avg episode reward: [(0, '-61.934')] [2022-07-12 21:10:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 33501184. Throughput: 0: 10036.3. Samples: 67022248. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:10:03,989][27935] Avg episode reward: [(0, '-62.124')] [2022-07-12 21:10:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 33526784. Throughput: 0: 10031.4. Samples: 67053212. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 21:10:08,989][27935] Avg episode reward: [(0, '-61.963')] [2022-07-12 21:10:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5008.9). Total num frames: 33552384. Throughput: 0: 10027.1. Samples: 67114460. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:13,989][27935] Avg episode reward: [(0, '-61.592')] [2022-07-12 21:10:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5012.4). Total num frames: 33579008. Throughput: 0: 10042.3. Samples: 67175880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:18,989][27935] Avg episode reward: [(0, '-61.840')] [2022-07-12 21:10:23,990][27935] Fps is (10 sec: 5119.5, 60 sec: 5034.6, 300 sec: 5015.8). Total num frames: 33603584. Throughput: 0: 10042.5. Samples: 67206844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:23,990][27935] Avg episode reward: [(0, '-62.657')] [2022-07-12 21:10:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5019.3). Total num frames: 33630208. Throughput: 0: 10055.3. Samples: 67268908. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:28,989][27935] Avg episode reward: [(0, '-62.561')] [2022-07-12 21:10:33,989][27935] Fps is (10 sec: 5120.5, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 33654784. Throughput: 0: 9376.7. Samples: 67299536. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:33,989][27935] Avg episode reward: [(0, '-62.720')] [2022-07-12 21:10:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 33681408. Throughput: 0: 10069.0. Samples: 67360892. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:38,992][27935] Avg episode reward: [(0, '-62.649')] [2022-07-12 21:10:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5022.8). Total num frames: 33705984. Throughput: 0: 10157.7. Samples: 67422228. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:43,989][27935] Avg episode reward: [(0, '-63.091')] [2022-07-12 21:10:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 33732608. Throughput: 0: 10244.4. Samples: 67483248. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:10:48,989][27935] Avg episode reward: [(0, '-62.601')] [2022-07-12 21:10:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5012.4). Total num frames: 33756160. Throughput: 0: 10240.9. Samples: 67514052. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:10:53,989][27935] Avg episode reward: [(0, '-62.846')] [2022-07-12 21:10:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5033.2). Total num frames: 33783808. Throughput: 0: 10259.8. Samples: 67576152. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:10:58,989][27935] Avg episode reward: [(0, '-62.279')] [2022-07-12 21:11:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5036.7). Total num frames: 33807360. Throughput: 0: 10183.1. Samples: 67634120. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:03,989][27935] Avg episode reward: [(0, '-61.781')] [2022-07-12 21:11:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5033.2). Total num frames: 33831936. Throughput: 0: 10187.0. Samples: 67665248. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:08,989][27935] Avg episode reward: [(0, '-61.962')] [2022-07-12 21:11:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5043.6). Total num frames: 33859584. Throughput: 0: 10181.3. Samples: 67727068. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:13,989][27935] Avg episode reward: [(0, '-61.645')] [2022-07-12 21:11:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 33884160. Throughput: 0: 10850.2. Samples: 67787796. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:18,989][27935] Avg episode reward: [(0, '-61.731')] [2022-07-12 21:11:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5040.2). Total num frames: 33908736. Throughput: 0: 10137.2. Samples: 67817068. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:23,989][27935] Avg episode reward: [(0, '-61.717')] [2022-07-12 21:11:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 33934336. Throughput: 0: 10116.4. Samples: 67877468. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:28,989][27935] Avg episode reward: [(0, '-61.716')] [2022-07-12 21:11:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 33958912. Throughput: 0: 10102.9. Samples: 67937880. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:11:33,989][27935] Avg episode reward: [(0, '-61.754')] [2022-07-12 21:11:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 33984512. Throughput: 0: 10100.4. Samples: 67968568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:11:38,989][27935] Avg episode reward: [(0, '-61.477')] [2022-07-12 21:11:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 34011136. Throughput: 0: 10084.3. Samples: 68029944. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:11:43,989][27935] Avg episode reward: [(0, '-62.132')] [2022-07-12 21:11:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 34035712. Throughput: 0: 10155.9. Samples: 68091136. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:11:48,989][27935] Avg episode reward: [(0, '-62.295')] [2022-07-12 21:11:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5047.1). Total num frames: 34061312. Throughput: 0: 10150.8. Samples: 68122032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:11:53,989][27935] Avg episode reward: [(0, '-61.817')] [2022-07-12 21:11:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 34086912. Throughput: 0: 10155.6. Samples: 68184068. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:11:58,989][27935] Avg episode reward: [(0, '-62.212')] [2022-07-12 21:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 34111488. Throughput: 0: 10084.5. Samples: 68241596. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:12:03,989][27935] Avg episode reward: [(0, '-62.550')] [2022-07-12 21:12:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 34136064. Throughput: 0: 10108.7. Samples: 68271960. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:12:08,989][27935] Avg episode reward: [(0, '-62.503')] [2022-07-12 21:12:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 34163712. Throughput: 0: 10140.9. Samples: 68333808. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:12:13,990][27935] Avg episode reward: [(0, '-62.610')] [2022-07-12 21:12:18,995][27935] Fps is (10 sec: 5116.8, 60 sec: 5051.2, 300 sec: 5057.4). Total num frames: 34187264. Throughput: 0: 10163.6. Samples: 68395308. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 21:12:18,996][27935] Avg episode reward: [(0, '-62.148')] [2022-07-12 21:12:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 34213888. Throughput: 0: 10162.4. Samples: 68425876. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:23,989][27935] Avg episode reward: [(0, '-62.538')] [2022-07-12 21:12:28,989][27935] Fps is (10 sec: 5225.7, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 34239488. Throughput: 0: 10165.5. Samples: 68487392. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:28,989][27935] Avg episode reward: [(0, '-62.124')] [2022-07-12 21:12:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 34265088. Throughput: 0: 10173.9. Samples: 68548960. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:33,989][27935] Avg episode reward: [(0, '-61.978')] [2022-07-12 21:12:38,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 34290688. Throughput: 0: 10168.7. Samples: 68579624. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:38,989][27935] Avg episode reward: [(0, '-62.413')] [2022-07-12 21:12:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 34315264. Throughput: 0: 10152.5. Samples: 68640932. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:43,989][27935] Avg episode reward: [(0, '-62.231')] [2022-07-12 21:12:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5071.4). Total num frames: 34342912. Throughput: 0: 10259.7. Samples: 68703284. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:48,989][27935] Avg episode reward: [(0, '-61.914')] [2022-07-12 21:12:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 34368512. Throughput: 0: 10280.2. Samples: 68734568. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:53,989][27935] Avg episode reward: [(0, '-61.782')] [2022-07-12 21:12:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5081.8). Total num frames: 34395136. Throughput: 0: 10314.3. Samples: 68797952. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-12 21:12:58,997][27935] Avg episode reward: [(0, '-61.555')] [2022-07-12 21:13:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 34417664. Throughput: 0: 10250.2. Samples: 68856504. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:03,989][27935] Avg episode reward: [(0, '-61.703')] [2022-07-12 21:13:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5078.3). Total num frames: 34445312. Throughput: 0: 10261.6. Samples: 68887648. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:08,989][27935] Avg episode reward: [(0, '-61.880')] [2022-07-12 21:13:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5137.1, 300 sec: 5088.8). Total num frames: 34471936. Throughput: 0: 10293.3. Samples: 68950592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:13,989][27935] Avg episode reward: [(0, '-62.181')] [2022-07-12 21:13:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.6, 300 sec: 5078.3). Total num frames: 34495488. Throughput: 0: 10306.8. Samples: 69012768. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:18,989][27935] Avg episode reward: [(0, '-62.582')] [2022-07-12 21:13:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5081.8). Total num frames: 34523136. Throughput: 0: 10321.5. Samples: 69044092. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:23,989][27935] Avg episode reward: [(0, '-62.340')] [2022-07-12 21:13:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5081.8). Total num frames: 34547712. Throughput: 0: 10347.3. Samples: 69106560. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:28,989][27935] Avg episode reward: [(0, '-62.566')] [2022-07-12 21:13:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5092.2). Total num frames: 34575360. Throughput: 0: 10330.0. Samples: 69168136. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:33,989][27935] Avg episode reward: [(0, '-62.156')] [2022-07-12 21:13:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5088.8). Total num frames: 34600960. Throughput: 0: 10333.7. Samples: 69199584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:38,989][27935] Avg episode reward: [(0, '-62.108')] [2022-07-12 21:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5081.8). Total num frames: 34624512. Throughput: 0: 10301.8. Samples: 69261532. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 21:13:43,989][27935] Avg episode reward: [(0, '-62.363')] [2022-07-12 21:13:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5088.8). Total num frames: 34651136. Throughput: 0: 10370.0. Samples: 69323156. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:13:48,989][27935] Avg episode reward: [(0, '-61.968')] [2022-07-12 21:13:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5092.2). Total num frames: 34677760. Throughput: 0: 10366.9. Samples: 69354160. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:13:53,989][27935] Avg episode reward: [(0, '-62.344')] [2022-07-12 21:13:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 34703360. Throughput: 0: 10330.0. Samples: 69415440. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:13:58,989][27935] Avg episode reward: [(0, '-61.911')] [2022-07-12 21:14:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5137.1, 300 sec: 5088.8). Total num frames: 34725888. Throughput: 0: 10221.9. Samples: 69472752. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:03,990][27935] Avg episode reward: [(0, '-62.255')] [2022-07-12 21:14:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 34753536. Throughput: 0: 10199.5. Samples: 69503068. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:08,989][27935] Avg episode reward: [(0, '-61.512')] [2022-07-12 21:14:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 34777088. Throughput: 0: 10168.7. Samples: 69564152. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:13,998][27935] Avg episode reward: [(0, '-61.179')] [2022-07-12 21:14:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5092.2). Total num frames: 34803712. Throughput: 0: 10175.0. Samples: 69626012. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:18,989][27935] Avg episode reward: [(0, '-61.022')] [2022-07-12 21:14:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 34828288. Throughput: 0: 10164.3. Samples: 69656976. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:23,989][27935] Avg episode reward: [(0, '-60.062')] [2022-07-12 21:14:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5092.2). Total num frames: 34854912. Throughput: 0: 10150.6. Samples: 69718308. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:14:28,989][27935] Avg episode reward: [(0, '-59.774')] [2022-07-12 21:14:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 34880512. Throughput: 0: 10121.6. Samples: 69778628. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:33,989][27935] Avg episode reward: [(0, '-59.720')] [2022-07-12 21:14:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 34906112. Throughput: 0: 10112.1. Samples: 69809204. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:38,989][27935] Avg episode reward: [(0, '-60.023')] [2022-07-12 21:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 34929664. Throughput: 0: 10112.6. Samples: 69870508. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:43,989][27935] Avg episode reward: [(0, '-60.208')] [2022-07-12 21:14:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 34956288. Throughput: 0: 10202.5. Samples: 69931864. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:48,989][27935] Avg episode reward: [(0, '-60.535')] [2022-07-12 21:14:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5095.7). Total num frames: 34981888. Throughput: 0: 10212.5. Samples: 69962628. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:53,989][27935] Avg episode reward: [(0, '-61.609')] [2022-07-12 21:14:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5109.6). Total num frames: 35008512. Throughput: 0: 10220.5. Samples: 70024076. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:14:58,989][27935] Avg episode reward: [(0, '-61.557')] [2022-07-12 21:15:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5095.7). Total num frames: 35030016. Throughput: 0: 10108.9. Samples: 70080912. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:15:03,989][27935] Avg episode reward: [(0, '-61.845')] [2022-07-12 21:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5099.2). Total num frames: 35056640. Throughput: 0: 10100.7. Samples: 70111508. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:15:08,989][27935] Avg episode reward: [(0, '-61.728')] [2022-07-12 21:15:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 35081216. Throughput: 0: 10102.9. Samples: 70172940. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:15:13,989][27935] Avg episode reward: [(0, '-61.905')] [2022-07-12 21:15:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5099.2). Total num frames: 35107840. Throughput: 0: 10120.9. Samples: 70234068. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:18,989][27935] Avg episode reward: [(0, '-62.001')] [2022-07-12 21:15:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 35132416. Throughput: 0: 10126.1. Samples: 70264880. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:23,989][27935] Avg episode reward: [(0, '-61.568')] [2022-07-12 21:15:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5095.7). Total num frames: 35158016. Throughput: 0: 10113.6. Samples: 70325620. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:28,989][27935] Avg episode reward: [(0, '-61.618')] [2022-07-12 21:15:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 35183616. Throughput: 0: 10101.6. Samples: 70386436. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:33,989][27935] Avg episode reward: [(0, '-61.509')] [2022-07-12 21:15:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5092.2). Total num frames: 35208192. Throughput: 0: 10092.5. Samples: 70416792. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:38,989][27935] Avg episode reward: [(0, '-61.250')] [2022-07-12 21:15:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 35233792. Throughput: 0: 10083.1. Samples: 70477816. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:43,989][27935] Avg episode reward: [(0, '-61.079')] [2022-07-12 21:15:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5095.7). Total num frames: 35259392. Throughput: 0: 10186.7. Samples: 70539312. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:48,989][27935] Avg episode reward: [(0, '-61.290')] [2022-07-12 21:15:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 35286016. Throughput: 0: 10190.9. Samples: 70570100. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:53,989][27935] Avg episode reward: [(0, '-61.257')] [2022-07-12 21:15:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5099.2). Total num frames: 35311616. Throughput: 0: 10188.4. Samples: 70631416. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:15:58,989][27935] Avg episode reward: [(0, '-60.899')] [2022-07-12 21:16:03,991][27935] Fps is (10 sec: 4914.0, 60 sec: 5085.7, 300 sec: 5095.7). Total num frames: 35335168. Throughput: 0: 10095.5. Samples: 70688388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:03,992][27935] Avg episode reward: [(0, '-60.544')] [2022-07-12 21:16:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5085.3). Total num frames: 35359744. Throughput: 0: 10090.7. Samples: 70718960. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:08,989][27935] Avg episode reward: [(0, '-60.733')] [2022-07-12 21:16:13,989][27935] Fps is (10 sec: 5121.2, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 35386368. Throughput: 0: 10085.4. Samples: 70779464. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:13,989][27935] Avg episode reward: [(0, '-60.300')] [2022-07-12 21:16:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 35410944. Throughput: 0: 10079.1. Samples: 70839996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:18,989][27935] Avg episode reward: [(0, '-60.484')] [2022-07-12 21:16:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5088.8). Total num frames: 35435520. Throughput: 0: 10080.5. Samples: 70870412. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:23,989][27935] Avg episode reward: [(0, '-60.279')] [2022-07-12 21:16:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 35461120. Throughput: 0: 10076.8. Samples: 70931272. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:28,989][27935] Avg episode reward: [(0, '-60.734')] [2022-07-12 21:16:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 35486720. Throughput: 0: 10044.3. Samples: 70991304. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:33,989][27935] Avg episode reward: [(0, '-61.181')] [2022-07-12 21:16:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 35512320. Throughput: 0: 10035.5. Samples: 71021696. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:38,989][27935] Avg episode reward: [(0, '-60.329')] [2022-07-12 21:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5085.3). Total num frames: 35535872. Throughput: 0: 10032.5. Samples: 71082880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 21:16:43,990][27935] Avg episode reward: [(0, '-60.179')] [2022-07-12 21:16:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5088.8). Total num frames: 35562496. Throughput: 0: 10134.7. Samples: 71144424. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:16:48,989][27935] Avg episode reward: [(0, '-59.922')] [2022-07-12 21:16:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5088.8). Total num frames: 35588096. Throughput: 0: 10134.7. Samples: 71175020. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:16:53,989][27935] Avg episode reward: [(0, '-59.985')] [2022-07-12 21:16:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5092.2). Total num frames: 35613696. Throughput: 0: 10148.4. Samples: 71236144. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:16:58,989][27935] Avg episode reward: [(0, '-60.923')] [2022-07-12 21:17:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.8, 300 sec: 5085.3). Total num frames: 35636224. Throughput: 0: 10071.6. Samples: 71293216. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:03,989][27935] Avg episode reward: [(0, '-61.609')] [2022-07-12 21:17:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 35661824. Throughput: 0: 10069.4. Samples: 71323536. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:08,989][27935] Avg episode reward: [(0, '-62.059')] [2022-07-12 21:17:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5017.6, 300 sec: 5085.4). Total num frames: 35687424. Throughput: 0: 10064.3. Samples: 71384164. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:13,989][27935] Avg episode reward: [(0, '-62.609')] [2022-07-12 21:17:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5081.8). Total num frames: 35713024. Throughput: 0: 10070.5. Samples: 71444476. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:18,989][27935] Avg episode reward: [(0, '-63.476')] [2022-07-12 21:17:23,990][27935] Fps is (10 sec: 4914.5, 60 sec: 5017.5, 300 sec: 5074.8). Total num frames: 35736576. Throughput: 0: 10062.5. Samples: 71474524. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:23,991][27935] Avg episode reward: [(0, '-63.222')] [2022-07-12 21:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 35762176. Throughput: 0: 9998.6. Samples: 71532816. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 21:17:28,989][27935] Avg episode reward: [(0, '-62.609')] [2022-07-12 21:17:33,989][27935] Fps is (10 sec: 4916.0, 60 sec: 4983.5, 300 sec: 5067.9). Total num frames: 35785728. Throughput: 0: 9974.9. Samples: 71593296. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:33,989][27935] Avg episode reward: [(0, '-62.740')] [2022-07-12 21:17:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5074.9). Total num frames: 35812352. Throughput: 0: 9973.9. Samples: 71623844. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:38,989][27935] Avg episode reward: [(0, '-62.416')] [2022-07-12 21:17:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 35837952. Throughput: 0: 9947.2. Samples: 71683768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:43,989][27935] Avg episode reward: [(0, '-61.496')] [2022-07-12 21:17:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5064.5). Total num frames: 35862528. Throughput: 0: 10036.7. Samples: 71744868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:48,989][27935] Avg episode reward: [(0, '-61.398')] [2022-07-12 21:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 5057.5). Total num frames: 35887104. Throughput: 0: 10036.4. Samples: 71775176. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:53,989][27935] Avg episode reward: [(0, '-60.829')] [2022-07-12 21:17:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 35914752. Throughput: 0: 10041.4. Samples: 71836024. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:17:58,989][27935] Avg episode reward: [(0, '-61.778')] [2022-07-12 21:18:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 35937280. Throughput: 0: 9970.9. Samples: 71893164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:18:03,989][27935] Avg episode reward: [(0, '-61.177')] [2022-07-12 21:18:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5054.0). Total num frames: 35962880. Throughput: 0: 9985.4. Samples: 71923852. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:18:08,989][27935] Avg episode reward: [(0, '-61.127')] [2022-07-12 21:18:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5061.0). Total num frames: 35988480. Throughput: 0: 10061.7. Samples: 71985592. Policy #0 lag: (min: 0.0, avg: 8.3, max: 22.0) [2022-07-12 21:18:13,990][27935] Avg episode reward: [(0, '-61.781')] [2022-07-12 21:18:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 36015104. Throughput: 0: 10063.6. Samples: 72046160. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:18,989][27935] Avg episode reward: [(0, '-61.637')] [2022-07-12 21:18:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.8, 300 sec: 5054.0). Total num frames: 36038656. Throughput: 0: 10069.0. Samples: 72076948. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:23,990][27935] Avg episode reward: [(0, '-61.775')] [2022-07-12 21:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 36064256. Throughput: 0: 10101.9. Samples: 72138352. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:28,990][27935] Avg episode reward: [(0, '-61.335')] [2022-07-12 21:18:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 36089856. Throughput: 0: 10112.8. Samples: 72199944. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:33,989][27935] Avg episode reward: [(0, '-60.986')] [2022-07-12 21:18:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 36115456. Throughput: 0: 10116.8. Samples: 72230432. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:38,989][27935] Avg episode reward: [(0, '-61.645')] [2022-07-12 21:18:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 36141056. Throughput: 0: 10131.1. Samples: 72291924. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:43,989][27935] Avg episode reward: [(0, '-61.726')] [2022-07-12 21:18:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 36165632. Throughput: 0: 10223.7. Samples: 72353232. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:48,989][27935] Avg episode reward: [(0, '-62.257')] [2022-07-12 21:18:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 36193280. Throughput: 0: 10226.6. Samples: 72384048. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:53,989][27935] Avg episode reward: [(0, '-62.676')] [2022-07-12 21:18:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 36217856. Throughput: 0: 10232.9. Samples: 72446072. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 21:18:58,989][27935] Avg episode reward: [(0, '-62.780')] [2022-07-12 21:19:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5047.1). Total num frames: 36242432. Throughput: 0: 10181.6. Samples: 72504332. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:03,989][27935] Avg episode reward: [(0, '-63.035')] [2022-07-12 21:19:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 36269056. Throughput: 0: 10178.2. Samples: 72534968. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:08,989][27935] Avg episode reward: [(0, '-62.565')] [2022-07-12 21:19:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 36293632. Throughput: 0: 10189.8. Samples: 72596892. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:13,989][27935] Avg episode reward: [(0, '-62.592')] [2022-07-12 21:19:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 36318208. Throughput: 0: 10197.3. Samples: 72658824. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:18,989][27935] Avg episode reward: [(0, '-62.795')] [2022-07-12 21:19:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5054.0). Total num frames: 36345856. Throughput: 0: 10204.2. Samples: 72689620. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:23,989][27935] Avg episode reward: [(0, '-62.074')] [2022-07-12 21:19:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5054.0). Total num frames: 36371456. Throughput: 0: 10202.6. Samples: 72751040. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:28,989][27935] Avg episode reward: [(0, '-61.642')] [2022-07-12 21:19:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 36396032. Throughput: 0: 9518.9. Samples: 72781584. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:33,989][27935] Avg episode reward: [(0, '-62.281')] [2022-07-12 21:19:38,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5102.6, 300 sec: 5057.5). Total num frames: 36421632. Throughput: 0: 10186.0. Samples: 72842456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:38,993][27935] Avg episode reward: [(0, '-61.883')] [2022-07-12 21:19:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5057.5). Total num frames: 36448256. Throughput: 0: 10182.0. Samples: 72904260. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-12 21:19:43,989][27935] Avg episode reward: [(0, '-61.584')] [2022-07-12 21:19:48,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5120.0, 300 sec: 5054.0). Total num frames: 36472832. Throughput: 0: 10250.0. Samples: 72965580. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:19:48,989][27935] Avg episode reward: [(0, '-60.845')] [2022-07-12 21:19:53,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 36499456. Throughput: 0: 10254.0. Samples: 72996400. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:19:53,989][27935] Avg episode reward: [(0, '-60.597')] [2022-07-12 21:19:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 36523008. Throughput: 0: 10245.5. Samples: 73057940. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:19:58,989][27935] Avg episode reward: [(0, '-60.570')] [2022-07-12 21:20:03,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5120.0, 300 sec: 5061.0). Total num frames: 36549632. Throughput: 0: 10153.3. Samples: 73115720. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:03,992][27935] Avg episode reward: [(0, '-59.541')] [2022-07-12 21:20:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 36574208. Throughput: 0: 10160.9. Samples: 73146860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:08,989][27935] Avg episode reward: [(0, '-59.159')] [2022-07-12 21:20:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 36599808. Throughput: 0: 10169.6. Samples: 73208672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:13,989][27935] Avg episode reward: [(0, '-59.851')] [2022-07-12 21:20:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5061.0). Total num frames: 36625408. Throughput: 0: 10860.9. Samples: 73270324. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:18,989][27935] Avg episode reward: [(0, '-60.019')] [2022-07-12 21:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 36649984. Throughput: 0: 10189.5. Samples: 73300948. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:23,989][27935] Avg episode reward: [(0, '-60.629')] [2022-07-12 21:20:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 36675584. Throughput: 0: 10169.1. Samples: 73361872. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:28,989][27935] Avg episode reward: [(0, '-61.319')] [2022-07-12 21:20:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5064.5). Total num frames: 36702208. Throughput: 0: 10154.0. Samples: 73422508. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 21:20:33,989][27935] Avg episode reward: [(0, '-61.472')] [2022-07-12 21:20:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5103.2, 300 sec: 5064.5). Total num frames: 36727808. Throughput: 0: 10144.4. Samples: 73452896. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:20:38,989][27935] Avg episode reward: [(0, '-61.690')] [2022-07-12 21:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 36751360. Throughput: 0: 10139.7. Samples: 73514228. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:20:43,990][27935] Avg episode reward: [(0, '-61.176')] [2022-07-12 21:20:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5061.0). Total num frames: 36779008. Throughput: 0: 9532.4. Samples: 73544676. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:20:48,989][27935] Avg episode reward: [(0, '-60.841')] [2022-07-12 21:20:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 36803584. Throughput: 0: 10204.8. Samples: 73606076. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:20:53,989][27935] Avg episode reward: [(0, '-59.896')] [2022-07-12 21:20:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5064.5). Total num frames: 36829184. Throughput: 0: 10204.7. Samples: 73667884. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:20:58,989][27935] Avg episode reward: [(0, '-60.019')] [2022-07-12 21:21:03,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5068.5, 300 sec: 5064.4). Total num frames: 36853760. Throughput: 0: 10124.9. Samples: 73725980. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:21:03,993][27935] Avg episode reward: [(0, '-59.116')] [2022-07-12 21:21:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 36879360. Throughput: 0: 10131.5. Samples: 73756864. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:21:08,989][27935] Avg episode reward: [(0, '-59.361')] [2022-07-12 21:21:13,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 36903936. Throughput: 0: 10144.0. Samples: 73818352. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:21:13,989][27935] Avg episode reward: [(0, '-59.212')] [2022-07-12 21:21:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 36929536. Throughput: 0: 10140.7. Samples: 73878840. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-12 21:21:18,989][27935] Avg episode reward: [(0, '-59.721')] [2022-07-12 21:21:23,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5085.8, 300 sec: 5064.5). Total num frames: 36955136. Throughput: 0: 10155.4. Samples: 73909892. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:23,990][27935] Avg episode reward: [(0, '-60.283')] [2022-07-12 21:21:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 36981760. Throughput: 0: 10162.9. Samples: 73971560. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:28,989][27935] Avg episode reward: [(0, '-60.921')] [2022-07-12 21:21:33,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 37005312. Throughput: 0: 10847.5. Samples: 74032812. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:33,989][27935] Avg episode reward: [(0, '-60.787')] [2022-07-12 21:21:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 37032960. Throughput: 0: 10165.7. Samples: 74063532. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:38,989][27935] Avg episode reward: [(0, '-60.444')] [2022-07-12 21:21:43,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5102.6, 300 sec: 5067.9). Total num frames: 37057536. Throughput: 0: 10167.8. Samples: 74125472. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:43,993][27935] Avg episode reward: [(0, '-60.466')] [2022-07-12 21:21:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 37084160. Throughput: 0: 9555.8. Samples: 74155956. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:48,989][27935] Avg episode reward: [(0, '-60.681')] [2022-07-12 21:21:53,989][27935] Fps is (10 sec: 5224.3, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 37109760. Throughput: 0: 10239.7. Samples: 74217652. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:53,989][27935] Avg episode reward: [(0, '-60.726')] [2022-07-12 21:21:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 37136384. Throughput: 0: 10251.5. Samples: 74279668. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:21:58,989][27935] Avg episode reward: [(0, '-59.968')] [2022-07-12 21:22:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5086.2, 300 sec: 5074.9). Total num frames: 37158912. Throughput: 0: 10186.2. Samples: 74337220. Policy #0 lag: (min: 0.0, avg: 10.8, max: 22.0) [2022-07-12 21:22:03,989][27935] Avg episode reward: [(0, '-59.861')] [2022-07-12 21:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 37183488. Throughput: 0: 10174.4. Samples: 74367736. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:08,989][27935] Avg episode reward: [(0, '-60.349')] [2022-07-12 21:22:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 37209088. Throughput: 0: 10178.8. Samples: 74429608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:13,989][27935] Avg episode reward: [(0, '-60.898')] [2022-07-12 21:22:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 37235712. Throughput: 0: 10165.6. Samples: 74490264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:18,989][27935] Avg episode reward: [(0, '-60.766')] [2022-07-12 21:22:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 37262336. Throughput: 0: 10167.4. Samples: 74521064. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:23,990][27935] Avg episode reward: [(0, '-60.883')] [2022-07-12 21:22:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 37286912. Throughput: 0: 10150.8. Samples: 74582220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:28,989][27935] Avg episode reward: [(0, '-61.029')] [2022-07-12 21:22:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 37311488. Throughput: 0: 10820.4. Samples: 74642872. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:33,989][27935] Avg episode reward: [(0, '-61.616')] [2022-07-12 21:22:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 37337088. Throughput: 0: 10137.5. Samples: 74673840. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:38,989][27935] Avg episode reward: [(0, '-61.096')] [2022-07-12 21:22:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.2, 300 sec: 5085.3). Total num frames: 37362688. Throughput: 0: 10101.7. Samples: 74734244. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:43,989][27935] Avg episode reward: [(0, '-61.175')] [2022-07-12 21:22:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5085.3). Total num frames: 37387264. Throughput: 0: 10183.3. Samples: 74795468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:48,989][27935] Avg episode reward: [(0, '-61.232')] [2022-07-12 21:22:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 37413888. Throughput: 0: 10199.3. Samples: 74826704. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 21:22:53,989][27935] Avg episode reward: [(0, '-61.530')] [2022-07-12 21:22:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 37439488. Throughput: 0: 10196.1. Samples: 74888432. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:22:58,990][27935] Avg episode reward: [(0, '-61.839')] [2022-07-12 21:23:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 37464064. Throughput: 0: 10124.6. Samples: 74945872. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:03,989][27935] Avg episode reward: [(0, '-61.970')] [2022-07-12 21:23:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 37488640. Throughput: 0: 10119.2. Samples: 74976428. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:08,989][27935] Avg episode reward: [(0, '-62.039')] [2022-07-12 21:23:13,991][27935] Fps is (10 sec: 4914.1, 60 sec: 5068.6, 300 sec: 5078.3). Total num frames: 37513216. Throughput: 0: 10117.8. Samples: 75037544. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:13,991][27935] Avg episode reward: [(0, '-61.821')] [2022-07-12 21:23:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 37539840. Throughput: 0: 10126.2. Samples: 75098552. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:18,989][27935] Avg episode reward: [(0, '-61.137')] [2022-07-12 21:23:23,989][27935] Fps is (10 sec: 5121.1, 60 sec: 5034.7, 300 sec: 5085.3). Total num frames: 37564416. Throughput: 0: 10118.1. Samples: 75129156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:23,989][27935] Avg episode reward: [(0, '-60.693')] [2022-07-12 21:23:28,989][27935] Fps is (10 sec: 5119.7, 60 sec: 5068.7, 300 sec: 5088.7). Total num frames: 37591040. Throughput: 0: 10123.6. Samples: 75189812. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:28,990][27935] Avg episode reward: [(0, '-61.396')] [2022-07-12 21:23:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5085.3). Total num frames: 37615616. Throughput: 0: 10064.3. Samples: 75248360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:33,989][27935] Avg episode reward: [(0, '-61.122')] [2022-07-12 21:23:38,989][27935] Fps is (10 sec: 4813.1, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 37639168. Throughput: 0: 10050.0. Samples: 75278956. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:23:38,989][27935] Avg episode reward: [(0, '-61.044')] [2022-07-12 21:23:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5085.3). Total num frames: 37665792. Throughput: 0: 10032.6. Samples: 75339900. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:23:43,989][27935] Avg episode reward: [(0, '-61.264')] [2022-07-12 21:23:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 37691392. Throughput: 0: 10127.6. Samples: 75401616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:23:48,989][27935] Avg episode reward: [(0, '-61.304')] [2022-07-12 21:23:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 37715968. Throughput: 0: 10132.9. Samples: 75432408. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:23:53,989][27935] Avg episode reward: [(0, '-61.140')] [2022-07-12 21:23:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 37743616. Throughput: 0: 10153.6. Samples: 75494436. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:23:58,989][27935] Avg episode reward: [(0, '-61.328')] [2022-07-12 21:24:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 37766144. Throughput: 0: 10081.8. Samples: 75552232. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:03,989][27935] Avg episode reward: [(0, '-61.583')] [2022-07-12 21:24:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 37792768. Throughput: 0: 10092.5. Samples: 75583316. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:08,989][27935] Avg episode reward: [(0, '-61.734')] [2022-07-12 21:24:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5069.0, 300 sec: 5081.8). Total num frames: 37817344. Throughput: 0: 10123.6. Samples: 75645368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:13,989][27935] Avg episode reward: [(0, '-61.952')] [2022-07-12 21:24:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 37844992. Throughput: 0: 10198.7. Samples: 75707300. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:18,989][27935] Avg episode reward: [(0, '-62.126')] [2022-07-12 21:24:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 37869568. Throughput: 0: 10206.5. Samples: 75738248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:23,989][27935] Avg episode reward: [(0, '-62.256')] [2022-07-12 21:24:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 37896192. Throughput: 0: 10240.2. Samples: 75800712. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-12 21:24:28,989][27935] Avg episode reward: [(0, '-61.563')] [2022-07-12 21:24:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5085.3). Total num frames: 37921792. Throughput: 0: 10268.7. Samples: 75863708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:33,989][27935] Avg episode reward: [(0, '-60.864')] [2022-07-12 21:24:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5085.3). Total num frames: 37948416. Throughput: 0: 10285.5. Samples: 75895256. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:38,989][27935] Avg episode reward: [(0, '-60.188')] [2022-07-12 21:24:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 37976064. Throughput: 0: 10294.7. Samples: 75957696. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:43,989][27935] Avg episode reward: [(0, '-60.410')] [2022-07-12 21:24:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5085.3). Total num frames: 37999616. Throughput: 0: 10405.1. Samples: 76020464. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:48,989][27935] Avg episode reward: [(0, '-59.854')] [2022-07-12 21:24:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5099.2). Total num frames: 38027264. Throughput: 0: 10411.3. Samples: 76051824. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:53,989][27935] Avg episode reward: [(0, '-60.698')] [2022-07-12 21:24:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5092.2). Total num frames: 38051840. Throughput: 0: 10417.2. Samples: 76114140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:24:58,990][27935] Avg episode reward: [(0, '-60.974')] [2022-07-12 21:25:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5095.7). Total num frames: 38077440. Throughput: 0: 10350.8. Samples: 76173084. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:25:03,989][27935] Avg episode reward: [(0, '-60.858')] [2022-07-12 21:25:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 38103040. Throughput: 0: 10366.4. Samples: 76204736. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:25:08,989][27935] Avg episode reward: [(0, '-60.712')] [2022-07-12 21:25:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5099.2). Total num frames: 38129664. Throughput: 0: 10379.9. Samples: 76267808. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:25:13,989][27935] Avg episode reward: [(0, '-61.195')] [2022-07-12 21:25:18,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5171.2, 300 sec: 5102.6). Total num frames: 38155264. Throughput: 0: 10371.9. Samples: 76330444. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:18,989][27935] Avg episode reward: [(0, '-61.531')] [2022-07-12 21:25:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5109.6). Total num frames: 38182912. Throughput: 0: 10367.8. Samples: 76361808. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:23,990][27935] Avg episode reward: [(0, '-60.801')] [2022-07-12 21:25:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5102.6). Total num frames: 38207488. Throughput: 0: 10383.7. Samples: 76424960. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:28,990][27935] Avg episode reward: [(0, '-61.194')] [2022-07-12 21:25:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5102.6). Total num frames: 38233088. Throughput: 0: 10379.5. Samples: 76487540. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:33,989][27935] Avg episode reward: [(0, '-62.442')] [2022-07-12 21:25:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5113.1). Total num frames: 38259712. Throughput: 0: 10380.5. Samples: 76518948. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:38,989][27935] Avg episode reward: [(0, '-63.066')] [2022-07-12 21:25:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5113.1). Total num frames: 38287360. Throughput: 0: 10389.3. Samples: 76581660. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:43,989][27935] Avg episode reward: [(0, '-62.532')] [2022-07-12 21:25:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5109.6). Total num frames: 38310912. Throughput: 0: 10469.7. Samples: 76644220. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:48,989][27935] Avg episode reward: [(0, '-62.632')] [2022-07-12 21:25:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5113.1). Total num frames: 38337536. Throughput: 0: 10465.2. Samples: 76675668. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:53,990][27935] Avg episode reward: [(0, '-62.845')] [2022-07-12 21:25:58,996][27935] Fps is (10 sec: 5423.5, 60 sec: 5221.8, 300 sec: 5123.4). Total num frames: 38365184. Throughput: 0: 10469.1. Samples: 76738988. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:25:58,996][27935] Avg episode reward: [(0, '-62.777')] [2022-07-12 21:26:03,993][27935] Fps is (10 sec: 5117.9, 60 sec: 5187.9, 300 sec: 5116.5). Total num frames: 38388736. Throughput: 0: 10382.9. Samples: 76797716. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 21:26:03,993][27935] Avg episode reward: [(0, '-62.054')] [2022-07-12 21:26:08,989][27935] Fps is (10 sec: 5021.0, 60 sec: 5205.3, 300 sec: 5123.5). Total num frames: 38415360. Throughput: 0: 10386.2. Samples: 76829188. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:08,989][27935] Avg episode reward: [(0, '-61.831')] [2022-07-12 21:26:13,989][27935] Fps is (10 sec: 5224.5, 60 sec: 5188.3, 300 sec: 5123.5). Total num frames: 38440960. Throughput: 0: 10389.8. Samples: 76892500. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:13,989][27935] Avg episode reward: [(0, '-61.674')] [2022-07-12 21:26:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5126.9). Total num frames: 38467584. Throughput: 0: 10383.2. Samples: 76954784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:18,989][27935] Avg episode reward: [(0, '-61.610')] [2022-07-12 21:26:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5126.9). Total num frames: 38494208. Throughput: 0: 10390.5. Samples: 76986520. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:23,989][27935] Avg episode reward: [(0, '-61.305')] [2022-07-12 21:26:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5133.9). Total num frames: 38519808. Throughput: 0: 10395.7. Samples: 77049468. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:28,992][27935] Avg episode reward: [(0, '-61.109')] [2022-07-12 21:26:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5123.5). Total num frames: 38544384. Throughput: 0: 10346.2. Samples: 77109800. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:33,989][27935] Avg episode reward: [(0, '-60.982')] [2022-07-12 21:26:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5130.5). Total num frames: 38571008. Throughput: 0: 10325.2. Samples: 77140304. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:38,989][27935] Avg episode reward: [(0, '-60.695')] [2022-07-12 21:26:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 38596608. Throughput: 0: 10298.4. Samples: 77202348. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:43,989][27935] Avg episode reward: [(0, '-61.219')] [2022-07-12 21:26:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5126.9). Total num frames: 38622208. Throughput: 0: 10355.1. Samples: 77263652. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:48,990][27935] Avg episode reward: [(0, '-61.082')] [2022-07-12 21:26:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5123.5). Total num frames: 38647808. Throughput: 0: 10341.8. Samples: 77294568. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-12 21:26:53,989][27935] Avg episode reward: [(0, '-61.663')] [2022-07-12 21:26:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.7, 300 sec: 5133.9). Total num frames: 38673408. Throughput: 0: 10308.4. Samples: 77356376. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:26:58,989][27935] Avg episode reward: [(0, '-62.309')] [2022-07-12 21:27:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.4, 300 sec: 5130.4). Total num frames: 38696960. Throughput: 0: 10225.5. Samples: 77414932. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:03,989][27935] Avg episode reward: [(0, '-61.809')] [2022-07-12 21:27:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 38723584. Throughput: 0: 10207.5. Samples: 77445856. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:08,989][27935] Avg episode reward: [(0, '-62.062')] [2022-07-12 21:27:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 38750208. Throughput: 0: 10188.8. Samples: 77507964. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:13,989][27935] Avg episode reward: [(0, '-61.978')] [2022-07-12 21:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 38773760. Throughput: 0: 10223.9. Samples: 77569876. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:18,989][27935] Avg episode reward: [(0, '-62.184')] [2022-07-12 21:27:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 38801408. Throughput: 0: 10233.2. Samples: 77600796. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:23,989][27935] Avg episode reward: [(0, '-62.051')] [2022-07-12 21:27:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 38825984. Throughput: 0: 10230.9. Samples: 77662740. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:28,989][27935] Avg episode reward: [(0, '-61.944')] [2022-07-12 21:27:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 38853632. Throughput: 0: 10235.4. Samples: 77724244. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:33,989][27935] Avg episode reward: [(0, '-62.105')] [2022-07-12 21:27:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 38877184. Throughput: 0: 10237.6. Samples: 77755260. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:38,989][27935] Avg episode reward: [(0, '-62.326')] [2022-07-12 21:27:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 38902784. Throughput: 0: 10202.1. Samples: 77815472. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:27:43,989][27935] Avg episode reward: [(0, '-62.645')] [2022-07-12 21:27:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 38929408. Throughput: 0: 10280.1. Samples: 77877536. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:27:48,989][27935] Avg episode reward: [(0, '-62.559')] [2022-07-12 21:27:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 38956032. Throughput: 0: 10293.4. Samples: 77909060. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:27:53,990][27935] Avg episode reward: [(0, '-62.690')] [2022-07-12 21:27:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 38981632. Throughput: 0: 10293.9. Samples: 77971188. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:27:58,989][27935] Avg episode reward: [(0, '-61.906')] [2022-07-12 21:28:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 39004160. Throughput: 0: 10210.1. Samples: 78029332. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:03,989][27935] Avg episode reward: [(0, '-61.913')] [2022-07-12 21:28:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 39031808. Throughput: 0: 10221.9. Samples: 78060780. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:08,989][27935] Avg episode reward: [(0, '-60.675')] [2022-07-12 21:28:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 39057408. Throughput: 0: 10221.5. Samples: 78122708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:13,989][27935] Avg episode reward: [(0, '-60.609')] [2022-07-12 21:28:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 39083008. Throughput: 0: 10246.8. Samples: 78185352. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:18,989][27935] Avg episode reward: [(0, '-60.306')] [2022-07-12 21:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 39109632. Throughput: 0: 10263.8. Samples: 78217132. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:23,989][27935] Avg episode reward: [(0, '-60.155')] [2022-07-12 21:28:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 39135232. Throughput: 0: 10330.2. Samples: 78280332. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-12 21:28:28,989][27935] Avg episode reward: [(0, '-60.469')] [2022-07-12 21:28:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 39162880. Throughput: 0: 10331.7. Samples: 78342464. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:33,989][27935] Avg episode reward: [(0, '-60.762')] [2022-07-12 21:28:38,996][27935] Fps is (10 sec: 5218.5, 60 sec: 5170.6, 300 sec: 5158.1). Total num frames: 39187456. Throughput: 0: 10330.0. Samples: 78373988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:38,997][27935] Avg episode reward: [(0, '-60.814')] [2022-07-12 21:28:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 39213056. Throughput: 0: 10339.0. Samples: 78436444. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:43,989][27935] Avg episode reward: [(0, '-61.064')] [2022-07-12 21:28:48,989][27935] Fps is (10 sec: 5226.3, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 39239680. Throughput: 0: 9740.4. Samples: 78467652. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:48,990][27935] Avg episode reward: [(0, '-61.274')] [2022-07-12 21:28:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 39265280. Throughput: 0: 10429.2. Samples: 78530096. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:53,989][27935] Avg episode reward: [(0, '-62.198')] [2022-07-12 21:28:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 39290880. Throughput: 0: 10433.8. Samples: 78592228. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:28:58,989][27935] Avg episode reward: [(0, '-62.031')] [2022-07-12 21:29:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5161.7). Total num frames: 39315456. Throughput: 0: 10327.5. Samples: 78650088. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:29:03,989][27935] Avg episode reward: [(0, '-61.867')] [2022-07-12 21:29:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 39341056. Throughput: 0: 10298.8. Samples: 78680580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:29:08,989][27935] Avg episode reward: [(0, '-61.579')] [2022-07-12 21:29:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 39366656. Throughput: 0: 10280.4. Samples: 78742948. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:29:13,989][27935] Avg episode reward: [(0, '-61.929')] [2022-07-12 21:29:18,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5153.8, 300 sec: 5161.6). Total num frames: 39392256. Throughput: 0: 10279.2. Samples: 78805064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 21:29:18,993][27935] Avg episode reward: [(0, '-61.857')] [2022-07-12 21:29:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 39418880. Throughput: 0: 10271.7. Samples: 78836136. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:23,989][27935] Avg episode reward: [(0, '-61.279')] [2022-07-12 21:29:28,996][27935] Fps is (10 sec: 5220.3, 60 sec: 5153.5, 300 sec: 5161.5). Total num frames: 39444480. Throughput: 0: 10262.7. Samples: 78898344. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:28,997][27935] Avg episode reward: [(0, '-61.016')] [2022-07-12 21:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5154.7). Total num frames: 39469056. Throughput: 0: 10892.9. Samples: 78957832. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:33,989][27935] Avg episode reward: [(0, '-61.716')] [2022-07-12 21:29:38,989][27935] Fps is (10 sec: 5021.4, 60 sec: 5120.6, 300 sec: 5147.8). Total num frames: 39494656. Throughput: 0: 10168.7. Samples: 78987688. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:38,989][27935] Avg episode reward: [(0, '-62.262')] [2022-07-12 21:29:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 39520256. Throughput: 0: 10155.4. Samples: 79049220. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:43,989][27935] Avg episode reward: [(0, '-62.564')] [2022-07-12 21:29:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 39546880. Throughput: 0: 10248.0. Samples: 79111248. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:48,990][27935] Avg episode reward: [(0, '-62.625')] [2022-07-12 21:29:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5147.8). Total num frames: 39570432. Throughput: 0: 10264.4. Samples: 79142476. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:53,995][27935] Avg episode reward: [(0, '-63.297')] [2022-07-12 21:29:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 39598080. Throughput: 0: 10266.2. Samples: 79204928. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:29:58,989][27935] Avg episode reward: [(0, '-63.282')] [2022-07-12 21:30:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5147.8). Total num frames: 39621632. Throughput: 0: 10176.3. Samples: 79262960. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:30:03,989][27935] Avg episode reward: [(0, '-63.729')] [2022-07-12 21:30:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 39647232. Throughput: 0: 10170.5. Samples: 79293808. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-12 21:30:08,989][27935] Avg episode reward: [(0, '-64.084')] [2022-07-12 21:30:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 39672832. Throughput: 0: 10170.3. Samples: 79355932. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:13,990][27935] Avg episode reward: [(0, '-64.045')] [2022-07-12 21:30:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.3, 300 sec: 5140.8). Total num frames: 39699456. Throughput: 0: 10217.0. Samples: 79417596. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:18,989][27935] Avg episode reward: [(0, '-64.680')] [2022-07-12 21:30:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 39725056. Throughput: 0: 10250.0. Samples: 79448936. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:23,989][27935] Avg episode reward: [(0, '-64.448')] [2022-07-12 21:30:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.6, 300 sec: 5144.3). Total num frames: 39750656. Throughput: 0: 10253.4. Samples: 79510624. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:28,989][27935] Avg episode reward: [(0, '-64.477')] [2022-07-12 21:30:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 39776256. Throughput: 0: 10241.9. Samples: 79572132. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:33,990][27935] Avg episode reward: [(0, '-63.374')] [2022-07-12 21:30:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 39802880. Throughput: 0: 10239.4. Samples: 79603248. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:38,989][27935] Avg episode reward: [(0, '-63.437')] [2022-07-12 21:30:43,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 39828480. Throughput: 0: 10240.8. Samples: 79665760. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:43,989][27935] Avg episode reward: [(0, '-63.707')] [2022-07-12 21:30:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 39854080. Throughput: 0: 10315.4. Samples: 79727152. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:48,989][27935] Avg episode reward: [(0, '-62.369')] [2022-07-12 21:30:53,992][27935] Fps is (10 sec: 5118.1, 60 sec: 5153.8, 300 sec: 5133.9). Total num frames: 39879680. Throughput: 0: 10327.7. Samples: 79758592. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:53,993][27935] Avg episode reward: [(0, '-62.464')] [2022-07-12 21:30:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.4). Total num frames: 39906304. Throughput: 0: 10343.7. Samples: 79821400. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 21:30:58,989][27935] Avg episode reward: [(0, '-62.161')] [2022-07-12 21:31:03,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 39930880. Throughput: 0: 10263.2. Samples: 79879440. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:03,989][27935] Avg episode reward: [(0, '-62.702')] [2022-07-12 21:31:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 39955456. Throughput: 0: 10257.3. Samples: 79910516. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:08,989][27935] Avg episode reward: [(0, '-62.959')] [2022-07-12 21:31:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 39982080. Throughput: 0: 10267.2. Samples: 79972648. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:13,989][27935] Avg episode reward: [(0, '-63.031')] [2022-07-12 21:31:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 40007680. Throughput: 0: 10253.8. Samples: 80033552. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:18,989][27935] Avg episode reward: [(0, '-63.369')] [2022-07-12 21:31:23,992][27935] Fps is (10 sec: 5016.2, 60 sec: 5119.8, 300 sec: 5126.9). Total num frames: 40032256. Throughput: 0: 10249.8. Samples: 80064516. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:23,992][27935] Avg episode reward: [(0, '-63.545')] [2022-07-12 21:31:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 40058880. Throughput: 0: 10235.7. Samples: 80126368. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:28,989][27935] Avg episode reward: [(0, '-63.472')] [2022-07-12 21:31:33,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 40084480. Throughput: 0: 10232.0. Samples: 80187592. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:33,989][27935] Avg episode reward: [(0, '-63.191')] [2022-07-12 21:31:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 40110080. Throughput: 0: 10229.3. Samples: 80218872. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:38,989][27935] Avg episode reward: [(0, '-62.898')] [2022-07-12 21:31:43,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5137.0, 300 sec: 5133.9). Total num frames: 40136704. Throughput: 0: 10220.3. Samples: 80281316. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:43,989][27935] Avg episode reward: [(0, '-62.117')] [2022-07-12 21:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 40161280. Throughput: 0: 10307.1. Samples: 80343260. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:31:48,989][27935] Avg episode reward: [(0, '-61.801')] [2022-07-12 21:31:53,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5137.4, 300 sec: 5133.9). Total num frames: 40187904. Throughput: 0: 10313.8. Samples: 80374636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:31:53,989][27935] Avg episode reward: [(0, '-61.499')] [2022-07-12 21:31:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 40213504. Throughput: 0: 10310.8. Samples: 80436632. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:31:58,989][27935] Avg episode reward: [(0, '-61.587')] [2022-07-12 21:32:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 40238080. Throughput: 0: 10256.6. Samples: 80495096. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:03,989][27935] Avg episode reward: [(0, '-61.895')] [2022-07-12 21:32:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 40264704. Throughput: 0: 10256.7. Samples: 80526040. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:08,989][27935] Avg episode reward: [(0, '-61.968')] [2022-07-12 21:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 40290304. Throughput: 0: 10278.4. Samples: 80588896. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:13,989][27935] Avg episode reward: [(0, '-62.142')] [2022-07-12 21:32:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 40316928. Throughput: 0: 10287.6. Samples: 80650532. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:18,989][27935] Avg episode reward: [(0, '-62.560')] [2022-07-12 21:32:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.3, 300 sec: 5133.9). Total num frames: 40340480. Throughput: 0: 10289.4. Samples: 80681896. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:23,989][27935] Avg episode reward: [(0, '-63.029')] [2022-07-12 21:32:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 40368128. Throughput: 0: 10288.1. Samples: 80744276. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:28,989][27935] Avg episode reward: [(0, '-63.504')] [2022-07-12 21:32:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 40393728. Throughput: 0: 9607.5. Samples: 80775600. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:33,989][27935] Avg episode reward: [(0, '-62.923')] [2022-07-12 21:32:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 40419328. Throughput: 0: 10286.8. Samples: 80837540. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 21:32:38,989][27935] Avg episode reward: [(0, '-62.475')] [2022-07-12 21:32:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 40443904. Throughput: 0: 10254.7. Samples: 80898092. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:32:43,989][27935] Avg episode reward: [(0, '-62.956')] [2022-07-12 21:32:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 40470528. Throughput: 0: 9632.0. Samples: 80928536. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:32:48,989][27935] Avg episode reward: [(0, '-62.544')] [2022-07-12 21:32:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 40495104. Throughput: 0: 10309.2. Samples: 80989952. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:32:53,989][27935] Avg episode reward: [(0, '-61.366')] [2022-07-12 21:32:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 40520704. Throughput: 0: 10278.5. Samples: 81051428. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:32:58,989][27935] Avg episode reward: [(0, '-60.439')] [2022-07-12 21:33:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 40545280. Throughput: 0: 10183.6. Samples: 81108796. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:03,989][27935] Avg episode reward: [(0, '-60.752')] [2022-07-12 21:33:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5126.9). Total num frames: 40569856. Throughput: 0: 10174.4. Samples: 81139744. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:08,989][27935] Avg episode reward: [(0, '-60.575')] [2022-07-12 21:33:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 40596480. Throughput: 0: 10176.0. Samples: 81202196. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:13,989][27935] Avg episode reward: [(0, '-60.265')] [2022-07-12 21:33:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5126.9). Total num frames: 40622080. Throughput: 0: 10860.3. Samples: 81264316. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:18,989][27935] Avg episode reward: [(0, '-60.599')] [2022-07-12 21:33:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 40648704. Throughput: 0: 10181.0. Samples: 81295684. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:23,989][27935] Avg episode reward: [(0, '-59.822')] [2022-07-12 21:33:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 40673280. Throughput: 0: 10221.0. Samples: 81358036. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:28,989][27935] Avg episode reward: [(0, '-59.791')] [2022-07-12 21:33:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5127.1). Total num frames: 40699904. Throughput: 0: 10895.5. Samples: 81418836. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 21:33:33,989][27935] Avg episode reward: [(0, '-59.743')] [2022-07-12 21:33:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5126.9). Total num frames: 40725504. Throughput: 0: 10222.5. Samples: 81449964. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:33:38,989][27935] Avg episode reward: [(0, '-59.952')] [2022-07-12 21:33:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 40751104. Throughput: 0: 10241.3. Samples: 81512284. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:33:43,989][27935] Avg episode reward: [(0, '-60.202')] [2022-07-12 21:33:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 40777728. Throughput: 0: 10350.8. Samples: 81574584. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:33:48,989][27935] Avg episode reward: [(0, '-61.036')] [2022-07-12 21:33:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 40803328. Throughput: 0: 10351.8. Samples: 81605576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:33:53,989][27935] Avg episode reward: [(0, '-61.820')] [2022-07-12 21:33:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 40829952. Throughput: 0: 10349.1. Samples: 81667904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:33:58,989][27935] Avg episode reward: [(0, '-61.989')] [2022-07-12 21:34:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 40852480. Throughput: 0: 10255.7. Samples: 81725820. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:34:03,989][27935] Avg episode reward: [(0, '-61.627')] [2022-07-12 21:34:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 40879104. Throughput: 0: 10245.1. Samples: 81756712. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:34:08,989][27935] Avg episode reward: [(0, '-61.489')] [2022-07-12 21:34:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5130.5). Total num frames: 40905728. Throughput: 0: 10245.8. Samples: 81819096. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:34:13,989][27935] Avg episode reward: [(0, '-61.345')] [2022-07-12 21:34:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 40930304. Throughput: 0: 10269.3. Samples: 81880956. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:34:18,989][27935] Avg episode reward: [(0, '-61.120')] [2022-07-12 21:34:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5127.1). Total num frames: 40956928. Throughput: 0: 10266.5. Samples: 81911956. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:34:23,989][27935] Avg episode reward: [(0, '-60.362')] [2022-07-12 21:34:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 40982528. Throughput: 0: 10249.3. Samples: 81973504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:28,990][27935] Avg episode reward: [(0, '-60.608')] [2022-07-12 21:34:33,991][27935] Fps is (10 sec: 5119.1, 60 sec: 5136.9, 300 sec: 5130.4). Total num frames: 41008128. Throughput: 0: 10228.8. Samples: 82034896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:33,991][27935] Avg episode reward: [(0, '-60.822')] [2022-07-12 21:34:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 41032704. Throughput: 0: 10231.1. Samples: 82065976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:38,989][27935] Avg episode reward: [(0, '-60.617')] [2022-07-12 21:34:43,989][27935] Fps is (10 sec: 5018.5, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 41058304. Throughput: 0: 10207.4. Samples: 82127236. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:43,989][27935] Avg episode reward: [(0, '-60.759')] [2022-07-12 21:34:48,992][27935] Fps is (10 sec: 5221.0, 60 sec: 5119.8, 300 sec: 5133.8). Total num frames: 41084928. Throughput: 0: 10289.3. Samples: 82188868. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:48,992][27935] Avg episode reward: [(0, '-60.783')] [2022-07-12 21:34:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 41110528. Throughput: 0: 10289.4. Samples: 82219736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:53,999][27935] Avg episode reward: [(0, '-60.843')] [2022-07-12 21:34:58,989][27935] Fps is (10 sec: 5121.4, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 41136128. Throughput: 0: 10284.7. Samples: 82281908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:34:58,989][27935] Avg episode reward: [(0, '-60.780')] [2022-07-12 21:35:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 41159680. Throughput: 0: 10192.8. Samples: 82339632. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:35:03,991][27935] Avg episode reward: [(0, '-60.994')] [2022-07-12 21:35:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 41186304. Throughput: 0: 10187.1. Samples: 82370376. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:35:08,989][27935] Avg episode reward: [(0, '-61.105')] [2022-07-12 21:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5126.9). Total num frames: 41211904. Throughput: 0: 10200.0. Samples: 82432504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:35:13,989][27935] Avg episode reward: [(0, '-60.686')] [2022-07-12 21:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 41236480. Throughput: 0: 10197.3. Samples: 82493756. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:18,991][27935] Avg episode reward: [(0, '-61.086')] [2022-07-12 21:35:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5123.5). Total num frames: 41262080. Throughput: 0: 10192.4. Samples: 82524636. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:23,989][27935] Avg episode reward: [(0, '-61.204')] [2022-07-12 21:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5126.9). Total num frames: 41288704. Throughput: 0: 10206.0. Samples: 82586508. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:28,991][27935] Avg episode reward: [(0, '-61.050')] [2022-07-12 21:35:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5103.1, 300 sec: 5123.5). Total num frames: 41314304. Throughput: 0: 10190.8. Samples: 82647424. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:33,989][27935] Avg episode reward: [(0, '-61.483')] [2022-07-12 21:35:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41336832. Throughput: 0: 10154.6. Samples: 82676692. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:38,989][27935] Avg episode reward: [(0, '-61.272')] [2022-07-12 21:35:43,992][27935] Fps is (10 sec: 5016.2, 60 sec: 5102.7, 300 sec: 5120.0). Total num frames: 41364480. Throughput: 0: 10106.9. Samples: 82736748. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:43,993][27935] Avg episode reward: [(0, '-60.804')] [2022-07-12 21:35:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5069.0, 300 sec: 5116.6). Total num frames: 41389056. Throughput: 0: 10184.6. Samples: 82797940. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:48,989][27935] Avg episode reward: [(0, '-60.936')] [2022-07-12 21:35:53,989][27935] Fps is (10 sec: 5019.0, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41414656. Throughput: 0: 10185.4. Samples: 82828720. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:53,989][27935] Avg episode reward: [(0, '-60.685')] [2022-07-12 21:35:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5116.5). Total num frames: 41440256. Throughput: 0: 10183.5. Samples: 82890760. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:35:58,989][27935] Avg episode reward: [(0, '-60.587')] [2022-07-12 21:36:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 41464832. Throughput: 0: 10112.8. Samples: 82948832. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:36:03,989][27935] Avg episode reward: [(0, '-60.745')] [2022-07-12 21:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41490432. Throughput: 0: 10106.3. Samples: 82979420. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:08,989][27935] Avg episode reward: [(0, '-60.937')] [2022-07-12 21:36:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41516032. Throughput: 0: 10104.0. Samples: 83041188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:13,989][27935] Avg episode reward: [(0, '-61.614')] [2022-07-12 21:36:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41540608. Throughput: 0: 10100.6. Samples: 83101952. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:18,989][27935] Avg episode reward: [(0, '-61.444')] [2022-07-12 21:36:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 41568256. Throughput: 0: 10145.1. Samples: 83133224. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:23,989][27935] Avg episode reward: [(0, '-61.762')] [2022-07-12 21:36:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 41593856. Throughput: 0: 10197.6. Samples: 83195612. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:28,989][27935] Avg episode reward: [(0, '-61.756')] [2022-07-12 21:36:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 41618432. Throughput: 0: 10206.8. Samples: 83257248. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:33,989][27935] Avg episode reward: [(0, '-60.999')] [2022-07-12 21:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5116.5). Total num frames: 41646080. Throughput: 0: 10206.3. Samples: 83288004. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:38,989][27935] Avg episode reward: [(0, '-60.535')] [2022-07-12 21:36:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.2, 300 sec: 5120.0). Total num frames: 41671680. Throughput: 0: 10206.9. Samples: 83350072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:43,989][27935] Avg episode reward: [(0, '-60.878')] [2022-07-12 21:36:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 41696256. Throughput: 0: 10286.6. Samples: 83411728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:48,989][27935] Avg episode reward: [(0, '-60.404')] [2022-07-12 21:36:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 41720832. Throughput: 0: 10296.1. Samples: 83442744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:53,995][27935] Avg episode reward: [(0, '-60.610')] [2022-07-12 21:36:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 41748480. Throughput: 0: 10309.2. Samples: 83505100. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-12 21:36:58,989][27935] Avg episode reward: [(0, '-60.875')] [2022-07-12 21:37:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 41772032. Throughput: 0: 10240.4. Samples: 83562772. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:03,989][27935] Avg episode reward: [(0, '-61.231')] [2022-07-12 21:37:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 41796608. Throughput: 0: 10223.6. Samples: 83593284. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:08,990][27935] Avg episode reward: [(0, '-61.272')] [2022-07-12 21:37:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 41823232. Throughput: 0: 10212.2. Samples: 83655160. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:13,989][27935] Avg episode reward: [(0, '-61.368')] [2022-07-12 21:37:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 41847808. Throughput: 0: 10217.1. Samples: 83717016. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:18,989][27935] Avg episode reward: [(0, '-60.449')] [2022-07-12 21:37:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 41875456. Throughput: 0: 10221.3. Samples: 83747964. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:23,989][27935] Avg episode reward: [(0, '-60.619')] [2022-07-12 21:37:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 41900032. Throughput: 0: 10209.8. Samples: 83809512. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:28,989][27935] Avg episode reward: [(0, '-59.636')] [2022-07-12 21:37:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 41925632. Throughput: 0: 9532.9. Samples: 83840708. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:33,990][27935] Avg episode reward: [(0, '-59.200')] [2022-07-12 21:37:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 41952256. Throughput: 0: 10218.0. Samples: 83902556. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:38,990][27935] Avg episode reward: [(0, '-58.847')] [2022-07-12 21:37:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 41976832. Throughput: 0: 10187.2. Samples: 83963524. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:43,999][27935] Avg episode reward: [(0, '-59.008')] [2022-07-12 21:37:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 42002432. Throughput: 0: 10284.1. Samples: 84025556. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-12 21:37:48,989][27935] Avg episode reward: [(0, '-59.027')] [2022-07-12 21:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 42029056. Throughput: 0: 10299.6. Samples: 84056764. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:37:53,989][27935] Avg episode reward: [(0, '-58.938')] [2022-07-12 21:37:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 42054656. Throughput: 0: 10297.1. Samples: 84118528. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:37:58,989][27935] Avg episode reward: [(0, '-59.417')] [2022-07-12 21:38:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 42078208. Throughput: 0: 10198.2. Samples: 84175936. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:03,989][27935] Avg episode reward: [(0, '-59.653')] [2022-07-12 21:38:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 42103808. Throughput: 0: 10196.9. Samples: 84206824. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:08,989][27935] Avg episode reward: [(0, '-60.124')] [2022-07-12 21:38:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 42129408. Throughput: 0: 10196.9. Samples: 84268372. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:13,989][27935] Avg episode reward: [(0, '-60.456')] [2022-07-12 21:38:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 42155008. Throughput: 0: 10892.1. Samples: 84330852. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:18,989][27935] Avg episode reward: [(0, '-60.911')] [2022-07-12 21:38:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 42182656. Throughput: 0: 10201.1. Samples: 84361604. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:23,989][27935] Avg episode reward: [(0, '-61.508')] [2022-07-12 21:38:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 42206208. Throughput: 0: 10222.9. Samples: 84423556. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:28,989][27935] Avg episode reward: [(0, '-61.444')] [2022-07-12 21:38:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 42232832. Throughput: 0: 10218.5. Samples: 84485388. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:33,989][27935] Avg episode reward: [(0, '-61.247')] [2022-07-12 21:38:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 42258432. Throughput: 0: 10220.1. Samples: 84516668. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:38,989][27935] Avg episode reward: [(0, '-61.189')] [2022-07-12 21:38:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5109.6). Total num frames: 42285056. Throughput: 0: 10216.4. Samples: 84578264. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:43,989][27935] Avg episode reward: [(0, '-61.462')] [2022-07-12 21:38:48,990][27935] Fps is (10 sec: 5119.3, 60 sec: 5119.9, 300 sec: 5106.1). Total num frames: 42309632. Throughput: 0: 10320.1. Samples: 84640356. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:48,991][27935] Avg episode reward: [(0, '-61.114')] [2022-07-12 21:38:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5102.6). Total num frames: 42335232. Throughput: 0: 10306.8. Samples: 84670628. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:53,989][27935] Avg episode reward: [(0, '-60.611')] [2022-07-12 21:38:58,989][27935] Fps is (10 sec: 5325.5, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 42362880. Throughput: 0: 10324.4. Samples: 84732972. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:38:58,989][27935] Avg episode reward: [(0, '-60.450')] [2022-07-12 21:39:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5102.6). Total num frames: 42384384. Throughput: 0: 10227.9. Samples: 84791108. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:03,989][27935] Avg episode reward: [(0, '-60.707')] [2022-07-12 21:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5106.1). Total num frames: 42412032. Throughput: 0: 10229.1. Samples: 84821916. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:08,991][27935] Avg episode reward: [(0, '-60.902')] [2022-07-12 21:39:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5109.6). Total num frames: 42437632. Throughput: 0: 10231.4. Samples: 84883968. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:13,989][27935] Avg episode reward: [(0, '-60.198')] [2022-07-12 21:39:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5106.1). Total num frames: 42463232. Throughput: 0: 10235.3. Samples: 84945976. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:18,989][27935] Avg episode reward: [(0, '-60.209')] [2022-07-12 21:39:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 42488832. Throughput: 0: 10233.6. Samples: 84977180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:23,989][27935] Avg episode reward: [(0, '-60.099')] [2022-07-12 21:39:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5109.6). Total num frames: 42515456. Throughput: 0: 10250.1. Samples: 85039520. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:28,989][27935] Avg episode reward: [(0, '-59.876')] [2022-07-12 21:39:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 42541056. Throughput: 0: 10247.9. Samples: 85101496. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-12 21:39:33,989][27935] Avg episode reward: [(0, '-59.484')] [2022-07-12 21:39:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 42566656. Throughput: 0: 10272.4. Samples: 85132888. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:39:38,989][27935] Avg episode reward: [(0, '-59.445')] [2022-07-12 21:39:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 42593280. Throughput: 0: 10273.9. Samples: 85195296. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:39:43,989][27935] Avg episode reward: [(0, '-60.150')] [2022-07-12 21:39:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.3, 300 sec: 5113.1). Total num frames: 42618880. Throughput: 0: 10359.8. Samples: 85257300. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:39:48,989][27935] Avg episode reward: [(0, '-60.388')] [2022-07-12 21:39:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5116.5). Total num frames: 42645504. Throughput: 0: 10357.2. Samples: 85287992. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:39:53,989][27935] Avg episode reward: [(0, '-60.521')] [2022-07-12 21:39:59,004][27935] Fps is (10 sec: 5214.2, 60 sec: 5135.7, 300 sec: 5123.2). Total num frames: 42671104. Throughput: 0: 10367.2. Samples: 85350652. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:39:59,005][27935] Avg episode reward: [(0, '-60.804')] [2022-07-12 21:40:04,001][27935] Fps is (10 sec: 4909.4, 60 sec: 5170.2, 300 sec: 5112.9). Total num frames: 42694656. Throughput: 0: 10299.8. Samples: 85409588. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:04,001][27935] Avg episode reward: [(0, '-60.843')] [2022-07-12 21:40:08,989][27935] Fps is (10 sec: 5025.5, 60 sec: 5154.1, 300 sec: 5116.5). Total num frames: 42721280. Throughput: 0: 10304.8. Samples: 85440896. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:08,989][27935] Avg episode reward: [(0, '-60.822')] [2022-07-12 21:40:13,989][27935] Fps is (10 sec: 5228.5, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 42746880. Throughput: 0: 10308.8. Samples: 85503416. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:13,989][27935] Avg episode reward: [(0, '-59.628')] [2022-07-12 21:40:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5123.5). Total num frames: 42773504. Throughput: 0: 10308.9. Samples: 85565396. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:18,989][27935] Avg episode reward: [(0, '-60.003')] [2022-07-12 21:40:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5123.5). Total num frames: 42800128. Throughput: 0: 10309.4. Samples: 85596812. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:23,989][27935] Avg episode reward: [(0, '-59.678')] [2022-07-12 21:40:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 42824704. Throughput: 0: 10318.0. Samples: 85659604. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 21:40:28,989][27935] Avg episode reward: [(0, '-59.297')] [2022-07-12 21:40:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 42851328. Throughput: 0: 10325.0. Samples: 85721928. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:33,989][27935] Avg episode reward: [(0, '-59.356')] [2022-07-12 21:40:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5127.0). Total num frames: 42876928. Throughput: 0: 10337.0. Samples: 85753156. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:38,989][27935] Avg episode reward: [(0, '-59.155')] [2022-07-12 21:40:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 42903552. Throughput: 0: 10338.8. Samples: 85815736. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:43,989][27935] Avg episode reward: [(0, '-59.964')] [2022-07-12 21:40:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 42929152. Throughput: 0: 10403.2. Samples: 85877608. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:48,989][27935] Avg episode reward: [(0, '-60.230')] [2022-07-12 21:40:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 42954752. Throughput: 0: 10387.7. Samples: 85908344. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:53,990][27935] Avg episode reward: [(0, '-61.047')] [2022-07-12 21:40:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5172.6, 300 sec: 5140.8). Total num frames: 42981376. Throughput: 0: 10394.1. Samples: 85971152. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:40:58,989][27935] Avg episode reward: [(0, '-61.492')] [2022-07-12 21:41:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5172.2, 300 sec: 5133.9). Total num frames: 43004928. Throughput: 0: 10305.1. Samples: 86029124. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:41:03,989][27935] Avg episode reward: [(0, '-61.627')] [2022-07-12 21:41:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 43030528. Throughput: 0: 10295.8. Samples: 86060124. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:41:08,989][27935] Avg episode reward: [(0, '-61.895')] [2022-07-12 21:41:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 43055104. Throughput: 0: 10264.0. Samples: 86121484. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:41:13,989][27935] Avg episode reward: [(0, '-62.411')] [2022-07-12 21:41:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 43081728. Throughput: 0: 10234.6. Samples: 86182484. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:41:18,989][27935] Avg episode reward: [(0, '-62.119')] [2022-07-12 21:41:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 43108352. Throughput: 0: 10235.3. Samples: 86213744. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 21:41:23,989][27935] Avg episode reward: [(0, '-61.500')] [2022-07-12 21:41:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 43131904. Throughput: 0: 10212.0. Samples: 86275276. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:28,989][27935] Avg episode reward: [(0, '-61.540')] [2022-07-12 21:41:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 43156480. Throughput: 0: 10210.2. Samples: 86337068. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:33,989][27935] Avg episode reward: [(0, '-61.980')] [2022-07-12 21:41:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 43185152. Throughput: 0: 10228.7. Samples: 86368636. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:38,989][27935] Avg episode reward: [(0, '-61.901')] [2022-07-12 21:41:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 43209728. Throughput: 0: 10155.6. Samples: 86428152. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:43,989][27935] Avg episode reward: [(0, '-61.074')] [2022-07-12 21:41:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 43235328. Throughput: 0: 10245.8. Samples: 86490184. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:48,989][27935] Avg episode reward: [(0, '-62.108')] [2022-07-12 21:41:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 43261952. Throughput: 0: 10258.8. Samples: 86521768. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:53,989][27935] Avg episode reward: [(0, '-61.756')] [2022-07-12 21:41:58,992][27935] Fps is (10 sec: 5323.2, 60 sec: 5119.7, 300 sec: 5140.8). Total num frames: 43288576. Throughput: 0: 10293.2. Samples: 86584708. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:41:58,992][27935] Avg episode reward: [(0, '-61.887')] [2022-07-12 21:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 43313152. Throughput: 0: 10238.4. Samples: 86643212. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:42:03,989][27935] Avg episode reward: [(0, '-61.373')] [2022-07-12 21:42:08,989][27935] Fps is (10 sec: 4916.7, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 43337728. Throughput: 0: 10234.5. Samples: 86674296. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:42:08,989][27935] Avg episode reward: [(0, '-61.006')] [2022-07-12 21:42:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 43363328. Throughput: 0: 10272.3. Samples: 86737528. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:42:13,989][27935] Avg episode reward: [(0, '-61.274')] [2022-07-12 21:42:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 43389952. Throughput: 0: 10279.1. Samples: 86799628. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-12 21:42:18,989][27935] Avg episode reward: [(0, '-60.634')] [2022-07-12 21:42:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 43415552. Throughput: 0: 10280.2. Samples: 86831244. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:23,989][27935] Avg episode reward: [(0, '-60.868')] [2022-07-12 21:42:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5140.8). Total num frames: 43442176. Throughput: 0: 10346.5. Samples: 86893744. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:28,989][27935] Avg episode reward: [(0, '-61.259')] [2022-07-12 21:42:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 43467776. Throughput: 0: 10356.0. Samples: 86956204. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:33,989][27935] Avg episode reward: [(0, '-62.072')] [2022-07-12 21:42:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 43495424. Throughput: 0: 10357.7. Samples: 86987864. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:38,989][27935] Avg episode reward: [(0, '-61.734')] [2022-07-12 21:42:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 43520000. Throughput: 0: 10349.3. Samples: 87050396. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:43,989][27935] Avg episode reward: [(0, '-61.466')] [2022-07-12 21:42:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5147.8). Total num frames: 43547648. Throughput: 0: 10450.2. Samples: 87113468. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:48,991][27935] Avg episode reward: [(0, '-61.911')] [2022-07-12 21:42:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5147.8). Total num frames: 43573248. Throughput: 0: 10464.8. Samples: 87145212. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:53,989][27935] Avg episode reward: [(0, '-60.951')] [2022-07-12 21:42:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.6, 300 sec: 5161.7). Total num frames: 43600896. Throughput: 0: 10476.5. Samples: 87208968. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:42:58,989][27935] Avg episode reward: [(0, '-59.826')] [2022-07-12 21:43:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 43624448. Throughput: 0: 10399.7. Samples: 87267612. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:43:03,989][27935] Avg episode reward: [(0, '-59.688')] [2022-07-12 21:43:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5222.4, 300 sec: 5158.2). Total num frames: 43651072. Throughput: 0: 10402.3. Samples: 87299348. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-12 21:43:08,990][27935] Avg episode reward: [(0, '-59.625')] [2022-07-12 21:43:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5222.4, 300 sec: 5158.2). Total num frames: 43676672. Throughput: 0: 10413.8. Samples: 87362368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:13,989][27935] Avg episode reward: [(0, '-59.487')] [2022-07-12 21:43:18,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5222.4, 300 sec: 5154.7). Total num frames: 43703296. Throughput: 0: 10428.9. Samples: 87425504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:18,989][27935] Avg episode reward: [(0, '-59.497')] [2022-07-12 21:43:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5222.4, 300 sec: 5161.7). Total num frames: 43728896. Throughput: 0: 10436.2. Samples: 87457492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:23,989][27935] Avg episode reward: [(0, '-59.987')] [2022-07-12 21:43:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5165.1). Total num frames: 43756544. Throughput: 0: 10467.1. Samples: 87521416. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:28,989][27935] Avg episode reward: [(0, '-59.670')] [2022-07-12 21:43:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5165.1). Total num frames: 43782144. Throughput: 0: 10467.6. Samples: 87584512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:33,989][27935] Avg episode reward: [(0, '-59.903')] [2022-07-12 21:43:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5165.1). Total num frames: 43808768. Throughput: 0: 10473.1. Samples: 87616500. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:38,989][27935] Avg episode reward: [(0, '-59.634')] [2022-07-12 21:43:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5175.6). Total num frames: 43836416. Throughput: 0: 10472.0. Samples: 87680208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:43,989][27935] Avg episode reward: [(0, '-59.606')] [2022-07-12 21:43:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 43862016. Throughput: 0: 10569.8. Samples: 87743252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:48,989][27935] Avg episode reward: [(0, '-58.910')] [2022-07-12 21:43:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5168.6). Total num frames: 43887616. Throughput: 0: 10563.5. Samples: 87774704. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:53,989][27935] Avg episode reward: [(0, '-58.634')] [2022-07-12 21:43:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 43914240. Throughput: 0: 10584.4. Samples: 87838664. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:43:58,989][27935] Avg episode reward: [(0, '-59.257')] [2022-07-12 21:44:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5182.5). Total num frames: 43940864. Throughput: 0: 10516.5. Samples: 87898744. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 21:44:03,989][27935] Avg episode reward: [(0, '-59.028')] [2022-07-12 21:44:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.6, 300 sec: 5182.5). Total num frames: 43966464. Throughput: 0: 10507.2. Samples: 87930316. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:08,991][27935] Avg episode reward: [(0, '-58.790')] [2022-07-12 21:44:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5186.0). Total num frames: 43993088. Throughput: 0: 10506.0. Samples: 87994184. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:13,989][27935] Avg episode reward: [(0, '-59.674')] [2022-07-12 21:44:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5186.0). Total num frames: 44018688. Throughput: 0: 10513.4. Samples: 88057616. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:18,989][27935] Avg episode reward: [(0, '-59.526')] [2022-07-12 21:44:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5186.0). Total num frames: 44045312. Throughput: 0: 10510.6. Samples: 88089476. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:23,989][27935] Avg episode reward: [(0, '-60.200')] [2022-07-12 21:44:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5189.4). Total num frames: 44071936. Throughput: 0: 10492.7. Samples: 88152380. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:28,990][27935] Avg episode reward: [(0, '-59.591')] [2022-07-12 21:44:33,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5222.2, 300 sec: 5182.4). Total num frames: 44095488. Throughput: 0: 10457.3. Samples: 88213852. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:33,991][27935] Avg episode reward: [(0, '-60.020')] [2022-07-12 21:44:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5192.9). Total num frames: 44125184. Throughput: 0: 10452.1. Samples: 88245048. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:38,989][27935] Avg episode reward: [(0, '-60.354')] [2022-07-12 21:44:43,996][27935] Fps is (10 sec: 5321.9, 60 sec: 5204.7, 300 sec: 5185.8). Total num frames: 44148736. Throughput: 0: 10405.1. Samples: 88306972. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:43,997][27935] Avg episode reward: [(0, '-59.547')] [2022-07-12 21:44:48,990][27935] Fps is (10 sec: 5017.1, 60 sec: 5222.3, 300 sec: 5185.9). Total num frames: 44175360. Throughput: 0: 10458.5. Samples: 88369388. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:48,990][27935] Avg episode reward: [(0, '-59.676')] [2022-07-12 21:44:53,989][27935] Fps is (10 sec: 5226.2, 60 sec: 5222.4, 300 sec: 5186.2). Total num frames: 44200960. Throughput: 0: 10458.8. Samples: 88400960. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:53,989][27935] Avg episode reward: [(0, '-59.832')] [2022-07-12 21:44:58,989][27935] Fps is (10 sec: 5223.0, 60 sec: 5222.4, 300 sec: 5196.6). Total num frames: 44227584. Throughput: 0: 10443.0. Samples: 88464120. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 21:44:58,989][27935] Avg episode reward: [(0, '-60.431')] [2022-07-12 21:45:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 44252160. Throughput: 0: 10350.3. Samples: 88523380. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:03,989][27935] Avg episode reward: [(0, '-59.908')] [2022-07-12 21:45:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 44277760. Throughput: 0: 10341.1. Samples: 88554828. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:08,989][27935] Avg episode reward: [(0, '-60.387')] [2022-07-12 21:45:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 44305408. Throughput: 0: 10342.9. Samples: 88617812. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:13,989][27935] Avg episode reward: [(0, '-60.295')] [2022-07-12 21:45:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 44331008. Throughput: 0: 10368.3. Samples: 88680404. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:18,989][27935] Avg episode reward: [(0, '-60.814')] [2022-07-12 21:45:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 44358656. Throughput: 0: 10385.3. Samples: 88712388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:23,989][27935] Avg episode reward: [(0, '-60.648')] [2022-07-12 21:45:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 44381184. Throughput: 0: 10424.1. Samples: 88775980. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:28,989][27935] Avg episode reward: [(0, '-60.548')] [2022-07-12 21:45:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.6, 300 sec: 5196.4). Total num frames: 44409856. Throughput: 0: 10422.1. Samples: 88838372. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:33,989][27935] Avg episode reward: [(0, '-60.774')] [2022-07-12 21:45:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 44435456. Throughput: 0: 10415.1. Samples: 88869640. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:38,989][27935] Avg episode reward: [(0, '-60.675')] [2022-07-12 21:45:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5223.0, 300 sec: 5196.4). Total num frames: 44462080. Throughput: 0: 10419.8. Samples: 88933012. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:43,989][27935] Avg episode reward: [(0, '-60.503')] [2022-07-12 21:45:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.5, 300 sec: 5199.8). Total num frames: 44488704. Throughput: 0: 10492.9. Samples: 88995560. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:48,989][27935] Avg episode reward: [(0, '-59.674')] [2022-07-12 21:45:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 44514304. Throughput: 0: 10507.7. Samples: 89027676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:45:53,989][27935] Avg episode reward: [(0, '-59.674')] [2022-07-12 21:45:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 44541952. Throughput: 0: 10510.9. Samples: 89090800. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:45:58,989][27935] Avg episode reward: [(0, '-59.283')] [2022-07-12 21:46:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 44564480. Throughput: 0: 10436.2. Samples: 89150032. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:03,989][27935] Avg episode reward: [(0, '-59.008')] [2022-07-12 21:46:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 44592128. Throughput: 0: 10426.9. Samples: 89181600. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:08,989][27935] Avg episode reward: [(0, '-58.787')] [2022-07-12 21:46:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 44618752. Throughput: 0: 10414.8. Samples: 89244644. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:13,989][27935] Avg episode reward: [(0, '-59.118')] [2022-07-12 21:46:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 44642304. Throughput: 0: 10418.5. Samples: 89307204. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:18,989][27935] Avg episode reward: [(0, '-58.114')] [2022-07-12 21:46:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 44669952. Throughput: 0: 10419.9. Samples: 89338536. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:23,989][27935] Avg episode reward: [(0, '-58.520')] [2022-07-12 21:46:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 44696576. Throughput: 0: 10410.3. Samples: 89401476. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:28,989][27935] Avg episode reward: [(0, '-58.727')] [2022-07-12 21:46:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 44722176. Throughput: 0: 10395.3. Samples: 89463348. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:33,989][27935] Avg episode reward: [(0, '-58.185')] [2022-07-12 21:46:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 44747776. Throughput: 0: 10379.1. Samples: 89494736. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:38,989][27935] Avg episode reward: [(0, '-58.726')] [2022-07-12 21:46:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 44774400. Throughput: 0: 10375.7. Samples: 89557708. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:43,989][27935] Avg episode reward: [(0, '-58.898')] [2022-07-12 21:46:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 44801024. Throughput: 0: 10448.5. Samples: 89620216. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 21:46:48,989][27935] Avg episode reward: [(0, '-59.428')] [2022-07-12 21:46:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5213.8). Total num frames: 44826624. Throughput: 0: 10449.2. Samples: 89651816. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:46:53,989][27935] Avg episode reward: [(0, '-59.876')] [2022-07-12 21:46:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 44852224. Throughput: 0: 10438.2. Samples: 89714364. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:46:58,989][27935] Avg episode reward: [(0, '-59.969')] [2022-07-12 21:47:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 44875776. Throughput: 0: 10350.8. Samples: 89772988. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:03,989][27935] Avg episode reward: [(0, '-60.256')] [2022-07-12 21:47:08,989][27935] Fps is (10 sec: 5222.1, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 44904448. Throughput: 0: 10349.3. Samples: 89804260. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:08,990][27935] Avg episode reward: [(0, '-59.898')] [2022-07-12 21:47:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5154.1, 300 sec: 5213.7). Total num frames: 44928000. Throughput: 0: 10340.2. Samples: 89866788. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:13,989][27935] Avg episode reward: [(0, '-59.144')] [2022-07-12 21:47:18,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 44955648. Throughput: 0: 10354.9. Samples: 89929320. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:18,989][27935] Avg episode reward: [(0, '-59.197')] [2022-07-12 21:47:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 44980224. Throughput: 0: 10354.8. Samples: 89960704. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:23,989][27935] Avg episode reward: [(0, '-58.570')] [2022-07-12 21:47:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 45007872. Throughput: 0: 10340.4. Samples: 90023024. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:28,989][27935] Avg episode reward: [(0, '-59.021')] [2022-07-12 21:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 45032448. Throughput: 0: 10346.0. Samples: 90085784. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:33,989][27935] Avg episode reward: [(0, '-58.876')] [2022-07-12 21:47:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 45060096. Throughput: 0: 10344.5. Samples: 90117320. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:38,989][27935] Avg episode reward: [(0, '-58.412')] [2022-07-12 21:47:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5206.8). Total num frames: 45083648. Throughput: 0: 10313.2. Samples: 90178460. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:47:43,989][27935] Avg episode reward: [(0, '-58.586')] [2022-07-12 21:47:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5210.2). Total num frames: 45110272. Throughput: 0: 10349.3. Samples: 90238708. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:47:48,989][27935] Avg episode reward: [(0, '-57.621')] [2022-07-12 21:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 45135872. Throughput: 0: 10346.9. Samples: 90269864. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:47:53,991][27935] Avg episode reward: [(0, '-57.398')] [2022-07-12 21:47:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5210.2). Total num frames: 45161472. Throughput: 0: 10366.2. Samples: 90333268. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:47:58,989][27935] Avg episode reward: [(0, '-56.887')] [2022-07-12 21:48:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 45186048. Throughput: 0: 10278.8. Samples: 90391864. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:03,989][27935] Avg episode reward: [(0, '-56.308')] [2022-07-12 21:48:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.2, 300 sec: 5210.3). Total num frames: 45213696. Throughput: 0: 10286.2. Samples: 90423584. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:08,989][27935] Avg episode reward: [(0, '-56.886')] [2022-07-12 21:48:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 45238272. Throughput: 0: 10289.0. Samples: 90486028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:13,989][27935] Avg episode reward: [(0, '-56.971')] [2022-07-12 21:48:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5206.8). Total num frames: 45264896. Throughput: 0: 10285.5. Samples: 90548632. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:18,989][27935] Avg episode reward: [(0, '-57.371')] [2022-07-12 21:48:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 45290496. Throughput: 0: 10276.6. Samples: 90579768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:23,989][27935] Avg episode reward: [(0, '-57.839')] [2022-07-12 21:48:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5199.8). Total num frames: 45316096. Throughput: 0: 10297.3. Samples: 90641836. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:28,989][27935] Avg episode reward: [(0, '-57.536')] [2022-07-12 21:48:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 45341696. Throughput: 0: 10349.0. Samples: 90704412. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:33,989][27935] Avg episode reward: [(0, '-57.391')] [2022-07-12 21:48:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 45368320. Throughput: 0: 10359.1. Samples: 90736024. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:38,989][27935] Avg episode reward: [(0, '-57.432')] [2022-07-12 21:48:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 45394944. Throughput: 0: 10346.2. Samples: 90798848. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 21:48:43,989][27935] Avg episode reward: [(0, '-57.687')] [2022-07-12 21:48:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 45420544. Throughput: 0: 10428.9. Samples: 90861164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:48:48,989][27935] Avg episode reward: [(0, '-58.717')] [2022-07-12 21:48:53,996][27935] Fps is (10 sec: 5218.5, 60 sec: 5187.6, 300 sec: 5196.2). Total num frames: 45447168. Throughput: 0: 10418.3. Samples: 90892488. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:48:53,997][27935] Avg episode reward: [(0, '-59.370')] [2022-07-12 21:48:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 45472768. Throughput: 0: 10422.1. Samples: 90955024. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:48:58,989][27935] Avg episode reward: [(0, '-59.995')] [2022-07-12 21:49:03,989][27935] Fps is (10 sec: 5021.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 45497344. Throughput: 0: 10336.4. Samples: 91013768. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:03,989][27935] Avg episode reward: [(0, '-59.578')] [2022-07-12 21:49:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 45523968. Throughput: 0: 10347.2. Samples: 91045392. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:08,989][27935] Avg episode reward: [(0, '-59.666')] [2022-07-12 21:49:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 45549568. Throughput: 0: 10366.6. Samples: 91108332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:13,989][27935] Avg episode reward: [(0, '-59.162')] [2022-07-12 21:49:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 45576192. Throughput: 0: 10360.0. Samples: 91170612. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:18,989][27935] Avg episode reward: [(0, '-57.963')] [2022-07-12 21:49:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 45600768. Throughput: 0: 10360.9. Samples: 91202264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:23,989][27935] Avg episode reward: [(0, '-57.916')] [2022-07-12 21:49:28,990][27935] Fps is (10 sec: 5119.2, 60 sec: 5188.1, 300 sec: 5192.9). Total num frames: 45627392. Throughput: 0: 10357.0. Samples: 91264928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:28,991][27935] Avg episode reward: [(0, '-57.091')] [2022-07-12 21:49:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 45652992. Throughput: 0: 10357.7. Samples: 91327260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:33,989][27935] Avg episode reward: [(0, '-57.854')] [2022-07-12 21:49:38,989][27935] Fps is (10 sec: 5223.3, 60 sec: 5188.3, 300 sec: 5189.6). Total num frames: 45679616. Throughput: 0: 10360.5. Samples: 91358632. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-12 21:49:38,989][27935] Avg episode reward: [(0, '-58.268')] [2022-07-12 21:49:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 45707264. Throughput: 0: 10370.0. Samples: 91421672. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:49:43,989][27935] Avg episode reward: [(0, '-58.227')] [2022-07-12 21:49:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 45730816. Throughput: 0: 10468.4. Samples: 91484848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:49:48,989][27935] Avg episode reward: [(0, '-58.625')] [2022-07-12 21:49:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.9, 300 sec: 5189.4). Total num frames: 45758464. Throughput: 0: 10467.3. Samples: 91516420. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:49:53,990][27935] Avg episode reward: [(0, '-58.296')] [2022-07-12 21:49:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 45786112. Throughput: 0: 10471.8. Samples: 91579564. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:49:58,989][27935] Avg episode reward: [(0, '-58.610')] [2022-07-12 21:50:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 45809664. Throughput: 0: 10404.8. Samples: 91638828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:03,989][27935] Avg episode reward: [(0, '-57.642')] [2022-07-12 21:50:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 45834240. Throughput: 0: 10384.5. Samples: 91669568. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:08,989][27935] Avg episode reward: [(0, '-57.702')] [2022-07-12 21:50:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 45861888. Throughput: 0: 10386.0. Samples: 91732280. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:13,990][27935] Avg episode reward: [(0, '-57.868')] [2022-07-12 21:50:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 45888512. Throughput: 0: 10386.3. Samples: 91794644. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:18,989][27935] Avg episode reward: [(0, '-58.352')] [2022-07-12 21:50:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 45914112. Throughput: 0: 10399.2. Samples: 91826596. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:23,989][27935] Avg episode reward: [(0, '-58.446')] [2022-07-12 21:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.5, 300 sec: 5189.4). Total num frames: 45940736. Throughput: 0: 10393.6. Samples: 91889384. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:28,989][27935] Avg episode reward: [(0, '-57.743')] [2022-07-12 21:50:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 45967360. Throughput: 0: 10370.2. Samples: 91951508. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 21:50:33,990][27935] Avg episode reward: [(0, '-58.320')] [2022-07-12 21:50:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 45992960. Throughput: 0: 10369.9. Samples: 91983064. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:50:38,991][27935] Avg episode reward: [(0, '-58.577')] [2022-07-12 21:50:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 46019584. Throughput: 0: 10374.8. Samples: 92046432. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:50:43,989][27935] Avg episode reward: [(0, '-59.354')] [2022-07-12 21:50:48,990][27935] Fps is (10 sec: 5119.2, 60 sec: 5222.3, 300 sec: 5185.9). Total num frames: 46044160. Throughput: 0: 10453.5. Samples: 92109252. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:50:48,991][27935] Avg episode reward: [(0, '-59.414')] [2022-07-12 21:50:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 46072832. Throughput: 0: 10474.9. Samples: 92140940. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:50:53,989][27935] Avg episode reward: [(0, '-59.102')] [2022-07-12 21:50:58,989][27935] Fps is (10 sec: 5223.2, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 46096384. Throughput: 0: 10480.1. Samples: 92203884. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:50:58,989][27935] Avg episode reward: [(0, '-59.627')] [2022-07-12 21:51:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 46121984. Throughput: 0: 10387.0. Samples: 92262060. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:03,989][27935] Avg episode reward: [(0, '-60.132')] [2022-07-12 21:51:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 46147584. Throughput: 0: 10374.8. Samples: 92293460. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:08,989][27935] Avg episode reward: [(0, '-60.557')] [2022-07-12 21:51:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 46175232. Throughput: 0: 10383.9. Samples: 92356660. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:13,989][27935] Avg episode reward: [(0, '-60.160')] [2022-07-12 21:51:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 46198784. Throughput: 0: 10378.7. Samples: 92418548. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:18,989][27935] Avg episode reward: [(0, '-60.678')] [2022-07-12 21:51:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 46226432. Throughput: 0: 10383.2. Samples: 92450308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:23,989][27935] Avg episode reward: [(0, '-59.680')] [2022-07-12 21:51:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 46252032. Throughput: 0: 10367.7. Samples: 92512980. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:28,989][27935] Avg episode reward: [(0, '-59.782')] [2022-07-12 21:51:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 46276608. Throughput: 0: 10339.0. Samples: 92574492. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 21:51:33,989][27935] Avg episode reward: [(0, '-59.430')] [2022-07-12 21:51:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 46304256. Throughput: 0: 10326.1. Samples: 92605616. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:51:38,989][27935] Avg episode reward: [(0, '-58.355')] [2022-07-12 21:51:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 46328832. Throughput: 0: 10325.9. Samples: 92668548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:51:43,991][27935] Avg episode reward: [(0, '-58.666')] [2022-07-12 21:51:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.4, 300 sec: 5182.5). Total num frames: 46355456. Throughput: 0: 10425.2. Samples: 92731192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:51:48,989][27935] Avg episode reward: [(0, '-58.263')] [2022-07-12 21:51:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 46382080. Throughput: 0: 10427.5. Samples: 92762696. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:51:53,989][27935] Avg episode reward: [(0, '-58.390')] [2022-07-12 21:51:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 46407680. Throughput: 0: 10409.9. Samples: 92825104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:51:58,989][27935] Avg episode reward: [(0, '-58.410')] [2022-07-12 21:52:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 46432256. Throughput: 0: 10338.0. Samples: 92883760. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:03,989][27935] Avg episode reward: [(0, '-58.807')] [2022-07-12 21:52:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 46457856. Throughput: 0: 10326.5. Samples: 92915000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:08,992][27935] Avg episode reward: [(0, '-59.481')] [2022-07-12 21:52:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 46484480. Throughput: 0: 10326.2. Samples: 92977660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:13,989][27935] Avg episode reward: [(0, '-60.322')] [2022-07-12 21:52:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 46511104. Throughput: 0: 10346.8. Samples: 93040100. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:18,989][27935] Avg episode reward: [(0, '-59.502')] [2022-07-12 21:52:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 46536704. Throughput: 0: 10355.9. Samples: 93071632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:23,989][27935] Avg episode reward: [(0, '-59.823')] [2022-07-12 21:52:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 46562304. Throughput: 0: 10362.1. Samples: 93134844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 21:52:28,989][27935] Avg episode reward: [(0, '-59.055')] [2022-07-12 21:52:33,992][27935] Fps is (10 sec: 5220.7, 60 sec: 5205.0, 300 sec: 5182.4). Total num frames: 46588928. Throughput: 0: 10352.2. Samples: 93197076. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:33,993][27935] Avg episode reward: [(0, '-58.986')] [2022-07-12 21:52:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 46613504. Throughput: 0: 10355.1. Samples: 93228676. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:38,989][27935] Avg episode reward: [(0, '-58.753')] [2022-07-12 21:52:43,989][27935] Fps is (10 sec: 5019.2, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 46639104. Throughput: 0: 10348.3. Samples: 93290776. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:43,990][27935] Avg episode reward: [(0, '-58.167')] [2022-07-12 21:52:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 46667776. Throughput: 0: 10439.6. Samples: 93353540. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:48,991][27935] Avg episode reward: [(0, '-57.997')] [2022-07-12 21:52:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 46694400. Throughput: 0: 10460.2. Samples: 93385708. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:53,990][27935] Avg episode reward: [(0, '-57.857')] [2022-07-12 21:52:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 46720000. Throughput: 0: 10473.8. Samples: 93448980. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:52:58,989][27935] Avg episode reward: [(0, '-57.898')] [2022-07-12 21:53:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 46743552. Throughput: 0: 10408.5. Samples: 93508480. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:03,990][27935] Avg episode reward: [(0, '-57.632')] [2022-07-12 21:53:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 46771200. Throughput: 0: 10410.6. Samples: 93540108. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:08,990][27935] Avg episode reward: [(0, '-56.999')] [2022-07-12 21:53:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 46796800. Throughput: 0: 10407.7. Samples: 93603192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:13,989][27935] Avg episode reward: [(0, '-56.693')] [2022-07-12 21:53:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 46823424. Throughput: 0: 10436.8. Samples: 93666700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:18,989][27935] Avg episode reward: [(0, '-57.383')] [2022-07-12 21:53:23,992][27935] Fps is (10 sec: 5425.3, 60 sec: 5239.2, 300 sec: 5203.2). Total num frames: 46851072. Throughput: 0: 10435.8. Samples: 93698324. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:23,994][27935] Avg episode reward: [(0, '-57.612')] [2022-07-12 21:53:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 46875648. Throughput: 0: 10477.8. Samples: 93762276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 21:53:28,989][27935] Avg episode reward: [(0, '-57.890')] [2022-07-12 21:53:33,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5222.7, 300 sec: 5199.8). Total num frames: 46902272. Throughput: 0: 10485.2. Samples: 93825376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:33,989][27935] Avg episode reward: [(0, '-58.515')] [2022-07-12 21:53:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5203.3). Total num frames: 46929920. Throughput: 0: 10482.1. Samples: 93857404. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:38,990][27935] Avg episode reward: [(0, '-59.035')] [2022-07-12 21:53:43,996][27935] Fps is (10 sec: 5218.8, 60 sec: 5255.9, 300 sec: 5199.7). Total num frames: 46954496. Throughput: 0: 10492.1. Samples: 93921196. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:43,996][27935] Avg episode reward: [(0, '-60.089')] [2022-07-12 21:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5203.4). Total num frames: 46982144. Throughput: 0: 10546.7. Samples: 93983080. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:48,989][27935] Avg episode reward: [(0, '-59.728')] [2022-07-12 21:53:53,989][27935] Fps is (10 sec: 5226.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 47006720. Throughput: 0: 10520.4. Samples: 94013528. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:53,989][27935] Avg episode reward: [(0, '-59.950')] [2022-07-12 21:53:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 47034368. Throughput: 0: 10517.3. Samples: 94076468. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:53:58,989][27935] Avg episode reward: [(0, '-59.811')] [2022-07-12 21:54:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 47056896. Throughput: 0: 10412.6. Samples: 94135264. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:54:03,989][27935] Avg episode reward: [(0, '-59.933')] [2022-07-12 21:54:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 47084544. Throughput: 0: 10409.2. Samples: 94166700. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:54:08,989][27935] Avg episode reward: [(0, '-59.959')] [2022-07-12 21:54:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 47111168. Throughput: 0: 10393.5. Samples: 94229984. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:54:13,989][27935] Avg episode reward: [(0, '-60.227')] [2022-07-12 21:54:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 47136768. Throughput: 0: 10382.9. Samples: 94292608. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:54:18,989][27935] Avg episode reward: [(0, '-59.820')] [2022-07-12 21:54:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.5, 300 sec: 5199.9). Total num frames: 47161344. Throughput: 0: 10375.1. Samples: 94324284. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 21:54:23,989][27935] Avg episode reward: [(0, '-60.346')] [2022-07-12 21:54:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 47188992. Throughput: 0: 10365.7. Samples: 94387580. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:28,989][27935] Avg episode reward: [(0, '-60.423')] [2022-07-12 21:54:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 47215616. Throughput: 0: 10380.0. Samples: 94450180. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:33,989][27935] Avg episode reward: [(0, '-60.323')] [2022-07-12 21:54:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 47241216. Throughput: 0: 10393.9. Samples: 94481252. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:38,989][27935] Avg episode reward: [(0, '-59.333')] [2022-07-12 21:54:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.9, 300 sec: 5206.8). Total num frames: 47266816. Throughput: 0: 10386.6. Samples: 94543864. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:43,989][27935] Avg episode reward: [(0, '-59.198')] [2022-07-12 21:54:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 47293440. Throughput: 0: 10491.0. Samples: 94607360. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:48,989][27935] Avg episode reward: [(0, '-58.741')] [2022-07-12 21:54:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 47321088. Throughput: 0: 10482.5. Samples: 94638412. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:53,989][27935] Avg episode reward: [(0, '-58.247')] [2022-07-12 21:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 47345664. Throughput: 0: 10476.1. Samples: 94701408. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:54:58,989][27935] Avg episode reward: [(0, '-58.355')] [2022-07-12 21:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 47371264. Throughput: 0: 10395.7. Samples: 94760416. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:55:03,989][27935] Avg episode reward: [(0, '-58.045')] [2022-07-12 21:55:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 47396864. Throughput: 0: 10393.3. Samples: 94791984. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:55:08,989][27935] Avg episode reward: [(0, '-58.329')] [2022-07-12 21:55:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 47422464. Throughput: 0: 10383.7. Samples: 94854848. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:55:13,989][27935] Avg episode reward: [(0, '-58.987')] [2022-07-12 21:55:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 47449088. Throughput: 0: 10389.2. Samples: 94917692. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:55:18,989][27935] Avg episode reward: [(0, '-59.370')] [2022-07-12 21:55:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 47475712. Throughput: 0: 10402.2. Samples: 94949352. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-12 21:55:23,989][27935] Avg episode reward: [(0, '-59.034')] [2022-07-12 21:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 47501312. Throughput: 0: 10423.1. Samples: 95012904. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:28,989][27935] Avg episode reward: [(0, '-59.056')] [2022-07-12 21:55:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 47527936. Throughput: 0: 10402.0. Samples: 95075452. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:33,989][27935] Avg episode reward: [(0, '-59.305')] [2022-07-12 21:55:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 47554560. Throughput: 0: 10411.7. Samples: 95106940. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:38,989][27935] Avg episode reward: [(0, '-59.608')] [2022-07-12 21:55:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 47580160. Throughput: 0: 10410.0. Samples: 95169856. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:43,989][27935] Avg episode reward: [(0, '-59.465')] [2022-07-12 21:55:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 47606784. Throughput: 0: 10485.1. Samples: 95232244. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:48,989][27935] Avg episode reward: [(0, '-59.160')] [2022-07-12 21:55:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 47632384. Throughput: 0: 10482.7. Samples: 95263704. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:53,989][27935] Avg episode reward: [(0, '-59.415')] [2022-07-12 21:55:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 47660032. Throughput: 0: 10481.6. Samples: 95326520. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:55:58,989][27935] Avg episode reward: [(0, '-59.218')] [2022-07-12 21:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 47682560. Throughput: 0: 10392.9. Samples: 95385372. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:56:03,989][27935] Avg episode reward: [(0, '-59.474')] [2022-07-12 21:56:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 47709184. Throughput: 0: 10392.5. Samples: 95417012. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:56:08,989][27935] Avg episode reward: [(0, '-59.055')] [2022-07-12 21:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 47734784. Throughput: 0: 10383.9. Samples: 95480180. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:56:13,989][27935] Avg episode reward: [(0, '-58.746')] [2022-07-12 21:56:18,991][27935] Fps is (10 sec: 5323.4, 60 sec: 5222.2, 300 sec: 5206.7). Total num frames: 47762432. Throughput: 0: 10380.9. Samples: 95542620. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:56:18,992][27935] Avg episode reward: [(0, '-58.874')] [2022-07-12 21:56:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 47788032. Throughput: 0: 10386.4. Samples: 95574328. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-12 21:56:23,989][27935] Avg episode reward: [(0, '-58.841')] [2022-07-12 21:56:28,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 47814656. Throughput: 0: 10402.5. Samples: 95637968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:28,990][27935] Avg episode reward: [(0, '-58.774')] [2022-07-12 21:56:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 47840256. Throughput: 0: 10413.6. Samples: 95700856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:33,989][27935] Avg episode reward: [(0, '-59.275')] [2022-07-12 21:56:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 47866880. Throughput: 0: 10425.5. Samples: 95732852. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:38,989][27935] Avg episode reward: [(0, '-58.767')] [2022-07-12 21:56:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 47894528. Throughput: 0: 10445.1. Samples: 95796548. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:43,989][27935] Avg episode reward: [(0, '-59.318')] [2022-07-12 21:56:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 47920128. Throughput: 0: 10560.6. Samples: 95860600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:48,989][27935] Avg episode reward: [(0, '-59.729')] [2022-07-12 21:56:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 47947776. Throughput: 0: 10553.6. Samples: 95891924. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:53,989][27935] Avg episode reward: [(0, '-59.464')] [2022-07-12 21:56:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 47973376. Throughput: 0: 10571.7. Samples: 95955908. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:56:58,989][27935] Avg episode reward: [(0, '-59.298')] [2022-07-12 21:57:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 47997952. Throughput: 0: 10494.5. Samples: 96014844. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:57:03,989][27935] Avg episode reward: [(0, '-58.807')] [2022-07-12 21:57:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 48024576. Throughput: 0: 10496.6. Samples: 96046676. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:57:08,989][27935] Avg episode reward: [(0, '-59.099')] [2022-07-12 21:57:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 48050176. Throughput: 0: 10498.8. Samples: 96110416. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:57:13,989][27935] Avg episode reward: [(0, '-59.254')] [2022-07-12 21:57:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.8, 300 sec: 5224.1). Total num frames: 48077824. Throughput: 0: 10517.7. Samples: 96174152. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:57:18,989][27935] Avg episode reward: [(0, '-59.297')] [2022-07-12 21:57:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 48103424. Throughput: 0: 10515.2. Samples: 96206036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 21:57:23,989][27935] Avg episode reward: [(0, '-60.336')] [2022-07-12 21:57:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.2). Total num frames: 48130048. Throughput: 0: 10523.6. Samples: 96270112. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:28,989][27935] Avg episode reward: [(0, '-60.431')] [2022-07-12 21:57:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5234.5). Total num frames: 48157696. Throughput: 0: 10493.8. Samples: 96332820. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:33,989][27935] Avg episode reward: [(0, '-60.297')] [2022-07-12 21:57:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 48183296. Throughput: 0: 10507.3. Samples: 96364752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:38,989][27935] Avg episode reward: [(0, '-60.410')] [2022-07-12 21:57:43,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 48209920. Throughput: 0: 10473.9. Samples: 96427236. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:43,990][27935] Avg episode reward: [(0, '-60.368')] [2022-07-12 21:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 48235520. Throughput: 0: 10595.5. Samples: 96491640. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:48,989][27935] Avg episode reward: [(0, '-59.721')] [2022-07-12 21:57:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 48262144. Throughput: 0: 10599.6. Samples: 96523656. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:53,989][27935] Avg episode reward: [(0, '-59.693')] [2022-07-12 21:57:58,992][27935] Fps is (10 sec: 5527.8, 60 sec: 5290.4, 300 sec: 5244.9). Total num frames: 48290816. Throughput: 0: 10622.1. Samples: 96588444. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:57:58,992][27935] Avg episode reward: [(0, '-59.989')] [2022-07-12 21:58:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5234.5). Total num frames: 48315392. Throughput: 0: 10543.4. Samples: 96648604. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:58:03,989][27935] Avg episode reward: [(0, '-60.382')] [2022-07-12 21:58:08,989][27935] Fps is (10 sec: 5121.6, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 48342016. Throughput: 0: 10546.1. Samples: 96680612. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:58:08,990][27935] Avg episode reward: [(0, '-60.145')] [2022-07-12 21:58:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5234.6). Total num frames: 48367616. Throughput: 0: 10548.4. Samples: 96744792. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:58:13,989][27935] Avg episode reward: [(0, '-60.121')] [2022-07-12 21:58:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5238.1). Total num frames: 48396288. Throughput: 0: 10587.2. Samples: 96809244. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:58:18,989][27935] Avg episode reward: [(0, '-59.864')] [2022-07-12 21:58:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5241.5). Total num frames: 48421888. Throughput: 0: 10586.5. Samples: 96841144. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-12 21:58:23,989][27935] Avg episode reward: [(0, '-59.976')] [2022-07-12 21:58:28,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5307.7, 300 sec: 5241.5). Total num frames: 48448512. Throughput: 0: 10625.1. Samples: 96905364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:28,989][27935] Avg episode reward: [(0, '-59.487')] [2022-07-12 21:58:33,996][27935] Fps is (10 sec: 5218.4, 60 sec: 5272.9, 300 sec: 5234.4). Total num frames: 48474112. Throughput: 0: 10592.0. Samples: 96968360. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:33,997][27935] Avg episode reward: [(0, '-59.069')] [2022-07-12 21:58:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5241.6). Total num frames: 48500736. Throughput: 0: 10572.0. Samples: 96999396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:38,989][27935] Avg episode reward: [(0, '-58.494')] [2022-07-12 21:58:43,989][27935] Fps is (10 sec: 5226.4, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 48526336. Throughput: 0: 10541.0. Samples: 97062756. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:43,989][27935] Avg episode reward: [(0, '-58.524')] [2022-07-12 21:58:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5245.0). Total num frames: 48553984. Throughput: 0: 10620.9. Samples: 97126544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:48,989][27935] Avg episode reward: [(0, '-58.630')] [2022-07-12 21:58:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5241.5). Total num frames: 48580608. Throughput: 0: 10616.9. Samples: 97158372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:53,989][27935] Avg episode reward: [(0, '-57.940')] [2022-07-12 21:58:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.8, 300 sec: 5251.9). Total num frames: 48606208. Throughput: 0: 10619.0. Samples: 97222648. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:58:58,989][27935] Avg episode reward: [(0, '-57.868')] [2022-07-12 21:59:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 48631808. Throughput: 0: 10519.4. Samples: 97282616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:59:03,989][27935] Avg episode reward: [(0, '-57.926')] [2022-07-12 21:59:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 48656384. Throughput: 0: 10513.9. Samples: 97314268. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:59:08,989][27935] Avg episode reward: [(0, '-58.154')] [2022-07-12 21:59:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5248.4). Total num frames: 48685056. Throughput: 0: 10515.9. Samples: 97378580. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:59:13,989][27935] Avg episode reward: [(0, '-58.068')] [2022-07-12 21:59:18,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 48711680. Throughput: 0: 10526.7. Samples: 97441980. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:59:18,989][27935] Avg episode reward: [(0, '-58.830')] [2022-07-12 21:59:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 48737280. Throughput: 0: 10545.6. Samples: 97473948. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-12 21:59:23,989][27935] Avg episode reward: [(0, '-58.526')] [2022-07-12 21:59:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 48764928. Throughput: 0: 10559.1. Samples: 97537916. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:28,989][27935] Avg episode reward: [(0, '-58.506')] [2022-07-12 21:59:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5274.3, 300 sec: 5251.9). Total num frames: 48790528. Throughput: 0: 10540.8. Samples: 97600880. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:33,989][27935] Avg episode reward: [(0, '-58.833')] [2022-07-12 21:59:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 48817152. Throughput: 0: 10541.9. Samples: 97632760. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:38,989][27935] Avg episode reward: [(0, '-58.737')] [2022-07-12 21:59:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5258.8). Total num frames: 48844800. Throughput: 0: 10526.5. Samples: 97696340. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:43,989][27935] Avg episode reward: [(0, '-58.192')] [2022-07-12 21:59:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 48869376. Throughput: 0: 10611.4. Samples: 97760128. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:48,989][27935] Avg episode reward: [(0, '-58.191')] [2022-07-12 21:59:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 48897024. Throughput: 0: 10593.5. Samples: 97790976. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:53,989][27935] Avg episode reward: [(0, '-57.804')] [2022-07-12 21:59:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 48921600. Throughput: 0: 10525.1. Samples: 97852208. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 21:59:58,989][27935] Avg episode reward: [(0, '-58.103')] [2022-07-12 22:00:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 48946176. Throughput: 0: 10424.8. Samples: 97911096. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 22:00:03,989][27935] Avg episode reward: [(0, '-57.290')] [2022-07-12 22:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 48971776. Throughput: 0: 10410.9. Samples: 97942440. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 22:00:08,989][27935] Avg episode reward: [(0, '-57.708')] [2022-07-12 22:00:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 48999424. Throughput: 0: 10399.5. Samples: 98005896. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 22:00:13,989][27935] Avg episode reward: [(0, '-58.301')] [2022-07-12 22:00:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 49025024. Throughput: 0: 10414.1. Samples: 98069516. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 22:00:18,989][27935] Avg episode reward: [(0, '-58.101')] [2022-07-12 22:00:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 49050624. Throughput: 0: 10407.4. Samples: 98101092. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 22:00:23,989][27935] Avg episode reward: [(0, '-59.006')] [2022-07-12 22:00:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 49078272. Throughput: 0: 10403.6. Samples: 98164500. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:28,989][27935] Avg episode reward: [(0, '-58.770')] [2022-07-12 22:00:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 49103872. Throughput: 0: 10376.4. Samples: 98227064. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:33,989][27935] Avg episode reward: [(0, '-59.240')] [2022-07-12 22:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5248.4). Total num frames: 49128448. Throughput: 0: 10384.4. Samples: 98258272. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:38,990][27935] Avg episode reward: [(0, '-58.954')] [2022-07-12 22:00:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5251.9). Total num frames: 49156096. Throughput: 0: 10416.9. Samples: 98320968. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:43,989][27935] Avg episode reward: [(0, '-58.527')] [2022-07-12 22:00:48,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5188.2, 300 sec: 5248.4). Total num frames: 49180672. Throughput: 0: 10520.5. Samples: 98384528. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:48,990][27935] Avg episode reward: [(0, '-57.961')] [2022-07-12 22:00:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 49210368. Throughput: 0: 10521.5. Samples: 98415908. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:53,989][27935] Avg episode reward: [(0, '-57.488')] [2022-07-12 22:00:58,989][27935] Fps is (10 sec: 5427.6, 60 sec: 5222.4, 300 sec: 5262.3). Total num frames: 49234944. Throughput: 0: 10510.2. Samples: 98478856. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:00:58,989][27935] Avg episode reward: [(0, '-58.022')] [2022-07-12 22:01:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 49259520. Throughput: 0: 10398.6. Samples: 98537452. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:01:03,989][27935] Avg episode reward: [(0, '-57.868')] [2022-07-12 22:01:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 49285120. Throughput: 0: 10401.3. Samples: 98569152. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:01:08,989][27935] Avg episode reward: [(0, '-57.749')] [2022-07-12 22:01:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5248.5). Total num frames: 49310720. Throughput: 0: 10386.7. Samples: 98631900. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:01:13,989][27935] Avg episode reward: [(0, '-57.995')] [2022-07-12 22:01:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5251.9). Total num frames: 49337344. Throughput: 0: 10380.3. Samples: 98694180. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:01:18,989][27935] Avg episode reward: [(0, '-58.407')] [2022-07-12 22:01:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 49363968. Throughput: 0: 10389.2. Samples: 98725788. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-12 22:01:23,989][27935] Avg episode reward: [(0, '-58.203')] [2022-07-12 22:01:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5251.9). Total num frames: 49389568. Throughput: 0: 10397.6. Samples: 98788860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:28,989][27935] Avg episode reward: [(0, '-58.272')] [2022-07-12 22:01:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5251.9). Total num frames: 49416192. Throughput: 0: 9679.6. Samples: 98820104. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:33,989][27935] Avg episode reward: [(0, '-57.965')] [2022-07-12 22:01:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 49441792. Throughput: 0: 10376.5. Samples: 98882852. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:38,989][27935] Avg episode reward: [(0, '-58.062')] [2022-07-12 22:01:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5248.4). Total num frames: 49468416. Throughput: 0: 10368.3. Samples: 98945432. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:43,989][27935] Avg episode reward: [(0, '-58.162')] [2022-07-12 22:01:48,991][27935] Fps is (10 sec: 5221.4, 60 sec: 5222.3, 300 sec: 5241.5). Total num frames: 49494016. Throughput: 0: 10472.9. Samples: 99008752. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:48,991][27935] Avg episode reward: [(0, '-58.269')] [2022-07-12 22:01:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5248.4). Total num frames: 49521664. Throughput: 0: 10472.9. Samples: 99040432. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:53,989][27935] Avg episode reward: [(0, '-58.813')] [2022-07-12 22:01:58,989][27935] Fps is (10 sec: 5325.8, 60 sec: 5205.3, 300 sec: 5251.9). Total num frames: 49547264. Throughput: 0: 10473.2. Samples: 99103192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:01:58,989][27935] Avg episode reward: [(0, '-57.937')] [2022-07-12 22:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 49571840. Throughput: 0: 10407.5. Samples: 99162516. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:02:03,989][27935] Avg episode reward: [(0, '-58.487')] [2022-07-12 22:02:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 49597440. Throughput: 0: 10418.4. Samples: 99194616. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:02:08,989][27935] Avg episode reward: [(0, '-58.060')] [2022-07-12 22:02:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 49625088. Throughput: 0: 10414.3. Samples: 99257504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:02:13,989][27935] Avg episode reward: [(0, '-57.870')] [2022-07-12 22:02:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 49649664. Throughput: 0: 11118.0. Samples: 99320412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:02:18,989][27935] Avg episode reward: [(0, '-57.726')] [2022-07-12 22:02:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 49676288. Throughput: 0: 10430.2. Samples: 99352212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:02:23,989][27935] Avg episode reward: [(0, '-57.690')] [2022-07-12 22:02:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 49702912. Throughput: 0: 10432.5. Samples: 99414896. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:28,989][27935] Avg episode reward: [(0, '-58.217')] [2022-07-12 22:02:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 49729536. Throughput: 0: 10424.5. Samples: 99477832. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:33,989][27935] Avg episode reward: [(0, '-58.496')] [2022-07-12 22:02:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 49755136. Throughput: 0: 10428.2. Samples: 99509700. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:38,989][27935] Avg episode reward: [(0, '-58.712')] [2022-07-12 22:02:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 49781760. Throughput: 0: 10411.6. Samples: 99571712. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:43,989][27935] Avg episode reward: [(0, '-58.504')] [2022-07-12 22:02:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.6, 300 sec: 5241.5). Total num frames: 49808384. Throughput: 0: 10505.1. Samples: 99635244. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:48,989][27935] Avg episode reward: [(0, '-59.214')] [2022-07-12 22:02:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.6). Total num frames: 49835008. Throughput: 0: 10504.3. Samples: 99667312. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:53,989][27935] Avg episode reward: [(0, '-59.792')] [2022-07-12 22:02:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 49860608. Throughput: 0: 10517.8. Samples: 99730804. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:02:58,989][27935] Avg episode reward: [(0, '-59.687')] [2022-07-12 22:03:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 49885184. Throughput: 0: 10445.2. Samples: 99790448. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:03:03,989][27935] Avg episode reward: [(0, '-59.452')] [2022-07-12 22:03:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 49911808. Throughput: 0: 10447.8. Samples: 99822364. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:03:08,989][27935] Avg episode reward: [(0, '-59.487')] [2022-07-12 22:03:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 49938432. Throughput: 0: 10467.6. Samples: 99885940. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:03:13,989][27935] Avg episode reward: [(0, '-59.479')] [2022-07-12 22:03:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 49964032. Throughput: 0: 10474.5. Samples: 99949184. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:03:18,989][27935] Avg episode reward: [(0, '-59.786')] [2022-07-12 22:03:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 49991680. Throughput: 0: 10475.8. Samples: 99981112. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-12 22:03:23,989][27935] Avg episode reward: [(0, '-58.798')] [2022-07-12 22:03:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5234.7). Total num frames: 50018304. Throughput: 0: 10510.6. Samples: 100044688. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:28,989][27935] Avg episode reward: [(0, '-58.744')] [2022-07-12 22:03:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 50043904. Throughput: 0: 10503.2. Samples: 100107888. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:33,989][27935] Avg episode reward: [(0, '-59.078')] [2022-07-12 22:03:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5241.5). Total num frames: 50072576. Throughput: 0: 10496.1. Samples: 100139636. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:38,989][27935] Avg episode reward: [(0, '-59.511')] [2022-07-12 22:03:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 50097152. Throughput: 0: 10482.6. Samples: 100202520. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:43,989][27935] Avg episode reward: [(0, '-59.463')] [2022-07-12 22:03:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 50123776. Throughput: 0: 10570.8. Samples: 100266132. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:48,989][27935] Avg episode reward: [(0, '-59.662')] [2022-07-12 22:03:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 50148352. Throughput: 0: 10557.6. Samples: 100297456. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:53,989][27935] Avg episode reward: [(0, '-59.509')] [2022-07-12 22:03:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 50176000. Throughput: 0: 10541.1. Samples: 100360288. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:03:58,989][27935] Avg episode reward: [(0, '-59.303')] [2022-07-12 22:04:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 50199552. Throughput: 0: 10463.1. Samples: 100420024. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:03,989][27935] Avg episode reward: [(0, '-58.529')] [2022-07-12 22:04:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 50226176. Throughput: 0: 10455.0. Samples: 100451588. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:08,989][27935] Avg episode reward: [(0, '-57.632')] [2022-07-12 22:04:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 50252800. Throughput: 0: 10443.3. Samples: 100514636. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:13,989][27935] Avg episode reward: [(0, '-57.051')] [2022-07-12 22:04:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 50279424. Throughput: 0: 10449.5. Samples: 100578116. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:18,989][27935] Avg episode reward: [(0, '-56.412')] [2022-07-12 22:04:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 50305024. Throughput: 0: 10447.3. Samples: 100609764. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:23,989][27935] Avg episode reward: [(0, '-56.716')] [2022-07-12 22:04:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 50332672. Throughput: 0: 10466.9. Samples: 100673532. Policy #0 lag: (min: 0.0, avg: 10.6, max: 21.0) [2022-07-12 22:04:28,989][27935] Avg episode reward: [(0, '-56.528')] [2022-07-12 22:04:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 50359296. Throughput: 0: 10473.6. Samples: 100737444. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:33,989][27935] Avg episode reward: [(0, '-56.689')] [2022-07-12 22:04:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 50385920. Throughput: 0: 10492.5. Samples: 100769620. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:38,989][27935] Avg episode reward: [(0, '-56.156')] [2022-07-12 22:04:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 50411520. Throughput: 0: 10512.5. Samples: 100833352. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:43,989][27935] Avg episode reward: [(0, '-56.341')] [2022-07-12 22:04:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 50439168. Throughput: 0: 10607.0. Samples: 100897340. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:48,989][27935] Avg episode reward: [(0, '-56.472')] [2022-07-12 22:04:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5234.6). Total num frames: 50465792. Throughput: 0: 10616.5. Samples: 100929328. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:53,989][27935] Avg episode reward: [(0, '-56.885')] [2022-07-12 22:04:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5245.0). Total num frames: 50493440. Throughput: 0: 10626.1. Samples: 100992812. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:04:58,989][27935] Avg episode reward: [(0, '-57.346')] [2022-07-12 22:05:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 50514944. Throughput: 0: 10539.4. Samples: 101052388. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:03,989][27935] Avg episode reward: [(0, '-57.493')] [2022-07-12 22:05:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5234.5). Total num frames: 50543616. Throughput: 0: 10540.0. Samples: 101084064. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:08,989][27935] Avg episode reward: [(0, '-57.445')] [2022-07-12 22:05:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 50569216. Throughput: 0: 10541.2. Samples: 101147888. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:13,989][27935] Avg episode reward: [(0, '-58.200')] [2022-07-12 22:05:18,992][27935] Fps is (10 sec: 5221.0, 60 sec: 5273.4, 300 sec: 5238.0). Total num frames: 50595840. Throughput: 0: 10528.8. Samples: 101211268. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:18,992][27935] Avg episode reward: [(0, '-57.939')] [2022-07-12 22:05:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5234.5). Total num frames: 50622464. Throughput: 0: 10525.1. Samples: 101243252. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:23,989][27935] Avg episode reward: [(0, '-57.780')] [2022-07-12 22:05:28,989][27935] Fps is (10 sec: 5326.3, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 50649088. Throughput: 0: 10517.3. Samples: 101306632. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:05:28,989][27935] Avg episode reward: [(0, '-57.466')] [2022-07-12 22:05:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 50674688. Throughput: 0: 10502.0. Samples: 101369932. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:33,989][27935] Avg episode reward: [(0, '-58.105')] [2022-07-12 22:05:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 50702336. Throughput: 0: 10484.4. Samples: 101401128. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:38,989][27935] Avg episode reward: [(0, '-58.185')] [2022-07-12 22:05:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 50727936. Throughput: 0: 10475.5. Samples: 101464208. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:43,989][27935] Avg episode reward: [(0, '-57.581')] [2022-07-12 22:05:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 50753536. Throughput: 0: 10560.1. Samples: 101527592. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:48,989][27935] Avg episode reward: [(0, '-57.364')] [2022-07-12 22:05:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 50780160. Throughput: 0: 10563.3. Samples: 101559412. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:53,989][27935] Avg episode reward: [(0, '-57.315')] [2022-07-12 22:05:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 50805760. Throughput: 0: 10516.0. Samples: 101621108. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:05:58,989][27935] Avg episode reward: [(0, '-57.498')] [2022-07-12 22:06:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 50830336. Throughput: 0: 10408.2. Samples: 101679608. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:03,989][27935] Avg episode reward: [(0, '-57.018')] [2022-07-12 22:06:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 50856960. Throughput: 0: 10396.1. Samples: 101711076. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:08,989][27935] Avg episode reward: [(0, '-56.902')] [2022-07-12 22:06:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 50882560. Throughput: 0: 10406.7. Samples: 101774932. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:13,989][27935] Avg episode reward: [(0, '-57.654')] [2022-07-12 22:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.6, 300 sec: 5234.5). Total num frames: 50908160. Throughput: 0: 10378.8. Samples: 101836980. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:18,989][27935] Avg episode reward: [(0, '-58.122')] [2022-07-12 22:06:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 50934784. Throughput: 0: 10381.9. Samples: 101868312. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:23,989][27935] Avg episode reward: [(0, '-57.804')] [2022-07-12 22:06:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 50961408. Throughput: 0: 10376.9. Samples: 101931168. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 22:06:28,990][27935] Avg episode reward: [(0, '-58.028')] [2022-07-12 22:06:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 50987008. Throughput: 0: 10374.7. Samples: 101994452. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:33,989][27935] Avg episode reward: [(0, '-57.886')] [2022-07-12 22:06:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 51014656. Throughput: 0: 10378.5. Samples: 102026444. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:38,989][27935] Avg episode reward: [(0, '-58.595')] [2022-07-12 22:06:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 51040256. Throughput: 0: 10414.9. Samples: 102089780. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:43,989][27935] Avg episode reward: [(0, '-58.039')] [2022-07-12 22:06:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 51067904. Throughput: 0: 10520.9. Samples: 102153048. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:48,989][27935] Avg episode reward: [(0, '-57.788')] [2022-07-12 22:06:53,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5222.2, 300 sec: 5241.4). Total num frames: 51093504. Throughput: 0: 10530.3. Samples: 102184968. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:53,992][27935] Avg episode reward: [(0, '-57.811')] [2022-07-12 22:06:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 51120128. Throughput: 0: 10512.3. Samples: 102247984. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:06:58,989][27935] Avg episode reward: [(0, '-58.028')] [2022-07-12 22:07:03,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 51144704. Throughput: 0: 10454.8. Samples: 102307444. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:03,989][27935] Avg episode reward: [(0, '-58.111')] [2022-07-12 22:07:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 51171328. Throughput: 0: 10463.2. Samples: 102339156. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:08,995][27935] Avg episode reward: [(0, '-57.628')] [2022-07-12 22:07:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 51195904. Throughput: 0: 10483.4. Samples: 102402920. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:13,989][27935] Avg episode reward: [(0, '-57.499')] [2022-07-12 22:07:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 51224576. Throughput: 0: 10487.2. Samples: 102466376. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:18,990][27935] Avg episode reward: [(0, '-58.142')] [2022-07-12 22:07:23,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 51250176. Throughput: 0: 10488.6. Samples: 102498432. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:23,989][27935] Avg episode reward: [(0, '-57.359')] [2022-07-12 22:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 51276800. Throughput: 0: 10496.6. Samples: 102562128. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:28,989][27935] Avg episode reward: [(0, '-57.184')] [2022-07-12 22:07:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 51303424. Throughput: 0: 10505.6. Samples: 102625800. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:07:33,990][27935] Avg episode reward: [(0, '-57.064')] [2022-07-12 22:07:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 51329024. Throughput: 0: 10503.4. Samples: 102657592. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:07:38,990][27935] Avg episode reward: [(0, '-57.104')] [2022-07-12 22:07:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 51355648. Throughput: 0: 10490.7. Samples: 102720064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:07:43,989][27935] Avg episode reward: [(0, '-56.955')] [2022-07-12 22:07:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 51382272. Throughput: 0: 10582.0. Samples: 102783636. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:07:48,990][27935] Avg episode reward: [(0, '-57.049')] [2022-07-12 22:07:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.8, 300 sec: 5251.9). Total num frames: 51409920. Throughput: 0: 10592.5. Samples: 102815820. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:07:53,989][27935] Avg episode reward: [(0, '-57.007')] [2022-07-12 22:07:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 51435520. Throughput: 0: 10596.7. Samples: 102879772. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:07:58,989][27935] Avg episode reward: [(0, '-56.409')] [2022-07-12 22:08:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 51460096. Throughput: 0: 10508.2. Samples: 102939244. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:03,989][27935] Avg episode reward: [(0, '-57.220')] [2022-07-12 22:08:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 51486720. Throughput: 0: 10499.2. Samples: 102970896. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:08,989][27935] Avg episode reward: [(0, '-57.259')] [2022-07-12 22:08:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 51512320. Throughput: 0: 10512.1. Samples: 103035172. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:13,989][27935] Avg episode reward: [(0, '-57.643')] [2022-07-12 22:08:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 51539968. Throughput: 0: 9808.0. Samples: 103067160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:18,989][27935] Avg episode reward: [(0, '-57.712')] [2022-07-12 22:08:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 51566592. Throughput: 0: 10516.5. Samples: 103130836. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:23,989][27935] Avg episode reward: [(0, '-57.594')] [2022-07-12 22:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 51593216. Throughput: 0: 10541.2. Samples: 103194416. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:28,989][27935] Avg episode reward: [(0, '-56.743')] [2022-07-12 22:08:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 51618816. Throughput: 0: 10545.8. Samples: 103258196. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:33,989][27935] Avg episode reward: [(0, '-56.389')] [2022-07-12 22:08:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 51646464. Throughput: 0: 10542.4. Samples: 103290228. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 22:08:38,989][27935] Avg episode reward: [(0, '-56.233')] [2022-07-12 22:08:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 51673088. Throughput: 0: 10545.8. Samples: 103354336. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:08:43,990][27935] Avg episode reward: [(0, '-56.356')] [2022-07-12 22:08:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 51698688. Throughput: 0: 10640.9. Samples: 103418084. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:08:48,989][27935] Avg episode reward: [(0, '-56.175')] [2022-07-12 22:08:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 51725312. Throughput: 0: 10640.5. Samples: 103449720. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:08:53,989][27935] Avg episode reward: [(0, '-56.075')] [2022-07-12 22:08:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 51751936. Throughput: 0: 10616.7. Samples: 103512924. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:08:58,989][27935] Avg episode reward: [(0, '-56.861')] [2022-07-12 22:09:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 51776512. Throughput: 0: 11209.7. Samples: 103571596. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:03,989][27935] Avg episode reward: [(0, '-57.513')] [2022-07-12 22:09:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 51802112. Throughput: 0: 10502.6. Samples: 103603452. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:08,989][27935] Avg episode reward: [(0, '-56.785')] [2022-07-12 22:09:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 51828736. Throughput: 0: 10508.7. Samples: 103667308. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:13,990][27935] Avg episode reward: [(0, '-57.009')] [2022-07-12 22:09:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 51854336. Throughput: 0: 10509.4. Samples: 103731120. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:18,989][27935] Avg episode reward: [(0, '-57.093')] [2022-07-12 22:09:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 51881984. Throughput: 0: 10498.1. Samples: 103762644. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:23,989][27935] Avg episode reward: [(0, '-56.701')] [2022-07-12 22:09:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 51908608. Throughput: 0: 10483.0. Samples: 103826072. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:28,989][27935] Avg episode reward: [(0, '-56.173')] [2022-07-12 22:09:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 51935232. Throughput: 0: 10470.2. Samples: 103889244. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:33,990][27935] Avg episode reward: [(0, '-56.001')] [2022-07-12 22:09:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 51960832. Throughput: 0: 10477.1. Samples: 103921188. Policy #0 lag: (min: 0.0, avg: 11.5, max: 23.0) [2022-07-12 22:09:38,989][27935] Avg episode reward: [(0, '-55.676')] [2022-07-12 22:09:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 51987456. Throughput: 0: 10483.6. Samples: 103984684. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:09:43,989][27935] Avg episode reward: [(0, '-56.523')] [2022-07-12 22:09:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 52015104. Throughput: 0: 10594.8. Samples: 104048360. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:09:48,989][27935] Avg episode reward: [(0, '-55.978')] [2022-07-12 22:09:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 52040704. Throughput: 0: 10590.8. Samples: 104080040. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:09:53,990][27935] Avg episode reward: [(0, '-56.248')] [2022-07-12 22:09:58,989][27935] Fps is (10 sec: 5222.1, 60 sec: 5256.5, 300 sec: 5262.3). Total num frames: 52067328. Throughput: 0: 10590.5. Samples: 104143884. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:09:58,990][27935] Avg episode reward: [(0, '-56.811')] [2022-07-12 22:10:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 52091904. Throughput: 0: 10498.9. Samples: 104203572. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:03,989][27935] Avg episode reward: [(0, '-57.091')] [2022-07-12 22:10:08,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 52118528. Throughput: 0: 10508.5. Samples: 104235528. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:08,989][27935] Avg episode reward: [(0, '-57.375')] [2022-07-12 22:10:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 52146176. Throughput: 0: 10528.3. Samples: 104299844. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:13,989][27935] Avg episode reward: [(0, '-57.118')] [2022-07-12 22:10:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 52171776. Throughput: 0: 10543.8. Samples: 104363716. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:18,989][27935] Avg episode reward: [(0, '-56.840')] [2022-07-12 22:10:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 52198400. Throughput: 0: 10540.1. Samples: 104395492. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:23,989][27935] Avg episode reward: [(0, '-56.452')] [2022-07-12 22:10:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 52225024. Throughput: 0: 10552.5. Samples: 104459548. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:28,989][27935] Avg episode reward: [(0, '-56.644')] [2022-07-12 22:10:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 52252672. Throughput: 0: 10547.7. Samples: 104523008. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:33,989][27935] Avg episode reward: [(0, '-56.456')] [2022-07-12 22:10:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 52277248. Throughput: 0: 10552.5. Samples: 104554904. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:38,989][27935] Avg episode reward: [(0, '-56.504')] [2022-07-12 22:10:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5258.8). Total num frames: 52304896. Throughput: 0: 10542.2. Samples: 104618280. Policy #0 lag: (min: 0.0, avg: 10.2, max: 22.0) [2022-07-12 22:10:43,989][27935] Avg episode reward: [(0, '-56.736')] [2022-07-12 22:10:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 52331520. Throughput: 0: 9908.6. Samples: 104649460. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:10:48,989][27935] Avg episode reward: [(0, '-56.332')] [2022-07-12 22:10:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 52357120. Throughput: 0: 10604.4. Samples: 104712728. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:10:53,989][27935] Avg episode reward: [(0, '-56.324')] [2022-07-12 22:10:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 52383744. Throughput: 0: 10603.0. Samples: 104776980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:10:58,989][27935] Avg episode reward: [(0, '-55.567')] [2022-07-12 22:11:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 52408320. Throughput: 0: 10502.0. Samples: 104836304. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:03,989][27935] Avg episode reward: [(0, '-56.466')] [2022-07-12 22:11:08,997][27935] Fps is (10 sec: 5116.0, 60 sec: 5272.9, 300 sec: 5262.2). Total num frames: 52434944. Throughput: 0: 10500.1. Samples: 104868080. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:08,997][27935] Avg episode reward: [(0, '-56.174')] [2022-07-12 22:11:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 52461568. Throughput: 0: 10504.2. Samples: 104932236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:13,989][27935] Avg episode reward: [(0, '-56.414')] [2022-07-12 22:11:18,989][27935] Fps is (10 sec: 5124.0, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 52486144. Throughput: 0: 10489.6. Samples: 104995040. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:18,994][27935] Avg episode reward: [(0, '-56.518')] [2022-07-12 22:11:23,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5290.7, 300 sec: 5269.3). Total num frames: 52515840. Throughput: 0: 10484.0. Samples: 105026684. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:23,989][27935] Avg episode reward: [(0, '-55.945')] [2022-07-12 22:11:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5262.3). Total num frames: 52539392. Throughput: 0: 10482.5. Samples: 105089992. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:28,989][27935] Avg episode reward: [(0, '-56.594')] [2022-07-12 22:11:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 52568064. Throughput: 0: 11183.1. Samples: 105152700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:33,989][27935] Avg episode reward: [(0, '-56.082')] [2022-07-12 22:11:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 52593664. Throughput: 0: 10489.3. Samples: 105184748. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:38,989][27935] Avg episode reward: [(0, '-55.751')] [2022-07-12 22:11:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 52619264. Throughput: 0: 10480.8. Samples: 105248616. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:43,989][27935] Avg episode reward: [(0, '-55.773')] [2022-07-12 22:11:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 52646912. Throughput: 0: 10589.7. Samples: 105312840. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 22:11:48,989][27935] Avg episode reward: [(0, '-55.792')] [2022-07-12 22:11:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 52673536. Throughput: 0: 10590.6. Samples: 105344572. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:11:53,989][27935] Avg episode reward: [(0, '-56.538')] [2022-07-12 22:11:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 52700160. Throughput: 0: 10591.9. Samples: 105408872. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:11:58,989][27935] Avg episode reward: [(0, '-56.282')] [2022-07-12 22:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5262.3). Total num frames: 52723712. Throughput: 0: 9877.6. Samples: 105439532. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:03,989][27935] Avg episode reward: [(0, '-55.555')] [2022-07-12 22:12:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5240.2, 300 sec: 5265.8). Total num frames: 52749312. Throughput: 0: 10447.7. Samples: 105496832. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:08,989][27935] Avg episode reward: [(0, '-56.229')] [2022-07-12 22:12:13,990][27935] Fps is (10 sec: 5221.7, 60 sec: 5239.4, 300 sec: 5258.8). Total num frames: 52775936. Throughput: 0: 10446.0. Samples: 105560076. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:13,991][27935] Avg episode reward: [(0, '-56.474')] [2022-07-12 22:12:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 52802560. Throughput: 0: 10449.3. Samples: 105622920. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:18,989][27935] Avg episode reward: [(0, '-56.251')] [2022-07-12 22:12:23,989][27935] Fps is (10 sec: 5223.1, 60 sec: 5205.3, 300 sec: 5258.8). Total num frames: 52828160. Throughput: 0: 10439.5. Samples: 105654524. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:23,989][27935] Avg episode reward: [(0, '-56.591')] [2022-07-12 22:12:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 52853760. Throughput: 0: 10432.4. Samples: 105718076. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:28,989][27935] Avg episode reward: [(0, '-56.763')] [2022-07-12 22:12:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5258.8). Total num frames: 52880384. Throughput: 0: 10395.9. Samples: 105780656. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:33,989][27935] Avg episode reward: [(0, '-57.627')] [2022-07-12 22:12:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5255.4). Total num frames: 52905984. Throughput: 0: 10404.3. Samples: 105812768. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:38,989][27935] Avg episode reward: [(0, '-57.183')] [2022-07-12 22:12:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 52933632. Throughput: 0: 10357.3. Samples: 105874952. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:43,990][27935] Avg episode reward: [(0, '-57.379')] [2022-07-12 22:12:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 52960256. Throughput: 0: 11093.2. Samples: 105938724. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:48,989][27935] Avg episode reward: [(0, '-57.299')] [2022-07-12 22:12:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5255.4). Total num frames: 52985856. Throughput: 0: 10521.2. Samples: 105970284. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:12:53,989][27935] Avg episode reward: [(0, '-57.503')] [2022-07-12 22:12:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5258.8). Total num frames: 53011456. Throughput: 0: 10527.3. Samples: 106033788. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:12:58,990][27935] Avg episode reward: [(0, '-57.891')] [2022-07-12 22:13:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 53038080. Throughput: 0: 10443.8. Samples: 106092892. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:03,990][27935] Avg episode reward: [(0, '-57.820')] [2022-07-12 22:13:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 53062656. Throughput: 0: 10442.0. Samples: 106124412. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:08,990][27935] Avg episode reward: [(0, '-58.180')] [2022-07-12 22:13:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.6, 300 sec: 5255.4). Total num frames: 53090304. Throughput: 0: 10437.9. Samples: 106187780. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:13,989][27935] Avg episode reward: [(0, '-57.795')] [2022-07-12 22:13:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5245.0). Total num frames: 53113856. Throughput: 0: 10452.0. Samples: 106250996. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:18,989][27935] Avg episode reward: [(0, '-57.640')] [2022-07-12 22:13:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 53142528. Throughput: 0: 10439.2. Samples: 106282532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:23,989][27935] Avg episode reward: [(0, '-57.825')] [2022-07-12 22:13:28,993][27935] Fps is (10 sec: 5425.2, 60 sec: 5239.1, 300 sec: 5251.8). Total num frames: 53168128. Throughput: 0: 10457.0. Samples: 106345556. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:28,993][27935] Avg episode reward: [(0, '-57.298')] [2022-07-12 22:13:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 53193728. Throughput: 0: 10403.7. Samples: 106406888. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:33,989][27935] Avg episode reward: [(0, '-56.772')] [2022-07-12 22:13:38,989][27935] Fps is (10 sec: 5121.9, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 53219328. Throughput: 0: 10393.7. Samples: 106438000. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:38,995][27935] Avg episode reward: [(0, '-55.569')] [2022-07-12 22:13:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5241.5). Total num frames: 53244928. Throughput: 0: 10369.8. Samples: 106500428. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:43,989][27935] Avg episode reward: [(0, '-55.544')] [2022-07-12 22:13:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 53273600. Throughput: 0: 10434.9. Samples: 106562464. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:48,989][27935] Avg episode reward: [(0, '-56.160')] [2022-07-12 22:13:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 53297152. Throughput: 0: 10430.3. Samples: 106593776. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:53,989][27935] Avg episode reward: [(0, '-56.324')] [2022-07-12 22:13:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 53323776. Throughput: 0: 10414.2. Samples: 106656420. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 22:13:58,989][27935] Avg episode reward: [(0, '-56.279')] [2022-07-12 22:14:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5234.5). Total num frames: 53346304. Throughput: 0: 10252.1. Samples: 106712340. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:03,989][27935] Avg episode reward: [(0, '-56.391')] [2022-07-12 22:14:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5154.1, 300 sec: 5231.1). Total num frames: 53371904. Throughput: 0: 10209.1. Samples: 106741940. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:08,996][27935] Avg episode reward: [(0, '-56.393')] [2022-07-12 22:14:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5120.0, 300 sec: 5231.1). Total num frames: 53397504. Throughput: 0: 10189.7. Samples: 106804056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:13,989][27935] Avg episode reward: [(0, '-56.357')] [2022-07-12 22:14:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5224.1). Total num frames: 53423104. Throughput: 0: 10206.3. Samples: 106866172. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:18,989][27935] Avg episode reward: [(0, '-55.615')] [2022-07-12 22:14:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5120.0, 300 sec: 5224.1). Total num frames: 53449728. Throughput: 0: 10211.0. Samples: 106897496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:23,989][27935] Avg episode reward: [(0, '-55.508')] [2022-07-12 22:14:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.3, 300 sec: 5220.7). Total num frames: 53475328. Throughput: 0: 10192.5. Samples: 106959092. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:28,989][27935] Avg episode reward: [(0, '-55.941')] [2022-07-12 22:14:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5220.7). Total num frames: 53500928. Throughput: 0: 10189.9. Samples: 107021008. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:33,989][27935] Avg episode reward: [(0, '-55.483')] [2022-07-12 22:14:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5217.2). Total num frames: 53526528. Throughput: 0: 10188.5. Samples: 107052260. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:38,989][27935] Avg episode reward: [(0, '-55.380')] [2022-07-12 22:14:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5210.3). Total num frames: 53552128. Throughput: 0: 10162.5. Samples: 107113732. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:43,989][27935] Avg episode reward: [(0, '-55.303')] [2022-07-12 22:14:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5213.7). Total num frames: 53578752. Throughput: 0: 10296.4. Samples: 107175680. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:48,989][27935] Avg episode reward: [(0, '-55.104')] [2022-07-12 22:14:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5206.8). Total num frames: 53603328. Throughput: 0: 10322.7. Samples: 107206460. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:53,989][27935] Avg episode reward: [(0, '-55.239')] [2022-07-12 22:14:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5213.7). Total num frames: 53629952. Throughput: 0: 10315.8. Samples: 107268264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:14:58,989][27935] Avg episode reward: [(0, '-55.415')] [2022-07-12 22:15:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5203.3). Total num frames: 53653504. Throughput: 0: 10206.2. Samples: 107325452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-12 22:15:03,989][27935] Avg episode reward: [(0, '-55.799')] [2022-07-12 22:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5192.9). Total num frames: 53678080. Throughput: 0: 10200.0. Samples: 107356496. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:08,989][27935] Avg episode reward: [(0, '-56.148')] [2022-07-12 22:15:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5120.0, 300 sec: 5196.4). Total num frames: 53704704. Throughput: 0: 10203.1. Samples: 107418232. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:13,989][27935] Avg episode reward: [(0, '-56.150')] [2022-07-12 22:15:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5189.4). Total num frames: 53729280. Throughput: 0: 10198.7. Samples: 107479952. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:18,989][27935] Avg episode reward: [(0, '-55.949')] [2022-07-12 22:15:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5102.9, 300 sec: 5189.4). Total num frames: 53755904. Throughput: 0: 10185.3. Samples: 107510600. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:23,989][27935] Avg episode reward: [(0, '-55.890')] [2022-07-12 22:15:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5182.5). Total num frames: 53781504. Throughput: 0: 10200.4. Samples: 107572748. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:28,989][27935] Avg episode reward: [(0, '-55.769')] [2022-07-12 22:15:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5186.0). Total num frames: 53807104. Throughput: 0: 10191.1. Samples: 107634280. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:33,989][27935] Avg episode reward: [(0, '-55.119')] [2022-07-12 22:15:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 53832704. Throughput: 0: 10198.0. Samples: 107665372. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:38,990][27935] Avg episode reward: [(0, '-54.932')] [2022-07-12 22:15:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 53860352. Throughput: 0: 10216.9. Samples: 107728024. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:43,990][27935] Avg episode reward: [(0, '-54.854')] [2022-07-12 22:15:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 53885952. Throughput: 0: 10327.6. Samples: 107790196. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:48,989][27935] Avg episode reward: [(0, '-55.570')] [2022-07-12 22:15:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 53911552. Throughput: 0: 10326.5. Samples: 107821188. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:53,989][27935] Avg episode reward: [(0, '-55.854')] [2022-07-12 22:15:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 53937152. Throughput: 0: 10349.6. Samples: 107883964. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:15:58,989][27935] Avg episode reward: [(0, '-56.041')] [2022-07-12 22:16:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5175.7). Total num frames: 53961728. Throughput: 0: 10266.2. Samples: 107941932. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:16:03,989][27935] Avg episode reward: [(0, '-56.563')] [2022-07-12 22:16:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 53987328. Throughput: 0: 10272.0. Samples: 107972840. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:16:08,989][27935] Avg episode reward: [(0, '-57.054')] [2022-07-12 22:16:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5175.5). Total num frames: 54012928. Throughput: 0: 10274.4. Samples: 108035096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:13,989][27935] Avg episode reward: [(0, '-57.295')] [2022-07-12 22:16:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 54038528. Throughput: 0: 10262.4. Samples: 108096088. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:18,989][27935] Avg episode reward: [(0, '-57.442')] [2022-07-12 22:16:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5165.1). Total num frames: 54063104. Throughput: 0: 10256.0. Samples: 108126892. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:23,989][27935] Avg episode reward: [(0, '-57.542')] [2022-07-12 22:16:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 54089728. Throughput: 0: 10251.0. Samples: 108189320. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:28,989][27935] Avg episode reward: [(0, '-57.487')] [2022-07-12 22:16:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 54115328. Throughput: 0: 10225.5. Samples: 108250344. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:33,989][27935] Avg episode reward: [(0, '-56.939')] [2022-07-12 22:16:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 54141952. Throughput: 0: 10220.4. Samples: 108281104. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:38,989][27935] Avg episode reward: [(0, '-55.999')] [2022-07-12 22:16:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5147.8). Total num frames: 54165504. Throughput: 0: 10199.1. Samples: 108342924. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:43,989][27935] Avg episode reward: [(0, '-56.275')] [2022-07-12 22:16:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 54194176. Throughput: 0: 10284.1. Samples: 108404716. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:48,989][27935] Avg episode reward: [(0, '-56.374')] [2022-07-12 22:16:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5140.8). Total num frames: 54216704. Throughput: 0: 10280.0. Samples: 108435440. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:53,989][27935] Avg episode reward: [(0, '-55.913')] [2022-07-12 22:16:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 54245376. Throughput: 0: 10268.2. Samples: 108497164. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:16:58,989][27935] Avg episode reward: [(0, '-55.209')] [2022-07-12 22:17:03,990][27935] Fps is (10 sec: 5016.8, 60 sec: 5085.7, 300 sec: 5144.3). Total num frames: 54266880. Throughput: 0: 10208.4. Samples: 108555484. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:17:03,991][27935] Avg episode reward: [(0, '-54.848')] [2022-07-12 22:17:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 54294528. Throughput: 0: 10211.4. Samples: 108586404. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:17:08,989][27935] Avg episode reward: [(0, '-54.600')] [2022-07-12 22:17:14,003][27935] Fps is (10 sec: 5215.6, 60 sec: 5101.7, 300 sec: 5140.6). Total num frames: 54319104. Throughput: 0: 10204.5. Samples: 108648672. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 22:17:14,004][27935] Avg episode reward: [(0, '-54.548')] [2022-07-12 22:17:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 54345728. Throughput: 0: 10227.3. Samples: 108710572. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:18,989][27935] Avg episode reward: [(0, '-54.930')] [2022-07-12 22:17:23,991][27935] Fps is (10 sec: 5126.4, 60 sec: 5119.8, 300 sec: 5140.8). Total num frames: 54370304. Throughput: 0: 10226.6. Samples: 108741324. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:23,991][27935] Avg episode reward: [(0, '-54.188')] [2022-07-12 22:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5133.9). Total num frames: 54394880. Throughput: 0: 10159.6. Samples: 108800104. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:28,989][27935] Avg episode reward: [(0, '-54.577')] [2022-07-12 22:17:33,989][27935] Fps is (10 sec: 5121.1, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 54421504. Throughput: 0: 10161.0. Samples: 108861960. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:33,989][27935] Avg episode reward: [(0, '-55.556')] [2022-07-12 22:17:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 54449152. Throughput: 0: 10178.1. Samples: 108893456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:38,989][27935] Avg episode reward: [(0, '-55.603')] [2022-07-12 22:17:43,990][27935] Fps is (10 sec: 5017.2, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 54471680. Throughput: 0: 10169.4. Samples: 108954796. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:43,990][27935] Avg episode reward: [(0, '-55.545')] [2022-07-12 22:17:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5130.4). Total num frames: 54499328. Throughput: 0: 10268.3. Samples: 109017540. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:48,989][27935] Avg episode reward: [(0, '-55.463')] [2022-07-12 22:17:53,990][27935] Fps is (10 sec: 5222.3, 60 sec: 5119.9, 300 sec: 5126.9). Total num frames: 54523904. Throughput: 0: 10266.5. Samples: 109048408. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:53,990][27935] Avg episode reward: [(0, '-55.500')] [2022-07-12 22:17:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 54551552. Throughput: 0: 10275.0. Samples: 109110896. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:17:58,989][27935] Avg episode reward: [(0, '-55.633')] [2022-07-12 22:18:03,989][27935] Fps is (10 sec: 5120.5, 60 sec: 5137.2, 300 sec: 5126.9). Total num frames: 54575104. Throughput: 0: 10175.6. Samples: 109168476. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:18:03,989][27935] Avg episode reward: [(0, '-55.124')] [2022-07-12 22:18:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 54598656. Throughput: 0: 10142.0. Samples: 109197692. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:18:08,989][27935] Avg episode reward: [(0, '-55.669')] [2022-07-12 22:18:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5104.2, 300 sec: 5123.5). Total num frames: 54625280. Throughput: 0: 10188.3. Samples: 109258576. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:18:13,989][27935] Avg episode reward: [(0, '-55.561')] [2022-07-12 22:18:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5109.6). Total num frames: 54649856. Throughput: 0: 10181.3. Samples: 109320116. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:18:18,989][27935] Avg episode reward: [(0, '-55.662')] [2022-07-12 22:18:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5086.0, 300 sec: 5109.7). Total num frames: 54675456. Throughput: 0: 10161.5. Samples: 109350724. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-12 22:18:23,989][27935] Avg episode reward: [(0, '-55.691')] [2022-07-12 22:18:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 54701056. Throughput: 0: 10178.3. Samples: 109412812. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:28,989][27935] Avg episode reward: [(0, '-56.024')] [2022-07-12 22:18:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 54727680. Throughput: 0: 10142.2. Samples: 109473940. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:33,989][27935] Avg episode reward: [(0, '-56.356')] [2022-07-12 22:18:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5109.6). Total num frames: 54752256. Throughput: 0: 10143.7. Samples: 109504864. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:38,989][27935] Avg episode reward: [(0, '-56.125')] [2022-07-12 22:18:43,991][27935] Fps is (10 sec: 5119.0, 60 sec: 5119.9, 300 sec: 5102.6). Total num frames: 54778880. Throughput: 0: 10134.8. Samples: 109566980. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:43,991][27935] Avg episode reward: [(0, '-56.626')] [2022-07-12 22:18:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 54805504. Throughput: 0: 10227.4. Samples: 109628708. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:48,989][27935] Avg episode reward: [(0, '-56.600')] [2022-07-12 22:18:53,989][27935] Fps is (10 sec: 5121.0, 60 sec: 5103.0, 300 sec: 5106.1). Total num frames: 54830080. Throughput: 0: 10260.7. Samples: 109659424. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:53,989][27935] Avg episode reward: [(0, '-56.903')] [2022-07-12 22:18:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 54856704. Throughput: 0: 10290.6. Samples: 109721652. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:18:58,989][27935] Avg episode reward: [(0, '-56.333')] [2022-07-12 22:19:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5113.1). Total num frames: 54880256. Throughput: 0: 10191.5. Samples: 109778732. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:03,989][27935] Avg episode reward: [(0, '-55.884')] [2022-07-12 22:19:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 54904832. Throughput: 0: 10196.2. Samples: 109809552. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:08,990][27935] Avg episode reward: [(0, '-55.686')] [2022-07-12 22:19:13,991][27935] Fps is (10 sec: 5118.9, 60 sec: 5102.7, 300 sec: 5113.0). Total num frames: 54931456. Throughput: 0: 10206.2. Samples: 109872112. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:13,993][27935] Avg episode reward: [(0, '-55.648')] [2022-07-12 22:19:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5109.6). Total num frames: 54957056. Throughput: 0: 10227.5. Samples: 109934180. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:18,989][27935] Avg episode reward: [(0, '-55.273')] [2022-07-12 22:19:23,989][27935] Fps is (10 sec: 5223.6, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 54983680. Throughput: 0: 10232.1. Samples: 109965308. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:23,989][27935] Avg episode reward: [(0, '-55.540')] [2022-07-12 22:19:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 55009280. Throughput: 0: 10239.1. Samples: 110027720. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:19:28,989][27935] Avg episode reward: [(0, '-55.878')] [2022-07-12 22:19:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 55034880. Throughput: 0: 10242.0. Samples: 110089600. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:33,989][27935] Avg episode reward: [(0, '-55.590')] [2022-07-12 22:19:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 55060480. Throughput: 0: 10267.1. Samples: 110121444. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:38,989][27935] Avg episode reward: [(0, '-55.895')] [2022-07-12 22:19:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.3, 300 sec: 5116.5). Total num frames: 55088128. Throughput: 0: 10271.6. Samples: 110183872. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:43,989][27935] Avg episode reward: [(0, '-55.858')] [2022-07-12 22:19:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5116.5). Total num frames: 55112704. Throughput: 0: 10391.6. Samples: 110246352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:48,989][27935] Avg episode reward: [(0, '-55.272')] [2022-07-12 22:19:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5116.5). Total num frames: 55139328. Throughput: 0: 10404.2. Samples: 110277740. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:53,989][27935] Avg episode reward: [(0, '-55.839')] [2022-07-12 22:19:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5123.5). Total num frames: 55164928. Throughput: 0: 10394.9. Samples: 110339860. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:19:58,989][27935] Avg episode reward: [(0, '-55.906')] [2022-07-12 22:20:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5123.5). Total num frames: 55189504. Throughput: 0: 10296.5. Samples: 110397524. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:03,989][27935] Avg episode reward: [(0, '-55.990')] [2022-07-12 22:20:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5116.5). Total num frames: 55214080. Throughput: 0: 10295.1. Samples: 110428588. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:08,989][27935] Avg episode reward: [(0, '-55.940')] [2022-07-12 22:20:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.3, 300 sec: 5123.5). Total num frames: 55240704. Throughput: 0: 10300.8. Samples: 110491256. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:13,989][27935] Avg episode reward: [(0, '-56.669')] [2022-07-12 22:20:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 55266304. Throughput: 0: 9624.1. Samples: 110522684. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:18,989][27935] Avg episode reward: [(0, '-56.005')] [2022-07-12 22:20:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5171.2, 300 sec: 5126.9). Total num frames: 55293952. Throughput: 0: 10311.8. Samples: 110585476. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:23,989][27935] Avg episode reward: [(0, '-57.546')] [2022-07-12 22:20:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5126.9). Total num frames: 55319552. Throughput: 0: 10308.8. Samples: 110647768. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:28,989][27935] Avg episode reward: [(0, '-57.172')] [2022-07-12 22:20:33,991][27935] Fps is (10 sec: 5221.1, 60 sec: 5188.1, 300 sec: 5130.4). Total num frames: 55346176. Throughput: 0: 10307.8. Samples: 110710228. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-12 22:20:33,992][27935] Avg episode reward: [(0, '-57.673')] [2022-07-12 22:20:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5120.0). Total num frames: 55370752. Throughput: 0: 10303.7. Samples: 110741408. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:20:38,989][27935] Avg episode reward: [(0, '-57.694')] [2022-07-12 22:20:43,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5154.1, 300 sec: 5123.5). Total num frames: 55397376. Throughput: 0: 10324.5. Samples: 110804460. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:20:43,990][27935] Avg episode reward: [(0, '-57.340')] [2022-07-12 22:20:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5126.9). Total num frames: 55424000. Throughput: 0: 10453.9. Samples: 110867948. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:20:48,989][27935] Avg episode reward: [(0, '-57.978')] [2022-07-12 22:20:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 55450624. Throughput: 0: 10472.3. Samples: 110899840. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:20:53,989][27935] Avg episode reward: [(0, '-57.823')] [2022-07-12 22:20:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5137.4). Total num frames: 55477248. Throughput: 0: 10481.3. Samples: 110962912. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:20:58,989][27935] Avg episode reward: [(0, '-58.105')] [2022-07-12 22:21:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 55500800. Throughput: 0: 11088.4. Samples: 111021660. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:03,989][27935] Avg episode reward: [(0, '-57.825')] [2022-07-12 22:21:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5133.9). Total num frames: 55527424. Throughput: 0: 10384.0. Samples: 111052756. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:08,989][27935] Avg episode reward: [(0, '-57.447')] [2022-07-12 22:21:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5133.9). Total num frames: 55553024. Throughput: 0: 10385.7. Samples: 111115124. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:13,989][27935] Avg episode reward: [(0, '-56.729')] [2022-07-12 22:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5137.4). Total num frames: 55578624. Throughput: 0: 10369.7. Samples: 111176840. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:18,989][27935] Avg episode reward: [(0, '-57.008')] [2022-07-12 22:21:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 55605248. Throughput: 0: 10385.4. Samples: 111208752. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:23,989][27935] Avg episode reward: [(0, '-56.776')] [2022-07-12 22:21:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 55630848. Throughput: 0: 10365.9. Samples: 111270928. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:28,989][27935] Avg episode reward: [(0, '-55.985')] [2022-07-12 22:21:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.4, 300 sec: 5133.9). Total num frames: 55656448. Throughput: 0: 10330.0. Samples: 111332800. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:33,989][27935] Avg episode reward: [(0, '-55.782')] [2022-07-12 22:21:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5144.3). Total num frames: 55683072. Throughput: 0: 10315.6. Samples: 111364040. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:38,989][27935] Avg episode reward: [(0, '-55.173')] [2022-07-12 22:21:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5133.9). Total num frames: 55708672. Throughput: 0: 10309.7. Samples: 111426848. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:21:43,989][27935] Avg episode reward: [(0, '-55.762')] [2022-07-12 22:21:48,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5188.2, 300 sec: 5147.8). Total num frames: 55735296. Throughput: 0: 10396.1. Samples: 111489488. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:21:48,990][27935] Avg episode reward: [(0, '-54.845')] [2022-07-12 22:21:53,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5170.9, 300 sec: 5137.3). Total num frames: 55760896. Throughput: 0: 10413.0. Samples: 111521376. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:21:53,993][27935] Avg episode reward: [(0, '-54.299')] [2022-07-12 22:21:58,989][27935] Fps is (10 sec: 5222.6, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 55787520. Throughput: 0: 10425.9. Samples: 111584288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:21:58,989][27935] Avg episode reward: [(0, '-54.915')] [2022-07-12 22:22:03,989][27935] Fps is (10 sec: 5121.9, 60 sec: 5188.3, 300 sec: 5144.3). Total num frames: 55812096. Throughput: 0: 10380.4. Samples: 111643956. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:03,989][27935] Avg episode reward: [(0, '-55.066')] [2022-07-12 22:22:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5151.5). Total num frames: 55838720. Throughput: 0: 10370.7. Samples: 111675432. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:08,989][27935] Avg episode reward: [(0, '-55.465')] [2022-07-12 22:22:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5222.4, 300 sec: 5154.7). Total num frames: 55866368. Throughput: 0: 10403.1. Samples: 111739068. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:13,989][27935] Avg episode reward: [(0, '-54.993')] [2022-07-12 22:22:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5154.7). Total num frames: 55890944. Throughput: 0: 10439.4. Samples: 111802572. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:18,989][27935] Avg episode reward: [(0, '-55.454')] [2022-07-12 22:22:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5165.1). Total num frames: 55918592. Throughput: 0: 10454.7. Samples: 111834500. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:23,989][27935] Avg episode reward: [(0, '-55.891')] [2022-07-12 22:22:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5158.2). Total num frames: 55943168. Throughput: 0: 10470.0. Samples: 111897996. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:28,989][27935] Avg episode reward: [(0, '-55.735')] [2022-07-12 22:22:33,992][27935] Fps is (10 sec: 5220.9, 60 sec: 5239.2, 300 sec: 5158.1). Total num frames: 55970816. Throughput: 0: 10484.2. Samples: 111961304. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:33,992][27935] Avg episode reward: [(0, '-55.200')] [2022-07-12 22:22:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5172.1). Total num frames: 55997440. Throughput: 0: 10473.3. Samples: 111992636. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:38,989][27935] Avg episode reward: [(0, '-55.269')] [2022-07-12 22:22:43,989][27935] Fps is (10 sec: 5326.3, 60 sec: 5256.5, 300 sec: 5168.6). Total num frames: 56024064. Throughput: 0: 10459.8. Samples: 112054980. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:43,989][27935] Avg episode reward: [(0, '-55.684')] [2022-07-12 22:22:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5172.1). Total num frames: 56049664. Throughput: 0: 10552.9. Samples: 112118836. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:48,989][27935] Avg episode reward: [(0, '-55.146')] [2022-07-12 22:22:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.9, 300 sec: 5172.1). Total num frames: 56077312. Throughput: 0: 10560.4. Samples: 112150652. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:22:53,989][27935] Avg episode reward: [(0, '-54.920')] [2022-07-12 22:22:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5179.0). Total num frames: 56102912. Throughput: 0: 10545.2. Samples: 112213600. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:22:58,989][27935] Avg episode reward: [(0, '-55.843')] [2022-07-12 22:23:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 56127488. Throughput: 0: 10458.6. Samples: 112273208. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:03,990][27935] Avg episode reward: [(0, '-56.260')] [2022-07-12 22:23:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 56152064. Throughput: 0: 10452.9. Samples: 112304880. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:08,992][27935] Avg episode reward: [(0, '-56.884')] [2022-07-12 22:23:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 56179712. Throughput: 0: 10462.2. Samples: 112368796. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:13,989][27935] Avg episode reward: [(0, '-56.930')] [2022-07-12 22:23:18,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5273.6, 300 sec: 5192.9). Total num frames: 56207360. Throughput: 0: 10470.9. Samples: 112432464. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:18,989][27935] Avg episode reward: [(0, '-57.152')] [2022-07-12 22:23:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 56232960. Throughput: 0: 10489.2. Samples: 112464648. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:23,989][27935] Avg episode reward: [(0, '-57.631')] [2022-07-12 22:23:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5196.4). Total num frames: 56260608. Throughput: 0: 10519.3. Samples: 112528348. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:28,989][27935] Avg episode reward: [(0, '-56.654')] [2022-07-12 22:23:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.7, 300 sec: 5196.4). Total num frames: 56285184. Throughput: 0: 10503.7. Samples: 112591504. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:33,989][27935] Avg episode reward: [(0, '-57.033')] [2022-07-12 22:23:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 56311808. Throughput: 0: 10492.7. Samples: 112622824. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:38,989][27935] Avg episode reward: [(0, '-57.309')] [2022-07-12 22:23:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5273.6, 300 sec: 5203.3). Total num frames: 56340480. Throughput: 0: 10510.9. Samples: 112686592. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:43,990][27935] Avg episode reward: [(0, '-56.926')] [2022-07-12 22:23:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 56364032. Throughput: 0: 10595.4. Samples: 112750000. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:48,990][27935] Avg episode reward: [(0, '-56.858')] [2022-07-12 22:23:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 56391680. Throughput: 0: 10596.4. Samples: 112781716. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:53,989][27935] Avg episode reward: [(0, '-56.968')] [2022-07-12 22:23:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 56417280. Throughput: 0: 10575.8. Samples: 112844708. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-12 22:23:58,989][27935] Avg episode reward: [(0, '-57.009')] [2022-07-12 22:24:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5213.7). Total num frames: 56442880. Throughput: 0: 10483.6. Samples: 112904224. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:03,989][27935] Avg episode reward: [(0, '-56.664')] [2022-07-12 22:24:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5210.3). Total num frames: 56468480. Throughput: 0: 10468.4. Samples: 112935724. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:08,989][27935] Avg episode reward: [(0, '-56.199')] [2022-07-12 22:24:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 56494080. Throughput: 0: 10400.2. Samples: 112996356. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:13,989][27935] Avg episode reward: [(0, '-56.462')] [2022-07-12 22:24:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 56519680. Throughput: 0: 9688.2. Samples: 113027472. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:18,989][27935] Avg episode reward: [(0, '-56.666')] [2022-07-12 22:24:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.2). Total num frames: 56546304. Throughput: 0: 10408.4. Samples: 113091200. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:23,989][27935] Avg episode reward: [(0, '-56.439')] [2022-07-12 22:24:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 56572928. Throughput: 0: 10394.2. Samples: 113154332. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:28,989][27935] Avg episode reward: [(0, '-55.669')] [2022-07-12 22:24:33,996][27935] Fps is (10 sec: 5320.7, 60 sec: 5238.8, 300 sec: 5217.1). Total num frames: 56599552. Throughput: 0: 10381.0. Samples: 113217224. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:33,997][27935] Avg episode reward: [(0, '-55.959')] [2022-07-12 22:24:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 56625152. Throughput: 0: 10370.0. Samples: 113248368. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:38,989][27935] Avg episode reward: [(0, '-56.809')] [2022-07-12 22:24:43,989][27935] Fps is (10 sec: 5226.4, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 56651776. Throughput: 0: 10384.5. Samples: 113312012. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:43,990][27935] Avg episode reward: [(0, '-57.187')] [2022-07-12 22:24:48,993][27935] Fps is (10 sec: 5322.8, 60 sec: 5239.1, 300 sec: 5217.1). Total num frames: 56678400. Throughput: 0: 10488.2. Samples: 113376232. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:48,993][27935] Avg episode reward: [(0, '-57.386')] [2022-07-12 22:24:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 56704000. Throughput: 0: 10500.7. Samples: 113408256. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:53,989][27935] Avg episode reward: [(0, '-57.762')] [2022-07-12 22:24:58,989][27935] Fps is (10 sec: 5326.9, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 56731648. Throughput: 0: 10567.9. Samples: 113471912. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:24:58,989][27935] Avg episode reward: [(0, '-57.823')] [2022-07-12 22:25:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 56755200. Throughput: 0: 11198.7. Samples: 113531412. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:25:03,989][27935] Avg episode reward: [(0, '-57.834')] [2022-07-12 22:25:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 56782848. Throughput: 0: 10496.4. Samples: 113563540. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-12 22:25:08,989][27935] Avg episode reward: [(0, '-57.334')] [2022-07-12 22:25:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 56808448. Throughput: 0: 10489.2. Samples: 113626344. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:13,989][27935] Avg episode reward: [(0, '-56.189')] [2022-07-12 22:25:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 56836096. Throughput: 0: 10494.1. Samples: 113689380. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:18,989][27935] Avg episode reward: [(0, '-56.092')] [2022-07-12 22:25:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 56861696. Throughput: 0: 10513.4. Samples: 113721472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:23,989][27935] Avg episode reward: [(0, '-56.367')] [2022-07-12 22:25:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5227.7). Total num frames: 56888320. Throughput: 0: 10520.3. Samples: 113785424. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:28,989][27935] Avg episode reward: [(0, '-56.460')] [2022-07-12 22:25:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5257.2, 300 sec: 5234.5). Total num frames: 56914944. Throughput: 0: 10490.1. Samples: 113848244. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:33,989][27935] Avg episode reward: [(0, '-56.377')] [2022-07-12 22:25:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 56941568. Throughput: 0: 10472.9. Samples: 113879536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:38,989][27935] Avg episode reward: [(0, '-56.589')] [2022-07-12 22:25:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 56967168. Throughput: 0: 10464.9. Samples: 113942832. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:43,989][27935] Avg episode reward: [(0, '-56.653')] [2022-07-12 22:25:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.8, 300 sec: 5227.6). Total num frames: 56992768. Throughput: 0: 10558.8. Samples: 114006556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:48,989][27935] Avg episode reward: [(0, '-56.015')] [2022-07-12 22:25:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 57020416. Throughput: 0: 10555.8. Samples: 114038552. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:53,989][27935] Avg episode reward: [(0, '-55.034')] [2022-07-12 22:25:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 57047040. Throughput: 0: 10572.6. Samples: 114102112. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:25:58,989][27935] Avg episode reward: [(0, '-56.107')] [2022-07-12 22:26:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 57070592. Throughput: 0: 10490.9. Samples: 114161472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:26:03,989][27935] Avg episode reward: [(0, '-56.067')] [2022-07-12 22:26:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 57097216. Throughput: 0: 10484.2. Samples: 114193260. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:26:08,989][27935] Avg episode reward: [(0, '-55.411')] [2022-07-12 22:26:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 57124864. Throughput: 0: 10482.6. Samples: 114257140. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:26:13,989][27935] Avg episode reward: [(0, '-55.229')] [2022-07-12 22:26:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 57149440. Throughput: 0: 10477.7. Samples: 114319740. Policy #0 lag: (min: 0.0, avg: 9.0, max: 23.0) [2022-07-12 22:26:18,989][27935] Avg episode reward: [(0, '-55.665')] [2022-07-12 22:26:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 57176064. Throughput: 0: 10499.5. Samples: 114352012. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:23,990][27935] Avg episode reward: [(0, '-55.774')] [2022-07-12 22:26:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 57203712. Throughput: 0: 10505.2. Samples: 114415568. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:28,989][27935] Avg episode reward: [(0, '-55.493')] [2022-07-12 22:26:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 57229312. Throughput: 0: 9776.7. Samples: 114446508. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:33,989][27935] Avg episode reward: [(0, '-55.302')] [2022-07-12 22:26:38,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 57254912. Throughput: 0: 10473.4. Samples: 114509856. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:38,989][27935] Avg episode reward: [(0, '-56.069')] [2022-07-12 22:26:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 57283584. Throughput: 0: 10471.0. Samples: 114573308. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:43,989][27935] Avg episode reward: [(0, '-56.742')] [2022-07-12 22:26:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 57308160. Throughput: 0: 10565.6. Samples: 114636924. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:48,989][27935] Avg episode reward: [(0, '-56.437')] [2022-07-12 22:26:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 57334784. Throughput: 0: 10566.5. Samples: 114668752. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:53,989][27935] Avg episode reward: [(0, '-57.005')] [2022-07-12 22:26:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 57361408. Throughput: 0: 10567.2. Samples: 114732664. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:26:58,989][27935] Avg episode reward: [(0, '-56.819')] [2022-07-12 22:27:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 57388032. Throughput: 0: 10499.9. Samples: 114792236. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:03,989][27935] Avg episode reward: [(0, '-57.512')] [2022-07-12 22:27:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 57412608. Throughput: 0: 10489.7. Samples: 114824048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:08,989][27935] Avg episode reward: [(0, '-57.354')] [2022-07-12 22:27:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 57439232. Throughput: 0: 10481.3. Samples: 114887228. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:13,989][27935] Avg episode reward: [(0, '-56.770')] [2022-07-12 22:27:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 57465856. Throughput: 0: 11191.1. Samples: 114950108. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:18,989][27935] Avg episode reward: [(0, '-56.432')] [2022-07-12 22:27:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 57491456. Throughput: 0: 10495.2. Samples: 114982140. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:23,989][27935] Avg episode reward: [(0, '-55.855')] [2022-07-12 22:27:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 57518080. Throughput: 0: 10493.3. Samples: 115045508. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:27:28,989][27935] Avg episode reward: [(0, '-54.907')] [2022-07-12 22:27:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 57544704. Throughput: 0: 10487.6. Samples: 115108868. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:33,989][27935] Avg episode reward: [(0, '-54.801')] [2022-07-12 22:27:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 57571328. Throughput: 0: 10489.9. Samples: 115140800. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:38,989][27935] Avg episode reward: [(0, '-54.758')] [2022-07-12 22:27:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 57597952. Throughput: 0: 10440.8. Samples: 115202500. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:43,989][27935] Avg episode reward: [(0, '-55.032')] [2022-07-12 22:27:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 57622528. Throughput: 0: 10528.0. Samples: 115265996. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:48,990][27935] Avg episode reward: [(0, '-54.606')] [2022-07-12 22:27:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 57651200. Throughput: 0: 10529.5. Samples: 115297876. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:53,989][27935] Avg episode reward: [(0, '-54.793')] [2022-07-12 22:27:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 57675776. Throughput: 0: 10543.5. Samples: 115361684. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:27:58,989][27935] Avg episode reward: [(0, '-55.669')] [2022-07-12 22:28:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 57702400. Throughput: 0: 10473.8. Samples: 115421428. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:03,989][27935] Avg episode reward: [(0, '-55.361')] [2022-07-12 22:28:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 57726976. Throughput: 0: 10473.5. Samples: 115453448. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:08,989][27935] Avg episode reward: [(0, '-55.268')] [2022-07-12 22:28:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 57754624. Throughput: 0: 10473.2. Samples: 115516804. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:13,989][27935] Avg episode reward: [(0, '-56.536')] [2022-07-12 22:28:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 57780224. Throughput: 0: 10470.5. Samples: 115580040. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:18,989][27935] Avg episode reward: [(0, '-56.948')] [2022-07-12 22:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 57806848. Throughput: 0: 10470.0. Samples: 115611948. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:23,989][27935] Avg episode reward: [(0, '-57.808')] [2022-07-12 22:28:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 57833472. Throughput: 0: 10512.7. Samples: 115675572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:28,989][27935] Avg episode reward: [(0, '-57.383')] [2022-07-12 22:28:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 57858048. Throughput: 0: 10471.1. Samples: 115737196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:33,989][27935] Avg episode reward: [(0, '-57.731')] [2022-07-12 22:28:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 57885696. Throughput: 0: 10466.9. Samples: 115768888. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-12 22:28:38,989][27935] Avg episode reward: [(0, '-58.310')] [2022-07-12 22:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 57910272. Throughput: 0: 10444.5. Samples: 115831688. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:28:43,989][27935] Avg episode reward: [(0, '-57.521')] [2022-07-12 22:28:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 57937920. Throughput: 0: 10512.5. Samples: 115894492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:28:48,989][27935] Avg episode reward: [(0, '-56.603')] [2022-07-12 22:28:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 57963520. Throughput: 0: 10497.6. Samples: 115925840. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:28:53,989][27935] Avg episode reward: [(0, '-56.161')] [2022-07-12 22:28:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 57990144. Throughput: 0: 10504.3. Samples: 115989496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:28:58,989][27935] Avg episode reward: [(0, '-56.081')] [2022-07-12 22:29:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 58014720. Throughput: 0: 10409.2. Samples: 116048452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:03,989][27935] Avg episode reward: [(0, '-56.291')] [2022-07-12 22:29:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 58041344. Throughput: 0: 10405.9. Samples: 116080216. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:08,989][27935] Avg episode reward: [(0, '-55.345')] [2022-07-12 22:29:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 58067968. Throughput: 0: 10406.4. Samples: 116143860. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:13,989][27935] Avg episode reward: [(0, '-55.116')] [2022-07-12 22:29:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 58093568. Throughput: 0: 10438.0. Samples: 116206908. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:18,989][27935] Avg episode reward: [(0, '-55.508')] [2022-07-12 22:29:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 58118144. Throughput: 0: 10375.7. Samples: 116235792. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:23,989][27935] Avg episode reward: [(0, '-55.948')] [2022-07-12 22:29:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5238.2). Total num frames: 58144768. Throughput: 0: 10372.2. Samples: 116298436. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:28,989][27935] Avg episode reward: [(0, '-56.023')] [2022-07-12 22:29:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 58170368. Throughput: 0: 10343.8. Samples: 116359964. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:33,989][27935] Avg episode reward: [(0, '-55.417')] [2022-07-12 22:29:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5234.5). Total num frames: 58195968. Throughput: 0: 10326.1. Samples: 116390516. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:38,989][27935] Avg episode reward: [(0, '-55.629')] [2022-07-12 22:29:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5227.7). Total num frames: 58220544. Throughput: 0: 10261.0. Samples: 116451240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:43,989][27935] Avg episode reward: [(0, '-56.411')] [2022-07-12 22:29:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5227.6). Total num frames: 58246144. Throughput: 0: 10293.6. Samples: 116511664. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 22:29:48,989][27935] Avg episode reward: [(0, '-56.282')] [2022-07-12 22:29:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 58273792. Throughput: 0: 10290.7. Samples: 116543296. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:29:53,989][27935] Avg episode reward: [(0, '-55.805')] [2022-07-12 22:29:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5234.5). Total num frames: 58299392. Throughput: 0: 10295.1. Samples: 116607140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:29:58,993][27935] Avg episode reward: [(0, '-55.646')] [2022-07-12 22:30:03,990][27935] Fps is (10 sec: 4914.7, 60 sec: 5137.0, 300 sec: 5220.6). Total num frames: 58322944. Throughput: 0: 10215.1. Samples: 116666600. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:03,990][27935] Avg episode reward: [(0, '-56.105')] [2022-07-12 22:30:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5231.1). Total num frames: 58351616. Throughput: 0: 10287.4. Samples: 116698728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:08,989][27935] Avg episode reward: [(0, '-56.290')] [2022-07-12 22:30:13,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5120.0, 300 sec: 5217.2). Total num frames: 58375168. Throughput: 0: 10284.6. Samples: 116761244. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:13,989][27935] Avg episode reward: [(0, '-55.938')] [2022-07-12 22:30:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5217.2). Total num frames: 58400768. Throughput: 0: 10272.0. Samples: 116822204. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:18,989][27935] Avg episode reward: [(0, '-56.456')] [2022-07-12 22:30:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 58428416. Throughput: 0: 10297.2. Samples: 116853888. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:23,989][27935] Avg episode reward: [(0, '-56.073')] [2022-07-12 22:30:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 58454016. Throughput: 0: 10372.7. Samples: 116918012. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:28,989][27935] Avg episode reward: [(0, '-56.088')] [2022-07-12 22:30:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 58480640. Throughput: 0: 10435.4. Samples: 116981256. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:33,989][27935] Avg episode reward: [(0, '-55.848')] [2022-07-12 22:30:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 58507264. Throughput: 0: 10435.3. Samples: 117012884. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:38,989][27935] Avg episode reward: [(0, '-56.017')] [2022-07-12 22:30:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 58533888. Throughput: 0: 10432.6. Samples: 117076608. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:43,989][27935] Avg episode reward: [(0, '-55.823')] [2022-07-12 22:30:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 58561536. Throughput: 0: 10532.0. Samples: 117140528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:48,989][27935] Avg episode reward: [(0, '-55.407')] [2022-07-12 22:30:53,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 58587136. Throughput: 0: 10526.9. Samples: 117172440. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:53,989][27935] Avg episode reward: [(0, '-55.363')] [2022-07-12 22:30:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 58613760. Throughput: 0: 10543.7. Samples: 117235708. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-12 22:30:58,989][27935] Avg episode reward: [(0, '-55.378')] [2022-07-12 22:31:03,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5256.6, 300 sec: 5224.1). Total num frames: 58638336. Throughput: 0: 10521.7. Samples: 117295680. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:03,989][27935] Avg episode reward: [(0, '-55.704')] [2022-07-12 22:31:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 58664960. Throughput: 0: 10517.9. Samples: 117327192. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:08,989][27935] Avg episode reward: [(0, '-55.271')] [2022-07-12 22:31:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5234.5). Total num frames: 58693632. Throughput: 0: 10497.5. Samples: 117390400. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:13,989][27935] Avg episode reward: [(0, '-55.851')] [2022-07-12 22:31:18,993][27935] Fps is (10 sec: 5117.6, 60 sec: 5256.1, 300 sec: 5220.6). Total num frames: 58716160. Throughput: 0: 10481.3. Samples: 117452964. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:18,994][27935] Avg episode reward: [(0, '-55.442')] [2022-07-12 22:31:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 58742784. Throughput: 0: 10487.8. Samples: 117484836. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:23,989][27935] Avg episode reward: [(0, '-55.815')] [2022-07-12 22:31:28,989][27935] Fps is (10 sec: 5327.3, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 58769408. Throughput: 0: 10494.5. Samples: 117548860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:28,989][27935] Avg episode reward: [(0, '-55.958')] [2022-07-12 22:31:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 58795008. Throughput: 0: 10478.0. Samples: 117612036. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:33,989][27935] Avg episode reward: [(0, '-55.439')] [2022-07-12 22:31:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5220.7). Total num frames: 58823680. Throughput: 0: 10470.0. Samples: 117643588. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:38,989][27935] Avg episode reward: [(0, '-55.173')] [2022-07-12 22:31:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 58848256. Throughput: 0: 10478.3. Samples: 117707232. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:43,989][27935] Avg episode reward: [(0, '-54.725')] [2022-07-12 22:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 58874880. Throughput: 0: 9853.0. Samples: 117739064. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:48,993][27935] Avg episode reward: [(0, '-55.000')] [2022-07-12 22:31:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 58899456. Throughput: 0: 10501.8. Samples: 117799772. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:53,989][27935] Avg episode reward: [(0, '-55.448')] [2022-07-12 22:31:58,989][27935] Fps is (10 sec: 4812.6, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 58923008. Throughput: 0: 10351.4. Samples: 117856216. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:31:58,990][27935] Avg episode reward: [(0, '-54.792')] [2022-07-12 22:32:03,990][27935] Fps is (10 sec: 4198.1, 60 sec: 5051.7, 300 sec: 5182.5). Total num frames: 58941440. Throughput: 0: 9995.2. Samples: 117902708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:32:03,990][27935] Avg episode reward: [(0, '-54.686')] [2022-07-12 22:32:08,989][27935] Fps is (10 sec: 3686.6, 60 sec: 4915.2, 300 sec: 5154.7). Total num frames: 58959872. Throughput: 0: 9763.0. Samples: 117924172. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-12 22:32:08,990][27935] Avg episode reward: [(0, '-54.904')] [2022-07-12 22:32:13,989][27935] Fps is (10 sec: 3993.9, 60 sec: 4795.7, 300 sec: 5137.4). Total num frames: 58981376. Throughput: 0: 9400.2. Samples: 117971872. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:13,989][27935] Avg episode reward: [(0, '-54.830')] [2022-07-12 22:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.4, 300 sec: 5140.8). Total num frames: 59008000. Throughput: 0: 9402.5. Samples: 118035148. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:18,989][27935] Avg episode reward: [(0, '-54.835')] [2022-07-12 22:32:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 4864.0, 300 sec: 5140.8). Total num frames: 59034624. Throughput: 0: 9407.5. Samples: 118066924. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:23,989][27935] Avg episode reward: [(0, '-54.763')] [2022-07-12 22:32:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4846.9, 300 sec: 5137.4). Total num frames: 59060224. Throughput: 0: 9400.6. Samples: 118130260. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:28,989][27935] Avg episode reward: [(0, '-55.399')] [2022-07-12 22:32:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 5133.9). Total num frames: 59085824. Throughput: 0: 10090.4. Samples: 118193132. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:33,989][27935] Avg episode reward: [(0, '-55.568')] [2022-07-12 22:32:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4829.9, 300 sec: 5137.4). Total num frames: 59113472. Throughput: 0: 9436.3. Samples: 118224404. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:38,989][27935] Avg episode reward: [(0, '-54.832')] [2022-07-12 22:32:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 4864.0, 300 sec: 5144.3). Total num frames: 59140096. Throughput: 0: 9586.1. Samples: 118287588. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:43,989][27935] Avg episode reward: [(0, '-55.023')] [2022-07-12 22:32:48,989][27935] Fps is (10 sec: 5119.7, 60 sec: 4829.8, 300 sec: 5130.4). Total num frames: 59164672. Throughput: 0: 9948.3. Samples: 118350380. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:48,990][27935] Avg episode reward: [(0, '-55.485')] [2022-07-12 22:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 5133.9). Total num frames: 59190272. Throughput: 0: 10169.7. Samples: 118381808. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:53,990][27935] Avg episode reward: [(0, '-54.718')] [2022-07-12 22:32:58,989][27935] Fps is (10 sec: 5427.5, 60 sec: 4932.3, 300 sec: 5140.8). Total num frames: 59218944. Throughput: 0: 10506.3. Samples: 118444656. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:32:58,990][27935] Avg episode reward: [(0, '-54.211')] [2022-07-12 22:33:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.7, 300 sec: 5137.4). Total num frames: 59242496. Throughput: 0: 10414.6. Samples: 118503808. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:33:03,989][27935] Avg episode reward: [(0, '-54.502')] [2022-07-12 22:33:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 59268096. Throughput: 0: 10406.6. Samples: 118535220. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:33:08,989][27935] Avg episode reward: [(0, '-54.681')] [2022-07-12 22:33:13,997][27935] Fps is (10 sec: 5116.0, 60 sec: 5204.7, 300 sec: 5130.3). Total num frames: 59293696. Throughput: 0: 10392.7. Samples: 118598016. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:33:13,997][27935] Avg episode reward: [(0, '-54.347')] [2022-07-12 22:33:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5133.9). Total num frames: 59321344. Throughput: 0: 10386.0. Samples: 118660504. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:33:18,989][27935] Avg episode reward: [(0, '-54.949')] [2022-07-12 22:33:23,989][27935] Fps is (10 sec: 5329.0, 60 sec: 5205.3, 300 sec: 5130.4). Total num frames: 59346944. Throughput: 0: 10395.3. Samples: 118692192. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-12 22:33:23,989][27935] Avg episode reward: [(0, '-54.868')] [2022-07-12 22:33:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5133.9). Total num frames: 59372544. Throughput: 0: 10406.7. Samples: 118755888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:28,990][27935] Avg episode reward: [(0, '-54.587')] [2022-07-12 22:33:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5133.9). Total num frames: 59400192. Throughput: 0: 10415.2. Samples: 118819056. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:33,989][27935] Avg episode reward: [(0, '-54.653')] [2022-07-12 22:33:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5137.4). Total num frames: 59425792. Throughput: 0: 10390.0. Samples: 118849360. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:38,989][27935] Avg episode reward: [(0, '-54.931')] [2022-07-12 22:33:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 59451392. Throughput: 0: 10392.7. Samples: 118912328. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:43,989][27935] Avg episode reward: [(0, '-55.236')] [2022-07-12 22:33:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5130.4). Total num frames: 59476992. Throughput: 0: 10489.8. Samples: 118975848. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:48,989][27935] Avg episode reward: [(0, '-54.732')] [2022-07-12 22:33:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5130.4). Total num frames: 59503616. Throughput: 0: 10481.7. Samples: 119006896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:53,989][27935] Avg episode reward: [(0, '-54.266')] [2022-07-12 22:33:58,989][27935] Fps is (10 sec: 5529.7, 60 sec: 5222.4, 300 sec: 5144.3). Total num frames: 59532288. Throughput: 0: 10477.9. Samples: 119069436. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:33:58,989][27935] Avg episode reward: [(0, '-54.600')] [2022-07-12 22:34:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5126.9). Total num frames: 59553792. Throughput: 0: 10377.4. Samples: 119127488. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:03,989][27935] Avg episode reward: [(0, '-54.585')] [2022-07-12 22:34:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5205.3, 300 sec: 5126.9). Total num frames: 59580416. Throughput: 0: 10379.6. Samples: 119159276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:08,989][27935] Avg episode reward: [(0, '-54.006')] [2022-07-12 22:34:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5206.0, 300 sec: 5126.9). Total num frames: 59606016. Throughput: 0: 10358.7. Samples: 119222028. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:13,989][27935] Avg episode reward: [(0, '-54.719')] [2022-07-12 22:34:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5133.9). Total num frames: 59632640. Throughput: 0: 10312.4. Samples: 119283116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:18,989][27935] Avg episode reward: [(0, '-54.785')] [2022-07-12 22:34:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5126.9). Total num frames: 59657216. Throughput: 0: 10318.6. Samples: 119313696. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:23,989][27935] Avg episode reward: [(0, '-55.020')] [2022-07-12 22:34:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 59683840. Throughput: 0: 10310.0. Samples: 119376276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:28,989][27935] Avg episode reward: [(0, '-55.932')] [2022-07-12 22:34:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 59710464. Throughput: 0: 10295.8. Samples: 119439156. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:34:33,989][27935] Avg episode reward: [(0, '-55.624')] [2022-07-12 22:34:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 59736064. Throughput: 0: 10289.9. Samples: 119469940. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:34:38,989][27935] Avg episode reward: [(0, '-55.951')] [2022-07-12 22:34:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 59761664. Throughput: 0: 10310.5. Samples: 119533408. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:34:43,989][27935] Avg episode reward: [(0, '-55.775')] [2022-07-12 22:34:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5133.9). Total num frames: 59788288. Throughput: 0: 10413.2. Samples: 119596084. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:34:48,989][27935] Avg episode reward: [(0, '-56.349')] [2022-07-12 22:34:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 59814912. Throughput: 0: 10401.7. Samples: 119627352. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:34:53,989][27935] Avg episode reward: [(0, '-56.483')] [2022-07-12 22:34:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 59839488. Throughput: 0: 10398.0. Samples: 119689936. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:34:58,989][27935] Avg episode reward: [(0, '-56.794')] [2022-07-12 22:35:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5133.9). Total num frames: 59866112. Throughput: 0: 10370.0. Samples: 119749764. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:03,989][27935] Avg episode reward: [(0, '-56.195')] [2022-07-12 22:35:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5140.8). Total num frames: 59891712. Throughput: 0: 10388.3. Samples: 119781168. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:08,989][27935] Avg episode reward: [(0, '-56.086')] [2022-07-12 22:35:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5147.8). Total num frames: 59919360. Throughput: 0: 10415.6. Samples: 119844980. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:13,990][27935] Avg episode reward: [(0, '-55.673')] [2022-07-12 22:35:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 59943936. Throughput: 0: 10426.1. Samples: 119908332. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:18,989][27935] Avg episode reward: [(0, '-55.369')] [2022-07-12 22:35:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5144.3). Total num frames: 59971584. Throughput: 0: 10439.8. Samples: 119939732. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:23,989][27935] Avg episode reward: [(0, '-54.950')] [2022-07-12 22:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5137.4). Total num frames: 59996160. Throughput: 0: 10449.6. Samples: 120003640. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:28,989][27935] Avg episode reward: [(0, '-54.140')] [2022-07-12 22:35:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5140.8). Total num frames: 60023808. Throughput: 0: 10460.0. Samples: 120066784. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:33,989][27935] Avg episode reward: [(0, '-54.956')] [2022-07-12 22:35:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5140.8). Total num frames: 60050432. Throughput: 0: 10467.9. Samples: 120098408. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:38,989][27935] Avg episode reward: [(0, '-54.852')] [2022-07-12 22:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5133.9). Total num frames: 60076032. Throughput: 0: 10481.7. Samples: 120161612. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:43,989][27935] Avg episode reward: [(0, '-55.174')] [2022-07-12 22:35:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5140.8). Total num frames: 60103680. Throughput: 0: 10554.6. Samples: 120224720. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-12 22:35:48,989][27935] Avg episode reward: [(0, '-55.071')] [2022-07-12 22:35:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5133.9). Total num frames: 60128256. Throughput: 0: 10564.3. Samples: 120256560. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:35:53,989][27935] Avg episode reward: [(0, '-54.769')] [2022-07-12 22:35:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5144.3). Total num frames: 60155904. Throughput: 0: 10544.3. Samples: 120319472. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:35:58,989][27935] Avg episode reward: [(0, '-54.933')] [2022-07-12 22:36:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5137.4). Total num frames: 60180480. Throughput: 0: 10454.3. Samples: 120378776. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:03,991][27935] Avg episode reward: [(0, '-54.114')] [2022-07-12 22:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5126.9). Total num frames: 60206080. Throughput: 0: 10465.2. Samples: 120410668. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:08,990][27935] Avg episode reward: [(0, '-53.913')] [2022-07-12 22:36:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5144.4). Total num frames: 60233728. Throughput: 0: 10465.3. Samples: 120474580. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:13,989][27935] Avg episode reward: [(0, '-53.753')] [2022-07-12 22:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5133.9). Total num frames: 60257280. Throughput: 0: 10402.6. Samples: 120534900. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:18,989][27935] Avg episode reward: [(0, '-53.429')] [2022-07-12 22:36:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 60282880. Throughput: 0: 10370.7. Samples: 120565088. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:23,989][27935] Avg episode reward: [(0, '-54.084')] [2022-07-12 22:36:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5137.4). Total num frames: 60310528. Throughput: 0: 10376.3. Samples: 120628544. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:28,989][27935] Avg episode reward: [(0, '-54.046')] [2022-07-12 22:36:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5123.5). Total num frames: 60335104. Throughput: 0: 10366.0. Samples: 120691188. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:33,989][27935] Avg episode reward: [(0, '-53.911')] [2022-07-12 22:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5133.9). Total num frames: 60362752. Throughput: 0: 10360.4. Samples: 120722780. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:38,989][27935] Avg episode reward: [(0, '-53.942')] [2022-07-12 22:36:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5130.4). Total num frames: 60388352. Throughput: 0: 10362.2. Samples: 120785772. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:43,989][27935] Avg episode reward: [(0, '-54.681')] [2022-07-12 22:36:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 60414976. Throughput: 0: 10447.9. Samples: 120848932. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:48,989][27935] Avg episode reward: [(0, '-54.138')] [2022-07-12 22:36:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5144.3). Total num frames: 60440576. Throughput: 0: 10444.9. Samples: 120880688. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:53,989][27935] Avg episode reward: [(0, '-54.568')] [2022-07-12 22:36:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 60467200. Throughput: 0: 10412.2. Samples: 120943128. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-12 22:36:58,989][27935] Avg episode reward: [(0, '-53.977')] [2022-07-12 22:37:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 60490752. Throughput: 0: 10374.7. Samples: 121001764. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:03,989][27935] Avg episode reward: [(0, '-53.501')] [2022-07-12 22:37:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 60517376. Throughput: 0: 10397.4. Samples: 121032972. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:08,989][27935] Avg episode reward: [(0, '-52.959')] [2022-07-12 22:37:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 60542976. Throughput: 0: 10385.0. Samples: 121095868. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:13,989][27935] Avg episode reward: [(0, '-52.662')] [2022-07-12 22:37:18,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 60569600. Throughput: 0: 10395.3. Samples: 121158980. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:18,990][27935] Avg episode reward: [(0, '-52.514')] [2022-07-12 22:37:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 60597248. Throughput: 0: 10396.8. Samples: 121190636. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:23,989][27935] Avg episode reward: [(0, '-52.860')] [2022-07-12 22:37:28,989][27935] Fps is (10 sec: 5222.6, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 60621824. Throughput: 0: 10378.0. Samples: 121252780. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:28,990][27935] Avg episode reward: [(0, '-53.303')] [2022-07-12 22:37:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 60645376. Throughput: 0: 10273.1. Samples: 121311220. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:33,989][27935] Avg episode reward: [(0, '-53.394')] [2022-07-12 22:37:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 60670976. Throughput: 0: 10250.1. Samples: 121341944. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:38,989][27935] Avg episode reward: [(0, '-54.090')] [2022-07-12 22:37:43,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5153.8, 300 sec: 5196.3). Total num frames: 60697600. Throughput: 0: 10205.8. Samples: 121402428. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:43,993][27935] Avg episode reward: [(0, '-53.946')] [2022-07-12 22:37:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5192.9). Total num frames: 60722176. Throughput: 0: 10265.5. Samples: 121463712. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:48,989][27935] Avg episode reward: [(0, '-53.952')] [2022-07-12 22:37:53,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 60747776. Throughput: 0: 10266.3. Samples: 121494956. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:53,989][27935] Avg episode reward: [(0, '-54.376')] [2022-07-12 22:37:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5186.0). Total num frames: 60772352. Throughput: 0: 10177.1. Samples: 121553836. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:37:58,989][27935] Avg episode reward: [(0, '-54.422')] [2022-07-12 22:38:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5182.5). Total num frames: 60796928. Throughput: 0: 10043.7. Samples: 121610944. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:38:03,989][27935] Avg episode reward: [(0, '-54.566')] [2022-07-12 22:38:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5179.1). Total num frames: 60821504. Throughput: 0: 10031.5. Samples: 121642052. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:38:08,989][27935] Avg episode reward: [(0, '-54.867')] [2022-07-12 22:38:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 60849152. Throughput: 0: 10076.8. Samples: 121706236. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 22:38:13,989][27935] Avg episode reward: [(0, '-54.853')] [2022-07-12 22:38:18,991][27935] Fps is (10 sec: 5425.9, 60 sec: 5102.8, 300 sec: 5182.4). Total num frames: 60875776. Throughput: 0: 10177.9. Samples: 121769248. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:18,992][27935] Avg episode reward: [(0, '-54.820')] [2022-07-12 22:38:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5179.0). Total num frames: 60900352. Throughput: 0: 10205.4. Samples: 121801188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:23,989][27935] Avg episode reward: [(0, '-55.384')] [2022-07-12 22:38:28,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 60928000. Throughput: 0: 10261.4. Samples: 121864156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:28,989][27935] Avg episode reward: [(0, '-54.599')] [2022-07-12 22:38:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 60953600. Throughput: 0: 10286.9. Samples: 121926624. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:33,989][27935] Avg episode reward: [(0, '-54.316')] [2022-07-12 22:38:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 60981248. Throughput: 0: 10290.5. Samples: 121958028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:38,989][27935] Avg episode reward: [(0, '-54.634')] [2022-07-12 22:38:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.3, 300 sec: 5179.0). Total num frames: 61004800. Throughput: 0: 10400.4. Samples: 122021852. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:43,989][27935] Avg episode reward: [(0, '-54.325')] [2022-07-12 22:38:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 61033472. Throughput: 0: 10536.5. Samples: 122085088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:48,989][27935] Avg episode reward: [(0, '-53.388')] [2022-07-12 22:38:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 61060096. Throughput: 0: 10552.2. Samples: 122116900. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:53,989][27935] Avg episode reward: [(0, '-53.178')] [2022-07-12 22:38:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 61085696. Throughput: 0: 10529.6. Samples: 122180068. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:38:58,989][27935] Avg episode reward: [(0, '-52.614')] [2022-07-12 22:39:03,993][27935] Fps is (10 sec: 4708.4, 60 sec: 5170.8, 300 sec: 5175.5). Total num frames: 61107200. Throughput: 0: 10363.3. Samples: 122235616. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:03,994][27935] Avg episode reward: [(0, '-52.958')] [2022-07-12 22:39:08,992][27935] Fps is (10 sec: 4708.8, 60 sec: 5188.0, 300 sec: 5175.5). Total num frames: 61132800. Throughput: 0: 10300.6. Samples: 122264752. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:08,993][27935] Avg episode reward: [(0, '-53.028')] [2022-07-12 22:39:13,989][27935] Fps is (10 sec: 5327.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 61160448. Throughput: 0: 10307.9. Samples: 122328012. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:13,989][27935] Avg episode reward: [(0, '-53.596')] [2022-07-12 22:39:18,989][27935] Fps is (10 sec: 5326.6, 60 sec: 5171.4, 300 sec: 5182.5). Total num frames: 61186048. Throughput: 0: 10309.8. Samples: 122390564. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:18,989][27935] Avg episode reward: [(0, '-53.731')] [2022-07-12 22:39:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 61211648. Throughput: 0: 10323.5. Samples: 122422584. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:23,990][27935] Avg episode reward: [(0, '-54.229')] [2022-07-12 22:39:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 61238272. Throughput: 0: 10298.4. Samples: 122485280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 22:39:28,991][27935] Avg episode reward: [(0, '-54.590')] [2022-07-12 22:39:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 61264896. Throughput: 0: 10299.9. Samples: 122548584. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:33,990][27935] Avg episode reward: [(0, '-53.937')] [2022-07-12 22:39:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 61290496. Throughput: 0: 10287.7. Samples: 122579848. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:38,989][27935] Avg episode reward: [(0, '-53.762')] [2022-07-12 22:39:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 61318144. Throughput: 0: 10291.5. Samples: 122643184. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:43,989][27935] Avg episode reward: [(0, '-53.324')] [2022-07-12 22:39:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 61343744. Throughput: 0: 10472.0. Samples: 122706812. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:48,989][27935] Avg episode reward: [(0, '-53.605')] [2022-07-12 22:39:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 61370368. Throughput: 0: 10531.6. Samples: 122738636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:53,989][27935] Avg episode reward: [(0, '-52.891')] [2022-07-12 22:39:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 61395968. Throughput: 0: 10536.9. Samples: 122802172. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:39:58,989][27935] Avg episode reward: [(0, '-52.325')] [2022-07-12 22:40:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.8, 300 sec: 5182.5). Total num frames: 61420544. Throughput: 0: 10440.6. Samples: 122860392. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:03,989][27935] Avg episode reward: [(0, '-53.138')] [2022-07-12 22:40:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.8, 300 sec: 5179.0). Total num frames: 61447168. Throughput: 0: 10433.3. Samples: 122892080. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:08,989][27935] Avg episode reward: [(0, '-52.446')] [2022-07-12 22:40:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 61472768. Throughput: 0: 10447.1. Samples: 122955400. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:13,989][27935] Avg episode reward: [(0, '-52.521')] [2022-07-12 22:40:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5186.0). Total num frames: 61501440. Throughput: 0: 10445.3. Samples: 123018624. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:18,989][27935] Avg episode reward: [(0, '-52.842')] [2022-07-12 22:40:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 61524992. Throughput: 0: 10455.6. Samples: 123050352. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:23,989][27935] Avg episode reward: [(0, '-53.393')] [2022-07-12 22:40:28,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5256.5, 300 sec: 5185.9). Total num frames: 61553664. Throughput: 0: 10458.3. Samples: 123113808. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:28,989][27935] Avg episode reward: [(0, '-54.940')] [2022-07-12 22:40:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 61578240. Throughput: 0: 10417.0. Samples: 123175576. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:33,989][27935] Avg episode reward: [(0, '-55.122')] [2022-07-12 22:40:38,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 61604864. Throughput: 0: 10420.3. Samples: 123207548. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:38,989][27935] Avg episode reward: [(0, '-55.313')] [2022-07-12 22:40:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 61631488. Throughput: 0: 10411.1. Samples: 123270672. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-12 22:40:43,995][27935] Avg episode reward: [(0, '-55.286')] [2022-07-12 22:40:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 61657088. Throughput: 0: 10535.6. Samples: 123334492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:40:48,989][27935] Avg episode reward: [(0, '-55.374')] [2022-07-12 22:40:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 61684736. Throughput: 0: 10547.0. Samples: 123366696. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:40:53,989][27935] Avg episode reward: [(0, '-54.757')] [2022-07-12 22:40:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 61710336. Throughput: 0: 10547.9. Samples: 123430056. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:40:58,989][27935] Avg episode reward: [(0, '-54.240')] [2022-07-12 22:41:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 61734912. Throughput: 0: 10466.0. Samples: 123489592. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:03,989][27935] Avg episode reward: [(0, '-52.703')] [2022-07-12 22:41:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 61762560. Throughput: 0: 10468.2. Samples: 123521420. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:08,989][27935] Avg episode reward: [(0, '-52.924')] [2022-07-12 22:41:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 61787136. Throughput: 0: 10470.0. Samples: 123584956. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:13,989][27935] Avg episode reward: [(0, '-53.053')] [2022-07-12 22:41:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 61813760. Throughput: 0: 10495.1. Samples: 123647856. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:18,989][27935] Avg episode reward: [(0, '-52.873')] [2022-07-12 22:41:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5186.0). Total num frames: 61840384. Throughput: 0: 10488.8. Samples: 123679544. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:23,989][27935] Avg episode reward: [(0, '-52.879')] [2022-07-12 22:41:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 61867008. Throughput: 0: 10502.2. Samples: 123743272. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:28,989][27935] Avg episode reward: [(0, '-53.301')] [2022-07-12 22:41:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5189.4). Total num frames: 61893632. Throughput: 0: 10482.5. Samples: 123806204. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:33,989][27935] Avg episode reward: [(0, '-54.068')] [2022-07-12 22:41:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5192.9). Total num frames: 61920256. Throughput: 0: 10482.1. Samples: 123838388. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:38,989][27935] Avg episode reward: [(0, '-53.042')] [2022-07-12 22:41:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 61945856. Throughput: 0: 10494.5. Samples: 123902308. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:43,989][27935] Avg episode reward: [(0, '-53.360')] [2022-07-12 22:41:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5192.9). Total num frames: 61972480. Throughput: 0: 10572.2. Samples: 123965340. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:48,989][27935] Avg episode reward: [(0, '-53.602')] [2022-07-12 22:41:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5196.4). Total num frames: 62000128. Throughput: 0: 10579.0. Samples: 123997476. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:53,989][27935] Avg episode reward: [(0, '-54.373')] [2022-07-12 22:41:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5203.3). Total num frames: 62025728. Throughput: 0: 10589.0. Samples: 124061460. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-12 22:41:58,989][27935] Avg episode reward: [(0, '-54.685')] [2022-07-12 22:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5199.8). Total num frames: 62051328. Throughput: 0: 10499.0. Samples: 124120312. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:03,989][27935] Avg episode reward: [(0, '-54.732')] [2022-07-12 22:42:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 62075904. Throughput: 0: 10498.7. Samples: 124151984. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:08,989][27935] Avg episode reward: [(0, '-54.347')] [2022-07-12 22:42:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 62101504. Throughput: 0: 10411.4. Samples: 124211784. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:13,991][27935] Avg episode reward: [(0, '-54.105')] [2022-07-12 22:42:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 62127104. Throughput: 0: 10416.5. Samples: 124274948. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:19,000][27935] Avg episode reward: [(0, '-54.688')] [2022-07-12 22:42:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 62152704. Throughput: 0: 10349.1. Samples: 124304096. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:23,989][27935] Avg episode reward: [(0, '-54.741')] [2022-07-12 22:42:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 62177280. Throughput: 0: 10302.7. Samples: 124365928. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:28,989][27935] Avg episode reward: [(0, '-54.742')] [2022-07-12 22:42:33,990][27935] Fps is (10 sec: 5017.1, 60 sec: 5154.0, 300 sec: 5192.9). Total num frames: 62202880. Throughput: 0: 10221.2. Samples: 124425304. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:33,990][27935] Avg episode reward: [(0, '-54.061')] [2022-07-12 22:42:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5186.0). Total num frames: 62227456. Throughput: 0: 10181.3. Samples: 124455636. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:38,989][27935] Avg episode reward: [(0, '-54.154')] [2022-07-12 22:42:43,989][27935] Fps is (10 sec: 5018.1, 60 sec: 5120.0, 300 sec: 5189.4). Total num frames: 62253056. Throughput: 0: 10082.1. Samples: 124515156. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:43,989][27935] Avg episode reward: [(0, '-53.692')] [2022-07-12 22:42:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5192.9). Total num frames: 62279680. Throughput: 0: 10186.0. Samples: 124578680. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:48,989][27935] Avg episode reward: [(0, '-53.850')] [2022-07-12 22:42:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5199.8). Total num frames: 62306304. Throughput: 0: 10195.9. Samples: 124610800. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:53,989][27935] Avg episode reward: [(0, '-53.522')] [2022-07-12 22:42:58,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5120.0, 300 sec: 5206.8). Total num frames: 62332928. Throughput: 0: 10283.8. Samples: 124674556. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:42:58,990][27935] Avg episode reward: [(0, '-53.300')] [2022-07-12 22:43:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5206.8). Total num frames: 62357504. Throughput: 0: 10191.8. Samples: 124733580. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:43:03,989][27935] Avg episode reward: [(0, '-53.275')] [2022-07-12 22:43:08,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5120.0, 300 sec: 5199.8). Total num frames: 62383104. Throughput: 0: 10244.1. Samples: 124765080. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:43:08,992][27935] Avg episode reward: [(0, '-52.926')] [2022-07-12 22:43:13,991][27935] Fps is (10 sec: 5118.7, 60 sec: 5119.8, 300 sec: 5196.4). Total num frames: 62408704. Throughput: 0: 10295.1. Samples: 124829232. Policy #0 lag: (min: 0.0, avg: 10.5, max: 21.0) [2022-07-12 22:43:13,996][27935] Avg episode reward: [(0, '-52.981')] [2022-07-12 22:43:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 62437376. Throughput: 0: 10390.9. Samples: 124892884. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:18,989][27935] Avg episode reward: [(0, '-53.831')] [2022-07-12 22:43:23,989][27935] Fps is (10 sec: 5531.0, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 62464000. Throughput: 0: 10426.8. Samples: 124924840. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:23,992][27935] Avg episode reward: [(0, '-53.814')] [2022-07-12 22:43:28,993][27935] Fps is (10 sec: 5220.0, 60 sec: 5204.9, 300 sec: 5206.7). Total num frames: 62489600. Throughput: 0: 10498.4. Samples: 124987632. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:28,994][27935] Avg episode reward: [(0, '-54.211')] [2022-07-12 22:43:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5199.8). Total num frames: 62515200. Throughput: 0: 10482.2. Samples: 125050380. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:33,989][27935] Avg episode reward: [(0, '-54.162')] [2022-07-12 22:43:39,000][27935] Fps is (10 sec: 5321.2, 60 sec: 5255.5, 300 sec: 5213.5). Total num frames: 62542848. Throughput: 0: 10478.3. Samples: 125082444. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:39,001][27935] Avg episode reward: [(0, '-54.602')] [2022-07-12 22:43:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5206.8). Total num frames: 62569472. Throughput: 0: 10488.0. Samples: 125146516. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:43,992][27935] Avg episode reward: [(0, '-54.272')] [2022-07-12 22:43:48,989][27935] Fps is (10 sec: 5023.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 62593024. Throughput: 0: 10582.0. Samples: 125209772. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:48,989][27935] Avg episode reward: [(0, '-53.568')] [2022-07-12 22:43:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5210.3). Total num frames: 62622720. Throughput: 0: 10592.0. Samples: 125241720. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:53,989][27935] Avg episode reward: [(0, '-53.854')] [2022-07-12 22:43:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5256.5, 300 sec: 5224.2). Total num frames: 62648320. Throughput: 0: 10593.1. Samples: 125305896. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:43:58,989][27935] Avg episode reward: [(0, '-54.181')] [2022-07-12 22:44:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 62672896. Throughput: 0: 10509.2. Samples: 125365796. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:03,989][27935] Avg episode reward: [(0, '-54.229')] [2022-07-12 22:44:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 62699520. Throughput: 0: 10504.6. Samples: 125397548. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:08,989][27935] Avg episode reward: [(0, '-54.234')] [2022-07-12 22:44:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.9, 300 sec: 5220.7). Total num frames: 62726144. Throughput: 0: 10517.2. Samples: 125460856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:13,990][27935] Avg episode reward: [(0, '-54.134')] [2022-07-12 22:44:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 62752768. Throughput: 0: 10520.7. Samples: 125523812. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:18,989][27935] Avg episode reward: [(0, '-55.185')] [2022-07-12 22:44:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 62776320. Throughput: 0: 10512.6. Samples: 125555392. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:23,989][27935] Avg episode reward: [(0, '-55.261')] [2022-07-12 22:44:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5274.0, 300 sec: 5224.1). Total num frames: 62806016. Throughput: 0: 10490.8. Samples: 125618604. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-12 22:44:28,989][27935] Avg episode reward: [(0, '-54.683')] [2022-07-12 22:44:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 62830592. Throughput: 0: 10469.6. Samples: 125680904. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:33,989][27935] Avg episode reward: [(0, '-53.982')] [2022-07-12 22:44:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5223.4, 300 sec: 5213.7). Total num frames: 62856192. Throughput: 0: 10467.6. Samples: 125712760. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:38,989][27935] Avg episode reward: [(0, '-53.672')] [2022-07-12 22:44:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 62882816. Throughput: 0: 10429.3. Samples: 125775216. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:43,989][27935] Avg episode reward: [(0, '-53.715')] [2022-07-12 22:44:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5220.7). Total num frames: 62910464. Throughput: 0: 10518.2. Samples: 125839116. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:48,989][27935] Avg episode reward: [(0, '-52.305')] [2022-07-12 22:44:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 62937088. Throughput: 0: 10507.0. Samples: 125870364. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:53,989][27935] Avg episode reward: [(0, '-51.937')] [2022-07-12 22:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 62962688. Throughput: 0: 10490.0. Samples: 125932904. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:44:58,989][27935] Avg episode reward: [(0, '-52.574')] [2022-07-12 22:45:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 62986240. Throughput: 0: 10400.8. Samples: 125991848. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:03,989][27935] Avg episode reward: [(0, '-53.062')] [2022-07-12 22:45:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 63012864. Throughput: 0: 10396.9. Samples: 126023252. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:08,989][27935] Avg episode reward: [(0, '-53.797')] [2022-07-12 22:45:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 63039488. Throughput: 0: 10409.8. Samples: 126087044. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:13,989][27935] Avg episode reward: [(0, '-53.908')] [2022-07-12 22:45:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 63065088. Throughput: 0: 10429.7. Samples: 126150240. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:18,989][27935] Avg episode reward: [(0, '-54.037')] [2022-07-12 22:45:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 63090688. Throughput: 0: 10418.4. Samples: 126181588. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:23,989][27935] Avg episode reward: [(0, '-55.134')] [2022-07-12 22:45:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 63119360. Throughput: 0: 10450.8. Samples: 126245504. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:28,989][27935] Avg episode reward: [(0, '-54.347')] [2022-07-12 22:45:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 63143936. Throughput: 0: 10428.5. Samples: 126308400. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:33,989][27935] Avg episode reward: [(0, '-54.238')] [2022-07-12 22:45:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 63171584. Throughput: 0: 10433.9. Samples: 126339888. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:38,989][27935] Avg episode reward: [(0, '-53.726')] [2022-07-12 22:45:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 63197184. Throughput: 0: 10464.9. Samples: 126403824. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-12 22:45:43,989][27935] Avg episode reward: [(0, '-53.810')] [2022-07-12 22:45:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 63223808. Throughput: 0: 10553.0. Samples: 126466732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:45:48,989][27935] Avg episode reward: [(0, '-54.171')] [2022-07-12 22:45:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 63250432. Throughput: 0: 10561.8. Samples: 126498532. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:45:53,989][27935] Avg episode reward: [(0, '-53.730')] [2022-07-12 22:45:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 63277056. Throughput: 0: 10562.7. Samples: 126562364. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:45:58,989][27935] Avg episode reward: [(0, '-53.755')] [2022-07-12 22:46:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 63300608. Throughput: 0: 10476.6. Samples: 126621688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:03,989][27935] Avg episode reward: [(0, '-53.905')] [2022-07-12 22:46:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 63328256. Throughput: 0: 10479.9. Samples: 126653184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:08,989][27935] Avg episode reward: [(0, '-53.681')] [2022-07-12 22:46:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 63352832. Throughput: 0: 10463.9. Samples: 126716380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:13,989][27935] Avg episode reward: [(0, '-53.570')] [2022-07-12 22:46:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 63380480. Throughput: 0: 10475.0. Samples: 126779776. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:18,989][27935] Avg episode reward: [(0, '-53.365')] [2022-07-12 22:46:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5220.7). Total num frames: 63407104. Throughput: 0: 10489.7. Samples: 126811924. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:23,989][27935] Avg episode reward: [(0, '-53.607')] [2022-07-12 22:46:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 63433728. Throughput: 0: 10488.1. Samples: 126875788. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:28,989][27935] Avg episode reward: [(0, '-53.755')] [2022-07-12 22:46:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 63459328. Throughput: 0: 10477.8. Samples: 126938232. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:33,990][27935] Avg episode reward: [(0, '-54.421')] [2022-07-12 22:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 63485952. Throughput: 0: 10460.4. Samples: 126969252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:38,989][27935] Avg episode reward: [(0, '-54.438')] [2022-07-12 22:46:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 63511552. Throughput: 0: 10448.5. Samples: 127032544. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:43,989][27935] Avg episode reward: [(0, '-53.983')] [2022-07-12 22:46:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 63537152. Throughput: 0: 10502.1. Samples: 127094280. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:48,989][27935] Avg episode reward: [(0, '-53.918')] [2022-07-12 22:46:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 63563776. Throughput: 0: 10502.6. Samples: 127125800. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:53,989][27935] Avg episode reward: [(0, '-54.152')] [2022-07-12 22:46:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 63590400. Throughput: 0: 10490.4. Samples: 127188448. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:46:58,989][27935] Avg episode reward: [(0, '-53.241')] [2022-07-12 22:47:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 63613952. Throughput: 0: 10396.4. Samples: 127247616. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:47:03,989][27935] Avg episode reward: [(0, '-53.350')] [2022-07-12 22:47:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 63640576. Throughput: 0: 10386.1. Samples: 127279300. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:08,989][27935] Avg episode reward: [(0, '-53.736')] [2022-07-12 22:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 63666176. Throughput: 0: 10384.5. Samples: 127343092. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:13,992][27935] Avg episode reward: [(0, '-54.189')] [2022-07-12 22:47:18,991][27935] Fps is (10 sec: 5323.7, 60 sec: 5222.2, 300 sec: 5224.1). Total num frames: 63693824. Throughput: 0: 10406.4. Samples: 127406544. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:18,991][27935] Avg episode reward: [(0, '-55.050')] [2022-07-12 22:47:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 63720448. Throughput: 0: 10429.7. Samples: 127438588. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:23,989][27935] Avg episode reward: [(0, '-55.165')] [2022-07-12 22:47:28,989][27935] Fps is (10 sec: 5325.9, 60 sec: 5222.4, 300 sec: 5234.6). Total num frames: 63747072. Throughput: 0: 10438.1. Samples: 127502260. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:28,989][27935] Avg episode reward: [(0, '-55.385')] [2022-07-12 22:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 63772672. Throughput: 0: 10465.9. Samples: 127565248. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:33,989][27935] Avg episode reward: [(0, '-55.216')] [2022-07-12 22:47:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 63799296. Throughput: 0: 10464.1. Samples: 127596684. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:38,990][27935] Avg episode reward: [(0, '-54.131')] [2022-07-12 22:47:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 63823872. Throughput: 0: 10453.8. Samples: 127658868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:43,989][27935] Avg episode reward: [(0, '-52.895')] [2022-07-12 22:47:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 63852544. Throughput: 0: 10550.7. Samples: 127722400. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:48,990][27935] Avg episode reward: [(0, '-52.499')] [2022-07-12 22:47:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 63878144. Throughput: 0: 10556.4. Samples: 127754336. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:53,989][27935] Avg episode reward: [(0, '-52.077')] [2022-07-12 22:47:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 63903744. Throughput: 0: 10563.0. Samples: 127818428. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:47:58,989][27935] Avg episode reward: [(0, '-52.097')] [2022-07-12 22:48:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 63930368. Throughput: 0: 10483.0. Samples: 127878256. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:48:03,990][27935] Avg episode reward: [(0, '-52.103')] [2022-07-12 22:48:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 63954944. Throughput: 0: 10482.9. Samples: 127910320. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:48:08,989][27935] Avg episode reward: [(0, '-53.533')] [2022-07-12 22:48:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 63982592. Throughput: 0: 10480.7. Samples: 127973892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:48:13,989][27935] Avg episode reward: [(0, '-54.105')] [2022-07-12 22:48:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.7, 300 sec: 5238.0). Total num frames: 64009216. Throughput: 0: 10490.1. Samples: 128037300. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-12 22:48:18,989][27935] Avg episode reward: [(0, '-53.809')] [2022-07-12 22:48:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.1). Total num frames: 64034816. Throughput: 0: 10500.6. Samples: 128069212. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:23,989][27935] Avg episode reward: [(0, '-53.872')] [2022-07-12 22:48:28,989][27935] Fps is (10 sec: 5017.3, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 64059392. Throughput: 0: 10458.2. Samples: 128129492. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:28,990][27935] Avg episode reward: [(0, '-53.371')] [2022-07-12 22:48:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.8). Total num frames: 64087040. Throughput: 0: 10441.9. Samples: 128192284. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:33,989][27935] Avg episode reward: [(0, '-53.473')] [2022-07-12 22:48:38,989][27935] Fps is (10 sec: 5427.5, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 64113664. Throughput: 0: 10437.2. Samples: 128224008. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:38,989][27935] Avg episode reward: [(0, '-53.478')] [2022-07-12 22:48:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 64140288. Throughput: 0: 10422.7. Samples: 128287448. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:43,990][27935] Avg episode reward: [(0, '-53.430')] [2022-07-12 22:48:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 64164864. Throughput: 0: 10498.8. Samples: 128350700. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:48,989][27935] Avg episode reward: [(0, '-53.917')] [2022-07-12 22:48:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 64192512. Throughput: 0: 10500.6. Samples: 128382848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:53,989][27935] Avg episode reward: [(0, '-53.787')] [2022-07-12 22:48:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 64219136. Throughput: 0: 10500.8. Samples: 128446428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:48:58,989][27935] Avg episode reward: [(0, '-54.293')] [2022-07-12 22:49:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 64242688. Throughput: 0: 10424.6. Samples: 128506408. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:03,989][27935] Avg episode reward: [(0, '-54.790')] [2022-07-12 22:49:09,013][27935] Fps is (10 sec: 5107.8, 60 sec: 5254.4, 300 sec: 5234.1). Total num frames: 64270336. Throughput: 0: 10417.2. Samples: 128538236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:09,013][27935] Avg episode reward: [(0, '-54.320')] [2022-07-12 22:49:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 64296960. Throughput: 0: 10488.2. Samples: 128601456. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:13,989][27935] Avg episode reward: [(0, '-53.997')] [2022-07-12 22:49:18,989][27935] Fps is (10 sec: 5234.9, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 64322560. Throughput: 0: 10501.1. Samples: 128664836. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:18,989][27935] Avg episode reward: [(0, '-54.273')] [2022-07-12 22:49:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 64349184. Throughput: 0: 10512.4. Samples: 128697064. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:23,989][27935] Avg episode reward: [(0, '-54.464')] [2022-07-12 22:49:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.7, 300 sec: 5238.0). Total num frames: 64375808. Throughput: 0: 10518.0. Samples: 128760760. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:28,989][27935] Avg episode reward: [(0, '-54.306')] [2022-07-12 22:49:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 64403456. Throughput: 0: 10505.8. Samples: 128823460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-12 22:49:33,989][27935] Avg episode reward: [(0, '-52.962')] [2022-07-12 22:49:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 64428032. Throughput: 0: 10499.9. Samples: 128855344. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:49:38,989][27935] Avg episode reward: [(0, '-52.987')] [2022-07-12 22:49:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 64455680. Throughput: 0: 10502.9. Samples: 128919060. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:49:43,998][27935] Avg episode reward: [(0, '-52.975')] [2022-07-12 22:49:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 64482304. Throughput: 0: 10574.4. Samples: 128982256. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:49:48,989][27935] Avg episode reward: [(0, '-53.385')] [2022-07-12 22:49:53,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5256.2, 300 sec: 5238.0). Total num frames: 64507904. Throughput: 0: 10581.9. Samples: 129014208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:49:53,993][27935] Avg episode reward: [(0, '-53.138')] [2022-07-12 22:49:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 64535552. Throughput: 0: 10601.4. Samples: 129078516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:49:58,990][27935] Avg episode reward: [(0, '-52.752')] [2022-07-12 22:50:03,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 64559104. Throughput: 0: 10523.1. Samples: 129138376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:03,989][27935] Avg episode reward: [(0, '-52.289')] [2022-07-12 22:50:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5275.7, 300 sec: 5245.0). Total num frames: 64586752. Throughput: 0: 10518.3. Samples: 129170388. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:08,989][27935] Avg episode reward: [(0, '-53.555')] [2022-07-12 22:50:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 64612352. Throughput: 0: 10517.2. Samples: 129234036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:13,989][27935] Avg episode reward: [(0, '-53.807')] [2022-07-12 22:50:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 64638976. Throughput: 0: 10530.5. Samples: 129297332. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:18,989][27935] Avg episode reward: [(0, '-53.380')] [2022-07-12 22:50:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 64665600. Throughput: 0: 10531.5. Samples: 129329260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:23,989][27935] Avg episode reward: [(0, '-53.793')] [2022-07-12 22:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 64691200. Throughput: 0: 10520.8. Samples: 129392496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:28,989][27935] Avg episode reward: [(0, '-53.504')] [2022-07-12 22:50:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 64717824. Throughput: 0: 10515.2. Samples: 129455440. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:33,990][27935] Avg episode reward: [(0, '-53.701')] [2022-07-12 22:50:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 64744448. Throughput: 0: 10505.4. Samples: 129486912. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:38,989][27935] Avg episode reward: [(0, '-53.914')] [2022-07-12 22:50:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 64770048. Throughput: 0: 10477.4. Samples: 129550000. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:43,989][27935] Avg episode reward: [(0, '-53.440')] [2022-07-12 22:50:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 64797696. Throughput: 0: 10563.6. Samples: 129613740. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:48,989][27935] Avg episode reward: [(0, '-53.556')] [2022-07-12 22:50:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.8, 300 sec: 5241.5). Total num frames: 64823296. Throughput: 0: 10549.4. Samples: 129645112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-12 22:50:53,989][27935] Avg episode reward: [(0, '-53.458')] [2022-07-12 22:50:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 64849920. Throughput: 0: 10532.7. Samples: 129708008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:50:58,989][27935] Avg episode reward: [(0, '-53.633')] [2022-07-12 22:51:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 64873472. Throughput: 0: 10441.9. Samples: 129767216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:03,989][27935] Avg episode reward: [(0, '-53.276')] [2022-07-12 22:51:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 64900096. Throughput: 0: 10425.8. Samples: 129798420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:08,989][27935] Avg episode reward: [(0, '-52.532')] [2022-07-12 22:51:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 64926720. Throughput: 0: 10427.5. Samples: 129861736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:13,989][27935] Avg episode reward: [(0, '-52.016')] [2022-07-12 22:51:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 64952320. Throughput: 0: 10417.0. Samples: 129924204. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:18,989][27935] Avg episode reward: [(0, '-51.954')] [2022-07-12 22:51:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 64978944. Throughput: 0: 10431.6. Samples: 129956336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:23,989][27935] Avg episode reward: [(0, '-52.449')] [2022-07-12 22:51:28,991][27935] Fps is (10 sec: 5221.1, 60 sec: 5222.2, 300 sec: 5238.0). Total num frames: 65004544. Throughput: 0: 10435.8. Samples: 130019636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:28,992][27935] Avg episode reward: [(0, '-52.463')] [2022-07-12 22:51:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 65031168. Throughput: 0: 10413.8. Samples: 130082360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:33,989][27935] Avg episode reward: [(0, '-52.239')] [2022-07-12 22:51:38,989][27935] Fps is (10 sec: 5326.1, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 65057792. Throughput: 0: 10415.7. Samples: 130113820. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:38,989][27935] Avg episode reward: [(0, '-52.160')] [2022-07-12 22:51:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 65083392. Throughput: 0: 10428.2. Samples: 130177276. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:43,989][27935] Avg episode reward: [(0, '-52.625')] [2022-07-12 22:51:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 65111040. Throughput: 0: 10518.0. Samples: 130240528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:48,989][27935] Avg episode reward: [(0, '-52.310')] [2022-07-12 22:51:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 65137664. Throughput: 0: 10529.1. Samples: 130272228. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:53,989][27935] Avg episode reward: [(0, '-52.806')] [2022-07-12 22:51:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 65163264. Throughput: 0: 10527.7. Samples: 130335480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:51:58,989][27935] Avg episode reward: [(0, '-53.032')] [2022-07-12 22:52:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 65187840. Throughput: 0: 10458.7. Samples: 130394844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:52:03,989][27935] Avg episode reward: [(0, '-53.425')] [2022-07-12 22:52:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 65213440. Throughput: 0: 10444.1. Samples: 130426320. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:52:08,989][27935] Avg episode reward: [(0, '-54.529')] [2022-07-12 22:52:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 65240064. Throughput: 0: 10432.8. Samples: 130489088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-12 22:52:13,989][27935] Avg episode reward: [(0, '-54.885')] [2022-07-12 22:52:18,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 65265664. Throughput: 0: 10436.3. Samples: 130551996. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:18,990][27935] Avg episode reward: [(0, '-54.705')] [2022-07-12 22:52:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 65292288. Throughput: 0: 10435.6. Samples: 130583420. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:23,989][27935] Avg episode reward: [(0, '-54.480')] [2022-07-12 22:52:28,989][27935] Fps is (10 sec: 5325.0, 60 sec: 5239.7, 300 sec: 5241.5). Total num frames: 65318912. Throughput: 0: 10429.8. Samples: 130646616. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:28,990][27935] Avg episode reward: [(0, '-53.904')] [2022-07-12 22:52:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 65345536. Throughput: 0: 10420.9. Samples: 130709468. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:33,989][27935] Avg episode reward: [(0, '-53.541')] [2022-07-12 22:52:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 65370112. Throughput: 0: 10419.9. Samples: 130741124. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:38,989][27935] Avg episode reward: [(0, '-53.160')] [2022-07-12 22:52:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 65396736. Throughput: 0: 10397.1. Samples: 130803348. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:43,989][27935] Avg episode reward: [(0, '-53.090')] [2022-07-12 22:52:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 65423360. Throughput: 0: 10477.9. Samples: 130866348. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:48,989][27935] Avg episode reward: [(0, '-53.864')] [2022-07-12 22:52:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 65449984. Throughput: 0: 10478.0. Samples: 130897832. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:53,989][27935] Avg episode reward: [(0, '-54.292')] [2022-07-12 22:52:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 65476608. Throughput: 0: 10482.2. Samples: 130960788. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:52:58,989][27935] Avg episode reward: [(0, '-54.594')] [2022-07-12 22:53:03,991][27935] Fps is (10 sec: 4914.0, 60 sec: 5188.1, 300 sec: 5234.5). Total num frames: 65499136. Throughput: 0: 10392.9. Samples: 131019700. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:03,992][27935] Avg episode reward: [(0, '-54.304')] [2022-07-12 22:53:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 65526784. Throughput: 0: 10394.4. Samples: 131051168. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:08,989][27935] Avg episode reward: [(0, '-54.206')] [2022-07-12 22:53:13,989][27935] Fps is (10 sec: 5326.1, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 65552384. Throughput: 0: 10394.6. Samples: 131114376. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:13,989][27935] Avg episode reward: [(0, '-54.109')] [2022-07-12 22:53:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 65579008. Throughput: 0: 10400.4. Samples: 131177488. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:18,989][27935] Avg episode reward: [(0, '-54.188')] [2022-07-12 22:53:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 65606656. Throughput: 0: 10404.3. Samples: 131209316. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:23,989][27935] Avg episode reward: [(0, '-53.561')] [2022-07-12 22:53:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 65631232. Throughput: 0: 10425.4. Samples: 131272492. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:28,989][27935] Avg episode reward: [(0, '-53.443')] [2022-07-12 22:53:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 65658880. Throughput: 0: 10429.2. Samples: 131335664. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-12 22:53:33,989][27935] Avg episode reward: [(0, '-54.002')] [2022-07-12 22:53:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 65684480. Throughput: 0: 10431.7. Samples: 131367260. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:53:38,989][27935] Avg episode reward: [(0, '-53.573')] [2022-07-12 22:53:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 65710080. Throughput: 0: 10442.9. Samples: 131430720. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:53:43,989][27935] Avg episode reward: [(0, '-53.769')] [2022-07-12 22:53:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 65737728. Throughput: 0: 10537.4. Samples: 131493856. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:53:48,989][27935] Avg episode reward: [(0, '-53.248')] [2022-07-12 22:53:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 65763328. Throughput: 0: 10538.5. Samples: 131525400. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:53:53,989][27935] Avg episode reward: [(0, '-53.032')] [2022-07-12 22:53:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 65789952. Throughput: 0: 10536.3. Samples: 131588508. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:53:58,989][27935] Avg episode reward: [(0, '-53.444')] [2022-07-12 22:54:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.7, 300 sec: 5231.5). Total num frames: 65813504. Throughput: 0: 10453.5. Samples: 131647896. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:03,989][27935] Avg episode reward: [(0, '-53.762')] [2022-07-12 22:54:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 65841152. Throughput: 0: 10452.1. Samples: 131679660. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:08,989][27935] Avg episode reward: [(0, '-54.053')] [2022-07-12 22:54:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 65866752. Throughput: 0: 10452.0. Samples: 131742832. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:13,989][27935] Avg episode reward: [(0, '-54.159')] [2022-07-12 22:54:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 65893376. Throughput: 0: 9740.4. Samples: 131773984. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:18,989][27935] Avg episode reward: [(0, '-54.687')] [2022-07-12 22:54:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 65918976. Throughput: 0: 10454.2. Samples: 131837700. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:23,989][27935] Avg episode reward: [(0, '-54.395')] [2022-07-12 22:54:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 65941504. Throughput: 0: 10332.3. Samples: 131895672. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:28,989][27935] Avg episode reward: [(0, '-53.731')] [2022-07-12 22:54:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 5085.9, 300 sec: 5206.8). Total num frames: 65964032. Throughput: 0: 10116.8. Samples: 131949112. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:33,989][27935] Avg episode reward: [(0, '-53.482')] [2022-07-12 22:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5203.3). Total num frames: 65990656. Throughput: 0: 10068.5. Samples: 131978484. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:38,989][27935] Avg episode reward: [(0, '-53.725')] [2022-07-12 22:54:44,004][27935] Fps is (10 sec: 5112.0, 60 sec: 5084.5, 300 sec: 5196.1). Total num frames: 66015232. Throughput: 0: 9990.3. Samples: 132038228. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:44,005][27935] Avg episode reward: [(0, '-53.326')] [2022-07-12 22:54:49,001][27935] Fps is (10 sec: 4909.4, 60 sec: 5033.7, 300 sec: 5192.7). Total num frames: 66039808. Throughput: 0: 9961.4. Samples: 132096276. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 22:54:49,001][27935] Avg episode reward: [(0, '-53.088')] [2022-07-12 22:54:53,989][27935] Fps is (10 sec: 4717.7, 60 sec: 4983.5, 300 sec: 5175.5). Total num frames: 66062336. Throughput: 0: 9895.4. Samples: 132124956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:54:53,989][27935] Avg episode reward: [(0, '-52.194')] [2022-07-12 22:54:58,989][27935] Fps is (10 sec: 4613.4, 60 sec: 4932.3, 300 sec: 5175.5). Total num frames: 66085888. Throughput: 0: 9793.1. Samples: 132183520. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:54:58,989][27935] Avg episode reward: [(0, '-52.402')] [2022-07-12 22:55:03,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4915.2, 300 sec: 5158.2). Total num frames: 66108416. Throughput: 0: 10297.7. Samples: 132237380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:03,989][27935] Avg episode reward: [(0, '-53.584')] [2022-07-12 22:55:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 5154.7). Total num frames: 66132992. Throughput: 0: 9518.7. Samples: 132266040. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:08,989][27935] Avg episode reward: [(0, '-53.293')] [2022-07-12 22:55:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 5151.2). Total num frames: 66158592. Throughput: 0: 9526.2. Samples: 132324352. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:13,989][27935] Avg episode reward: [(0, '-53.051')] [2022-07-12 22:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 5137.4). Total num frames: 66181120. Throughput: 0: 9572.0. Samples: 132379852. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:18,989][27935] Avg episode reward: [(0, '-52.373')] [2022-07-12 22:55:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 5126.9). Total num frames: 66203648. Throughput: 0: 9564.8. Samples: 132408900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:23,989][27935] Avg episode reward: [(0, '-51.850')] [2022-07-12 22:55:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 5123.5). Total num frames: 66229248. Throughput: 0: 9566.3. Samples: 132468564. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:28,989][27935] Avg episode reward: [(0, '-52.367')] [2022-07-12 22:55:33,990][27935] Fps is (10 sec: 4914.5, 60 sec: 4812.7, 300 sec: 5113.0). Total num frames: 66252800. Throughput: 0: 9552.3. Samples: 132526028. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:33,991][27935] Avg episode reward: [(0, '-52.023')] [2022-07-12 22:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 5109.6). Total num frames: 66277376. Throughput: 0: 9556.0. Samples: 132554976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:38,989][27935] Avg episode reward: [(0, '-51.600')] [2022-07-12 22:55:43,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4779.9, 300 sec: 5099.2). Total num frames: 66301952. Throughput: 0: 9568.6. Samples: 132614108. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:43,989][27935] Avg episode reward: [(0, '-51.662')] [2022-07-12 22:55:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4796.7, 300 sec: 5099.2). Total num frames: 66327552. Throughput: 0: 9667.2. Samples: 132672404. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:48,989][27935] Avg episode reward: [(0, '-51.401')] [2022-07-12 22:55:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 5092.2). Total num frames: 66352128. Throughput: 0: 9682.1. Samples: 132701736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:53,989][27935] Avg episode reward: [(0, '-51.650')] [2022-07-12 22:55:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 5088.8). Total num frames: 66374656. Throughput: 0: 9679.0. Samples: 132759908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:55:58,989][27935] Avg episode reward: [(0, '-52.524')] [2022-07-12 22:56:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 5074.9). Total num frames: 66397184. Throughput: 0: 9656.1. Samples: 132814376. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:56:03,989][27935] Avg episode reward: [(0, '-52.918')] [2022-07-12 22:56:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5071.4). Total num frames: 66422784. Throughput: 0: 9688.1. Samples: 132844864. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 22:56:08,990][27935] Avg episode reward: [(0, '-52.863')] [2022-07-12 22:56:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 5057.5). Total num frames: 66444288. Throughput: 0: 9575.0. Samples: 132899440. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:13,989][27935] Avg episode reward: [(0, '-52.524')] [2022-07-12 22:56:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 5050.6). Total num frames: 66468864. Throughput: 0: 9562.6. Samples: 132956332. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:18,989][27935] Avg episode reward: [(0, '-53.601')] [2022-07-12 22:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 5043.7). Total num frames: 66492416. Throughput: 0: 9590.0. Samples: 132986524. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:23,989][27935] Avg episode reward: [(0, '-53.532')] [2022-07-12 22:56:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5040.2). Total num frames: 66518016. Throughput: 0: 9591.8. Samples: 133045740. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:28,990][27935] Avg episode reward: [(0, '-53.452')] [2022-07-12 22:56:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4830.0, 300 sec: 5033.2). Total num frames: 66542592. Throughput: 0: 9590.0. Samples: 133103952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:33,989][27935] Avg episode reward: [(0, '-52.713')] [2022-07-12 22:56:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 5029.7). Total num frames: 66567168. Throughput: 0: 9591.6. Samples: 133133360. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:38,989][27935] Avg episode reward: [(0, '-52.579')] [2022-07-12 22:56:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 5012.4). Total num frames: 66589696. Throughput: 0: 9598.1. Samples: 133191820. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:43,989][27935] Avg episode reward: [(0, '-52.707')] [2022-07-12 22:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5012.4). Total num frames: 66616320. Throughput: 0: 9679.1. Samples: 133249936. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:48,989][27935] Avg episode reward: [(0, '-53.037')] [2022-07-12 22:56:53,992][27935] Fps is (10 sec: 4913.6, 60 sec: 4778.4, 300 sec: 5001.9). Total num frames: 66638848. Throughput: 0: 9654.0. Samples: 133279328. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:53,993][27935] Avg episode reward: [(0, '-52.529')] [2022-07-12 22:56:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 5015.9). Total num frames: 66667520. Throughput: 0: 9843.3. Samples: 133342388. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:56:58,989][27935] Avg episode reward: [(0, '-53.018')] [2022-07-12 22:57:03,989][27935] Fps is (10 sec: 5121.7, 60 sec: 4881.1, 300 sec: 5005.5). Total num frames: 66690048. Throughput: 0: 9887.3. Samples: 133401260. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:03,989][27935] Avg episode reward: [(0, '-53.383')] [2022-07-12 22:57:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 5008.9). Total num frames: 66717696. Throughput: 0: 9915.4. Samples: 133432716. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:08,989][27935] Avg episode reward: [(0, '-53.119')] [2022-07-12 22:57:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4983.5, 300 sec: 5008.9). Total num frames: 66743296. Throughput: 0: 9988.6. Samples: 133495228. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:13,989][27935] Avg episode reward: [(0, '-53.249')] [2022-07-12 22:57:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5008.9). Total num frames: 66769920. Throughput: 0: 10088.1. Samples: 133557916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:18,989][27935] Avg episode reward: [(0, '-53.352')] [2022-07-12 22:57:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5002.0). Total num frames: 66794496. Throughput: 0: 10140.9. Samples: 133589700. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:23,989][27935] Avg episode reward: [(0, '-52.778')] [2022-07-12 22:57:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5005.5). Total num frames: 66822144. Throughput: 0: 10250.2. Samples: 133653080. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-12 22:57:28,989][27935] Avg episode reward: [(0, '-53.158')] [2022-07-12 22:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5002.0). Total num frames: 66845696. Throughput: 0: 10214.4. Samples: 133709584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:33,989][27935] Avg episode reward: [(0, '-53.423')] [2022-07-12 22:57:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 66868224. Throughput: 0: 10157.1. Samples: 133736364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:38,989][27935] Avg episode reward: [(0, '-52.610')] [2022-07-12 22:57:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5034.7, 300 sec: 4977.7). Total num frames: 66891776. Throughput: 0: 10027.2. Samples: 133793612. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:43,989][27935] Avg episode reward: [(0, '-51.802')] [2022-07-12 22:57:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4974.2). Total num frames: 66917376. Throughput: 0: 10034.8. Samples: 133852824. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:48,989][27935] Avg episode reward: [(0, '-51.271')] [2022-07-12 22:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.9, 300 sec: 4963.8). Total num frames: 66940928. Throughput: 0: 9977.2. Samples: 133881688. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:53,989][27935] Avg episode reward: [(0, '-51.917')] [2022-07-12 22:57:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4977.7). Total num frames: 66967552. Throughput: 0: 9948.7. Samples: 133942920. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:57:58,989][27935] Avg episode reward: [(0, '-52.008')] [2022-07-12 22:58:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4960.3). Total num frames: 66990080. Throughput: 0: 9876.3. Samples: 134002348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:03,989][27935] Avg episode reward: [(0, '-51.543')] [2022-07-12 22:58:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4970.7). Total num frames: 67018752. Throughput: 0: 9872.5. Samples: 134033964. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:08,989][27935] Avg episode reward: [(0, '-51.984')] [2022-07-12 22:58:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5017.6, 300 sec: 4967.3). Total num frames: 67044352. Throughput: 0: 9875.0. Samples: 134097456. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:13,989][27935] Avg episode reward: [(0, '-52.318')] [2022-07-12 22:58:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4963.8). Total num frames: 67070976. Throughput: 0: 10020.7. Samples: 134160516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:18,989][27935] Avg episode reward: [(0, '-53.184')] [2022-07-12 22:58:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4967.3). Total num frames: 67096576. Throughput: 0: 10117.5. Samples: 134191652. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:23,989][27935] Avg episode reward: [(0, '-53.236')] [2022-07-12 22:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4956.9). Total num frames: 67121152. Throughput: 0: 10129.8. Samples: 134249452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:28,989][27935] Avg episode reward: [(0, '-53.288')] [2022-07-12 22:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4949.9). Total num frames: 67144704. Throughput: 0: 10175.0. Samples: 134310700. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:33,989][27935] Avg episode reward: [(0, '-53.074')] [2022-07-12 22:58:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4953.4). Total num frames: 67171328. Throughput: 0: 10184.1. Samples: 134339972. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:38,989][27935] Avg episode reward: [(0, '-53.118')] [2022-07-12 22:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4936.0). Total num frames: 67193856. Throughput: 0: 10145.9. Samples: 134399484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:43,989][27935] Avg episode reward: [(0, '-52.640')] [2022-07-12 22:58:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4939.5). Total num frames: 67220480. Throughput: 0: 10157.8. Samples: 134459448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:48,989][27935] Avg episode reward: [(0, '-53.034')] [2022-07-12 22:58:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4929.1). Total num frames: 67244032. Throughput: 0: 10110.7. Samples: 134488944. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 22:58:53,989][27935] Avg episode reward: [(0, '-53.500')] [2022-07-12 22:58:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4939.5). Total num frames: 67270656. Throughput: 0: 10090.5. Samples: 134551528. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:58:58,989][27935] Avg episode reward: [(0, '-52.871')] [2022-07-12 22:59:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4929.1). Total num frames: 67295232. Throughput: 0: 9997.1. Samples: 134610384. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:03,989][27935] Avg episode reward: [(0, '-53.353')] [2022-07-12 22:59:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4932.6). Total num frames: 67321856. Throughput: 0: 10003.4. Samples: 134641804. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:08,989][27935] Avg episode reward: [(0, '-53.296')] [2022-07-12 22:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 4929.1). Total num frames: 67347456. Throughput: 0: 10102.4. Samples: 134704060. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:13,989][27935] Avg episode reward: [(0, '-53.464')] [2022-07-12 22:59:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 4932.6). Total num frames: 67374080. Throughput: 0: 10133.8. Samples: 134766720. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:18,989][27935] Avg episode reward: [(0, '-53.802')] [2022-07-12 22:59:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5068.8, 300 sec: 4946.4). Total num frames: 67400704. Throughput: 0: 10191.6. Samples: 134798592. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:23,989][27935] Avg episode reward: [(0, '-53.684')] [2022-07-12 22:59:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 4956.9). Total num frames: 67426304. Throughput: 0: 10268.5. Samples: 134861568. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:28,989][27935] Avg episode reward: [(0, '-53.485')] [2022-07-12 22:59:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 4953.4). Total num frames: 67451904. Throughput: 0: 10331.4. Samples: 134924360. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:33,989][27935] Avg episode reward: [(0, '-53.375')] [2022-07-12 22:59:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 4964.1). Total num frames: 67479552. Throughput: 0: 10380.6. Samples: 134956072. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:38,989][27935] Avg episode reward: [(0, '-53.019')] [2022-07-12 22:59:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 4964.0). Total num frames: 67504128. Throughput: 0: 10396.1. Samples: 135019352. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:43,989][27935] Avg episode reward: [(0, '-52.321')] [2022-07-12 22:59:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 4984.6). Total num frames: 67532800. Throughput: 0: 10489.0. Samples: 135082388. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:48,989][27935] Avg episode reward: [(0, '-52.822')] [2022-07-12 22:59:53,990][27935] Fps is (10 sec: 5324.0, 60 sec: 5222.3, 300 sec: 4988.1). Total num frames: 67557376. Throughput: 0: 10492.7. Samples: 135113992. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:53,991][27935] Avg episode reward: [(0, '-52.418')] [2022-07-12 22:59:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5002.0). Total num frames: 67584000. Throughput: 0: 10503.4. Samples: 135176712. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 22:59:58,989][27935] Avg episode reward: [(0, '-52.932')] [2022-07-12 23:00:03,989][27935] Fps is (10 sec: 5120.8, 60 sec: 5222.4, 300 sec: 5002.0). Total num frames: 67608576. Throughput: 0: 10416.3. Samples: 135235452. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 23:00:03,989][27935] Avg episode reward: [(0, '-53.609')] [2022-07-12 23:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5002.0). Total num frames: 67634176. Throughput: 0: 10410.3. Samples: 135267056. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 23:00:08,990][27935] Avg episode reward: [(0, '-53.233')] [2022-07-12 23:00:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5015.9). Total num frames: 67660800. Throughput: 0: 10429.8. Samples: 135330908. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-12 23:00:13,989][27935] Avg episode reward: [(0, '-52.648')] [2022-07-12 23:00:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5029.7). Total num frames: 67687424. Throughput: 0: 10420.1. Samples: 135393264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:18,990][27935] Avg episode reward: [(0, '-53.020')] [2022-07-12 23:00:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5033.2). Total num frames: 67714048. Throughput: 0: 10418.0. Samples: 135424884. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:23,989][27935] Avg episode reward: [(0, '-53.276')] [2022-07-12 23:00:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5036.7). Total num frames: 67738624. Throughput: 0: 10395.1. Samples: 135487132. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:28,989][27935] Avg episode reward: [(0, '-53.039')] [2022-07-12 23:00:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5043.6). Total num frames: 67765248. Throughput: 0: 10344.2. Samples: 135547876. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:33,989][27935] Avg episode reward: [(0, '-52.807')] [2022-07-12 23:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5040.2). Total num frames: 67788800. Throughput: 0: 10301.0. Samples: 135577524. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:38,989][27935] Avg episode reward: [(0, '-53.042')] [2022-07-12 23:00:43,991][27935] Fps is (10 sec: 5118.9, 60 sec: 5205.1, 300 sec: 5047.1). Total num frames: 67816448. Throughput: 0: 10300.5. Samples: 135640256. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:43,991][27935] Avg episode reward: [(0, '-52.548')] [2022-07-12 23:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5047.1). Total num frames: 67841024. Throughput: 0: 10372.2. Samples: 135702204. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:48,989][27935] Avg episode reward: [(0, '-52.228')] [2022-07-12 23:00:53,989][27935] Fps is (10 sec: 5121.2, 60 sec: 5171.3, 300 sec: 5061.0). Total num frames: 67867648. Throughput: 0: 10366.1. Samples: 135733532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:53,989][27935] Avg episode reward: [(0, '-52.270')] [2022-07-12 23:00:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5074.9). Total num frames: 67894272. Throughput: 0: 10348.2. Samples: 135796576. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:00:58,989][27935] Avg episode reward: [(0, '-52.181')] [2022-07-12 23:01:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5067.9). Total num frames: 67917824. Throughput: 0: 10239.0. Samples: 135854020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:03,989][27935] Avg episode reward: [(0, '-52.906')] [2022-07-12 23:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 67941376. Throughput: 0: 10189.6. Samples: 135883416. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:08,989][27935] Avg episode reward: [(0, '-53.154')] [2022-07-12 23:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 67966976. Throughput: 0: 10146.7. Samples: 135943736. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:13,989][27935] Avg episode reward: [(0, '-53.736')] [2022-07-12 23:01:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5092.2). Total num frames: 67994624. Throughput: 0: 10177.6. Samples: 136005868. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:18,989][27935] Avg episode reward: [(0, '-53.689')] [2022-07-12 23:01:23,996][27935] Fps is (10 sec: 5218.8, 60 sec: 5085.3, 300 sec: 5088.6). Total num frames: 68019200. Throughput: 0: 10217.3. Samples: 136037376. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:23,996][27935] Avg episode reward: [(0, '-53.594')] [2022-07-12 23:01:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5085.3). Total num frames: 68042752. Throughput: 0: 10113.1. Samples: 136095324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:28,989][27935] Avg episode reward: [(0, '-53.883')] [2022-07-12 23:01:33,989][27935] Fps is (10 sec: 4713.8, 60 sec: 5017.6, 300 sec: 5081.8). Total num frames: 68066304. Throughput: 0: 9333.7. Samples: 136122220. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-12 23:01:33,989][27935] Avg episode reward: [(0, '-53.091')] [2022-07-12 23:01:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5017.6, 300 sec: 5085.3). Total num frames: 68089856. Throughput: 0: 9909.7. Samples: 136179468. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:01:38,989][27935] Avg episode reward: [(0, '-52.486')] [2022-07-12 23:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.7, 300 sec: 5081.8). Total num frames: 68115456. Throughput: 0: 9820.3. Samples: 136238488. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:01:43,989][27935] Avg episode reward: [(0, '-51.840')] [2022-07-12 23:01:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 5081.9). Total num frames: 68137984. Throughput: 0: 9833.8. Samples: 136296540. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:01:48,989][27935] Avg episode reward: [(0, '-52.407')] [2022-07-12 23:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 5071.4). Total num frames: 68163584. Throughput: 0: 9825.4. Samples: 136325560. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:01:53,989][27935] Avg episode reward: [(0, '-52.698')] [2022-07-12 23:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 5071.4). Total num frames: 68186112. Throughput: 0: 9771.9. Samples: 136383472. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:01:58,989][27935] Avg episode reward: [(0, '-51.974')] [2022-07-12 23:02:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 5054.0). Total num frames: 68208640. Throughput: 0: 9593.3. Samples: 136437568. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:03,989][27935] Avg episode reward: [(0, '-52.058')] [2022-07-12 23:02:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 5054.0). Total num frames: 68234240. Throughput: 0: 9546.5. Samples: 136466900. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:08,989][27935] Avg episode reward: [(0, '-52.467')] [2022-07-12 23:02:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 5047.1). Total num frames: 68258816. Throughput: 0: 9611.1. Samples: 136527824. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:13,989][27935] Avg episode reward: [(0, '-52.202')] [2022-07-12 23:02:19,000][27935] Fps is (10 sec: 5114.0, 60 sec: 4846.0, 300 sec: 5053.8). Total num frames: 68285440. Throughput: 0: 10396.4. Samples: 136590180. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:19,001][27935] Avg episode reward: [(0, '-51.751')] [2022-07-12 23:02:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4864.6, 300 sec: 5047.1). Total num frames: 68311040. Throughput: 0: 9816.5. Samples: 136621212. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:23,989][27935] Avg episode reward: [(0, '-51.991')] [2022-07-12 23:02:28,989][27935] Fps is (10 sec: 5228.5, 60 sec: 4915.2, 300 sec: 5057.5). Total num frames: 68337664. Throughput: 0: 9889.9. Samples: 136683536. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:28,989][27935] Avg episode reward: [(0, '-52.758')] [2022-07-12 23:02:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4949.3, 300 sec: 5067.9). Total num frames: 68363264. Throughput: 0: 9967.6. Samples: 136745084. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:33,989][27935] Avg episode reward: [(0, '-52.929')] [2022-07-12 23:02:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5074.9). Total num frames: 68388864. Throughput: 0: 10010.0. Samples: 136776008. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:38,989][27935] Avg episode reward: [(0, '-53.052')] [2022-07-12 23:02:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5074.9). Total num frames: 68414464. Throughput: 0: 10070.9. Samples: 136836664. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:43,999][27935] Avg episode reward: [(0, '-52.582')] [2022-07-12 23:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5078.3). Total num frames: 68439040. Throughput: 0: 10246.4. Samples: 136898656. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:48,989][27935] Avg episode reward: [(0, '-53.117')] [2022-07-12 23:02:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 68464640. Throughput: 0: 10282.7. Samples: 136929620. Policy #0 lag: (min: 0.0, avg: 7.6, max: 16.0) [2022-07-12 23:02:53,989][27935] Avg episode reward: [(0, '-53.592')] [2022-07-12 23:02:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 68491264. Throughput: 0: 10288.9. Samples: 136990824. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:02:58,989][27935] Avg episode reward: [(0, '-53.673')] [2022-07-12 23:03:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 68514816. Throughput: 0: 10184.5. Samples: 137048364. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:03,989][27935] Avg episode reward: [(0, '-54.157')] [2022-07-12 23:03:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 68540416. Throughput: 0: 10182.8. Samples: 137079436. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:08,989][27935] Avg episode reward: [(0, '-54.122')] [2022-07-12 23:03:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5120.0, 300 sec: 5067.9). Total num frames: 68566016. Throughput: 0: 10172.0. Samples: 137141276. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:13,990][27935] Avg episode reward: [(0, '-54.163')] [2022-07-12 23:03:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.9, 300 sec: 5067.9). Total num frames: 68591616. Throughput: 0: 10173.0. Samples: 137202868. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:18,989][27935] Avg episode reward: [(0, '-53.753')] [2022-07-12 23:03:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 68616192. Throughput: 0: 10182.4. Samples: 137234216. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:23,989][27935] Avg episode reward: [(0, '-53.331')] [2022-07-12 23:03:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 68642816. Throughput: 0: 10200.8. Samples: 137295700. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:28,989][27935] Avg episode reward: [(0, '-53.421')] [2022-07-12 23:03:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 68670464. Throughput: 0: 10187.1. Samples: 137357076. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:33,989][27935] Avg episode reward: [(0, '-52.786')] [2022-07-12 23:03:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 68694016. Throughput: 0: 10176.8. Samples: 137387576. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:38,989][27935] Avg episode reward: [(0, '-53.017')] [2022-07-12 23:03:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5088.8). Total num frames: 68721664. Throughput: 0: 10203.6. Samples: 137449988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:43,989][27935] Avg episode reward: [(0, '-54.022')] [2022-07-12 23:03:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5088.8). Total num frames: 68745216. Throughput: 0: 9608.9. Samples: 137480764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:48,992][27935] Avg episode reward: [(0, '-54.013')] [2022-07-12 23:03:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5092.2). Total num frames: 68772864. Throughput: 0: 10305.9. Samples: 137543200. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:53,989][27935] Avg episode reward: [(0, '-54.519')] [2022-07-12 23:03:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5095.7). Total num frames: 68798464. Throughput: 0: 10307.8. Samples: 137605124. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:03:58,989][27935] Avg episode reward: [(0, '-54.299')] [2022-07-12 23:04:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 68822016. Throughput: 0: 10227.7. Samples: 137663112. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:04:03,989][27935] Avg episode reward: [(0, '-53.900')] [2022-07-12 23:04:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 68846592. Throughput: 0: 10226.9. Samples: 137694428. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:04:08,989][27935] Avg episode reward: [(0, '-54.328')] [2022-07-12 23:04:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5085.3). Total num frames: 68874240. Throughput: 0: 10246.7. Samples: 137756800. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:04:13,989][27935] Avg episode reward: [(0, '-53.965')] [2022-07-12 23:04:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 68898816. Throughput: 0: 10243.8. Samples: 137818048. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-12 23:04:18,992][27935] Avg episode reward: [(0, '-53.284')] [2022-07-12 23:04:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5081.8). Total num frames: 68925440. Throughput: 0: 10258.6. Samples: 137849212. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:23,989][27935] Avg episode reward: [(0, '-52.737')] [2022-07-12 23:04:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5081.8). Total num frames: 68951040. Throughput: 0: 10247.1. Samples: 137911108. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:28,989][27935] Avg episode reward: [(0, '-52.138')] [2022-07-12 23:04:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 68976640. Throughput: 0: 10923.5. Samples: 137972320. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:33,989][27935] Avg episode reward: [(0, '-52.122')] [2022-07-12 23:04:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5078.3). Total num frames: 69002240. Throughput: 0: 10222.5. Samples: 138003212. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:38,989][27935] Avg episode reward: [(0, '-52.340')] [2022-07-12 23:04:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 69027840. Throughput: 0: 10242.8. Samples: 138066048. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:43,989][27935] Avg episode reward: [(0, '-51.562')] [2022-07-12 23:04:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5074.9). Total num frames: 69054464. Throughput: 0: 9635.6. Samples: 138096716. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:48,989][27935] Avg episode reward: [(0, '-51.903')] [2022-07-12 23:04:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5071.4). Total num frames: 69080064. Throughput: 0: 10319.3. Samples: 138158796. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:53,989][27935] Avg episode reward: [(0, '-51.906')] [2022-07-12 23:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 69105664. Throughput: 0: 10301.0. Samples: 138220344. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:04:58,989][27935] Avg episode reward: [(0, '-52.279')] [2022-07-12 23:05:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5067.9). Total num frames: 69129216. Throughput: 0: 10222.6. Samples: 138278064. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:03,989][27935] Avg episode reward: [(0, '-52.496')] [2022-07-12 23:05:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5064.5). Total num frames: 69154816. Throughput: 0: 10210.7. Samples: 138308692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:08,990][27935] Avg episode reward: [(0, '-51.819')] [2022-07-12 23:05:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5057.5). Total num frames: 69179392. Throughput: 0: 10211.7. Samples: 138370636. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:13,989][27935] Avg episode reward: [(0, '-51.573')] [2022-07-12 23:05:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5057.5). Total num frames: 69206016. Throughput: 0: 10176.7. Samples: 138430272. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:18,989][27935] Avg episode reward: [(0, '-50.944')] [2022-07-12 23:05:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 69228544. Throughput: 0: 10087.7. Samples: 138457160. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:23,990][27935] Avg episode reward: [(0, '-50.988')] [2022-07-12 23:05:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 5000.5, 300 sec: 5036.7). Total num frames: 69251072. Throughput: 0: 9910.8. Samples: 138512036. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:28,989][27935] Avg episode reward: [(0, '-51.237')] [2022-07-12 23:05:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 5040.2). Total num frames: 69275648. Throughput: 0: 9892.6. Samples: 138541884. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:33,989][27935] Avg episode reward: [(0, '-50.827')] [2022-07-12 23:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5029.8). Total num frames: 69300224. Throughput: 0: 9823.8. Samples: 138600868. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:38,989][27935] Avg episode reward: [(0, '-51.372')] [2022-07-12 23:05:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5033.2). Total num frames: 69325824. Throughput: 0: 9799.6. Samples: 138661324. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:43,989][27935] Avg episode reward: [(0, '-51.946')] [2022-07-12 23:05:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5029.7). Total num frames: 69351424. Throughput: 0: 9852.0. Samples: 138721404. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:48,989][27935] Avg episode reward: [(0, '-52.228')] [2022-07-12 23:05:53,992][27935] Fps is (10 sec: 5015.8, 60 sec: 4932.0, 300 sec: 5022.7). Total num frames: 69376000. Throughput: 0: 9841.5. Samples: 138751592. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:53,993][27935] Avg episode reward: [(0, '-52.418')] [2022-07-12 23:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5026.3). Total num frames: 69400576. Throughput: 0: 9792.4. Samples: 138811296. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:05:58,989][27935] Avg episode reward: [(0, '-52.384')] [2022-07-12 23:06:03,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4932.3, 300 sec: 5029.7). Total num frames: 69425152. Throughput: 0: 9723.2. Samples: 138867816. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:03,989][27935] Avg episode reward: [(0, '-52.514')] [2022-07-12 23:06:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 5022.8). Total num frames: 69448704. Throughput: 0: 9794.2. Samples: 138897900. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:08,989][27935] Avg episode reward: [(0, '-53.201')] [2022-07-12 23:06:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5015.9). Total num frames: 69474304. Throughput: 0: 9926.8. Samples: 138958744. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:13,990][27935] Avg episode reward: [(0, '-53.238')] [2022-07-12 23:06:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 5016.0). Total num frames: 69498880. Throughput: 0: 10607.8. Samples: 139019236. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:18,990][27935] Avg episode reward: [(0, '-53.850')] [2022-07-12 23:06:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5026.3). Total num frames: 69525504. Throughput: 0: 9971.6. Samples: 139049588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:23,989][27935] Avg episode reward: [(0, '-53.435')] [2022-07-12 23:06:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5026.3). Total num frames: 69549056. Throughput: 0: 9976.1. Samples: 139110248. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:28,989][27935] Avg episode reward: [(0, '-53.915')] [2022-07-12 23:06:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 5033.2). Total num frames: 69574656. Throughput: 0: 9300.5. Samples: 139139928. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:33,989][27935] Avg episode reward: [(0, '-53.680')] [2022-07-12 23:06:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5029.7). Total num frames: 69599232. Throughput: 0: 9945.1. Samples: 139199088. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:38,989][27935] Avg episode reward: [(0, '-53.754')] [2022-07-12 23:06:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5036.7). Total num frames: 69623808. Throughput: 0: 9911.5. Samples: 139257312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:43,989][27935] Avg episode reward: [(0, '-53.673')] [2022-07-12 23:06:48,991][27935] Fps is (10 sec: 5016.7, 60 sec: 4966.2, 300 sec: 5036.7). Total num frames: 69649408. Throughput: 0: 9986.8. Samples: 139317240. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:48,991][27935] Avg episode reward: [(0, '-53.103')] [2022-07-12 23:06:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.6, 300 sec: 5036.7). Total num frames: 69671936. Throughput: 0: 9986.5. Samples: 139347292. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:53,989][27935] Avg episode reward: [(0, '-53.212')] [2022-07-12 23:06:58,989][27935] Fps is (10 sec: 4404.0, 60 sec: 4881.1, 300 sec: 5033.2). Total num frames: 69693440. Throughput: 0: 9771.8. Samples: 139398476. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:06:58,989][27935] Avg episode reward: [(0, '-52.999')] [2022-07-12 23:07:03,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4778.7, 300 sec: 5008.9). Total num frames: 69711872. Throughput: 0: 9392.3. Samples: 139441888. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:03,989][27935] Avg episode reward: [(0, '-53.123')] [2022-07-12 23:07:08,989][27935] Fps is (10 sec: 3481.6, 60 sec: 4659.2, 300 sec: 4981.2). Total num frames: 69728256. Throughput: 0: 9177.9. Samples: 139462592. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:08,989][27935] Avg episode reward: [(0, '-52.892')] [2022-07-12 23:07:13,989][27935] Fps is (10 sec: 3686.4, 60 sec: 4573.9, 300 sec: 4960.5). Total num frames: 69748736. Throughput: 0: 8798.6. Samples: 139506184. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:13,989][27935] Avg episode reward: [(0, '-52.565')] [2022-07-12 23:07:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4556.8, 300 sec: 4953.4). Total num frames: 69772288. Throughput: 0: 8767.2. Samples: 139534452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:19,000][27935] Avg episode reward: [(0, '-53.238')] [2022-07-12 23:07:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4539.7, 300 sec: 4949.9). Total num frames: 69797888. Throughput: 0: 8792.4. Samples: 139594744. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:23,989][27935] Avg episode reward: [(0, '-53.833')] [2022-07-12 23:07:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4556.8, 300 sec: 4946.4). Total num frames: 69822464. Throughput: 0: 8844.3. Samples: 139655304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:28,989][27935] Avg episode reward: [(0, '-53.814')] [2022-07-12 23:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4556.8, 300 sec: 4946.4). Total num frames: 69848064. Throughput: 0: 8849.1. Samples: 139715432. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:33,989][27935] Avg episode reward: [(0, '-54.274')] [2022-07-12 23:07:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4573.9, 300 sec: 4946.4). Total num frames: 69873664. Throughput: 0: 8847.7. Samples: 139745440. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:38,989][27935] Avg episode reward: [(0, '-54.233')] [2022-07-12 23:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4590.9, 300 sec: 4949.9). Total num frames: 69899264. Throughput: 0: 9051.2. Samples: 139805780. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:43,989][27935] Avg episode reward: [(0, '-54.291')] [2022-07-12 23:07:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4574.0, 300 sec: 4946.4). Total num frames: 69923840. Throughput: 0: 9431.1. Samples: 139866288. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:48,989][27935] Avg episode reward: [(0, '-53.507')] [2022-07-12 23:07:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4625.1, 300 sec: 4943.0). Total num frames: 69949440. Throughput: 0: 9655.8. Samples: 139897104. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:53,989][27935] Avg episode reward: [(0, '-52.380')] [2022-07-12 23:07:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4659.2, 300 sec: 4943.0). Total num frames: 69972992. Throughput: 0: 10008.2. Samples: 139956552. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:07:58,989][27935] Avg episode reward: [(0, '-51.953')] [2022-07-12 23:08:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4936.0). Total num frames: 69996544. Throughput: 0: 10620.4. Samples: 140012368. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:03,989][27935] Avg episode reward: [(0, '-51.745')] [2022-07-12 23:08:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4932.6). Total num frames: 70021120. Throughput: 0: 9944.5. Samples: 140042248. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:08,989][27935] Avg episode reward: [(0, '-51.764')] [2022-07-12 23:08:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4939.5). Total num frames: 70048768. Throughput: 0: 9949.2. Samples: 140103016. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:13,989][27935] Avg episode reward: [(0, '-51.527')] [2022-07-12 23:08:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4936.0). Total num frames: 70072320. Throughput: 0: 9946.8. Samples: 140163040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:18,989][27935] Avg episode reward: [(0, '-51.618')] [2022-07-12 23:08:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4929.1). Total num frames: 70096896. Throughput: 0: 9962.7. Samples: 140193760. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:23,989][27935] Avg episode reward: [(0, '-51.152')] [2022-07-12 23:08:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4922.1). Total num frames: 70122496. Throughput: 0: 9959.2. Samples: 140253944. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:08:28,989][27935] Avg episode reward: [(0, '-51.598')] [2022-07-12 23:08:33,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4966.1, 300 sec: 4922.1). Total num frames: 70146048. Throughput: 0: 9935.3. Samples: 140313412. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:33,993][27935] Avg episode reward: [(0, '-51.140')] [2022-07-12 23:08:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4918.7). Total num frames: 70172672. Throughput: 0: 9941.0. Samples: 140344448. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:38,989][27935] Avg episode reward: [(0, '-50.814')] [2022-07-12 23:08:43,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5000.5, 300 sec: 4929.1). Total num frames: 70199296. Throughput: 0: 10003.8. Samples: 140406724. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:43,989][27935] Avg episode reward: [(0, '-50.409')] [2022-07-12 23:08:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5034.7, 300 sec: 4925.6). Total num frames: 70225920. Throughput: 0: 10135.8. Samples: 140468480. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:48,999][27935] Avg episode reward: [(0, '-50.644')] [2022-07-12 23:08:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4922.1). Total num frames: 70250496. Throughput: 0: 10166.4. Samples: 140499736. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:53,989][27935] Avg episode reward: [(0, '-51.460')] [2022-07-12 23:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4929.1). Total num frames: 70276096. Throughput: 0: 10202.2. Samples: 140562116. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:08:58,989][27935] Avg episode reward: [(0, '-51.262')] [2022-07-12 23:09:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4925.6). Total num frames: 70299648. Throughput: 0: 10149.9. Samples: 140619784. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:03,989][27935] Avg episode reward: [(0, '-51.421')] [2022-07-12 23:09:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 4922.1). Total num frames: 70326272. Throughput: 0: 10145.6. Samples: 140650312. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:08,989][27935] Avg episode reward: [(0, '-51.912')] [2022-07-12 23:09:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5051.7, 300 sec: 4925.6). Total num frames: 70351872. Throughput: 0: 10190.3. Samples: 140712508. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:13,989][27935] Avg episode reward: [(0, '-51.541')] [2022-07-12 23:09:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 4925.6). Total num frames: 70378496. Throughput: 0: 10236.5. Samples: 140774020. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:18,990][27935] Avg episode reward: [(0, '-51.818')] [2022-07-12 23:09:23,990][27935] Fps is (10 sec: 5119.2, 60 sec: 5102.8, 300 sec: 4922.1). Total num frames: 70403072. Throughput: 0: 10232.4. Samples: 140804924. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:23,991][27935] Avg episode reward: [(0, '-51.785')] [2022-07-12 23:09:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 4925.6). Total num frames: 70429696. Throughput: 0: 10219.8. Samples: 140866616. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:28,989][27935] Avg episode reward: [(0, '-52.713')] [2022-07-12 23:09:33,989][27935] Fps is (10 sec: 5018.4, 60 sec: 5120.3, 300 sec: 4918.7). Total num frames: 70453248. Throughput: 0: 10204.3. Samples: 140927672. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:33,989][27935] Avg episode reward: [(0, '-52.023')] [2022-07-12 23:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 4918.7). Total num frames: 70478848. Throughput: 0: 10179.1. Samples: 140957796. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:38,989][27935] Avg episode reward: [(0, '-52.582')] [2022-07-12 23:09:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 4918.7). Total num frames: 70505472. Throughput: 0: 10165.6. Samples: 141019568. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:43,989][27935] Avg episode reward: [(0, '-53.010')] [2022-07-12 23:09:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4915.2). Total num frames: 70530048. Throughput: 0: 10251.5. Samples: 141081100. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:48,989][27935] Avg episode reward: [(0, '-53.262')] [2022-07-12 23:09:53,991][27935] Fps is (10 sec: 5119.0, 60 sec: 5102.8, 300 sec: 4918.6). Total num frames: 70556672. Throughput: 0: 10251.0. Samples: 141111628. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-12 23:09:53,991][27935] Avg episode reward: [(0, '-53.467')] [2022-07-12 23:09:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4922.1). Total num frames: 70581248. Throughput: 0: 10233.8. Samples: 141173028. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:09:58,995][27935] Avg episode reward: [(0, '-53.128')] [2022-07-12 23:10:03,989][27935] Fps is (10 sec: 4916.1, 60 sec: 5102.9, 300 sec: 4918.7). Total num frames: 70605824. Throughput: 0: 10150.4. Samples: 141230788. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:03,989][27935] Avg episode reward: [(0, '-52.558')] [2022-07-12 23:10:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 4922.1). Total num frames: 70631424. Throughput: 0: 10144.6. Samples: 141261416. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:08,989][27935] Avg episode reward: [(0, '-52.142')] [2022-07-12 23:10:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 4922.1). Total num frames: 70658048. Throughput: 0: 10155.6. Samples: 141323616. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:13,989][27935] Avg episode reward: [(0, '-52.133')] [2022-07-12 23:10:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4929.1). Total num frames: 70682624. Throughput: 0: 10171.7. Samples: 141385400. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:18,989][27935] Avg episode reward: [(0, '-52.856')] [2022-07-12 23:10:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.1, 300 sec: 4943.0). Total num frames: 70709248. Throughput: 0: 10186.7. Samples: 141416200. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:23,989][27935] Avg episode reward: [(0, '-52.336')] [2022-07-12 23:10:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4943.0). Total num frames: 70733824. Throughput: 0: 10207.5. Samples: 141478904. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:28,989][27935] Avg episode reward: [(0, '-52.657')] [2022-07-12 23:10:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 4946.4). Total num frames: 70759424. Throughput: 0: 10215.7. Samples: 141540804. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:33,989][27935] Avg episode reward: [(0, '-53.202')] [2022-07-12 23:10:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 4953.4). Total num frames: 70787072. Throughput: 0: 10212.8. Samples: 141571184. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:38,989][27935] Avg episode reward: [(0, '-53.506')] [2022-07-12 23:10:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 4949.9). Total num frames: 70811648. Throughput: 0: 10228.0. Samples: 141633288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:43,989][27935] Avg episode reward: [(0, '-53.943')] [2022-07-12 23:10:48,998][27935] Fps is (10 sec: 5115.4, 60 sec: 5136.3, 300 sec: 4956.8). Total num frames: 70838272. Throughput: 0: 10330.6. Samples: 141695760. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:48,998][27935] Avg episode reward: [(0, '-53.441')] [2022-07-12 23:10:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.1, 300 sec: 4956.9). Total num frames: 70862848. Throughput: 0: 10338.0. Samples: 141726624. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:53,989][27935] Avg episode reward: [(0, '-53.243')] [2022-07-12 23:10:58,989][27935] Fps is (10 sec: 5124.7, 60 sec: 5137.1, 300 sec: 4963.8). Total num frames: 70889472. Throughput: 0: 10337.1. Samples: 141788788. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:10:58,989][27935] Avg episode reward: [(0, '-52.448')] [2022-07-12 23:11:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 4967.3). Total num frames: 70914048. Throughput: 0: 10255.6. Samples: 141846900. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:11:03,990][27935] Avg episode reward: [(0, '-51.997')] [2022-07-12 23:11:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 4967.3). Total num frames: 70939648. Throughput: 0: 10251.7. Samples: 141877524. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:11:08,989][27935] Avg episode reward: [(0, '-51.604')] [2022-07-12 23:11:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 4970.7). Total num frames: 70965248. Throughput: 0: 10231.4. Samples: 141939316. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:11:13,989][27935] Avg episode reward: [(0, '-51.510')] [2022-07-12 23:11:19,005][27935] Fps is (10 sec: 5111.9, 60 sec: 5135.7, 300 sec: 4967.0). Total num frames: 70990848. Throughput: 0: 10229.4. Samples: 142001292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-12 23:11:19,005][27935] Avg episode reward: [(0, '-51.370')] [2022-07-12 23:11:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 4981.2). Total num frames: 71018496. Throughput: 0: 10234.8. Samples: 142031748. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:23,989][27935] Avg episode reward: [(0, '-51.640')] [2022-07-12 23:11:28,989][27935] Fps is (10 sec: 5128.2, 60 sec: 5137.1, 300 sec: 4974.2). Total num frames: 71042048. Throughput: 0: 10240.3. Samples: 142094100. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:28,989][27935] Avg episode reward: [(0, '-51.731')] [2022-07-12 23:11:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 4977.7). Total num frames: 71067648. Throughput: 0: 10230.0. Samples: 142156016. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:33,989][27935] Avg episode reward: [(0, '-51.822')] [2022-07-12 23:11:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 4984.6). Total num frames: 71094272. Throughput: 0: 10226.8. Samples: 142186828. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:38,989][27935] Avg episode reward: [(0, '-52.141')] [2022-07-12 23:11:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 4988.1). Total num frames: 71120896. Throughput: 0: 10235.6. Samples: 142249388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:43,989][27935] Avg episode reward: [(0, '-51.980')] [2022-07-12 23:11:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.8, 300 sec: 4995.0). Total num frames: 71145472. Throughput: 0: 10319.6. Samples: 142311280. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:48,989][27935] Avg episode reward: [(0, '-52.673')] [2022-07-12 23:11:53,991][27935] Fps is (10 sec: 5118.8, 60 sec: 5153.9, 300 sec: 5012.4). Total num frames: 71172096. Throughput: 0: 10330.9. Samples: 142342440. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:53,992][27935] Avg episode reward: [(0, '-52.176')] [2022-07-12 23:11:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5040.2). Total num frames: 71198720. Throughput: 0: 10353.5. Samples: 142405224. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:11:58,989][27935] Avg episode reward: [(0, '-52.302')] [2022-07-12 23:12:03,989][27935] Fps is (10 sec: 5121.2, 60 sec: 5154.1, 300 sec: 5067.9). Total num frames: 71223296. Throughput: 0: 10262.3. Samples: 142462932. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:03,989][27935] Avg episode reward: [(0, '-53.198')] [2022-07-12 23:12:08,993][27935] Fps is (10 sec: 4811.0, 60 sec: 5119.7, 300 sec: 5078.3). Total num frames: 71246848. Throughput: 0: 10283.5. Samples: 142494544. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:08,993][27935] Avg episode reward: [(0, '-53.106')] [2022-07-12 23:12:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5154.1, 300 sec: 5092.2). Total num frames: 71274496. Throughput: 0: 10292.9. Samples: 142557284. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:13,990][27935] Avg episode reward: [(0, '-52.912')] [2022-07-12 23:12:18,989][27935] Fps is (10 sec: 5326.8, 60 sec: 5155.5, 300 sec: 5092.2). Total num frames: 71300096. Throughput: 0: 10304.4. Samples: 142619716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:18,989][27935] Avg episode reward: [(0, '-53.025')] [2022-07-12 23:12:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 71326720. Throughput: 0: 10308.4. Samples: 142650708. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:23,989][27935] Avg episode reward: [(0, '-53.032')] [2022-07-12 23:12:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5099.2). Total num frames: 71352320. Throughput: 0: 10297.4. Samples: 142712772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:28,989][27935] Avg episode reward: [(0, '-53.148')] [2022-07-12 23:12:33,993][27935] Fps is (10 sec: 5118.0, 60 sec: 5170.9, 300 sec: 5099.1). Total num frames: 71377920. Throughput: 0: 10288.8. Samples: 142774316. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:33,993][27935] Avg episode reward: [(0, '-53.004')] [2022-07-12 23:12:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5099.2). Total num frames: 71403520. Throughput: 0: 10282.2. Samples: 142805116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:38,989][27935] Avg episode reward: [(0, '-53.351')] [2022-07-12 23:12:43,989][27935] Fps is (10 sec: 4917.1, 60 sec: 5102.9, 300 sec: 5095.7). Total num frames: 71427072. Throughput: 0: 10206.8. Samples: 142864528. Policy #0 lag: (min: 0.0, avg: 9.0, max: 22.0) [2022-07-12 23:12:43,989][27935] Avg episode reward: [(0, '-53.464')] [2022-07-12 23:12:48,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 71453696. Throughput: 0: 10290.6. Samples: 142926012. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:12:48,989][27935] Avg episode reward: [(0, '-53.079')] [2022-07-12 23:12:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.2, 300 sec: 5106.1). Total num frames: 71479296. Throughput: 0: 10287.4. Samples: 142957440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:12:53,989][27935] Avg episode reward: [(0, '-53.005')] [2022-07-12 23:12:58,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 71506944. Throughput: 0: 10289.7. Samples: 143020320. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:12:58,989][27935] Avg episode reward: [(0, '-52.727')] [2022-07-12 23:13:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5109.6). Total num frames: 71528448. Throughput: 0: 10195.2. Samples: 143078500. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:03,989][27935] Avg episode reward: [(0, '-52.408')] [2022-07-12 23:13:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.5, 300 sec: 5109.6). Total num frames: 71556096. Throughput: 0: 10201.0. Samples: 143109752. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:08,989][27935] Avg episode reward: [(0, '-52.214')] [2022-07-12 23:13:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 71580672. Throughput: 0: 10211.3. Samples: 143172280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:13,989][27935] Avg episode reward: [(0, '-52.415')] [2022-07-12 23:13:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 71607296. Throughput: 0: 10233.5. Samples: 143234784. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:18,989][27935] Avg episode reward: [(0, '-52.709')] [2022-07-12 23:13:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 71632896. Throughput: 0: 10241.1. Samples: 143265964. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:23,989][27935] Avg episode reward: [(0, '-53.468')] [2022-07-12 23:13:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5127.0). Total num frames: 71658496. Throughput: 0: 10312.0. Samples: 143328568. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:28,989][27935] Avg episode reward: [(0, '-53.016')] [2022-07-12 23:13:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.4, 300 sec: 5130.4). Total num frames: 71686144. Throughput: 0: 10328.3. Samples: 143390784. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:33,989][27935] Avg episode reward: [(0, '-53.232')] [2022-07-12 23:13:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 71711744. Throughput: 0: 10330.5. Samples: 143422312. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:38,989][27935] Avg episode reward: [(0, '-52.962')] [2022-07-12 23:13:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5126.9). Total num frames: 71738368. Throughput: 0: 10312.3. Samples: 143484372. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:43,989][27935] Avg episode reward: [(0, '-53.333')] [2022-07-12 23:13:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5130.4). Total num frames: 71763968. Throughput: 0: 10410.3. Samples: 143546964. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:48,989][27935] Avg episode reward: [(0, '-52.442')] [2022-07-12 23:13:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 71788544. Throughput: 0: 10413.9. Samples: 143578376. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:53,989][27935] Avg episode reward: [(0, '-52.435')] [2022-07-12 23:13:58,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5153.8, 300 sec: 5140.8). Total num frames: 71816192. Throughput: 0: 10406.0. Samples: 143640588. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:13:58,993][27935] Avg episode reward: [(0, '-53.166')] [2022-07-12 23:14:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5130.4). Total num frames: 71839744. Throughput: 0: 10315.7. Samples: 143698988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:14:03,989][27935] Avg episode reward: [(0, '-53.555')] [2022-07-12 23:14:08,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 71866368. Throughput: 0: 10312.5. Samples: 143730028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-12 23:14:08,989][27935] Avg episode reward: [(0, '-53.317')] [2022-07-12 23:14:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5126.9). Total num frames: 71890944. Throughput: 0: 10304.0. Samples: 143792248. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:13,989][27935] Avg episode reward: [(0, '-53.026')] [2022-07-12 23:14:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 71917568. Throughput: 0: 10317.9. Samples: 143855088. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:18,989][27935] Avg episode reward: [(0, '-52.904')] [2022-07-12 23:14:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5133.9). Total num frames: 71944192. Throughput: 0: 10314.1. Samples: 143886444. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:23,990][27935] Avg episode reward: [(0, '-53.128')] [2022-07-12 23:14:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 71968768. Throughput: 0: 10262.8. Samples: 143946196. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:28,990][27935] Avg episode reward: [(0, '-52.652')] [2022-07-12 23:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 71993344. Throughput: 0: 10260.9. Samples: 144008704. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:33,989][27935] Avg episode reward: [(0, '-52.912')] [2022-07-12 23:14:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5140.8). Total num frames: 72022016. Throughput: 0: 10257.5. Samples: 144039964. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:38,989][27935] Avg episode reward: [(0, '-53.376')] [2022-07-12 23:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5126.9). Total num frames: 72042496. Throughput: 0: 10120.4. Samples: 144095968. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:43,989][27935] Avg episode reward: [(0, '-53.818')] [2022-07-12 23:14:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5068.8, 300 sec: 5123.5). Total num frames: 72068096. Throughput: 0: 10167.3. Samples: 144156516. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:48,989][27935] Avg episode reward: [(0, '-53.583')] [2022-07-12 23:14:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 72094720. Throughput: 0: 10162.6. Samples: 144187344. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:53,989][27935] Avg episode reward: [(0, '-53.915')] [2022-07-12 23:14:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5035.0, 300 sec: 5126.9). Total num frames: 72118272. Throughput: 0: 10165.3. Samples: 144249688. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:14:58,989][27935] Avg episode reward: [(0, '-53.485')] [2022-07-12 23:15:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5123.5). Total num frames: 72142848. Throughput: 0: 10011.2. Samples: 144305592. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:03,989][27935] Avg episode reward: [(0, '-54.360')] [2022-07-12 23:15:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5120.0). Total num frames: 72168448. Throughput: 0: 9998.3. Samples: 144336368. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:08,989][27935] Avg episode reward: [(0, '-53.085')] [2022-07-12 23:15:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5123.5). Total num frames: 72194048. Throughput: 0: 10035.5. Samples: 144397792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:13,989][27935] Avg episode reward: [(0, '-52.911')] [2022-07-12 23:15:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5120.0). Total num frames: 72219648. Throughput: 0: 10007.3. Samples: 144459032. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:18,989][27935] Avg episode reward: [(0, '-52.122')] [2022-07-12 23:15:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5123.5). Total num frames: 72245248. Throughput: 0: 9991.3. Samples: 144489572. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:23,989][27935] Avg episode reward: [(0, '-52.135')] [2022-07-12 23:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 5113.1). Total num frames: 72267776. Throughput: 0: 9945.2. Samples: 144543504. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:28,989][27935] Avg episode reward: [(0, '-52.191')] [2022-07-12 23:15:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 5102.6). Total num frames: 72292352. Throughput: 0: 9964.9. Samples: 144604936. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:33,989][27935] Avg episode reward: [(0, '-51.455')] [2022-07-12 23:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5102.6). Total num frames: 72316928. Throughput: 0: 9972.5. Samples: 144636108. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-12 23:15:38,989][27935] Avg episode reward: [(0, '-51.981')] [2022-07-12 23:15:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5106.3). Total num frames: 72344576. Throughput: 0: 9949.4. Samples: 144697412. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:15:43,989][27935] Avg episode reward: [(0, '-52.214')] [2022-07-12 23:15:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5106.1). Total num frames: 72369152. Throughput: 0: 10088.8. Samples: 144759588. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:15:48,989][27935] Avg episode reward: [(0, '-52.361')] [2022-07-12 23:15:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5102.6). Total num frames: 72394752. Throughput: 0: 10093.0. Samples: 144790552. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:15:53,989][27935] Avg episode reward: [(0, '-52.739')] [2022-07-12 23:15:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5102.6). Total num frames: 72419328. Throughput: 0: 10034.2. Samples: 144849332. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:15:58,989][27935] Avg episode reward: [(0, '-52.725')] [2022-07-12 23:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4966.4, 300 sec: 5088.8). Total num frames: 72440832. Throughput: 0: 9850.0. Samples: 144902280. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:03,989][27935] Avg episode reward: [(0, '-52.437')] [2022-07-12 23:16:08,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4846.9, 300 sec: 5064.5). Total num frames: 72459264. Throughput: 0: 9730.3. Samples: 144927436. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:08,989][27935] Avg episode reward: [(0, '-52.629')] [2022-07-12 23:16:13,989][27935] Fps is (10 sec: 3686.4, 60 sec: 4727.5, 300 sec: 5040.4). Total num frames: 72477696. Throughput: 0: 9412.5. Samples: 144967068. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:13,989][27935] Avg episode reward: [(0, '-52.639')] [2022-07-12 23:16:18,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4693.3, 300 sec: 5026.3). Total num frames: 72501248. Throughput: 0: 9251.8. Samples: 145021268. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:18,989][27935] Avg episode reward: [(0, '-52.527')] [2022-07-12 23:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 5029.7). Total num frames: 72525824. Throughput: 0: 9200.7. Samples: 145050140. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:23,989][27935] Avg episode reward: [(0, '-52.831')] [2022-07-12 23:16:29,001][27935] Fps is (10 sec: 4807.1, 60 sec: 4692.4, 300 sec: 5022.6). Total num frames: 72549376. Throughput: 0: 9133.7. Samples: 145108536. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:29,001][27935] Avg episode reward: [(0, '-52.711')] [2022-07-12 23:16:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 5005.5). Total num frames: 72570880. Throughput: 0: 8979.0. Samples: 145163644. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:33,989][27935] Avg episode reward: [(0, '-52.282')] [2022-07-12 23:16:38,989][27935] Fps is (10 sec: 4613.5, 60 sec: 4642.1, 300 sec: 4998.5). Total num frames: 72595456. Throughput: 0: 8950.8. Samples: 145193336. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:38,989][27935] Avg episode reward: [(0, '-52.097')] [2022-07-12 23:16:43,990][27935] Fps is (10 sec: 4300.2, 60 sec: 4488.4, 300 sec: 4977.7). Total num frames: 72613888. Throughput: 0: 8621.3. Samples: 145237304. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:43,991][27935] Avg episode reward: [(0, '-50.992')] [2022-07-12 23:16:48,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4454.4, 300 sec: 4963.8). Total num frames: 72636416. Throughput: 0: 8689.8. Samples: 145293320. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:48,989][27935] Avg episode reward: [(0, '-50.812')] [2022-07-12 23:16:53,989][27935] Fps is (10 sec: 4915.9, 60 sec: 4471.5, 300 sec: 4963.8). Total num frames: 72663040. Throughput: 0: 8826.0. Samples: 145324608. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:53,989][27935] Avg episode reward: [(0, '-51.223')] [2022-07-12 23:16:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4488.5, 300 sec: 4967.3). Total num frames: 72688640. Throughput: 0: 9306.6. Samples: 145385864. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:16:58,989][27935] Avg episode reward: [(0, '-51.539')] [2022-07-12 23:17:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4522.7, 300 sec: 4967.3). Total num frames: 72712192. Throughput: 0: 9369.5. Samples: 145442896. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-12 23:17:03,989][27935] Avg episode reward: [(0, '-51.539')] [2022-07-12 23:17:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4956.9). Total num frames: 72736768. Throughput: 0: 9403.4. Samples: 145473292. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:08,989][27935] Avg episode reward: [(0, '-51.794')] [2022-07-12 23:17:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4956.9). Total num frames: 72762368. Throughput: 0: 9460.9. Samples: 145534164. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:13,989][27935] Avg episode reward: [(0, '-52.188')] [2022-07-12 23:17:18,991][27935] Fps is (10 sec: 4811.7, 60 sec: 4727.3, 300 sec: 4942.9). Total num frames: 72784896. Throughput: 0: 9498.9. Samples: 145591116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:18,992][27935] Avg episode reward: [(0, '-52.230')] [2022-07-12 23:17:23,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4929.1). Total num frames: 72806400. Throughput: 0: 9373.9. Samples: 145615160. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:23,989][27935] Avg episode reward: [(0, '-52.195')] [2022-07-12 23:17:28,989][27935] Fps is (10 sec: 4301.8, 60 sec: 4643.0, 300 sec: 4915.3). Total num frames: 72827904. Throughput: 0: 9539.5. Samples: 145666568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:28,990][27935] Avg episode reward: [(0, '-51.817')] [2022-07-12 23:17:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4918.7). Total num frames: 72854528. Throughput: 0: 9656.0. Samples: 145727840. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:33,989][27935] Avg episode reward: [(0, '-51.584')] [2022-07-12 23:17:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4744.5, 300 sec: 4925.6). Total num frames: 72880128. Throughput: 0: 9648.4. Samples: 145758788. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:38,989][27935] Avg episode reward: [(0, '-51.379')] [2022-07-12 23:17:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.0, 300 sec: 4918.7). Total num frames: 72904704. Throughput: 0: 9611.2. Samples: 145818368. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:43,989][27935] Avg episode reward: [(0, '-51.819')] [2022-07-12 23:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4915.2). Total num frames: 72929280. Throughput: 0: 9697.2. Samples: 145879268. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:48,989][27935] Avg episode reward: [(0, '-52.363')] [2022-07-12 23:17:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4911.7). Total num frames: 72955904. Throughput: 0: 9695.0. Samples: 145909568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:53,989][27935] Avg episode reward: [(0, '-52.604')] [2022-07-12 23:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4915.2). Total num frames: 72978432. Throughput: 0: 9635.8. Samples: 145967776. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:17:58,989][27935] Avg episode reward: [(0, '-52.501')] [2022-07-12 23:18:03,991][27935] Fps is (10 sec: 4402.3, 60 sec: 4795.6, 300 sec: 4894.3). Total num frames: 72999936. Throughput: 0: 9487.2. Samples: 146018036. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:03,991][27935] Avg episode reward: [(0, '-52.575')] [2022-07-12 23:18:08,989][27935] Fps is (10 sec: 3788.8, 60 sec: 4659.2, 300 sec: 4866.6). Total num frames: 73016320. Throughput: 0: 9417.9. Samples: 146038964. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:08,989][27935] Avg episode reward: [(0, '-52.398')] [2022-07-12 23:18:13,989][27935] Fps is (10 sec: 3687.1, 60 sec: 4573.9, 300 sec: 4845.8). Total num frames: 73036800. Throughput: 0: 9260.8. Samples: 146083304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:13,992][27935] Avg episode reward: [(0, '-52.216')] [2022-07-12 23:18:18,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4539.9, 300 sec: 4828.4). Total num frames: 73057280. Throughput: 0: 8986.9. Samples: 146132248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:18,989][27935] Avg episode reward: [(0, '-51.898')] [2022-07-12 23:18:23,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4505.6, 300 sec: 4807.6). Total num frames: 73076736. Throughput: 0: 8815.2. Samples: 146155472. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:23,989][27935] Avg episode reward: [(0, '-51.786')] [2022-07-12 23:18:28,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4522.7, 300 sec: 4790.2). Total num frames: 73099264. Throughput: 0: 8661.6. Samples: 146208140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-12 23:18:28,989][27935] Avg episode reward: [(0, '-51.664')] [2022-07-12 23:18:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4471.5, 300 sec: 4783.3). Total num frames: 73122816. Throughput: 0: 8594.1. Samples: 146266004. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:33,989][27935] Avg episode reward: [(0, '-51.390')] [2022-07-12 23:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4437.3, 300 sec: 4772.9). Total num frames: 73146368. Throughput: 0: 8526.0. Samples: 146293240. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:38,989][27935] Avg episode reward: [(0, '-51.449')] [2022-07-12 23:18:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4454.4, 300 sec: 4772.9). Total num frames: 73171968. Throughput: 0: 8560.3. Samples: 146352988. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:43,990][27935] Avg episode reward: [(0, '-51.995')] [2022-07-12 23:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4437.3, 300 sec: 4769.4). Total num frames: 73195520. Throughput: 0: 8738.7. Samples: 146411260. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:48,990][27935] Avg episode reward: [(0, '-52.394')] [2022-07-12 23:18:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4420.3, 300 sec: 4762.5). Total num frames: 73221120. Throughput: 0: 8949.2. Samples: 146441676. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:53,989][27935] Avg episode reward: [(0, '-52.257')] [2022-07-12 23:18:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4471.5, 300 sec: 4769.4). Total num frames: 73246720. Throughput: 0: 9331.6. Samples: 146503228. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:18:58,989][27935] Avg episode reward: [(0, '-52.241')] [2022-07-12 23:19:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4471.6, 300 sec: 4752.1). Total num frames: 73268224. Throughput: 0: 9422.0. Samples: 146556240. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:03,990][27935] Avg episode reward: [(0, '-52.034')] [2022-07-12 23:19:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4556.8, 300 sec: 4741.6). Total num frames: 73289728. Throughput: 0: 9445.1. Samples: 146580500. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:08,989][27935] Avg episode reward: [(0, '-52.019')] [2022-07-12 23:19:13,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4539.7, 300 sec: 4717.3). Total num frames: 73309184. Throughput: 0: 9404.9. Samples: 146631360. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:13,989][27935] Avg episode reward: [(0, '-51.632')] [2022-07-12 23:19:18,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4573.9, 300 sec: 4703.5). Total num frames: 73331712. Throughput: 0: 9302.1. Samples: 146684600. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:18,990][27935] Avg episode reward: [(0, '-52.301')] [2022-07-12 23:19:23,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4659.2, 300 sec: 4703.5). Total num frames: 73356288. Throughput: 0: 9288.0. Samples: 146711200. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:23,989][27935] Avg episode reward: [(0, '-52.165')] [2022-07-12 23:19:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 73380864. Throughput: 0: 9299.4. Samples: 146771460. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:28,990][27935] Avg episode reward: [(0, '-51.950')] [2022-07-12 23:19:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 73406464. Throughput: 0: 9363.8. Samples: 146832632. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:33,989][27935] Avg episode reward: [(0, '-52.638')] [2022-07-12 23:19:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4706.9). Total num frames: 73431040. Throughput: 0: 9365.2. Samples: 146863112. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:38,989][27935] Avg episode reward: [(0, '-52.586')] [2022-07-12 23:19:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 73453568. Throughput: 0: 9188.2. Samples: 146916696. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:43,991][27935] Avg episode reward: [(0, '-52.652')] [2022-07-12 23:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 73479168. Throughput: 0: 9341.6. Samples: 146976612. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:48,991][27935] Avg episode reward: [(0, '-52.641')] [2022-07-12 23:19:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 73503744. Throughput: 0: 9488.8. Samples: 147007496. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:53,991][27935] Avg episode reward: [(0, '-52.804')] [2022-07-12 23:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 73528320. Throughput: 0: 9719.0. Samples: 147068712. Policy #0 lag: (min: 0.0, avg: 10.4, max: 22.0) [2022-07-12 23:19:58,990][27935] Avg episode reward: [(0, '-52.775')] [2022-07-12 23:20:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4693.0). Total num frames: 73552896. Throughput: 0: 9809.1. Samples: 147126008. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:03,991][27935] Avg episode reward: [(0, '-52.196')] [2022-07-12 23:20:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4689.6). Total num frames: 73577472. Throughput: 0: 9849.4. Samples: 147154424. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:08,989][27935] Avg episode reward: [(0, '-52.171')] [2022-07-12 23:20:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4679.2). Total num frames: 73600000. Throughput: 0: 9806.7. Samples: 147212760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:13,989][27935] Avg episode reward: [(0, '-52.729')] [2022-07-12 23:20:18,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4761.6, 300 sec: 4651.4). Total num frames: 73617408. Throughput: 0: 9378.1. Samples: 147254644. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:18,990][27935] Avg episode reward: [(0, '-52.778')] [2022-07-12 23:20:23,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 73635840. Throughput: 0: 9183.8. Samples: 147276384. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:23,990][27935] Avg episode reward: [(0, '-52.463')] [2022-07-12 23:20:28,989][27935] Fps is (10 sec: 3788.7, 60 sec: 4573.9, 300 sec: 4620.1). Total num frames: 73655296. Throughput: 0: 9095.6. Samples: 147326000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:28,989][27935] Avg episode reward: [(0, '-52.129')] [2022-07-12 23:20:33,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4488.5, 300 sec: 4606.3). Total num frames: 73675776. Throughput: 0: 8787.0. Samples: 147372028. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:33,990][27935] Avg episode reward: [(0, '-51.799')] [2022-07-12 23:20:38,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4403.2, 300 sec: 4578.5). Total num frames: 73695232. Throughput: 0: 8605.4. Samples: 147394740. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:38,989][27935] Avg episode reward: [(0, '-52.138')] [2022-07-12 23:20:43,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4386.1, 300 sec: 4568.1). Total num frames: 73716736. Throughput: 0: 8295.8. Samples: 147442024. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:43,989][27935] Avg episode reward: [(0, '-52.520')] [2022-07-12 23:20:48,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4300.8, 300 sec: 4550.7). Total num frames: 73737216. Throughput: 0: 8158.4. Samples: 147493136. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:48,989][27935] Avg episode reward: [(0, '-52.464')] [2022-07-12 23:20:53,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4232.5, 300 sec: 4536.8). Total num frames: 73757696. Throughput: 0: 8075.7. Samples: 147517832. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:53,989][27935] Avg episode reward: [(0, '-51.922')] [2022-07-12 23:20:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4249.6, 300 sec: 4550.7). Total num frames: 73783296. Throughput: 0: 8083.6. Samples: 147576524. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:20:58,989][27935] Avg episode reward: [(0, '-51.432')] [2022-07-12 23:21:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4215.5, 300 sec: 4564.6). Total num frames: 73805824. Throughput: 0: 8380.7. Samples: 147631776. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:21:03,989][27935] Avg episode reward: [(0, '-51.885')] [2022-07-12 23:21:08,990][27935] Fps is (10 sec: 4914.8, 60 sec: 4249.5, 300 sec: 4592.4). Total num frames: 73832448. Throughput: 0: 8570.0. Samples: 147662040. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:21:08,990][27935] Avg episode reward: [(0, '-51.959')] [2022-07-12 23:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4266.7, 300 sec: 4592.4). Total num frames: 73856000. Throughput: 0: 8835.8. Samples: 147723612. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:21:13,990][27935] Avg episode reward: [(0, '-51.773')] [2022-07-12 23:21:18,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4386.1, 300 sec: 4592.4). Total num frames: 73880576. Throughput: 0: 9064.6. Samples: 147779936. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:21:18,989][27935] Avg episode reward: [(0, '-51.066')] [2022-07-12 23:21:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4454.4, 300 sec: 4589.1). Total num frames: 73903104. Throughput: 0: 9152.0. Samples: 147806580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-12 23:21:23,989][27935] Avg episode reward: [(0, '-51.335')] [2022-07-12 23:21:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4522.7, 300 sec: 4595.9). Total num frames: 73926656. Throughput: 0: 9430.8. Samples: 147866412. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:28,989][27935] Avg episode reward: [(0, '-52.288')] [2022-07-12 23:21:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4625.1, 300 sec: 4602.8). Total num frames: 73953280. Throughput: 0: 8958.1. Samples: 147896252. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:33,989][27935] Avg episode reward: [(0, '-52.165')] [2022-07-12 23:21:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4620.2). Total num frames: 73976832. Throughput: 0: 9712.3. Samples: 147954884. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:38,989][27935] Avg episode reward: [(0, '-52.152')] [2022-07-12 23:21:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4620.1). Total num frames: 73999360. Throughput: 0: 9567.2. Samples: 148007048. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:43,989][27935] Avg episode reward: [(0, '-53.260')] [2022-07-12 23:21:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4613.2). Total num frames: 74023936. Throughput: 0: 9673.9. Samples: 148067100. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:48,989][27935] Avg episode reward: [(0, '-53.099')] [2022-07-12 23:21:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4602.8). Total num frames: 74046464. Throughput: 0: 9625.8. Samples: 148095192. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:53,990][27935] Avg episode reward: [(0, '-53.178')] [2022-07-12 23:21:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4744.5, 300 sec: 4595.9). Total num frames: 74067968. Throughput: 0: 9418.2. Samples: 148147432. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:21:58,989][27935] Avg episode reward: [(0, '-53.209')] [2022-07-12 23:22:03,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4710.4, 300 sec: 4582.0). Total num frames: 74088448. Throughput: 0: 8725.5. Samples: 148172584. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:03,989][27935] Avg episode reward: [(0, '-53.127')] [2022-07-12 23:22:08,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4625.1, 300 sec: 4568.1). Total num frames: 74109952. Throughput: 0: 9232.2. Samples: 148222028. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:08,991][27935] Avg episode reward: [(0, '-52.562')] [2022-07-12 23:22:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4571.6). Total num frames: 74133504. Throughput: 0: 9124.5. Samples: 148277012. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:13,992][27935] Avg episode reward: [(0, '-52.474')] [2022-07-12 23:22:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4575.0). Total num frames: 74156032. Throughput: 0: 9066.2. Samples: 148304232. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:18,989][27935] Avg episode reward: [(0, '-51.532')] [2022-07-12 23:22:23,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4556.8, 300 sec: 4571.6). Total num frames: 74176512. Throughput: 0: 8915.8. Samples: 148356096. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:23,989][27935] Avg episode reward: [(0, '-51.982')] [2022-07-12 23:22:28,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4539.7, 300 sec: 4557.7). Total num frames: 74199040. Throughput: 0: 8907.7. Samples: 148407896. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:28,990][27935] Avg episode reward: [(0, '-52.049')] [2022-07-12 23:22:33,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4454.4, 300 sec: 4543.8). Total num frames: 74220544. Throughput: 0: 8733.7. Samples: 148460116. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:33,989][27935] Avg episode reward: [(0, '-52.091')] [2022-07-12 23:22:38,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4420.3, 300 sec: 4533.4). Total num frames: 74242048. Throughput: 0: 8678.5. Samples: 148485724. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:38,989][27935] Avg episode reward: [(0, '-51.819')] [2022-07-12 23:22:43,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4386.1, 300 sec: 4519.5). Total num frames: 74262528. Throughput: 0: 8677.7. Samples: 148537928. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:43,989][27935] Avg episode reward: [(0, '-52.293')] [2022-07-12 23:22:48,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4317.9, 300 sec: 4498.7). Total num frames: 74283008. Throughput: 0: 9216.2. Samples: 148587316. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:48,989][27935] Avg episode reward: [(0, '-52.216')] [2022-07-12 23:22:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4334.9, 300 sec: 4502.1). Total num frames: 74306560. Throughput: 0: 8721.2. Samples: 148614480. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-12 23:22:53,989][27935] Avg episode reward: [(0, '-52.609')] [2022-07-12 23:22:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4317.9, 300 sec: 4498.7). Total num frames: 74327040. Throughput: 0: 8601.8. Samples: 148664092. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:22:58,989][27935] Avg episode reward: [(0, '-52.208')] [2022-07-12 23:23:03,989][27935] Fps is (10 sec: 3788.8, 60 sec: 4266.7, 300 sec: 4502.1). Total num frames: 74344448. Throughput: 0: 8969.1. Samples: 148707840. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:03,989][27935] Avg episode reward: [(0, '-51.992')] [2022-07-12 23:23:08,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4283.7, 300 sec: 4509.1). Total num frames: 74366976. Throughput: 0: 8415.3. Samples: 148734784. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:08,989][27935] Avg episode reward: [(0, '-51.936')] [2022-07-12 23:23:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4317.9, 300 sec: 4526.4). Total num frames: 74392576. Throughput: 0: 8566.9. Samples: 148793408. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:13,989][27935] Avg episode reward: [(0, '-51.808')] [2022-07-12 23:23:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4352.0, 300 sec: 4543.8). Total num frames: 74417152. Throughput: 0: 8770.8. Samples: 148854800. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:18,989][27935] Avg episode reward: [(0, '-52.199')] [2022-07-12 23:23:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4454.4, 300 sec: 4557.7). Total num frames: 74443776. Throughput: 0: 8875.5. Samples: 148885120. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:23,989][27935] Avg episode reward: [(0, '-52.471')] [2022-07-12 23:23:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4488.5, 300 sec: 4561.1). Total num frames: 74468352. Throughput: 0: 9081.5. Samples: 148946596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:28,989][27935] Avg episode reward: [(0, '-52.770')] [2022-07-12 23:23:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4505.6, 300 sec: 4557.7). Total num frames: 74490880. Throughput: 0: 9217.1. Samples: 149002084. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:33,989][27935] Avg episode reward: [(0, '-52.977')] [2022-07-12 23:23:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4522.7, 300 sec: 4547.3). Total num frames: 74513408. Throughput: 0: 9208.1. Samples: 149028844. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:38,989][27935] Avg episode reward: [(0, '-52.963')] [2022-07-12 23:23:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4554.2). Total num frames: 74539008. Throughput: 0: 9397.9. Samples: 149086996. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:43,990][27935] Avg episode reward: [(0, '-52.362')] [2022-07-12 23:23:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4659.2, 300 sec: 4547.3). Total num frames: 74562560. Throughput: 0: 9721.2. Samples: 149145292. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:48,989][27935] Avg episode reward: [(0, '-51.987')] [2022-07-12 23:23:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4550.7). Total num frames: 74589184. Throughput: 0: 9785.4. Samples: 149175128. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:53,989][27935] Avg episode reward: [(0, '-51.683')] [2022-07-12 23:23:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4557.7). Total num frames: 74612736. Throughput: 0: 9861.5. Samples: 149237176. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:23:58,989][27935] Avg episode reward: [(0, '-51.069')] [2022-07-12 23:24:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4568.1). Total num frames: 74637312. Throughput: 0: 9770.5. Samples: 149294472. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:24:03,989][27935] Avg episode reward: [(0, '-50.471')] [2022-07-12 23:24:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4578.5). Total num frames: 74659840. Throughput: 0: 9711.9. Samples: 149322156. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:24:08,989][27935] Avg episode reward: [(0, '-50.132')] [2022-07-12 23:24:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4812.8, 300 sec: 4575.0). Total num frames: 74681344. Throughput: 0: 9494.3. Samples: 149373840. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:24:13,989][27935] Avg episode reward: [(0, '-50.757')] [2022-07-12 23:24:18,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4744.5, 300 sec: 4561.1). Total num frames: 74701824. Throughput: 0: 9355.6. Samples: 149423088. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:24:18,989][27935] Avg episode reward: [(0, '-50.470')] [2022-07-12 23:24:23,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4625.1, 300 sec: 4543.8). Total num frames: 74721280. Throughput: 0: 9290.9. Samples: 149446936. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-12 23:24:23,989][27935] Avg episode reward: [(0, '-50.226')] [2022-07-12 23:24:28,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4573.9, 300 sec: 4529.9). Total num frames: 74742784. Throughput: 0: 9132.0. Samples: 149497936. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:28,989][27935] Avg episode reward: [(0, '-50.839')] [2022-07-12 23:24:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4529.9). Total num frames: 74767360. Throughput: 0: 9080.4. Samples: 149553908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:33,989][27935] Avg episode reward: [(0, '-50.944')] [2022-07-12 23:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4536.8). Total num frames: 74791936. Throughput: 0: 9084.4. Samples: 149583928. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:38,989][27935] Avg episode reward: [(0, '-51.378')] [2022-07-12 23:24:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4642.1, 300 sec: 4536.8). Total num frames: 74817536. Throughput: 0: 9050.7. Samples: 149644456. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:43,989][27935] Avg episode reward: [(0, '-51.856')] [2022-07-12 23:24:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4533.4). Total num frames: 74841088. Throughput: 0: 9085.4. Samples: 149703316. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:48,989][27935] Avg episode reward: [(0, '-51.784')] [2022-07-12 23:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4625.1, 300 sec: 4536.8). Total num frames: 74866688. Throughput: 0: 9113.3. Samples: 149732252. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:53,989][27935] Avg episode reward: [(0, '-52.002')] [2022-07-12 23:24:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4642.1, 300 sec: 4536.8). Total num frames: 74891264. Throughput: 0: 9308.5. Samples: 149792724. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:24:58,995][27935] Avg episode reward: [(0, '-51.863')] [2022-07-12 23:25:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4533.4). Total num frames: 74914816. Throughput: 0: 8895.8. Samples: 149823400. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:03,989][27935] Avg episode reward: [(0, '-52.058')] [2022-07-12 23:25:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4547.3). Total num frames: 74941440. Throughput: 0: 9642.4. Samples: 149880844. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:08,989][27935] Avg episode reward: [(0, '-52.069')] [2022-07-12 23:25:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 4744.5, 300 sec: 4571.5). Total num frames: 74966016. Throughput: 0: 9867.9. Samples: 149941992. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:13,989][27935] Avg episode reward: [(0, '-51.877')] [2022-07-12 23:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4595.8). Total num frames: 74991616. Throughput: 0: 9969.4. Samples: 150002532. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:18,989][27935] Avg episode reward: [(0, '-51.489')] [2022-07-12 23:25:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4915.2, 300 sec: 4613.2). Total num frames: 75016192. Throughput: 0: 9971.7. Samples: 150032656. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:23,989][27935] Avg episode reward: [(0, '-51.494')] [2022-07-12 23:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 4627.1). Total num frames: 75040768. Throughput: 0: 9952.7. Samples: 150092328. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:28,989][27935] Avg episode reward: [(0, '-52.177')] [2022-07-12 23:25:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4651.4). Total num frames: 75067392. Throughput: 0: 10000.5. Samples: 150153336. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:33,989][27935] Avg episode reward: [(0, '-51.699')] [2022-07-12 23:25:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4661.8). Total num frames: 75091968. Throughput: 0: 10039.6. Samples: 150184032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:38,989][27935] Avg episode reward: [(0, '-51.310')] [2022-07-12 23:25:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4682.6). Total num frames: 75118592. Throughput: 0: 10048.3. Samples: 150244900. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:43,989][27935] Avg episode reward: [(0, '-52.033')] [2022-07-12 23:25:48,991][27935] Fps is (10 sec: 5016.7, 60 sec: 5017.5, 300 sec: 4693.0). Total num frames: 75142144. Throughput: 0: 10695.3. Samples: 150304708. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:48,991][27935] Avg episode reward: [(0, '-51.277')] [2022-07-12 23:25:53,992][27935] Fps is (10 sec: 5016.2, 60 sec: 5034.4, 300 sec: 4696.5). Total num frames: 75168768. Throughput: 0: 10100.6. Samples: 150335400. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-12 23:25:53,992][27935] Avg episode reward: [(0, '-51.026')] [2022-07-12 23:25:58,989][27935] Fps is (10 sec: 5120.9, 60 sec: 5034.7, 300 sec: 4703.5). Total num frames: 75193344. Throughput: 0: 10093.9. Samples: 150396216. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:25:58,989][27935] Avg episode reward: [(0, '-51.440')] [2022-07-12 23:26:03,989][27935] Fps is (10 sec: 4711.7, 60 sec: 5017.6, 300 sec: 4689.6). Total num frames: 75215872. Throughput: 0: 10010.6. Samples: 150453008. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:04,000][27935] Avg episode reward: [(0, '-51.941')] [2022-07-12 23:26:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4700.0). Total num frames: 75242496. Throughput: 0: 9996.0. Samples: 150482476. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:08,989][27935] Avg episode reward: [(0, '-51.802')] [2022-07-12 23:26:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4703.5). Total num frames: 75268096. Throughput: 0: 10033.2. Samples: 150543820. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:13,990][27935] Avg episode reward: [(0, '-51.901')] [2022-07-12 23:26:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4710.4). Total num frames: 75292672. Throughput: 0: 10024.9. Samples: 150604456. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:18,989][27935] Avg episode reward: [(0, '-51.521')] [2022-07-12 23:26:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4713.9). Total num frames: 75317248. Throughput: 0: 10028.9. Samples: 150635332. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:23,989][27935] Avg episode reward: [(0, '-52.435')] [2022-07-12 23:26:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4710.4). Total num frames: 75342848. Throughput: 0: 10026.6. Samples: 150696096. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:28,990][27935] Avg episode reward: [(0, '-52.584')] [2022-07-12 23:26:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4717.3). Total num frames: 75368448. Throughput: 0: 10009.2. Samples: 150755104. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:33,989][27935] Avg episode reward: [(0, '-52.600')] [2022-07-12 23:26:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4717.3). Total num frames: 75390976. Throughput: 0: 9993.3. Samples: 150785068. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:38,989][27935] Avg episode reward: [(0, '-52.148')] [2022-07-12 23:26:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4727.8). Total num frames: 75418624. Throughput: 0: 9977.9. Samples: 150845220. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:43,989][27935] Avg episode reward: [(0, '-52.006')] [2022-07-12 23:26:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.7, 300 sec: 4731.2). Total num frames: 75442176. Throughput: 0: 10060.2. Samples: 150905716. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:48,989][27935] Avg episode reward: [(0, '-52.635')] [2022-07-12 23:26:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.8, 300 sec: 4748.6). Total num frames: 75468800. Throughput: 0: 10078.3. Samples: 150936000. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:53,990][27935] Avg episode reward: [(0, '-53.373')] [2022-07-12 23:26:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4762.5). Total num frames: 75493376. Throughput: 0: 10057.3. Samples: 150996396. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:26:58,989][27935] Avg episode reward: [(0, '-53.390')] [2022-07-12 23:27:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4983.5, 300 sec: 4762.5). Total num frames: 75514880. Throughput: 0: 9959.2. Samples: 151052620. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:27:03,989][27935] Avg episode reward: [(0, '-52.844')] [2022-07-12 23:27:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 4769.4). Total num frames: 75540480. Throughput: 0: 9942.5. Samples: 151082744. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:27:08,989][27935] Avg episode reward: [(0, '-53.334')] [2022-07-12 23:27:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4779.8). Total num frames: 75566080. Throughput: 0: 9934.8. Samples: 151143164. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:27:13,989][27935] Avg episode reward: [(0, '-53.855')] [2022-07-12 23:27:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4800.6). Total num frames: 75592704. Throughput: 0: 9967.6. Samples: 151203648. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:27:18,989][27935] Avg episode reward: [(0, '-53.645')] [2022-07-12 23:27:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4807.6). Total num frames: 75617280. Throughput: 0: 9979.3. Samples: 151234136. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-12 23:27:23,989][27935] Avg episode reward: [(0, '-53.496')] [2022-07-12 23:27:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4818.0). Total num frames: 75641856. Throughput: 0: 9976.3. Samples: 151294152. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:28,989][27935] Avg episode reward: [(0, '-52.583')] [2022-07-12 23:27:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4831.9). Total num frames: 75667456. Throughput: 0: 9971.3. Samples: 151354424. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:33,989][27935] Avg episode reward: [(0, '-52.341')] [2022-07-12 23:27:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4845.8). Total num frames: 75692032. Throughput: 0: 9962.0. Samples: 151384288. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:38,990][27935] Avg episode reward: [(0, '-51.769')] [2022-07-12 23:27:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4852.7). Total num frames: 75714560. Throughput: 0: 9864.7. Samples: 151440308. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:43,989][27935] Avg episode reward: [(0, '-52.838')] [2022-07-12 23:27:48,992][27935] Fps is (10 sec: 4401.7, 60 sec: 4897.9, 300 sec: 4845.7). Total num frames: 75736064. Throughput: 0: 9738.0. Samples: 151490864. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:48,993][27935] Avg episode reward: [(0, '-52.874')] [2022-07-12 23:27:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 75758592. Throughput: 0: 9648.3. Samples: 151516916. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:53,989][27935] Avg episode reward: [(0, '-52.120')] [2022-07-12 23:27:58,989][27935] Fps is (10 sec: 4302.3, 60 sec: 4761.6, 300 sec: 4863.1). Total num frames: 75779072. Throughput: 0: 9462.5. Samples: 151568976. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:27:58,989][27935] Avg episode reward: [(0, '-52.285')] [2022-07-12 23:28:03,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4761.6, 300 sec: 4859.7). Total num frames: 75800576. Throughput: 0: 9227.9. Samples: 151618904. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:03,991][27935] Avg episode reward: [(0, '-51.915')] [2022-07-12 23:28:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 4849.2). Total num frames: 75823104. Throughput: 0: 9154.2. Samples: 151646076. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:08,989][27935] Avg episode reward: [(0, '-51.305')] [2022-07-12 23:28:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4849.2). Total num frames: 75847680. Throughput: 0: 9132.5. Samples: 151705116. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:13,989][27935] Avg episode reward: [(0, '-51.654')] [2022-07-12 23:28:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4693.3, 300 sec: 4849.2). Total num frames: 75874304. Throughput: 0: 9143.2. Samples: 151765868. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:18,991][27935] Avg episode reward: [(0, '-50.484')] [2022-07-12 23:28:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4676.3, 300 sec: 4845.8). Total num frames: 75897856. Throughput: 0: 9162.0. Samples: 151796576. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:23,989][27935] Avg episode reward: [(0, '-50.171')] [2022-07-12 23:28:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4727.5, 300 sec: 4863.1). Total num frames: 75925504. Throughput: 0: 9293.8. Samples: 151858528. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:28,990][27935] Avg episode reward: [(0, '-49.946')] [2022-07-12 23:28:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4710.4, 300 sec: 4870.1). Total num frames: 75950080. Throughput: 0: 9526.9. Samples: 151919540. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:33,991][27935] Avg episode reward: [(0, '-49.977')] [2022-07-12 23:28:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4866.6). Total num frames: 75974656. Throughput: 0: 9630.1. Samples: 151950272. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:38,990][27935] Avg episode reward: [(0, '-50.515')] [2022-07-12 23:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4795.7, 300 sec: 4880.5). Total num frames: 76002304. Throughput: 0: 9841.1. Samples: 152011824. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:43,989][27935] Avg episode reward: [(0, '-50.484')] [2022-07-12 23:28:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4847.2, 300 sec: 4873.5). Total num frames: 76026880. Throughput: 0: 10087.5. Samples: 152072844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:48,991][27935] Avg episode reward: [(0, '-50.418')] [2022-07-12 23:28:53,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4880.9, 300 sec: 4877.0). Total num frames: 76051456. Throughput: 0: 10166.2. Samples: 152103580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-12 23:28:54,000][27935] Avg episode reward: [(0, '-51.066')] [2022-07-12 23:28:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4880.5). Total num frames: 76077056. Throughput: 0: 10218.9. Samples: 152164968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:28:58,989][27935] Avg episode reward: [(0, '-50.838')] [2022-07-12 23:29:03,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4983.5, 300 sec: 4880.5). Total num frames: 76099584. Throughput: 0: 10050.7. Samples: 152218148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:03,989][27935] Avg episode reward: [(0, '-52.056')] [2022-07-12 23:29:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 4894.4). Total num frames: 76125184. Throughput: 0: 10037.2. Samples: 152248252. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:08,989][27935] Avg episode reward: [(0, '-51.936')] [2022-07-12 23:29:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4911.7). Total num frames: 76150784. Throughput: 0: 10016.7. Samples: 152309280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:13,989][27935] Avg episode reward: [(0, '-51.737')] [2022-07-12 23:29:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4929.1). Total num frames: 76175360. Throughput: 0: 10017.9. Samples: 152370344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:18,989][27935] Avg episode reward: [(0, '-51.795')] [2022-07-12 23:29:23,990][27935] Fps is (10 sec: 5017.0, 60 sec: 5051.6, 300 sec: 4942.9). Total num frames: 76200960. Throughput: 0: 10009.2. Samples: 152400700. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:23,991][27935] Avg episode reward: [(0, '-52.648')] [2022-07-12 23:29:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4946.4). Total num frames: 76226560. Throughput: 0: 10013.9. Samples: 152462448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:28,989][27935] Avg episode reward: [(0, '-51.978')] [2022-07-12 23:29:33,989][27935] Fps is (10 sec: 5120.7, 60 sec: 5034.7, 300 sec: 4949.9). Total num frames: 76252160. Throughput: 0: 10012.1. Samples: 152523388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:33,989][27935] Avg episode reward: [(0, '-52.275')] [2022-07-12 23:29:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4946.4). Total num frames: 76276736. Throughput: 0: 9999.1. Samples: 152553516. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:38,989][27935] Avg episode reward: [(0, '-52.108')] [2022-07-12 23:29:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4953.4). Total num frames: 76302336. Throughput: 0: 9998.0. Samples: 152614880. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:43,989][27935] Avg episode reward: [(0, '-51.866')] [2022-07-12 23:29:48,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5000.2, 300 sec: 4949.9). Total num frames: 76326912. Throughput: 0: 10112.2. Samples: 152673232. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:48,993][27935] Avg episode reward: [(0, '-52.487')] [2022-07-12 23:29:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.7, 300 sec: 4949.9). Total num frames: 76351488. Throughput: 0: 10092.1. Samples: 152702396. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:53,989][27935] Avg episode reward: [(0, '-52.310')] [2022-07-12 23:29:58,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5017.6, 300 sec: 4960.3). Total num frames: 76378112. Throughput: 0: 10100.5. Samples: 152763804. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:29:58,992][27935] Avg episode reward: [(0, '-52.639')] [2022-07-12 23:30:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4943.0). Total num frames: 76399616. Throughput: 0: 9993.7. Samples: 152820060. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:30:03,990][27935] Avg episode reward: [(0, '-52.807')] [2022-07-12 23:30:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5000.5, 300 sec: 4946.4). Total num frames: 76425216. Throughput: 0: 9998.7. Samples: 152850628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:30:08,990][27935] Avg episode reward: [(0, '-52.257')] [2022-07-12 23:30:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4949.9). Total num frames: 76451840. Throughput: 0: 9981.1. Samples: 152911600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:30:13,989][27935] Avg episode reward: [(0, '-51.720')] [2022-07-12 23:30:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4953.4). Total num frames: 76477440. Throughput: 0: 9979.6. Samples: 152972472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:30:18,989][27935] Avg episode reward: [(0, '-52.642')] [2022-07-12 23:30:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.8, 300 sec: 4956.9). Total num frames: 76503040. Throughput: 0: 9986.4. Samples: 153002904. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:30:23,989][27935] Avg episode reward: [(0, '-52.102')] [2022-07-12 23:30:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4949.9). Total num frames: 76527616. Throughput: 0: 9984.6. Samples: 153064188. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:28,989][27935] Avg episode reward: [(0, '-52.354')] [2022-07-12 23:30:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4949.9). Total num frames: 76552192. Throughput: 0: 10033.2. Samples: 153124692. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:33,989][27935] Avg episode reward: [(0, '-51.890')] [2022-07-12 23:30:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4949.9). Total num frames: 76578816. Throughput: 0: 10070.9. Samples: 153155588. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:38,990][27935] Avg episode reward: [(0, '-52.266')] [2022-07-12 23:30:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4956.9). Total num frames: 76604416. Throughput: 0: 10074.3. Samples: 153217148. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:43,989][27935] Avg episode reward: [(0, '-52.286')] [2022-07-12 23:30:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.9, 300 sec: 4946.5). Total num frames: 76627968. Throughput: 0: 10148.9. Samples: 153276760. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:48,989][27935] Avg episode reward: [(0, '-51.669')] [2022-07-12 23:30:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4949.9). Total num frames: 76653568. Throughput: 0: 10139.7. Samples: 153306916. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:53,989][27935] Avg episode reward: [(0, '-51.449')] [2022-07-12 23:30:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4960.3). Total num frames: 76679168. Throughput: 0: 10101.0. Samples: 153366144. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:30:58,989][27935] Avg episode reward: [(0, '-51.803')] [2022-07-12 23:31:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 4946.4). Total num frames: 76701696. Throughput: 0: 10018.1. Samples: 153423288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:03,989][27935] Avg episode reward: [(0, '-50.893')] [2022-07-12 23:31:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 4946.4). Total num frames: 76727296. Throughput: 0: 10021.4. Samples: 153453868. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:08,989][27935] Avg episode reward: [(0, '-50.908')] [2022-07-12 23:31:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4936.0). Total num frames: 76748800. Throughput: 0: 9946.6. Samples: 153511788. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:13,989][27935] Avg episode reward: [(0, '-50.935')] [2022-07-12 23:31:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4898.1, 300 sec: 4929.1). Total num frames: 76771328. Throughput: 0: 9742.1. Samples: 153563088. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:18,989][27935] Avg episode reward: [(0, '-50.881')] [2022-07-12 23:31:23,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4829.9, 300 sec: 4915.2). Total num frames: 76792832. Throughput: 0: 9682.8. Samples: 153591316. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:23,989][27935] Avg episode reward: [(0, '-50.688')] [2022-07-12 23:31:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4908.3). Total num frames: 76816384. Throughput: 0: 9440.9. Samples: 153641988. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:28,989][27935] Avg episode reward: [(0, '-50.943')] [2022-07-12 23:31:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4911.7). Total num frames: 76839936. Throughput: 0: 9396.6. Samples: 153699608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:33,989][27935] Avg episode reward: [(0, '-51.080')] [2022-07-12 23:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4904.8). Total num frames: 76865536. Throughput: 0: 9374.8. Samples: 153728784. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:38,989][27935] Avg episode reward: [(0, '-51.852')] [2022-07-12 23:31:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4901.3). Total num frames: 76888064. Throughput: 0: 9320.1. Samples: 153785548. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:43,989][27935] Avg episode reward: [(0, '-51.674')] [2022-07-12 23:31:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4887.4). Total num frames: 76910592. Throughput: 0: 9302.9. Samples: 153841920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:48,989][27935] Avg episode reward: [(0, '-51.595')] [2022-07-12 23:31:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4884.0). Total num frames: 76934144. Throughput: 0: 9210.3. Samples: 153868332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:53,989][27935] Avg episode reward: [(0, '-52.125')] [2022-07-12 23:31:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4901.3). Total num frames: 76960768. Throughput: 0: 9277.3. Samples: 153929264. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-12 23:31:58,989][27935] Avg episode reward: [(0, '-51.899')] [2022-07-12 23:32:03,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4573.9, 300 sec: 4866.6). Total num frames: 76976128. Throughput: 0: 9113.3. Samples: 153973184. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:03,989][27935] Avg episode reward: [(0, '-52.009')] [2022-07-12 23:32:08,989][27935] Fps is (10 sec: 3379.2, 60 sec: 4454.4, 300 sec: 4842.3). Total num frames: 76994560. Throughput: 0: 8976.8. Samples: 153995272. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:08,989][27935] Avg episode reward: [(0, '-51.602')] [2022-07-12 23:32:13,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4471.5, 300 sec: 4828.4). Total num frames: 77017088. Throughput: 0: 8937.4. Samples: 154044172. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:13,989][27935] Avg episode reward: [(0, '-51.693')] [2022-07-12 23:32:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4471.5, 300 sec: 4821.5). Total num frames: 77039616. Throughput: 0: 8885.5. Samples: 154099456. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:18,990][27935] Avg episode reward: [(0, '-51.751')] [2022-07-12 23:32:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4505.6, 300 sec: 4818.0). Total num frames: 77063168. Throughput: 0: 8834.7. Samples: 154126344. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:23,989][27935] Avg episode reward: [(0, '-51.393')] [2022-07-12 23:32:28,990][27935] Fps is (10 sec: 4505.0, 60 sec: 4471.4, 300 sec: 4804.1). Total num frames: 77084672. Throughput: 0: 8782.1. Samples: 154180752. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:28,991][27935] Avg episode reward: [(0, '-51.185')] [2022-07-12 23:32:33,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4437.3, 300 sec: 4793.7). Total num frames: 77106176. Throughput: 0: 8681.5. Samples: 154232588. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:33,989][27935] Avg episode reward: [(0, '-51.388')] [2022-07-12 23:32:38,989][27935] Fps is (10 sec: 4403.8, 60 sec: 4386.1, 300 sec: 4793.7). Total num frames: 77128704. Throughput: 0: 8703.8. Samples: 154260004. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:38,989][27935] Avg episode reward: [(0, '-51.219')] [2022-07-12 23:32:43,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4369.1, 300 sec: 4793.8). Total num frames: 77150208. Throughput: 0: 8527.0. Samples: 154312980. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:43,989][27935] Avg episode reward: [(0, '-51.775')] [2022-07-12 23:32:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4386.1, 300 sec: 4797.2). Total num frames: 77173760. Throughput: 0: 8107.5. Samples: 154338020. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:48,989][27935] Avg episode reward: [(0, '-51.844')] [2022-07-12 23:32:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4334.9, 300 sec: 4797.2). Total num frames: 77194240. Throughput: 0: 8823.6. Samples: 154392332. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:53,989][27935] Avg episode reward: [(0, '-52.523')] [2022-07-12 23:32:58,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4232.5, 300 sec: 4793.7). Total num frames: 77214720. Throughput: 0: 8841.2. Samples: 154442024. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:32:58,989][27935] Avg episode reward: [(0, '-52.248')] [2022-07-12 23:33:03,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4283.7, 300 sec: 4779.8). Total num frames: 77233152. Throughput: 0: 8628.1. Samples: 154487720. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:03,991][27935] Avg episode reward: [(0, '-52.339')] [2022-07-12 23:33:08,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4266.7, 300 sec: 4755.5). Total num frames: 77250560. Throughput: 0: 8479.0. Samples: 154507900. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:08,990][27935] Avg episode reward: [(0, '-51.898')] [2022-07-12 23:33:13,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4198.4, 300 sec: 4727.8). Total num frames: 77268992. Throughput: 0: 8247.6. Samples: 154551884. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:13,990][27935] Avg episode reward: [(0, '-52.120')] [2022-07-12 23:33:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4249.6, 300 sec: 4734.7). Total num frames: 77294592. Throughput: 0: 8273.2. Samples: 154604880. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:18,989][27935] Avg episode reward: [(0, '-52.484')] [2022-07-12 23:33:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4198.4, 300 sec: 4710.4). Total num frames: 77315072. Throughput: 0: 8252.8. Samples: 154631380. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:23,996][27935] Avg episode reward: [(0, '-51.170')] [2022-07-12 23:33:28,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4198.5, 300 sec: 4700.0). Total num frames: 77336576. Throughput: 0: 8248.6. Samples: 154684168. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-12 23:33:28,989][27935] Avg episode reward: [(0, '-50.576')] [2022-07-12 23:33:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4283.7, 300 sec: 4706.9). Total num frames: 77363200. Throughput: 0: 9053.4. Samples: 154745424. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:33,989][27935] Avg episode reward: [(0, '-49.950')] [2022-07-12 23:33:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4249.6, 300 sec: 4682.6). Total num frames: 77383680. Throughput: 0: 8433.8. Samples: 154771852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:38,989][27935] Avg episode reward: [(0, '-50.356')] [2022-07-12 23:33:43,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4198.4, 300 sec: 4661.8). Total num frames: 77402112. Throughput: 0: 8367.9. Samples: 154818580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:43,989][27935] Avg episode reward: [(0, '-50.764')] [2022-07-12 23:33:48,989][27935] Fps is (10 sec: 4095.9, 60 sec: 4181.3, 300 sec: 4654.9). Total num frames: 77424640. Throughput: 0: 8469.7. Samples: 154868856. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:48,992][27935] Avg episode reward: [(0, '-50.593')] [2022-07-12 23:33:53,989][27935] Fps is (10 sec: 4403.1, 60 sec: 4198.4, 300 sec: 4641.0). Total num frames: 77446144. Throughput: 0: 8596.0. Samples: 154894720. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:53,989][27935] Avg episode reward: [(0, '-50.293')] [2022-07-12 23:33:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4232.5, 300 sec: 4641.0). Total num frames: 77468672. Throughput: 0: 8770.3. Samples: 154946548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:33:58,989][27935] Avg episode reward: [(0, '-50.394')] [2022-07-12 23:34:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4300.8, 300 sec: 4630.6). Total num frames: 77491200. Throughput: 0: 8859.1. Samples: 155003540. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:03,989][27935] Avg episode reward: [(0, '-51.297')] [2022-07-12 23:34:08,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4437.3, 300 sec: 4630.6). Total num frames: 77516800. Throughput: 0: 8951.5. Samples: 155034196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:08,989][27935] Avg episode reward: [(0, '-51.830')] [2022-07-12 23:34:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4556.8, 300 sec: 4634.0). Total num frames: 77542400. Throughput: 0: 9125.7. Samples: 155094824. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:13,989][27935] Avg episode reward: [(0, '-51.917')] [2022-07-12 23:34:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4488.5, 300 sec: 4620.2). Total num frames: 77563904. Throughput: 0: 8914.2. Samples: 155146564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:18,989][27935] Avg episode reward: [(0, '-52.204')] [2022-07-12 23:34:23,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4488.5, 300 sec: 4602.8). Total num frames: 77584384. Throughput: 0: 8931.4. Samples: 155173764. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:23,989][27935] Avg episode reward: [(0, '-52.511')] [2022-07-12 23:34:28,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4386.1, 300 sec: 4568.1). Total num frames: 77599744. Throughput: 0: 8745.7. Samples: 155212136. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:28,990][27935] Avg episode reward: [(0, '-52.850')] [2022-07-12 23:34:33,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4283.7, 300 sec: 4554.2). Total num frames: 77620224. Throughput: 0: 8665.6. Samples: 155258808. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:33,989][27935] Avg episode reward: [(0, '-52.547')] [2022-07-12 23:34:38,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4300.8, 300 sec: 4540.3). Total num frames: 77641728. Throughput: 0: 8657.7. Samples: 155284316. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:38,989][27935] Avg episode reward: [(0, '-52.431')] [2022-07-12 23:34:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4386.1, 300 sec: 4536.9). Total num frames: 77665280. Throughput: 0: 8724.9. Samples: 155339168. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:43,989][27935] Avg episode reward: [(0, '-52.955')] [2022-07-12 23:34:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4386.1, 300 sec: 4529.9). Total num frames: 77687808. Throughput: 0: 8726.9. Samples: 155396252. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:48,989][27935] Avg episode reward: [(0, '-52.751')] [2022-07-12 23:34:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4488.5, 300 sec: 4533.4). Total num frames: 77715456. Throughput: 0: 8737.4. Samples: 155427380. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:53,989][27935] Avg episode reward: [(0, '-52.864')] [2022-07-12 23:34:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4505.6, 300 sec: 4540.3). Total num frames: 77739008. Throughput: 0: 8761.9. Samples: 155489108. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-12 23:34:58,989][27935] Avg episode reward: [(0, '-52.356')] [2022-07-12 23:35:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4539.7, 300 sec: 4536.8). Total num frames: 77763584. Throughput: 0: 8897.5. Samples: 155546952. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:03,989][27935] Avg episode reward: [(0, '-52.291')] [2022-07-12 23:35:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4556.8, 300 sec: 4536.8). Total num frames: 77790208. Throughput: 0: 8978.9. Samples: 155577816. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:08,989][27935] Avg episode reward: [(0, '-52.158')] [2022-07-12 23:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4556.8, 300 sec: 4536.8). Total num frames: 77815808. Throughput: 0: 9500.3. Samples: 155639652. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:13,989][27935] Avg episode reward: [(0, '-52.502')] [2022-07-12 23:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4608.0, 300 sec: 4533.4). Total num frames: 77840384. Throughput: 0: 9829.7. Samples: 155701144. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:18,989][27935] Avg episode reward: [(0, '-52.310')] [2022-07-12 23:35:23,993][27935] Fps is (10 sec: 5015.4, 60 sec: 4693.0, 300 sec: 4536.8). Total num frames: 77865984. Throughput: 0: 9946.0. Samples: 155731932. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:23,994][27935] Avg episode reward: [(0, '-52.679')] [2022-07-12 23:35:28,991][27935] Fps is (10 sec: 5118.7, 60 sec: 4863.8, 300 sec: 4540.3). Total num frames: 77891584. Throughput: 0: 10092.3. Samples: 155793348. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:28,992][27935] Avg episode reward: [(0, '-52.402')] [2022-07-12 23:35:33,989][27935] Fps is (10 sec: 5019.9, 60 sec: 4932.3, 300 sec: 4533.4). Total num frames: 77916160. Throughput: 0: 10182.8. Samples: 155854476. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:33,990][27935] Avg episode reward: [(0, '-52.724')] [2022-07-12 23:35:38,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5017.6, 300 sec: 4536.8). Total num frames: 77942784. Throughput: 0: 10166.9. Samples: 155884892. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:38,989][27935] Avg episode reward: [(0, '-52.781')] [2022-07-12 23:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 4543.8). Total num frames: 77968384. Throughput: 0: 10161.7. Samples: 155946384. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:43,989][27935] Avg episode reward: [(0, '-52.704')] [2022-07-12 23:35:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 4543.8). Total num frames: 77993984. Throughput: 0: 10239.5. Samples: 156007728. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:48,989][27935] Avg episode reward: [(0, '-52.784')] [2022-07-12 23:35:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 4547.3). Total num frames: 78020608. Throughput: 0: 10241.8. Samples: 156038696. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:53,989][27935] Avg episode reward: [(0, '-52.274')] [2022-07-12 23:35:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 4554.2). Total num frames: 78045184. Throughput: 0: 10248.9. Samples: 156100852. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:35:58,989][27935] Avg episode reward: [(0, '-52.376')] [2022-07-12 23:36:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 4547.3). Total num frames: 78068736. Throughput: 0: 10142.8. Samples: 156157572. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:03,989][27935] Avg episode reward: [(0, '-52.414')] [2022-07-12 23:36:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4561.1). Total num frames: 78094336. Throughput: 0: 10141.5. Samples: 156188252. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:08,989][27935] Avg episode reward: [(0, '-52.617')] [2022-07-12 23:36:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 4575.0). Total num frames: 78120960. Throughput: 0: 10122.7. Samples: 156248844. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:13,989][27935] Avg episode reward: [(0, '-52.809')] [2022-07-12 23:36:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4578.5). Total num frames: 78143488. Throughput: 0: 10075.9. Samples: 156307892. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:18,989][27935] Avg episode reward: [(0, '-52.555')] [2022-07-12 23:36:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5052.1, 300 sec: 4585.4). Total num frames: 78169088. Throughput: 0: 10087.6. Samples: 156338836. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:23,989][27935] Avg episode reward: [(0, '-52.453')] [2022-07-12 23:36:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.9, 300 sec: 4588.9). Total num frames: 78193664. Throughput: 0: 10006.4. Samples: 156396672. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:28,991][27935] Avg episode reward: [(0, '-52.160')] [2022-07-12 23:36:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 4582.0). Total num frames: 78217216. Throughput: 0: 9231.1. Samples: 156423128. Policy #0 lag: (min: 1.0, avg: 9.1, max: 22.0) [2022-07-12 23:36:33,989][27935] Avg episode reward: [(0, '-51.802')] [2022-07-12 23:36:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4932.3, 300 sec: 4578.5). Total num frames: 78238720. Throughput: 0: 9801.8. Samples: 156479776. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:36:38,989][27935] Avg episode reward: [(0, '-51.997')] [2022-07-12 23:36:43,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4812.8, 300 sec: 4564.6). Total num frames: 78257152. Throughput: 0: 9528.6. Samples: 156529640. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:36:43,989][27935] Avg episode reward: [(0, '-51.910')] [2022-07-12 23:36:48,989][27935] Fps is (10 sec: 3481.6, 60 sec: 4659.2, 300 sec: 4540.3). Total num frames: 78273536. Throughput: 0: 9147.6. Samples: 156569212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:36:48,989][27935] Avg episode reward: [(0, '-51.999')] [2022-07-12 23:36:53,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4590.9, 300 sec: 4526.4). Total num frames: 78296064. Throughput: 0: 9022.7. Samples: 156594272. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:36:53,989][27935] Avg episode reward: [(0, '-51.483')] [2022-07-12 23:36:58,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4505.6, 300 sec: 4540.3). Total num frames: 78315520. Throughput: 0: 8745.6. Samples: 156642396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:36:58,989][27935] Avg episode reward: [(0, '-51.808')] [2022-07-12 23:37:03,989][27935] Fps is (10 sec: 3686.4, 60 sec: 4403.2, 300 sec: 4536.8). Total num frames: 78332928. Throughput: 0: 7955.6. Samples: 156665896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:03,989][27935] Avg episode reward: [(0, '-51.782')] [2022-07-12 23:37:08,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4352.0, 300 sec: 4536.8). Total num frames: 78355456. Throughput: 0: 8285.0. Samples: 156711660. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:08,990][27935] Avg episode reward: [(0, '-51.601')] [2022-07-12 23:37:13,991][27935] Fps is (10 sec: 4504.8, 60 sec: 4283.6, 300 sec: 4536.8). Total num frames: 78377984. Throughput: 0: 8235.0. Samples: 156767260. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:13,991][27935] Avg episode reward: [(0, '-52.006')] [2022-07-12 23:37:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4334.9, 300 sec: 4543.8). Total num frames: 78403584. Throughput: 0: 8976.2. Samples: 156827056. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:18,989][27935] Avg episode reward: [(0, '-51.734')] [2022-07-12 23:37:23,989][27935] Fps is (10 sec: 5223.3, 60 sec: 4352.0, 300 sec: 4561.2). Total num frames: 78430208. Throughput: 0: 8411.0. Samples: 156858272. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:23,989][27935] Avg episode reward: [(0, '-51.847')] [2022-07-12 23:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4317.9, 300 sec: 4564.6). Total num frames: 78452736. Throughput: 0: 8642.0. Samples: 156918532. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:28,989][27935] Avg episode reward: [(0, '-51.736')] [2022-07-12 23:37:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4352.0, 300 sec: 4575.0). Total num frames: 78478336. Throughput: 0: 9049.0. Samples: 156976416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:33,989][27935] Avg episode reward: [(0, '-51.530')] [2022-07-12 23:37:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4403.2, 300 sec: 4585.4). Total num frames: 78502912. Throughput: 0: 9176.1. Samples: 157007196. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:38,990][27935] Avg episode reward: [(0, '-52.245')] [2022-07-12 23:37:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4539.7, 300 sec: 4595.9). Total num frames: 78529536. Throughput: 0: 9431.0. Samples: 157066788. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:43,989][27935] Avg episode reward: [(0, '-52.370')] [2022-07-12 23:37:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4676.3, 300 sec: 4609.7). Total num frames: 78554112. Throughput: 0: 10264.9. Samples: 157127816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:48,990][27935] Avg episode reward: [(0, '-52.766')] [2022-07-12 23:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4761.6, 300 sec: 4634.0). Total num frames: 78581760. Throughput: 0: 9933.3. Samples: 157158656. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:53,989][27935] Avg episode reward: [(0, '-52.453')] [2022-07-12 23:37:58,991][27935] Fps is (10 sec: 5118.9, 60 sec: 4829.7, 300 sec: 4651.4). Total num frames: 78605312. Throughput: 0: 10055.1. Samples: 157219744. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:37:58,992][27935] Avg episode reward: [(0, '-52.433')] [2022-07-12 23:38:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4881.1, 300 sec: 4661.8). Total num frames: 78625792. Throughput: 0: 9918.5. Samples: 157273388. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:38:03,989][27935] Avg episode reward: [(0, '-52.432')] [2022-07-12 23:38:08,989][27935] Fps is (10 sec: 4301.7, 60 sec: 4881.1, 300 sec: 4675.7). Total num frames: 78648320. Throughput: 0: 9790.2. Samples: 157298832. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-12 23:38:08,989][27935] Avg episode reward: [(0, '-51.744')] [2022-07-12 23:38:13,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4830.0, 300 sec: 4654.9). Total num frames: 78667776. Throughput: 0: 9519.4. Samples: 157346904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:13,989][27935] Avg episode reward: [(0, '-51.581')] [2022-07-12 23:38:18,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4761.6, 300 sec: 4658.3). Total num frames: 78689280. Throughput: 0: 8817.6. Samples: 157373208. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:18,989][27935] Avg episode reward: [(0, '-51.205')] [2022-07-12 23:38:23,989][27935] Fps is (10 sec: 3788.8, 60 sec: 4590.9, 300 sec: 4641.0). Total num frames: 78705664. Throughput: 0: 9140.4. Samples: 157418512. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:23,989][27935] Avg episode reward: [(0, '-51.565')] [2022-07-12 23:38:28,989][27935] Fps is (10 sec: 3276.8, 60 sec: 4488.5, 300 sec: 4606.3). Total num frames: 78722048. Throughput: 0: 8678.3. Samples: 157457312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:28,989][27935] Avg episode reward: [(0, '-51.322')] [2022-07-12 23:38:33,989][27935] Fps is (10 sec: 3686.4, 60 sec: 4403.2, 300 sec: 4606.3). Total num frames: 78742528. Throughput: 0: 8404.2. Samples: 157506004. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:33,989][27935] Avg episode reward: [(0, '-51.671')] [2022-07-12 23:38:38,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4334.9, 300 sec: 4613.2). Total num frames: 78763008. Throughput: 0: 8243.7. Samples: 157529624. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:38,989][27935] Avg episode reward: [(0, '-51.676')] [2022-07-12 23:38:43,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4232.5, 300 sec: 4606.3). Total num frames: 78783488. Throughput: 0: 7959.4. Samples: 157577900. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:43,989][27935] Avg episode reward: [(0, '-52.028')] [2022-07-12 23:38:48,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4181.3, 300 sec: 4606.3). Total num frames: 78804992. Throughput: 0: 7931.4. Samples: 157630300. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:48,989][27935] Avg episode reward: [(0, '-51.503')] [2022-07-12 23:38:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4130.1, 300 sec: 4613.2). Total num frames: 78829568. Throughput: 0: 7981.1. Samples: 157657980. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:53,989][27935] Avg episode reward: [(0, '-51.984')] [2022-07-12 23:38:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4113.2, 300 sec: 4613.2). Total num frames: 78852096. Throughput: 0: 8140.2. Samples: 157713212. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:38:58,989][27935] Avg episode reward: [(0, '-51.675')] [2022-07-12 23:39:03,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4096.0, 300 sec: 4592.4). Total num frames: 78871552. Throughput: 0: 8672.5. Samples: 157763472. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:03,989][27935] Avg episode reward: [(0, '-50.905')] [2022-07-12 23:39:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4147.2, 300 sec: 4592.4). Total num frames: 78897152. Throughput: 0: 8271.8. Samples: 157790744. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:08,989][27935] Avg episode reward: [(0, '-50.515')] [2022-07-12 23:39:13,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4181.3, 300 sec: 4592.4). Total num frames: 78918656. Throughput: 0: 8625.9. Samples: 157845476. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:13,989][27935] Avg episode reward: [(0, '-50.770')] [2022-07-12 23:39:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4215.5, 300 sec: 4602.8). Total num frames: 78942208. Throughput: 0: 8854.3. Samples: 157904448. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:18,989][27935] Avg episode reward: [(0, '-51.411')] [2022-07-12 23:39:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4369.1, 300 sec: 4637.5). Total num frames: 78967808. Throughput: 0: 9001.4. Samples: 157934688. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:23,989][27935] Avg episode reward: [(0, '-51.639')] [2022-07-12 23:39:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4505.6, 300 sec: 4651.4). Total num frames: 78992384. Throughput: 0: 9278.3. Samples: 157995424. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:28,989][27935] Avg episode reward: [(0, '-52.016')] [2022-07-12 23:39:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4590.9, 300 sec: 4665.3). Total num frames: 79017984. Throughput: 0: 9454.2. Samples: 158055740. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:33,989][27935] Avg episode reward: [(0, '-52.096')] [2022-07-12 23:39:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4659.2, 300 sec: 4668.7). Total num frames: 79042560. Throughput: 0: 9508.3. Samples: 158085852. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-12 23:39:38,990][27935] Avg episode reward: [(0, '-52.780')] [2022-07-12 23:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4761.6, 300 sec: 4682.6). Total num frames: 79069184. Throughput: 0: 9637.2. Samples: 158146884. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:39:43,989][27935] Avg episode reward: [(0, '-52.584')] [2022-07-12 23:39:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4812.8, 300 sec: 4672.2). Total num frames: 79093760. Throughput: 0: 9872.6. Samples: 158207740. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:39:48,989][27935] Avg episode reward: [(0, '-52.694')] [2022-07-12 23:39:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4682.6). Total num frames: 79120384. Throughput: 0: 9951.0. Samples: 158238540. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:39:53,989][27935] Avg episode reward: [(0, '-52.188')] [2022-07-12 23:39:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4679.2). Total num frames: 79143936. Throughput: 0: 10088.4. Samples: 158299456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:39:58,989][27935] Avg episode reward: [(0, '-52.549')] [2022-07-12 23:40:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4668.7). Total num frames: 79167488. Throughput: 0: 10043.2. Samples: 158356392. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:03,989][27935] Avg episode reward: [(0, '-53.093')] [2022-07-12 23:40:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4672.2). Total num frames: 79194112. Throughput: 0: 10052.7. Samples: 158387060. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:08,989][27935] Avg episode reward: [(0, '-52.795')] [2022-07-12 23:40:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4675.7). Total num frames: 79219712. Throughput: 0: 10057.0. Samples: 158447988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:13,989][27935] Avg episode reward: [(0, '-52.246')] [2022-07-12 23:40:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4675.8). Total num frames: 79245312. Throughput: 0: 10080.8. Samples: 158509376. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:18,989][27935] Avg episode reward: [(0, '-52.170')] [2022-07-12 23:40:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4675.7). Total num frames: 79270912. Throughput: 0: 10101.2. Samples: 158540404. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:23,989][27935] Avg episode reward: [(0, '-51.620')] [2022-07-12 23:40:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4679.2). Total num frames: 79296512. Throughput: 0: 10114.5. Samples: 158602036. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:28,989][27935] Avg episode reward: [(0, '-51.801')] [2022-07-12 23:40:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4672.2). Total num frames: 79321088. Throughput: 0: 10114.6. Samples: 158662896. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:33,990][27935] Avg episode reward: [(0, '-51.460')] [2022-07-12 23:40:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4675.7). Total num frames: 79347712. Throughput: 0: 10104.1. Samples: 158693224. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:38,989][27935] Avg episode reward: [(0, '-50.872')] [2022-07-12 23:40:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4672.2). Total num frames: 79372288. Throughput: 0: 10110.8. Samples: 158754440. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:43,989][27935] Avg episode reward: [(0, '-51.291')] [2022-07-12 23:40:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 4668.7). Total num frames: 79397888. Throughput: 0: 10200.5. Samples: 158815416. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:48,989][27935] Avg episode reward: [(0, '-51.676')] [2022-07-12 23:40:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4668.7). Total num frames: 79422464. Throughput: 0: 10198.6. Samples: 158845996. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:53,989][27935] Avg episode reward: [(0, '-51.984')] [2022-07-12 23:40:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4679.2). Total num frames: 79449088. Throughput: 0: 10190.8. Samples: 158906576. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:40:58,989][27935] Avg episode reward: [(0, '-52.526')] [2022-07-12 23:41:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4668.7). Total num frames: 79471616. Throughput: 0: 10097.9. Samples: 158963780. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:41:03,990][27935] Avg episode reward: [(0, '-52.273')] [2022-07-12 23:41:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4668.7). Total num frames: 79498240. Throughput: 0: 10087.0. Samples: 158994320. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:41:08,989][27935] Avg episode reward: [(0, '-52.599')] [2022-07-12 23:41:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5034.7, 300 sec: 4672.2). Total num frames: 79521792. Throughput: 0: 10062.3. Samples: 159054840. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-12 23:41:13,990][27935] Avg episode reward: [(0, '-51.978')] [2022-07-12 23:41:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4672.2). Total num frames: 79547392. Throughput: 0: 10018.8. Samples: 159113740. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:18,989][27935] Avg episode reward: [(0, '-51.568')] [2022-07-12 23:41:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4675.7). Total num frames: 79572992. Throughput: 0: 10026.7. Samples: 159144428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:23,992][27935] Avg episode reward: [(0, '-51.429')] [2022-07-12 23:41:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4682.6). Total num frames: 79598592. Throughput: 0: 10019.0. Samples: 159205296. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:28,989][27935] Avg episode reward: [(0, '-51.410')] [2022-07-12 23:41:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4689.6). Total num frames: 79622144. Throughput: 0: 9997.9. Samples: 159265320. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:33,989][27935] Avg episode reward: [(0, '-51.526')] [2022-07-12 23:41:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4717.3). Total num frames: 79648768. Throughput: 0: 9990.8. Samples: 159295584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:38,989][27935] Avg episode reward: [(0, '-51.210')] [2022-07-12 23:41:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4745.1). Total num frames: 79673344. Throughput: 0: 9990.7. Samples: 159356156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:43,991][27935] Avg episode reward: [(0, '-51.133')] [2022-07-12 23:41:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4755.5). Total num frames: 79698944. Throughput: 0: 10074.7. Samples: 159417140. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:48,989][27935] Avg episode reward: [(0, '-51.465')] [2022-07-12 23:41:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4769.4). Total num frames: 79722496. Throughput: 0: 10073.2. Samples: 159447612. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:53,989][27935] Avg episode reward: [(0, '-52.219')] [2022-07-12 23:41:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4804.1). Total num frames: 79750144. Throughput: 0: 10089.4. Samples: 159508864. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:41:58,991][27935] Avg episode reward: [(0, '-51.976')] [2022-07-12 23:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4807.6). Total num frames: 79773696. Throughput: 0: 10032.8. Samples: 159565216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:03,989][27935] Avg episode reward: [(0, '-52.167')] [2022-07-12 23:42:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4814.6). Total num frames: 79798272. Throughput: 0: 10010.7. Samples: 159594908. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:08,990][27935] Avg episode reward: [(0, '-51.178')] [2022-07-12 23:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4807.6). Total num frames: 79821824. Throughput: 0: 10004.1. Samples: 159655480. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:13,989][27935] Avg episode reward: [(0, '-51.679')] [2022-07-12 23:42:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4811.1). Total num frames: 79849472. Throughput: 0: 10018.8. Samples: 159716164. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:18,991][27935] Avg episode reward: [(0, '-51.957')] [2022-07-12 23:42:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4818.0). Total num frames: 79874048. Throughput: 0: 10027.6. Samples: 159746828. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:23,991][27935] Avg episode reward: [(0, '-51.180')] [2022-07-12 23:42:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4818.0). Total num frames: 79899648. Throughput: 0: 10056.5. Samples: 159808700. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:28,989][27935] Avg episode reward: [(0, '-51.305')] [2022-07-12 23:42:33,991][27935] Fps is (10 sec: 5119.0, 60 sec: 5051.6, 300 sec: 4821.4). Total num frames: 79925248. Throughput: 0: 10060.5. Samples: 159869884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:33,993][27935] Avg episode reward: [(0, '-51.147')] [2022-07-12 23:42:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4818.0). Total num frames: 79950848. Throughput: 0: 10029.7. Samples: 159898948. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:38,994][27935] Avg episode reward: [(0, '-50.873')] [2022-07-12 23:42:43,989][27935] Fps is (10 sec: 4711.3, 60 sec: 4983.5, 300 sec: 4807.6). Total num frames: 79972352. Throughput: 0: 9876.5. Samples: 159953308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:43,989][27935] Avg episode reward: [(0, '-51.293')] [2022-07-12 23:42:48,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4915.2, 300 sec: 4786.8). Total num frames: 79993856. Throughput: 0: 9834.3. Samples: 160007760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-12 23:42:48,990][27935] Avg episode reward: [(0, '-50.255')] [2022-07-12 23:42:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 4793.7). Total num frames: 80019456. Throughput: 0: 9854.8. Samples: 160038376. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:42:53,996][27935] Avg episode reward: [(0, '-50.287')] [2022-07-12 23:42:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4807.6). Total num frames: 80044032. Throughput: 0: 9829.2. Samples: 160097792. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:42:58,989][27935] Avg episode reward: [(0, '-50.334')] [2022-07-12 23:43:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4804.1). Total num frames: 80065536. Throughput: 0: 9649.0. Samples: 160150368. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:03,989][27935] Avg episode reward: [(0, '-50.214')] [2022-07-12 23:43:08,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 80086016. Throughput: 0: 9505.6. Samples: 160174580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:08,990][27935] Avg episode reward: [(0, '-50.814')] [2022-07-12 23:43:13,989][27935] Fps is (10 sec: 3788.8, 60 sec: 4693.3, 300 sec: 4793.7). Total num frames: 80103424. Throughput: 0: 9132.4. Samples: 160219660. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:13,989][27935] Avg episode reward: [(0, '-51.096')] [2022-07-12 23:43:18,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4625.1, 300 sec: 4818.0). Total num frames: 80126976. Throughput: 0: 8923.1. Samples: 160271408. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:18,989][27935] Avg episode reward: [(0, '-51.087')] [2022-07-12 23:43:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4838.8). Total num frames: 80149504. Throughput: 0: 8888.0. Samples: 160298908. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:23,989][27935] Avg episode reward: [(0, '-51.630')] [2022-07-12 23:43:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4539.7, 300 sec: 4845.8). Total num frames: 80172032. Throughput: 0: 8908.7. Samples: 160354200. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:28,989][27935] Avg episode reward: [(0, '-51.633')] [2022-07-12 23:43:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4522.8, 300 sec: 4859.7). Total num frames: 80196608. Throughput: 0: 9005.3. Samples: 160413000. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:33,989][27935] Avg episode reward: [(0, '-52.239')] [2022-07-12 23:43:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4539.7, 300 sec: 4880.5). Total num frames: 80223232. Throughput: 0: 9006.4. Samples: 160443664. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:38,989][27935] Avg episode reward: [(0, '-52.672')] [2022-07-12 23:43:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4590.9, 300 sec: 4890.9). Total num frames: 80247808. Throughput: 0: 9054.2. Samples: 160505232. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:43,989][27935] Avg episode reward: [(0, '-52.151')] [2022-07-12 23:43:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4659.2, 300 sec: 4894.4). Total num frames: 80273408. Throughput: 0: 9238.1. Samples: 160566080. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:48,989][27935] Avg episode reward: [(0, '-52.608')] [2022-07-12 23:43:54,001][27935] Fps is (10 sec: 5011.6, 60 sec: 4641.2, 300 sec: 4901.1). Total num frames: 80297984. Throughput: 0: 9378.1. Samples: 160596708. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:54,001][27935] Avg episode reward: [(0, '-52.149')] [2022-07-12 23:43:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4676.3, 300 sec: 4925.6). Total num frames: 80324608. Throughput: 0: 9737.0. Samples: 160657824. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:43:58,989][27935] Avg episode reward: [(0, '-52.644')] [2022-07-12 23:44:03,989][27935] Fps is (10 sec: 4716.1, 60 sec: 4659.2, 300 sec: 4908.3). Total num frames: 80345088. Throughput: 0: 9769.6. Samples: 160711040. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:44:03,989][27935] Avg episode reward: [(0, '-52.964')] [2022-07-12 23:44:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4918.7). Total num frames: 80369664. Throughput: 0: 9802.0. Samples: 160740000. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:44:08,989][27935] Avg episode reward: [(0, '-52.356')] [2022-07-12 23:44:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4925.6). Total num frames: 80395264. Throughput: 0: 9912.2. Samples: 160800248. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:44:13,989][27935] Avg episode reward: [(0, '-52.325')] [2022-07-12 23:44:18,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4761.6, 300 sec: 4897.8). Total num frames: 80412672. Throughput: 0: 9111.4. Samples: 160823012. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:44:18,990][27935] Avg episode reward: [(0, '-52.010')] [2022-07-12 23:44:23,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4693.3, 300 sec: 4877.0). Total num frames: 80431104. Throughput: 0: 9404.6. Samples: 160866872. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-12 23:44:23,990][27935] Avg episode reward: [(0, '-52.938')] [2022-07-12 23:44:28,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4693.3, 300 sec: 4866.6). Total num frames: 80453632. Throughput: 0: 9181.2. Samples: 160918384. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:28,989][27935] Avg episode reward: [(0, '-52.771')] [2022-07-12 23:44:33,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4608.0, 300 sec: 4849.2). Total num frames: 80473088. Throughput: 0: 8871.8. Samples: 160965312. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:33,990][27935] Avg episode reward: [(0, '-52.410')] [2022-07-12 23:44:38,989][27935] Fps is (10 sec: 3788.8, 60 sec: 4471.5, 300 sec: 4821.5). Total num frames: 80491520. Throughput: 0: 8677.7. Samples: 160987100. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:38,989][27935] Avg episode reward: [(0, '-52.634')] [2022-07-12 23:44:43,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4437.3, 300 sec: 4814.5). Total num frames: 80514048. Throughput: 0: 8436.8. Samples: 161037480. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:43,989][27935] Avg episode reward: [(0, '-51.528')] [2022-07-12 23:44:48,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4352.0, 300 sec: 4793.7). Total num frames: 80534528. Throughput: 0: 8406.4. Samples: 161089328. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:48,989][27935] Avg episode reward: [(0, '-51.917')] [2022-07-12 23:44:53,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4250.4, 300 sec: 4776.4). Total num frames: 80552960. Throughput: 0: 8267.8. Samples: 161112052. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:53,989][27935] Avg episode reward: [(0, '-51.575')] [2022-07-12 23:44:58,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4164.3, 300 sec: 4769.4). Total num frames: 80574464. Throughput: 0: 7934.5. Samples: 161157300. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:44:58,990][27935] Avg episode reward: [(0, '-51.151')] [2022-07-12 23:45:03,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4147.2, 300 sec: 4745.1). Total num frames: 80593920. Throughput: 0: 8536.4. Samples: 161207148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:03,990][27935] Avg episode reward: [(0, '-50.761')] [2022-07-12 23:45:08,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4096.0, 300 sec: 4731.2). Total num frames: 80615424. Throughput: 0: 8142.7. Samples: 161233292. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:08,989][27935] Avg episode reward: [(0, '-50.472')] [2022-07-12 23:45:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4061.9, 300 sec: 4724.3). Total num frames: 80638976. Throughput: 0: 8207.4. Samples: 161287716. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:13,989][27935] Avg episode reward: [(0, '-49.431')] [2022-07-12 23:45:18,989][27935] Fps is (10 sec: 4812.6, 60 sec: 4181.3, 300 sec: 4720.8). Total num frames: 80663552. Throughput: 0: 8486.2. Samples: 161347196. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:18,990][27935] Avg episode reward: [(0, '-49.749')] [2022-07-12 23:45:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4283.7, 300 sec: 4717.3). Total num frames: 80688128. Throughput: 0: 8633.2. Samples: 161375592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:23,989][27935] Avg episode reward: [(0, '-49.845')] [2022-07-12 23:45:28,989][27935] Fps is (10 sec: 5017.8, 60 sec: 4334.9, 300 sec: 4720.8). Total num frames: 80713728. Throughput: 0: 8876.8. Samples: 161436936. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:28,989][27935] Avg episode reward: [(0, '-50.526')] [2022-07-12 23:45:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4437.3, 300 sec: 4717.3). Total num frames: 80739328. Throughput: 0: 9072.0. Samples: 161497568. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:33,989][27935] Avg episode reward: [(0, '-51.030')] [2022-07-12 23:45:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4539.7, 300 sec: 4717.3). Total num frames: 80763904. Throughput: 0: 9245.5. Samples: 161528100. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:38,989][27935] Avg episode reward: [(0, '-51.579')] [2022-07-12 23:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4608.0, 300 sec: 4720.8). Total num frames: 80790528. Throughput: 0: 9588.4. Samples: 161588776. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:43,989][27935] Avg episode reward: [(0, '-52.655')] [2022-07-12 23:45:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4703.5). Total num frames: 80809984. Throughput: 0: 9610.5. Samples: 161639620. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:48,996][27935] Avg episode reward: [(0, '-52.731')] [2022-07-12 23:45:53,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4608.0, 300 sec: 4679.2). Total num frames: 80829440. Throughput: 0: 9536.7. Samples: 161662444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:53,990][27935] Avg episode reward: [(0, '-52.930')] [2022-07-12 23:45:58,989][27935] Fps is (10 sec: 3891.2, 60 sec: 4573.9, 300 sec: 4668.7). Total num frames: 80848896. Throughput: 0: 9369.2. Samples: 161709328. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:45:58,989][27935] Avg episode reward: [(0, '-52.543')] [2022-07-12 23:46:03,989][27935] Fps is (10 sec: 3686.4, 60 sec: 4539.7, 300 sec: 4637.5). Total num frames: 80866304. Throughput: 0: 8565.0. Samples: 161732616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-12 23:46:03,989][27935] Avg episode reward: [(0, '-52.428')] [2022-07-12 23:46:08,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4556.8, 300 sec: 4634.0). Total num frames: 80888832. Throughput: 0: 8917.0. Samples: 161776856. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:08,989][27935] Avg episode reward: [(0, '-52.021')] [2022-07-12 23:46:13,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4505.6, 300 sec: 4616.7). Total num frames: 80909312. Throughput: 0: 8695.9. Samples: 161828252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:13,989][27935] Avg episode reward: [(0, '-51.128')] [2022-07-12 23:46:18,989][27935] Fps is (10 sec: 3993.4, 60 sec: 4420.3, 300 sec: 4595.8). Total num frames: 80928768. Throughput: 0: 8454.4. Samples: 161878020. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:18,990][27935] Avg episode reward: [(0, '-51.335')] [2022-07-12 23:46:23,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4403.2, 300 sec: 4588.9). Total num frames: 80952320. Throughput: 0: 8379.7. Samples: 161905184. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:23,989][27935] Avg episode reward: [(0, '-50.884')] [2022-07-12 23:46:28,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4352.0, 300 sec: 4585.4). Total num frames: 80974848. Throughput: 0: 8246.7. Samples: 161959876. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:28,989][27935] Avg episode reward: [(0, '-50.938')] [2022-07-12 23:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4334.9, 300 sec: 4578.5). Total num frames: 80999424. Throughput: 0: 8359.6. Samples: 162015804. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:33,989][27935] Avg episode reward: [(0, '-51.096')] [2022-07-12 23:46:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4317.9, 300 sec: 4575.0). Total num frames: 81022976. Throughput: 0: 8534.4. Samples: 162046492. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:39,000][27935] Avg episode reward: [(0, '-50.525')] [2022-07-12 23:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4300.8, 300 sec: 4575.0). Total num frames: 81048576. Throughput: 0: 8840.4. Samples: 162107148. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:43,990][27935] Avg episode reward: [(0, '-51.472')] [2022-07-12 23:46:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4369.1, 300 sec: 4575.0). Total num frames: 81072128. Throughput: 0: 9597.6. Samples: 162164508. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:48,989][27935] Avg episode reward: [(0, '-51.054')] [2022-07-12 23:46:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4488.5, 300 sec: 4571.6). Total num frames: 81098752. Throughput: 0: 9289.6. Samples: 162194888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:53,989][27935] Avg episode reward: [(0, '-51.399')] [2022-07-12 23:46:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4573.9, 300 sec: 4575.0). Total num frames: 81123328. Throughput: 0: 9504.1. Samples: 162255936. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:46:58,989][27935] Avg episode reward: [(0, '-51.276')] [2022-07-12 23:47:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4568.1). Total num frames: 81145856. Throughput: 0: 9663.6. Samples: 162312876. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:03,989][27935] Avg episode reward: [(0, '-51.213')] [2022-07-12 23:47:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4578.5). Total num frames: 81172480. Throughput: 0: 9733.0. Samples: 162343168. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:08,989][27935] Avg episode reward: [(0, '-50.837')] [2022-07-12 23:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4812.8, 300 sec: 4571.6). Total num frames: 81198080. Throughput: 0: 9863.5. Samples: 162403732. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:13,990][27935] Avg episode reward: [(0, '-50.994')] [2022-07-12 23:47:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4568.1). Total num frames: 81221632. Throughput: 0: 9962.7. Samples: 162464124. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:18,989][27935] Avg episode reward: [(0, '-50.923')] [2022-07-12 23:47:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4568.1). Total num frames: 81247232. Throughput: 0: 9944.3. Samples: 162493984. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:23,989][27935] Avg episode reward: [(0, '-50.501')] [2022-07-12 23:47:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5000.5, 300 sec: 4575.1). Total num frames: 81274880. Throughput: 0: 9945.6. Samples: 162554700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:28,989][27935] Avg episode reward: [(0, '-50.051')] [2022-07-12 23:47:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4564.6). Total num frames: 81297408. Throughput: 0: 9996.2. Samples: 162614336. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:33,989][27935] Avg episode reward: [(0, '-50.355')] [2022-07-12 23:47:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4578.5). Total num frames: 81323008. Throughput: 0: 10004.5. Samples: 162645092. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-12 23:47:38,989][27935] Avg episode reward: [(0, '-51.144')] [2022-07-12 23:47:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4588.9). Total num frames: 81347584. Throughput: 0: 9969.3. Samples: 162704556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:47:43,989][27935] Avg episode reward: [(0, '-51.209')] [2022-07-12 23:47:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4585.4). Total num frames: 81372160. Throughput: 0: 10039.0. Samples: 162764632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:47:48,989][27935] Avg episode reward: [(0, '-50.293')] [2022-07-12 23:47:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4588.9). Total num frames: 81397760. Throughput: 0: 10045.8. Samples: 162795228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:47:53,989][27935] Avg episode reward: [(0, '-50.127')] [2022-07-12 23:47:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5034.7, 300 sec: 4609.7). Total num frames: 81425408. Throughput: 0: 10060.3. Samples: 162856444. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:47:58,989][27935] Avg episode reward: [(0, '-50.807')] [2022-07-12 23:48:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4613.2). Total num frames: 81446912. Throughput: 0: 9973.1. Samples: 162912912. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:03,989][27935] Avg episode reward: [(0, '-50.427')] [2022-07-12 23:48:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4983.5, 300 sec: 4637.5). Total num frames: 81471488. Throughput: 0: 9944.4. Samples: 162941480. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:08,989][27935] Avg episode reward: [(0, '-50.215')] [2022-07-12 23:48:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4634.0). Total num frames: 81494016. Throughput: 0: 9851.5. Samples: 162998020. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:13,989][27935] Avg episode reward: [(0, '-49.405')] [2022-07-12 23:48:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4915.2, 300 sec: 4634.0). Total num frames: 81516544. Throughput: 0: 9746.2. Samples: 163052916. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:18,989][27935] Avg episode reward: [(0, '-49.613')] [2022-07-12 23:48:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4637.5). Total num frames: 81540096. Throughput: 0: 9673.1. Samples: 163080380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:23,989][27935] Avg episode reward: [(0, '-49.972')] [2022-07-12 23:48:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4627.1). Total num frames: 81561600. Throughput: 0: 9570.5. Samples: 163135228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:28,989][27935] Avg episode reward: [(0, '-49.664')] [2022-07-12 23:48:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4623.6). Total num frames: 81587200. Throughput: 0: 8830.7. Samples: 163162012. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:33,989][27935] Avg episode reward: [(0, '-50.009')] [2022-07-12 23:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4620.1). Total num frames: 81610752. Throughput: 0: 9502.3. Samples: 163222832. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:38,989][27935] Avg episode reward: [(0, '-50.832')] [2022-07-12 23:48:43,990][27935] Fps is (10 sec: 5016.9, 60 sec: 4829.8, 300 sec: 4623.6). Total num frames: 81637376. Throughput: 0: 9502.5. Samples: 163284068. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:43,991][27935] Avg episode reward: [(0, '-51.551')] [2022-07-12 23:48:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4623.8). Total num frames: 81661952. Throughput: 0: 9605.0. Samples: 163345136. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:48,989][27935] Avg episode reward: [(0, '-51.727')] [2022-07-12 23:48:53,989][27935] Fps is (10 sec: 5223.1, 60 sec: 4864.0, 300 sec: 4627.1). Total num frames: 81689600. Throughput: 0: 9660.1. Samples: 163376184. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:53,990][27935] Avg episode reward: [(0, '-51.967')] [2022-07-12 23:48:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4634.0). Total num frames: 81712128. Throughput: 0: 9731.3. Samples: 163435928. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:48:58,989][27935] Avg episode reward: [(0, '-52.122')] [2022-07-12 23:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4634.0). Total num frames: 81736704. Throughput: 0: 9756.1. Samples: 163491940. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:49:03,989][27935] Avg episode reward: [(0, '-51.738')] [2022-07-12 23:49:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4627.1). Total num frames: 81760256. Throughput: 0: 9789.3. Samples: 163520900. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:49:08,989][27935] Avg episode reward: [(0, '-51.504')] [2022-07-12 23:49:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4654.9). Total num frames: 81785856. Throughput: 0: 9897.6. Samples: 163580620. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-12 23:49:13,989][27935] Avg episode reward: [(0, '-51.016')] [2022-07-12 23:49:18,992][27935] Fps is (10 sec: 5118.1, 60 sec: 4914.9, 300 sec: 4679.1). Total num frames: 81811456. Throughput: 0: 10653.9. Samples: 163641476. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:18,993][27935] Avg episode reward: [(0, '-50.334')] [2022-07-12 23:49:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 4693.0). Total num frames: 81838080. Throughput: 0: 9978.9. Samples: 163671884. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:23,989][27935] Avg episode reward: [(0, '-49.727')] [2022-07-12 23:49:28,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4983.5, 300 sec: 4703.5). Total num frames: 81860608. Throughput: 0: 9966.5. Samples: 163732548. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:28,989][27935] Avg episode reward: [(0, '-50.608')] [2022-07-12 23:49:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4731.2). Total num frames: 81887232. Throughput: 0: 9959.1. Samples: 163793296. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:33,989][27935] Avg episode reward: [(0, '-50.894')] [2022-07-12 23:49:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4734.7). Total num frames: 81910784. Throughput: 0: 9944.7. Samples: 163823696. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:38,989][27935] Avg episode reward: [(0, '-51.565')] [2022-07-12 23:49:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4932.4, 300 sec: 4741.6). Total num frames: 81933312. Throughput: 0: 9823.7. Samples: 163877996. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:43,989][27935] Avg episode reward: [(0, '-51.935')] [2022-07-12 23:49:49,000][27935] Fps is (10 sec: 4602.7, 60 sec: 4914.3, 300 sec: 4758.8). Total num frames: 81956864. Throughput: 0: 9746.9. Samples: 163930664. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:49,001][27935] Avg episode reward: [(0, '-51.586')] [2022-07-12 23:49:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 81977344. Throughput: 0: 9700.0. Samples: 163957400. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:53,989][27935] Avg episode reward: [(0, '-51.007')] [2022-07-12 23:49:58,989][27935] Fps is (10 sec: 4408.3, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 82000896. Throughput: 0: 9582.0. Samples: 164011808. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:49:58,989][27935] Avg episode reward: [(0, '-51.070')] [2022-07-12 23:50:03,989][27935] Fps is (10 sec: 4505.4, 60 sec: 4761.6, 300 sec: 4769.4). Total num frames: 82022400. Throughput: 0: 9363.9. Samples: 164062820. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:03,990][27935] Avg episode reward: [(0, '-50.405')] [2022-07-12 23:50:08,990][27935] Fps is (10 sec: 4505.1, 60 sec: 4761.5, 300 sec: 4769.4). Total num frames: 82045952. Throughput: 0: 9294.3. Samples: 164090140. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:08,991][27935] Avg episode reward: [(0, '-49.995')] [2022-07-12 23:50:13,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4710.4, 300 sec: 4762.5). Total num frames: 82068480. Throughput: 0: 9239.7. Samples: 164148336. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:13,989][27935] Avg episode reward: [(0, '-49.721')] [2022-07-12 23:50:18,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4727.8, 300 sec: 4769.4). Total num frames: 82095104. Throughput: 0: 9195.5. Samples: 164207092. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:18,989][27935] Avg episode reward: [(0, '-49.460')] [2022-07-12 23:50:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4755.5). Total num frames: 82116608. Throughput: 0: 9130.8. Samples: 164234584. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:23,989][27935] Avg episode reward: [(0, '-50.179')] [2022-07-12 23:50:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4748.6). Total num frames: 82140160. Throughput: 0: 9149.7. Samples: 164289732. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:28,989][27935] Avg episode reward: [(0, '-50.793')] [2022-07-12 23:50:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4741.6). Total num frames: 82162688. Throughput: 0: 9201.2. Samples: 164344612. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:33,989][27935] Avg episode reward: [(0, '-51.424')] [2022-07-12 23:50:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4731.2). Total num frames: 82186240. Throughput: 0: 9214.0. Samples: 164372032. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:38,989][27935] Avg episode reward: [(0, '-51.277')] [2022-07-12 23:50:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4745.1). Total num frames: 82209792. Throughput: 0: 9317.1. Samples: 164431076. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:43,989][27935] Avg episode reward: [(0, '-51.715')] [2022-07-12 23:50:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4626.0, 300 sec: 4762.5). Total num frames: 82234368. Throughput: 0: 8814.1. Samples: 164459452. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:48,990][27935] Avg episode reward: [(0, '-50.970')] [2022-07-12 23:50:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4769.4). Total num frames: 82255872. Throughput: 0: 9431.3. Samples: 164514536. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-12 23:50:53,989][27935] Avg episode reward: [(0, '-50.958')] [2022-07-12 23:50:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4793.7). Total num frames: 82280448. Throughput: 0: 9385.3. Samples: 164570676. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:50:58,989][27935] Avg episode reward: [(0, '-50.694')] [2022-07-12 23:51:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4790.2). Total num frames: 82301952. Throughput: 0: 9224.4. Samples: 164622192. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:03,989][27935] Avg episode reward: [(0, '-50.063')] [2022-07-12 23:51:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4642.2, 300 sec: 4797.2). Total num frames: 82324480. Throughput: 0: 9206.9. Samples: 164648896. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:08,989][27935] Avg episode reward: [(0, '-50.574')] [2022-07-12 23:51:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4804.1). Total num frames: 82345984. Throughput: 0: 9218.1. Samples: 164704544. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:13,989][27935] Avg episode reward: [(0, '-50.079')] [2022-07-12 23:51:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4811.1). Total num frames: 82371584. Throughput: 0: 9210.3. Samples: 164759076. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:18,989][27935] Avg episode reward: [(0, '-50.003')] [2022-07-12 23:51:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4804.1). Total num frames: 82392064. Throughput: 0: 9194.6. Samples: 164785788. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:23,989][27935] Avg episode reward: [(0, '-50.837')] [2022-07-12 23:51:28,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 4800.7). Total num frames: 82415616. Throughput: 0: 9106.9. Samples: 164840884. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:28,989][27935] Avg episode reward: [(0, '-50.420')] [2022-07-12 23:51:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4797.2). Total num frames: 82438144. Throughput: 0: 9693.4. Samples: 164895656. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:33,989][27935] Avg episode reward: [(0, '-50.783')] [2022-07-12 23:51:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4786.8). Total num frames: 82460672. Throughput: 0: 9076.5. Samples: 164922980. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:38,989][27935] Avg episode reward: [(0, '-51.408')] [2022-07-12 23:51:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4786.8). Total num frames: 82484224. Throughput: 0: 9057.3. Samples: 164978256. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:43,989][27935] Avg episode reward: [(0, '-50.816')] [2022-07-12 23:51:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4539.7, 300 sec: 4772.9). Total num frames: 82506752. Throughput: 0: 9130.1. Samples: 165033048. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:48,989][27935] Avg episode reward: [(0, '-51.112')] [2022-07-12 23:51:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4556.8, 300 sec: 4765.9). Total num frames: 82529280. Throughput: 0: 9148.2. Samples: 165060564. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:53,989][27935] Avg episode reward: [(0, '-52.051')] [2022-07-12 23:51:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4539.7, 300 sec: 4769.4). Total num frames: 82552832. Throughput: 0: 9136.5. Samples: 165115688. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:51:58,990][27935] Avg episode reward: [(0, '-51.920')] [2022-07-12 23:52:03,989][27935] Fps is (10 sec: 4403.1, 60 sec: 4522.6, 300 sec: 4748.6). Total num frames: 82573312. Throughput: 0: 9069.7. Samples: 165167216. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:03,990][27935] Avg episode reward: [(0, '-52.017')] [2022-07-12 23:52:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4539.7, 300 sec: 4741.6). Total num frames: 82596864. Throughput: 0: 9078.3. Samples: 165194312. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:08,989][27935] Avg episode reward: [(0, '-52.331')] [2022-07-12 23:52:13,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4573.9, 300 sec: 4741.6). Total num frames: 82620416. Throughput: 0: 9080.3. Samples: 165249496. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:13,989][27935] Avg episode reward: [(0, '-51.726')] [2022-07-12 23:52:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4505.6, 300 sec: 4727.8). Total num frames: 82641920. Throughput: 0: 9110.1. Samples: 165305612. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:18,989][27935] Avg episode reward: [(0, '-51.826')] [2022-07-12 23:52:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4717.3). Total num frames: 82666496. Throughput: 0: 9120.2. Samples: 165333388. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:23,989][27935] Avg episode reward: [(0, '-51.829')] [2022-07-12 23:52:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4556.8, 300 sec: 4717.3). Total num frames: 82689024. Throughput: 0: 9121.9. Samples: 165388740. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-12 23:52:28,989][27935] Avg episode reward: [(0, '-51.216')] [2022-07-12 23:52:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4710.4). Total num frames: 82712576. Throughput: 0: 9134.8. Samples: 165444116. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:33,989][27935] Avg episode reward: [(0, '-51.159')] [2022-07-12 23:52:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4703.5). Total num frames: 82735104. Throughput: 0: 9137.3. Samples: 165471744. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:38,989][27935] Avg episode reward: [(0, '-50.880')] [2022-07-12 23:52:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4556.8, 300 sec: 4696.5). Total num frames: 82757632. Throughput: 0: 9124.6. Samples: 165526296. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:43,989][27935] Avg episode reward: [(0, '-50.264')] [2022-07-12 23:52:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4556.8, 300 sec: 4686.1). Total num frames: 82780160. Throughput: 0: 9150.4. Samples: 165578980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:48,989][27935] Avg episode reward: [(0, '-51.006')] [2022-07-12 23:52:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4672.2). Total num frames: 82803712. Throughput: 0: 9160.4. Samples: 165606528. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:53,989][27935] Avg episode reward: [(0, '-51.566')] [2022-07-12 23:52:58,992][27935] Fps is (10 sec: 4197.0, 60 sec: 4488.3, 300 sec: 4661.7). Total num frames: 82822144. Throughput: 0: 9058.4. Samples: 165657152. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:52:58,993][27935] Avg episode reward: [(0, '-50.923')] [2022-07-12 23:53:03,989][27935] Fps is (10 sec: 3174.4, 60 sec: 4369.1, 300 sec: 4623.6). Total num frames: 82835456. Throughput: 0: 8213.2. Samples: 165675204. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:03,989][27935] Avg episode reward: [(0, '-50.832')] [2022-07-12 23:53:08,989][27935] Fps is (10 sec: 3277.9, 60 sec: 4300.8, 300 sec: 4613.2). Total num frames: 82854912. Throughput: 0: 8403.7. Samples: 165711552. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:08,989][27935] Avg episode reward: [(0, '-51.774')] [2022-07-12 23:53:13,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4283.7, 300 sec: 4613.2). Total num frames: 82877440. Throughput: 0: 8371.7. Samples: 165765468. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:13,989][27935] Avg episode reward: [(0, '-51.516')] [2022-07-12 23:53:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4300.8, 300 sec: 4609.7). Total num frames: 82899968. Throughput: 0: 7730.9. Samples: 165792008. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:18,989][27935] Avg episode reward: [(0, '-52.138')] [2022-07-12 23:53:23,991][27935] Fps is (10 sec: 4504.5, 60 sec: 4266.5, 300 sec: 4613.2). Total num frames: 82922496. Throughput: 0: 8325.6. Samples: 165846416. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:23,992][27935] Avg episode reward: [(0, '-52.116')] [2022-07-12 23:53:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4317.9, 300 sec: 4613.2). Total num frames: 82948096. Throughput: 0: 8467.1. Samples: 165907316. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:28,989][27935] Avg episode reward: [(0, '-52.173')] [2022-07-12 23:53:33,989][27935] Fps is (10 sec: 5223.8, 60 sec: 4369.1, 300 sec: 4623.6). Total num frames: 82974720. Throughput: 0: 8636.7. Samples: 165967632. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:33,989][27935] Avg episode reward: [(0, '-51.845')] [2022-07-12 23:53:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4403.2, 300 sec: 4616.7). Total num frames: 82999296. Throughput: 0: 8699.9. Samples: 165998024. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:38,989][27935] Avg episode reward: [(0, '-51.715')] [2022-07-12 23:53:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4454.4, 300 sec: 4620.2). Total num frames: 83024896. Throughput: 0: 8934.1. Samples: 166059156. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:43,989][27935] Avg episode reward: [(0, '-51.261')] [2022-07-12 23:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4522.7, 300 sec: 4616.7). Total num frames: 83051520. Throughput: 0: 9890.0. Samples: 166120256. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:48,989][27935] Avg episode reward: [(0, '-51.532')] [2022-07-12 23:53:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4539.7, 300 sec: 4623.6). Total num frames: 83076096. Throughput: 0: 9756.7. Samples: 166150604. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:53,990][27935] Avg episode reward: [(0, '-51.397')] [2022-07-12 23:53:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4659.5, 300 sec: 4627.1). Total num frames: 83101696. Throughput: 0: 9920.0. Samples: 166211868. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:53:58,989][27935] Avg episode reward: [(0, '-51.517')] [2022-07-12 23:54:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4627.1). Total num frames: 83125248. Throughput: 0: 10594.5. Samples: 166268760. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:54:03,990][27935] Avg episode reward: [(0, '-51.431')] [2022-07-12 23:54:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4623.6). Total num frames: 83149824. Throughput: 0: 10057.6. Samples: 166298984. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:54:08,990][27935] Avg episode reward: [(0, '-50.891')] [2022-07-12 23:54:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4623.7). Total num frames: 83175424. Throughput: 0: 10061.9. Samples: 166360104. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:13,989][27935] Avg episode reward: [(0, '-51.662')] [2022-07-12 23:54:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4620.1). Total num frames: 83201024. Throughput: 0: 10067.5. Samples: 166420672. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:18,989][27935] Avg episode reward: [(0, '-52.047')] [2022-07-12 23:54:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 5034.9, 300 sec: 4623.6). Total num frames: 83224576. Throughput: 0: 10067.9. Samples: 166451080. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:23,989][27935] Avg episode reward: [(0, '-51.891')] [2022-07-12 23:54:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4623.6). Total num frames: 83251200. Throughput: 0: 10061.1. Samples: 166511904. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:28,989][27935] Avg episode reward: [(0, '-51.970')] [2022-07-12 23:54:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4630.6). Total num frames: 83276800. Throughput: 0: 10038.3. Samples: 166571980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:33,989][27935] Avg episode reward: [(0, '-52.099')] [2022-07-12 23:54:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4641.0). Total num frames: 83302400. Throughput: 0: 10046.8. Samples: 166602712. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:38,989][27935] Avg episode reward: [(0, '-53.287')] [2022-07-12 23:54:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4641.2). Total num frames: 83325952. Throughput: 0: 10042.2. Samples: 166663768. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:43,989][27935] Avg episode reward: [(0, '-52.452')] [2022-07-12 23:54:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4665.3). Total num frames: 83353600. Throughput: 0: 10131.0. Samples: 166724656. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:48,989][27935] Avg episode reward: [(0, '-52.567')] [2022-07-12 23:54:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4654.9). Total num frames: 83374080. Throughput: 0: 10054.9. Samples: 166751452. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:53,989][27935] Avg episode reward: [(0, '-51.966')] [2022-07-12 23:54:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4932.3, 300 sec: 4661.8). Total num frames: 83397632. Throughput: 0: 9905.1. Samples: 166805832. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:54:58,989][27935] Avg episode reward: [(0, '-51.380')] [2022-07-12 23:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4661.8). Total num frames: 83421184. Throughput: 0: 9825.4. Samples: 166862816. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:03,989][27935] Avg episode reward: [(0, '-51.118')] [2022-07-12 23:55:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4675.7). Total num frames: 83447808. Throughput: 0: 9830.0. Samples: 166893432. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:08,989][27935] Avg episode reward: [(0, '-50.813')] [2022-07-12 23:55:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4665.3). Total num frames: 83471360. Throughput: 0: 9775.9. Samples: 166951820. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:13,989][27935] Avg episode reward: [(0, '-50.998')] [2022-07-12 23:55:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4672.2). Total num frames: 83494912. Throughput: 0: 9786.7. Samples: 167012384. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:18,989][27935] Avg episode reward: [(0, '-51.204')] [2022-07-12 23:55:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4686.1). Total num frames: 83522560. Throughput: 0: 9782.1. Samples: 167042908. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:23,989][27935] Avg episode reward: [(0, '-51.527')] [2022-07-12 23:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4932.3, 300 sec: 4693.0). Total num frames: 83547136. Throughput: 0: 9790.3. Samples: 167104332. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:28,989][27935] Avg episode reward: [(0, '-52.097')] [2022-07-12 23:55:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4693.0). Total num frames: 83570688. Throughput: 0: 9715.4. Samples: 167161848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:33,990][27935] Avg episode reward: [(0, '-52.010')] [2022-07-12 23:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4696.5). Total num frames: 83595264. Throughput: 0: 9730.1. Samples: 167189308. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:38,989][27935] Avg episode reward: [(0, '-52.781')] [2022-07-12 23:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4700.0). Total num frames: 83620864. Throughput: 0: 9862.7. Samples: 167249652. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:43,989][27935] Avg episode reward: [(0, '-52.778')] [2022-07-12 23:55:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4710.4). Total num frames: 83645440. Throughput: 0: 9958.0. Samples: 167310928. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-12 23:55:48,989][27935] Avg episode reward: [(0, '-52.595')] [2022-07-12 23:55:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 4713.9). Total num frames: 83671040. Throughput: 0: 9952.4. Samples: 167341292. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:55:53,989][27935] Avg episode reward: [(0, '-52.329')] [2022-07-12 23:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5000.5, 300 sec: 4731.2). Total num frames: 83697664. Throughput: 0: 10027.3. Samples: 167403048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:55:58,989][27935] Avg episode reward: [(0, '-52.715')] [2022-07-12 23:56:03,994][27935] Fps is (10 sec: 5014.9, 60 sec: 5000.1, 300 sec: 4734.6). Total num frames: 83721216. Throughput: 0: 9949.0. Samples: 167460144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:03,995][27935] Avg episode reward: [(0, '-53.148')] [2022-07-12 23:56:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4748.6). Total num frames: 83746816. Throughput: 0: 9959.5. Samples: 167491084. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:08,989][27935] Avg episode reward: [(0, '-53.590')] [2022-07-12 23:56:13,989][27935] Fps is (10 sec: 5020.3, 60 sec: 5000.5, 300 sec: 4745.1). Total num frames: 83771392. Throughput: 0: 9959.1. Samples: 167552492. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:13,989][27935] Avg episode reward: [(0, '-53.123')] [2022-07-12 23:56:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4762.5). Total num frames: 83796992. Throughput: 0: 10028.5. Samples: 167613132. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:18,989][27935] Avg episode reward: [(0, '-53.397')] [2022-07-12 23:56:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4769.4). Total num frames: 83822592. Throughput: 0: 10101.6. Samples: 167643880. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:23,990][27935] Avg episode reward: [(0, '-52.575')] [2022-07-12 23:56:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4779.8). Total num frames: 83848192. Throughput: 0: 10132.4. Samples: 167705608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:28,989][27935] Avg episode reward: [(0, '-52.335')] [2022-07-12 23:56:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4786.8). Total num frames: 83872768. Throughput: 0: 10105.2. Samples: 167765664. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:33,989][27935] Avg episode reward: [(0, '-52.192')] [2022-07-12 23:56:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4797.2). Total num frames: 83899392. Throughput: 0: 10112.2. Samples: 167796340. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:38,989][27935] Avg episode reward: [(0, '-51.954')] [2022-07-12 23:56:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4800.7). Total num frames: 83922944. Throughput: 0: 10057.9. Samples: 167855652. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:43,990][27935] Avg episode reward: [(0, '-52.189')] [2022-07-12 23:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4811.1). Total num frames: 83948544. Throughput: 0: 10136.0. Samples: 167916208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:48,990][27935] Avg episode reward: [(0, '-51.840')] [2022-07-12 23:56:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4818.0). Total num frames: 83974144. Throughput: 0: 10127.5. Samples: 167946820. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:53,996][27935] Avg episode reward: [(0, '-52.132')] [2022-07-12 23:56:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4835.4). Total num frames: 83999744. Throughput: 0: 10129.0. Samples: 168008296. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:56:58,989][27935] Avg episode reward: [(0, '-52.077')] [2022-07-12 23:57:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5035.1, 300 sec: 4835.4). Total num frames: 84023296. Throughput: 0: 10037.7. Samples: 168064828. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:03,989][27935] Avg episode reward: [(0, '-51.424')] [2022-07-12 23:57:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 4838.8). Total num frames: 84047872. Throughput: 0: 10034.2. Samples: 168095420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:08,989][27935] Avg episode reward: [(0, '-51.811')] [2022-07-12 23:57:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4852.7). Total num frames: 84073472. Throughput: 0: 10016.9. Samples: 168156368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:13,989][27935] Avg episode reward: [(0, '-52.002')] [2022-07-12 23:57:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4856.2). Total num frames: 84099072. Throughput: 0: 10045.6. Samples: 168217716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:18,992][27935] Avg episode reward: [(0, '-51.789')] [2022-07-12 23:57:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 4866.6). Total num frames: 84124672. Throughput: 0: 10049.3. Samples: 168248560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:23,989][27935] Avg episode reward: [(0, '-51.796')] [2022-07-12 23:57:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4870.1). Total num frames: 84149248. Throughput: 0: 10100.2. Samples: 168310160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-12 23:57:28,989][27935] Avg episode reward: [(0, '-52.753')] [2022-07-12 23:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4884.0). Total num frames: 84175872. Throughput: 0: 10082.6. Samples: 168369924. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:33,989][27935] Avg episode reward: [(0, '-52.910')] [2022-07-12 23:57:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4894.4). Total num frames: 84201472. Throughput: 0: 10090.7. Samples: 168400904. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:38,990][27935] Avg episode reward: [(0, '-52.900')] [2022-07-12 23:57:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4897.8). Total num frames: 84225024. Throughput: 0: 10036.3. Samples: 168459928. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:43,989][27935] Avg episode reward: [(0, '-52.379')] [2022-07-12 23:57:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4908.3). Total num frames: 84251648. Throughput: 0: 9456.0. Samples: 168490348. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:48,989][27935] Avg episode reward: [(0, '-52.918')] [2022-07-12 23:57:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4925.7). Total num frames: 84275200. Throughput: 0: 10147.4. Samples: 168552052. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:53,989][27935] Avg episode reward: [(0, '-52.557')] [2022-07-12 23:57:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4970.7). Total num frames: 84301824. Throughput: 0: 10154.9. Samples: 168613336. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:57:58,989][27935] Avg episode reward: [(0, '-52.440')] [2022-07-12 23:58:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4984.6). Total num frames: 84325376. Throughput: 0: 10055.0. Samples: 168670192. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:03,989][27935] Avg episode reward: [(0, '-51.144')] [2022-07-12 23:58:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4995.0). Total num frames: 84350976. Throughput: 0: 10048.6. Samples: 168700748. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:08,990][27935] Avg episode reward: [(0, '-51.358')] [2022-07-12 23:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5005.5). Total num frames: 84376576. Throughput: 0: 10036.5. Samples: 168761804. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:13,989][27935] Avg episode reward: [(0, '-51.275')] [2022-07-12 23:58:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 84401152. Throughput: 0: 10062.8. Samples: 168822752. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:18,990][27935] Avg episode reward: [(0, '-50.717')] [2022-07-12 23:58:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 84426752. Throughput: 0: 10054.8. Samples: 168853372. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:23,989][27935] Avg episode reward: [(0, '-50.776')] [2022-07-12 23:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5005.5). Total num frames: 84451328. Throughput: 0: 10096.5. Samples: 168914268. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:28,989][27935] Avg episode reward: [(0, '-51.246')] [2022-07-12 23:58:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 84478976. Throughput: 0: 10767.7. Samples: 168974892. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:33,989][27935] Avg episode reward: [(0, '-51.876')] [2022-07-12 23:58:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 84504576. Throughput: 0: 10070.5. Samples: 169005224. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:38,989][27935] Avg episode reward: [(0, '-52.178')] [2022-07-12 23:58:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5008.9). Total num frames: 84529152. Throughput: 0: 10069.6. Samples: 169066468. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:43,989][27935] Avg episode reward: [(0, '-51.047')] [2022-07-12 23:58:48,992][27935] Fps is (10 sec: 4913.5, 60 sec: 5034.4, 300 sec: 5008.9). Total num frames: 84553728. Throughput: 0: 10164.0. Samples: 169127608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:48,993][27935] Avg episode reward: [(0, '-51.410')] [2022-07-12 23:58:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5008.9). Total num frames: 84579328. Throughput: 0: 10166.4. Samples: 169158236. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:53,989][27935] Avg episode reward: [(0, '-51.141')] [2022-07-12 23:58:58,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5051.7, 300 sec: 5015.9). Total num frames: 84604928. Throughput: 0: 10161.8. Samples: 169219084. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:58:58,989][27935] Avg episode reward: [(0, '-50.332')] [2022-07-12 23:59:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 84628480. Throughput: 0: 9486.7. Samples: 169249652. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:59:03,989][27935] Avg episode reward: [(0, '-50.477')] [2022-07-12 23:59:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 84654080. Throughput: 0: 10074.2. Samples: 169306712. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-12 23:59:08,989][27935] Avg episode reward: [(0, '-50.550')] [2022-07-12 23:59:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5008.9). Total num frames: 84678656. Throughput: 0: 10072.9. Samples: 169367548. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:13,989][27935] Avg episode reward: [(0, '-50.555')] [2022-07-12 23:59:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5019.3). Total num frames: 84705280. Throughput: 0: 10081.8. Samples: 169428572. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:18,989][27935] Avg episode reward: [(0, '-51.667')] [2022-07-12 23:59:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5012.4). Total num frames: 84729856. Throughput: 0: 10095.2. Samples: 169459508. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:23,989][27935] Avg episode reward: [(0, '-51.696')] [2022-07-12 23:59:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5012.4). Total num frames: 84755456. Throughput: 0: 10081.5. Samples: 169520136. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:28,989][27935] Avg episode reward: [(0, '-51.945')] [2022-07-12 23:59:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5012.4). Total num frames: 84781056. Throughput: 0: 10066.8. Samples: 169580580. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:33,991][27935] Avg episode reward: [(0, '-51.845')] [2022-07-12 23:59:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5015.9). Total num frames: 84805632. Throughput: 0: 10067.6. Samples: 169611276. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:38,989][27935] Avg episode reward: [(0, '-51.671')] [2022-07-12 23:59:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5008.9). Total num frames: 84831232. Throughput: 0: 10062.0. Samples: 169671876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:43,989][27935] Avg episode reward: [(0, '-51.797')] [2022-07-12 23:59:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5035.0, 300 sec: 5022.8). Total num frames: 84855808. Throughput: 0: 10724.5. Samples: 169732256. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:48,989][27935] Avg episode reward: [(0, '-52.591')] [2022-07-12 23:59:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 84882432. Throughput: 0: 10140.3. Samples: 169763024. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:53,989][27935] Avg episode reward: [(0, '-51.005')] [2022-07-12 23:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5029.7). Total num frames: 84904960. Throughput: 0: 10140.5. Samples: 169823872. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-12 23:59:58,989][27935] Avg episode reward: [(0, '-51.268')] [2022-07-13 00:00:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5029.7). Total num frames: 84931584. Throughput: 0: 9456.2. Samples: 169854100. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:03,989][27935] Avg episode reward: [(0, '-50.847')] [2022-07-13 00:00:08,991][27935] Fps is (10 sec: 5118.7, 60 sec: 5034.4, 300 sec: 5033.2). Total num frames: 84956160. Throughput: 0: 10024.2. Samples: 169910624. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:08,992][27935] Avg episode reward: [(0, '-51.460')] [2022-07-13 00:00:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5036.7). Total num frames: 84980736. Throughput: 0: 10014.5. Samples: 169970788. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:13,989][27935] Avg episode reward: [(0, '-52.005')] [2022-07-13 00:00:18,989][27935] Fps is (10 sec: 4916.5, 60 sec: 5000.5, 300 sec: 5026.3). Total num frames: 85005312. Throughput: 0: 10022.6. Samples: 170031596. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:18,989][27935] Avg episode reward: [(0, '-51.900')] [2022-07-13 00:00:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 85031936. Throughput: 0: 10020.2. Samples: 170062184. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:23,989][27935] Avg episode reward: [(0, '-51.545')] [2022-07-13 00:00:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 85056512. Throughput: 0: 10034.5. Samples: 170123428. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:28,989][27935] Avg episode reward: [(0, '-52.225')] [2022-07-13 00:00:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5043.6). Total num frames: 85083136. Throughput: 0: 10020.3. Samples: 170183168. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:33,989][27935] Avg episode reward: [(0, '-51.392')] [2022-07-13 00:00:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5033.2). Total num frames: 85105664. Throughput: 0: 10004.7. Samples: 170213236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:38,989][27935] Avg episode reward: [(0, '-51.698')] [2022-07-13 00:00:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5043.6). Total num frames: 85133312. Throughput: 0: 10001.7. Samples: 170273948. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:43,989][27935] Avg episode reward: [(0, '-51.291')] [2022-07-13 00:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 85157888. Throughput: 0: 10670.9. Samples: 170334292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 00:00:48,989][27935] Avg episode reward: [(0, '-50.311')] [2022-07-13 00:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 85183488. Throughput: 0: 10087.0. Samples: 170364512. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:00:53,989][27935] Avg episode reward: [(0, '-50.644')] [2022-07-13 00:00:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5040.3). Total num frames: 85208064. Throughput: 0: 10114.8. Samples: 170425956. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:00:58,989][27935] Avg episode reward: [(0, '-50.675')] [2022-07-13 00:01:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5033.2). Total num frames: 85231616. Throughput: 0: 10016.7. Samples: 170482348. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:03,989][27935] Avg episode reward: [(0, '-51.317')] [2022-07-13 00:01:08,989][27935] Fps is (10 sec: 4812.7, 60 sec: 5000.7, 300 sec: 5033.2). Total num frames: 85256192. Throughput: 0: 10015.5. Samples: 170512884. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:08,989][27935] Avg episode reward: [(0, '-52.270')] [2022-07-13 00:01:13,991][27935] Fps is (10 sec: 5016.7, 60 sec: 5017.5, 300 sec: 5033.2). Total num frames: 85281792. Throughput: 0: 9985.6. Samples: 170572796. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:13,991][27935] Avg episode reward: [(0, '-52.030')] [2022-07-13 00:01:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5026.3). Total num frames: 85305344. Throughput: 0: 9960.7. Samples: 170631400. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:18,989][27935] Avg episode reward: [(0, '-51.672')] [2022-07-13 00:01:23,989][27935] Fps is (10 sec: 5018.5, 60 sec: 5000.5, 300 sec: 5029.8). Total num frames: 85331968. Throughput: 0: 9973.5. Samples: 170662044. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:23,989][27935] Avg episode reward: [(0, '-52.115')] [2022-07-13 00:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5026.3). Total num frames: 85355520. Throughput: 0: 9985.5. Samples: 170723296. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:28,989][27935] Avg episode reward: [(0, '-51.624')] [2022-07-13 00:01:33,991][27935] Fps is (10 sec: 5221.2, 60 sec: 5017.4, 300 sec: 5033.2). Total num frames: 85384192. Throughput: 0: 9996.4. Samples: 170784152. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:33,992][27935] Avg episode reward: [(0, '-51.317')] [2022-07-13 00:01:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 85407744. Throughput: 0: 10010.0. Samples: 170814964. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:38,989][27935] Avg episode reward: [(0, '-50.610')] [2022-07-13 00:01:43,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4983.5, 300 sec: 5029.8). Total num frames: 85432320. Throughput: 0: 10003.1. Samples: 170876096. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:43,989][27935] Avg episode reward: [(0, '-50.676')] [2022-07-13 00:01:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5033.2). Total num frames: 85458944. Throughput: 0: 10120.4. Samples: 170937764. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:48,989][27935] Avg episode reward: [(0, '-50.006')] [2022-07-13 00:01:53,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5017.6, 300 sec: 5033.2). Total num frames: 85484544. Throughput: 0: 10124.6. Samples: 170968492. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:53,990][27935] Avg episode reward: [(0, '-50.228')] [2022-07-13 00:01:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 85511168. Throughput: 0: 10170.8. Samples: 171030464. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:01:58,989][27935] Avg episode reward: [(0, '-49.698')] [2022-07-13 00:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 85534720. Throughput: 0: 10133.4. Samples: 171087400. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:03,989][27935] Avg episode reward: [(0, '-49.783')] [2022-07-13 00:02:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 85558272. Throughput: 0: 10137.6. Samples: 171118236. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:08,989][27935] Avg episode reward: [(0, '-49.964')] [2022-07-13 00:02:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.9, 300 sec: 5040.2). Total num frames: 85585920. Throughput: 0: 10134.2. Samples: 171179336. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:13,989][27935] Avg episode reward: [(0, '-50.085')] [2022-07-13 00:02:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 85610496. Throughput: 0: 10151.7. Samples: 171240956. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:18,989][27935] Avg episode reward: [(0, '-50.597')] [2022-07-13 00:02:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 85636096. Throughput: 0: 10157.8. Samples: 171272064. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:23,989][27935] Avg episode reward: [(0, '-50.913')] [2022-07-13 00:02:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5033.2). Total num frames: 85660672. Throughput: 0: 10153.2. Samples: 171332992. Policy #0 lag: (min: 0.0, avg: 7.5, max: 19.0) [2022-07-13 00:02:28,989][27935] Avg episode reward: [(0, '-51.477')] [2022-07-13 00:02:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5069.0, 300 sec: 5040.2). Total num frames: 85688320. Throughput: 0: 10135.1. Samples: 171393844. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:33,989][27935] Avg episode reward: [(0, '-52.007')] [2022-07-13 00:02:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 85711872. Throughput: 0: 10125.6. Samples: 171424144. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:38,989][27935] Avg episode reward: [(0, '-52.070')] [2022-07-13 00:02:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 85737472. Throughput: 0: 10078.7. Samples: 171484004. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:43,989][27935] Avg episode reward: [(0, '-52.189')] [2022-07-13 00:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 85762048. Throughput: 0: 10183.6. Samples: 171545660. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:48,989][27935] Avg episode reward: [(0, '-52.384')] [2022-07-13 00:02:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 85787648. Throughput: 0: 10173.2. Samples: 171576028. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:53,989][27935] Avg episode reward: [(0, '-53.449')] [2022-07-13 00:02:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 85814272. Throughput: 0: 10164.8. Samples: 171636752. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:02:58,989][27935] Avg episode reward: [(0, '-53.251')] [2022-07-13 00:03:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5036.7). Total num frames: 85836800. Throughput: 0: 10063.0. Samples: 171693792. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:03,990][27935] Avg episode reward: [(0, '-53.288')] [2022-07-13 00:03:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 85862400. Throughput: 0: 10049.3. Samples: 171724284. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:08,989][27935] Avg episode reward: [(0, '-53.525')] [2022-07-13 00:03:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 85888000. Throughput: 0: 10033.6. Samples: 171784504. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:13,989][27935] Avg episode reward: [(0, '-53.321')] [2022-07-13 00:03:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5036.7). Total num frames: 85912576. Throughput: 0: 10031.1. Samples: 171845244. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:18,989][27935] Avg episode reward: [(0, '-53.065')] [2022-07-13 00:03:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 85939200. Throughput: 0: 10040.7. Samples: 171875976. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:23,989][27935] Avg episode reward: [(0, '-53.029')] [2022-07-13 00:03:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5036.7). Total num frames: 85964800. Throughput: 0: 10068.9. Samples: 171937104. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:28,989][27935] Avg episode reward: [(0, '-52.814')] [2022-07-13 00:03:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5033.2). Total num frames: 85989376. Throughput: 0: 10040.0. Samples: 171997460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:33,989][27935] Avg episode reward: [(0, '-52.387')] [2022-07-13 00:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 86013952. Throughput: 0: 10052.0. Samples: 172028368. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:38,989][27935] Avg episode reward: [(0, '-52.321')] [2022-07-13 00:03:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 86040576. Throughput: 0: 10066.4. Samples: 172089740. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:43,989][27935] Avg episode reward: [(0, '-52.862')] [2022-07-13 00:03:49,000][27935] Fps is (10 sec: 5114.5, 60 sec: 5050.8, 300 sec: 5036.5). Total num frames: 86065152. Throughput: 0: 10151.4. Samples: 172150716. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:49,000][27935] Avg episode reward: [(0, '-53.752')] [2022-07-13 00:03:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 86090752. Throughput: 0: 10155.6. Samples: 172181288. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:53,989][27935] Avg episode reward: [(0, '-53.589')] [2022-07-13 00:03:58,989][27935] Fps is (10 sec: 5125.6, 60 sec: 5034.7, 300 sec: 5043.6). Total num frames: 86116352. Throughput: 0: 10184.2. Samples: 172242792. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:03:58,990][27935] Avg episode reward: [(0, '-53.086')] [2022-07-13 00:04:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5040.2). Total num frames: 86140928. Throughput: 0: 10116.1. Samples: 172300468. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:04:03,989][27935] Avg episode reward: [(0, '-52.618')] [2022-07-13 00:04:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 86165504. Throughput: 0: 10116.9. Samples: 172331236. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:04:08,995][27935] Avg episode reward: [(0, '-52.300')] [2022-07-13 00:04:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 86193152. Throughput: 0: 10127.3. Samples: 172392832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 00:04:13,989][27935] Avg episode reward: [(0, '-51.313')] [2022-07-13 00:04:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 86215680. Throughput: 0: 10158.0. Samples: 172454572. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:18,990][27935] Avg episode reward: [(0, '-50.938')] [2022-07-13 00:04:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5047.1). Total num frames: 86244352. Throughput: 0: 10163.9. Samples: 172485744. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:23,989][27935] Avg episode reward: [(0, '-51.179')] [2022-07-13 00:04:28,992][27935] Fps is (10 sec: 5220.6, 60 sec: 5051.4, 300 sec: 5040.1). Total num frames: 86267904. Throughput: 0: 10162.2. Samples: 172547076. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:28,993][27935] Avg episode reward: [(0, '-51.055')] [2022-07-13 00:04:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 86295552. Throughput: 0: 10167.6. Samples: 172608148. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:33,989][27935] Avg episode reward: [(0, '-51.228')] [2022-07-13 00:04:39,009][27935] Fps is (10 sec: 5213.8, 60 sec: 5101.2, 300 sec: 5046.8). Total num frames: 86320128. Throughput: 0: 10164.4. Samples: 172638892. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:39,009][27935] Avg episode reward: [(0, '-50.757')] [2022-07-13 00:04:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 86345728. Throughput: 0: 10177.1. Samples: 172700760. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:43,989][27935] Avg episode reward: [(0, '-51.826')] [2022-07-13 00:04:48,989][27935] Fps is (10 sec: 5130.3, 60 sec: 5103.9, 300 sec: 5047.1). Total num frames: 86371328. Throughput: 0: 10258.0. Samples: 172762080. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:48,989][27935] Avg episode reward: [(0, '-52.221')] [2022-07-13 00:04:53,990][27935] Fps is (10 sec: 5119.2, 60 sec: 5102.8, 300 sec: 5057.5). Total num frames: 86396928. Throughput: 0: 10246.4. Samples: 172792340. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:53,991][27935] Avg episode reward: [(0, '-52.104')] [2022-07-13 00:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5054.0). Total num frames: 86422528. Throughput: 0: 10246.7. Samples: 172853932. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:04:58,989][27935] Avg episode reward: [(0, '-52.009')] [2022-07-13 00:05:03,989][27935] Fps is (10 sec: 4915.9, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 86446080. Throughput: 0: 9565.3. Samples: 172885012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:03,989][27935] Avg episode reward: [(0, '-52.960')] [2022-07-13 00:05:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 86470656. Throughput: 0: 10129.0. Samples: 172941548. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:08,989][27935] Avg episode reward: [(0, '-53.229')] [2022-07-13 00:05:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 86497280. Throughput: 0: 10124.2. Samples: 173002628. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:13,990][27935] Avg episode reward: [(0, '-53.032')] [2022-07-13 00:05:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5047.1). Total num frames: 86520832. Throughput: 0: 10123.4. Samples: 173063700. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:18,989][27935] Avg episode reward: [(0, '-52.917')] [2022-07-13 00:05:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5054.0). Total num frames: 86547456. Throughput: 0: 10131.7. Samples: 173094616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:23,989][27935] Avg episode reward: [(0, '-52.173')] [2022-07-13 00:05:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5086.2, 300 sec: 5050.6). Total num frames: 86573056. Throughput: 0: 10105.6. Samples: 173155512. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:28,989][27935] Avg episode reward: [(0, '-52.324')] [2022-07-13 00:05:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 86597632. Throughput: 0: 10092.7. Samples: 173216252. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:33,989][27935] Avg episode reward: [(0, '-52.581')] [2022-07-13 00:05:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5070.5, 300 sec: 5054.0). Total num frames: 86624256. Throughput: 0: 10103.5. Samples: 173246984. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:38,989][27935] Avg episode reward: [(0, '-52.649')] [2022-07-13 00:05:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 86649856. Throughput: 0: 10109.4. Samples: 173308856. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:43,989][27935] Avg episode reward: [(0, '-52.180')] [2022-07-13 00:05:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 86675456. Throughput: 0: 10784.5. Samples: 173370316. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:48,989][27935] Avg episode reward: [(0, '-52.425')] [2022-07-13 00:05:53,991][27935] Fps is (10 sec: 5118.8, 60 sec: 5068.7, 300 sec: 5061.0). Total num frames: 86701056. Throughput: 0: 10210.2. Samples: 173401032. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 00:05:53,992][27935] Avg episode reward: [(0, '-52.725')] [2022-07-13 00:05:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 86725632. Throughput: 0: 10222.8. Samples: 173462652. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:05:58,989][27935] Avg episode reward: [(0, '-52.226')] [2022-07-13 00:06:03,989][27935] Fps is (10 sec: 4916.3, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 86750208. Throughput: 0: 10136.5. Samples: 173519840. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:03,989][27935] Avg episode reward: [(0, '-52.087')] [2022-07-13 00:06:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5068.0). Total num frames: 86776832. Throughput: 0: 10131.0. Samples: 173550512. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:08,989][27935] Avg episode reward: [(0, '-52.289')] [2022-07-13 00:06:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 86800384. Throughput: 0: 10144.9. Samples: 173612032. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:13,989][27935] Avg episode reward: [(0, '-51.677')] [2022-07-13 00:06:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 86827008. Throughput: 0: 10144.3. Samples: 173672744. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:18,989][27935] Avg episode reward: [(0, '-52.119')] [2022-07-13 00:06:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 86851584. Throughput: 0: 10151.1. Samples: 173703784. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:23,990][27935] Avg episode reward: [(0, '-50.828')] [2022-07-13 00:06:28,993][27935] Fps is (10 sec: 5220.4, 60 sec: 5102.6, 300 sec: 5067.9). Total num frames: 86879232. Throughput: 0: 10160.7. Samples: 173766128. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:28,993][27935] Avg episode reward: [(0, '-50.601')] [2022-07-13 00:06:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 86901760. Throughput: 0: 10144.3. Samples: 173826808. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:33,989][27935] Avg episode reward: [(0, '-50.412')] [2022-07-13 00:06:38,989][27935] Fps is (10 sec: 5019.5, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 86929408. Throughput: 0: 10139.0. Samples: 173857264. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:38,989][27935] Avg episode reward: [(0, '-49.937')] [2022-07-13 00:06:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 86955008. Throughput: 0: 10140.1. Samples: 173918956. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:43,989][27935] Avg episode reward: [(0, '-50.081')] [2022-07-13 00:06:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 86980608. Throughput: 0: 10236.6. Samples: 173980488. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:48,989][27935] Avg episode reward: [(0, '-49.724')] [2022-07-13 00:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.1, 300 sec: 5067.9). Total num frames: 87006208. Throughput: 0: 10240.7. Samples: 174011344. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:53,989][27935] Avg episode reward: [(0, '-50.181')] [2022-07-13 00:06:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 87031808. Throughput: 0: 10239.6. Samples: 174072812. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:06:58,989][27935] Avg episode reward: [(0, '-50.535')] [2022-07-13 00:07:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 87055360. Throughput: 0: 10168.4. Samples: 174130320. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:03,990][27935] Avg episode reward: [(0, '-50.386')] [2022-07-13 00:07:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 87078912. Throughput: 0: 10096.7. Samples: 174158136. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:08,989][27935] Avg episode reward: [(0, '-50.916')] [2022-07-13 00:07:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 87102464. Throughput: 0: 10068.7. Samples: 174219184. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:13,990][27935] Avg episode reward: [(0, '-50.799')] [2022-07-13 00:07:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4983.5, 300 sec: 5050.6). Total num frames: 87126016. Throughput: 0: 9874.5. Samples: 174271160. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:18,989][27935] Avg episode reward: [(0, '-51.838')] [2022-07-13 00:07:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4983.5, 300 sec: 5050.6). Total num frames: 87150592. Throughput: 0: 9854.4. Samples: 174300712. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:23,989][27935] Avg episode reward: [(0, '-52.004')] [2022-07-13 00:07:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.7, 300 sec: 5047.1). Total num frames: 87177216. Throughput: 0: 9850.7. Samples: 174362236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:28,989][27935] Avg episode reward: [(0, '-51.954')] [2022-07-13 00:07:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5050.6). Total num frames: 87201792. Throughput: 0: 9170.4. Samples: 174393156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:33,989][27935] Avg episode reward: [(0, '-52.002')] [2022-07-13 00:07:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5054.0). Total num frames: 87228416. Throughput: 0: 9864.5. Samples: 174455244. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 00:07:38,989][27935] Avg episode reward: [(0, '-51.733')] [2022-07-13 00:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5054.0). Total num frames: 87252992. Throughput: 0: 9849.8. Samples: 174516052. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:07:43,989][27935] Avg episode reward: [(0, '-51.301')] [2022-07-13 00:07:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5057.5). Total num frames: 87279616. Throughput: 0: 9946.8. Samples: 174577928. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:07:48,989][27935] Avg episode reward: [(0, '-51.508')] [2022-07-13 00:07:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 5050.6). Total num frames: 87304192. Throughput: 0: 10008.9. Samples: 174608536. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:07:53,996][27935] Avg episode reward: [(0, '-50.957')] [2022-07-13 00:07:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5064.5). Total num frames: 87330816. Throughput: 0: 10021.2. Samples: 174670136. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:07:58,989][27935] Avg episode reward: [(0, '-50.977')] [2022-07-13 00:08:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 5050.6). Total num frames: 87352320. Throughput: 0: 10141.2. Samples: 174727512. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:03,989][27935] Avg episode reward: [(0, '-51.670')] [2022-07-13 00:08:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5054.0). Total num frames: 87378944. Throughput: 0: 10170.6. Samples: 174758388. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:08,989][27935] Avg episode reward: [(0, '-51.969')] [2022-07-13 00:08:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 87405568. Throughput: 0: 10186.0. Samples: 174820604. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:13,989][27935] Avg episode reward: [(0, '-52.535')] [2022-07-13 00:08:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 87430144. Throughput: 0: 10866.2. Samples: 174882136. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:18,989][27935] Avg episode reward: [(0, '-53.119')] [2022-07-13 00:08:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5057.5). Total num frames: 87456768. Throughput: 0: 10174.6. Samples: 174913100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:23,989][27935] Avg episode reward: [(0, '-52.863')] [2022-07-13 00:08:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 87482368. Throughput: 0: 10198.1. Samples: 174974968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:28,989][27935] Avg episode reward: [(0, '-53.023')] [2022-07-13 00:08:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5154.1, 300 sec: 5074.9). Total num frames: 87511040. Throughput: 0: 10190.5. Samples: 175036500. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:33,989][27935] Avg episode reward: [(0, '-53.375')] [2022-07-13 00:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 87533568. Throughput: 0: 10204.1. Samples: 175067720. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:38,989][27935] Avg episode reward: [(0, '-53.108')] [2022-07-13 00:08:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5071.6). Total num frames: 87561216. Throughput: 0: 10234.3. Samples: 175130680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:43,989][27935] Avg episode reward: [(0, '-52.741')] [2022-07-13 00:08:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 87585792. Throughput: 0: 10338.0. Samples: 175192720. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:48,989][27935] Avg episode reward: [(0, '-51.526')] [2022-07-13 00:08:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5071.4). Total num frames: 87612416. Throughput: 0: 10340.3. Samples: 175223700. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:53,989][27935] Avg episode reward: [(0, '-51.508')] [2022-07-13 00:08:58,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5136.8, 300 sec: 5078.3). Total num frames: 87639040. Throughput: 0: 10332.0. Samples: 175285580. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:08:58,993][27935] Avg episode reward: [(0, '-51.050')] [2022-07-13 00:09:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5074.9). Total num frames: 87662592. Throughput: 0: 10267.3. Samples: 175344164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:09:03,989][27935] Avg episode reward: [(0, '-50.662')] [2022-07-13 00:09:08,989][27935] Fps is (10 sec: 4917.0, 60 sec: 5154.1, 300 sec: 5067.9). Total num frames: 87688192. Throughput: 0: 10268.2. Samples: 175375168. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:09:08,989][27935] Avg episode reward: [(0, '-50.689')] [2022-07-13 00:09:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5078.3). Total num frames: 87713792. Throughput: 0: 10247.8. Samples: 175436120. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:09:13,989][27935] Avg episode reward: [(0, '-50.696')] [2022-07-13 00:09:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5071.4). Total num frames: 87740416. Throughput: 0: 10268.2. Samples: 175498568. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:09:18,989][27935] Avg episode reward: [(0, '-51.051')] [2022-07-13 00:09:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5074.9). Total num frames: 87764992. Throughput: 0: 10266.4. Samples: 175529708. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 00:09:23,989][27935] Avg episode reward: [(0, '-51.078')] [2022-07-13 00:09:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5074.9). Total num frames: 87792640. Throughput: 0: 10250.5. Samples: 175591952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:28,989][27935] Avg episode reward: [(0, '-51.358')] [2022-07-13 00:09:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5075.2). Total num frames: 87817216. Throughput: 0: 10264.0. Samples: 175654600. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:33,989][27935] Avg episode reward: [(0, '-51.895')] [2022-07-13 00:09:38,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5171.2, 300 sec: 5078.3). Total num frames: 87843840. Throughput: 0: 10280.0. Samples: 175686300. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:38,989][27935] Avg episode reward: [(0, '-52.918')] [2022-07-13 00:09:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5078.3). Total num frames: 87869440. Throughput: 0: 10293.1. Samples: 175748732. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:43,989][27935] Avg episode reward: [(0, '-53.371')] [2022-07-13 00:09:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5085.3). Total num frames: 87897088. Throughput: 0: 10387.2. Samples: 175811588. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:48,989][27935] Avg episode reward: [(0, '-53.825')] [2022-07-13 00:09:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5081.8). Total num frames: 87921664. Throughput: 0: 10398.7. Samples: 175843108. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:53,989][27935] Avg episode reward: [(0, '-53.192')] [2022-07-13 00:09:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.4, 300 sec: 5092.2). Total num frames: 87948288. Throughput: 0: 10449.5. Samples: 175906348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:09:58,990][27935] Avg episode reward: [(0, '-53.301')] [2022-07-13 00:10:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5092.2). Total num frames: 87972864. Throughput: 0: 10371.1. Samples: 175965268. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:03,989][27935] Avg episode reward: [(0, '-53.510')] [2022-07-13 00:10:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5092.2). Total num frames: 87999488. Throughput: 0: 10379.4. Samples: 175996780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:08,989][27935] Avg episode reward: [(0, '-52.808')] [2022-07-13 00:10:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 88024064. Throughput: 0: 10399.2. Samples: 176059916. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:13,989][27935] Avg episode reward: [(0, '-52.162')] [2022-07-13 00:10:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 88050688. Throughput: 0: 10383.7. Samples: 176121868. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:18,989][27935] Avg episode reward: [(0, '-52.232')] [2022-07-13 00:10:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5095.7). Total num frames: 88076288. Throughput: 0: 10365.8. Samples: 176152760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:23,989][27935] Avg episode reward: [(0, '-52.689')] [2022-07-13 00:10:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5102.6). Total num frames: 88102912. Throughput: 0: 10355.9. Samples: 176214748. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:28,989][27935] Avg episode reward: [(0, '-53.802')] [2022-07-13 00:10:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 88127488. Throughput: 0: 10333.4. Samples: 176276592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:33,989][27935] Avg episode reward: [(0, '-53.520')] [2022-07-13 00:10:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5099.2). Total num frames: 88154112. Throughput: 0: 10324.2. Samples: 176307696. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:38,989][27935] Avg episode reward: [(0, '-53.358')] [2022-07-13 00:10:44,000][27935] Fps is (10 sec: 5421.0, 60 sec: 5204.3, 300 sec: 5105.9). Total num frames: 88181760. Throughput: 0: 10291.7. Samples: 176369592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:44,001][27935] Avg episode reward: [(0, '-53.625')] [2022-07-13 00:10:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 88205312. Throughput: 0: 10369.4. Samples: 176431892. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:48,989][27935] Avg episode reward: [(0, '-53.020')] [2022-07-13 00:10:53,989][27935] Fps is (10 sec: 5125.7, 60 sec: 5188.2, 300 sec: 5109.6). Total num frames: 88232960. Throughput: 0: 10361.2. Samples: 176463040. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:53,990][27935] Avg episode reward: [(0, '-51.811')] [2022-07-13 00:10:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5109.6). Total num frames: 88257536. Throughput: 0: 10342.0. Samples: 176525304. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:10:58,989][27935] Avg episode reward: [(0, '-50.958')] [2022-07-13 00:11:03,989][27935] Fps is (10 sec: 4915.4, 60 sec: 5154.1, 300 sec: 5102.6). Total num frames: 88282112. Throughput: 0: 10266.8. Samples: 176583876. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 00:11:03,990][27935] Avg episode reward: [(0, '-50.918')] [2022-07-13 00:11:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5113.1). Total num frames: 88308736. Throughput: 0: 10275.3. Samples: 176615152. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:08,990][27935] Avg episode reward: [(0, '-50.818')] [2022-07-13 00:11:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5109.6). Total num frames: 88334336. Throughput: 0: 10282.9. Samples: 176677480. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:13,989][27935] Avg episode reward: [(0, '-51.141')] [2022-07-13 00:11:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5109.6). Total num frames: 88358912. Throughput: 0: 9588.4. Samples: 176708072. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:18,989][27935] Avg episode reward: [(0, '-51.241')] [2022-07-13 00:11:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5109.7). Total num frames: 88386560. Throughput: 0: 10275.9. Samples: 176770112. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:23,989][27935] Avg episode reward: [(0, '-51.675')] [2022-07-13 00:11:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 88411136. Throughput: 0: 10284.6. Samples: 176832280. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:28,989][27935] Avg episode reward: [(0, '-52.072')] [2022-07-13 00:11:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5109.6). Total num frames: 88436736. Throughput: 0: 10264.8. Samples: 176893808. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:33,989][27935] Avg episode reward: [(0, '-51.619')] [2022-07-13 00:11:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5113.1). Total num frames: 88463360. Throughput: 0: 10264.5. Samples: 176924936. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:38,989][27935] Avg episode reward: [(0, '-51.575')] [2022-07-13 00:11:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5155.1, 300 sec: 5120.0). Total num frames: 88491008. Throughput: 0: 10279.0. Samples: 176987856. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:43,989][27935] Avg episode reward: [(0, '-51.373')] [2022-07-13 00:11:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5116.5). Total num frames: 88515584. Throughput: 0: 10364.0. Samples: 177050256. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:48,989][27935] Avg episode reward: [(0, '-51.285')] [2022-07-13 00:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 88540160. Throughput: 0: 10367.2. Samples: 177081676. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:53,990][27935] Avg episode reward: [(0, '-50.960')] [2022-07-13 00:11:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5123.5). Total num frames: 88566784. Throughput: 0: 10372.3. Samples: 177144232. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:11:58,989][27935] Avg episode reward: [(0, '-50.858')] [2022-07-13 00:12:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 88591360. Throughput: 0: 10991.7. Samples: 177202696. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:03,989][27935] Avg episode reward: [(0, '-50.968')] [2022-07-13 00:12:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 88617984. Throughput: 0: 10305.4. Samples: 177233856. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:08,989][27935] Avg episode reward: [(0, '-51.963')] [2022-07-13 00:12:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 88642560. Throughput: 0: 10302.0. Samples: 177295868. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:13,989][27935] Avg episode reward: [(0, '-52.242')] [2022-07-13 00:12:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 88670208. Throughput: 0: 10302.3. Samples: 177357412. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:18,989][27935] Avg episode reward: [(0, '-51.973')] [2022-07-13 00:12:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 88694784. Throughput: 0: 10308.2. Samples: 177388804. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:23,989][27935] Avg episode reward: [(0, '-52.400')] [2022-07-13 00:12:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 88720384. Throughput: 0: 10286.0. Samples: 177450728. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:28,990][27935] Avg episode reward: [(0, '-52.275')] [2022-07-13 00:12:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 88748032. Throughput: 0: 10269.0. Samples: 177512360. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:33,989][27935] Avg episode reward: [(0, '-52.085')] [2022-07-13 00:12:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 88772608. Throughput: 0: 10260.2. Samples: 177543384. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:38,989][27935] Avg episode reward: [(0, '-51.826')] [2022-07-13 00:12:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 88798208. Throughput: 0: 10244.0. Samples: 177605212. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:43,989][27935] Avg episode reward: [(0, '-51.588')] [2022-07-13 00:12:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 88823808. Throughput: 0: 10329.6. Samples: 177667528. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 00:12:48,989][27935] Avg episode reward: [(0, '-51.633')] [2022-07-13 00:12:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 88849408. Throughput: 0: 10334.4. Samples: 177698904. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:12:53,989][27935] Avg episode reward: [(0, '-51.435')] [2022-07-13 00:12:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 88876032. Throughput: 0: 10343.8. Samples: 177761340. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:12:58,989][27935] Avg episode reward: [(0, '-51.679')] [2022-07-13 00:13:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 88899584. Throughput: 0: 9660.7. Samples: 177792144. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:03,989][27935] Avg episode reward: [(0, '-50.700')] [2022-07-13 00:13:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 88926208. Throughput: 0: 10247.3. Samples: 177849932. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:08,989][27935] Avg episode reward: [(0, '-49.975')] [2022-07-13 00:13:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 88950784. Throughput: 0: 10243.5. Samples: 177911684. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:13,989][27935] Avg episode reward: [(0, '-49.701')] [2022-07-13 00:13:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 88977408. Throughput: 0: 10233.9. Samples: 177972884. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:18,989][27935] Avg episode reward: [(0, '-50.039')] [2022-07-13 00:13:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5147.8). Total num frames: 89000960. Throughput: 0: 10206.6. Samples: 178002684. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:23,989][27935] Avg episode reward: [(0, '-50.629')] [2022-07-13 00:13:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 89026560. Throughput: 0: 10181.2. Samples: 178063368. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:28,992][27935] Avg episode reward: [(0, '-50.665')] [2022-07-13 00:13:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5151.2). Total num frames: 89053184. Throughput: 0: 10181.9. Samples: 178125712. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:33,989][27935] Avg episode reward: [(0, '-50.909')] [2022-07-13 00:13:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 89078784. Throughput: 0: 10183.5. Samples: 178157160. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:38,989][27935] Avg episode reward: [(0, '-50.821')] [2022-07-13 00:13:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 89105408. Throughput: 0: 10178.7. Samples: 178219380. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:43,989][27935] Avg episode reward: [(0, '-50.833')] [2022-07-13 00:13:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 89129984. Throughput: 0: 10904.0. Samples: 178282824. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:48,989][27935] Avg episode reward: [(0, '-50.766')] [2022-07-13 00:13:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5151.3). Total num frames: 89158656. Throughput: 0: 10315.2. Samples: 178314116. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:53,989][27935] Avg episode reward: [(0, '-50.746')] [2022-07-13 00:13:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 89184256. Throughput: 0: 10344.7. Samples: 178377196. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:13:58,993][27935] Avg episode reward: [(0, '-51.147')] [2022-07-13 00:14:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5154.7). Total num frames: 89208832. Throughput: 0: 10285.3. Samples: 178435720. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:03,990][27935] Avg episode reward: [(0, '-51.672')] [2022-07-13 00:14:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 89234432. Throughput: 0: 10322.9. Samples: 178467216. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:08,989][27935] Avg episode reward: [(0, '-52.887')] [2022-07-13 00:14:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 89260032. Throughput: 0: 10357.7. Samples: 178529464. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:13,989][27935] Avg episode reward: [(0, '-53.768')] [2022-07-13 00:14:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 89286656. Throughput: 0: 10361.7. Samples: 178591988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:18,989][27935] Avg episode reward: [(0, '-53.483')] [2022-07-13 00:14:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 89311232. Throughput: 0: 10356.6. Samples: 178623208. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:23,989][27935] Avg episode reward: [(0, '-53.388')] [2022-07-13 00:14:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 89337856. Throughput: 0: 10364.3. Samples: 178685776. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:28,989][27935] Avg episode reward: [(0, '-53.010')] [2022-07-13 00:14:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 89364480. Throughput: 0: 10332.5. Samples: 178747788. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:33,989][27935] Avg episode reward: [(0, '-53.243')] [2022-07-13 00:14:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 89390080. Throughput: 0: 10325.9. Samples: 178778780. Policy #0 lag: (min: 0.0, avg: 8.2, max: 17.0) [2022-07-13 00:14:38,990][27935] Avg episode reward: [(0, '-53.142')] [2022-07-13 00:14:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 89414656. Throughput: 0: 10264.8. Samples: 178839112. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:14:43,989][27935] Avg episode reward: [(0, '-52.208')] [2022-07-13 00:14:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 89441280. Throughput: 0: 10342.7. Samples: 178901140. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:14:48,989][27935] Avg episode reward: [(0, '-51.941')] [2022-07-13 00:14:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 89465856. Throughput: 0: 10325.9. Samples: 178931880. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:14:53,991][27935] Avg episode reward: [(0, '-51.449')] [2022-07-13 00:14:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 89492480. Throughput: 0: 10296.5. Samples: 178992808. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:14:58,990][27935] Avg episode reward: [(0, '-51.582')] [2022-07-13 00:15:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 89515008. Throughput: 0: 10197.5. Samples: 179050876. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:03,989][27935] Avg episode reward: [(0, '-51.380')] [2022-07-13 00:15:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 89541632. Throughput: 0: 10185.1. Samples: 179081536. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:08,989][27935] Avg episode reward: [(0, '-51.426')] [2022-07-13 00:15:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 89567232. Throughput: 0: 10174.0. Samples: 179143608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:13,992][27935] Avg episode reward: [(0, '-51.190')] [2022-07-13 00:15:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5137.4). Total num frames: 89591808. Throughput: 0: 10163.3. Samples: 179205136. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:18,990][27935] Avg episode reward: [(0, '-52.041')] [2022-07-13 00:15:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5130.4). Total num frames: 89616384. Throughput: 0: 10085.4. Samples: 179232624. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:23,989][27935] Avg episode reward: [(0, '-52.390')] [2022-07-13 00:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5130.4). Total num frames: 89640960. Throughput: 0: 10052.1. Samples: 179291456. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:28,989][27935] Avg episode reward: [(0, '-52.871')] [2022-07-13 00:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5120.0). Total num frames: 89664512. Throughput: 0: 9955.1. Samples: 179349120. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:33,990][27935] Avg episode reward: [(0, '-52.908')] [2022-07-13 00:15:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 5109.8). Total num frames: 89689088. Throughput: 0: 9908.7. Samples: 179377772. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:38,989][27935] Avg episode reward: [(0, '-52.105')] [2022-07-13 00:15:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 5109.6). Total num frames: 89712640. Throughput: 0: 9843.9. Samples: 179435784. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:43,989][27935] Avg episode reward: [(0, '-52.077')] [2022-07-13 00:15:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 5099.2). Total num frames: 89737216. Throughput: 0: 9862.6. Samples: 179494692. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:48,989][27935] Avg episode reward: [(0, '-52.654')] [2022-07-13 00:15:54,000][27935] Fps is (10 sec: 4909.7, 60 sec: 4931.3, 300 sec: 5099.0). Total num frames: 89761792. Throughput: 0: 9815.9. Samples: 179523360. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:54,001][27935] Avg episode reward: [(0, '-52.080')] [2022-07-13 00:15:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 5099.2). Total num frames: 89786368. Throughput: 0: 9735.8. Samples: 179581720. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:15:58,989][27935] Avg episode reward: [(0, '-51.981')] [2022-07-13 00:16:03,989][27935] Fps is (10 sec: 4715.7, 60 sec: 4898.1, 300 sec: 5085.3). Total num frames: 89808896. Throughput: 0: 9593.9. Samples: 179636860. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:16:03,989][27935] Avg episode reward: [(0, '-51.893')] [2022-07-13 00:16:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 5078.3). Total num frames: 89832448. Throughput: 0: 9637.0. Samples: 179666288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:16:08,989][27935] Avg episode reward: [(0, '-51.825')] [2022-07-13 00:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5078.3). Total num frames: 89857024. Throughput: 0: 9648.5. Samples: 179725640. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:16:13,989][27935] Avg episode reward: [(0, '-52.199')] [2022-07-13 00:16:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 5071.4). Total num frames: 89882624. Throughput: 0: 9671.4. Samples: 179784332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:16:18,989][27935] Avg episode reward: [(0, '-52.906')] [2022-07-13 00:16:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 5071.4). Total num frames: 89907200. Throughput: 0: 9688.3. Samples: 179813744. Policy #0 lag: (min: 0.0, avg: 9.8, max: 19.0) [2022-07-13 00:16:23,989][27935] Avg episode reward: [(0, '-51.737')] [2022-07-13 00:16:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 5064.5). Total num frames: 89930752. Throughput: 0: 9707.9. Samples: 179872640. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:28,989][27935] Avg episode reward: [(0, '-51.696')] [2022-07-13 00:16:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 5054.0). Total num frames: 89954304. Throughput: 0: 9694.6. Samples: 179930948. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:33,989][27935] Avg episode reward: [(0, '-52.383')] [2022-07-13 00:16:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 5036.7). Total num frames: 89976832. Throughput: 0: 9661.7. Samples: 179958028. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:38,989][27935] Avg episode reward: [(0, '-53.317')] [2022-07-13 00:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 5043.6). Total num frames: 90003456. Throughput: 0: 9621.2. Samples: 180014672. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:43,989][27935] Avg episode reward: [(0, '-53.191')] [2022-07-13 00:16:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5036.7). Total num frames: 90025984. Throughput: 0: 9668.8. Samples: 180071956. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:48,989][27935] Avg episode reward: [(0, '-52.922')] [2022-07-13 00:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.8, 300 sec: 5033.2). Total num frames: 90051584. Throughput: 0: 9646.8. Samples: 180100392. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:53,989][27935] Avg episode reward: [(0, '-52.521')] [2022-07-13 00:16:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5029.7). Total num frames: 90075136. Throughput: 0: 9628.1. Samples: 180158904. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:16:58,989][27935] Avg episode reward: [(0, '-53.287')] [2022-07-13 00:17:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 5012.4). Total num frames: 90096640. Throughput: 0: 9529.1. Samples: 180213144. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:03,989][27935] Avg episode reward: [(0, '-52.641')] [2022-07-13 00:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 5012.4). Total num frames: 90121216. Throughput: 0: 9527.9. Samples: 180242500. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:08,989][27935] Avg episode reward: [(0, '-52.808')] [2022-07-13 00:17:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5002.0). Total num frames: 90145792. Throughput: 0: 9530.0. Samples: 180301488. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:13,989][27935] Avg episode reward: [(0, '-51.689')] [2022-07-13 00:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 5002.0). Total num frames: 90170368. Throughput: 0: 9527.7. Samples: 180359696. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:18,989][27935] Avg episode reward: [(0, '-51.307')] [2022-07-13 00:17:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4995.0). Total num frames: 90193920. Throughput: 0: 9570.7. Samples: 180388708. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:23,992][27935] Avg episode reward: [(0, '-51.659')] [2022-07-13 00:17:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4984.6). Total num frames: 90218496. Throughput: 0: 9619.6. Samples: 180447552. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:28,989][27935] Avg episode reward: [(0, '-51.780')] [2022-07-13 00:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4984.6). Total num frames: 90243072. Throughput: 0: 9647.2. Samples: 180506080. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:33,989][27935] Avg episode reward: [(0, '-51.099')] [2022-07-13 00:17:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4981.2). Total num frames: 90267648. Throughput: 0: 9674.1. Samples: 180535728. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:38,989][27935] Avg episode reward: [(0, '-51.093')] [2022-07-13 00:17:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4974.2). Total num frames: 90291200. Throughput: 0: 9661.4. Samples: 180593668. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:43,989][27935] Avg episode reward: [(0, '-50.624')] [2022-07-13 00:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4974.2). Total num frames: 90316800. Throughput: 0: 9744.6. Samples: 180651652. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:48,989][27935] Avg episode reward: [(0, '-51.444')] [2022-07-13 00:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4963.8). Total num frames: 90340352. Throughput: 0: 9734.0. Samples: 180680528. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:53,989][27935] Avg episode reward: [(0, '-51.660')] [2022-07-13 00:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4970.7). Total num frames: 90365952. Throughput: 0: 9730.3. Samples: 180739352. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:17:58,989][27935] Avg episode reward: [(0, '-51.414')] [2022-07-13 00:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4953.4). Total num frames: 90387456. Throughput: 0: 9649.5. Samples: 180793924. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:18:03,990][27935] Avg episode reward: [(0, '-51.436')] [2022-07-13 00:18:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4953.4). Total num frames: 90412032. Throughput: 0: 9655.3. Samples: 180823196. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 00:18:08,990][27935] Avg episode reward: [(0, '-51.726')] [2022-07-13 00:18:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4939.5). Total num frames: 90434560. Throughput: 0: 9648.4. Samples: 180881732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:13,989][27935] Avg episode reward: [(0, '-51.977')] [2022-07-13 00:18:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4943.0). Total num frames: 90459136. Throughput: 0: 9637.5. Samples: 180939768. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:18,989][27935] Avg episode reward: [(0, '-52.121')] [2022-07-13 00:18:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4946.4). Total num frames: 90485760. Throughput: 0: 9623.3. Samples: 180968776. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:23,989][27935] Avg episode reward: [(0, '-51.732')] [2022-07-13 00:18:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4936.0). Total num frames: 90509312. Throughput: 0: 9635.4. Samples: 181027260. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:28,989][27935] Avg episode reward: [(0, '-51.578')] [2022-07-13 00:18:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4929.1). Total num frames: 90532864. Throughput: 0: 9644.1. Samples: 181085636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:33,990][27935] Avg episode reward: [(0, '-51.814')] [2022-07-13 00:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4918.7). Total num frames: 90556416. Throughput: 0: 9630.9. Samples: 181113920. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:38,990][27935] Avg episode reward: [(0, '-51.980')] [2022-07-13 00:18:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4922.1). Total num frames: 90582016. Throughput: 0: 9633.2. Samples: 181172848. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:43,989][27935] Avg episode reward: [(0, '-52.187')] [2022-07-13 00:18:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4901.3). Total num frames: 90604544. Throughput: 0: 9725.4. Samples: 181231568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:48,989][27935] Avg episode reward: [(0, '-52.357')] [2022-07-13 00:18:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4904.8). Total num frames: 90631168. Throughput: 0: 9747.5. Samples: 181261832. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:53,989][27935] Avg episode reward: [(0, '-52.730')] [2022-07-13 00:18:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4901.3). Total num frames: 90654720. Throughput: 0: 9742.8. Samples: 181320156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:18:58,989][27935] Avg episode reward: [(0, '-52.999')] [2022-07-13 00:19:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4890.9). Total num frames: 90677248. Throughput: 0: 9682.7. Samples: 181375488. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:03,989][27935] Avg episode reward: [(0, '-52.865')] [2022-07-13 00:19:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4890.9). Total num frames: 90702848. Throughput: 0: 9657.3. Samples: 181403356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:08,989][27935] Avg episode reward: [(0, '-52.510')] [2022-07-13 00:19:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 90724352. Throughput: 0: 9597.4. Samples: 181459144. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:13,990][27935] Avg episode reward: [(0, '-52.780')] [2022-07-13 00:19:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 90748928. Throughput: 0: 9571.0. Samples: 181516332. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:18,989][27935] Avg episode reward: [(0, '-52.839')] [2022-07-13 00:19:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4863.1). Total num frames: 90772480. Throughput: 0: 9593.7. Samples: 181545636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:23,989][27935] Avg episode reward: [(0, '-52.984')] [2022-07-13 00:19:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4852.7). Total num frames: 90796032. Throughput: 0: 9550.8. Samples: 181602632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:28,989][27935] Avg episode reward: [(0, '-52.974')] [2022-07-13 00:19:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 90820608. Throughput: 0: 8885.6. Samples: 181631420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:33,989][27935] Avg episode reward: [(0, '-52.959')] [2022-07-13 00:19:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 90845184. Throughput: 0: 9509.4. Samples: 181689756. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:38,989][27935] Avg episode reward: [(0, '-53.240')] [2022-07-13 00:19:43,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4778.5, 300 sec: 4838.8). Total num frames: 90868736. Throughput: 0: 9513.8. Samples: 181748296. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:43,991][27935] Avg episode reward: [(0, '-53.443')] [2022-07-13 00:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 90893312. Throughput: 0: 9586.8. Samples: 181806896. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:48,989][27935] Avg episode reward: [(0, '-53.107')] [2022-07-13 00:19:53,989][27935] Fps is (10 sec: 5018.6, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 90918912. Throughput: 0: 9623.4. Samples: 181836408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:53,989][27935] Avg episode reward: [(0, '-52.819')] [2022-07-13 00:19:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4835.4). Total num frames: 90941440. Throughput: 0: 9659.6. Samples: 181893824. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 00:19:58,989][27935] Avg episode reward: [(0, '-52.608')] [2022-07-13 00:20:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 90964992. Throughput: 0: 9599.9. Samples: 181948328. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:03,989][27935] Avg episode reward: [(0, '-52.699')] [2022-07-13 00:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 90988544. Throughput: 0: 9585.1. Samples: 181976964. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:08,989][27935] Avg episode reward: [(0, '-52.604')] [2022-07-13 00:20:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 91012096. Throughput: 0: 9610.8. Samples: 182035116. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:13,989][27935] Avg episode reward: [(0, '-52.867')] [2022-07-13 00:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 91037696. Throughput: 0: 10273.1. Samples: 182093708. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:18,989][27935] Avg episode reward: [(0, '-52.784')] [2022-07-13 00:20:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 91060224. Throughput: 0: 9631.8. Samples: 182123188. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:23,989][27935] Avg episode reward: [(0, '-52.656')] [2022-07-13 00:20:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 91086848. Throughput: 0: 9630.8. Samples: 182181664. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:28,989][27935] Avg episode reward: [(0, '-52.032')] [2022-07-13 00:20:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 91109376. Throughput: 0: 9600.1. Samples: 182238900. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:33,989][27935] Avg episode reward: [(0, '-51.808')] [2022-07-13 00:20:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 91133952. Throughput: 0: 9583.4. Samples: 182267660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:38,989][27935] Avg episode reward: [(0, '-51.882')] [2022-07-13 00:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4818.0). Total num frames: 91158528. Throughput: 0: 9591.8. Samples: 182325456. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:43,989][27935] Avg episode reward: [(0, '-51.362')] [2022-07-13 00:20:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.2). Total num frames: 91181056. Throughput: 0: 9662.8. Samples: 182383156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:48,989][27935] Avg episode reward: [(0, '-51.751')] [2022-07-13 00:20:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 91206656. Throughput: 0: 9680.7. Samples: 182412596. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:53,989][27935] Avg episode reward: [(0, '-52.178')] [2022-07-13 00:20:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 91231232. Throughput: 0: 9687.9. Samples: 182471072. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:20:58,989][27935] Avg episode reward: [(0, '-51.961')] [2022-07-13 00:21:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 91252736. Throughput: 0: 9606.0. Samples: 182525976. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:03,989][27935] Avg episode reward: [(0, '-51.997')] [2022-07-13 00:21:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 91277312. Throughput: 0: 9584.4. Samples: 182554488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:08,989][27935] Avg episode reward: [(0, '-52.168')] [2022-07-13 00:21:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 91300864. Throughput: 0: 9566.3. Samples: 182612148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:13,992][27935] Avg episode reward: [(0, '-52.008')] [2022-07-13 00:21:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 91325440. Throughput: 0: 9556.9. Samples: 182668960. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:18,989][27935] Avg episode reward: [(0, '-51.436')] [2022-07-13 00:21:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 91350016. Throughput: 0: 9561.1. Samples: 182697908. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:23,989][27935] Avg episode reward: [(0, '-50.810')] [2022-07-13 00:21:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 91373568. Throughput: 0: 9568.5. Samples: 182756040. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:28,989][27935] Avg episode reward: [(0, '-50.750')] [2022-07-13 00:21:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 91397120. Throughput: 0: 8926.1. Samples: 182784832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:33,989][27935] Avg episode reward: [(0, '-51.329')] [2022-07-13 00:21:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 91419648. Throughput: 0: 9529.8. Samples: 182841436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:38,989][27935] Avg episode reward: [(0, '-51.188')] [2022-07-13 00:21:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 91444224. Throughput: 0: 9496.7. Samples: 182898424. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 00:21:43,989][27935] Avg episode reward: [(0, '-51.636')] [2022-07-13 00:21:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 91468800. Throughput: 0: 9538.5. Samples: 182955208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:21:48,989][27935] Avg episode reward: [(0, '-52.128')] [2022-07-13 00:21:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4800.7). Total num frames: 91491328. Throughput: 0: 9540.3. Samples: 182983800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:21:53,989][27935] Avg episode reward: [(0, '-52.252')] [2022-07-13 00:21:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4807.6). Total num frames: 91514880. Throughput: 0: 9513.8. Samples: 183040268. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:21:58,989][27935] Avg episode reward: [(0, '-52.153')] [2022-07-13 00:22:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4797.2). Total num frames: 91536384. Throughput: 0: 9428.0. Samples: 183093220. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:03,989][27935] Avg episode reward: [(0, '-51.654')] [2022-07-13 00:22:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4793.7). Total num frames: 91559936. Throughput: 0: 9407.2. Samples: 183121232. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:08,989][27935] Avg episode reward: [(0, '-51.441')] [2022-07-13 00:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4793.7). Total num frames: 91584512. Throughput: 0: 9381.1. Samples: 183178192. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:13,989][27935] Avg episode reward: [(0, '-51.621')] [2022-07-13 00:22:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4793.7). Total num frames: 91608064. Throughput: 0: 10012.3. Samples: 183235384. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:18,990][27935] Avg episode reward: [(0, '-51.235')] [2022-07-13 00:22:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4793.7). Total num frames: 91632640. Throughput: 0: 9395.2. Samples: 183264220. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:23,989][27935] Avg episode reward: [(0, '-50.946')] [2022-07-13 00:22:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4783.3). Total num frames: 91654144. Throughput: 0: 9389.1. Samples: 183320932. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:28,989][27935] Avg episode reward: [(0, '-51.724')] [2022-07-13 00:22:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4783.3). Total num frames: 91678720. Throughput: 0: 9391.3. Samples: 183377816. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:33,989][27935] Avg episode reward: [(0, '-52.523')] [2022-07-13 00:22:38,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4710.2, 300 sec: 4783.3). Total num frames: 91702272. Throughput: 0: 9388.3. Samples: 183406292. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:38,991][27935] Avg episode reward: [(0, '-53.438')] [2022-07-13 00:22:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4779.8). Total num frames: 91726848. Throughput: 0: 9390.1. Samples: 183462820. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:43,989][27935] Avg episode reward: [(0, '-53.796')] [2022-07-13 00:22:48,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4693.3, 300 sec: 4779.8). Total num frames: 91750400. Throughput: 0: 9485.5. Samples: 183520068. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:48,989][27935] Avg episode reward: [(0, '-53.697')] [2022-07-13 00:22:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 91774976. Throughput: 0: 9504.0. Samples: 183548912. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:53,989][27935] Avg episode reward: [(0, '-54.390')] [2022-07-13 00:22:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4779.8). Total num frames: 91797504. Throughput: 0: 9520.7. Samples: 183606624. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:22:58,989][27935] Avg episode reward: [(0, '-54.220')] [2022-07-13 00:23:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4772.9). Total num frames: 91820032. Throughput: 0: 9468.4. Samples: 183661464. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:03,990][27935] Avg episode reward: [(0, '-53.109')] [2022-07-13 00:23:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 91846656. Throughput: 0: 9472.3. Samples: 183690472. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:08,990][27935] Avg episode reward: [(0, '-53.033')] [2022-07-13 00:23:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4779.8). Total num frames: 91869184. Throughput: 0: 9500.6. Samples: 183748460. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:13,989][27935] Avg episode reward: [(0, '-51.820')] [2022-07-13 00:23:18,991][27935] Fps is (10 sec: 4709.6, 60 sec: 4761.5, 300 sec: 4772.9). Total num frames: 91893760. Throughput: 0: 9541.0. Samples: 183807176. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:18,991][27935] Avg episode reward: [(0, '-51.864')] [2022-07-13 00:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4772.9). Total num frames: 91917312. Throughput: 0: 9571.7. Samples: 183837000. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:23,989][27935] Avg episode reward: [(0, '-52.020')] [2022-07-13 00:23:28,989][27935] Fps is (10 sec: 4813.6, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 91941888. Throughput: 0: 9597.0. Samples: 183894684. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:28,989][27935] Avg episode reward: [(0, '-51.209')] [2022-07-13 00:23:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 91966464. Throughput: 0: 9597.2. Samples: 183951940. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 00:23:33,989][27935] Avg episode reward: [(0, '-52.051')] [2022-07-13 00:23:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4772.9). Total num frames: 91990016. Throughput: 0: 9581.1. Samples: 183980060. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:23:38,989][27935] Avg episode reward: [(0, '-52.511')] [2022-07-13 00:23:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 92014592. Throughput: 0: 9602.8. Samples: 184038752. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:23:43,989][27935] Avg episode reward: [(0, '-52.868')] [2022-07-13 00:23:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 92036096. Throughput: 0: 9687.0. Samples: 184097380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:23:48,989][27935] Avg episode reward: [(0, '-53.133')] [2022-07-13 00:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4776.4). Total num frames: 92063744. Throughput: 0: 9682.2. Samples: 184126172. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:23:53,989][27935] Avg episode reward: [(0, '-52.901')] [2022-07-13 00:23:58,991][27935] Fps is (10 sec: 5118.8, 60 sec: 4829.7, 300 sec: 4779.8). Total num frames: 92087296. Throughput: 0: 9669.8. Samples: 184183624. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:23:58,992][27935] Avg episode reward: [(0, '-53.052')] [2022-07-13 00:24:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4765.9). Total num frames: 92108800. Throughput: 0: 9554.2. Samples: 184237096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:03,990][27935] Avg episode reward: [(0, '-52.647')] [2022-07-13 00:24:08,989][27935] Fps is (10 sec: 4609.1, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 92133376. Throughput: 0: 9525.4. Samples: 184265644. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:08,989][27935] Avg episode reward: [(0, '-51.993')] [2022-07-13 00:24:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 92155904. Throughput: 0: 9536.5. Samples: 184323828. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:13,989][27935] Avg episode reward: [(0, '-52.377')] [2022-07-13 00:24:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4776.4). Total num frames: 92181504. Throughput: 0: 9542.2. Samples: 184381340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:18,989][27935] Avg episode reward: [(0, '-52.628')] [2022-07-13 00:24:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 92205056. Throughput: 0: 9555.5. Samples: 184410056. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:23,989][27935] Avg episode reward: [(0, '-52.747')] [2022-07-13 00:24:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 92229632. Throughput: 0: 9522.9. Samples: 184467284. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:28,990][27935] Avg episode reward: [(0, '-52.529')] [2022-07-13 00:24:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 92253184. Throughput: 0: 9515.3. Samples: 184525568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:33,989][27935] Avg episode reward: [(0, '-52.307')] [2022-07-13 00:24:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 92277760. Throughput: 0: 9527.5. Samples: 184554912. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:38,989][27935] Avg episode reward: [(0, '-52.189')] [2022-07-13 00:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 92301312. Throughput: 0: 9547.4. Samples: 184613236. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:43,989][27935] Avg episode reward: [(0, '-51.697')] [2022-07-13 00:24:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4772.9). Total num frames: 92326912. Throughput: 0: 9637.1. Samples: 184670764. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:48,989][27935] Avg episode reward: [(0, '-51.704')] [2022-07-13 00:24:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 92351488. Throughput: 0: 9637.8. Samples: 184699344. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:53,990][27935] Avg episode reward: [(0, '-51.297')] [2022-07-13 00:24:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.8, 300 sec: 4772.9). Total num frames: 92372992. Throughput: 0: 9614.1. Samples: 184756464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:24:58,989][27935] Avg episode reward: [(0, '-51.344')] [2022-07-13 00:25:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4761.6, 300 sec: 4765.9). Total num frames: 92394496. Throughput: 0: 9518.3. Samples: 184809664. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:25:03,990][27935] Avg episode reward: [(0, '-51.006')] [2022-07-13 00:25:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 92418048. Throughput: 0: 9518.1. Samples: 184838372. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:25:08,990][27935] Avg episode reward: [(0, '-51.373')] [2022-07-13 00:25:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 92441600. Throughput: 0: 9506.3. Samples: 184895068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:25:13,989][27935] Avg episode reward: [(0, '-51.275')] [2022-07-13 00:25:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 92466176. Throughput: 0: 9467.5. Samples: 184951604. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:25:18,989][27935] Avg episode reward: [(0, '-51.072')] [2022-07-13 00:25:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 92489728. Throughput: 0: 9452.7. Samples: 184980284. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:25:23,989][27935] Avg episode reward: [(0, '-51.301')] [2022-07-13 00:25:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4755.5). Total num frames: 92512256. Throughput: 0: 9408.9. Samples: 185036636. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:28,989][27935] Avg episode reward: [(0, '-50.976')] [2022-07-13 00:25:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4755.5). Total num frames: 92536832. Throughput: 0: 9356.2. Samples: 185091792. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:33,989][27935] Avg episode reward: [(0, '-51.037')] [2022-07-13 00:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4748.6). Total num frames: 92559360. Throughput: 0: 9345.3. Samples: 185119884. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:38,989][27935] Avg episode reward: [(0, '-51.426')] [2022-07-13 00:25:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4752.1). Total num frames: 92582912. Throughput: 0: 9335.0. Samples: 185176540. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:43,989][27935] Avg episode reward: [(0, '-51.725')] [2022-07-13 00:25:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4748.6). Total num frames: 92607488. Throughput: 0: 9423.6. Samples: 185233724. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:48,989][27935] Avg episode reward: [(0, '-51.743')] [2022-07-13 00:25:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4748.6). Total num frames: 92632064. Throughput: 0: 9424.0. Samples: 185262452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:53,989][27935] Avg episode reward: [(0, '-51.865')] [2022-07-13 00:25:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4752.1). Total num frames: 92654592. Throughput: 0: 9431.4. Samples: 185319480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:25:58,989][27935] Avg episode reward: [(0, '-51.701')] [2022-07-13 00:26:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 92678144. Throughput: 0: 9371.8. Samples: 185373336. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:03,989][27935] Avg episode reward: [(0, '-51.712')] [2022-07-13 00:26:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 92700672. Throughput: 0: 9375.0. Samples: 185402160. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:08,989][27935] Avg episode reward: [(0, '-52.314')] [2022-07-13 00:26:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 92725248. Throughput: 0: 9398.5. Samples: 185459568. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:13,989][27935] Avg episode reward: [(0, '-53.272')] [2022-07-13 00:26:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 92748800. Throughput: 0: 9439.2. Samples: 185516556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:18,989][27935] Avg episode reward: [(0, '-53.394')] [2022-07-13 00:26:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 92772352. Throughput: 0: 9447.6. Samples: 185545024. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:23,989][27935] Avg episode reward: [(0, '-53.921')] [2022-07-13 00:26:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4738.2). Total num frames: 92794880. Throughput: 0: 9455.6. Samples: 185602040. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:28,989][27935] Avg episode reward: [(0, '-53.758')] [2022-07-13 00:26:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 92818432. Throughput: 0: 9431.0. Samples: 185658120. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:33,989][27935] Avg episode reward: [(0, '-54.165')] [2022-07-13 00:26:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 92843008. Throughput: 0: 9424.0. Samples: 185686532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:38,989][27935] Avg episode reward: [(0, '-53.647')] [2022-07-13 00:26:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 92866560. Throughput: 0: 9405.1. Samples: 185742708. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:43,989][27935] Avg episode reward: [(0, '-53.435')] [2022-07-13 00:26:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 92891136. Throughput: 0: 9490.0. Samples: 185800384. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:48,989][27935] Avg episode reward: [(0, '-53.117')] [2022-07-13 00:26:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 92913664. Throughput: 0: 9491.5. Samples: 185829276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:53,989][27935] Avg episode reward: [(0, '-52.138')] [2022-07-13 00:26:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4752.1). Total num frames: 92938240. Throughput: 0: 9497.3. Samples: 185886948. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:26:58,989][27935] Avg episode reward: [(0, '-52.572')] [2022-07-13 00:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4752.1). Total num frames: 92961792. Throughput: 0: 9416.3. Samples: 185940288. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:03,989][27935] Avg episode reward: [(0, '-52.339')] [2022-07-13 00:27:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 92984320. Throughput: 0: 9424.1. Samples: 185969108. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:08,989][27935] Avg episode reward: [(0, '-53.166')] [2022-07-13 00:27:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 93008896. Throughput: 0: 9448.1. Samples: 186027204. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:13,989][27935] Avg episode reward: [(0, '-52.467')] [2022-07-13 00:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 93034496. Throughput: 0: 9527.0. Samples: 186086836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:18,993][27935] Avg episode reward: [(0, '-51.942')] [2022-07-13 00:27:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 93058048. Throughput: 0: 9515.5. Samples: 186114728. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:23,989][27935] Avg episode reward: [(0, '-51.882')] [2022-07-13 00:27:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4762.5). Total num frames: 93083648. Throughput: 0: 9629.0. Samples: 186176012. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:28,989][27935] Avg episode reward: [(0, '-52.035')] [2022-07-13 00:27:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 93106176. Throughput: 0: 9621.7. Samples: 186233360. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:33,989][27935] Avg episode reward: [(0, '-51.641')] [2022-07-13 00:27:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4762.5). Total num frames: 93131776. Throughput: 0: 9619.4. Samples: 186262148. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:38,989][27935] Avg episode reward: [(0, '-50.879')] [2022-07-13 00:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 93154304. Throughput: 0: 9586.4. Samples: 186318336. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:43,989][27935] Avg episode reward: [(0, '-51.709')] [2022-07-13 00:27:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 93178880. Throughput: 0: 9654.2. Samples: 186374728. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:48,989][27935] Avg episode reward: [(0, '-52.296')] [2022-07-13 00:27:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 93200384. Throughput: 0: 9651.2. Samples: 186403412. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:53,989][27935] Avg episode reward: [(0, '-52.506')] [2022-07-13 00:27:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 93224960. Throughput: 0: 9630.3. Samples: 186460568. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:27:58,990][27935] Avg episode reward: [(0, '-52.147')] [2022-07-13 00:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4748.6). Total num frames: 93247488. Throughput: 0: 9492.5. Samples: 186513996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:03,989][27935] Avg episode reward: [(0, '-52.471')] [2022-07-13 00:28:08,992][27935] Fps is (10 sec: 4606.7, 60 sec: 4778.4, 300 sec: 4752.0). Total num frames: 93271040. Throughput: 0: 9506.8. Samples: 186542560. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:08,992][27935] Avg episode reward: [(0, '-53.238')] [2022-07-13 00:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4755.6). Total num frames: 93296640. Throughput: 0: 9418.3. Samples: 186599836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:13,989][27935] Avg episode reward: [(0, '-53.618')] [2022-07-13 00:28:18,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 93320192. Throughput: 0: 9405.3. Samples: 186656600. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:18,990][27935] Avg episode reward: [(0, '-53.566')] [2022-07-13 00:28:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 93341696. Throughput: 0: 9408.6. Samples: 186685536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:23,989][27935] Avg episode reward: [(0, '-53.146')] [2022-07-13 00:28:28,992][27935] Fps is (10 sec: 4606.7, 60 sec: 4710.2, 300 sec: 4745.1). Total num frames: 93366272. Throughput: 0: 9435.3. Samples: 186742952. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:28,992][27935] Avg episode reward: [(0, '-53.311')] [2022-07-13 00:28:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 93388800. Throughput: 0: 9441.6. Samples: 186799600. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:33,989][27935] Avg episode reward: [(0, '-53.025')] [2022-07-13 00:28:38,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 93414400. Throughput: 0: 9437.5. Samples: 186828100. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:38,990][27935] Avg episode reward: [(0, '-53.072')] [2022-07-13 00:28:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4752.1). Total num frames: 93437952. Throughput: 0: 9442.2. Samples: 186885468. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:43,989][27935] Avg episode reward: [(0, '-52.866')] [2022-07-13 00:28:48,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4710.4, 300 sec: 4738.2). Total num frames: 93461504. Throughput: 0: 9525.3. Samples: 186942636. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:48,989][27935] Avg episode reward: [(0, '-52.856')] [2022-07-13 00:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4741.7). Total num frames: 93486080. Throughput: 0: 9531.7. Samples: 186971460. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:53,989][27935] Avg episode reward: [(0, '-52.754')] [2022-07-13 00:28:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 93508608. Throughput: 0: 9535.4. Samples: 187028928. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:28:58,990][27935] Avg episode reward: [(0, '-53.763')] [2022-07-13 00:29:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 93531136. Throughput: 0: 8918.3. Samples: 187057924. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 00:29:03,989][27935] Avg episode reward: [(0, '-53.912')] [2022-07-13 00:29:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.8, 300 sec: 4745.1). Total num frames: 93555712. Throughput: 0: 9472.9. Samples: 187111816. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:08,989][27935] Avg episode reward: [(0, '-53.492')] [2022-07-13 00:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 93580288. Throughput: 0: 9468.7. Samples: 187169016. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:13,989][27935] Avg episode reward: [(0, '-52.811')] [2022-07-13 00:29:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 93606912. Throughput: 0: 9604.4. Samples: 187231800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:18,989][27935] Avg episode reward: [(0, '-52.787')] [2022-07-13 00:29:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4846.9, 300 sec: 4755.5). Total num frames: 93632512. Throughput: 0: 9674.6. Samples: 187263456. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:23,989][27935] Avg episode reward: [(0, '-52.207')] [2022-07-13 00:29:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 4881.3, 300 sec: 4765.9). Total num frames: 93659136. Throughput: 0: 9813.7. Samples: 187327084. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:28,989][27935] Avg episode reward: [(0, '-51.401')] [2022-07-13 00:29:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4949.3, 300 sec: 4772.9). Total num frames: 93685760. Throughput: 0: 9961.8. Samples: 187390916. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:33,989][27935] Avg episode reward: [(0, '-51.723')] [2022-07-13 00:29:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4949.3, 300 sec: 4779.8). Total num frames: 93711360. Throughput: 0: 10028.6. Samples: 187422748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:38,989][27935] Avg episode reward: [(0, '-52.044')] [2022-07-13 00:29:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5034.7, 300 sec: 4790.2). Total num frames: 93740032. Throughput: 0: 10169.4. Samples: 187486548. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:43,989][27935] Avg episode reward: [(0, '-52.120')] [2022-07-13 00:29:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5068.8, 300 sec: 4793.7). Total num frames: 93765632. Throughput: 0: 10937.3. Samples: 187550104. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:48,989][27935] Avg episode reward: [(0, '-53.302')] [2022-07-13 00:29:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 4807.6). Total num frames: 93791232. Throughput: 0: 10442.9. Samples: 187581748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:53,989][27935] Avg episode reward: [(0, '-54.115')] [2022-07-13 00:29:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 4831.9). Total num frames: 93819904. Throughput: 0: 10608.0. Samples: 187646376. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:29:58,989][27935] Avg episode reward: [(0, '-54.054')] [2022-07-13 00:30:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 4828.4). Total num frames: 93842432. Throughput: 0: 10547.3. Samples: 187706428. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:03,989][27935] Avg episode reward: [(0, '-54.050')] [2022-07-13 00:30:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 4845.8). Total num frames: 93871104. Throughput: 0: 10563.2. Samples: 187738800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:08,989][27935] Avg episode reward: [(0, '-53.411')] [2022-07-13 00:30:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 4849.2). Total num frames: 93896704. Throughput: 0: 10576.5. Samples: 187803028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:13,989][27935] Avg episode reward: [(0, '-53.232')] [2022-07-13 00:30:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 4863.1). Total num frames: 93924352. Throughput: 0: 10569.7. Samples: 187866552. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:18,989][27935] Avg episode reward: [(0, '-52.926')] [2022-07-13 00:30:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 4870.1). Total num frames: 93948928. Throughput: 0: 10576.3. Samples: 187898680. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:23,989][27935] Avg episode reward: [(0, '-52.128')] [2022-07-13 00:30:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 4884.0). Total num frames: 93977600. Throughput: 0: 10588.9. Samples: 187963048. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:28,989][27935] Avg episode reward: [(0, '-52.781')] [2022-07-13 00:30:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 4894.4). Total num frames: 94003200. Throughput: 0: 10600.4. Samples: 188027120. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:33,992][27935] Avg episode reward: [(0, '-52.106')] [2022-07-13 00:30:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 4908.3). Total num frames: 94030848. Throughput: 0: 10612.4. Samples: 188059308. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:38,990][27935] Avg episode reward: [(0, '-51.873')] [2022-07-13 00:30:43,990][27935] Fps is (10 sec: 5426.8, 60 sec: 5290.6, 300 sec: 4915.2). Total num frames: 94057472. Throughput: 0: 10610.9. Samples: 188123876. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:43,990][27935] Avg episode reward: [(0, '-51.822')] [2022-07-13 00:30:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 4925.6). Total num frames: 94085120. Throughput: 0: 10697.2. Samples: 188187800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:48,989][27935] Avg episode reward: [(0, '-51.238')] [2022-07-13 00:30:53,989][27935] Fps is (10 sec: 5427.6, 60 sec: 5341.9, 300 sec: 4939.5). Total num frames: 94111744. Throughput: 0: 10690.5. Samples: 188219872. Policy #0 lag: (min: 0.0, avg: 8.3, max: 21.0) [2022-07-13 00:30:53,989][27935] Avg episode reward: [(0, '-50.980')] [2022-07-13 00:30:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 4949.9). Total num frames: 94138368. Throughput: 0: 10693.3. Samples: 188284224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:30:58,989][27935] Avg episode reward: [(0, '-51.164')] [2022-07-13 00:31:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5324.8, 300 sec: 4953.4). Total num frames: 94161920. Throughput: 0: 10609.9. Samples: 188344000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:03,989][27935] Avg episode reward: [(0, '-51.470')] [2022-07-13 00:31:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5307.7, 300 sec: 4963.8). Total num frames: 94189568. Throughput: 0: 10605.1. Samples: 188375912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:08,989][27935] Avg episode reward: [(0, '-51.684')] [2022-07-13 00:31:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 4974.2). Total num frames: 94216192. Throughput: 0: 10599.3. Samples: 188440016. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:13,989][27935] Avg episode reward: [(0, '-52.442')] [2022-07-13 00:31:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 4981.2). Total num frames: 94241792. Throughput: 0: 10587.6. Samples: 188503560. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:18,989][27935] Avg episode reward: [(0, '-52.537')] [2022-07-13 00:31:23,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5358.9, 300 sec: 5002.0). Total num frames: 94270464. Throughput: 0: 10588.3. Samples: 188535780. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:23,989][27935] Avg episode reward: [(0, '-53.102')] [2022-07-13 00:31:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5005.5). Total num frames: 94295040. Throughput: 0: 10583.0. Samples: 188600104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:28,989][27935] Avg episode reward: [(0, '-53.210')] [2022-07-13 00:31:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5307.7, 300 sec: 5012.4). Total num frames: 94321664. Throughput: 0: 10539.3. Samples: 188662068. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:33,989][27935] Avg episode reward: [(0, '-53.453')] [2022-07-13 00:31:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5019.3). Total num frames: 94347264. Throughput: 0: 10502.6. Samples: 188692488. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:38,989][27935] Avg episode reward: [(0, '-52.570')] [2022-07-13 00:31:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.7, 300 sec: 5026.3). Total num frames: 94373888. Throughput: 0: 10496.9. Samples: 188756584. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:43,989][27935] Avg episode reward: [(0, '-52.197')] [2022-07-13 00:31:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5040.2). Total num frames: 94400512. Throughput: 0: 10590.1. Samples: 188820556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:48,989][27935] Avg episode reward: [(0, '-52.630')] [2022-07-13 00:31:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5043.6). Total num frames: 94426112. Throughput: 0: 10590.4. Samples: 188852480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:53,990][27935] Avg episode reward: [(0, '-53.046')] [2022-07-13 00:31:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5061.0). Total num frames: 94454784. Throughput: 0: 10582.7. Samples: 188916236. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:31:58,989][27935] Avg episode reward: [(0, '-52.566')] [2022-07-13 00:32:03,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5256.5, 300 sec: 5061.0). Total num frames: 94477312. Throughput: 0: 10493.1. Samples: 188975748. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:03,989][27935] Avg episode reward: [(0, '-52.823')] [2022-07-13 00:32:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5071.4). Total num frames: 94504960. Throughput: 0: 10483.8. Samples: 189007552. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:08,989][27935] Avg episode reward: [(0, '-52.497')] [2022-07-13 00:32:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5074.9). Total num frames: 94531584. Throughput: 0: 10478.0. Samples: 189071612. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:13,989][27935] Avg episode reward: [(0, '-51.994')] [2022-07-13 00:32:18,992][27935] Fps is (10 sec: 5425.7, 60 sec: 5290.4, 300 sec: 5088.7). Total num frames: 94559232. Throughput: 0: 10521.5. Samples: 189135564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:18,992][27935] Avg episode reward: [(0, '-51.778')] [2022-07-13 00:32:24,000][27935] Fps is (10 sec: 5318.7, 60 sec: 5238.5, 300 sec: 5088.6). Total num frames: 94584832. Throughput: 0: 10548.0. Samples: 189167268. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:24,001][27935] Avg episode reward: [(0, '-51.194')] [2022-07-13 00:32:28,989][27935] Fps is (10 sec: 5326.2, 60 sec: 5290.7, 300 sec: 5106.1). Total num frames: 94612480. Throughput: 0: 10570.2. Samples: 189232244. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:28,989][27935] Avg episode reward: [(0, '-51.581')] [2022-07-13 00:32:33,989][27935] Fps is (10 sec: 5331.0, 60 sec: 5273.6, 300 sec: 5106.1). Total num frames: 94638080. Throughput: 0: 10574.8. Samples: 189296420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:33,989][27935] Avg episode reward: [(0, '-51.776')] [2022-07-13 00:32:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5123.5). Total num frames: 94665728. Throughput: 0: 10575.3. Samples: 189328368. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:38,990][27935] Avg episode reward: [(0, '-53.054')] [2022-07-13 00:32:43,991][27935] Fps is (10 sec: 5221.3, 60 sec: 5273.4, 300 sec: 5123.4). Total num frames: 94690304. Throughput: 0: 10566.2. Samples: 189391736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 00:32:43,991][27935] Avg episode reward: [(0, '-53.415')] [2022-07-13 00:32:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5144.3). Total num frames: 94717952. Throughput: 0: 10665.2. Samples: 189455684. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:32:48,989][27935] Avg episode reward: [(0, '-53.981')] [2022-07-13 00:32:53,989][27935] Fps is (10 sec: 5325.9, 60 sec: 5290.7, 300 sec: 5147.8). Total num frames: 94743552. Throughput: 0: 10671.1. Samples: 189487752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:32:53,989][27935] Avg episode reward: [(0, '-53.705')] [2022-07-13 00:32:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5168.6). Total num frames: 94772224. Throughput: 0: 10682.0. Samples: 189552300. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:32:58,989][27935] Avg episode reward: [(0, '-53.282')] [2022-07-13 00:33:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5168.6). Total num frames: 94795776. Throughput: 0: 10590.6. Samples: 189612112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:03,989][27935] Avg episode reward: [(0, '-52.797')] [2022-07-13 00:33:08,990][27935] Fps is (10 sec: 5119.6, 60 sec: 5307.7, 300 sec: 5175.5). Total num frames: 94823424. Throughput: 0: 10597.5. Samples: 189644044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:08,990][27935] Avg episode reward: [(0, '-52.200')] [2022-07-13 00:33:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5182.5). Total num frames: 94849024. Throughput: 0: 10557.1. Samples: 189707312. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:13,989][27935] Avg episode reward: [(0, '-52.339')] [2022-07-13 00:33:18,989][27935] Fps is (10 sec: 5222.8, 60 sec: 5273.8, 300 sec: 5199.8). Total num frames: 94875648. Throughput: 0: 10534.3. Samples: 189770464. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:18,989][27935] Avg episode reward: [(0, '-52.618')] [2022-07-13 00:33:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5274.6, 300 sec: 5203.4). Total num frames: 94901248. Throughput: 0: 10535.4. Samples: 189802460. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:23,990][27935] Avg episode reward: [(0, '-51.754')] [2022-07-13 00:33:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 94927872. Throughput: 0: 10519.5. Samples: 189865092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:28,989][27935] Avg episode reward: [(0, '-51.802')] [2022-07-13 00:33:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 94953472. Throughput: 0: 10496.3. Samples: 189928020. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:33,989][27935] Avg episode reward: [(0, '-52.037')] [2022-07-13 00:33:38,992][27935] Fps is (10 sec: 5425.2, 60 sec: 5273.3, 300 sec: 5234.5). Total num frames: 94982144. Throughput: 0: 10491.4. Samples: 189959904. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:38,993][27935] Avg episode reward: [(0, '-51.991')] [2022-07-13 00:33:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.7, 300 sec: 5234.5). Total num frames: 95005696. Throughput: 0: 10459.5. Samples: 190022976. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:43,989][27935] Avg episode reward: [(0, '-52.520')] [2022-07-13 00:33:48,989][27935] Fps is (10 sec: 5121.9, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 95033344. Throughput: 0: 10518.7. Samples: 190085452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:48,989][27935] Avg episode reward: [(0, '-52.210')] [2022-07-13 00:33:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 95058944. Throughput: 0: 10498.3. Samples: 190116460. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:53,989][27935] Avg episode reward: [(0, '-52.824')] [2022-07-13 00:33:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5269.3). Total num frames: 95085568. Throughput: 0: 10471.1. Samples: 190178512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:33:58,989][27935] Avg episode reward: [(0, '-52.339')] [2022-07-13 00:34:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5262.3). Total num frames: 95108096. Throughput: 0: 10386.1. Samples: 190237836. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:03,989][27935] Avg episode reward: [(0, '-52.596')] [2022-07-13 00:34:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.5, 300 sec: 5276.2). Total num frames: 95136768. Throughput: 0: 10386.4. Samples: 190269848. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:08,989][27935] Avg episode reward: [(0, '-53.178')] [2022-07-13 00:34:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5269.3). Total num frames: 95161344. Throughput: 0: 10396.5. Samples: 190332936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:13,989][27935] Avg episode reward: [(0, '-53.146')] [2022-07-13 00:34:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5276.2). Total num frames: 95188992. Throughput: 0: 10393.0. Samples: 190395704. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:18,989][27935] Avg episode reward: [(0, '-54.173')] [2022-07-13 00:34:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5269.3). Total num frames: 95213568. Throughput: 0: 10381.5. Samples: 190427036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:23,989][27935] Avg episode reward: [(0, '-53.983')] [2022-07-13 00:34:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5269.3). Total num frames: 95240192. Throughput: 0: 10365.7. Samples: 190489432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:28,989][27935] Avg episode reward: [(0, '-54.114')] [2022-07-13 00:34:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5272.7). Total num frames: 95266816. Throughput: 0: 10380.3. Samples: 190552564. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:34:33,989][27935] Avg episode reward: [(0, '-52.530')] [2022-07-13 00:34:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.5, 300 sec: 5262.3). Total num frames: 95292416. Throughput: 0: 10385.0. Samples: 190583784. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:34:38,989][27935] Avg episode reward: [(0, '-51.941')] [2022-07-13 00:34:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5265.8). Total num frames: 95319040. Throughput: 0: 10413.0. Samples: 190647096. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:34:43,989][27935] Avg episode reward: [(0, '-51.490')] [2022-07-13 00:34:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5269.3). Total num frames: 95345664. Throughput: 0: 10504.9. Samples: 190710556. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:34:48,989][27935] Avg episode reward: [(0, '-51.256')] [2022-07-13 00:34:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5258.8). Total num frames: 95371264. Throughput: 0: 10491.6. Samples: 190741972. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:34:53,989][27935] Avg episode reward: [(0, '-51.655')] [2022-07-13 00:34:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5265.8). Total num frames: 95395840. Throughput: 0: 10484.0. Samples: 190804716. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:34:58,989][27935] Avg episode reward: [(0, '-51.408')] [2022-07-13 00:35:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 95422464. Throughput: 0: 10408.7. Samples: 190864096. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:03,989][27935] Avg episode reward: [(0, '-52.739')] [2022-07-13 00:35:08,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5265.8). Total num frames: 95450112. Throughput: 0: 10418.6. Samples: 190895872. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:08,990][27935] Avg episode reward: [(0, '-53.623')] [2022-07-13 00:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 95474688. Throughput: 0: 10438.0. Samples: 190959140. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:13,989][27935] Avg episode reward: [(0, '-53.904')] [2022-07-13 00:35:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5265.8). Total num frames: 95502336. Throughput: 0: 10455.5. Samples: 191023064. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:18,989][27935] Avg episode reward: [(0, '-53.567')] [2022-07-13 00:35:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 95527936. Throughput: 0: 10465.3. Samples: 191054720. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:23,989][27935] Avg episode reward: [(0, '-53.457')] [2022-07-13 00:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 95554560. Throughput: 0: 10474.1. Samples: 191118432. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:28,989][27935] Avg episode reward: [(0, '-53.772')] [2022-07-13 00:35:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 95581184. Throughput: 0: 10478.0. Samples: 191182068. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:33,989][27935] Avg episode reward: [(0, '-53.229')] [2022-07-13 00:35:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5258.9). Total num frames: 95608832. Throughput: 0: 10478.4. Samples: 191213500. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:38,989][27935] Avg episode reward: [(0, '-52.697')] [2022-07-13 00:35:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 95634432. Throughput: 0: 10519.0. Samples: 191278072. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:43,989][27935] Avg episode reward: [(0, '-52.380')] [2022-07-13 00:35:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 95660032. Throughput: 0: 10594.1. Samples: 191340832. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:48,989][27935] Avg episode reward: [(0, '-53.102')] [2022-07-13 00:35:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 95687680. Throughput: 0: 10592.3. Samples: 191372524. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:53,989][27935] Avg episode reward: [(0, '-53.129')] [2022-07-13 00:35:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5262.3). Total num frames: 95714304. Throughput: 0: 10606.9. Samples: 191436452. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:35:58,989][27935] Avg episode reward: [(0, '-53.282')] [2022-07-13 00:36:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 95738880. Throughput: 0: 10526.7. Samples: 191496764. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:03,989][27935] Avg episode reward: [(0, '-53.119')] [2022-07-13 00:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 95764480. Throughput: 0: 10533.2. Samples: 191528716. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:08,989][27935] Avg episode reward: [(0, '-54.203')] [2022-07-13 00:36:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 95792128. Throughput: 0: 10524.9. Samples: 191592052. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:13,989][27935] Avg episode reward: [(0, '-53.883')] [2022-07-13 00:36:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 95817728. Throughput: 0: 10511.2. Samples: 191655072. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:18,989][27935] Avg episode reward: [(0, '-53.637')] [2022-07-13 00:36:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 95844352. Throughput: 0: 10509.4. Samples: 191686424. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:23,990][27935] Avg episode reward: [(0, '-53.469')] [2022-07-13 00:36:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 95870976. Throughput: 0: 10491.2. Samples: 191750176. Policy #0 lag: (min: 0.0, avg: 7.4, max: 17.0) [2022-07-13 00:36:28,989][27935] Avg episode reward: [(0, '-52.266')] [2022-07-13 00:36:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 95896576. Throughput: 0: 10490.2. Samples: 191812892. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:33,989][27935] Avg episode reward: [(0, '-52.053')] [2022-07-13 00:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 95923200. Throughput: 0: 10482.4. Samples: 191844232. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:38,989][27935] Avg episode reward: [(0, '-51.212')] [2022-07-13 00:36:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 95949824. Throughput: 0: 10469.0. Samples: 191907556. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:43,990][27935] Avg episode reward: [(0, '-51.000')] [2022-07-13 00:36:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 95975424. Throughput: 0: 10531.9. Samples: 191970700. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:48,989][27935] Avg episode reward: [(0, '-51.236')] [2022-07-13 00:36:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 96002048. Throughput: 0: 10531.7. Samples: 192002644. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:53,992][27935] Avg episode reward: [(0, '-50.996')] [2022-07-13 00:36:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5251.9). Total num frames: 96026624. Throughput: 0: 10514.8. Samples: 192065216. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:36:58,989][27935] Avg episode reward: [(0, '-51.359')] [2022-07-13 00:37:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 96053248. Throughput: 0: 10441.1. Samples: 192124920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:03,989][27935] Avg episode reward: [(0, '-51.471')] [2022-07-13 00:37:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 96078848. Throughput: 0: 10452.6. Samples: 192156792. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:08,989][27935] Avg episode reward: [(0, '-51.918')] [2022-07-13 00:37:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 96105472. Throughput: 0: 10425.9. Samples: 192219340. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:13,989][27935] Avg episode reward: [(0, '-52.006')] [2022-07-13 00:37:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5238.2). Total num frames: 96130048. Throughput: 0: 10446.3. Samples: 192282976. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:18,990][27935] Avg episode reward: [(0, '-51.843')] [2022-07-13 00:37:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 96158720. Throughput: 0: 10452.8. Samples: 192314608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:23,989][27935] Avg episode reward: [(0, '-52.210')] [2022-07-13 00:37:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 96183296. Throughput: 0: 10434.4. Samples: 192377104. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:28,989][27935] Avg episode reward: [(0, '-52.993')] [2022-07-13 00:37:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 96210944. Throughput: 0: 10440.7. Samples: 192440532. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:33,989][27935] Avg episode reward: [(0, '-53.294')] [2022-07-13 00:37:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 96236544. Throughput: 0: 10416.2. Samples: 192471372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:38,989][27935] Avg episode reward: [(0, '-52.647')] [2022-07-13 00:37:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 96261120. Throughput: 0: 10364.6. Samples: 192531624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:43,989][27935] Avg episode reward: [(0, '-52.151')] [2022-07-13 00:37:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 96288768. Throughput: 0: 10445.2. Samples: 192594956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:48,989][27935] Avg episode reward: [(0, '-52.308')] [2022-07-13 00:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 96313344. Throughput: 0: 10447.6. Samples: 192626936. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:53,990][27935] Avg episode reward: [(0, '-52.909')] [2022-07-13 00:37:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 96340992. Throughput: 0: 10468.5. Samples: 192690424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:37:58,989][27935] Avg episode reward: [(0, '-51.733')] [2022-07-13 00:38:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 96366592. Throughput: 0: 10392.9. Samples: 192750656. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:38:03,989][27935] Avg episode reward: [(0, '-51.591')] [2022-07-13 00:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 96391168. Throughput: 0: 10395.8. Samples: 192782420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:38:08,989][27935] Avg episode reward: [(0, '-51.489')] [2022-07-13 00:38:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 96418816. Throughput: 0: 10418.5. Samples: 192845936. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:38:13,989][27935] Avg episode reward: [(0, '-51.388')] [2022-07-13 00:38:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 96445440. Throughput: 0: 10421.1. Samples: 192909484. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:38:18,989][27935] Avg episode reward: [(0, '-52.091')] [2022-07-13 00:38:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 96471040. Throughput: 0: 10445.4. Samples: 192941416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 00:38:23,989][27935] Avg episode reward: [(0, '-51.672')] [2022-07-13 00:38:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 96497664. Throughput: 0: 10516.8. Samples: 193004880. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:28,989][27935] Avg episode reward: [(0, '-51.317')] [2022-07-13 00:38:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 96525312. Throughput: 0: 10517.1. Samples: 193068224. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:33,989][27935] Avg episode reward: [(0, '-51.535')] [2022-07-13 00:38:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 96550912. Throughput: 0: 10512.2. Samples: 193099984. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:38,989][27935] Avg episode reward: [(0, '-51.750')] [2022-07-13 00:38:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 96577536. Throughput: 0: 10512.2. Samples: 193163472. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:43,989][27935] Avg episode reward: [(0, '-51.628')] [2022-07-13 00:38:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 96604160. Throughput: 0: 10584.4. Samples: 193226956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:48,989][27935] Avg episode reward: [(0, '-51.535')] [2022-07-13 00:38:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 96629760. Throughput: 0: 10590.0. Samples: 193258972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:53,989][27935] Avg episode reward: [(0, '-51.146')] [2022-07-13 00:38:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 96656384. Throughput: 0: 10591.2. Samples: 193322540. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:38:58,989][27935] Avg episode reward: [(0, '-51.373')] [2022-07-13 00:39:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 96680960. Throughput: 0: 10494.9. Samples: 193381752. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:03,989][27935] Avg episode reward: [(0, '-51.371')] [2022-07-13 00:39:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 96707584. Throughput: 0: 10494.8. Samples: 193413680. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:08,989][27935] Avg episode reward: [(0, '-51.614')] [2022-07-13 00:39:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 96734208. Throughput: 0: 10512.4. Samples: 193477936. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:13,989][27935] Avg episode reward: [(0, '-51.825')] [2022-07-13 00:39:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 96761856. Throughput: 0: 10530.1. Samples: 193542076. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:18,989][27935] Avg episode reward: [(0, '-51.875')] [2022-07-13 00:39:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 96787456. Throughput: 0: 10519.3. Samples: 193573352. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:23,990][27935] Avg episode reward: [(0, '-51.468')] [2022-07-13 00:39:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 96814080. Throughput: 0: 10513.6. Samples: 193636584. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:28,989][27935] Avg episode reward: [(0, '-51.957')] [2022-07-13 00:39:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 96840704. Throughput: 0: 10507.5. Samples: 193699792. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:33,989][27935] Avg episode reward: [(0, '-52.192')] [2022-07-13 00:39:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 96867328. Throughput: 0: 10502.2. Samples: 193731572. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:38,989][27935] Avg episode reward: [(0, '-51.896')] [2022-07-13 00:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 96891904. Throughput: 0: 10503.3. Samples: 193795188. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:43,989][27935] Avg episode reward: [(0, '-52.236')] [2022-07-13 00:39:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 96920576. Throughput: 0: 10616.5. Samples: 193859496. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:48,989][27935] Avg episode reward: [(0, '-52.930')] [2022-07-13 00:39:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 96946176. Throughput: 0: 10614.0. Samples: 193891308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:53,989][27935] Avg episode reward: [(0, '-53.431')] [2022-07-13 00:39:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 96972800. Throughput: 0: 10599.2. Samples: 193954900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:39:58,989][27935] Avg episode reward: [(0, '-53.882')] [2022-07-13 00:40:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 96996352. Throughput: 0: 10496.9. Samples: 194014436. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:40:03,989][27935] Avg episode reward: [(0, '-53.874')] [2022-07-13 00:40:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 97024000. Throughput: 0: 10506.2. Samples: 194046132. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:40:08,989][27935] Avg episode reward: [(0, '-53.446')] [2022-07-13 00:40:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 97050624. Throughput: 0: 10499.6. Samples: 194109068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 00:40:13,989][27935] Avg episode reward: [(0, '-53.897')] [2022-07-13 00:40:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 97076224. Throughput: 0: 10505.1. Samples: 194172520. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:18,989][27935] Avg episode reward: [(0, '-53.010')] [2022-07-13 00:40:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 97103872. Throughput: 0: 10512.4. Samples: 194204632. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:23,989][27935] Avg episode reward: [(0, '-52.850')] [2022-07-13 00:40:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 97128448. Throughput: 0: 10509.9. Samples: 194268136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:28,989][27935] Avg episode reward: [(0, '-53.058')] [2022-07-13 00:40:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 97156096. Throughput: 0: 10483.4. Samples: 194331248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:33,989][27935] Avg episode reward: [(0, '-53.041')] [2022-07-13 00:40:38,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 97182720. Throughput: 0: 10478.8. Samples: 194362852. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:38,989][27935] Avg episode reward: [(0, '-52.918')] [2022-07-13 00:40:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 97208320. Throughput: 0: 10478.5. Samples: 194426432. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:43,989][27935] Avg episode reward: [(0, '-53.390')] [2022-07-13 00:40:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 97235968. Throughput: 0: 10571.0. Samples: 194490132. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:48,989][27935] Avg episode reward: [(0, '-52.081')] [2022-07-13 00:40:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 97261568. Throughput: 0: 10578.5. Samples: 194522164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:53,989][27935] Avg episode reward: [(0, '-51.829')] [2022-07-13 00:40:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 97289216. Throughput: 0: 10594.7. Samples: 194585828. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:40:58,989][27935] Avg episode reward: [(0, '-50.912')] [2022-07-13 00:41:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 97313792. Throughput: 0: 10509.6. Samples: 194645452. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:03,989][27935] Avg episode reward: [(0, '-51.314')] [2022-07-13 00:41:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 97339392. Throughput: 0: 10514.9. Samples: 194677804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:08,989][27935] Avg episode reward: [(0, '-51.619')] [2022-07-13 00:41:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 97366016. Throughput: 0: 10522.3. Samples: 194741640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:13,989][27935] Avg episode reward: [(0, '-52.886')] [2022-07-13 00:41:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 97393664. Throughput: 0: 10531.8. Samples: 194805180. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:18,989][27935] Avg episode reward: [(0, '-52.584')] [2022-07-13 00:41:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 97420288. Throughput: 0: 10543.6. Samples: 194837316. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:23,989][27935] Avg episode reward: [(0, '-52.886')] [2022-07-13 00:41:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5307.7, 300 sec: 5255.4). Total num frames: 97446912. Throughput: 0: 10555.6. Samples: 194901432. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:28,989][27935] Avg episode reward: [(0, '-53.809')] [2022-07-13 00:41:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 97472512. Throughput: 0: 10542.4. Samples: 194964540. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:33,989][27935] Avg episode reward: [(0, '-53.559')] [2022-07-13 00:41:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 97499136. Throughput: 0: 10542.1. Samples: 194996560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:38,989][27935] Avg episode reward: [(0, '-53.396')] [2022-07-13 00:41:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5258.8). Total num frames: 97526784. Throughput: 0: 10549.8. Samples: 195060568. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:43,989][27935] Avg episode reward: [(0, '-52.515')] [2022-07-13 00:41:48,995][27935] Fps is (10 sec: 5321.3, 60 sec: 5273.0, 300 sec: 5255.3). Total num frames: 97552384. Throughput: 0: 10645.8. Samples: 195124584. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:48,996][27935] Avg episode reward: [(0, '-52.806')] [2022-07-13 00:41:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5265.8). Total num frames: 97580032. Throughput: 0: 10639.7. Samples: 195156592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:53,989][27935] Avg episode reward: [(0, '-53.123')] [2022-07-13 00:41:58,989][27935] Fps is (10 sec: 5328.2, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 97605632. Throughput: 0: 10648.0. Samples: 195220800. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:41:58,989][27935] Avg episode reward: [(0, '-53.158')] [2022-07-13 00:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 97631232. Throughput: 0: 10566.6. Samples: 195280676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:42:03,989][27935] Avg episode reward: [(0, '-52.964')] [2022-07-13 00:42:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5258.8). Total num frames: 97656832. Throughput: 0: 10564.7. Samples: 195312728. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 00:42:08,989][27935] Avg episode reward: [(0, '-53.094')] [2022-07-13 00:42:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5307.7, 300 sec: 5269.3). Total num frames: 97684480. Throughput: 0: 10561.7. Samples: 195376712. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:13,989][27935] Avg episode reward: [(0, '-52.581')] [2022-07-13 00:42:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 97711104. Throughput: 0: 10574.3. Samples: 195440384. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:18,989][27935] Avg episode reward: [(0, '-52.536')] [2022-07-13 00:42:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 97736704. Throughput: 0: 10566.0. Samples: 195472028. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:23,989][27935] Avg episode reward: [(0, '-51.566')] [2022-07-13 00:42:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 97763328. Throughput: 0: 10571.1. Samples: 195536268. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:28,989][27935] Avg episode reward: [(0, '-50.913')] [2022-07-13 00:42:33,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5290.7, 300 sec: 5265.8). Total num frames: 97789952. Throughput: 0: 10558.7. Samples: 195599656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:33,989][27935] Avg episode reward: [(0, '-51.243')] [2022-07-13 00:42:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 97816576. Throughput: 0: 10559.3. Samples: 195631760. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:38,989][27935] Avg episode reward: [(0, '-51.025')] [2022-07-13 00:42:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 97843200. Throughput: 0: 10533.6. Samples: 195694812. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:43,989][27935] Avg episode reward: [(0, '-50.772')] [2022-07-13 00:42:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5274.2, 300 sec: 5272.7). Total num frames: 97868800. Throughput: 0: 10617.6. Samples: 195758468. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:48,989][27935] Avg episode reward: [(0, '-51.227')] [2022-07-13 00:42:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 97897472. Throughput: 0: 10612.2. Samples: 195790276. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:53,989][27935] Avg episode reward: [(0, '-51.193')] [2022-07-13 00:42:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 97922048. Throughput: 0: 10608.1. Samples: 195854076. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:42:58,989][27935] Avg episode reward: [(0, '-51.159')] [2022-07-13 00:43:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 97947648. Throughput: 0: 10518.0. Samples: 195913692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:03,990][27935] Avg episode reward: [(0, '-51.237')] [2022-07-13 00:43:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 97974272. Throughput: 0: 10528.9. Samples: 195945828. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:08,989][27935] Avg episode reward: [(0, '-51.181')] [2022-07-13 00:43:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5256.5, 300 sec: 5269.3). Total num frames: 97999872. Throughput: 0: 10521.7. Samples: 196009744. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:13,990][27935] Avg episode reward: [(0, '-51.441')] [2022-07-13 00:43:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 98027520. Throughput: 0: 10531.8. Samples: 196073588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:18,989][27935] Avg episode reward: [(0, '-51.722')] [2022-07-13 00:43:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 98053120. Throughput: 0: 10521.9. Samples: 196105244. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:23,989][27935] Avg episode reward: [(0, '-51.870')] [2022-07-13 00:43:28,997][27935] Fps is (10 sec: 5320.7, 60 sec: 5290.0, 300 sec: 5272.6). Total num frames: 98080768. Throughput: 0: 10552.4. Samples: 196169752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:28,997][27935] Avg episode reward: [(0, '-52.745')] [2022-07-13 00:43:33,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 98107392. Throughput: 0: 10537.2. Samples: 196232640. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:33,989][27935] Avg episode reward: [(0, '-52.435')] [2022-07-13 00:43:38,989][27935] Fps is (10 sec: 5226.5, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 98132992. Throughput: 0: 10537.4. Samples: 196264460. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:38,989][27935] Avg episode reward: [(0, '-53.209')] [2022-07-13 00:43:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5265.8). Total num frames: 98157568. Throughput: 0: 10487.1. Samples: 196325996. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:43,989][27935] Avg episode reward: [(0, '-52.278')] [2022-07-13 00:43:48,989][27935] Fps is (10 sec: 5222.1, 60 sec: 5273.5, 300 sec: 5272.7). Total num frames: 98185216. Throughput: 0: 10565.9. Samples: 196389164. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:48,990][27935] Avg episode reward: [(0, '-51.840')] [2022-07-13 00:43:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 98211840. Throughput: 0: 10556.4. Samples: 196420864. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:53,989][27935] Avg episode reward: [(0, '-52.357')] [2022-07-13 00:43:58,989][27935] Fps is (10 sec: 5325.1, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 98238464. Throughput: 0: 10570.7. Samples: 196485424. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:43:58,990][27935] Avg episode reward: [(0, '-51.361')] [2022-07-13 00:44:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5269.3). Total num frames: 98262016. Throughput: 0: 10464.0. Samples: 196544468. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:44:03,989][27935] Avg episode reward: [(0, '-51.523')] [2022-07-13 00:44:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5272.7). Total num frames: 98289664. Throughput: 0: 10469.1. Samples: 196576352. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:44:08,989][27935] Avg episode reward: [(0, '-52.772')] [2022-07-13 00:44:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5262.3). Total num frames: 98314240. Throughput: 0: 10430.1. Samples: 196639024. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:13,989][27935] Avg episode reward: [(0, '-52.492')] [2022-07-13 00:44:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5269.3). Total num frames: 98341888. Throughput: 0: 10431.6. Samples: 196702064. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:18,989][27935] Avg episode reward: [(0, '-52.517')] [2022-07-13 00:44:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5265.8). Total num frames: 98367488. Throughput: 0: 10437.5. Samples: 196734148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:23,989][27935] Avg episode reward: [(0, '-51.298')] [2022-07-13 00:44:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5223.1, 300 sec: 5265.8). Total num frames: 98394112. Throughput: 0: 10499.0. Samples: 196798452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:28,989][27935] Avg episode reward: [(0, '-50.783')] [2022-07-13 00:44:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5265.8). Total num frames: 98420736. Throughput: 0: 10506.4. Samples: 196861948. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:33,989][27935] Avg episode reward: [(0, '-50.254')] [2022-07-13 00:44:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 98448384. Throughput: 0: 10514.7. Samples: 196894024. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:38,989][27935] Avg episode reward: [(0, '-49.525')] [2022-07-13 00:44:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5269.3). Total num frames: 98475008. Throughput: 0: 10509.9. Samples: 196958368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:43,989][27935] Avg episode reward: [(0, '-49.997')] [2022-07-13 00:44:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.7, 300 sec: 5272.7). Total num frames: 98501632. Throughput: 0: 10617.4. Samples: 197022252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:48,989][27935] Avg episode reward: [(0, '-50.974')] [2022-07-13 00:44:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 98528256. Throughput: 0: 10623.8. Samples: 197054424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:53,989][27935] Avg episode reward: [(0, '-51.442')] [2022-07-13 00:44:58,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 98553856. Throughput: 0: 10655.6. Samples: 197118532. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:44:58,990][27935] Avg episode reward: [(0, '-52.469')] [2022-07-13 00:45:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 98578432. Throughput: 0: 10581.3. Samples: 197178224. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:03,989][27935] Avg episode reward: [(0, '-52.763')] [2022-07-13 00:45:08,989][27935] Fps is (10 sec: 5325.2, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 98607104. Throughput: 0: 10576.8. Samples: 197210104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:08,990][27935] Avg episode reward: [(0, '-52.353')] [2022-07-13 00:45:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 98631680. Throughput: 0: 10581.4. Samples: 197274616. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:13,989][27935] Avg episode reward: [(0, '-51.957')] [2022-07-13 00:45:18,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5290.6, 300 sec: 5272.7). Total num frames: 98659328. Throughput: 0: 10593.8. Samples: 197338672. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:18,990][27935] Avg episode reward: [(0, '-51.230')] [2022-07-13 00:45:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 98685952. Throughput: 0: 10598.3. Samples: 197370948. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:23,989][27935] Avg episode reward: [(0, '-51.103')] [2022-07-13 00:45:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5307.7, 300 sec: 5276.2). Total num frames: 98712576. Throughput: 0: 10590.3. Samples: 197434932. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:28,989][27935] Avg episode reward: [(0, '-50.531')] [2022-07-13 00:45:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5276.2). Total num frames: 98739200. Throughput: 0: 10563.2. Samples: 197497596. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:33,989][27935] Avg episode reward: [(0, '-50.184')] [2022-07-13 00:45:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 98765824. Throughput: 0: 10567.1. Samples: 197529944. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:38,989][27935] Avg episode reward: [(0, '-50.694')] [2022-07-13 00:45:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 98792448. Throughput: 0: 10576.7. Samples: 197594476. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:43,989][27935] Avg episode reward: [(0, '-51.073')] [2022-07-13 00:45:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 98820096. Throughput: 0: 10673.6. Samples: 197658536. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:48,995][27935] Avg episode reward: [(0, '-51.527')] [2022-07-13 00:45:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 98846720. Throughput: 0: 10678.9. Samples: 197690656. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:53,989][27935] Avg episode reward: [(0, '-51.510')] [2022-07-13 00:45:58,989][27935] Fps is (10 sec: 5222.1, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 98872320. Throughput: 0: 10683.2. Samples: 197755368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:45:58,990][27935] Avg episode reward: [(0, '-51.322')] [2022-07-13 00:46:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 98897920. Throughput: 0: 10597.7. Samples: 197815564. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 00:46:03,989][27935] Avg episode reward: [(0, '-52.113')] [2022-07-13 00:46:08,989][27935] Fps is (10 sec: 5427.6, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 98926592. Throughput: 0: 10594.5. Samples: 197847700. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:08,989][27935] Avg episode reward: [(0, '-51.470')] [2022-07-13 00:46:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5279.7). Total num frames: 98951168. Throughput: 0: 10601.5. Samples: 197912000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:13,989][27935] Avg episode reward: [(0, '-50.903')] [2022-07-13 00:46:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5307.8, 300 sec: 5279.7). Total num frames: 98977792. Throughput: 0: 10615.6. Samples: 197975300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:18,989][27935] Avg episode reward: [(0, '-50.422')] [2022-07-13 00:46:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 99004416. Throughput: 0: 10612.4. Samples: 198007500. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:23,989][27935] Avg episode reward: [(0, '-49.816')] [2022-07-13 00:46:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5286.6). Total num frames: 99032064. Throughput: 0: 10595.6. Samples: 198071276. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:28,989][27935] Avg episode reward: [(0, '-50.167')] [2022-07-13 00:46:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 99057664. Throughput: 0: 10570.4. Samples: 198134204. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:33,989][27935] Avg episode reward: [(0, '-50.605')] [2022-07-13 00:46:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 99083264. Throughput: 0: 10561.1. Samples: 198165904. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:38,989][27935] Avg episode reward: [(0, '-50.043')] [2022-07-13 00:46:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5283.3). Total num frames: 99110912. Throughput: 0: 10536.6. Samples: 198229508. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:43,989][27935] Avg episode reward: [(0, '-50.621')] [2022-07-13 00:46:49,001][27935] Fps is (10 sec: 5318.5, 60 sec: 5272.6, 300 sec: 5276.0). Total num frames: 99136512. Throughput: 0: 10597.0. Samples: 198292556. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:49,001][27935] Avg episode reward: [(0, '-50.571')] [2022-07-13 00:46:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 99163136. Throughput: 0: 10597.6. Samples: 198324592. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:53,989][27935] Avg episode reward: [(0, '-51.444')] [2022-07-13 00:46:58,989][27935] Fps is (10 sec: 5331.1, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 99189760. Throughput: 0: 10586.8. Samples: 198388404. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:46:58,989][27935] Avg episode reward: [(0, '-50.855')] [2022-07-13 00:47:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 99215360. Throughput: 0: 10512.8. Samples: 198448376. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:03,989][27935] Avg episode reward: [(0, '-50.253')] [2022-07-13 00:47:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5276.2). Total num frames: 99240960. Throughput: 0: 10501.8. Samples: 198480080. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:08,989][27935] Avg episode reward: [(0, '-50.572')] [2022-07-13 00:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 99267584. Throughput: 0: 10495.8. Samples: 198543588. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:13,989][27935] Avg episode reward: [(0, '-51.123')] [2022-07-13 00:47:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 99294208. Throughput: 0: 10524.5. Samples: 198607808. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:18,989][27935] Avg episode reward: [(0, '-50.878')] [2022-07-13 00:47:23,995][27935] Fps is (10 sec: 5423.6, 60 sec: 5290.1, 300 sec: 5283.0). Total num frames: 99321856. Throughput: 0: 10532.6. Samples: 198639940. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:23,996][27935] Avg episode reward: [(0, '-50.644')] [2022-07-13 00:47:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 99347456. Throughput: 0: 10536.6. Samples: 198703656. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:28,989][27935] Avg episode reward: [(0, '-50.645')] [2022-07-13 00:47:33,989][27935] Fps is (10 sec: 5225.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 99374080. Throughput: 0: 10557.0. Samples: 198767496. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:33,989][27935] Avg episode reward: [(0, '-51.914')] [2022-07-13 00:47:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 99399680. Throughput: 0: 10535.3. Samples: 198798680. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:38,989][27935] Avg episode reward: [(0, '-51.829')] [2022-07-13 00:47:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 99426304. Throughput: 0: 10498.5. Samples: 198860836. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:43,989][27935] Avg episode reward: [(0, '-50.922')] [2022-07-13 00:47:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5257.6, 300 sec: 5269.3). Total num frames: 99451904. Throughput: 0: 10594.4. Samples: 198925124. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:48,989][27935] Avg episode reward: [(0, '-51.580')] [2022-07-13 00:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 99478528. Throughput: 0: 10596.9. Samples: 198956940. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:53,989][27935] Avg episode reward: [(0, '-51.883')] [2022-07-13 00:47:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 99506176. Throughput: 0: 10594.9. Samples: 199020356. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 00:47:58,990][27935] Avg episode reward: [(0, '-50.957')] [2022-07-13 00:48:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 99530752. Throughput: 0: 10477.8. Samples: 199079308. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:03,989][27935] Avg episode reward: [(0, '-51.119')] [2022-07-13 00:48:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 99555328. Throughput: 0: 10467.2. Samples: 199110896. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:08,989][27935] Avg episode reward: [(0, '-50.195')] [2022-07-13 00:48:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 99584000. Throughput: 0: 10447.9. Samples: 199173812. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:13,989][27935] Avg episode reward: [(0, '-50.509')] [2022-07-13 00:48:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 99608576. Throughput: 0: 10430.9. Samples: 199236888. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:18,989][27935] Avg episode reward: [(0, '-50.120')] [2022-07-13 00:48:23,990][27935] Fps is (10 sec: 5017.0, 60 sec: 5205.8, 300 sec: 5265.9). Total num frames: 99634176. Throughput: 0: 10407.7. Samples: 199267040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:23,991][27935] Avg episode reward: [(0, '-50.266')] [2022-07-13 00:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5258.8). Total num frames: 99658752. Throughput: 0: 10387.1. Samples: 199328256. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:28,989][27935] Avg episode reward: [(0, '-50.606')] [2022-07-13 00:48:33,989][27935] Fps is (10 sec: 5223.1, 60 sec: 5205.3, 300 sec: 5265.8). Total num frames: 99686400. Throughput: 0: 10337.5. Samples: 199390312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:33,989][27935] Avg episode reward: [(0, '-49.917')] [2022-07-13 00:48:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5269.3). Total num frames: 99712000. Throughput: 0: 10332.3. Samples: 199421892. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:38,989][27935] Avg episode reward: [(0, '-51.478')] [2022-07-13 00:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5265.8). Total num frames: 99738624. Throughput: 0: 10282.4. Samples: 199483064. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:43,989][27935] Avg episode reward: [(0, '-51.436')] [2022-07-13 00:48:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5255.4). Total num frames: 99762176. Throughput: 0: 10330.5. Samples: 199544180. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:48,989][27935] Avg episode reward: [(0, '-51.117')] [2022-07-13 00:48:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5251.9). Total num frames: 99787776. Throughput: 0: 10310.1. Samples: 199574848. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:53,989][27935] Avg episode reward: [(0, '-50.661')] [2022-07-13 00:48:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5258.8). Total num frames: 99813376. Throughput: 0: 10248.5. Samples: 199634992. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:48:58,996][27935] Avg episode reward: [(0, '-50.912')] [2022-07-13 00:49:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5241.5). Total num frames: 99835904. Throughput: 0: 10105.3. Samples: 199691628. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:03,989][27935] Avg episode reward: [(0, '-51.530')] [2022-07-13 00:49:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5245.0). Total num frames: 99861504. Throughput: 0: 10126.2. Samples: 199722708. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:08,989][27935] Avg episode reward: [(0, '-51.418')] [2022-07-13 00:49:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5234.5). Total num frames: 99886080. Throughput: 0: 10087.5. Samples: 199782196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:13,989][27935] Avg episode reward: [(0, '-51.228')] [2022-07-13 00:49:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5231.1). Total num frames: 99910656. Throughput: 0: 10004.9. Samples: 199840532. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:18,989][27935] Avg episode reward: [(0, '-51.545')] [2022-07-13 00:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.7, 300 sec: 5224.1). Total num frames: 99935232. Throughput: 0: 9960.3. Samples: 199870108. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:23,989][27935] Avg episode reward: [(0, '-51.522')] [2022-07-13 00:49:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5220.7). Total num frames: 99960832. Throughput: 0: 9937.4. Samples: 199930248. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:28,989][27935] Avg episode reward: [(0, '-51.386')] [2022-07-13 00:49:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 5203.3). Total num frames: 99983360. Throughput: 0: 9875.5. Samples: 199988576. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:33,989][27935] Avg episode reward: [(0, '-50.886')] [2022-07-13 00:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5203.3). Total num frames: 100009984. Throughput: 0: 9832.7. Samples: 200017320. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:38,989][27935] Avg episode reward: [(0, '-50.747')] [2022-07-13 00:49:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 5186.0). Total num frames: 100031488. Throughput: 0: 9745.8. Samples: 200073552. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:43,990][27935] Avg episode reward: [(0, '-50.164')] [2022-07-13 00:49:48,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4864.0, 300 sec: 5172.1). Total num frames: 100054016. Throughput: 0: 9694.6. Samples: 200127884. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:48,989][27935] Avg episode reward: [(0, '-51.541')] [2022-07-13 00:49:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 5168.6). Total num frames: 100078592. Throughput: 0: 9626.4. Samples: 200155896. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:53,989][27935] Avg episode reward: [(0, '-51.741')] [2022-07-13 00:49:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 5161.7). Total num frames: 100101120. Throughput: 0: 9552.0. Samples: 200212036. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:49:58,989][27935] Avg episode reward: [(0, '-52.255')] [2022-07-13 00:50:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4778.7, 300 sec: 5137.4). Total num frames: 100122624. Throughput: 0: 9420.2. Samples: 200264440. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:03,989][27935] Avg episode reward: [(0, '-52.217')] [2022-07-13 00:50:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 5130.4). Total num frames: 100145152. Throughput: 0: 9374.3. Samples: 200291952. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:08,989][27935] Avg episode reward: [(0, '-51.664')] [2022-07-13 00:50:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 5116.5). Total num frames: 100168704. Throughput: 0: 9271.1. Samples: 200347448. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:13,989][27935] Avg episode reward: [(0, '-51.628')] [2022-07-13 00:50:18,994][27935] Fps is (10 sec: 4605.6, 60 sec: 4675.9, 300 sec: 5102.6). Total num frames: 100191232. Throughput: 0: 9218.3. Samples: 200403448. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:18,994][27935] Avg episode reward: [(0, '-50.724')] [2022-07-13 00:50:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 5092.2). Total num frames: 100214784. Throughput: 0: 9195.2. Samples: 200431104. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:23,989][27935] Avg episode reward: [(0, '-50.639')] [2022-07-13 00:50:28,989][27935] Fps is (10 sec: 4712.8, 60 sec: 4625.1, 300 sec: 5081.8). Total num frames: 100238336. Throughput: 0: 9179.3. Samples: 200486620. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:28,989][27935] Avg episode reward: [(0, '-50.407')] [2022-07-13 00:50:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 5067.9). Total num frames: 100260864. Throughput: 0: 9212.4. Samples: 200542440. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:33,989][27935] Avg episode reward: [(0, '-50.698')] [2022-07-13 00:50:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 5057.5). Total num frames: 100284416. Throughput: 0: 9204.1. Samples: 200570080. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:38,989][27935] Avg episode reward: [(0, '-51.082')] [2022-07-13 00:50:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 5047.1). Total num frames: 100308992. Throughput: 0: 9200.5. Samples: 200626060. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:43,989][27935] Avg episode reward: [(0, '-51.286')] [2022-07-13 00:50:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 5033.2). Total num frames: 100331520. Throughput: 0: 9274.8. Samples: 200681804. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:48,989][27935] Avg episode reward: [(0, '-51.749')] [2022-07-13 00:50:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 5022.8). Total num frames: 100354048. Throughput: 0: 9285.7. Samples: 200709808. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:53,989][27935] Avg episode reward: [(0, '-51.982')] [2022-07-13 00:50:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 5015.9). Total num frames: 100377600. Throughput: 0: 9288.6. Samples: 200765436. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:50:58,989][27935] Avg episode reward: [(0, '-52.188')] [2022-07-13 00:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4991.6). Total num frames: 100399104. Throughput: 0: 9200.2. Samples: 200817412. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:03,989][27935] Avg episode reward: [(0, '-52.304')] [2022-07-13 00:51:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4984.6). Total num frames: 100421632. Throughput: 0: 9203.6. Samples: 200845268. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:08,989][27935] Avg episode reward: [(0, '-52.183')] [2022-07-13 00:51:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4974.2). Total num frames: 100445184. Throughput: 0: 9211.1. Samples: 200901120. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:13,989][27935] Avg episode reward: [(0, '-51.860')] [2022-07-13 00:51:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.5, 300 sec: 4963.8). Total num frames: 100468736. Throughput: 0: 9214.6. Samples: 200957096. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:18,989][27935] Avg episode reward: [(0, '-52.232')] [2022-07-13 00:51:24,004][27935] Fps is (10 sec: 4805.7, 60 sec: 4641.0, 300 sec: 4953.1). Total num frames: 100493312. Throughput: 0: 9217.8. Samples: 200985016. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:24,004][27935] Avg episode reward: [(0, '-51.250')] [2022-07-13 00:51:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4939.5). Total num frames: 100514816. Throughput: 0: 9205.7. Samples: 201040316. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:28,989][27935] Avg episode reward: [(0, '-52.023')] [2022-07-13 00:51:33,989][27935] Fps is (10 sec: 4614.8, 60 sec: 4642.1, 300 sec: 4936.0). Total num frames: 100539392. Throughput: 0: 9198.7. Samples: 201095744. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:33,989][27935] Avg episode reward: [(0, '-51.452')] [2022-07-13 00:51:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4918.7). Total num frames: 100561920. Throughput: 0: 9194.5. Samples: 201123560. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:38,989][27935] Avg episode reward: [(0, '-50.956')] [2022-07-13 00:51:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4908.5). Total num frames: 100584448. Throughput: 0: 9197.0. Samples: 201179300. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:43,989][27935] Avg episode reward: [(0, '-50.284')] [2022-07-13 00:51:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4894.4). Total num frames: 100606976. Throughput: 0: 9282.2. Samples: 201235112. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:48,989][27935] Avg episode reward: [(0, '-50.291')] [2022-07-13 00:51:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4887.4). Total num frames: 100631552. Throughput: 0: 9291.6. Samples: 201263392. Policy #0 lag: (min: 0.0, avg: 7.7, max: 20.0) [2022-07-13 00:51:53,989][27935] Avg episode reward: [(0, '-50.585')] [2022-07-13 00:51:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4877.0). Total num frames: 100654080. Throughput: 0: 9297.1. Samples: 201319488. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:51:58,989][27935] Avg episode reward: [(0, '-50.057')] [2022-07-13 00:52:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4863.1). Total num frames: 100675584. Throughput: 0: 9212.1. Samples: 201371640. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:03,990][27935] Avg episode reward: [(0, '-50.118')] [2022-07-13 00:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4856.2). Total num frames: 100700160. Throughput: 0: 9216.2. Samples: 201399608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:08,989][27935] Avg episode reward: [(0, '-50.652')] [2022-07-13 00:52:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4842.3). Total num frames: 100722688. Throughput: 0: 9222.7. Samples: 201455340. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:13,990][27935] Avg episode reward: [(0, '-50.868')] [2022-07-13 00:52:18,989][27935] Fps is (10 sec: 4505.5, 60 sec: 4608.0, 300 sec: 4825.1). Total num frames: 100745216. Throughput: 0: 9223.3. Samples: 201510796. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:18,990][27935] Avg episode reward: [(0, '-51.548')] [2022-07-13 00:52:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4575.0, 300 sec: 4814.5). Total num frames: 100767744. Throughput: 0: 9232.7. Samples: 201539032. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:23,989][27935] Avg episode reward: [(0, '-51.643')] [2022-07-13 00:52:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4642.1, 300 sec: 4811.1). Total num frames: 100793344. Throughput: 0: 9237.8. Samples: 201595000. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:28,989][27935] Avg episode reward: [(0, '-51.606')] [2022-07-13 00:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4800.7). Total num frames: 100815872. Throughput: 0: 9229.9. Samples: 201650456. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:33,989][27935] Avg episode reward: [(0, '-51.617')] [2022-07-13 00:52:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4786.8). Total num frames: 100838400. Throughput: 0: 9220.6. Samples: 201678320. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:38,989][27935] Avg episode reward: [(0, '-51.254')] [2022-07-13 00:52:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4779.8). Total num frames: 100861952. Throughput: 0: 9198.6. Samples: 201733424. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:43,989][27935] Avg episode reward: [(0, '-50.563')] [2022-07-13 00:52:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4765.9). Total num frames: 100884480. Throughput: 0: 9283.8. Samples: 201789412. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:48,989][27935] Avg episode reward: [(0, '-49.992')] [2022-07-13 00:52:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4755.5). Total num frames: 100909056. Throughput: 0: 9293.4. Samples: 201817812. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:53,989][27935] Avg episode reward: [(0, '-49.693')] [2022-07-13 00:52:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4752.1). Total num frames: 100932608. Throughput: 0: 9301.0. Samples: 201873884. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:52:58,989][27935] Avg episode reward: [(0, '-49.438')] [2022-07-13 00:53:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4738.2). Total num frames: 100953088. Throughput: 0: 9231.9. Samples: 201926228. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:03,989][27935] Avg episode reward: [(0, '-49.655')] [2022-07-13 00:53:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4720.8). Total num frames: 100976640. Throughput: 0: 9228.5. Samples: 201954316. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:08,989][27935] Avg episode reward: [(0, '-49.655')] [2022-07-13 00:53:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4717.3). Total num frames: 101000192. Throughput: 0: 9219.7. Samples: 202009888. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:13,989][27935] Avg episode reward: [(0, '-49.180')] [2022-07-13 00:53:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4706.9). Total num frames: 101022720. Throughput: 0: 9216.5. Samples: 202065200. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:18,989][27935] Avg episode reward: [(0, '-49.070')] [2022-07-13 00:53:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4703.5). Total num frames: 101046272. Throughput: 0: 9218.5. Samples: 202093152. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:23,990][27935] Avg episode reward: [(0, '-50.341')] [2022-07-13 00:53:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4686.1). Total num frames: 101068800. Throughput: 0: 9237.4. Samples: 202149108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:28,989][27935] Avg episode reward: [(0, '-50.113')] [2022-07-13 00:53:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4679.2). Total num frames: 101092352. Throughput: 0: 9227.7. Samples: 202204660. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:33,989][27935] Avg episode reward: [(0, '-50.285')] [2022-07-13 00:53:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4668.7). Total num frames: 101115904. Throughput: 0: 9211.9. Samples: 202232348. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:38,989][27935] Avg episode reward: [(0, '-51.041')] [2022-07-13 00:53:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4668.7). Total num frames: 101139456. Throughput: 0: 9212.4. Samples: 202288444. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:43,989][27935] Avg episode reward: [(0, '-50.596')] [2022-07-13 00:53:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 101160960. Throughput: 0: 9287.2. Samples: 202344152. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:48,989][27935] Avg episode reward: [(0, '-50.757')] [2022-07-13 00:53:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4651.4). Total num frames: 101185536. Throughput: 0: 9285.3. Samples: 202372156. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 00:53:53,989][27935] Avg episode reward: [(0, '-51.035')] [2022-07-13 00:53:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 101209088. Throughput: 0: 9286.8. Samples: 202427792. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:53:58,989][27935] Avg episode reward: [(0, '-50.314')] [2022-07-13 00:54:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 101231616. Throughput: 0: 9237.3. Samples: 202480876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:03,989][27935] Avg episode reward: [(0, '-50.198')] [2022-07-13 00:54:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 101254144. Throughput: 0: 9247.5. Samples: 202509288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:08,989][27935] Avg episode reward: [(0, '-49.299')] [2022-07-13 00:54:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4637.5). Total num frames: 101278720. Throughput: 0: 9276.7. Samples: 202566560. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:13,989][27935] Avg episode reward: [(0, '-49.376')] [2022-07-13 00:54:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4637.5). Total num frames: 101303296. Throughput: 0: 9320.6. Samples: 202624088. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:18,989][27935] Avg episode reward: [(0, '-49.074')] [2022-07-13 00:54:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4627.1). Total num frames: 101325824. Throughput: 0: 9353.9. Samples: 202653272. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:23,989][27935] Avg episode reward: [(0, '-49.412')] [2022-07-13 00:54:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4630.6). Total num frames: 101349376. Throughput: 0: 9383.7. Samples: 202710712. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:28,989][27935] Avg episode reward: [(0, '-49.984')] [2022-07-13 00:54:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4627.1). Total num frames: 101374976. Throughput: 0: 9420.4. Samples: 202768068. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:33,989][27935] Avg episode reward: [(0, '-50.015')] [2022-07-13 00:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4634.0). Total num frames: 101398528. Throughput: 0: 9437.2. Samples: 202796828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:38,989][27935] Avg episode reward: [(0, '-49.945')] [2022-07-13 00:54:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4637.5). Total num frames: 101422080. Throughput: 0: 9468.3. Samples: 202853864. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:43,989][27935] Avg episode reward: [(0, '-49.322')] [2022-07-13 00:54:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4630.6). Total num frames: 101444608. Throughput: 0: 9562.8. Samples: 202911200. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:48,989][27935] Avg episode reward: [(0, '-49.540')] [2022-07-13 00:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4644.4). Total num frames: 101471232. Throughput: 0: 9568.0. Samples: 202939848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:53,989][27935] Avg episode reward: [(0, '-49.238')] [2022-07-13 00:54:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4647.9). Total num frames: 101493760. Throughput: 0: 9567.1. Samples: 202997080. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:54:58,989][27935] Avg episode reward: [(0, '-49.166')] [2022-07-13 00:55:03,990][27935] Fps is (10 sec: 4402.5, 60 sec: 4727.3, 300 sec: 4644.4). Total num frames: 101515264. Throughput: 0: 9495.2. Samples: 203051388. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:03,991][27935] Avg episode reward: [(0, '-49.716')] [2022-07-13 00:55:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4651.4). Total num frames: 101540864. Throughput: 0: 9488.6. Samples: 203080260. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:08,989][27935] Avg episode reward: [(0, '-50.060')] [2022-07-13 00:55:13,989][27935] Fps is (10 sec: 4915.9, 60 sec: 4761.6, 300 sec: 4654.9). Total num frames: 101564416. Throughput: 0: 9497.0. Samples: 203138076. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:13,990][27935] Avg episode reward: [(0, '-49.602')] [2022-07-13 00:55:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4654.9). Total num frames: 101587968. Throughput: 0: 9500.0. Samples: 203195568. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:18,989][27935] Avg episode reward: [(0, '-49.804')] [2022-07-13 00:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4658.3). Total num frames: 101612544. Throughput: 0: 9502.0. Samples: 203224416. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:23,989][27935] Avg episode reward: [(0, '-49.762')] [2022-07-13 00:55:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4778.7, 300 sec: 4661.8). Total num frames: 101636096. Throughput: 0: 9518.1. Samples: 203282180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:28,989][27935] Avg episode reward: [(0, '-49.399')] [2022-07-13 00:55:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4665.3). Total num frames: 101660672. Throughput: 0: 9514.2. Samples: 203339340. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:33,989][27935] Avg episode reward: [(0, '-48.457')] [2022-07-13 00:55:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4658.3). Total num frames: 101683200. Throughput: 0: 9518.4. Samples: 203368176. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:38,989][27935] Avg episode reward: [(0, '-48.707')] [2022-07-13 00:55:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4665.3). Total num frames: 101707776. Throughput: 0: 9535.6. Samples: 203426180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:43,989][27935] Avg episode reward: [(0, '-48.404')] [2022-07-13 00:55:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4672.2). Total num frames: 101732352. Throughput: 0: 9586.9. Samples: 203482784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:48,991][27935] Avg episode reward: [(0, '-48.185')] [2022-07-13 00:55:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4668.7). Total num frames: 101754880. Throughput: 0: 9561.1. Samples: 203510508. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 00:55:53,989][27935] Avg episode reward: [(0, '-48.683')] [2022-07-13 00:55:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4679.2). Total num frames: 101779456. Throughput: 0: 9556.4. Samples: 203568112. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:55:58,989][27935] Avg episode reward: [(0, '-48.395')] [2022-07-13 00:56:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.7, 300 sec: 4675.7). Total num frames: 101800960. Throughput: 0: 9472.5. Samples: 203621828. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:03,989][27935] Avg episode reward: [(0, '-48.476')] [2022-07-13 00:56:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4679.2). Total num frames: 101825536. Throughput: 0: 9474.8. Samples: 203650780. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:08,991][27935] Avg episode reward: [(0, '-48.487')] [2022-07-13 00:56:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4679.2). Total num frames: 101849088. Throughput: 0: 9470.4. Samples: 203708348. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:13,989][27935] Avg episode reward: [(0, '-48.723')] [2022-07-13 00:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4675.9). Total num frames: 101872640. Throughput: 0: 9472.2. Samples: 203765588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:18,989][27935] Avg episode reward: [(0, '-49.148')] [2022-07-13 00:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4686.1). Total num frames: 101897216. Throughput: 0: 9470.4. Samples: 203794344. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:23,989][27935] Avg episode reward: [(0, '-48.844')] [2022-07-13 00:56:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4682.6). Total num frames: 101920768. Throughput: 0: 9468.4. Samples: 203852260. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:28,991][27935] Avg episode reward: [(0, '-49.480')] [2022-07-13 00:56:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4686.1). Total num frames: 101944320. Throughput: 0: 9482.6. Samples: 203909500. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:33,989][27935] Avg episode reward: [(0, '-49.107')] [2022-07-13 00:56:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4696.5). Total num frames: 101969920. Throughput: 0: 9512.4. Samples: 203938564. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:38,989][27935] Avg episode reward: [(0, '-49.843')] [2022-07-13 00:56:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4700.0). Total num frames: 101993472. Throughput: 0: 9518.0. Samples: 203996424. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:43,989][27935] Avg episode reward: [(0, '-50.185')] [2022-07-13 00:56:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4696.5). Total num frames: 102017024. Throughput: 0: 9608.8. Samples: 204054224. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:48,989][27935] Avg episode reward: [(0, '-49.864')] [2022-07-13 00:56:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4703.5). Total num frames: 102041600. Throughput: 0: 9606.7. Samples: 204083084. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:53,989][27935] Avg episode reward: [(0, '-49.845')] [2022-07-13 00:56:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4706.9). Total num frames: 102064128. Throughput: 0: 9597.3. Samples: 204140228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:56:58,989][27935] Avg episode reward: [(0, '-49.827')] [2022-07-13 00:57:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4700.0). Total num frames: 102086656. Throughput: 0: 9511.4. Samples: 204193600. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:03,991][27935] Avg episode reward: [(0, '-50.100')] [2022-07-13 00:57:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4703.5). Total num frames: 102110208. Throughput: 0: 9496.4. Samples: 204221680. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:08,989][27935] Avg episode reward: [(0, '-49.825')] [2022-07-13 00:57:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4710.4). Total num frames: 102134784. Throughput: 0: 9472.4. Samples: 204278516. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:13,989][27935] Avg episode reward: [(0, '-48.947')] [2022-07-13 00:57:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 102157312. Throughput: 0: 9462.3. Samples: 204335304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:18,989][27935] Avg episode reward: [(0, '-49.566')] [2022-07-13 00:57:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4706.9). Total num frames: 102181888. Throughput: 0: 9461.6. Samples: 204364336. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:23,989][27935] Avg episode reward: [(0, '-49.346')] [2022-07-13 00:57:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4713.9). Total num frames: 102206464. Throughput: 0: 9442.8. Samples: 204421348. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:28,989][27935] Avg episode reward: [(0, '-49.420')] [2022-07-13 00:57:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 102228992. Throughput: 0: 9423.8. Samples: 204478296. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:33,989][27935] Avg episode reward: [(0, '-49.452')] [2022-07-13 00:57:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 102254592. Throughput: 0: 9412.2. Samples: 204506632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:38,989][27935] Avg episode reward: [(0, '-49.522')] [2022-07-13 00:57:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 102275072. Throughput: 0: 9399.2. Samples: 204563192. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:43,989][27935] Avg episode reward: [(0, '-49.504')] [2022-07-13 00:57:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 102300672. Throughput: 0: 9469.8. Samples: 204619740. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:48,989][27935] Avg episode reward: [(0, '-50.118')] [2022-07-13 00:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4717.3). Total num frames: 102324224. Throughput: 0: 9468.8. Samples: 204647776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 00:57:53,989][27935] Avg episode reward: [(0, '-49.960')] [2022-07-13 00:57:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 102347776. Throughput: 0: 9460.4. Samples: 204704232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:57:58,989][27935] Avg episode reward: [(0, '-49.313')] [2022-07-13 00:58:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4724.3). Total num frames: 102370304. Throughput: 0: 9371.9. Samples: 204757040. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:03,989][27935] Avg episode reward: [(0, '-49.206')] [2022-07-13 00:58:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4693.3, 300 sec: 4717.3). Total num frames: 102391808. Throughput: 0: 9346.7. Samples: 204784940. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:08,989][27935] Avg episode reward: [(0, '-49.216')] [2022-07-13 00:58:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4717.3). Total num frames: 102414336. Throughput: 0: 9332.8. Samples: 204841324. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:13,989][27935] Avg episode reward: [(0, '-49.237')] [2022-07-13 00:58:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4720.8). Total num frames: 102438912. Throughput: 0: 9310.7. Samples: 204897276. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:18,989][27935] Avg episode reward: [(0, '-49.219')] [2022-07-13 00:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4724.3). Total num frames: 102462464. Throughput: 0: 9298.0. Samples: 204925040. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:23,989][27935] Avg episode reward: [(0, '-49.137')] [2022-07-13 00:58:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4724.3). Total num frames: 102486016. Throughput: 0: 9292.4. Samples: 204981348. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:28,989][27935] Avg episode reward: [(0, '-49.068')] [2022-07-13 00:58:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4724.3). Total num frames: 102509568. Throughput: 0: 9279.0. Samples: 205037296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:33,989][27935] Avg episode reward: [(0, '-49.328')] [2022-07-13 00:58:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4717.3). Total num frames: 102531072. Throughput: 0: 9286.0. Samples: 205065648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:38,989][27935] Avg episode reward: [(0, '-49.729')] [2022-07-13 00:58:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4731.2). Total num frames: 102556672. Throughput: 0: 9305.4. Samples: 205122976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:43,989][27935] Avg episode reward: [(0, '-50.346')] [2022-07-13 00:58:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4659.2, 300 sec: 4727.8). Total num frames: 102580224. Throughput: 0: 9385.9. Samples: 205179404. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:48,989][27935] Avg episode reward: [(0, '-49.703')] [2022-07-13 00:58:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4727.8). Total num frames: 102603776. Throughput: 0: 9383.5. Samples: 205207196. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:53,989][27935] Avg episode reward: [(0, '-50.072')] [2022-07-13 00:58:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4734.7). Total num frames: 102628352. Throughput: 0: 9395.5. Samples: 205264120. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:58:58,989][27935] Avg episode reward: [(0, '-49.898')] [2022-07-13 00:59:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4727.8). Total num frames: 102648832. Throughput: 0: 9330.9. Samples: 205317168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:03,989][27935] Avg episode reward: [(0, '-51.258')] [2022-07-13 00:59:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4724.3). Total num frames: 102672384. Throughput: 0: 9343.2. Samples: 205345484. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:08,989][27935] Avg episode reward: [(0, '-50.836')] [2022-07-13 00:59:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 102696960. Throughput: 0: 9371.1. Samples: 205403048. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:13,990][27935] Avg episode reward: [(0, '-50.270')] [2022-07-13 00:59:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4727.8). Total num frames: 102720512. Throughput: 0: 9401.8. Samples: 205460376. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:18,989][27935] Avg episode reward: [(0, '-50.112')] [2022-07-13 00:59:23,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4693.3, 300 sec: 4727.8). Total num frames: 102744064. Throughput: 0: 9409.0. Samples: 205489052. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:23,995][27935] Avg episode reward: [(0, '-50.943')] [2022-07-13 00:59:28,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4693.3, 300 sec: 4720.8). Total num frames: 102767616. Throughput: 0: 9406.0. Samples: 205546244. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:28,989][27935] Avg episode reward: [(0, '-50.135')] [2022-07-13 00:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 102792192. Throughput: 0: 9425.7. Samples: 205603560. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:33,989][27935] Avg episode reward: [(0, '-50.186')] [2022-07-13 00:59:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 102815744. Throughput: 0: 9444.8. Samples: 205632212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:38,989][27935] Avg episode reward: [(0, '-50.002')] [2022-07-13 00:59:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4731.2). Total num frames: 102840320. Throughput: 0: 9448.2. Samples: 205689288. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:43,989][27935] Avg episode reward: [(0, '-50.566')] [2022-07-13 00:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 102863872. Throughput: 0: 9541.8. Samples: 205746548. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:48,989][27935] Avg episode reward: [(0, '-50.478')] [2022-07-13 00:59:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4720.8). Total num frames: 102886400. Throughput: 0: 9546.7. Samples: 205775084. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 00:59:53,990][27935] Avg episode reward: [(0, '-49.705')] [2022-07-13 00:59:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4731.3). Total num frames: 102910976. Throughput: 0: 9546.1. Samples: 205832620. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 00:59:58,991][27935] Avg episode reward: [(0, '-49.961')] [2022-07-13 01:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 102933504. Throughput: 0: 9469.9. Samples: 205886520. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:03,989][27935] Avg episode reward: [(0, '-50.703')] [2022-07-13 01:00:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 102958080. Throughput: 0: 9475.4. Samples: 205915444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:08,989][27935] Avg episode reward: [(0, '-50.893')] [2022-07-13 01:00:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 102981632. Throughput: 0: 9484.5. Samples: 205973048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:13,990][27935] Avg episode reward: [(0, '-50.649')] [2022-07-13 01:00:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 103005184. Throughput: 0: 9498.7. Samples: 206031000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:18,989][27935] Avg episode reward: [(0, '-50.665')] [2022-07-13 01:00:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4778.7, 300 sec: 4727.8). Total num frames: 103030784. Throughput: 0: 9502.4. Samples: 206059820. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:23,989][27935] Avg episode reward: [(0, '-50.541')] [2022-07-13 01:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 103053312. Throughput: 0: 9499.0. Samples: 206116744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:28,989][27935] Avg episode reward: [(0, '-50.874')] [2022-07-13 01:00:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4727.8). Total num frames: 103077888. Throughput: 0: 9503.6. Samples: 206174212. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:33,989][27935] Avg episode reward: [(0, '-50.790')] [2022-07-13 01:00:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4727.8). Total num frames: 103102464. Throughput: 0: 9510.8. Samples: 206203072. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:38,990][27935] Avg episode reward: [(0, '-50.846')] [2022-07-13 01:00:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 103123968. Throughput: 0: 9518.0. Samples: 206260928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:43,989][27935] Avg episode reward: [(0, '-50.728')] [2022-07-13 01:00:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 103148544. Throughput: 0: 9592.1. Samples: 206318164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:48,990][27935] Avg episode reward: [(0, '-49.985')] [2022-07-13 01:00:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4724.3). Total num frames: 103173120. Throughput: 0: 9589.0. Samples: 206346948. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:53,989][27935] Avg episode reward: [(0, '-50.394')] [2022-07-13 01:00:58,990][27935] Fps is (10 sec: 4812.4, 60 sec: 4761.5, 300 sec: 4731.2). Total num frames: 103196672. Throughput: 0: 9582.9. Samples: 206404284. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:00:58,992][27935] Avg episode reward: [(0, '-49.869')] [2022-07-13 01:01:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 103219200. Throughput: 0: 9477.4. Samples: 206457484. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:03,991][27935] Avg episode reward: [(0, '-50.020')] [2022-07-13 01:01:08,989][27935] Fps is (10 sec: 4608.3, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 103242752. Throughput: 0: 9478.5. Samples: 206486352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:08,991][27935] Avg episode reward: [(0, '-50.387')] [2022-07-13 01:01:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4727.8). Total num frames: 103267328. Throughput: 0: 9487.5. Samples: 206543680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:13,989][27935] Avg episode reward: [(0, '-50.203')] [2022-07-13 01:01:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 103290880. Throughput: 0: 9493.0. Samples: 206601396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:18,991][27935] Avg episode reward: [(0, '-50.175')] [2022-07-13 01:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4727.8). Total num frames: 103315456. Throughput: 0: 9486.0. Samples: 206629944. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:23,989][27935] Avg episode reward: [(0, '-50.298')] [2022-07-13 01:01:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4731.2). Total num frames: 103340032. Throughput: 0: 9488.9. Samples: 206687928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:28,989][27935] Avg episode reward: [(0, '-50.599')] [2022-07-13 01:01:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 103362560. Throughput: 0: 9490.5. Samples: 206745236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:33,991][27935] Avg episode reward: [(0, '-51.208')] [2022-07-13 01:01:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 103387136. Throughput: 0: 9490.6. Samples: 206774024. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:38,989][27935] Avg episode reward: [(0, '-51.007')] [2022-07-13 01:01:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4724.3). Total num frames: 103410688. Throughput: 0: 9498.4. Samples: 206831704. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:43,991][27935] Avg episode reward: [(0, '-50.320')] [2022-07-13 01:01:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 103434240. Throughput: 0: 9603.4. Samples: 206889636. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:48,989][27935] Avg episode reward: [(0, '-49.787')] [2022-07-13 01:01:53,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4761.5, 300 sec: 4727.7). Total num frames: 103458816. Throughput: 0: 9592.5. Samples: 206918024. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 01:01:53,991][27935] Avg episode reward: [(0, '-49.594')] [2022-07-13 01:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.7, 300 sec: 4731.2). Total num frames: 103482368. Throughput: 0: 9560.0. Samples: 206973880. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:01:58,989][27935] Avg episode reward: [(0, '-49.310')] [2022-07-13 01:02:03,989][27935] Fps is (10 sec: 4608.6, 60 sec: 4761.6, 300 sec: 4727.8). Total num frames: 103504896. Throughput: 0: 8917.4. Samples: 207002680. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:03,989][27935] Avg episode reward: [(0, '-48.921')] [2022-07-13 01:02:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 103528448. Throughput: 0: 9484.2. Samples: 207056732. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:08,989][27935] Avg episode reward: [(0, '-48.583')] [2022-07-13 01:02:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4724.3). Total num frames: 103550976. Throughput: 0: 9477.3. Samples: 207114408. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:13,989][27935] Avg episode reward: [(0, '-49.506')] [2022-07-13 01:02:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4727.8). Total num frames: 103576576. Throughput: 0: 9479.3. Samples: 207171804. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:18,989][27935] Avg episode reward: [(0, '-49.135')] [2022-07-13 01:02:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4727.8). Total num frames: 103601152. Throughput: 0: 9485.4. Samples: 207200868. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:23,989][27935] Avg episode reward: [(0, '-49.895')] [2022-07-13 01:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 103624704. Throughput: 0: 9498.4. Samples: 207259132. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:28,989][27935] Avg episode reward: [(0, '-50.229')] [2022-07-13 01:02:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 103648256. Throughput: 0: 9486.3. Samples: 207316520. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:33,990][27935] Avg episode reward: [(0, '-49.935')] [2022-07-13 01:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4738.2). Total num frames: 103672832. Throughput: 0: 9500.2. Samples: 207345520. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:38,989][27935] Avg episode reward: [(0, '-50.529')] [2022-07-13 01:02:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4731.2). Total num frames: 103696384. Throughput: 0: 9535.1. Samples: 207402960. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:43,991][27935] Avg episode reward: [(0, '-49.426')] [2022-07-13 01:02:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4734.7). Total num frames: 103720960. Throughput: 0: 10192.9. Samples: 207461360. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:48,989][27935] Avg episode reward: [(0, '-48.902')] [2022-07-13 01:02:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.8, 300 sec: 4738.2). Total num frames: 103745536. Throughput: 0: 9640.8. Samples: 207490568. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:53,989][27935] Avg episode reward: [(0, '-49.147')] [2022-07-13 01:02:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 103770112. Throughput: 0: 9646.0. Samples: 207548480. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:02:58,989][27935] Avg episode reward: [(0, '-49.721')] [2022-07-13 01:03:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 103791616. Throughput: 0: 9562.8. Samples: 207602132. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:03,989][27935] Avg episode reward: [(0, '-49.130')] [2022-07-13 01:03:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 103815168. Throughput: 0: 9558.2. Samples: 207630988. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:08,990][27935] Avg episode reward: [(0, '-49.457')] [2022-07-13 01:03:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4748.6). Total num frames: 103839744. Throughput: 0: 9542.1. Samples: 207688528. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:13,990][27935] Avg episode reward: [(0, '-49.507')] [2022-07-13 01:03:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4745.1). Total num frames: 103862272. Throughput: 0: 9545.0. Samples: 207746044. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:18,989][27935] Avg episode reward: [(0, '-50.186')] [2022-07-13 01:03:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 103887872. Throughput: 0: 9547.2. Samples: 207775144. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:23,989][27935] Avg episode reward: [(0, '-50.621')] [2022-07-13 01:03:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 103911424. Throughput: 0: 9547.1. Samples: 207832580. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:28,992][27935] Avg episode reward: [(0, '-50.052')] [2022-07-13 01:03:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 103934976. Throughput: 0: 9541.9. Samples: 207890744. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:33,989][27935] Avg episode reward: [(0, '-49.476')] [2022-07-13 01:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 103960576. Throughput: 0: 9540.3. Samples: 207919884. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:38,989][27935] Avg episode reward: [(0, '-49.919')] [2022-07-13 01:03:43,990][27935] Fps is (10 sec: 4914.4, 60 sec: 4795.6, 300 sec: 4759.0). Total num frames: 103984128. Throughput: 0: 9554.2. Samples: 207978432. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:43,991][27935] Avg episode reward: [(0, '-49.893')] [2022-07-13 01:03:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 104008704. Throughput: 0: 9637.2. Samples: 208035804. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:48,991][27935] Avg episode reward: [(0, '-49.968')] [2022-07-13 01:03:53,991][27935] Fps is (10 sec: 4812.7, 60 sec: 4778.5, 300 sec: 4759.0). Total num frames: 104032256. Throughput: 0: 9638.8. Samples: 208064752. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 01:03:53,992][27935] Avg episode reward: [(0, '-48.805')] [2022-07-13 01:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 104056832. Throughput: 0: 9656.2. Samples: 208123056. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:03:58,990][27935] Avg episode reward: [(0, '-49.069')] [2022-07-13 01:04:03,989][27935] Fps is (10 sec: 4608.9, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 104078336. Throughput: 0: 9582.5. Samples: 208177256. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:03,990][27935] Avg episode reward: [(0, '-48.425')] [2022-07-13 01:04:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4765.9). Total num frames: 104102912. Throughput: 0: 9574.6. Samples: 208206000. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:08,989][27935] Avg episode reward: [(0, '-48.646')] [2022-07-13 01:04:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 104126464. Throughput: 0: 9577.4. Samples: 208263564. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:13,989][27935] Avg episode reward: [(0, '-48.790')] [2022-07-13 01:04:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 104151040. Throughput: 0: 9560.3. Samples: 208320956. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:18,989][27935] Avg episode reward: [(0, '-49.103')] [2022-07-13 01:04:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 104174592. Throughput: 0: 9551.5. Samples: 208349704. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:23,989][27935] Avg episode reward: [(0, '-48.947')] [2022-07-13 01:04:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4769.4). Total num frames: 104199168. Throughput: 0: 9536.9. Samples: 208407576. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:28,991][27935] Avg episode reward: [(0, '-48.571')] [2022-07-13 01:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4772.9). Total num frames: 104223744. Throughput: 0: 9546.7. Samples: 208465404. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:33,992][27935] Avg episode reward: [(0, '-48.347')] [2022-07-13 01:04:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 104247296. Throughput: 0: 9539.1. Samples: 208493996. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:38,989][27935] Avg episode reward: [(0, '-48.336')] [2022-07-13 01:04:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.8, 300 sec: 4769.4). Total num frames: 104270848. Throughput: 0: 9532.3. Samples: 208552008. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:43,989][27935] Avg episode reward: [(0, '-48.706')] [2022-07-13 01:04:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4769.4). Total num frames: 104293376. Throughput: 0: 9612.2. Samples: 208609804. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:48,990][27935] Avg episode reward: [(0, '-48.825')] [2022-07-13 01:04:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.7, 300 sec: 4769.4). Total num frames: 104317952. Throughput: 0: 9605.9. Samples: 208638264. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:53,989][27935] Avg episode reward: [(0, '-49.360')] [2022-07-13 01:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 104344576. Throughput: 0: 9609.5. Samples: 208695992. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:04:58,989][27935] Avg episode reward: [(0, '-50.333')] [2022-07-13 01:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 104365056. Throughput: 0: 9544.4. Samples: 208750452. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:03,989][27935] Avg episode reward: [(0, '-50.772')] [2022-07-13 01:05:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 104389632. Throughput: 0: 9552.8. Samples: 208779580. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:08,989][27935] Avg episode reward: [(0, '-51.677')] [2022-07-13 01:05:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 104414208. Throughput: 0: 9558.0. Samples: 208837688. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:13,991][27935] Avg episode reward: [(0, '-51.764')] [2022-07-13 01:05:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 104437760. Throughput: 0: 9559.5. Samples: 208895584. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:18,989][27935] Avg episode reward: [(0, '-51.608')] [2022-07-13 01:05:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 104462336. Throughput: 0: 9569.1. Samples: 208924604. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:23,989][27935] Avg episode reward: [(0, '-51.684')] [2022-07-13 01:05:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 104487936. Throughput: 0: 9571.7. Samples: 208982736. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:28,991][27935] Avg episode reward: [(0, '-51.422')] [2022-07-13 01:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 104510464. Throughput: 0: 9564.2. Samples: 209040192. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:33,990][27935] Avg episode reward: [(0, '-50.867')] [2022-07-13 01:05:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 104535040. Throughput: 0: 9574.9. Samples: 209069136. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:38,990][27935] Avg episode reward: [(0, '-51.133')] [2022-07-13 01:05:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 104557568. Throughput: 0: 9580.4. Samples: 209127108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:43,989][27935] Avg episode reward: [(0, '-51.185')] [2022-07-13 01:05:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4779.8). Total num frames: 104583168. Throughput: 0: 9650.1. Samples: 209184708. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:48,989][27935] Avg episode reward: [(0, '-51.259')] [2022-07-13 01:05:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 104607744. Throughput: 0: 9650.8. Samples: 209213864. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 01:05:53,989][27935] Avg episode reward: [(0, '-51.122')] [2022-07-13 01:05:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 104631296. Throughput: 0: 9655.4. Samples: 209272180. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:05:58,990][27935] Avg episode reward: [(0, '-50.695')] [2022-07-13 01:06:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 104653824. Throughput: 0: 9577.3. Samples: 209326564. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:03,989][27935] Avg episode reward: [(0, '-51.458')] [2022-07-13 01:06:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 104678400. Throughput: 0: 9573.3. Samples: 209355404. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:08,989][27935] Avg episode reward: [(0, '-51.150')] [2022-07-13 01:06:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 104700928. Throughput: 0: 9573.5. Samples: 209413544. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:13,989][27935] Avg episode reward: [(0, '-51.158')] [2022-07-13 01:06:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 104726528. Throughput: 0: 9579.7. Samples: 209471280. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:18,989][27935] Avg episode reward: [(0, '-51.164')] [2022-07-13 01:06:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 104750080. Throughput: 0: 9579.8. Samples: 209500228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:23,989][27935] Avg episode reward: [(0, '-50.903')] [2022-07-13 01:06:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 104774656. Throughput: 0: 9586.1. Samples: 209558484. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:28,989][27935] Avg episode reward: [(0, '-50.315')] [2022-07-13 01:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 104798208. Throughput: 0: 9592.7. Samples: 209616380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:33,989][27935] Avg episode reward: [(0, '-49.007')] [2022-07-13 01:06:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 104822784. Throughput: 0: 9582.6. Samples: 209645080. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:38,991][27935] Avg episode reward: [(0, '-47.535')] [2022-07-13 01:06:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 104846336. Throughput: 0: 9586.1. Samples: 209703556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:43,989][27935] Avg episode reward: [(0, '-47.441')] [2022-07-13 01:06:48,993][27935] Fps is (10 sec: 4810.9, 60 sec: 4795.4, 300 sec: 4786.7). Total num frames: 104870912. Throughput: 0: 9667.7. Samples: 209761648. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:48,993][27935] Avg episode reward: [(0, '-47.452')] [2022-07-13 01:06:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 104894464. Throughput: 0: 9663.0. Samples: 209790240. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:53,989][27935] Avg episode reward: [(0, '-47.583')] [2022-07-13 01:06:58,989][27935] Fps is (10 sec: 4712.0, 60 sec: 4778.6, 300 sec: 4790.2). Total num frames: 104918016. Throughput: 0: 9669.9. Samples: 209848692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:06:58,990][27935] Avg episode reward: [(0, '-47.789')] [2022-07-13 01:07:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 104942592. Throughput: 0: 9583.1. Samples: 209902520. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:03,990][27935] Avg episode reward: [(0, '-48.033')] [2022-07-13 01:07:08,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 104966144. Throughput: 0: 9581.6. Samples: 209931400. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:08,989][27935] Avg episode reward: [(0, '-48.596')] [2022-07-13 01:07:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 104988672. Throughput: 0: 9581.6. Samples: 209989656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:13,989][27935] Avg episode reward: [(0, '-48.757')] [2022-07-13 01:07:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 105014272. Throughput: 0: 9593.7. Samples: 210048096. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:18,989][27935] Avg episode reward: [(0, '-49.214')] [2022-07-13 01:07:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 105038848. Throughput: 0: 9602.7. Samples: 210077200. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:23,989][27935] Avg episode reward: [(0, '-49.682')] [2022-07-13 01:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 105063424. Throughput: 0: 9603.6. Samples: 210135720. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:28,989][27935] Avg episode reward: [(0, '-49.123')] [2022-07-13 01:07:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 105088000. Throughput: 0: 9591.2. Samples: 210193216. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:33,989][27935] Avg episode reward: [(0, '-49.937')] [2022-07-13 01:07:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 105111552. Throughput: 0: 9603.4. Samples: 210222392. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:38,989][27935] Avg episode reward: [(0, '-50.658')] [2022-07-13 01:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 105135104. Throughput: 0: 9577.2. Samples: 210279664. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:43,990][27935] Avg episode reward: [(0, '-50.629')] [2022-07-13 01:07:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4779.0, 300 sec: 4786.8). Total num frames: 105157632. Throughput: 0: 9676.8. Samples: 210337976. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:48,990][27935] Avg episode reward: [(0, '-49.987')] [2022-07-13 01:07:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 105183232. Throughput: 0: 9678.0. Samples: 210366908. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 01:07:53,989][27935] Avg episode reward: [(0, '-49.259')] [2022-07-13 01:07:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 105207808. Throughput: 0: 9646.2. Samples: 210423736. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:07:58,991][27935] Avg episode reward: [(0, '-49.061')] [2022-07-13 01:08:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 105229312. Throughput: 0: 9534.1. Samples: 210477132. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:03,989][27935] Avg episode reward: [(0, '-49.094')] [2022-07-13 01:08:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105252864. Throughput: 0: 9530.9. Samples: 210506092. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:08,991][27935] Avg episode reward: [(0, '-49.045')] [2022-07-13 01:08:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 105276416. Throughput: 0: 9522.2. Samples: 210564220. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:13,989][27935] Avg episode reward: [(0, '-49.172')] [2022-07-13 01:08:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105300992. Throughput: 0: 9529.7. Samples: 210622052. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:18,989][27935] Avg episode reward: [(0, '-49.870')] [2022-07-13 01:08:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 105324544. Throughput: 0: 9526.9. Samples: 210651104. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:23,989][27935] Avg episode reward: [(0, '-50.615')] [2022-07-13 01:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 105349120. Throughput: 0: 9550.0. Samples: 210709416. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:28,989][27935] Avg episode reward: [(0, '-51.618')] [2022-07-13 01:08:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 105373696. Throughput: 0: 9545.3. Samples: 210767512. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:33,992][27935] Avg episode reward: [(0, '-51.274')] [2022-07-13 01:08:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 105398272. Throughput: 0: 9551.8. Samples: 210796740. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:38,995][27935] Avg episode reward: [(0, '-51.418')] [2022-07-13 01:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 105422848. Throughput: 0: 9586.0. Samples: 210855104. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:43,989][27935] Avg episode reward: [(0, '-51.077')] [2022-07-13 01:08:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 105446400. Throughput: 0: 9670.2. Samples: 210912292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:48,990][27935] Avg episode reward: [(0, '-50.455')] [2022-07-13 01:08:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105469952. Throughput: 0: 9665.3. Samples: 210941032. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:53,990][27935] Avg episode reward: [(0, '-49.496')] [2022-07-13 01:08:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 105493504. Throughput: 0: 9653.8. Samples: 210998640. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:08:58,991][27935] Avg episode reward: [(0, '-49.440')] [2022-07-13 01:09:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105516032. Throughput: 0: 9554.9. Samples: 211052020. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:03,991][27935] Avg episode reward: [(0, '-48.972')] [2022-07-13 01:09:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 105540608. Throughput: 0: 9538.8. Samples: 211080348. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:08,991][27935] Avg episode reward: [(0, '-48.890')] [2022-07-13 01:09:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 105563136. Throughput: 0: 9524.3. Samples: 211138008. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:13,989][27935] Avg episode reward: [(0, '-48.808')] [2022-07-13 01:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 105589760. Throughput: 0: 9531.4. Samples: 211196428. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:18,989][27935] Avg episode reward: [(0, '-49.379')] [2022-07-13 01:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 105612288. Throughput: 0: 9534.9. Samples: 211225808. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:23,989][27935] Avg episode reward: [(0, '-49.536')] [2022-07-13 01:09:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 105636864. Throughput: 0: 9523.6. Samples: 211283668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:28,991][27935] Avg episode reward: [(0, '-49.094')] [2022-07-13 01:09:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 105661440. Throughput: 0: 9532.2. Samples: 211341240. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:33,989][27935] Avg episode reward: [(0, '-49.966')] [2022-07-13 01:09:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 105684992. Throughput: 0: 9526.1. Samples: 211369708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:38,989][27935] Avg episode reward: [(0, '-49.645')] [2022-07-13 01:09:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 105708544. Throughput: 0: 9519.3. Samples: 211427008. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:43,990][27935] Avg episode reward: [(0, '-49.487')] [2022-07-13 01:09:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 105732096. Throughput: 0: 9608.5. Samples: 211484404. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:48,991][27935] Avg episode reward: [(0, '-49.151')] [2022-07-13 01:09:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 105757696. Throughput: 0: 9622.8. Samples: 211513376. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 01:09:53,990][27935] Avg episode reward: [(0, '-48.962')] [2022-07-13 01:09:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 105780224. Throughput: 0: 9629.0. Samples: 211571312. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:09:58,990][27935] Avg episode reward: [(0, '-49.365')] [2022-07-13 01:10:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105802752. Throughput: 0: 9531.3. Samples: 211625336. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:03,989][27935] Avg episode reward: [(0, '-49.651')] [2022-07-13 01:10:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 105827328. Throughput: 0: 9510.0. Samples: 211653760. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:08,989][27935] Avg episode reward: [(0, '-49.694')] [2022-07-13 01:10:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 105849856. Throughput: 0: 9501.9. Samples: 211711252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:13,989][27935] Avg episode reward: [(0, '-50.142')] [2022-07-13 01:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 105875456. Throughput: 0: 9506.0. Samples: 211769012. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:18,989][27935] Avg episode reward: [(0, '-50.355')] [2022-07-13 01:10:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 105899008. Throughput: 0: 9517.0. Samples: 211797972. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:23,989][27935] Avg episode reward: [(0, '-50.368')] [2022-07-13 01:10:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 105921536. Throughput: 0: 9521.3. Samples: 211855468. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:28,990][27935] Avg episode reward: [(0, '-50.457')] [2022-07-13 01:10:33,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 105947136. Throughput: 0: 9520.7. Samples: 211912836. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:33,990][27935] Avg episode reward: [(0, '-50.647')] [2022-07-13 01:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 105969664. Throughput: 0: 9512.1. Samples: 211941420. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:38,989][27935] Avg episode reward: [(0, '-50.729')] [2022-07-13 01:10:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 105994240. Throughput: 0: 9502.3. Samples: 211998916. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:43,991][27935] Avg episode reward: [(0, '-50.460')] [2022-07-13 01:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 106019840. Throughput: 0: 9581.0. Samples: 212056484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:48,989][27935] Avg episode reward: [(0, '-50.638')] [2022-07-13 01:10:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 106044416. Throughput: 0: 9593.3. Samples: 212085460. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:53,989][27935] Avg episode reward: [(0, '-50.964')] [2022-07-13 01:10:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 106065920. Throughput: 0: 9603.1. Samples: 212143392. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:10:58,989][27935] Avg episode reward: [(0, '-50.313')] [2022-07-13 01:11:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 106088448. Throughput: 0: 9508.4. Samples: 212196892. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:03,989][27935] Avg episode reward: [(0, '-50.084')] [2022-07-13 01:11:08,995][27935] Fps is (10 sec: 4707.4, 60 sec: 4761.1, 300 sec: 4786.7). Total num frames: 106113024. Throughput: 0: 9502.1. Samples: 212225628. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:09,006][27935] Avg episode reward: [(0, '-49.626')] [2022-07-13 01:11:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 106136576. Throughput: 0: 9506.0. Samples: 212283236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:13,990][27935] Avg episode reward: [(0, '-48.647')] [2022-07-13 01:11:18,989][27935] Fps is (10 sec: 4713.4, 60 sec: 4744.5, 300 sec: 4779.8). Total num frames: 106160128. Throughput: 0: 9504.0. Samples: 212340516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:18,989][27935] Avg episode reward: [(0, '-49.237')] [2022-07-13 01:11:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 106185728. Throughput: 0: 9516.9. Samples: 212369680. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:23,989][27935] Avg episode reward: [(0, '-49.438')] [2022-07-13 01:11:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 106208256. Throughput: 0: 9538.2. Samples: 212428136. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:28,989][27935] Avg episode reward: [(0, '-49.650')] [2022-07-13 01:11:33,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4778.6, 300 sec: 4783.3). Total num frames: 106233856. Throughput: 0: 9541.8. Samples: 212485868. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:33,990][27935] Avg episode reward: [(0, '-50.015')] [2022-07-13 01:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 106256384. Throughput: 0: 9543.9. Samples: 212514936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:38,989][27935] Avg episode reward: [(0, '-50.086')] [2022-07-13 01:11:43,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4795.7, 300 sec: 4783.4). Total num frames: 106281984. Throughput: 0: 9536.0. Samples: 212572512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:43,989][27935] Avg episode reward: [(0, '-49.825')] [2022-07-13 01:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 106305536. Throughput: 0: 9632.4. Samples: 212630352. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:48,989][27935] Avg episode reward: [(0, '-49.451')] [2022-07-13 01:11:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 106330112. Throughput: 0: 9642.0. Samples: 212659456. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:53,989][27935] Avg episode reward: [(0, '-49.681')] [2022-07-13 01:11:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 106353664. Throughput: 0: 9639.3. Samples: 212717004. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 01:11:58,990][27935] Avg episode reward: [(0, '-49.237')] [2022-07-13 01:12:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 106374144. Throughput: 0: 9572.1. Samples: 212771260. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:03,991][27935] Avg episode reward: [(0, '-49.325')] [2022-07-13 01:12:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4796.3, 300 sec: 4786.8). Total num frames: 106400768. Throughput: 0: 9562.0. Samples: 212799972. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:08,989][27935] Avg episode reward: [(0, '-48.996')] [2022-07-13 01:12:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 106423296. Throughput: 0: 9531.0. Samples: 212857032. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:13,989][27935] Avg episode reward: [(0, '-49.658')] [2022-07-13 01:12:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 106447872. Throughput: 0: 9530.5. Samples: 212914740. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:18,991][27935] Avg episode reward: [(0, '-49.939')] [2022-07-13 01:12:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 106472448. Throughput: 0: 9525.2. Samples: 212943568. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:23,989][27935] Avg episode reward: [(0, '-50.185')] [2022-07-13 01:12:28,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4795.5, 300 sec: 4772.8). Total num frames: 106496000. Throughput: 0: 9529.8. Samples: 213001376. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:28,992][27935] Avg episode reward: [(0, '-50.288')] [2022-07-13 01:12:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 106519552. Throughput: 0: 9517.5. Samples: 213058640. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:33,989][27935] Avg episode reward: [(0, '-50.830')] [2022-07-13 01:12:38,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 106544128. Throughput: 0: 9517.1. Samples: 213087724. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:38,989][27935] Avg episode reward: [(0, '-51.333')] [2022-07-13 01:12:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 106568704. Throughput: 0: 9512.7. Samples: 213145076. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:43,989][27935] Avg episode reward: [(0, '-52.151')] [2022-07-13 01:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 106592256. Throughput: 0: 9585.3. Samples: 213202600. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:48,989][27935] Avg episode reward: [(0, '-52.204')] [2022-07-13 01:12:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 106615808. Throughput: 0: 9594.3. Samples: 213231716. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:53,989][27935] Avg episode reward: [(0, '-51.902')] [2022-07-13 01:12:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 106639360. Throughput: 0: 9627.6. Samples: 213290272. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:12:58,989][27935] Avg episode reward: [(0, '-51.951')] [2022-07-13 01:13:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 106662912. Throughput: 0: 9557.1. Samples: 213344808. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:03,989][27935] Avg episode reward: [(0, '-51.260')] [2022-07-13 01:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 106687488. Throughput: 0: 9562.1. Samples: 213373864. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:08,989][27935] Avg episode reward: [(0, '-51.843')] [2022-07-13 01:13:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 106711040. Throughput: 0: 9572.0. Samples: 213432092. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:13,989][27935] Avg episode reward: [(0, '-51.155')] [2022-07-13 01:13:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 106734592. Throughput: 0: 9582.8. Samples: 213489868. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:18,989][27935] Avg episode reward: [(0, '-51.028')] [2022-07-13 01:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 106759168. Throughput: 0: 9588.6. Samples: 213519212. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:23,989][27935] Avg episode reward: [(0, '-51.426')] [2022-07-13 01:13:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.9, 300 sec: 4779.8). Total num frames: 106783744. Throughput: 0: 9608.0. Samples: 213577436. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:28,989][27935] Avg episode reward: [(0, '-50.944')] [2022-07-13 01:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 106808320. Throughput: 0: 9617.1. Samples: 213635368. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:33,991][27935] Avg episode reward: [(0, '-51.142')] [2022-07-13 01:13:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 106831872. Throughput: 0: 9616.2. Samples: 213664444. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:38,990][27935] Avg episode reward: [(0, '-51.657')] [2022-07-13 01:13:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 106855424. Throughput: 0: 9610.3. Samples: 213722736. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:43,989][27935] Avg episode reward: [(0, '-52.236')] [2022-07-13 01:13:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 106881024. Throughput: 0: 9683.3. Samples: 213780556. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:48,989][27935] Avg episode reward: [(0, '-52.180')] [2022-07-13 01:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 106904576. Throughput: 0: 9687.1. Samples: 213809784. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:53,989][27935] Avg episode reward: [(0, '-51.761')] [2022-07-13 01:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4793.7). Total num frames: 106930176. Throughput: 0: 9702.1. Samples: 213868688. Policy #0 lag: (min: 0.0, avg: 7.6, max: 18.0) [2022-07-13 01:13:58,989][27935] Avg episode reward: [(0, '-50.623')] [2022-07-13 01:14:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 106951680. Throughput: 0: 9598.4. Samples: 213921796. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:03,989][27935] Avg episode reward: [(0, '-51.287')] [2022-07-13 01:14:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 106974208. Throughput: 0: 9577.6. Samples: 213950204. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:08,989][27935] Avg episode reward: [(0, '-50.734')] [2022-07-13 01:14:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 106998784. Throughput: 0: 9567.6. Samples: 214007976. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:13,989][27935] Avg episode reward: [(0, '-49.859')] [2022-07-13 01:14:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 107022336. Throughput: 0: 9562.1. Samples: 214065664. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:18,989][27935] Avg episode reward: [(0, '-49.809')] [2022-07-13 01:14:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 107047936. Throughput: 0: 9558.1. Samples: 214094560. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:23,990][27935] Avg episode reward: [(0, '-49.333')] [2022-07-13 01:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 107071488. Throughput: 0: 9564.0. Samples: 214153116. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:28,990][27935] Avg episode reward: [(0, '-49.702')] [2022-07-13 01:14:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 107096064. Throughput: 0: 9556.3. Samples: 214210588. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:33,989][27935] Avg episode reward: [(0, '-50.000')] [2022-07-13 01:14:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 107119616. Throughput: 0: 9556.0. Samples: 214239804. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:38,989][27935] Avg episode reward: [(0, '-49.772')] [2022-07-13 01:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 107145216. Throughput: 0: 9529.8. Samples: 214297528. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:43,989][27935] Avg episode reward: [(0, '-50.432')] [2022-07-13 01:14:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 107168768. Throughput: 0: 9632.1. Samples: 214355240. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:48,989][27935] Avg episode reward: [(0, '-50.417')] [2022-07-13 01:14:53,990][27935] Fps is (10 sec: 4709.9, 60 sec: 4795.6, 300 sec: 4786.7). Total num frames: 107192320. Throughput: 0: 9643.6. Samples: 214384176. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:53,990][27935] Avg episode reward: [(0, '-51.376')] [2022-07-13 01:14:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 107214848. Throughput: 0: 9646.0. Samples: 214442044. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:14:58,989][27935] Avg episode reward: [(0, '-51.157')] [2022-07-13 01:15:03,989][27935] Fps is (10 sec: 4506.1, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 107237376. Throughput: 0: 9008.0. Samples: 214471024. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:03,989][27935] Avg episode reward: [(0, '-51.277')] [2022-07-13 01:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 107262976. Throughput: 0: 9565.3. Samples: 214525000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:08,989][27935] Avg episode reward: [(0, '-50.998')] [2022-07-13 01:15:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 107286528. Throughput: 0: 9541.1. Samples: 214582468. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:13,989][27935] Avg episode reward: [(0, '-51.235')] [2022-07-13 01:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 107311104. Throughput: 0: 8895.1. Samples: 214610868. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:18,989][27935] Avg episode reward: [(0, '-51.139')] [2022-07-13 01:15:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 107332608. Throughput: 0: 9522.9. Samples: 214668336. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:23,990][27935] Avg episode reward: [(0, '-51.652')] [2022-07-13 01:15:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 107358208. Throughput: 0: 9539.1. Samples: 214726788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:28,989][27935] Avg episode reward: [(0, '-51.374')] [2022-07-13 01:15:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 107382784. Throughput: 0: 8890.2. Samples: 214755300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:33,990][27935] Avg episode reward: [(0, '-51.302')] [2022-07-13 01:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 107407360. Throughput: 0: 9523.8. Samples: 214812736. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:38,989][27935] Avg episode reward: [(0, '-51.442')] [2022-07-13 01:15:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4779.8). Total num frames: 107429888. Throughput: 0: 9535.4. Samples: 214871136. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:43,989][27935] Avg episode reward: [(0, '-50.706')] [2022-07-13 01:15:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 107454464. Throughput: 0: 10174.5. Samples: 214928876. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:48,989][27935] Avg episode reward: [(0, '-50.749')] [2022-07-13 01:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.7, 300 sec: 4786.8). Total num frames: 107478016. Throughput: 0: 9617.1. Samples: 214957768. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:53,990][27935] Avg episode reward: [(0, '-50.615')] [2022-07-13 01:15:58,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 107502592. Throughput: 0: 9620.0. Samples: 215015368. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 01:15:58,991][27935] Avg episode reward: [(0, '-50.383')] [2022-07-13 01:16:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.3). Total num frames: 107526144. Throughput: 0: 10176.9. Samples: 215068828. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:03,989][27935] Avg episode reward: [(0, '-50.431')] [2022-07-13 01:16:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 107548672. Throughput: 0: 9552.2. Samples: 215098184. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:08,989][27935] Avg episode reward: [(0, '-50.480')] [2022-07-13 01:16:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 107573248. Throughput: 0: 9535.1. Samples: 215155868. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:13,990][27935] Avg episode reward: [(0, '-50.328')] [2022-07-13 01:16:18,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107597824. Throughput: 0: 9530.1. Samples: 215184156. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:18,990][27935] Avg episode reward: [(0, '-50.283')] [2022-07-13 01:16:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 107619328. Throughput: 0: 9530.8. Samples: 215241620. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:23,989][27935] Avg episode reward: [(0, '-50.239')] [2022-07-13 01:16:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 107645952. Throughput: 0: 9524.0. Samples: 215299716. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:28,989][27935] Avg episode reward: [(0, '-50.993')] [2022-07-13 01:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 107667456. Throughput: 0: 9521.6. Samples: 215357348. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:33,989][27935] Avg episode reward: [(0, '-50.303')] [2022-07-13 01:16:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107694080. Throughput: 0: 9518.2. Samples: 215386088. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:38,991][27935] Avg episode reward: [(0, '-50.196')] [2022-07-13 01:16:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 107717632. Throughput: 0: 9533.1. Samples: 215444356. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:43,991][27935] Avg episode reward: [(0, '-50.273')] [2022-07-13 01:16:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 107740160. Throughput: 0: 9641.2. Samples: 215502684. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:48,989][27935] Avg episode reward: [(0, '-51.230')] [2022-07-13 01:16:53,992][27935] Fps is (10 sec: 4709.1, 60 sec: 4778.4, 300 sec: 4783.2). Total num frames: 107764736. Throughput: 0: 9628.3. Samples: 215531484. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:53,992][27935] Avg episode reward: [(0, '-51.607')] [2022-07-13 01:16:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 107789312. Throughput: 0: 9632.7. Samples: 215589340. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:16:58,989][27935] Avg episode reward: [(0, '-51.434')] [2022-07-13 01:17:03,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107812864. Throughput: 0: 10213.0. Samples: 215643740. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:03,990][27935] Avg episode reward: [(0, '-50.693')] [2022-07-13 01:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107835392. Throughput: 0: 9585.3. Samples: 215672960. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:08,989][27935] Avg episode reward: [(0, '-50.586')] [2022-07-13 01:17:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 107862016. Throughput: 0: 9581.4. Samples: 215730880. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:13,989][27935] Avg episode reward: [(0, '-50.643')] [2022-07-13 01:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107884544. Throughput: 0: 9580.6. Samples: 215788476. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:18,989][27935] Avg episode reward: [(0, '-50.849')] [2022-07-13 01:17:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4790.3). Total num frames: 107909120. Throughput: 0: 9588.2. Samples: 215817556. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:23,989][27935] Avg episode reward: [(0, '-49.976')] [2022-07-13 01:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 107933696. Throughput: 0: 9591.5. Samples: 215875972. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:28,989][27935] Avg episode reward: [(0, '-49.571')] [2022-07-13 01:17:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 107957248. Throughput: 0: 8942.3. Samples: 215905088. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:33,989][27935] Avg episode reward: [(0, '-50.292')] [2022-07-13 01:17:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 107980800. Throughput: 0: 9597.0. Samples: 215963320. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:38,989][27935] Avg episode reward: [(0, '-50.539')] [2022-07-13 01:17:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 108003328. Throughput: 0: 9575.1. Samples: 216020220. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:43,989][27935] Avg episode reward: [(0, '-50.966')] [2022-07-13 01:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 108029952. Throughput: 0: 9636.2. Samples: 216077368. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:48,989][27935] Avg episode reward: [(0, '-50.851')] [2022-07-13 01:17:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4813.0, 300 sec: 4793.7). Total num frames: 108053504. Throughput: 0: 9631.7. Samples: 216106388. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:53,990][27935] Avg episode reward: [(0, '-50.462')] [2022-07-13 01:17:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 108078080. Throughput: 0: 9630.9. Samples: 216164268. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 01:17:58,989][27935] Avg episode reward: [(0, '-50.165')] [2022-07-13 01:18:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108099584. Throughput: 0: 9551.1. Samples: 216218276. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:03,989][27935] Avg episode reward: [(0, '-49.443')] [2022-07-13 01:18:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 108123136. Throughput: 0: 9549.0. Samples: 216247260. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:08,989][27935] Avg episode reward: [(0, '-49.617')] [2022-07-13 01:18:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 108146688. Throughput: 0: 9543.0. Samples: 216305408. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:13,991][27935] Avg episode reward: [(0, '-49.411')] [2022-07-13 01:18:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 108172288. Throughput: 0: 10175.7. Samples: 216362992. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:18,989][27935] Avg episode reward: [(0, '-49.998')] [2022-07-13 01:18:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108195840. Throughput: 0: 9528.2. Samples: 216392088. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:23,991][27935] Avg episode reward: [(0, '-50.461')] [2022-07-13 01:18:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108220416. Throughput: 0: 9559.8. Samples: 216450412. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:28,990][27935] Avg episode reward: [(0, '-52.346')] [2022-07-13 01:18:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108243968. Throughput: 0: 9561.6. Samples: 216507640. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:33,989][27935] Avg episode reward: [(0, '-52.837')] [2022-07-13 01:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108267520. Throughput: 0: 9557.1. Samples: 216536456. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:38,991][27935] Avg episode reward: [(0, '-52.700')] [2022-07-13 01:18:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 108292096. Throughput: 0: 9561.9. Samples: 216594552. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:43,989][27935] Avg episode reward: [(0, '-52.769')] [2022-07-13 01:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108316672. Throughput: 0: 9639.8. Samples: 216652068. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:48,990][27935] Avg episode reward: [(0, '-52.029')] [2022-07-13 01:18:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 108340224. Throughput: 0: 9637.7. Samples: 216680956. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:53,989][27935] Avg episode reward: [(0, '-51.932')] [2022-07-13 01:18:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 108364800. Throughput: 0: 9635.7. Samples: 216739016. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:18:58,989][27935] Avg episode reward: [(0, '-51.396')] [2022-07-13 01:19:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 108387328. Throughput: 0: 9553.1. Samples: 216792880. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:03,989][27935] Avg episode reward: [(0, '-50.359')] [2022-07-13 01:19:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 108410880. Throughput: 0: 9541.8. Samples: 216821468. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:08,989][27935] Avg episode reward: [(0, '-49.852')] [2022-07-13 01:19:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 108435456. Throughput: 0: 9532.1. Samples: 216879356. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:13,989][27935] Avg episode reward: [(0, '-50.898')] [2022-07-13 01:19:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108459008. Throughput: 0: 9538.6. Samples: 216936876. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:18,989][27935] Avg episode reward: [(0, '-50.389')] [2022-07-13 01:19:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108482560. Throughput: 0: 9542.9. Samples: 216965884. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:23,989][27935] Avg episode reward: [(0, '-50.237')] [2022-07-13 01:19:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108507136. Throughput: 0: 9533.5. Samples: 217023560. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:28,989][27935] Avg episode reward: [(0, '-50.268')] [2022-07-13 01:19:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108530688. Throughput: 0: 9539.9. Samples: 217081364. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:33,989][27935] Avg episode reward: [(0, '-50.431')] [2022-07-13 01:19:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 108554240. Throughput: 0: 9538.8. Samples: 217110200. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:38,989][27935] Avg episode reward: [(0, '-49.697')] [2022-07-13 01:19:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 108579840. Throughput: 0: 9537.7. Samples: 217168212. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:43,989][27935] Avg episode reward: [(0, '-49.525')] [2022-07-13 01:19:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108603392. Throughput: 0: 9637.4. Samples: 217226564. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:48,989][27935] Avg episode reward: [(0, '-48.870')] [2022-07-13 01:19:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 108627968. Throughput: 0: 9650.9. Samples: 217255760. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:53,989][27935] Avg episode reward: [(0, '-48.899')] [2022-07-13 01:19:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 108651520. Throughput: 0: 9661.1. Samples: 217314104. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 01:19:58,989][27935] Avg episode reward: [(0, '-49.531')] [2022-07-13 01:20:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108674048. Throughput: 0: 9584.6. Samples: 217368184. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:03,989][27935] Avg episode reward: [(0, '-49.155')] [2022-07-13 01:20:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108697600. Throughput: 0: 9558.3. Samples: 217396008. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:08,989][27935] Avg episode reward: [(0, '-49.603')] [2022-07-13 01:20:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 108720128. Throughput: 0: 9542.5. Samples: 217452972. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:13,989][27935] Avg episode reward: [(0, '-49.365')] [2022-07-13 01:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 108746752. Throughput: 0: 9541.9. Samples: 217510748. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:18,989][27935] Avg episode reward: [(0, '-49.759')] [2022-07-13 01:20:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108769280. Throughput: 0: 9548.0. Samples: 217539860. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:23,989][27935] Avg episode reward: [(0, '-49.643')] [2022-07-13 01:20:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 108793856. Throughput: 0: 9550.2. Samples: 217597972. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:28,989][27935] Avg episode reward: [(0, '-49.279')] [2022-07-13 01:20:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 108817408. Throughput: 0: 9528.0. Samples: 217655324. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:33,989][27935] Avg episode reward: [(0, '-49.722')] [2022-07-13 01:20:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 108843008. Throughput: 0: 9521.9. Samples: 217684248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:38,989][27935] Avg episode reward: [(0, '-49.500')] [2022-07-13 01:20:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 108865536. Throughput: 0: 9524.4. Samples: 217742700. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:43,989][27935] Avg episode reward: [(0, '-50.239')] [2022-07-13 01:20:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 108891136. Throughput: 0: 9614.9. Samples: 217800856. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:48,989][27935] Avg episode reward: [(0, '-50.019')] [2022-07-13 01:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 108914688. Throughput: 0: 9649.8. Samples: 217830248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:53,989][27935] Avg episode reward: [(0, '-50.228')] [2022-07-13 01:20:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 108940288. Throughput: 0: 9679.7. Samples: 217888560. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:20:58,989][27935] Avg episode reward: [(0, '-50.665')] [2022-07-13 01:21:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 108961792. Throughput: 0: 9603.6. Samples: 217942912. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:03,989][27935] Avg episode reward: [(0, '-50.568')] [2022-07-13 01:21:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 108985344. Throughput: 0: 9597.0. Samples: 217971724. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:08,990][27935] Avg episode reward: [(0, '-49.878')] [2022-07-13 01:21:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4790.2). Total num frames: 109010944. Throughput: 0: 9599.1. Samples: 218029932. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:13,989][27935] Avg episode reward: [(0, '-49.643')] [2022-07-13 01:21:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 109034496. Throughput: 0: 9614.6. Samples: 218087980. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:18,989][27935] Avg episode reward: [(0, '-49.842')] [2022-07-13 01:21:23,996][27935] Fps is (10 sec: 4604.6, 60 sec: 4795.1, 300 sec: 4783.2). Total num frames: 109057024. Throughput: 0: 9612.7. Samples: 218116892. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:23,997][27935] Avg episode reward: [(0, '-50.048')] [2022-07-13 01:21:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 109082624. Throughput: 0: 9607.6. Samples: 218175044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:28,989][27935] Avg episode reward: [(0, '-50.674')] [2022-07-13 01:21:33,989][27935] Fps is (10 sec: 5021.4, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 109107200. Throughput: 0: 9599.4. Samples: 218232828. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:33,989][27935] Avg episode reward: [(0, '-50.629')] [2022-07-13 01:21:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 109131776. Throughput: 0: 9588.8. Samples: 218261744. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:38,990][27935] Avg episode reward: [(0, '-50.210')] [2022-07-13 01:21:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 109154304. Throughput: 0: 9580.5. Samples: 218319680. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:43,990][27935] Avg episode reward: [(0, '-50.542')] [2022-07-13 01:21:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.8). Total num frames: 109178880. Throughput: 0: 9664.8. Samples: 218377828. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:48,989][27935] Avg episode reward: [(0, '-50.467')] [2022-07-13 01:21:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 109203456. Throughput: 0: 9665.5. Samples: 218406672. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:53,989][27935] Avg episode reward: [(0, '-50.684')] [2022-07-13 01:21:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 109228032. Throughput: 0: 9662.8. Samples: 218464756. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 01:21:58,989][27935] Avg episode reward: [(0, '-49.698')] [2022-07-13 01:22:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 109250560. Throughput: 0: 9583.2. Samples: 218519224. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:03,991][27935] Avg episode reward: [(0, '-49.224')] [2022-07-13 01:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 109275136. Throughput: 0: 9583.9. Samples: 218548096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:08,991][27935] Avg episode reward: [(0, '-49.422')] [2022-07-13 01:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 109298688. Throughput: 0: 9587.6. Samples: 218606488. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:13,991][27935] Avg episode reward: [(0, '-49.912')] [2022-07-13 01:22:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 109321216. Throughput: 0: 9586.7. Samples: 218664228. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:18,991][27935] Avg episode reward: [(0, '-50.050')] [2022-07-13 01:22:23,999][27935] Fps is (10 sec: 4807.9, 60 sec: 4829.6, 300 sec: 4790.1). Total num frames: 109346816. Throughput: 0: 9584.6. Samples: 218693152. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:24,000][27935] Avg episode reward: [(0, '-50.041')] [2022-07-13 01:22:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 109372416. Throughput: 0: 9589.1. Samples: 218751188. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:28,989][27935] Avg episode reward: [(0, '-49.969')] [2022-07-13 01:22:33,989][27935] Fps is (10 sec: 4817.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 109394944. Throughput: 0: 9566.5. Samples: 218808320. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:33,989][27935] Avg episode reward: [(0, '-50.566')] [2022-07-13 01:22:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 109418496. Throughput: 0: 9564.1. Samples: 218837056. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:38,989][27935] Avg episode reward: [(0, '-50.559')] [2022-07-13 01:22:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 109441024. Throughput: 0: 9524.3. Samples: 218893352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:43,989][27935] Avg episode reward: [(0, '-50.272')] [2022-07-13 01:22:48,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4778.4, 300 sec: 4786.7). Total num frames: 109465600. Throughput: 0: 9583.1. Samples: 218950492. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:48,992][27935] Avg episode reward: [(0, '-49.611')] [2022-07-13 01:22:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 109490176. Throughput: 0: 9572.5. Samples: 218978860. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:53,989][27935] Avg episode reward: [(0, '-49.097')] [2022-07-13 01:22:58,989][27935] Fps is (10 sec: 4609.4, 60 sec: 4727.5, 300 sec: 4786.8). Total num frames: 109511680. Throughput: 0: 9532.6. Samples: 219035456. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:22:58,989][27935] Avg episode reward: [(0, '-48.768')] [2022-07-13 01:23:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 4783.3). Total num frames: 109534208. Throughput: 0: 9435.9. Samples: 219088844. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:03,989][27935] Avg episode reward: [(0, '-49.625')] [2022-07-13 01:23:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4786.8). Total num frames: 109558784. Throughput: 0: 9428.6. Samples: 219117340. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:08,989][27935] Avg episode reward: [(0, '-49.338')] [2022-07-13 01:23:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4779.8). Total num frames: 109582336. Throughput: 0: 9389.1. Samples: 219173696. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:13,989][27935] Avg episode reward: [(0, '-50.092')] [2022-07-13 01:23:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 109604864. Throughput: 0: 9376.1. Samples: 219230244. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:18,991][27935] Avg episode reward: [(0, '-49.608')] [2022-07-13 01:23:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4694.1, 300 sec: 4772.9). Total num frames: 109628416. Throughput: 0: 9369.4. Samples: 219258680. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:23,989][27935] Avg episode reward: [(0, '-49.412')] [2022-07-13 01:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4779.8). Total num frames: 109654016. Throughput: 0: 9380.0. Samples: 219315452. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:28,990][27935] Avg episode reward: [(0, '-50.254')] [2022-07-13 01:23:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4772.9). Total num frames: 109675520. Throughput: 0: 9370.2. Samples: 219372120. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:33,989][27935] Avg episode reward: [(0, '-50.852')] [2022-07-13 01:23:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4772.9). Total num frames: 109700096. Throughput: 0: 9367.9. Samples: 219400416. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:38,989][27935] Avg episode reward: [(0, '-49.905')] [2022-07-13 01:23:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4769.4). Total num frames: 109723648. Throughput: 0: 9375.0. Samples: 219457332. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:43,989][27935] Avg episode reward: [(0, '-49.321')] [2022-07-13 01:23:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.6, 300 sec: 4769.4). Total num frames: 109747200. Throughput: 0: 9456.3. Samples: 219514376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:48,989][27935] Avg episode reward: [(0, '-49.206')] [2022-07-13 01:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4772.9). Total num frames: 109772800. Throughput: 0: 9461.9. Samples: 219543124. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:53,989][27935] Avg episode reward: [(0, '-49.771')] [2022-07-13 01:23:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4769.4). Total num frames: 109794304. Throughput: 0: 9475.6. Samples: 219600096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:23:58,989][27935] Avg episode reward: [(0, '-49.508')] [2022-07-13 01:24:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4693.3, 300 sec: 4762.5). Total num frames: 109815808. Throughput: 0: 9416.0. Samples: 219653964. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 01:24:03,989][27935] Avg episode reward: [(0, '-49.674')] [2022-07-13 01:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4769.4). Total num frames: 109842432. Throughput: 0: 9418.3. Samples: 219682504. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:08,989][27935] Avg episode reward: [(0, '-49.448')] [2022-07-13 01:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4765.9). Total num frames: 109864960. Throughput: 0: 9433.1. Samples: 219739940. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:13,989][27935] Avg episode reward: [(0, '-49.027')] [2022-07-13 01:24:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4765.9). Total num frames: 109888512. Throughput: 0: 9447.5. Samples: 219797256. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:18,989][27935] Avg episode reward: [(0, '-49.452')] [2022-07-13 01:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 109913088. Throughput: 0: 9450.8. Samples: 219825700. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:23,990][27935] Avg episode reward: [(0, '-49.716')] [2022-07-13 01:24:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4765.9). Total num frames: 109936640. Throughput: 0: 9443.3. Samples: 219882280. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:28,990][27935] Avg episode reward: [(0, '-49.405')] [2022-07-13 01:24:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 109960192. Throughput: 0: 9450.9. Samples: 219939668. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:33,989][27935] Avg episode reward: [(0, '-48.823')] [2022-07-13 01:24:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4762.5). Total num frames: 109984768. Throughput: 0: 9456.2. Samples: 219968652. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:38,989][27935] Avg episode reward: [(0, '-49.432')] [2022-07-13 01:24:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4765.9). Total num frames: 110009344. Throughput: 0: 9473.2. Samples: 220026392. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:43,989][27935] Avg episode reward: [(0, '-49.342')] [2022-07-13 01:24:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4759.0). Total num frames: 110031872. Throughput: 0: 9583.5. Samples: 220085220. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:48,991][27935] Avg episode reward: [(0, '-49.130')] [2022-07-13 01:24:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 110057472. Throughput: 0: 9588.3. Samples: 220113976. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:53,989][27935] Avg episode reward: [(0, '-48.827')] [2022-07-13 01:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 110081024. Throughput: 0: 9596.2. Samples: 220171768. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:24:58,989][27935] Avg episode reward: [(0, '-49.228')] [2022-07-13 01:25:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 110102528. Throughput: 0: 9525.3. Samples: 220225896. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:03,989][27935] Avg episode reward: [(0, '-50.022')] [2022-07-13 01:25:08,999][27935] Fps is (10 sec: 4705.6, 60 sec: 4760.8, 300 sec: 4772.7). Total num frames: 110128128. Throughput: 0: 9539.4. Samples: 220255068. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:09,000][27935] Avg episode reward: [(0, '-50.628')] [2022-07-13 01:25:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 110151680. Throughput: 0: 9566.2. Samples: 220312760. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:13,989][27935] Avg episode reward: [(0, '-50.244')] [2022-07-13 01:25:18,989][27935] Fps is (10 sec: 4612.6, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 110174208. Throughput: 0: 9573.1. Samples: 220370460. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:18,989][27935] Avg episode reward: [(0, '-50.849')] [2022-07-13 01:25:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 110199808. Throughput: 0: 9563.4. Samples: 220399004. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:23,989][27935] Avg episode reward: [(0, '-50.910')] [2022-07-13 01:25:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 110222336. Throughput: 0: 9548.5. Samples: 220456076. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:28,989][27935] Avg episode reward: [(0, '-50.662')] [2022-07-13 01:25:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 110245888. Throughput: 0: 9507.3. Samples: 220513048. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:33,989][27935] Avg episode reward: [(0, '-50.816')] [2022-07-13 01:25:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 110270464. Throughput: 0: 9501.1. Samples: 220541524. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:38,989][27935] Avg episode reward: [(0, '-50.057')] [2022-07-13 01:25:43,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4761.4, 300 sec: 4759.0). Total num frames: 110295040. Throughput: 0: 9487.4. Samples: 220598724. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:43,993][27935] Avg episode reward: [(0, '-50.085')] [2022-07-13 01:25:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 110317568. Throughput: 0: 9557.9. Samples: 220656000. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:48,989][27935] Avg episode reward: [(0, '-50.601')] [2022-07-13 01:25:53,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4744.5, 300 sec: 4752.1). Total num frames: 110342144. Throughput: 0: 9546.8. Samples: 220684576. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:53,989][27935] Avg episode reward: [(0, '-50.361')] [2022-07-13 01:25:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4759.0). Total num frames: 110365696. Throughput: 0: 9534.5. Samples: 220741812. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:25:58,989][27935] Avg episode reward: [(0, '-50.568')] [2022-07-13 01:26:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 110386176. Throughput: 0: 9439.2. Samples: 220795224. Policy #0 lag: (min: 0.0, avg: 10.7, max: 24.0) [2022-07-13 01:26:03,990][27935] Avg episode reward: [(0, '-51.341')] [2022-07-13 01:26:09,004][27935] Fps is (10 sec: 4601.1, 60 sec: 4727.1, 300 sec: 4748.3). Total num frames: 110411776. Throughput: 0: 9432.8. Samples: 220823620. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:09,004][27935] Avg episode reward: [(0, '-51.481')] [2022-07-13 01:26:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4752.1). Total num frames: 110436352. Throughput: 0: 9395.9. Samples: 220878892. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:13,989][27935] Avg episode reward: [(0, '-52.012')] [2022-07-13 01:26:18,989][27935] Fps is (10 sec: 4614.9, 60 sec: 4727.5, 300 sec: 4748.7). Total num frames: 110457856. Throughput: 0: 9392.3. Samples: 220935704. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:18,989][27935] Avg episode reward: [(0, '-51.456')] [2022-07-13 01:26:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 110482432. Throughput: 0: 9394.8. Samples: 220964288. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:23,989][27935] Avg episode reward: [(0, '-50.814')] [2022-07-13 01:26:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 110505984. Throughput: 0: 9388.3. Samples: 221021172. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:28,989][27935] Avg episode reward: [(0, '-50.684')] [2022-07-13 01:26:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 110529536. Throughput: 0: 9380.6. Samples: 221078128. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:33,989][27935] Avg episode reward: [(0, '-50.009')] [2022-07-13 01:26:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4738.2). Total num frames: 110552064. Throughput: 0: 9386.5. Samples: 221106968. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:38,989][27935] Avg episode reward: [(0, '-49.818')] [2022-07-13 01:26:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.7, 300 sec: 4745.1). Total num frames: 110578688. Throughput: 0: 9397.1. Samples: 221164680. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:43,989][27935] Avg episode reward: [(0, '-49.593')] [2022-07-13 01:26:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 110602240. Throughput: 0: 9488.7. Samples: 221222216. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:48,989][27935] Avg episode reward: [(0, '-49.047')] [2022-07-13 01:26:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4731.2). Total num frames: 110623744. Throughput: 0: 9501.5. Samples: 221251048. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:53,989][27935] Avg episode reward: [(0, '-48.967')] [2022-07-13 01:26:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 110649344. Throughput: 0: 9541.9. Samples: 221308276. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:26:58,990][27935] Avg episode reward: [(0, '-49.498')] [2022-07-13 01:27:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 110669824. Throughput: 0: 9462.4. Samples: 221361512. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:03,989][27935] Avg episode reward: [(0, '-50.009')] [2022-07-13 01:27:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4728.6, 300 sec: 4734.7). Total num frames: 110695424. Throughput: 0: 9459.7. Samples: 221389976. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:08,989][27935] Avg episode reward: [(0, '-50.078')] [2022-07-13 01:27:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 110717952. Throughput: 0: 9453.5. Samples: 221446580. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:13,989][27935] Avg episode reward: [(0, '-49.045')] [2022-07-13 01:27:18,995][27935] Fps is (10 sec: 4604.9, 60 sec: 4726.9, 300 sec: 4727.8). Total num frames: 110741504. Throughput: 0: 9449.1. Samples: 221503400. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:18,997][27935] Avg episode reward: [(0, '-49.270')] [2022-07-13 01:27:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4727.8). Total num frames: 110767104. Throughput: 0: 9451.3. Samples: 221532276. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:23,989][27935] Avg episode reward: [(0, '-49.768')] [2022-07-13 01:27:28,989][27935] Fps is (10 sec: 4713.5, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 110788608. Throughput: 0: 9433.2. Samples: 221589172. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:28,989][27935] Avg episode reward: [(0, '-49.437')] [2022-07-13 01:27:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 110813184. Throughput: 0: 9425.9. Samples: 221646380. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:33,989][27935] Avg episode reward: [(0, '-48.884')] [2022-07-13 01:27:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 110836736. Throughput: 0: 9422.8. Samples: 221675072. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:38,989][27935] Avg episode reward: [(0, '-48.641')] [2022-07-13 01:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4731.3). Total num frames: 110861312. Throughput: 0: 9407.4. Samples: 221731608. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:43,989][27935] Avg episode reward: [(0, '-48.856')] [2022-07-13 01:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4727.8). Total num frames: 110884864. Throughput: 0: 9512.7. Samples: 221789584. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:48,989][27935] Avg episode reward: [(0, '-50.776')] [2022-07-13 01:27:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4738.2). Total num frames: 110909440. Throughput: 0: 9525.2. Samples: 221818608. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:53,991][27935] Avg episode reward: [(0, '-50.500')] [2022-07-13 01:27:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 110932992. Throughput: 0: 9549.2. Samples: 221876292. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:27:58,990][27935] Avg episode reward: [(0, '-50.918')] [2022-07-13 01:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4738.2). Total num frames: 110956544. Throughput: 0: 9476.5. Samples: 221929780. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 01:28:03,990][27935] Avg episode reward: [(0, '-50.756')] [2022-07-13 01:28:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 110979072. Throughput: 0: 9474.0. Samples: 221958608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:08,991][27935] Avg episode reward: [(0, '-51.238')] [2022-07-13 01:28:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 111004672. Throughput: 0: 9497.7. Samples: 222016568. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:13,989][27935] Avg episode reward: [(0, '-51.070')] [2022-07-13 01:28:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4762.1, 300 sec: 4741.6). Total num frames: 111027200. Throughput: 0: 9511.6. Samples: 222074400. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:18,989][27935] Avg episode reward: [(0, '-50.154')] [2022-07-13 01:28:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 111050752. Throughput: 0: 9511.9. Samples: 222103108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:23,989][27935] Avg episode reward: [(0, '-49.766')] [2022-07-13 01:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4748.6). Total num frames: 111076352. Throughput: 0: 9545.1. Samples: 222161136. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:28,989][27935] Avg episode reward: [(0, '-50.097')] [2022-07-13 01:28:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 111099904. Throughput: 0: 9539.8. Samples: 222218876. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:33,989][27935] Avg episode reward: [(0, '-49.392')] [2022-07-13 01:28:38,992][27935] Fps is (10 sec: 4811.2, 60 sec: 4795.5, 300 sec: 4748.5). Total num frames: 111124480. Throughput: 0: 9539.7. Samples: 222247928. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:38,993][27935] Avg episode reward: [(0, '-50.059')] [2022-07-13 01:28:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111148032. Throughput: 0: 9551.6. Samples: 222306112. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:43,991][27935] Avg episode reward: [(0, '-50.060')] [2022-07-13 01:28:48,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 111172608. Throughput: 0: 9665.2. Samples: 222364716. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:48,989][27935] Avg episode reward: [(0, '-50.751')] [2022-07-13 01:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 111196160. Throughput: 0: 9667.6. Samples: 222393648. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:53,989][27935] Avg episode reward: [(0, '-50.881')] [2022-07-13 01:28:58,992][27935] Fps is (10 sec: 4708.7, 60 sec: 4778.4, 300 sec: 4758.9). Total num frames: 111219712. Throughput: 0: 9655.7. Samples: 222451108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:28:58,993][27935] Avg episode reward: [(0, '-50.959')] [2022-07-13 01:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111243264. Throughput: 0: 9001.2. Samples: 222479452. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:03,989][27935] Avg episode reward: [(0, '-51.519')] [2022-07-13 01:29:08,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111265792. Throughput: 0: 9538.4. Samples: 222532336. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:08,989][27935] Avg episode reward: [(0, '-51.068')] [2022-07-13 01:29:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 111290368. Throughput: 0: 9512.5. Samples: 222589200. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:13,989][27935] Avg episode reward: [(0, '-51.304')] [2022-07-13 01:29:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111313920. Throughput: 0: 9507.0. Samples: 222646692. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:18,989][27935] Avg episode reward: [(0, '-50.529')] [2022-07-13 01:29:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111337472. Throughput: 0: 9506.0. Samples: 222675664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:23,989][27935] Avg episode reward: [(0, '-50.283')] [2022-07-13 01:29:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4748.6). Total num frames: 111361024. Throughput: 0: 9495.4. Samples: 222733404. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:28,990][27935] Avg episode reward: [(0, '-50.325')] [2022-07-13 01:29:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4745.1). Total num frames: 111384576. Throughput: 0: 9464.3. Samples: 222790608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:33,991][27935] Avg episode reward: [(0, '-50.077')] [2022-07-13 01:29:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.8, 300 sec: 4745.1). Total num frames: 111409152. Throughput: 0: 9469.6. Samples: 222819780. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:38,989][27935] Avg episode reward: [(0, '-49.230')] [2022-07-13 01:29:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 111434752. Throughput: 0: 9459.0. Samples: 222876732. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:43,989][27935] Avg episode reward: [(0, '-49.816')] [2022-07-13 01:29:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4745.1). Total num frames: 111457280. Throughput: 0: 10096.1. Samples: 222933776. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:48,989][27935] Avg episode reward: [(0, '-49.011')] [2022-07-13 01:29:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4745.1). Total num frames: 111480832. Throughput: 0: 9554.1. Samples: 222962272. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:53,991][27935] Avg episode reward: [(0, '-49.506')] [2022-07-13 01:29:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.8, 300 sec: 4752.1). Total num frames: 111504384. Throughput: 0: 9575.8. Samples: 223020112. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:29:58,989][27935] Avg episode reward: [(0, '-49.773')] [2022-07-13 01:30:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4748.7). Total num frames: 111528960. Throughput: 0: 8940.7. Samples: 223049024. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 01:30:03,991][27935] Avg episode reward: [(0, '-50.117')] [2022-07-13 01:30:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 111552512. Throughput: 0: 9504.1. Samples: 223103348. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:08,989][27935] Avg episode reward: [(0, '-50.116')] [2022-07-13 01:30:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 111576064. Throughput: 0: 9522.5. Samples: 223161916. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:13,990][27935] Avg episode reward: [(0, '-51.301')] [2022-07-13 01:30:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4745.1). Total num frames: 111599616. Throughput: 0: 9533.3. Samples: 223219608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:18,989][27935] Avg episode reward: [(0, '-51.194')] [2022-07-13 01:30:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 111624192. Throughput: 0: 9533.0. Samples: 223248764. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:23,989][27935] Avg episode reward: [(0, '-51.887')] [2022-07-13 01:30:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 111648768. Throughput: 0: 9567.9. Samples: 223307288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:28,989][27935] Avg episode reward: [(0, '-52.371')] [2022-07-13 01:30:33,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4795.6, 300 sec: 4752.0). Total num frames: 111672320. Throughput: 0: 9585.8. Samples: 223365152. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:33,991][27935] Avg episode reward: [(0, '-51.881')] [2022-07-13 01:30:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 111696896. Throughput: 0: 9591.6. Samples: 223393892. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:38,989][27935] Avg episode reward: [(0, '-51.857')] [2022-07-13 01:30:43,989][27935] Fps is (10 sec: 4916.0, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 111721472. Throughput: 0: 9589.3. Samples: 223451632. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:43,989][27935] Avg episode reward: [(0, '-51.480')] [2022-07-13 01:30:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 111744000. Throughput: 0: 9571.1. Samples: 223479724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:48,989][27935] Avg episode reward: [(0, '-51.765')] [2022-07-13 01:30:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 111768576. Throughput: 0: 9655.2. Samples: 223537832. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:53,989][27935] Avg episode reward: [(0, '-51.248')] [2022-07-13 01:30:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4772.9). Total num frames: 111794176. Throughput: 0: 9653.2. Samples: 223596308. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:30:58,989][27935] Avg episode reward: [(0, '-51.100')] [2022-07-13 01:31:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4759.2). Total num frames: 111815680. Throughput: 0: 9573.0. Samples: 223650392. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:03,989][27935] Avg episode reward: [(0, '-50.314')] [2022-07-13 01:31:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 111840256. Throughput: 0: 9577.3. Samples: 223679744. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:08,989][27935] Avg episode reward: [(0, '-50.597')] [2022-07-13 01:31:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 111862784. Throughput: 0: 9572.1. Samples: 223738032. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:13,989][27935] Avg episode reward: [(0, '-50.604')] [2022-07-13 01:31:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 111887360. Throughput: 0: 9565.6. Samples: 223795588. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:18,992][27935] Avg episode reward: [(0, '-51.208')] [2022-07-13 01:31:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 111912960. Throughput: 0: 9573.0. Samples: 223824676. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:23,989][27935] Avg episode reward: [(0, '-50.401')] [2022-07-13 01:31:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 111935488. Throughput: 0: 9587.8. Samples: 223883084. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:28,989][27935] Avg episode reward: [(0, '-50.402')] [2022-07-13 01:31:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4772.9). Total num frames: 111960064. Throughput: 0: 10249.7. Samples: 223940960. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:33,990][27935] Avg episode reward: [(0, '-50.066')] [2022-07-13 01:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4765.9). Total num frames: 111984640. Throughput: 0: 9598.9. Samples: 223969784. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:38,989][27935] Avg episode reward: [(0, '-50.330')] [2022-07-13 01:31:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4769.4). Total num frames: 112009216. Throughput: 0: 9598.3. Samples: 224028232. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:43,989][27935] Avg episode reward: [(0, '-49.780')] [2022-07-13 01:31:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4779.8). Total num frames: 112033792. Throughput: 0: 9692.5. Samples: 224086552. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:48,989][27935] Avg episode reward: [(0, '-49.459')] [2022-07-13 01:31:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4772.9). Total num frames: 112057344. Throughput: 0: 9676.1. Samples: 224115168. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:53,989][27935] Avg episode reward: [(0, '-49.592')] [2022-07-13 01:31:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 112082944. Throughput: 0: 9676.6. Samples: 224173480. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:31:58,991][27935] Avg episode reward: [(0, '-50.219')] [2022-07-13 01:32:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4776.4). Total num frames: 112104448. Throughput: 0: 9602.5. Samples: 224227700. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:32:03,991][27935] Avg episode reward: [(0, '-49.819')] [2022-07-13 01:32:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 112128000. Throughput: 0: 9604.6. Samples: 224256884. Policy #0 lag: (min: 0.0, avg: 9.8, max: 23.0) [2022-07-13 01:32:08,997][27935] Avg episode reward: [(0, '-49.204')] [2022-07-13 01:32:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4783.4). Total num frames: 112152576. Throughput: 0: 9591.3. Samples: 224314692. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:13,989][27935] Avg episode reward: [(0, '-48.933')] [2022-07-13 01:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4776.4). Total num frames: 112176128. Throughput: 0: 9556.5. Samples: 224371000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:18,989][27935] Avg episode reward: [(0, '-49.740')] [2022-07-13 01:32:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 112200704. Throughput: 0: 9568.9. Samples: 224400384. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:23,989][27935] Avg episode reward: [(0, '-50.125')] [2022-07-13 01:32:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 112224256. Throughput: 0: 9564.5. Samples: 224458632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:28,989][27935] Avg episode reward: [(0, '-49.732')] [2022-07-13 01:32:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 112247808. Throughput: 0: 9541.3. Samples: 224515912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:33,989][27935] Avg episode reward: [(0, '-49.376')] [2022-07-13 01:32:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 112272384. Throughput: 0: 9548.4. Samples: 224544848. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:38,989][27935] Avg episode reward: [(0, '-49.575')] [2022-07-13 01:32:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 112296960. Throughput: 0: 9526.6. Samples: 224602176. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:43,989][27935] Avg episode reward: [(0, '-50.072')] [2022-07-13 01:32:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 112319488. Throughput: 0: 9603.2. Samples: 224659844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:48,989][27935] Avg episode reward: [(0, '-50.803')] [2022-07-13 01:32:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 112345088. Throughput: 0: 9602.1. Samples: 224688976. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:53,989][27935] Avg episode reward: [(0, '-49.813')] [2022-07-13 01:32:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 112368640. Throughput: 0: 9603.8. Samples: 224746864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:32:58,990][27935] Avg episode reward: [(0, '-49.261')] [2022-07-13 01:33:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 112390144. Throughput: 0: 9544.6. Samples: 224800508. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:03,989][27935] Avg episode reward: [(0, '-49.258')] [2022-07-13 01:33:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 112414720. Throughput: 0: 9532.1. Samples: 224829328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:08,989][27935] Avg episode reward: [(0, '-48.468')] [2022-07-13 01:33:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 112438272. Throughput: 0: 9517.1. Samples: 224886904. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:13,989][27935] Avg episode reward: [(0, '-48.398')] [2022-07-13 01:33:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 112461824. Throughput: 0: 9518.1. Samples: 224944228. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:18,989][27935] Avg episode reward: [(0, '-47.827')] [2022-07-13 01:33:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 112485376. Throughput: 0: 9511.5. Samples: 224972864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:23,991][27935] Avg episode reward: [(0, '-47.997')] [2022-07-13 01:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 112510976. Throughput: 0: 9527.0. Samples: 225030892. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:28,989][27935] Avg episode reward: [(0, '-47.934')] [2022-07-13 01:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4779.9). Total num frames: 112534528. Throughput: 0: 9504.6. Samples: 225087552. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:33,990][27935] Avg episode reward: [(0, '-48.117')] [2022-07-13 01:33:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 112558080. Throughput: 0: 9499.4. Samples: 225116448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:38,990][27935] Avg episode reward: [(0, '-48.474')] [2022-07-13 01:33:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 112582656. Throughput: 0: 9500.9. Samples: 225174404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:43,990][27935] Avg episode reward: [(0, '-49.101')] [2022-07-13 01:33:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 112606208. Throughput: 0: 9587.5. Samples: 225231944. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:48,989][27935] Avg episode reward: [(0, '-49.496')] [2022-07-13 01:33:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4779.9). Total num frames: 112629760. Throughput: 0: 9580.2. Samples: 225260436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:53,989][27935] Avg episode reward: [(0, '-49.895')] [2022-07-13 01:33:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 112654336. Throughput: 0: 9573.3. Samples: 225317700. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:33:58,989][27935] Avg episode reward: [(0, '-49.556')] [2022-07-13 01:34:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 112675840. Throughput: 0: 9478.6. Samples: 225370764. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:34:03,991][27935] Avg episode reward: [(0, '-50.032')] [2022-07-13 01:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 112700416. Throughput: 0: 9476.3. Samples: 225399296. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 01:34:08,989][27935] Avg episode reward: [(0, '-49.848')] [2022-07-13 01:34:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 112722944. Throughput: 0: 9456.5. Samples: 225456436. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:13,991][27935] Avg episode reward: [(0, '-50.151')] [2022-07-13 01:34:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4772.9). Total num frames: 112745472. Throughput: 0: 9459.4. Samples: 225513224. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:18,989][27935] Avg episode reward: [(0, '-49.521')] [2022-07-13 01:34:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 112770048. Throughput: 0: 9453.4. Samples: 225541852. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:23,991][27935] Avg episode reward: [(0, '-49.578')] [2022-07-13 01:34:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4776.4). Total num frames: 112793600. Throughput: 0: 9418.7. Samples: 225598244. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:28,991][27935] Avg episode reward: [(0, '-49.619')] [2022-07-13 01:34:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4772.9). Total num frames: 112817152. Throughput: 0: 9401.2. Samples: 225655000. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:33,990][27935] Avg episode reward: [(0, '-49.776')] [2022-07-13 01:34:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4769.4). Total num frames: 112841728. Throughput: 0: 9394.3. Samples: 225683180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:38,989][27935] Avg episode reward: [(0, '-49.353')] [2022-07-13 01:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4772.9). Total num frames: 112865280. Throughput: 0: 9393.6. Samples: 225740412. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:43,990][27935] Avg episode reward: [(0, '-49.807')] [2022-07-13 01:34:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4772.9). Total num frames: 112888832. Throughput: 0: 9480.7. Samples: 225797396. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:48,989][27935] Avg episode reward: [(0, '-49.493')] [2022-07-13 01:34:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4769.4). Total num frames: 112911360. Throughput: 0: 9485.4. Samples: 225826140. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:53,989][27935] Avg episode reward: [(0, '-49.162')] [2022-07-13 01:34:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4772.9). Total num frames: 112936960. Throughput: 0: 9486.3. Samples: 225883320. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:34:58,989][27935] Avg episode reward: [(0, '-49.113')] [2022-07-13 01:35:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4769.4). Total num frames: 112959488. Throughput: 0: 9411.1. Samples: 225936724. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:03,989][27935] Avg episode reward: [(0, '-49.736')] [2022-07-13 01:35:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4710.4, 300 sec: 4769.4). Total num frames: 112983040. Throughput: 0: 9413.3. Samples: 225965452. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:08,991][27935] Avg episode reward: [(0, '-49.748')] [2022-07-13 01:35:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4765.9). Total num frames: 113005568. Throughput: 0: 9427.9. Samples: 226022500. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:13,991][27935] Avg episode reward: [(0, '-49.386')] [2022-07-13 01:35:18,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4727.5, 300 sec: 4762.5). Total num frames: 113029120. Throughput: 0: 9417.9. Samples: 226078808. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:18,989][27935] Avg episode reward: [(0, '-49.707')] [2022-07-13 01:35:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4762.5). Total num frames: 113053696. Throughput: 0: 9421.1. Samples: 226107132. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:23,989][27935] Avg episode reward: [(0, '-49.695')] [2022-07-13 01:35:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4762.5). Total num frames: 113077248. Throughput: 0: 9415.0. Samples: 226164088. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:28,989][27935] Avg episode reward: [(0, '-50.497')] [2022-07-13 01:35:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4759.0). Total num frames: 113100800. Throughput: 0: 9397.1. Samples: 226220268. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:33,989][27935] Avg episode reward: [(0, '-50.384')] [2022-07-13 01:35:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4755.5). Total num frames: 113124352. Throughput: 0: 9388.0. Samples: 226248600. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:38,989][27935] Avg episode reward: [(0, '-50.113')] [2022-07-13 01:35:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4759.0). Total num frames: 113147904. Throughput: 0: 9373.9. Samples: 226305148. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:43,989][27935] Avg episode reward: [(0, '-50.123')] [2022-07-13 01:35:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4752.1). Total num frames: 113170432. Throughput: 0: 9450.1. Samples: 226361980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:48,989][27935] Avg episode reward: [(0, '-50.467')] [2022-07-13 01:35:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 113193984. Throughput: 0: 9439.7. Samples: 226390236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:53,989][27935] Avg episode reward: [(0, '-49.898')] [2022-07-13 01:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4759.0). Total num frames: 113219584. Throughput: 0: 9428.5. Samples: 226446780. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:35:58,989][27935] Avg episode reward: [(0, '-50.002')] [2022-07-13 01:36:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4745.1). Total num frames: 113240064. Throughput: 0: 8811.0. Samples: 226475304. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:36:03,989][27935] Avg episode reward: [(0, '-49.734')] [2022-07-13 01:36:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4752.1). Total num frames: 113264640. Throughput: 0: 9358.9. Samples: 226528284. Policy #0 lag: (min: 0.0, avg: 8.5, max: 21.0) [2022-07-13 01:36:08,990][27935] Avg episode reward: [(0, '-49.964')] [2022-07-13 01:36:13,990][27935] Fps is (10 sec: 4709.8, 60 sec: 4693.2, 300 sec: 4745.1). Total num frames: 113287168. Throughput: 0: 9361.3. Samples: 226585360. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:13,994][27935] Avg episode reward: [(0, '-49.411')] [2022-07-13 01:36:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4738.2). Total num frames: 113310720. Throughput: 0: 9367.1. Samples: 226641788. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:18,989][27935] Avg episode reward: [(0, '-49.807')] [2022-07-13 01:36:23,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4693.3, 300 sec: 4745.1). Total num frames: 113335296. Throughput: 0: 9370.1. Samples: 226670256. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:23,989][27935] Avg episode reward: [(0, '-49.694')] [2022-07-13 01:36:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4738.2). Total num frames: 113357824. Throughput: 0: 9378.6. Samples: 226727184. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:28,989][27935] Avg episode reward: [(0, '-49.560')] [2022-07-13 01:36:33,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4710.1, 300 sec: 4741.6). Total num frames: 113383424. Throughput: 0: 9370.3. Samples: 226783676. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:33,993][27935] Avg episode reward: [(0, '-49.635')] [2022-07-13 01:36:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 113405952. Throughput: 0: 9370.3. Samples: 226811900. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:38,989][27935] Avg episode reward: [(0, '-49.650')] [2022-07-13 01:36:43,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4693.3, 300 sec: 4731.2). Total num frames: 113429504. Throughput: 0: 9387.4. Samples: 226869216. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:43,990][27935] Avg episode reward: [(0, '-49.353')] [2022-07-13 01:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 113454080. Throughput: 0: 10027.2. Samples: 226926528. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:48,989][27935] Avg episode reward: [(0, '-49.663')] [2022-07-13 01:36:53,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 113477632. Throughput: 0: 9489.2. Samples: 226955296. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:53,989][27935] Avg episode reward: [(0, '-49.875')] [2022-07-13 01:36:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 113501184. Throughput: 0: 9489.6. Samples: 227012380. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:36:58,989][27935] Avg episode reward: [(0, '-49.684')] [2022-07-13 01:37:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4731.2). Total num frames: 113523712. Throughput: 0: 9427.2. Samples: 227066012. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:03,989][27935] Avg episode reward: [(0, '-50.571')] [2022-07-13 01:37:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4727.8). Total num frames: 113547264. Throughput: 0: 9426.7. Samples: 227094460. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:08,989][27935] Avg episode reward: [(0, '-50.861')] [2022-07-13 01:37:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.6, 300 sec: 4727.8). Total num frames: 113570816. Throughput: 0: 9432.6. Samples: 227151652. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:13,989][27935] Avg episode reward: [(0, '-50.160')] [2022-07-13 01:37:18,989][27935] Fps is (10 sec: 4812.6, 60 sec: 4744.5, 300 sec: 4727.7). Total num frames: 113595392. Throughput: 0: 9436.4. Samples: 227208284. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:18,990][27935] Avg episode reward: [(0, '-50.251')] [2022-07-13 01:37:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 113617920. Throughput: 0: 9447.4. Samples: 227237032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:23,989][27935] Avg episode reward: [(0, '-49.850')] [2022-07-13 01:37:28,989][27935] Fps is (10 sec: 4608.3, 60 sec: 4727.5, 300 sec: 4724.3). Total num frames: 113641472. Throughput: 0: 9443.0. Samples: 227294148. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:28,989][27935] Avg episode reward: [(0, '-49.334')] [2022-07-13 01:37:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.7, 300 sec: 4724.3). Total num frames: 113666048. Throughput: 0: 9450.8. Samples: 227351812. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:33,989][27935] Avg episode reward: [(0, '-48.990')] [2022-07-13 01:37:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 113690624. Throughput: 0: 9446.0. Samples: 227380368. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:38,989][27935] Avg episode reward: [(0, '-48.635')] [2022-07-13 01:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4727.8). Total num frames: 113714176. Throughput: 0: 9428.8. Samples: 227436676. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:43,989][27935] Avg episode reward: [(0, '-48.487')] [2022-07-13 01:37:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 113737728. Throughput: 0: 9514.3. Samples: 227494156. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:48,989][27935] Avg episode reward: [(0, '-49.025')] [2022-07-13 01:37:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 113761280. Throughput: 0: 9520.9. Samples: 227522900. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:53,989][27935] Avg episode reward: [(0, '-48.795')] [2022-07-13 01:37:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 113784832. Throughput: 0: 9524.7. Samples: 227580264. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:37:58,989][27935] Avg episode reward: [(0, '-48.969')] [2022-07-13 01:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 113807360. Throughput: 0: 9445.1. Samples: 227633308. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:38:03,989][27935] Avg episode reward: [(0, '-49.373')] [2022-07-13 01:38:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 113831936. Throughput: 0: 9437.5. Samples: 227661720. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:38:08,989][27935] Avg episode reward: [(0, '-49.305')] [2022-07-13 01:38:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 113854464. Throughput: 0: 9442.0. Samples: 227719036. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 01:38:13,989][27935] Avg episode reward: [(0, '-49.068')] [2022-07-13 01:38:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.4, 300 sec: 4717.3). Total num frames: 113876992. Throughput: 0: 9405.4. Samples: 227775056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:18,989][27935] Avg episode reward: [(0, '-49.453')] [2022-07-13 01:38:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 113901568. Throughput: 0: 9394.1. Samples: 227803104. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:23,989][27935] Avg episode reward: [(0, '-49.710')] [2022-07-13 01:38:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 113924096. Throughput: 0: 9405.1. Samples: 227859904. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:28,989][27935] Avg episode reward: [(0, '-49.948')] [2022-07-13 01:38:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 113948672. Throughput: 0: 9393.2. Samples: 227916852. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:33,989][27935] Avg episode reward: [(0, '-50.154')] [2022-07-13 01:38:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 113973248. Throughput: 0: 9390.3. Samples: 227945464. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:38,990][27935] Avg episode reward: [(0, '-49.889')] [2022-07-13 01:38:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 113995776. Throughput: 0: 9390.1. Samples: 228002820. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:43,989][27935] Avg episode reward: [(0, '-49.847')] [2022-07-13 01:38:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 114020352. Throughput: 0: 9483.7. Samples: 228060076. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:48,989][27935] Avg episode reward: [(0, '-49.590')] [2022-07-13 01:38:53,996][27935] Fps is (10 sec: 4809.4, 60 sec: 4709.8, 300 sec: 4710.3). Total num frames: 114043904. Throughput: 0: 9483.7. Samples: 228088556. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:53,997][27935] Avg episode reward: [(0, '-49.013')] [2022-07-13 01:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 114068480. Throughput: 0: 9489.9. Samples: 228146084. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:38:58,989][27935] Avg episode reward: [(0, '-48.707')] [2022-07-13 01:39:03,990][27935] Fps is (10 sec: 4610.6, 60 sec: 4710.3, 300 sec: 4710.4). Total num frames: 114089984. Throughput: 0: 9426.4. Samples: 228199260. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:03,991][27935] Avg episode reward: [(0, '-48.391')] [2022-07-13 01:39:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 114113536. Throughput: 0: 9428.2. Samples: 228227372. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:08,989][27935] Avg episode reward: [(0, '-47.761')] [2022-07-13 01:39:13,989][27935] Fps is (10 sec: 4915.9, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114139136. Throughput: 0: 9446.3. Samples: 228284988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:13,991][27935] Avg episode reward: [(0, '-47.775')] [2022-07-13 01:39:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 114160640. Throughput: 0: 9443.5. Samples: 228341812. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:18,989][27935] Avg episode reward: [(0, '-47.421')] [2022-07-13 01:39:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 114184192. Throughput: 0: 9445.3. Samples: 228370504. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:23,989][27935] Avg episode reward: [(0, '-47.534')] [2022-07-13 01:39:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 114209792. Throughput: 0: 9442.9. Samples: 228427752. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:28,991][27935] Avg episode reward: [(0, '-47.511')] [2022-07-13 01:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 114233344. Throughput: 0: 9450.9. Samples: 228485368. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:33,990][27935] Avg episode reward: [(0, '-47.593')] [2022-07-13 01:39:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 114256896. Throughput: 0: 9458.0. Samples: 228514100. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:38,989][27935] Avg episode reward: [(0, '-47.691')] [2022-07-13 01:39:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 114280448. Throughput: 0: 9474.3. Samples: 228572428. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:43,990][27935] Avg episode reward: [(0, '-47.554')] [2022-07-13 01:39:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114305024. Throughput: 0: 9570.3. Samples: 228629908. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:48,991][27935] Avg episode reward: [(0, '-47.850')] [2022-07-13 01:39:53,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4762.0, 300 sec: 4720.8). Total num frames: 114329600. Throughput: 0: 9591.0. Samples: 228658988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:53,992][27935] Avg episode reward: [(0, '-47.895')] [2022-07-13 01:39:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114353152. Throughput: 0: 9591.5. Samples: 228716604. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:39:58,989][27935] Avg episode reward: [(0, '-48.997')] [2022-07-13 01:40:03,989][27935] Fps is (10 sec: 4609.0, 60 sec: 4761.7, 300 sec: 4720.8). Total num frames: 114375680. Throughput: 0: 9524.1. Samples: 228770396. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:40:03,989][27935] Avg episode reward: [(0, '-50.122')] [2022-07-13 01:40:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 114398208. Throughput: 0: 9522.6. Samples: 228799020. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:40:08,989][27935] Avg episode reward: [(0, '-50.218')] [2022-07-13 01:40:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4720.8). Total num frames: 114421760. Throughput: 0: 9527.0. Samples: 228856468. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 01:40:13,989][27935] Avg episode reward: [(0, '-50.210')] [2022-07-13 01:40:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4727.8). Total num frames: 114448384. Throughput: 0: 9511.6. Samples: 228913392. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:18,989][27935] Avg episode reward: [(0, '-49.937')] [2022-07-13 01:40:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 114469888. Throughput: 0: 9515.4. Samples: 228942292. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:23,989][27935] Avg episode reward: [(0, '-50.427')] [2022-07-13 01:40:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114494464. Throughput: 0: 9490.6. Samples: 228999504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:28,990][27935] Avg episode reward: [(0, '-49.786')] [2022-07-13 01:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114518016. Throughput: 0: 9482.3. Samples: 229056612. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:33,989][27935] Avg episode reward: [(0, '-49.090')] [2022-07-13 01:40:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 114541568. Throughput: 0: 9474.0. Samples: 229085296. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:38,989][27935] Avg episode reward: [(0, '-48.495')] [2022-07-13 01:40:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4731.2). Total num frames: 114566144. Throughput: 0: 9482.1. Samples: 229143300. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:43,989][27935] Avg episode reward: [(0, '-48.828')] [2022-07-13 01:40:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 114589696. Throughput: 0: 9553.3. Samples: 229200292. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:48,989][27935] Avg episode reward: [(0, '-49.081')] [2022-07-13 01:40:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.7, 300 sec: 4727.8). Total num frames: 114614272. Throughput: 0: 9554.3. Samples: 229228964. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:53,989][27935] Avg episode reward: [(0, '-50.185')] [2022-07-13 01:40:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 114636800. Throughput: 0: 9557.9. Samples: 229286572. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:40:58,989][27935] Avg episode reward: [(0, '-50.294')] [2022-07-13 01:41:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 114660352. Throughput: 0: 9467.7. Samples: 229339436. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:03,989][27935] Avg episode reward: [(0, '-51.294')] [2022-07-13 01:41:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4734.7). Total num frames: 114683904. Throughput: 0: 9453.3. Samples: 229367692. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:08,989][27935] Avg episode reward: [(0, '-50.884')] [2022-07-13 01:41:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4738.2). Total num frames: 114708480. Throughput: 0: 9454.8. Samples: 229424972. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:13,989][27935] Avg episode reward: [(0, '-49.842')] [2022-07-13 01:41:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4731.2). Total num frames: 114731008. Throughput: 0: 9445.6. Samples: 229481664. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:18,991][27935] Avg episode reward: [(0, '-50.013')] [2022-07-13 01:41:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 114754560. Throughput: 0: 9448.8. Samples: 229510492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:23,990][27935] Avg episode reward: [(0, '-49.815')] [2022-07-13 01:41:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 114777088. Throughput: 0: 9441.1. Samples: 229568148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:28,989][27935] Avg episode reward: [(0, '-49.391')] [2022-07-13 01:41:33,992][27935] Fps is (10 sec: 4708.8, 60 sec: 4727.2, 300 sec: 4731.2). Total num frames: 114801664. Throughput: 0: 9442.6. Samples: 229625244. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:33,994][27935] Avg episode reward: [(0, '-49.066')] [2022-07-13 01:41:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4738.2). Total num frames: 114827264. Throughput: 0: 9439.7. Samples: 229653752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:38,989][27935] Avg episode reward: [(0, '-48.984')] [2022-07-13 01:41:43,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 114850816. Throughput: 0: 9441.2. Samples: 229711424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:43,989][27935] Avg episode reward: [(0, '-48.945')] [2022-07-13 01:41:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 114874368. Throughput: 0: 9541.0. Samples: 229768780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:48,989][27935] Avg episode reward: [(0, '-48.802')] [2022-07-13 01:41:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 114898944. Throughput: 0: 9556.0. Samples: 229797712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:53,989][27935] Avg episode reward: [(0, '-48.157')] [2022-07-13 01:41:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4741.6). Total num frames: 114922496. Throughput: 0: 9559.7. Samples: 229855160. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:41:58,989][27935] Avg episode reward: [(0, '-48.323')] [2022-07-13 01:42:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 114944000. Throughput: 0: 9484.1. Samples: 229908448. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:42:03,989][27935] Avg episode reward: [(0, '-48.992')] [2022-07-13 01:42:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 114968576. Throughput: 0: 9482.5. Samples: 229937204. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:42:08,989][27935] Avg episode reward: [(0, '-48.977')] [2022-07-13 01:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 114992128. Throughput: 0: 9468.4. Samples: 229994228. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 01:42:13,989][27935] Avg episode reward: [(0, '-49.051')] [2022-07-13 01:42:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 115015680. Throughput: 0: 9471.6. Samples: 230051432. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:18,989][27935] Avg episode reward: [(0, '-49.512')] [2022-07-13 01:42:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 115039232. Throughput: 0: 9479.2. Samples: 230080316. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:23,989][27935] Avg episode reward: [(0, '-50.359')] [2022-07-13 01:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4741.6). Total num frames: 115064832. Throughput: 0: 9479.7. Samples: 230138008. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:28,989][27935] Avg episode reward: [(0, '-50.177')] [2022-07-13 01:42:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.9, 300 sec: 4738.2). Total num frames: 115088384. Throughput: 0: 9482.8. Samples: 230195508. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:33,989][27935] Avg episode reward: [(0, '-49.880')] [2022-07-13 01:42:38,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4761.6, 300 sec: 4741.6). Total num frames: 115112960. Throughput: 0: 9480.3. Samples: 230224328. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:38,992][27935] Avg episode reward: [(0, '-49.167')] [2022-07-13 01:42:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 115134464. Throughput: 0: 9455.7. Samples: 230280664. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:43,989][27935] Avg episode reward: [(0, '-48.523')] [2022-07-13 01:42:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4741.6). Total num frames: 115160064. Throughput: 0: 9548.9. Samples: 230338148. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:49,000][27935] Avg episode reward: [(0, '-49.465')] [2022-07-13 01:42:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 115182592. Throughput: 0: 9547.6. Samples: 230366848. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:53,989][27935] Avg episode reward: [(0, '-48.887')] [2022-07-13 01:42:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4748.6). Total num frames: 115208192. Throughput: 0: 9563.4. Samples: 230424580. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:42:58,989][27935] Avg episode reward: [(0, '-48.507')] [2022-07-13 01:43:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4741.6). Total num frames: 115230720. Throughput: 0: 9490.4. Samples: 230478500. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:03,989][27935] Avg episode reward: [(0, '-49.217')] [2022-07-13 01:43:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 115253248. Throughput: 0: 9487.9. Samples: 230507272. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:08,989][27935] Avg episode reward: [(0, '-50.022')] [2022-07-13 01:43:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4745.1). Total num frames: 115276800. Throughput: 0: 9493.1. Samples: 230565200. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:13,989][27935] Avg episode reward: [(0, '-49.981')] [2022-07-13 01:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 115302400. Throughput: 0: 9483.8. Samples: 230622280. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:18,991][27935] Avg episode reward: [(0, '-50.124')] [2022-07-13 01:43:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 115325952. Throughput: 0: 9481.2. Samples: 230650980. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:23,991][27935] Avg episode reward: [(0, '-49.339')] [2022-07-13 01:43:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4748.6). Total num frames: 115349504. Throughput: 0: 9505.2. Samples: 230708400. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:28,989][27935] Avg episode reward: [(0, '-49.549')] [2022-07-13 01:43:33,991][27935] Fps is (10 sec: 4709.6, 60 sec: 4744.4, 300 sec: 4745.1). Total num frames: 115373056. Throughput: 0: 9494.3. Samples: 230765408. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:33,991][27935] Avg episode reward: [(0, '-49.788')] [2022-07-13 01:43:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 115395584. Throughput: 0: 9495.0. Samples: 230794124. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:38,995][27935] Avg episode reward: [(0, '-49.411')] [2022-07-13 01:43:43,989][27935] Fps is (10 sec: 4711.2, 60 sec: 4761.6, 300 sec: 4745.1). Total num frames: 115420160. Throughput: 0: 9494.3. Samples: 230851824. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:43,989][27935] Avg episode reward: [(0, '-49.159')] [2022-07-13 01:43:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4745.2). Total num frames: 115443712. Throughput: 0: 9556.4. Samples: 230908536. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:48,989][27935] Avg episode reward: [(0, '-49.486')] [2022-07-13 01:43:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 115467264. Throughput: 0: 9548.6. Samples: 230936960. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:53,989][27935] Avg episode reward: [(0, '-49.054')] [2022-07-13 01:43:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 115492864. Throughput: 0: 9535.6. Samples: 230994300. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:43:58,990][27935] Avg episode reward: [(0, '-49.015')] [2022-07-13 01:44:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4752.1). Total num frames: 115515392. Throughput: 0: 9468.6. Samples: 231048364. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:44:03,989][27935] Avg episode reward: [(0, '-48.523')] [2022-07-13 01:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4745.1). Total num frames: 115538944. Throughput: 0: 9470.0. Samples: 231077132. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:44:08,989][27935] Avg episode reward: [(0, '-48.229')] [2022-07-13 01:44:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 115562496. Throughput: 0: 9472.1. Samples: 231134644. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:44:13,989][27935] Avg episode reward: [(0, '-48.263')] [2022-07-13 01:44:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4752.1). Total num frames: 115586048. Throughput: 0: 9473.1. Samples: 231191680. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 01:44:18,990][27935] Avg episode reward: [(0, '-48.015')] [2022-07-13 01:44:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 115609600. Throughput: 0: 9456.1. Samples: 231219648. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:23,989][27935] Avg episode reward: [(0, '-47.695')] [2022-07-13 01:44:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 115632128. Throughput: 0: 9420.0. Samples: 231275724. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:28,989][27935] Avg episode reward: [(0, '-47.719')] [2022-07-13 01:44:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.5, 300 sec: 4741.6). Total num frames: 115655680. Throughput: 0: 9428.1. Samples: 231332800. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:33,989][27935] Avg episode reward: [(0, '-48.232')] [2022-07-13 01:44:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4745.1). Total num frames: 115680256. Throughput: 0: 9424.4. Samples: 231361056. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:38,991][27935] Avg episode reward: [(0, '-48.696')] [2022-07-13 01:44:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 115703808. Throughput: 0: 9412.5. Samples: 231417864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:43,989][27935] Avg episode reward: [(0, '-48.637')] [2022-07-13 01:44:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 115727360. Throughput: 0: 9492.3. Samples: 231475516. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:48,989][27935] Avg episode reward: [(0, '-48.408')] [2022-07-13 01:44:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 115751936. Throughput: 0: 9500.4. Samples: 231504652. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:53,989][27935] Avg episode reward: [(0, '-48.313')] [2022-07-13 01:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 115776512. Throughput: 0: 9515.4. Samples: 231562836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:44:58,989][27935] Avg episode reward: [(0, '-48.670')] [2022-07-13 01:45:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 115798016. Throughput: 0: 9449.5. Samples: 231616908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:03,991][27935] Avg episode reward: [(0, '-49.056')] [2022-07-13 01:45:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 115822592. Throughput: 0: 9464.9. Samples: 231645568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:08,989][27935] Avg episode reward: [(0, '-49.126')] [2022-07-13 01:45:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 115847168. Throughput: 0: 9514.6. Samples: 231703880. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:13,990][27935] Avg episode reward: [(0, '-49.842')] [2022-07-13 01:45:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4748.6). Total num frames: 115870720. Throughput: 0: 9519.9. Samples: 231761196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:18,989][27935] Avg episode reward: [(0, '-50.486')] [2022-07-13 01:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4748.6). Total num frames: 115895296. Throughput: 0: 9533.6. Samples: 231790068. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:23,989][27935] Avg episode reward: [(0, '-49.958')] [2022-07-13 01:45:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 115919872. Throughput: 0: 9564.1. Samples: 231848248. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:28,989][27935] Avg episode reward: [(0, '-50.424')] [2022-07-13 01:45:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 115943424. Throughput: 0: 8925.3. Samples: 231877156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:33,989][27935] Avg episode reward: [(0, '-50.150')] [2022-07-13 01:45:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 115968000. Throughput: 0: 9554.0. Samples: 231934580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:38,989][27935] Avg episode reward: [(0, '-49.328')] [2022-07-13 01:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 115991552. Throughput: 0: 9544.4. Samples: 231992332. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:43,989][27935] Avg episode reward: [(0, '-48.797')] [2022-07-13 01:45:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 116014080. Throughput: 0: 9629.1. Samples: 232050216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:48,989][27935] Avg episode reward: [(0, '-47.866')] [2022-07-13 01:45:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 116039680. Throughput: 0: 9645.7. Samples: 232079624. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:53,989][27935] Avg episode reward: [(0, '-48.330')] [2022-07-13 01:45:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 116063232. Throughput: 0: 9627.5. Samples: 232137116. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:45:58,989][27935] Avg episode reward: [(0, '-48.582')] [2022-07-13 01:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4755.5). Total num frames: 116086784. Throughput: 0: 9545.3. Samples: 232190732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:46:03,989][27935] Avg episode reward: [(0, '-48.681')] [2022-07-13 01:46:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 116110336. Throughput: 0: 9540.8. Samples: 232219404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:46:08,989][27935] Avg episode reward: [(0, '-48.195')] [2022-07-13 01:46:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 116133888. Throughput: 0: 9528.0. Samples: 232277008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:46:13,989][27935] Avg episode reward: [(0, '-48.288')] [2022-07-13 01:46:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 116157440. Throughput: 0: 10147.4. Samples: 232333788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 01:46:18,989][27935] Avg episode reward: [(0, '-49.273')] [2022-07-13 01:46:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 116180992. Throughput: 0: 9505.3. Samples: 232362320. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:23,991][27935] Avg episode reward: [(0, '-49.405')] [2022-07-13 01:46:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4755.6). Total num frames: 116204544. Throughput: 0: 9500.0. Samples: 232419832. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:28,989][27935] Avg episode reward: [(0, '-49.046')] [2022-07-13 01:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4748.6). Total num frames: 116228096. Throughput: 0: 8843.2. Samples: 232448160. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:33,989][27935] Avg episode reward: [(0, '-49.144')] [2022-07-13 01:46:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 116253696. Throughput: 0: 9470.4. Samples: 232505792. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:38,989][27935] Avg episode reward: [(0, '-49.409')] [2022-07-13 01:46:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 116278272. Throughput: 0: 9474.4. Samples: 232563464. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:43,989][27935] Avg episode reward: [(0, '-49.302')] [2022-07-13 01:46:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4752.1). Total num frames: 116300800. Throughput: 0: 9567.5. Samples: 232621268. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:48,990][27935] Avg episode reward: [(0, '-49.127')] [2022-07-13 01:46:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4752.1). Total num frames: 116324352. Throughput: 0: 9572.6. Samples: 232650172. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:53,989][27935] Avg episode reward: [(0, '-47.851')] [2022-07-13 01:46:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4759.0). Total num frames: 116347904. Throughput: 0: 9579.4. Samples: 232708080. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:46:58,989][27935] Avg episode reward: [(0, '-47.879')] [2022-07-13 01:47:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 116371456. Throughput: 0: 9528.8. Samples: 232762584. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:03,989][27935] Avg episode reward: [(0, '-48.916')] [2022-07-13 01:47:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 116396032. Throughput: 0: 9537.5. Samples: 232791508. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:08,989][27935] Avg episode reward: [(0, '-48.996')] [2022-07-13 01:47:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 116420608. Throughput: 0: 9546.8. Samples: 232849440. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:13,989][27935] Avg episode reward: [(0, '-48.991')] [2022-07-13 01:47:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 116443136. Throughput: 0: 10185.2. Samples: 232906496. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:18,989][27935] Avg episode reward: [(0, '-48.988')] [2022-07-13 01:47:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 116467712. Throughput: 0: 9541.4. Samples: 232935156. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:23,989][27935] Avg episode reward: [(0, '-49.060')] [2022-07-13 01:47:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 116490240. Throughput: 0: 9532.3. Samples: 232992416. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:28,989][27935] Avg episode reward: [(0, '-50.735')] [2022-07-13 01:47:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 116515840. Throughput: 0: 9515.4. Samples: 233049460. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:33,989][27935] Avg episode reward: [(0, '-50.695')] [2022-07-13 01:47:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 116539392. Throughput: 0: 9509.4. Samples: 233078096. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:38,989][27935] Avg episode reward: [(0, '-51.528')] [2022-07-13 01:47:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 116562944. Throughput: 0: 9480.0. Samples: 233134680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:43,989][27935] Avg episode reward: [(0, '-51.069')] [2022-07-13 01:47:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 116585472. Throughput: 0: 9536.2. Samples: 233191712. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:48,989][27935] Avg episode reward: [(0, '-51.705')] [2022-07-13 01:47:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4748.6). Total num frames: 116609024. Throughput: 0: 9533.2. Samples: 233220504. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:53,990][27935] Avg episode reward: [(0, '-52.403')] [2022-07-13 01:47:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 116634624. Throughput: 0: 9526.0. Samples: 233278108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:47:58,989][27935] Avg episode reward: [(0, '-52.835')] [2022-07-13 01:48:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 116656128. Throughput: 0: 9437.4. Samples: 233331176. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:48:03,989][27935] Avg episode reward: [(0, '-51.889')] [2022-07-13 01:48:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4755.5). Total num frames: 116679680. Throughput: 0: 9430.5. Samples: 233359528. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:48:08,991][27935] Avg episode reward: [(0, '-50.429')] [2022-07-13 01:48:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4748.6). Total num frames: 116703232. Throughput: 0: 9412.3. Samples: 233415968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:48:13,990][27935] Avg episode reward: [(0, '-50.701')] [2022-07-13 01:48:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 116725760. Throughput: 0: 9402.8. Samples: 233472588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:48:18,989][27935] Avg episode reward: [(0, '-50.164')] [2022-07-13 01:48:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4748.6). Total num frames: 116750336. Throughput: 0: 9397.8. Samples: 233500996. Policy #0 lag: (min: 0.0, avg: 9.5, max: 22.0) [2022-07-13 01:48:23,990][27935] Avg episode reward: [(0, '-48.924')] [2022-07-13 01:48:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4748.6). Total num frames: 116773888. Throughput: 0: 9402.7. Samples: 233557800. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:28,989][27935] Avg episode reward: [(0, '-48.710')] [2022-07-13 01:48:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4752.1). Total num frames: 116797440. Throughput: 0: 9393.1. Samples: 233614400. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:33,989][27935] Avg episode reward: [(0, '-48.903')] [2022-07-13 01:48:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4752.1). Total num frames: 116822016. Throughput: 0: 9386.7. Samples: 233642904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:38,989][27935] Avg episode reward: [(0, '-48.541')] [2022-07-13 01:48:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4752.1). Total num frames: 116845568. Throughput: 0: 9367.7. Samples: 233699656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:43,989][27935] Avg episode reward: [(0, '-48.989')] [2022-07-13 01:48:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4745.1). Total num frames: 116867072. Throughput: 0: 9458.5. Samples: 233756808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:48,989][27935] Avg episode reward: [(0, '-48.832')] [2022-07-13 01:48:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4745.1). Total num frames: 116892672. Throughput: 0: 9461.1. Samples: 233785276. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:53,990][27935] Avg episode reward: [(0, '-48.679')] [2022-07-13 01:48:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4752.1). Total num frames: 116917248. Throughput: 0: 9470.4. Samples: 233842136. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:48:58,990][27935] Avg episode reward: [(0, '-49.328')] [2022-07-13 01:49:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 116937728. Throughput: 0: 9393.2. Samples: 233895284. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:03,989][27935] Avg episode reward: [(0, '-49.300')] [2022-07-13 01:49:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 116961280. Throughput: 0: 9379.9. Samples: 233923092. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:08,991][27935] Avg episode reward: [(0, '-48.854')] [2022-07-13 01:49:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 116984832. Throughput: 0: 9366.3. Samples: 233979284. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:13,990][27935] Avg episode reward: [(0, '-49.444')] [2022-07-13 01:49:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 117008384. Throughput: 0: 9359.7. Samples: 234035588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:18,989][27935] Avg episode reward: [(0, '-49.707')] [2022-07-13 01:49:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4741.6). Total num frames: 117030912. Throughput: 0: 9362.0. Samples: 234064196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:23,990][27935] Avg episode reward: [(0, '-49.290')] [2022-07-13 01:49:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4745.1). Total num frames: 117055488. Throughput: 0: 9351.2. Samples: 234120460. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:28,990][27935] Avg episode reward: [(0, '-49.525')] [2022-07-13 01:49:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 117079040. Throughput: 0: 9332.9. Samples: 234176788. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:33,991][27935] Avg episode reward: [(0, '-49.748')] [2022-07-13 01:49:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4741.6). Total num frames: 117102592. Throughput: 0: 9334.8. Samples: 234205344. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:38,991][27935] Avg episode reward: [(0, '-50.104')] [2022-07-13 01:49:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4738.2). Total num frames: 117125120. Throughput: 0: 9328.2. Samples: 234261904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:43,989][27935] Avg episode reward: [(0, '-49.784')] [2022-07-13 01:49:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 117148672. Throughput: 0: 9403.3. Samples: 234318432. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:48,991][27935] Avg episode reward: [(0, '-48.349')] [2022-07-13 01:49:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4731.2). Total num frames: 117172224. Throughput: 0: 9419.6. Samples: 234346972. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:53,989][27935] Avg episode reward: [(0, '-48.569')] [2022-07-13 01:49:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4745.1). Total num frames: 117197824. Throughput: 0: 9429.1. Samples: 234403592. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:49:58,996][27935] Avg episode reward: [(0, '-47.772')] [2022-07-13 01:50:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 117219328. Throughput: 0: 9350.8. Samples: 234456372. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:50:03,989][27935] Avg episode reward: [(0, '-48.095')] [2022-07-13 01:50:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4727.8). Total num frames: 117241856. Throughput: 0: 9350.1. Samples: 234484952. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:50:08,989][27935] Avg episode reward: [(0, '-47.330')] [2022-07-13 01:50:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4727.8). Total num frames: 117265408. Throughput: 0: 9366.0. Samples: 234541932. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:50:13,990][27935] Avg episode reward: [(0, '-46.797')] [2022-07-13 01:50:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4724.3). Total num frames: 117288960. Throughput: 0: 9380.2. Samples: 234598896. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:50:18,989][27935] Avg episode reward: [(0, '-47.444')] [2022-07-13 01:50:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 117313536. Throughput: 0: 9386.5. Samples: 234627736. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 01:50:23,989][27935] Avg episode reward: [(0, '-47.229')] [2022-07-13 01:50:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4720.8). Total num frames: 117336064. Throughput: 0: 9375.9. Samples: 234683820. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:28,989][27935] Avg episode reward: [(0, '-47.262')] [2022-07-13 01:50:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 117361664. Throughput: 0: 9373.0. Samples: 234740216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:33,989][27935] Avg episode reward: [(0, '-48.020')] [2022-07-13 01:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4720.8). Total num frames: 117384192. Throughput: 0: 9374.1. Samples: 234768808. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:38,989][27935] Avg episode reward: [(0, '-47.499')] [2022-07-13 01:50:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 117407744. Throughput: 0: 9396.7. Samples: 234826444. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:43,992][27935] Avg episode reward: [(0, '-48.081')] [2022-07-13 01:50:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 117432320. Throughput: 0: 9494.9. Samples: 234883644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:48,989][27935] Avg episode reward: [(0, '-48.570')] [2022-07-13 01:50:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 117455872. Throughput: 0: 9503.2. Samples: 234912596. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:53,989][27935] Avg episode reward: [(0, '-48.658')] [2022-07-13 01:50:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4724.3). Total num frames: 117480448. Throughput: 0: 9506.9. Samples: 234969744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:50:58,989][27935] Avg episode reward: [(0, '-48.867')] [2022-07-13 01:51:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 117502976. Throughput: 0: 9424.3. Samples: 235022988. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:03,989][27935] Avg episode reward: [(0, '-48.611')] [2022-07-13 01:51:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 117526528. Throughput: 0: 9424.7. Samples: 235051848. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:08,990][27935] Avg episode reward: [(0, '-48.775')] [2022-07-13 01:51:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 117549056. Throughput: 0: 9458.6. Samples: 235109456. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:13,989][27935] Avg episode reward: [(0, '-48.827')] [2022-07-13 01:51:18,997][27935] Fps is (10 sec: 4706.8, 60 sec: 4743.9, 300 sec: 4720.7). Total num frames: 117573632. Throughput: 0: 9463.6. Samples: 235166152. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:18,997][27935] Avg episode reward: [(0, '-48.543')] [2022-07-13 01:51:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 117597184. Throughput: 0: 9468.7. Samples: 235194900. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:23,989][27935] Avg episode reward: [(0, '-48.274')] [2022-07-13 01:51:28,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 117620736. Throughput: 0: 9455.4. Samples: 235251936. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:28,989][27935] Avg episode reward: [(0, '-48.293')] [2022-07-13 01:51:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 117645312. Throughput: 0: 9460.0. Samples: 235309344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:33,989][27935] Avg episode reward: [(0, '-49.709')] [2022-07-13 01:51:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 117668864. Throughput: 0: 9453.5. Samples: 235338004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:38,989][27935] Avg episode reward: [(0, '-49.832')] [2022-07-13 01:51:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 117692416. Throughput: 0: 9466.8. Samples: 235395748. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:43,989][27935] Avg episode reward: [(0, '-49.054')] [2022-07-13 01:51:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 117716992. Throughput: 0: 9562.1. Samples: 235453284. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:48,989][27935] Avg episode reward: [(0, '-48.943')] [2022-07-13 01:51:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 117740544. Throughput: 0: 9556.7. Samples: 235481900. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:53,989][27935] Avg episode reward: [(0, '-48.910')] [2022-07-13 01:51:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4724.3). Total num frames: 117765120. Throughput: 0: 9556.4. Samples: 235539492. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:51:58,989][27935] Avg episode reward: [(0, '-49.425')] [2022-07-13 01:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 117786624. Throughput: 0: 9496.9. Samples: 235593440. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:52:03,989][27935] Avg episode reward: [(0, '-48.893')] [2022-07-13 01:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 117811200. Throughput: 0: 9497.3. Samples: 235622280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:52:08,989][27935] Avg episode reward: [(0, '-48.435')] [2022-07-13 01:52:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4717.3). Total num frames: 117834752. Throughput: 0: 9502.9. Samples: 235679568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:52:13,989][27935] Avg episode reward: [(0, '-48.760')] [2022-07-13 01:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4762.2, 300 sec: 4717.3). Total num frames: 117859328. Throughput: 0: 9498.4. Samples: 235736772. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:52:18,989][27935] Avg episode reward: [(0, '-49.006')] [2022-07-13 01:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 117882880. Throughput: 0: 9496.5. Samples: 235765348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 01:52:23,989][27935] Avg episode reward: [(0, '-48.651')] [2022-07-13 01:52:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 117905408. Throughput: 0: 9483.8. Samples: 235822520. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:28,989][27935] Avg episode reward: [(0, '-48.524')] [2022-07-13 01:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4717.3). Total num frames: 117931008. Throughput: 0: 9469.2. Samples: 235879400. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:33,989][27935] Avg episode reward: [(0, '-48.346')] [2022-07-13 01:52:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 117952512. Throughput: 0: 9471.2. Samples: 235908104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:38,990][27935] Avg episode reward: [(0, '-48.433')] [2022-07-13 01:52:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 117977088. Throughput: 0: 9448.0. Samples: 235964652. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:43,989][27935] Avg episode reward: [(0, '-48.053')] [2022-07-13 01:52:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4724.3). Total num frames: 118002688. Throughput: 0: 9515.6. Samples: 236021644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:48,989][27935] Avg episode reward: [(0, '-47.800')] [2022-07-13 01:52:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 118024192. Throughput: 0: 9509.2. Samples: 236050192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:53,989][27935] Avg episode reward: [(0, '-47.526')] [2022-07-13 01:52:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 118048768. Throughput: 0: 9515.2. Samples: 236107752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:52:58,989][27935] Avg episode reward: [(0, '-47.796')] [2022-07-13 01:53:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 118071296. Throughput: 0: 9428.6. Samples: 236161060. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:03,989][27935] Avg episode reward: [(0, '-48.410')] [2022-07-13 01:53:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 118094848. Throughput: 0: 9425.1. Samples: 236189476. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:08,991][27935] Avg episode reward: [(0, '-49.465')] [2022-07-13 01:53:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 118118400. Throughput: 0: 9438.2. Samples: 236247240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:13,989][27935] Avg episode reward: [(0, '-49.734')] [2022-07-13 01:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 118142976. Throughput: 0: 9448.4. Samples: 236304580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:18,990][27935] Avg episode reward: [(0, '-49.925')] [2022-07-13 01:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 118166528. Throughput: 0: 9446.1. Samples: 236333180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:23,989][27935] Avg episode reward: [(0, '-50.143')] [2022-07-13 01:53:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 118190080. Throughput: 0: 9459.9. Samples: 236390348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:28,991][27935] Avg episode reward: [(0, '-49.883')] [2022-07-13 01:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4717.3). Total num frames: 118213632. Throughput: 0: 9463.0. Samples: 236447480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:33,989][27935] Avg episode reward: [(0, '-49.821')] [2022-07-13 01:53:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 118237184. Throughput: 0: 9460.7. Samples: 236475924. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:38,989][27935] Avg episode reward: [(0, '-49.269')] [2022-07-13 01:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4727.8). Total num frames: 118261760. Throughput: 0: 9463.8. Samples: 236533624. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:43,989][27935] Avg episode reward: [(0, '-48.108')] [2022-07-13 01:53:48,992][27935] Fps is (10 sec: 4913.8, 60 sec: 4727.2, 300 sec: 4724.2). Total num frames: 118286336. Throughput: 0: 9540.3. Samples: 236590400. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:48,992][27935] Avg episode reward: [(0, '-47.704')] [2022-07-13 01:53:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 118309888. Throughput: 0: 9548.4. Samples: 236619152. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:53,989][27935] Avg episode reward: [(0, '-47.775')] [2022-07-13 01:53:58,989][27935] Fps is (10 sec: 4711.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 118333440. Throughput: 0: 9542.6. Samples: 236676656. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:53:58,989][27935] Avg episode reward: [(0, '-47.216')] [2022-07-13 01:54:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4724.3). Total num frames: 118354944. Throughput: 0: 9458.9. Samples: 236730228. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:03,989][27935] Avg episode reward: [(0, '-47.727')] [2022-07-13 01:54:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4731.2). Total num frames: 118380544. Throughput: 0: 9458.3. Samples: 236758804. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:08,989][27935] Avg episode reward: [(0, '-47.157')] [2022-07-13 01:54:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4727.8). Total num frames: 118403072. Throughput: 0: 9450.7. Samples: 236815628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:13,989][27935] Avg episode reward: [(0, '-47.741')] [2022-07-13 01:54:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4731.2). Total num frames: 118426624. Throughput: 0: 9456.4. Samples: 236873020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:18,989][27935] Avg episode reward: [(0, '-47.782')] [2022-07-13 01:54:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 118451200. Throughput: 0: 9467.6. Samples: 236901968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:23,990][27935] Avg episode reward: [(0, '-48.133')] [2022-07-13 01:54:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 118474752. Throughput: 0: 9464.5. Samples: 236959528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 01:54:28,989][27935] Avg episode reward: [(0, '-48.487')] [2022-07-13 01:54:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4734.7). Total num frames: 118499328. Throughput: 0: 9462.6. Samples: 237016188. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:33,989][27935] Avg episode reward: [(0, '-49.294')] [2022-07-13 01:54:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 118521856. Throughput: 0: 9455.2. Samples: 237044636. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:38,989][27935] Avg episode reward: [(0, '-50.582')] [2022-07-13 01:54:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 118545408. Throughput: 0: 9448.8. Samples: 237101852. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:43,989][27935] Avg episode reward: [(0, '-51.109')] [2022-07-13 01:54:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.7, 300 sec: 4738.2). Total num frames: 118569984. Throughput: 0: 9524.0. Samples: 237158808. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:48,989][27935] Avg episode reward: [(0, '-50.604')] [2022-07-13 01:54:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4731.2). Total num frames: 118593536. Throughput: 0: 9523.1. Samples: 237187344. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:53,989][27935] Avg episode reward: [(0, '-50.256')] [2022-07-13 01:54:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 118617088. Throughput: 0: 9527.1. Samples: 237244348. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:54:58,990][27935] Avg episode reward: [(0, '-50.166')] [2022-07-13 01:55:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 118639616. Throughput: 0: 9424.5. Samples: 237297120. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:03,991][27935] Avg episode reward: [(0, '-49.644')] [2022-07-13 01:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4738.2). Total num frames: 118663168. Throughput: 0: 9417.4. Samples: 237325752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:08,989][27935] Avg episode reward: [(0, '-49.565')] [2022-07-13 01:55:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 118686720. Throughput: 0: 9406.6. Samples: 237382824. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:13,989][27935] Avg episode reward: [(0, '-48.713')] [2022-07-13 01:55:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 118710272. Throughput: 0: 9411.7. Samples: 237439716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:18,991][27935] Avg episode reward: [(0, '-47.500')] [2022-07-13 01:55:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4738.2). Total num frames: 118733824. Throughput: 0: 9423.0. Samples: 237468672. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:23,991][27935] Avg episode reward: [(0, '-47.277')] [2022-07-13 01:55:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4731.2). Total num frames: 118757376. Throughput: 0: 9412.2. Samples: 237525400. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:28,989][27935] Avg episode reward: [(0, '-46.882')] [2022-07-13 01:55:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4734.7). Total num frames: 118780928. Throughput: 0: 9405.8. Samples: 237582068. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:33,989][27935] Avg episode reward: [(0, '-46.539')] [2022-07-13 01:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 118805504. Throughput: 0: 9412.1. Samples: 237610888. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:38,989][27935] Avg episode reward: [(0, '-46.637')] [2022-07-13 01:55:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 118830080. Throughput: 0: 9435.7. Samples: 237668956. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:43,990][27935] Avg episode reward: [(0, '-45.951')] [2022-07-13 01:55:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 118853632. Throughput: 0: 9533.8. Samples: 237726140. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:48,989][27935] Avg episode reward: [(0, '-45.257')] [2022-07-13 01:55:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 118877184. Throughput: 0: 9540.4. Samples: 237755072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:53,989][27935] Avg episode reward: [(0, '-45.623')] [2022-07-13 01:55:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 118901760. Throughput: 0: 9556.1. Samples: 237812848. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:55:58,989][27935] Avg episode reward: [(0, '-46.253')] [2022-07-13 01:56:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 118924288. Throughput: 0: 9474.8. Samples: 237866080. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:03,991][27935] Avg episode reward: [(0, '-47.627')] [2022-07-13 01:56:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 118946816. Throughput: 0: 9464.1. Samples: 237894556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:08,990][27935] Avg episode reward: [(0, '-47.976')] [2022-07-13 01:56:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.8). Total num frames: 118970368. Throughput: 0: 9482.5. Samples: 237952112. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:13,992][27935] Avg episode reward: [(0, '-48.548')] [2022-07-13 01:56:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 118994944. Throughput: 0: 9492.3. Samples: 238009220. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:18,989][27935] Avg episode reward: [(0, '-48.807')] [2022-07-13 01:56:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4741.6). Total num frames: 119019520. Throughput: 0: 9493.6. Samples: 238038100. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:23,989][27935] Avg episode reward: [(0, '-48.599')] [2022-07-13 01:56:29,005][27935] Fps is (10 sec: 4805.2, 60 sec: 4760.3, 300 sec: 4737.9). Total num frames: 119043072. Throughput: 0: 9483.9. Samples: 238095880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:56:29,005][27935] Avg episode reward: [(0, '-48.870')] [2022-07-13 01:56:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4731.2). Total num frames: 119064576. Throughput: 0: 9442.3. Samples: 238151044. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:33,989][27935] Avg episode reward: [(0, '-49.047')] [2022-07-13 01:56:38,989][27935] Fps is (10 sec: 4717.9, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 119090176. Throughput: 0: 9430.5. Samples: 238179444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:38,989][27935] Avg episode reward: [(0, '-48.808')] [2022-07-13 01:56:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 119113728. Throughput: 0: 9416.4. Samples: 238236584. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:43,989][27935] Avg episode reward: [(0, '-48.551')] [2022-07-13 01:56:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 119137280. Throughput: 0: 9503.5. Samples: 238293740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:48,989][27935] Avg episode reward: [(0, '-49.433')] [2022-07-13 01:56:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4727.8). Total num frames: 119159808. Throughput: 0: 9500.8. Samples: 238322092. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:53,994][27935] Avg episode reward: [(0, '-50.344')] [2022-07-13 01:56:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 119185408. Throughput: 0: 9501.1. Samples: 238379660. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:56:58,989][27935] Avg episode reward: [(0, '-51.343')] [2022-07-13 01:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4731.2). Total num frames: 119206912. Throughput: 0: 9428.3. Samples: 238433496. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:03,989][27935] Avg episode reward: [(0, '-51.283')] [2022-07-13 01:57:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 119231488. Throughput: 0: 9427.5. Samples: 238462336. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:08,989][27935] Avg episode reward: [(0, '-51.100')] [2022-07-13 01:57:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 119254016. Throughput: 0: 9421.3. Samples: 238519692. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:13,989][27935] Avg episode reward: [(0, '-50.939')] [2022-07-13 01:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 119279616. Throughput: 0: 9471.3. Samples: 238577252. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:18,989][27935] Avg episode reward: [(0, '-50.899')] [2022-07-13 01:57:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4738.2). Total num frames: 119303168. Throughput: 0: 9478.5. Samples: 238605976. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:23,989][27935] Avg episode reward: [(0, '-50.798')] [2022-07-13 01:57:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4745.8, 300 sec: 4734.7). Total num frames: 119327744. Throughput: 0: 9498.9. Samples: 238664036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:28,989][27935] Avg episode reward: [(0, '-50.752')] [2022-07-13 01:57:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4741.6). Total num frames: 119351296. Throughput: 0: 9494.9. Samples: 238721012. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:33,989][27935] Avg episode reward: [(0, '-49.125')] [2022-07-13 01:57:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4734.7). Total num frames: 119373824. Throughput: 0: 9506.7. Samples: 238749892. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:38,989][27935] Avg episode reward: [(0, '-48.909')] [2022-07-13 01:57:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4731.2). Total num frames: 119398400. Throughput: 0: 9492.1. Samples: 238806804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:43,989][27935] Avg episode reward: [(0, '-49.157')] [2022-07-13 01:57:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4741.6). Total num frames: 119422976. Throughput: 0: 9581.7. Samples: 238864672. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:48,989][27935] Avg episode reward: [(0, '-48.765')] [2022-07-13 01:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4741.6). Total num frames: 119447552. Throughput: 0: 9587.0. Samples: 238893752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:53,991][27935] Avg episode reward: [(0, '-47.470')] [2022-07-13 01:57:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 119470080. Throughput: 0: 9565.6. Samples: 238950144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:57:58,991][27935] Avg episode reward: [(0, '-47.537')] [2022-07-13 01:58:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4744.5, 300 sec: 4734.7). Total num frames: 119491584. Throughput: 0: 9443.3. Samples: 239002200. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:03,991][27935] Avg episode reward: [(0, '-47.300')] [2022-07-13 01:58:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4693.3, 300 sec: 4727.8). Total num frames: 119513088. Throughput: 0: 9419.7. Samples: 239029864. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:08,991][27935] Avg episode reward: [(0, '-47.679')] [2022-07-13 01:58:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4727.8). Total num frames: 119537664. Throughput: 0: 9365.4. Samples: 239085480. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:13,989][27935] Avg episode reward: [(0, '-46.982')] [2022-07-13 01:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4727.8). Total num frames: 119561216. Throughput: 0: 9339.3. Samples: 239141280. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:18,990][27935] Avg episode reward: [(0, '-46.785')] [2022-07-13 01:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4731.2). Total num frames: 119585792. Throughput: 0: 9322.9. Samples: 239169420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:23,989][27935] Avg episode reward: [(0, '-47.654')] [2022-07-13 01:58:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4724.3). Total num frames: 119607296. Throughput: 0: 9296.4. Samples: 239225140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:28,989][27935] Avg episode reward: [(0, '-48.021')] [2022-07-13 01:58:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4724.3). Total num frames: 119630848. Throughput: 0: 9248.0. Samples: 239280832. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 01:58:33,989][27935] Avg episode reward: [(0, '-48.233')] [2022-07-13 01:58:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4717.3). Total num frames: 119653376. Throughput: 0: 9218.5. Samples: 239308584. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:58:38,989][27935] Avg episode reward: [(0, '-47.027')] [2022-07-13 01:58:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4710.4). Total num frames: 119675904. Throughput: 0: 9199.9. Samples: 239364140. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:58:43,989][27935] Avg episode reward: [(0, '-47.133')] [2022-07-13 01:58:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4710.4). Total num frames: 119699456. Throughput: 0: 9263.9. Samples: 239419076. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:58:48,989][27935] Avg episode reward: [(0, '-47.079')] [2022-07-13 01:58:53,997][27935] Fps is (10 sec: 4706.7, 60 sec: 4590.3, 300 sec: 4710.3). Total num frames: 119723008. Throughput: 0: 9261.3. Samples: 239446696. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:58:53,997][27935] Avg episode reward: [(0, '-47.714')] [2022-07-13 01:58:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4717.3). Total num frames: 119746560. Throughput: 0: 9261.3. Samples: 239502240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:58:58,989][27935] Avg episode reward: [(0, '-47.483')] [2022-07-13 01:59:03,989][27935] Fps is (10 sec: 4611.6, 60 sec: 4625.1, 300 sec: 4706.9). Total num frames: 119769088. Throughput: 0: 9166.2. Samples: 239553760. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:03,989][27935] Avg episode reward: [(0, '-46.879')] [2022-07-13 01:59:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4608.0, 300 sec: 4700.0). Total num frames: 119789568. Throughput: 0: 9150.4. Samples: 239581188. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:08,989][27935] Avg episode reward: [(0, '-47.952')] [2022-07-13 01:59:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 4700.0). Total num frames: 119813120. Throughput: 0: 9136.5. Samples: 239636284. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:13,989][27935] Avg episode reward: [(0, '-48.748')] [2022-07-13 01:59:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4556.8, 300 sec: 4689.6). Total num frames: 119834624. Throughput: 0: 9131.4. Samples: 239691744. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:18,989][27935] Avg episode reward: [(0, '-49.281')] [2022-07-13 01:59:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4608.0, 300 sec: 4703.5). Total num frames: 119862272. Throughput: 0: 9187.8. Samples: 239722036. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:23,989][27935] Avg episode reward: [(0, '-49.208')] [2022-07-13 01:59:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4659.2, 300 sec: 4703.5). Total num frames: 119886848. Throughput: 0: 9321.2. Samples: 239783596. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:28,989][27935] Avg episode reward: [(0, '-49.237')] [2022-07-13 01:59:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 119912448. Throughput: 0: 9462.1. Samples: 239844868. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:33,989][27935] Avg episode reward: [(0, '-49.557')] [2022-07-13 01:59:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4744.5, 300 sec: 4720.8). Total num frames: 119938048. Throughput: 0: 9537.2. Samples: 239875796. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:38,989][27935] Avg episode reward: [(0, '-50.086')] [2022-07-13 01:59:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4795.7, 300 sec: 4724.3). Total num frames: 119963648. Throughput: 0: 9649.4. Samples: 239936464. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:43,990][27935] Avg episode reward: [(0, '-49.502')] [2022-07-13 01:59:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4731.2). Total num frames: 119989248. Throughput: 0: 9884.9. Samples: 239998580. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:48,991][27935] Avg episode reward: [(0, '-49.138')] [2022-07-13 01:59:53,992][27935] Fps is (10 sec: 5220.6, 60 sec: 4881.4, 300 sec: 4741.6). Total num frames: 120015872. Throughput: 0: 9969.4. Samples: 240029848. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:53,994][27935] Avg episode reward: [(0, '-48.956')] [2022-07-13 01:59:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4915.2, 300 sec: 4752.1). Total num frames: 120041472. Throughput: 0: 10127.5. Samples: 240092020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 01:59:58,989][27935] Avg episode reward: [(0, '-48.521')] [2022-07-13 02:00:03,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4932.3, 300 sec: 4752.1). Total num frames: 120065024. Throughput: 0: 9585.3. Samples: 240123084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:03,989][27935] Avg episode reward: [(0, '-48.597')] [2022-07-13 02:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4762.5). Total num frames: 120091648. Throughput: 0: 10229.7. Samples: 240182372. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:08,989][27935] Avg episode reward: [(0, '-48.261')] [2022-07-13 02:00:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 4769.4). Total num frames: 120117248. Throughput: 0: 10259.6. Samples: 240245276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:13,989][27935] Avg episode reward: [(0, '-48.918')] [2022-07-13 02:00:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 4783.3). Total num frames: 120144896. Throughput: 0: 10295.3. Samples: 240308156. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:18,989][27935] Avg episode reward: [(0, '-49.002')] [2022-07-13 02:00:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 4786.8). Total num frames: 120169472. Throughput: 0: 10306.7. Samples: 240339596. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:23,989][27935] Avg episode reward: [(0, '-48.692')] [2022-07-13 02:00:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 4800.7). Total num frames: 120197120. Throughput: 0: 10362.1. Samples: 240402756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:28,990][27935] Avg episode reward: [(0, '-49.534')] [2022-07-13 02:00:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 4804.1). Total num frames: 120222720. Throughput: 0: 10373.0. Samples: 240465364. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 02:00:33,989][27935] Avg episode reward: [(0, '-48.786')] [2022-07-13 02:00:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 4814.5). Total num frames: 120250368. Throughput: 0: 10382.4. Samples: 240497020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:00:38,993][27935] Avg episode reward: [(0, '-48.075')] [2022-07-13 02:00:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 4818.0). Total num frames: 120274944. Throughput: 0: 10402.7. Samples: 240560140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:00:43,989][27935] Avg episode reward: [(0, '-47.895')] [2022-07-13 02:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4831.9). Total num frames: 120302592. Throughput: 0: 11117.6. Samples: 240623376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:00:48,989][27935] Avg episode reward: [(0, '-47.745')] [2022-07-13 02:00:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.6, 300 sec: 4831.9). Total num frames: 120327168. Throughput: 0: 10506.1. Samples: 240655144. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:00:53,989][27935] Avg episode reward: [(0, '-48.602')] [2022-07-13 02:00:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4845.8). Total num frames: 120353792. Throughput: 0: 10519.9. Samples: 240718672. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:00:58,989][27935] Avg episode reward: [(0, '-48.289')] [2022-07-13 02:01:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4856.2). Total num frames: 120379392. Throughput: 0: 10431.3. Samples: 240777564. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:03,989][27935] Avg episode reward: [(0, '-48.334')] [2022-07-13 02:01:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4866.6). Total num frames: 120406016. Throughput: 0: 10429.5. Samples: 240808924. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:08,989][27935] Avg episode reward: [(0, '-48.365')] [2022-07-13 02:01:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5222.4, 300 sec: 4866.6). Total num frames: 120430592. Throughput: 0: 10406.1. Samples: 240871032. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:13,989][27935] Avg episode reward: [(0, '-48.948')] [2022-07-13 02:01:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4873.5). Total num frames: 120457216. Throughput: 0: 10405.8. Samples: 240933628. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:18,989][27935] Avg episode reward: [(0, '-48.104')] [2022-07-13 02:01:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4880.8). Total num frames: 120482816. Throughput: 0: 10403.9. Samples: 240965196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:23,991][27935] Avg episode reward: [(0, '-48.150')] [2022-07-13 02:01:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5205.3, 300 sec: 4897.8). Total num frames: 120509440. Throughput: 0: 10403.6. Samples: 241028304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:28,989][27935] Avg episode reward: [(0, '-47.679')] [2022-07-13 02:01:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4897.8). Total num frames: 120535040. Throughput: 0: 10397.0. Samples: 241091240. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:33,990][27935] Avg episode reward: [(0, '-47.655')] [2022-07-13 02:01:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 4911.7). Total num frames: 120562688. Throughput: 0: 10398.1. Samples: 241123060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:38,991][27935] Avg episode reward: [(0, '-48.026')] [2022-07-13 02:01:43,990][27935] Fps is (10 sec: 5221.8, 60 sec: 5205.2, 300 sec: 4915.2). Total num frames: 120587264. Throughput: 0: 10387.5. Samples: 241186120. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:43,991][27935] Avg episode reward: [(0, '-48.171')] [2022-07-13 02:01:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 4929.1). Total num frames: 120613888. Throughput: 0: 10487.0. Samples: 241249480. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:48,989][27935] Avg episode reward: [(0, '-47.999')] [2022-07-13 02:01:53,989][27935] Fps is (10 sec: 5530.2, 60 sec: 5256.5, 300 sec: 4939.5). Total num frames: 120642560. Throughput: 0: 10500.7. Samples: 241281456. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:53,989][27935] Avg episode reward: [(0, '-48.120')] [2022-07-13 02:01:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 4949.9). Total num frames: 120667136. Throughput: 0: 10534.0. Samples: 241345060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:01:58,989][27935] Avg episode reward: [(0, '-48.633')] [2022-07-13 02:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 4953.4). Total num frames: 120692736. Throughput: 0: 10468.1. Samples: 241404692. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:03,989][27935] Avg episode reward: [(0, '-48.431')] [2022-07-13 02:02:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4963.8). Total num frames: 120718336. Throughput: 0: 10457.1. Samples: 241435764. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:08,989][27935] Avg episode reward: [(0, '-48.192')] [2022-07-13 02:02:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 4970.7). Total num frames: 120745984. Throughput: 0: 10467.9. Samples: 241499360. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:13,992][27935] Avg episode reward: [(0, '-47.741')] [2022-07-13 02:02:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4974.2). Total num frames: 120770560. Throughput: 0: 10477.1. Samples: 241562708. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:18,989][27935] Avg episode reward: [(0, '-47.845')] [2022-07-13 02:02:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 4988.1). Total num frames: 120799232. Throughput: 0: 10487.7. Samples: 241595008. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:23,989][27935] Avg episode reward: [(0, '-47.460')] [2022-07-13 02:02:28,990][27935] Fps is (10 sec: 5426.6, 60 sec: 5256.4, 300 sec: 4995.0). Total num frames: 120824832. Throughput: 0: 10503.0. Samples: 241658756. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:28,990][27935] Avg episode reward: [(0, '-46.884')] [2022-07-13 02:02:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5002.0). Total num frames: 120849408. Throughput: 0: 10478.7. Samples: 241721020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:33,989][27935] Avg episode reward: [(0, '-46.321')] [2022-07-13 02:02:38,989][27935] Fps is (10 sec: 5120.5, 60 sec: 5222.4, 300 sec: 5008.9). Total num frames: 120876032. Throughput: 0: 10435.8. Samples: 241751068. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 02:02:38,989][27935] Avg episode reward: [(0, '-46.495')] [2022-07-13 02:02:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.6, 300 sec: 5015.9). Total num frames: 120902656. Throughput: 0: 10396.1. Samples: 241812884. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:02:43,989][27935] Avg episode reward: [(0, '-46.838')] [2022-07-13 02:02:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5019.3). Total num frames: 120928256. Throughput: 0: 10480.2. Samples: 241876300. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:02:48,989][27935] Avg episode reward: [(0, '-47.504')] [2022-07-13 02:02:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5033.2). Total num frames: 120954880. Throughput: 0: 10500.3. Samples: 241908276. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:02:53,989][27935] Avg episode reward: [(0, '-47.699')] [2022-07-13 02:02:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5050.6). Total num frames: 120981504. Throughput: 0: 10500.3. Samples: 241971872. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:02:58,989][27935] Avg episode reward: [(0, '-48.312')] [2022-07-13 02:03:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5061.0). Total num frames: 121006080. Throughput: 0: 10410.7. Samples: 242031188. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:03,989][27935] Avg episode reward: [(0, '-48.629')] [2022-07-13 02:03:08,992][27935] Fps is (10 sec: 5015.9, 60 sec: 5222.1, 300 sec: 5064.4). Total num frames: 121031680. Throughput: 0: 10395.9. Samples: 242062860. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:08,993][27935] Avg episode reward: [(0, '-48.605')] [2022-07-13 02:03:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5074.9). Total num frames: 121058304. Throughput: 0: 10383.3. Samples: 242125996. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:13,989][27935] Avg episode reward: [(0, '-48.286')] [2022-07-13 02:03:18,989][27935] Fps is (10 sec: 5429.0, 60 sec: 5256.5, 300 sec: 5085.3). Total num frames: 121085952. Throughput: 0: 10398.6. Samples: 242188956. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:18,989][27935] Avg episode reward: [(0, '-47.787')] [2022-07-13 02:03:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5099.2). Total num frames: 121111552. Throughput: 0: 10440.0. Samples: 242220868. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:23,989][27935] Avg episode reward: [(0, '-48.004')] [2022-07-13 02:03:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5106.1). Total num frames: 121137152. Throughput: 0: 10475.5. Samples: 242284284. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:28,990][27935] Avg episode reward: [(0, '-47.637')] [2022-07-13 02:03:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5120.0). Total num frames: 121163776. Throughput: 0: 10455.7. Samples: 242346808. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:33,989][27935] Avg episode reward: [(0, '-48.639')] [2022-07-13 02:03:38,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5256.5, 300 sec: 5137.4). Total num frames: 121191424. Throughput: 0: 10459.7. Samples: 242378964. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:38,989][27935] Avg episode reward: [(0, '-48.857')] [2022-07-13 02:03:43,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5222.3, 300 sec: 5140.8). Total num frames: 121216000. Throughput: 0: 10474.2. Samples: 242443220. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:43,990][27935] Avg episode reward: [(0, '-49.415')] [2022-07-13 02:03:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5154.8). Total num frames: 121243648. Throughput: 0: 10573.4. Samples: 242506992. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:48,991][27935] Avg episode reward: [(0, '-49.025')] [2022-07-13 02:03:53,989][27935] Fps is (10 sec: 5427.6, 60 sec: 5256.5, 300 sec: 5165.1). Total num frames: 121270272. Throughput: 0: 10582.9. Samples: 242539056. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:53,991][27935] Avg episode reward: [(0, '-48.108')] [2022-07-13 02:03:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5179.0). Total num frames: 121296896. Throughput: 0: 10605.4. Samples: 242603240. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:03:58,991][27935] Avg episode reward: [(0, '-48.478')] [2022-07-13 02:04:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5192.9). Total num frames: 121321472. Throughput: 0: 10538.8. Samples: 242663200. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:03,989][27935] Avg episode reward: [(0, '-47.817')] [2022-07-13 02:04:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.9, 300 sec: 5203.3). Total num frames: 121348096. Throughput: 0: 10533.8. Samples: 242694888. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:08,991][27935] Avg episode reward: [(0, '-47.700')] [2022-07-13 02:04:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5220.7). Total num frames: 121374720. Throughput: 0: 10535.1. Samples: 242758364. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:13,989][27935] Avg episode reward: [(0, '-47.938')] [2022-07-13 02:04:19,001][27935] Fps is (10 sec: 5318.5, 60 sec: 5255.5, 300 sec: 5217.0). Total num frames: 121401344. Throughput: 0: 10554.5. Samples: 242821884. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:19,001][27935] Avg episode reward: [(0, '-48.743')] [2022-07-13 02:04:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 121427968. Throughput: 0: 10559.6. Samples: 242854144. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:23,989][27935] Avg episode reward: [(0, '-48.886')] [2022-07-13 02:04:28,989][27935] Fps is (10 sec: 5433.6, 60 sec: 5307.7, 300 sec: 5231.1). Total num frames: 121455616. Throughput: 0: 10557.9. Samples: 242918316. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:28,989][27935] Avg episode reward: [(0, '-48.267')] [2022-07-13 02:04:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 121480192. Throughput: 0: 10559.2. Samples: 242982156. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:33,989][27935] Avg episode reward: [(0, '-48.166')] [2022-07-13 02:04:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.6). Total num frames: 121507840. Throughput: 0: 10560.2. Samples: 243014264. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 02:04:38,989][27935] Avg episode reward: [(0, '-48.210')] [2022-07-13 02:04:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.9, 300 sec: 5241.5). Total num frames: 121535488. Throughput: 0: 10560.7. Samples: 243078472. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:04:43,989][27935] Avg episode reward: [(0, '-47.601')] [2022-07-13 02:04:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.6). Total num frames: 121560064. Throughput: 0: 10636.9. Samples: 243141860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:04:48,989][27935] Avg episode reward: [(0, '-47.183')] [2022-07-13 02:04:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 121585664. Throughput: 0: 10624.3. Samples: 243172980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:04:53,989][27935] Avg episode reward: [(0, '-46.908')] [2022-07-13 02:04:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 121614336. Throughput: 0: 10594.9. Samples: 243235136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:04:58,989][27935] Avg episode reward: [(0, '-47.762')] [2022-07-13 02:05:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 121637888. Throughput: 0: 10498.0. Samples: 243294172. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:03,989][27935] Avg episode reward: [(0, '-47.742')] [2022-07-13 02:05:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 121663488. Throughput: 0: 10473.1. Samples: 243325432. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:08,989][27935] Avg episode reward: [(0, '-47.649')] [2022-07-13 02:05:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 121689088. Throughput: 0: 10445.6. Samples: 243388368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:13,989][27935] Avg episode reward: [(0, '-48.023')] [2022-07-13 02:05:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5257.6, 300 sec: 5245.0). Total num frames: 121716736. Throughput: 0: 10423.2. Samples: 243451200. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:18,989][27935] Avg episode reward: [(0, '-47.968')] [2022-07-13 02:05:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 121742336. Throughput: 0: 10409.1. Samples: 243482676. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:23,991][27935] Avg episode reward: [(0, '-48.010')] [2022-07-13 02:05:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 121767936. Throughput: 0: 10375.1. Samples: 243545352. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:28,991][27935] Avg episode reward: [(0, '-47.733')] [2022-07-13 02:05:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 121795584. Throughput: 0: 10343.0. Samples: 243607296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:33,990][27935] Avg episode reward: [(0, '-46.539')] [2022-07-13 02:05:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 121820160. Throughput: 0: 10341.9. Samples: 243638364. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:38,989][27935] Avg episode reward: [(0, '-46.858')] [2022-07-13 02:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5227.6). Total num frames: 121844736. Throughput: 0: 10354.1. Samples: 243701072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:43,991][27935] Avg episode reward: [(0, '-46.581')] [2022-07-13 02:05:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 121872384. Throughput: 0: 10431.3. Samples: 243763580. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:48,989][27935] Avg episode reward: [(0, '-47.026')] [2022-07-13 02:05:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 121899008. Throughput: 0: 10438.8. Samples: 243795176. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:53,989][27935] Avg episode reward: [(0, '-47.278')] [2022-07-13 02:05:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5234.5). Total num frames: 121923584. Throughput: 0: 10426.3. Samples: 243857552. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:05:58,989][27935] Avg episode reward: [(0, '-47.412')] [2022-07-13 02:06:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 121949184. Throughput: 0: 10332.7. Samples: 243916172. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:03,989][27935] Avg episode reward: [(0, '-48.021')] [2022-07-13 02:06:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5234.6). Total num frames: 121974784. Throughput: 0: 10328.2. Samples: 243947444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:08,989][27935] Avg episode reward: [(0, '-48.035')] [2022-07-13 02:06:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 122000384. Throughput: 0: 10322.1. Samples: 244009848. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:13,989][27935] Avg episode reward: [(0, '-48.123')] [2022-07-13 02:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5231.1). Total num frames: 122025984. Throughput: 0: 10311.0. Samples: 244071292. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:18,991][27935] Avg episode reward: [(0, '-48.179')] [2022-07-13 02:06:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5224.1). Total num frames: 122050560. Throughput: 0: 10308.4. Samples: 244102244. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:23,989][27935] Avg episode reward: [(0, '-48.102')] [2022-07-13 02:06:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5234.5). Total num frames: 122079232. Throughput: 0: 10309.0. Samples: 244164976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:28,992][27935] Avg episode reward: [(0, '-48.277')] [2022-07-13 02:06:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5224.1). Total num frames: 122103808. Throughput: 0: 10299.4. Samples: 244227052. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:33,989][27935] Avg episode reward: [(0, '-49.886')] [2022-07-13 02:06:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5231.1). Total num frames: 122130432. Throughput: 0: 10296.7. Samples: 244258528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:38,989][27935] Avg episode reward: [(0, '-49.860')] [2022-07-13 02:06:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 122156032. Throughput: 0: 10313.5. Samples: 244321660. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 02:06:43,989][27935] Avg episode reward: [(0, '-49.964')] [2022-07-13 02:06:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 122182656. Throughput: 0: 10393.1. Samples: 244383860. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:06:48,989][27935] Avg episode reward: [(0, '-50.355')] [2022-07-13 02:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5220.7). Total num frames: 122207232. Throughput: 0: 10398.0. Samples: 244415356. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:06:53,990][27935] Avg episode reward: [(0, '-49.696')] [2022-07-13 02:06:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 122233856. Throughput: 0: 10393.4. Samples: 244477552. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:06:58,989][27935] Avg episode reward: [(0, '-49.271')] [2022-07-13 02:07:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5213.7). Total num frames: 122256384. Throughput: 0: 10318.7. Samples: 244535632. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:03,989][27935] Avg episode reward: [(0, '-47.827')] [2022-07-13 02:07:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5213.7). Total num frames: 122284032. Throughput: 0: 10324.5. Samples: 244566848. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:08,989][27935] Avg episode reward: [(0, '-47.431')] [2022-07-13 02:07:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 122310656. Throughput: 0: 10334.7. Samples: 244630036. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:13,989][27935] Avg episode reward: [(0, '-47.144')] [2022-07-13 02:07:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 122336256. Throughput: 0: 10336.6. Samples: 244692200. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:18,989][27935] Avg episode reward: [(0, '-46.654')] [2022-07-13 02:07:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 122362880. Throughput: 0: 10335.1. Samples: 244723608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:23,989][27935] Avg episode reward: [(0, '-47.223')] [2022-07-13 02:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 122388480. Throughput: 0: 10325.6. Samples: 244786312. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:28,989][27935] Avg episode reward: [(0, '-47.476')] [2022-07-13 02:07:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 122414080. Throughput: 0: 10310.0. Samples: 244847812. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:33,991][27935] Avg episode reward: [(0, '-48.081')] [2022-07-13 02:07:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 122440704. Throughput: 0: 10292.4. Samples: 244878512. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:38,990][27935] Avg episode reward: [(0, '-48.475')] [2022-07-13 02:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5210.3). Total num frames: 122465280. Throughput: 0: 10291.7. Samples: 244940676. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:43,990][27935] Avg episode reward: [(0, '-48.351')] [2022-07-13 02:07:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 122492928. Throughput: 0: 10411.0. Samples: 245004128. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:48,989][27935] Avg episode reward: [(0, '-48.084')] [2022-07-13 02:07:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 122518528. Throughput: 0: 10428.4. Samples: 245036124. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:53,990][27935] Avg episode reward: [(0, '-48.044')] [2022-07-13 02:07:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 122545152. Throughput: 0: 10451.9. Samples: 245100372. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:07:58,990][27935] Avg episode reward: [(0, '-47.661')] [2022-07-13 02:08:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.3). Total num frames: 122570752. Throughput: 0: 10402.1. Samples: 245160292. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:03,991][27935] Avg episode reward: [(0, '-48.117')] [2022-07-13 02:08:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 122596352. Throughput: 0: 10420.3. Samples: 245192524. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:08,989][27935] Avg episode reward: [(0, '-48.187')] [2022-07-13 02:08:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 122625024. Throughput: 0: 10467.4. Samples: 245257344. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:13,989][27935] Avg episode reward: [(0, '-48.133')] [2022-07-13 02:08:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 122649600. Throughput: 0: 10524.0. Samples: 245321392. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:18,990][27935] Avg episode reward: [(0, '-47.908')] [2022-07-13 02:08:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 122677248. Throughput: 0: 10557.8. Samples: 245353612. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:23,989][27935] Avg episode reward: [(0, '-48.602')] [2022-07-13 02:08:28,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 122704896. Throughput: 0: 10605.5. Samples: 245417924. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:28,989][27935] Avg episode reward: [(0, '-48.174')] [2022-07-13 02:08:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 122730496. Throughput: 0: 10622.4. Samples: 245482136. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:33,989][27935] Avg episode reward: [(0, '-47.696')] [2022-07-13 02:08:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 122757120. Throughput: 0: 10601.7. Samples: 245513200. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:38,989][27935] Avg episode reward: [(0, '-47.384')] [2022-07-13 02:08:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5217.2). Total num frames: 122782720. Throughput: 0: 10557.6. Samples: 245575464. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:08:43,989][27935] Avg episode reward: [(0, '-47.352')] [2022-07-13 02:08:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5220.7). Total num frames: 122810368. Throughput: 0: 10645.0. Samples: 245639316. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:08:48,989][27935] Avg episode reward: [(0, '-48.250')] [2022-07-13 02:08:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5217.2). Total num frames: 122835968. Throughput: 0: 10635.4. Samples: 245671116. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:08:53,989][27935] Avg episode reward: [(0, '-47.184')] [2022-07-13 02:08:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5224.1). Total num frames: 122862592. Throughput: 0: 10616.3. Samples: 245735076. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:08:58,989][27935] Avg episode reward: [(0, '-47.107')] [2022-07-13 02:09:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5224.1). Total num frames: 122889216. Throughput: 0: 10526.5. Samples: 245795084. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:03,989][27935] Avg episode reward: [(0, '-48.728')] [2022-07-13 02:09:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5217.2). Total num frames: 122913792. Throughput: 0: 10533.7. Samples: 245827628. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:08,990][27935] Avg episode reward: [(0, '-48.583')] [2022-07-13 02:09:13,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5273.3, 300 sec: 5220.8). Total num frames: 122941440. Throughput: 0: 10535.3. Samples: 245892048. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:13,993][27935] Avg episode reward: [(0, '-48.260')] [2022-07-13 02:09:18,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5224.1). Total num frames: 122969088. Throughput: 0: 9818.8. Samples: 245923984. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:18,989][27935] Avg episode reward: [(0, '-47.964')] [2022-07-13 02:09:23,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5290.7, 300 sec: 5217.2). Total num frames: 122994688. Throughput: 0: 10555.0. Samples: 245988176. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:23,989][27935] Avg episode reward: [(0, '-48.703')] [2022-07-13 02:09:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5227.6). Total num frames: 123022336. Throughput: 0: 10601.2. Samples: 246052516. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:28,989][27935] Avg episode reward: [(0, '-49.199')] [2022-07-13 02:09:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5220.7). Total num frames: 123047936. Throughput: 0: 10591.6. Samples: 246115936. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:33,989][27935] Avg episode reward: [(0, '-49.391')] [2022-07-13 02:09:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5217.2). Total num frames: 123074560. Throughput: 0: 10601.1. Samples: 246148164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:38,989][27935] Avg episode reward: [(0, '-48.231')] [2022-07-13 02:09:43,991][27935] Fps is (10 sec: 5425.8, 60 sec: 5324.6, 300 sec: 5227.6). Total num frames: 123102208. Throughput: 0: 10611.3. Samples: 246212612. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:43,992][27935] Avg episode reward: [(0, '-48.688')] [2022-07-13 02:09:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5227.6). Total num frames: 123127808. Throughput: 0: 10700.3. Samples: 246276596. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:48,989][27935] Avg episode reward: [(0, '-48.698')] [2022-07-13 02:09:53,989][27935] Fps is (10 sec: 5326.1, 60 sec: 5324.8, 300 sec: 5224.1). Total num frames: 123155456. Throughput: 0: 10685.3. Samples: 246308468. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:53,990][27935] Avg episode reward: [(0, '-48.389')] [2022-07-13 02:09:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5234.5). Total num frames: 123182080. Throughput: 0: 10686.1. Samples: 246372884. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:09:58,991][27935] Avg episode reward: [(0, '-49.460')] [2022-07-13 02:10:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5234.6). Total num frames: 123207680. Throughput: 0: 11309.8. Samples: 246432924. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:03,989][27935] Avg episode reward: [(0, '-48.999')] [2022-07-13 02:10:08,996][27935] Fps is (10 sec: 5218.5, 60 sec: 5341.2, 300 sec: 5237.9). Total num frames: 123234304. Throughput: 0: 10596.2. Samples: 246465084. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:08,998][27935] Avg episode reward: [(0, '-48.875')] [2022-07-13 02:10:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5308.0, 300 sec: 5231.1). Total num frames: 123259904. Throughput: 0: 10585.9. Samples: 246528880. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:13,989][27935] Avg episode reward: [(0, '-49.234')] [2022-07-13 02:10:18,989][27935] Fps is (10 sec: 5226.4, 60 sec: 5290.7, 300 sec: 5234.6). Total num frames: 123286528. Throughput: 0: 10600.5. Samples: 246592960. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:18,989][27935] Avg episode reward: [(0, '-48.881')] [2022-07-13 02:10:23,992][27935] Fps is (10 sec: 5323.2, 60 sec: 5307.5, 300 sec: 5238.0). Total num frames: 123313152. Throughput: 0: 10586.2. Samples: 246624576. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:24,000][27935] Avg episode reward: [(0, '-47.498')] [2022-07-13 02:10:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5234.5). Total num frames: 123339776. Throughput: 0: 10587.9. Samples: 246689040. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:28,989][27935] Avg episode reward: [(0, '-46.455')] [2022-07-13 02:10:33,989][27935] Fps is (10 sec: 5224.0, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 123365376. Throughput: 0: 10587.3. Samples: 246753024. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:33,989][27935] Avg episode reward: [(0, '-46.986')] [2022-07-13 02:10:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5251.9). Total num frames: 123394048. Throughput: 0: 10590.9. Samples: 246785060. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:38,989][27935] Avg episode reward: [(0, '-46.374')] [2022-07-13 02:10:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.9, 300 sec: 5245.0). Total num frames: 123419648. Throughput: 0: 10590.0. Samples: 246849436. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:43,989][27935] Avg episode reward: [(0, '-46.140')] [2022-07-13 02:10:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5251.9). Total num frames: 123448320. Throughput: 0: 10692.1. Samples: 246914068. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 02:10:48,989][27935] Avg episode reward: [(0, '-46.831')] [2022-07-13 02:10:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5255.4). Total num frames: 123473920. Throughput: 0: 10688.6. Samples: 246945992. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:10:53,989][27935] Avg episode reward: [(0, '-46.780')] [2022-07-13 02:10:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5258.8). Total num frames: 123500544. Throughput: 0: 10698.7. Samples: 247010320. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:10:58,989][27935] Avg episode reward: [(0, '-48.124')] [2022-07-13 02:11:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 123525120. Throughput: 0: 10607.6. Samples: 247070300. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:03,989][27935] Avg episode reward: [(0, '-48.655')] [2022-07-13 02:11:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5291.3, 300 sec: 5258.8). Total num frames: 123551744. Throughput: 0: 10617.5. Samples: 247102332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:08,990][27935] Avg episode reward: [(0, '-48.700')] [2022-07-13 02:11:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5324.8, 300 sec: 5265.8). Total num frames: 123579392. Throughput: 0: 10616.4. Samples: 247166780. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:13,989][27935] Avg episode reward: [(0, '-48.066')] [2022-07-13 02:11:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5269.3). Total num frames: 123604992. Throughput: 0: 10603.0. Samples: 247230160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:18,991][27935] Avg episode reward: [(0, '-47.884')] [2022-07-13 02:11:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5308.0, 300 sec: 5262.3). Total num frames: 123631616. Throughput: 0: 10598.1. Samples: 247261976. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:23,989][27935] Avg episode reward: [(0, '-48.492')] [2022-07-13 02:11:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5269.3). Total num frames: 123658240. Throughput: 0: 10595.9. Samples: 247326252. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:28,989][27935] Avg episode reward: [(0, '-48.367')] [2022-07-13 02:11:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5269.3). Total num frames: 123684864. Throughput: 0: 10565.9. Samples: 247389532. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:33,995][27935] Avg episode reward: [(0, '-47.491')] [2022-07-13 02:11:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 123711488. Throughput: 0: 10563.9. Samples: 247421368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:38,989][27935] Avg episode reward: [(0, '-47.255')] [2022-07-13 02:11:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5272.7). Total num frames: 123738112. Throughput: 0: 10541.9. Samples: 247484704. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:43,989][27935] Avg episode reward: [(0, '-47.225')] [2022-07-13 02:11:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 123764736. Throughput: 0: 10635.4. Samples: 247548892. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:48,989][27935] Avg episode reward: [(0, '-47.534')] [2022-07-13 02:11:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 123791360. Throughput: 0: 10628.3. Samples: 247580604. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:53,989][27935] Avg episode reward: [(0, '-46.863')] [2022-07-13 02:11:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 123817984. Throughput: 0: 10621.0. Samples: 247644724. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:11:58,989][27935] Avg episode reward: [(0, '-46.866')] [2022-07-13 02:12:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5286.6). Total num frames: 123843584. Throughput: 0: 10540.3. Samples: 247704472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:03,989][27935] Avg episode reward: [(0, '-47.852')] [2022-07-13 02:12:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 123868160. Throughput: 0: 10544.3. Samples: 247736468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:08,989][27935] Avg episode reward: [(0, '-47.566')] [2022-07-13 02:12:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 123895808. Throughput: 0: 10522.2. Samples: 247799752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:13,989][27935] Avg episode reward: [(0, '-47.270')] [2022-07-13 02:12:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 123922432. Throughput: 0: 10529.9. Samples: 247863376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:18,989][27935] Avg episode reward: [(0, '-46.439')] [2022-07-13 02:12:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 123948032. Throughput: 0: 10533.8. Samples: 247895388. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:23,989][27935] Avg episode reward: [(0, '-46.362')] [2022-07-13 02:12:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 123974656. Throughput: 0: 10549.4. Samples: 247959428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:28,995][27935] Avg episode reward: [(0, '-46.474')] [2022-07-13 02:12:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124002304. Throughput: 0: 10538.4. Samples: 248023120. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:33,989][27935] Avg episode reward: [(0, '-45.974')] [2022-07-13 02:12:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 124027904. Throughput: 0: 10549.0. Samples: 248055308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:38,989][27935] Avg episode reward: [(0, '-45.438')] [2022-07-13 02:12:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 124054528. Throughput: 0: 10532.4. Samples: 248118684. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:43,989][27935] Avg episode reward: [(0, '-45.227')] [2022-07-13 02:12:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 124081152. Throughput: 0: 10627.5. Samples: 248182708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:48,989][27935] Avg episode reward: [(0, '-46.162')] [2022-07-13 02:12:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 124107776. Throughput: 0: 10619.0. Samples: 248214324. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:12:53,989][27935] Avg episode reward: [(0, '-46.604')] [2022-07-13 02:12:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5300.5). Total num frames: 124134400. Throughput: 0: 10620.3. Samples: 248277664. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:12:58,989][27935] Avg episode reward: [(0, '-46.143')] [2022-07-13 02:13:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5293.6). Total num frames: 124157952. Throughput: 0: 10534.8. Samples: 248337444. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:03,989][27935] Avg episode reward: [(0, '-46.748')] [2022-07-13 02:13:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 124185600. Throughput: 0: 10534.7. Samples: 248369448. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:08,991][27935] Avg episode reward: [(0, '-47.108')] [2022-07-13 02:13:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5300.5). Total num frames: 124213248. Throughput: 0: 10539.6. Samples: 248433708. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:13,989][27935] Avg episode reward: [(0, '-47.623')] [2022-07-13 02:13:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5286.6). Total num frames: 124236800. Throughput: 0: 10546.5. Samples: 248497712. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:18,989][27935] Avg episode reward: [(0, '-48.045')] [2022-07-13 02:13:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 124266496. Throughput: 0: 10544.3. Samples: 248529800. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:23,989][27935] Avg episode reward: [(0, '-47.871')] [2022-07-13 02:13:28,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124292096. Throughput: 0: 10556.2. Samples: 248593712. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:28,989][27935] Avg episode reward: [(0, '-46.741')] [2022-07-13 02:13:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 124318720. Throughput: 0: 9836.6. Samples: 248625356. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:33,989][27935] Avg episode reward: [(0, '-46.663')] [2022-07-13 02:13:38,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 124347392. Throughput: 0: 10545.9. Samples: 248688888. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:38,989][27935] Avg episode reward: [(0, '-46.351')] [2022-07-13 02:13:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124371968. Throughput: 0: 10574.3. Samples: 248753508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:43,989][27935] Avg episode reward: [(0, '-46.159')] [2022-07-13 02:13:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 124398592. Throughput: 0: 10681.6. Samples: 248818116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:48,990][27935] Avg episode reward: [(0, '-46.072')] [2022-07-13 02:13:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 124426240. Throughput: 0: 10678.7. Samples: 248849988. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:53,989][27935] Avg episode reward: [(0, '-45.334')] [2022-07-13 02:13:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 124451840. Throughput: 0: 10668.9. Samples: 248913808. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:13:58,990][27935] Avg episode reward: [(0, '-45.329')] [2022-07-13 02:14:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 124477440. Throughput: 0: 10586.7. Samples: 248974112. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:03,989][27935] Avg episode reward: [(0, '-45.212')] [2022-07-13 02:14:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5297.1). Total num frames: 124504064. Throughput: 0: 10583.5. Samples: 249006056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:08,989][27935] Avg episode reward: [(0, '-45.358')] [2022-07-13 02:14:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124530688. Throughput: 0: 10595.1. Samples: 249070492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:13,989][27935] Avg episode reward: [(0, '-46.396')] [2022-07-13 02:14:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5358.9, 300 sec: 5300.5). Total num frames: 124558336. Throughput: 0: 11315.3. Samples: 249134544. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:18,989][27935] Avg episode reward: [(0, '-46.694')] [2022-07-13 02:14:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 124582912. Throughput: 0: 10614.7. Samples: 249166552. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:23,989][27935] Avg episode reward: [(0, '-46.531')] [2022-07-13 02:14:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 124611584. Throughput: 0: 10600.2. Samples: 249230516. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:28,989][27935] Avg episode reward: [(0, '-46.456')] [2022-07-13 02:14:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 124637184. Throughput: 0: 10578.9. Samples: 249294168. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:33,989][27935] Avg episode reward: [(0, '-46.122')] [2022-07-13 02:14:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5290.1). Total num frames: 124662784. Throughput: 0: 10586.7. Samples: 249326388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:38,989][27935] Avg episode reward: [(0, '-45.413')] [2022-07-13 02:14:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 124690432. Throughput: 0: 10560.8. Samples: 249389044. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:43,989][27935] Avg episode reward: [(0, '-44.646')] [2022-07-13 02:14:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 124716032. Throughput: 0: 10608.7. Samples: 249451504. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:48,989][27935] Avg episode reward: [(0, '-44.524')] [2022-07-13 02:14:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 124741632. Throughput: 0: 10604.7. Samples: 249483268. Policy #0 lag: (min: 0.0, avg: 9.0, max: 18.0) [2022-07-13 02:14:53,989][27935] Avg episode reward: [(0, '-45.175')] [2022-07-13 02:14:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124769280. Throughput: 0: 10583.8. Samples: 249546764. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:14:58,989][27935] Avg episode reward: [(0, '-45.752')] [2022-07-13 02:15:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5283.3). Total num frames: 124792832. Throughput: 0: 10484.2. Samples: 249606332. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:03,989][27935] Avg episode reward: [(0, '-46.494')] [2022-07-13 02:15:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 124820480. Throughput: 0: 10489.7. Samples: 249638588. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:08,989][27935] Avg episode reward: [(0, '-46.632')] [2022-07-13 02:15:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 124848128. Throughput: 0: 10496.5. Samples: 249702860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:13,989][27935] Avg episode reward: [(0, '-46.543')] [2022-07-13 02:15:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5286.7). Total num frames: 124872704. Throughput: 0: 10493.8. Samples: 249766388. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:18,989][27935] Avg episode reward: [(0, '-47.240')] [2022-07-13 02:15:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 124900352. Throughput: 0: 10493.9. Samples: 249798612. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:23,989][27935] Avg episode reward: [(0, '-47.173')] [2022-07-13 02:15:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5290.1). Total num frames: 124925952. Throughput: 0: 10507.8. Samples: 249861896. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:28,989][27935] Avg episode reward: [(0, '-46.128')] [2022-07-13 02:15:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 124953600. Throughput: 0: 10522.9. Samples: 249925032. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:33,989][27935] Avg episode reward: [(0, '-45.274')] [2022-07-13 02:15:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 124980224. Throughput: 0: 10531.1. Samples: 249957168. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:38,989][27935] Avg episode reward: [(0, '-45.853')] [2022-07-13 02:15:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 125005824. Throughput: 0: 10549.6. Samples: 250021496. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:43,989][27935] Avg episode reward: [(0, '-46.115')] [2022-07-13 02:15:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 125034496. Throughput: 0: 10659.5. Samples: 250086008. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:48,996][27935] Avg episode reward: [(0, '-45.430')] [2022-07-13 02:15:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 125061120. Throughput: 0: 10660.8. Samples: 250118324. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:53,989][27935] Avg episode reward: [(0, '-44.819')] [2022-07-13 02:15:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 125086720. Throughput: 0: 10658.5. Samples: 250182492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:15:58,989][27935] Avg episode reward: [(0, '-45.492')] [2022-07-13 02:16:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 125110272. Throughput: 0: 10572.8. Samples: 250242164. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:03,989][27935] Avg episode reward: [(0, '-45.307')] [2022-07-13 02:16:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 125137920. Throughput: 0: 10576.4. Samples: 250274552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:08,989][27935] Avg episode reward: [(0, '-45.393')] [2022-07-13 02:16:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 125164544. Throughput: 0: 10597.7. Samples: 250338792. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:13,989][27935] Avg episode reward: [(0, '-43.875')] [2022-07-13 02:16:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 125192192. Throughput: 0: 10608.4. Samples: 250402412. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:18,990][27935] Avg episode reward: [(0, '-44.436')] [2022-07-13 02:16:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 125218816. Throughput: 0: 10610.0. Samples: 250434620. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:23,989][27935] Avg episode reward: [(0, '-44.806')] [2022-07-13 02:16:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 125242368. Throughput: 0: 10590.1. Samples: 250498052. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:28,991][27935] Avg episode reward: [(0, '-43.793')] [2022-07-13 02:16:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 125271040. Throughput: 0: 10558.1. Samples: 250561120. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:33,989][27935] Avg episode reward: [(0, '-43.689')] [2022-07-13 02:16:38,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 125297664. Throughput: 0: 10559.1. Samples: 250593484. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:38,989][27935] Avg episode reward: [(0, '-45.511')] [2022-07-13 02:16:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 125325312. Throughput: 0: 10564.8. Samples: 250657908. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:43,989][27935] Avg episode reward: [(0, '-46.294')] [2022-07-13 02:16:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 125351936. Throughput: 0: 10672.2. Samples: 250722412. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:48,990][27935] Avg episode reward: [(0, '-46.888')] [2022-07-13 02:16:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 125378560. Throughput: 0: 10667.1. Samples: 250754572. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:53,991][27935] Avg episode reward: [(0, '-46.843')] [2022-07-13 02:16:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 125405184. Throughput: 0: 10642.8. Samples: 250817716. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:16:58,989][27935] Avg episode reward: [(0, '-47.374')] [2022-07-13 02:17:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 125429760. Throughput: 0: 10562.2. Samples: 250877712. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:03,990][27935] Avg episode reward: [(0, '-47.143')] [2022-07-13 02:17:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 125455360. Throughput: 0: 10560.2. Samples: 250909828. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:08,989][27935] Avg episode reward: [(0, '-47.229')] [2022-07-13 02:17:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 125481984. Throughput: 0: 10574.8. Samples: 250973920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:13,989][27935] Avg episode reward: [(0, '-45.594')] [2022-07-13 02:17:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 125508608. Throughput: 0: 10587.7. Samples: 251037568. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:18,989][27935] Avg episode reward: [(0, '-44.774')] [2022-07-13 02:17:23,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 125537280. Throughput: 0: 10580.4. Samples: 251069604. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:23,989][27935] Avg episode reward: [(0, '-44.894')] [2022-07-13 02:17:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5290.1). Total num frames: 125562880. Throughput: 0: 10576.3. Samples: 251133840. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:28,990][27935] Avg episode reward: [(0, '-45.105')] [2022-07-13 02:17:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 125588480. Throughput: 0: 9844.6. Samples: 251165420. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:33,990][27935] Avg episode reward: [(0, '-44.729')] [2022-07-13 02:17:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 125616128. Throughput: 0: 10543.0. Samples: 251229008. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:38,989][27935] Avg episode reward: [(0, '-44.266')] [2022-07-13 02:17:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 125641728. Throughput: 0: 10527.1. Samples: 251291436. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:43,991][27935] Avg episode reward: [(0, '-44.704')] [2022-07-13 02:17:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 125668352. Throughput: 0: 10627.3. Samples: 251355940. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:48,991][27935] Avg episode reward: [(0, '-46.269')] [2022-07-13 02:17:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 125697024. Throughput: 0: 10633.2. Samples: 251388320. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:53,989][27935] Avg episode reward: [(0, '-47.130')] [2022-07-13 02:17:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5300.5). Total num frames: 125721600. Throughput: 0: 10640.1. Samples: 251452724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:17:58,989][27935] Avg episode reward: [(0, '-46.082')] [2022-07-13 02:18:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 125747200. Throughput: 0: 10545.2. Samples: 251512100. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:03,991][27935] Avg episode reward: [(0, '-46.614')] [2022-07-13 02:18:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 125771776. Throughput: 0: 10546.9. Samples: 251544212. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:08,992][27935] Avg episode reward: [(0, '-46.868')] [2022-07-13 02:18:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 125800448. Throughput: 0: 10522.0. Samples: 251607332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:13,989][27935] Avg episode reward: [(0, '-46.459')] [2022-07-13 02:18:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 125825024. Throughput: 0: 11221.8. Samples: 251670400. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:18,989][27935] Avg episode reward: [(0, '-45.995')] [2022-07-13 02:18:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5290.1). Total num frames: 125852672. Throughput: 0: 10520.5. Samples: 251702432. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:23,989][27935] Avg episode reward: [(0, '-45.202')] [2022-07-13 02:18:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 125878272. Throughput: 0: 10551.1. Samples: 251766236. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:28,989][27935] Avg episode reward: [(0, '-45.240')] [2022-07-13 02:18:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 125903872. Throughput: 0: 10521.9. Samples: 251829424. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:33,989][27935] Avg episode reward: [(0, '-45.291')] [2022-07-13 02:18:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 125931520. Throughput: 0: 10493.0. Samples: 251860504. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:38,989][27935] Avg episode reward: [(0, '-45.541')] [2022-07-13 02:18:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 125957120. Throughput: 0: 10477.1. Samples: 251924192. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:43,989][27935] Avg episode reward: [(0, '-45.583')] [2022-07-13 02:18:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 125983744. Throughput: 0: 10560.4. Samples: 251987316. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:48,989][27935] Avg episode reward: [(0, '-45.607')] [2022-07-13 02:18:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5286.6). Total num frames: 126011392. Throughput: 0: 10555.6. Samples: 252019212. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:53,989][27935] Avg episode reward: [(0, '-46.550')] [2022-07-13 02:18:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5283.1). Total num frames: 126035968. Throughput: 0: 10563.5. Samples: 252082688. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 02:18:59,000][27935] Avg episode reward: [(0, '-46.849')] [2022-07-13 02:19:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5279.7). Total num frames: 126061568. Throughput: 0: 10491.8. Samples: 252142532. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:03,989][27935] Avg episode reward: [(0, '-46.459')] [2022-07-13 02:19:08,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 126089216. Throughput: 0: 10501.3. Samples: 252174992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:08,989][27935] Avg episode reward: [(0, '-46.364')] [2022-07-13 02:19:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5222.4, 300 sec: 5272.7). Total num frames: 126113792. Throughput: 0: 10496.0. Samples: 252238556. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:13,989][27935] Avg episode reward: [(0, '-46.032')] [2022-07-13 02:19:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 126140416. Throughput: 0: 10500.3. Samples: 252301940. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:18,989][27935] Avg episode reward: [(0, '-46.097')] [2022-07-13 02:19:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 126168064. Throughput: 0: 10512.4. Samples: 252333564. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:23,989][27935] Avg episode reward: [(0, '-46.270')] [2022-07-13 02:19:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 126193664. Throughput: 0: 10508.1. Samples: 252397056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:28,989][27935] Avg episode reward: [(0, '-45.239')] [2022-07-13 02:19:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 126219264. Throughput: 0: 9809.1. Samples: 252428728. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:33,989][27935] Avg episode reward: [(0, '-44.880')] [2022-07-13 02:19:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 126247936. Throughput: 0: 10507.6. Samples: 252492056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:38,989][27935] Avg episode reward: [(0, '-45.746')] [2022-07-13 02:19:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 126274560. Throughput: 0: 10513.7. Samples: 252555804. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:43,989][27935] Avg episode reward: [(0, '-45.591')] [2022-07-13 02:19:48,990][27935] Fps is (10 sec: 5221.5, 60 sec: 5273.4, 300 sec: 5283.1). Total num frames: 126300160. Throughput: 0: 10612.7. Samples: 252620124. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:48,991][27935] Avg episode reward: [(0, '-45.721')] [2022-07-13 02:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 126326784. Throughput: 0: 10612.0. Samples: 252652532. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:53,989][27935] Avg episode reward: [(0, '-45.469')] [2022-07-13 02:19:58,989][27935] Fps is (10 sec: 5428.1, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 126354432. Throughput: 0: 10620.1. Samples: 252716460. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:19:58,989][27935] Avg episode reward: [(0, '-46.434')] [2022-07-13 02:20:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 126377984. Throughput: 0: 10550.2. Samples: 252776700. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:03,990][27935] Avg episode reward: [(0, '-45.599')] [2022-07-13 02:20:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 126405632. Throughput: 0: 10558.8. Samples: 252808712. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:08,991][27935] Avg episode reward: [(0, '-47.051')] [2022-07-13 02:20:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 126433280. Throughput: 0: 10573.5. Samples: 252872864. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:13,991][27935] Avg episode reward: [(0, '-46.596')] [2022-07-13 02:20:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 126457856. Throughput: 0: 11288.1. Samples: 252936692. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:18,989][27935] Avg episode reward: [(0, '-47.376')] [2022-07-13 02:20:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 126486528. Throughput: 0: 10591.9. Samples: 252968692. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:23,989][27935] Avg episode reward: [(0, '-47.003')] [2022-07-13 02:20:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 126512128. Throughput: 0: 10599.5. Samples: 253032780. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:28,990][27935] Avg episode reward: [(0, '-47.416')] [2022-07-13 02:20:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 126538752. Throughput: 0: 10584.3. Samples: 253096400. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:33,989][27935] Avg episode reward: [(0, '-48.010')] [2022-07-13 02:20:38,996][27935] Fps is (10 sec: 5218.5, 60 sec: 5272.9, 300 sec: 5283.0). Total num frames: 126564352. Throughput: 0: 10564.0. Samples: 253127992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:38,997][27935] Avg episode reward: [(0, '-46.662')] [2022-07-13 02:20:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 126592000. Throughput: 0: 10567.4. Samples: 253191992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:43,989][27935] Avg episode reward: [(0, '-47.462')] [2022-07-13 02:20:48,989][27935] Fps is (10 sec: 5226.3, 60 sec: 5273.7, 300 sec: 5272.7). Total num frames: 126616576. Throughput: 0: 10579.4. Samples: 253252772. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:48,989][27935] Avg episode reward: [(0, '-47.561')] [2022-07-13 02:20:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 126643200. Throughput: 0: 10563.1. Samples: 253284052. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:53,990][27935] Avg episode reward: [(0, '-48.166')] [2022-07-13 02:20:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 126669824. Throughput: 0: 10557.0. Samples: 253347928. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:20:58,990][27935] Avg episode reward: [(0, '-47.988')] [2022-07-13 02:21:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 126694400. Throughput: 0: 10448.6. Samples: 253406880. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 02:21:03,989][27935] Avg episode reward: [(0, '-48.357')] [2022-07-13 02:21:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 126721024. Throughput: 0: 10453.0. Samples: 253439076. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:08,989][27935] Avg episode reward: [(0, '-48.707')] [2022-07-13 02:21:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 126747648. Throughput: 0: 10459.5. Samples: 253503456. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:13,990][27935] Avg episode reward: [(0, '-48.426')] [2022-07-13 02:21:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 126774272. Throughput: 0: 10457.1. Samples: 253566968. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:18,989][27935] Avg episode reward: [(0, '-47.082')] [2022-07-13 02:21:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5279.7). Total num frames: 126799872. Throughput: 0: 10468.1. Samples: 253598976. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:23,989][27935] Avg episode reward: [(0, '-46.370')] [2022-07-13 02:21:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 126826496. Throughput: 0: 10473.8. Samples: 253663312. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:28,989][27935] Avg episode reward: [(0, '-45.634')] [2022-07-13 02:21:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 126854144. Throughput: 0: 10528.8. Samples: 253726568. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:33,989][27935] Avg episode reward: [(0, '-44.627')] [2022-07-13 02:21:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5274.3, 300 sec: 5272.7). Total num frames: 126880768. Throughput: 0: 10543.8. Samples: 253758524. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:38,989][27935] Avg episode reward: [(0, '-44.573')] [2022-07-13 02:21:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5272.7). Total num frames: 126907392. Throughput: 0: 10564.6. Samples: 253823336. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:43,989][27935] Avg episode reward: [(0, '-44.542')] [2022-07-13 02:21:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 126932992. Throughput: 0: 9971.7. Samples: 253855604. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:48,989][27935] Avg episode reward: [(0, '-45.310')] [2022-07-13 02:21:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5276.2). Total num frames: 126961664. Throughput: 0: 10691.5. Samples: 253920192. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:53,989][27935] Avg episode reward: [(0, '-45.808')] [2022-07-13 02:21:58,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 126987264. Throughput: 0: 10678.8. Samples: 253984000. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:21:58,989][27935] Avg episode reward: [(0, '-45.733')] [2022-07-13 02:22:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 127011840. Throughput: 0: 10600.5. Samples: 254043992. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:03,989][27935] Avg episode reward: [(0, '-45.681')] [2022-07-13 02:22:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 127039488. Throughput: 0: 10601.8. Samples: 254076056. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:08,989][27935] Avg episode reward: [(0, '-45.532')] [2022-07-13 02:22:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 127065088. Throughput: 0: 10604.1. Samples: 254140496. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:13,989][27935] Avg episode reward: [(0, '-46.122')] [2022-07-13 02:22:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5269.3). Total num frames: 127091712. Throughput: 0: 10606.9. Samples: 254203880. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:18,989][27935] Avg episode reward: [(0, '-45.657')] [2022-07-13 02:22:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5272.7). Total num frames: 127118336. Throughput: 0: 10605.2. Samples: 254235756. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:23,989][27935] Avg episode reward: [(0, '-45.081')] [2022-07-13 02:22:28,990][27935] Fps is (10 sec: 5323.9, 60 sec: 5307.6, 300 sec: 5276.2). Total num frames: 127144960. Throughput: 0: 10576.1. Samples: 254299276. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:28,991][27935] Avg episode reward: [(0, '-45.009')] [2022-07-13 02:22:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 127171584. Throughput: 0: 11264.1. Samples: 254362488. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:33,989][27935] Avg episode reward: [(0, '-44.979')] [2022-07-13 02:22:38,989][27935] Fps is (10 sec: 5325.7, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 127198208. Throughput: 0: 10526.3. Samples: 254393876. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:38,989][27935] Avg episode reward: [(0, '-45.026')] [2022-07-13 02:22:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 127224832. Throughput: 0: 10541.0. Samples: 254458344. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:43,989][27935] Avg episode reward: [(0, '-44.647')] [2022-07-13 02:22:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5265.8). Total num frames: 127250432. Throughput: 0: 10626.7. Samples: 254522192. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:48,989][27935] Avg episode reward: [(0, '-44.112')] [2022-07-13 02:22:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 127278080. Throughput: 0: 10630.9. Samples: 254554448. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:53,989][27935] Avg episode reward: [(0, '-44.043')] [2022-07-13 02:22:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 127304704. Throughput: 0: 10613.3. Samples: 254618096. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:22:58,989][27935] Avg episode reward: [(0, '-44.452')] [2022-07-13 02:23:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 127330304. Throughput: 0: 10546.0. Samples: 254678452. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:23:03,989][27935] Avg episode reward: [(0, '-44.968')] [2022-07-13 02:23:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 127355904. Throughput: 0: 10554.0. Samples: 254710688. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 02:23:08,989][27935] Avg episode reward: [(0, '-46.207')] [2022-07-13 02:23:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 127383552. Throughput: 0: 10565.4. Samples: 254774700. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:13,989][27935] Avg episode reward: [(0, '-46.565')] [2022-07-13 02:23:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 127409152. Throughput: 0: 10569.2. Samples: 254838104. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:18,991][27935] Avg episode reward: [(0, '-46.896')] [2022-07-13 02:23:23,994][27935] Fps is (10 sec: 5322.1, 60 sec: 5307.3, 300 sec: 5283.1). Total num frames: 127436800. Throughput: 0: 10583.4. Samples: 254870184. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:23,998][27935] Avg episode reward: [(0, '-48.575')] [2022-07-13 02:23:28,989][27935] Fps is (10 sec: 5324.5, 60 sec: 5290.8, 300 sec: 5283.1). Total num frames: 127462400. Throughput: 0: 10578.3. Samples: 254934376. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:28,990][27935] Avg episode reward: [(0, '-47.795')] [2022-07-13 02:23:33,989][27935] Fps is (10 sec: 5327.5, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 127490048. Throughput: 0: 10571.1. Samples: 254997892. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:33,989][27935] Avg episode reward: [(0, '-47.384')] [2022-07-13 02:23:38,989][27935] Fps is (10 sec: 5325.1, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 127515648. Throughput: 0: 10556.9. Samples: 255029508. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:38,989][27935] Avg episode reward: [(0, '-46.733')] [2022-07-13 02:23:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 127541248. Throughput: 0: 10555.9. Samples: 255093112. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:43,989][27935] Avg episode reward: [(0, '-47.050')] [2022-07-13 02:23:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 127569920. Throughput: 0: 10620.0. Samples: 255156352. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:48,989][27935] Avg episode reward: [(0, '-47.641')] [2022-07-13 02:23:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 127594496. Throughput: 0: 10613.2. Samples: 255188280. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:53,989][27935] Avg episode reward: [(0, '-45.411')] [2022-07-13 02:23:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 127620096. Throughput: 0: 10610.3. Samples: 255252164. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:23:58,989][27935] Avg episode reward: [(0, '-46.275')] [2022-07-13 02:24:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 127646720. Throughput: 0: 10525.3. Samples: 255311740. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:03,989][27935] Avg episode reward: [(0, '-46.429')] [2022-07-13 02:24:08,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 127673344. Throughput: 0: 10522.1. Samples: 255343624. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:08,989][27935] Avg episode reward: [(0, '-46.315')] [2022-07-13 02:24:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 127698944. Throughput: 0: 10516.3. Samples: 255407604. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:13,989][27935] Avg episode reward: [(0, '-45.893')] [2022-07-13 02:24:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 127725568. Throughput: 0: 10511.0. Samples: 255470884. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:18,989][27935] Avg episode reward: [(0, '-45.382')] [2022-07-13 02:24:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.9, 300 sec: 5279.7). Total num frames: 127751168. Throughput: 0: 10515.8. Samples: 255502720. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:23,989][27935] Avg episode reward: [(0, '-46.246')] [2022-07-13 02:24:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.7, 300 sec: 5286.6). Total num frames: 127778816. Throughput: 0: 10527.2. Samples: 255566836. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:28,989][27935] Avg episode reward: [(0, '-46.627')] [2022-07-13 02:24:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 127805440. Throughput: 0: 10522.9. Samples: 255629884. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:33,991][27935] Avg episode reward: [(0, '-45.534')] [2022-07-13 02:24:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 127830016. Throughput: 0: 10514.5. Samples: 255661432. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:38,989][27935] Avg episode reward: [(0, '-45.785')] [2022-07-13 02:24:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.2). Total num frames: 127858688. Throughput: 0: 10508.1. Samples: 255725028. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:43,990][27935] Avg episode reward: [(0, '-45.579')] [2022-07-13 02:24:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5279.7). Total num frames: 127884288. Throughput: 0: 10602.8. Samples: 255788864. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:48,991][27935] Avg episode reward: [(0, '-45.099')] [2022-07-13 02:24:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 127911936. Throughput: 0: 10605.5. Samples: 255820872. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:53,989][27935] Avg episode reward: [(0, '-44.407')] [2022-07-13 02:24:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 127939584. Throughput: 0: 10614.9. Samples: 255885272. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:24:58,989][27935] Avg episode reward: [(0, '-44.647')] [2022-07-13 02:25:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 127963136. Throughput: 0: 10535.4. Samples: 255944980. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:25:03,991][27935] Avg episode reward: [(0, '-45.283')] [2022-07-13 02:25:08,989][27935] Fps is (10 sec: 4915.1, 60 sec: 5256.5, 300 sec: 5272.7). Total num frames: 127988736. Throughput: 0: 10542.5. Samples: 255977132. Policy #0 lag: (min: 1.0, avg: 9.6, max: 22.0) [2022-07-13 02:25:08,991][27935] Avg episode reward: [(0, '-45.470')] [2022-07-13 02:25:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 128015360. Throughput: 0: 10516.7. Samples: 256040088. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:13,991][27935] Avg episode reward: [(0, '-45.367')] [2022-07-13 02:25:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 128043008. Throughput: 0: 10526.4. Samples: 256103572. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:18,991][27935] Avg episode reward: [(0, '-45.720')] [2022-07-13 02:25:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 128068608. Throughput: 0: 10539.7. Samples: 256135720. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:23,990][27935] Avg episode reward: [(0, '-46.418')] [2022-07-13 02:25:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 128095232. Throughput: 0: 10562.1. Samples: 256200324. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:28,991][27935] Avg episode reward: [(0, '-46.141')] [2022-07-13 02:25:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.8). Total num frames: 128121856. Throughput: 0: 10549.2. Samples: 256263580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:33,989][27935] Avg episode reward: [(0, '-46.083')] [2022-07-13 02:25:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5279.7). Total num frames: 128149504. Throughput: 0: 10557.6. Samples: 256295964. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:38,990][27935] Avg episode reward: [(0, '-46.107')] [2022-07-13 02:25:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 128176128. Throughput: 0: 10557.2. Samples: 256360348. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:43,990][27935] Avg episode reward: [(0, '-45.938')] [2022-07-13 02:25:48,991][27935] Fps is (10 sec: 5323.8, 60 sec: 5307.6, 300 sec: 5286.6). Total num frames: 128202752. Throughput: 0: 10665.3. Samples: 256424940. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:48,993][27935] Avg episode reward: [(0, '-46.185')] [2022-07-13 02:25:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 128229376. Throughput: 0: 10671.8. Samples: 256457360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:53,990][27935] Avg episode reward: [(0, '-45.565')] [2022-07-13 02:25:58,989][27935] Fps is (10 sec: 5428.3, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 128257024. Throughput: 0: 10709.8. Samples: 256522028. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:25:58,989][27935] Avg episode reward: [(0, '-45.528')] [2022-07-13 02:26:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 128281600. Throughput: 0: 10625.7. Samples: 256581728. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:03,989][27935] Avg episode reward: [(0, '-45.461')] [2022-07-13 02:26:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 128308224. Throughput: 0: 10630.6. Samples: 256614096. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:08,990][27935] Avg episode reward: [(0, '-45.623')] [2022-07-13 02:26:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 128334848. Throughput: 0: 10627.9. Samples: 256678580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:13,989][27935] Avg episode reward: [(0, '-45.574')] [2022-07-13 02:26:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 128361472. Throughput: 0: 10638.9. Samples: 256742332. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:18,990][27935] Avg episode reward: [(0, '-45.078')] [2022-07-13 02:26:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 128388096. Throughput: 0: 10628.3. Samples: 256774236. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:23,989][27935] Avg episode reward: [(0, '-45.703')] [2022-07-13 02:26:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 128414720. Throughput: 0: 10624.4. Samples: 256838448. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:28,989][27935] Avg episode reward: [(0, '-45.558')] [2022-07-13 02:26:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 128441344. Throughput: 0: 10594.9. Samples: 256901692. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:33,989][27935] Avg episode reward: [(0, '-45.798')] [2022-07-13 02:26:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 128466944. Throughput: 0: 10583.0. Samples: 256933596. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:38,990][27935] Avg episode reward: [(0, '-45.293')] [2022-07-13 02:26:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 128494592. Throughput: 0: 10572.3. Samples: 256997780. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:43,991][27935] Avg episode reward: [(0, '-45.574')] [2022-07-13 02:26:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.8, 300 sec: 5283.1). Total num frames: 128520192. Throughput: 0: 10644.4. Samples: 257060724. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:48,989][27935] Avg episode reward: [(0, '-46.493')] [2022-07-13 02:26:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 128545792. Throughput: 0: 10605.5. Samples: 257091344. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:53,990][27935] Avg episode reward: [(0, '-46.532')] [2022-07-13 02:26:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 128573440. Throughput: 0: 10577.8. Samples: 257154580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:26:58,990][27935] Avg episode reward: [(0, '-46.646')] [2022-07-13 02:27:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 128596992. Throughput: 0: 10499.0. Samples: 257214788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:27:03,989][27935] Avg episode reward: [(0, '-46.592')] [2022-07-13 02:27:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 128625664. Throughput: 0: 10505.6. Samples: 257246988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:27:08,989][27935] Avg episode reward: [(0, '-46.712')] [2022-07-13 02:27:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 128650240. Throughput: 0: 10496.4. Samples: 257310784. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 02:27:13,989][27935] Avg episode reward: [(0, '-46.685')] [2022-07-13 02:27:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 128678912. Throughput: 0: 9794.1. Samples: 257342428. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:18,992][27935] Avg episode reward: [(0, '-45.173')] [2022-07-13 02:27:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5283.2). Total num frames: 128703488. Throughput: 0: 10513.1. Samples: 257406684. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:23,989][27935] Avg episode reward: [(0, '-45.173')] [2022-07-13 02:27:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 128730112. Throughput: 0: 10518.3. Samples: 257471104. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:28,989][27935] Avg episode reward: [(0, '-45.687')] [2022-07-13 02:27:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 128756736. Throughput: 0: 10516.4. Samples: 257533960. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:33,990][27935] Avg episode reward: [(0, '-45.675')] [2022-07-13 02:27:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 128784384. Throughput: 0: 10551.0. Samples: 257566140. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:38,989][27935] Avg episode reward: [(0, '-45.491')] [2022-07-13 02:27:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5283.1). Total num frames: 128808960. Throughput: 0: 10519.3. Samples: 257627948. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:43,990][27935] Avg episode reward: [(0, '-45.578')] [2022-07-13 02:27:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 128836608. Throughput: 0: 10586.4. Samples: 257691176. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:48,989][27935] Avg episode reward: [(0, '-45.270')] [2022-07-13 02:27:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 128861184. Throughput: 0: 10583.9. Samples: 257723264. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:53,989][27935] Avg episode reward: [(0, '-45.979')] [2022-07-13 02:27:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 128888832. Throughput: 0: 10587.2. Samples: 257787208. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:27:58,989][27935] Avg episode reward: [(0, '-44.931')] [2022-07-13 02:28:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 128913408. Throughput: 0: 11207.4. Samples: 257846760. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:03,989][27935] Avg episode reward: [(0, '-45.566')] [2022-07-13 02:28:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 128941056. Throughput: 0: 10500.3. Samples: 257879196. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:08,990][27935] Avg episode reward: [(0, '-45.570')] [2022-07-13 02:28:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 128966656. Throughput: 0: 10482.8. Samples: 257942832. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:13,989][27935] Avg episode reward: [(0, '-45.539')] [2022-07-13 02:28:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5276.3). Total num frames: 128993280. Throughput: 0: 10498.9. Samples: 258006412. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:18,989][27935] Avg episode reward: [(0, '-46.652')] [2022-07-13 02:28:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 129019904. Throughput: 0: 10493.9. Samples: 258038364. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:23,989][27935] Avg episode reward: [(0, '-46.294')] [2022-07-13 02:28:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 129047552. Throughput: 0: 10555.0. Samples: 258102924. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:28,989][27935] Avg episode reward: [(0, '-46.550')] [2022-07-13 02:28:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 129073152. Throughput: 0: 10555.7. Samples: 258166180. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:33,991][27935] Avg episode reward: [(0, '-46.276')] [2022-07-13 02:28:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 129100800. Throughput: 0: 10552.6. Samples: 258198132. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:38,990][27935] Avg episode reward: [(0, '-45.849')] [2022-07-13 02:28:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 129127424. Throughput: 0: 10572.6. Samples: 258262976. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:43,989][27935] Avg episode reward: [(0, '-46.041')] [2022-07-13 02:28:48,991][27935] Fps is (10 sec: 5221.1, 60 sec: 5273.4, 300 sec: 5283.1). Total num frames: 129153024. Throughput: 0: 10648.3. Samples: 258325960. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:48,993][27935] Avg episode reward: [(0, '-45.228')] [2022-07-13 02:28:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5286.6). Total num frames: 129179648. Throughput: 0: 10642.9. Samples: 258358128. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:53,990][27935] Avg episode reward: [(0, '-44.917')] [2022-07-13 02:28:58,989][27935] Fps is (10 sec: 5428.5, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 129207296. Throughput: 0: 10653.0. Samples: 258422216. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:28:58,990][27935] Avg episode reward: [(0, '-44.785')] [2022-07-13 02:29:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 129230848. Throughput: 0: 10554.0. Samples: 258481344. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:29:03,989][27935] Avg episode reward: [(0, '-44.720')] [2022-07-13 02:29:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 129256448. Throughput: 0: 10544.0. Samples: 258512844. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:29:08,989][27935] Avg episode reward: [(0, '-44.181')] [2022-07-13 02:29:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 129284096. Throughput: 0: 10525.3. Samples: 258576564. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:29:13,989][27935] Avg episode reward: [(0, '-45.180')] [2022-07-13 02:29:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 129310720. Throughput: 0: 10523.7. Samples: 258639748. Policy #0 lag: (min: 0.0, avg: 7.3, max: 19.0) [2022-07-13 02:29:18,990][27935] Avg episode reward: [(0, '-45.515')] [2022-07-13 02:29:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 129337344. Throughput: 0: 10526.8. Samples: 258671840. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:23,989][27935] Avg episode reward: [(0, '-45.239')] [2022-07-13 02:29:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 129362944. Throughput: 0: 10502.8. Samples: 258735600. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:28,990][27935] Avg episode reward: [(0, '-45.053')] [2022-07-13 02:29:33,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5290.4, 300 sec: 5290.0). Total num frames: 129390592. Throughput: 0: 10517.0. Samples: 258799228. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:33,992][27935] Avg episode reward: [(0, '-45.314')] [2022-07-13 02:29:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 129416192. Throughput: 0: 10521.6. Samples: 258831600. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:38,989][27935] Avg episode reward: [(0, '-45.393')] [2022-07-13 02:29:43,989][27935] Fps is (10 sec: 5326.1, 60 sec: 5273.6, 300 sec: 5286.6). Total num frames: 129443840. Throughput: 0: 10516.8. Samples: 258895472. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:43,989][27935] Avg episode reward: [(0, '-44.981')] [2022-07-13 02:29:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.9, 300 sec: 5283.1). Total num frames: 129470464. Throughput: 0: 10630.6. Samples: 258959720. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:48,989][27935] Avg episode reward: [(0, '-44.066')] [2022-07-13 02:29:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 129496064. Throughput: 0: 10630.1. Samples: 258991196. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:53,989][27935] Avg episode reward: [(0, '-44.467')] [2022-07-13 02:29:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 129522688. Throughput: 0: 10627.8. Samples: 259054812. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:29:58,989][27935] Avg episode reward: [(0, '-44.900')] [2022-07-13 02:30:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 129547264. Throughput: 0: 10552.4. Samples: 259114604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:03,989][27935] Avg episode reward: [(0, '-45.063')] [2022-07-13 02:30:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 129573888. Throughput: 0: 10541.3. Samples: 259146200. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:08,990][27935] Avg episode reward: [(0, '-44.794')] [2022-07-13 02:30:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 129600512. Throughput: 0: 10530.6. Samples: 259209476. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:13,989][27935] Avg episode reward: [(0, '-44.756')] [2022-07-13 02:30:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 129627136. Throughput: 0: 10526.5. Samples: 259272892. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:18,993][27935] Avg episode reward: [(0, '-45.063')] [2022-07-13 02:30:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 129652736. Throughput: 0: 10514.2. Samples: 259304740. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:23,989][27935] Avg episode reward: [(0, '-45.605')] [2022-07-13 02:30:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 129680384. Throughput: 0: 10511.0. Samples: 259368468. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:28,989][27935] Avg episode reward: [(0, '-45.871')] [2022-07-13 02:30:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.8, 300 sec: 5276.2). Total num frames: 129705984. Throughput: 0: 10490.9. Samples: 259431812. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:33,989][27935] Avg episode reward: [(0, '-45.642')] [2022-07-13 02:30:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 129733632. Throughput: 0: 10497.3. Samples: 259463576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:38,989][27935] Avg episode reward: [(0, '-45.466')] [2022-07-13 02:30:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5272.8). Total num frames: 129758208. Throughput: 0: 10494.9. Samples: 259527084. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:43,989][27935] Avg episode reward: [(0, '-46.350')] [2022-07-13 02:30:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 129786880. Throughput: 0: 10580.9. Samples: 259590744. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:48,989][27935] Avg episode reward: [(0, '-46.014')] [2022-07-13 02:30:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 129813504. Throughput: 0: 10596.5. Samples: 259623044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:53,989][27935] Avg episode reward: [(0, '-46.524')] [2022-07-13 02:30:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 129839104. Throughput: 0: 10620.5. Samples: 259687396. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:30:58,989][27935] Avg episode reward: [(0, '-46.830')] [2022-07-13 02:31:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 129863680. Throughput: 0: 10544.5. Samples: 259747396. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:31:03,989][27935] Avg episode reward: [(0, '-46.202')] [2022-07-13 02:31:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 129890304. Throughput: 0: 10547.5. Samples: 259779380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:31:08,989][27935] Avg episode reward: [(0, '-45.704')] [2022-07-13 02:31:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 129916928. Throughput: 0: 10555.3. Samples: 259843460. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:31:13,990][27935] Avg episode reward: [(0, '-44.294')] [2022-07-13 02:31:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 129943552. Throughput: 0: 10549.2. Samples: 259906528. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:31:18,989][27935] Avg episode reward: [(0, '-44.084')] [2022-07-13 02:31:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 129970176. Throughput: 0: 10548.2. Samples: 259938244. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 02:31:23,990][27935] Avg episode reward: [(0, '-43.590')] [2022-07-13 02:31:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 129996800. Throughput: 0: 10565.2. Samples: 260002520. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:28,989][27935] Avg episode reward: [(0, '-43.010')] [2022-07-13 02:31:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 130022400. Throughput: 0: 10556.2. Samples: 260065772. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:33,989][27935] Avg episode reward: [(0, '-43.297')] [2022-07-13 02:31:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 130051072. Throughput: 0: 10542.6. Samples: 260097460. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:38,989][27935] Avg episode reward: [(0, '-44.488')] [2022-07-13 02:31:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5272.7). Total num frames: 130075648. Throughput: 0: 10529.2. Samples: 260161208. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:43,989][27935] Avg episode reward: [(0, '-45.438')] [2022-07-13 02:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 130102272. Throughput: 0: 9892.9. Samples: 260192576. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:48,996][27935] Avg episode reward: [(0, '-46.192')] [2022-07-13 02:31:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 130129920. Throughput: 0: 10604.5. Samples: 260256584. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:53,989][27935] Avg episode reward: [(0, '-46.795')] [2022-07-13 02:31:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 130155520. Throughput: 0: 10599.6. Samples: 260320440. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:31:58,989][27935] Avg episode reward: [(0, '-46.710')] [2022-07-13 02:32:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 130180096. Throughput: 0: 10521.4. Samples: 260379992. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:03,989][27935] Avg episode reward: [(0, '-46.973')] [2022-07-13 02:32:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 130207744. Throughput: 0: 10515.5. Samples: 260411440. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:08,989][27935] Avg episode reward: [(0, '-46.610')] [2022-07-13 02:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 130232320. Throughput: 0: 10512.2. Samples: 260475568. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:13,989][27935] Avg episode reward: [(0, '-46.778')] [2022-07-13 02:32:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 130259968. Throughput: 0: 10521.9. Samples: 260539256. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:18,989][27935] Avg episode reward: [(0, '-46.394')] [2022-07-13 02:32:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 130286592. Throughput: 0: 10525.6. Samples: 260571112. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:23,989][27935] Avg episode reward: [(0, '-46.530')] [2022-07-13 02:32:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 130314240. Throughput: 0: 10528.4. Samples: 260634988. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:28,989][27935] Avg episode reward: [(0, '-46.630')] [2022-07-13 02:32:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 130338816. Throughput: 0: 11232.2. Samples: 260698024. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:33,989][27935] Avg episode reward: [(0, '-46.524')] [2022-07-13 02:32:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 130366464. Throughput: 0: 10514.1. Samples: 260729716. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:38,989][27935] Avg episode reward: [(0, '-46.000')] [2022-07-13 02:32:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5269.3). Total num frames: 130391040. Throughput: 0: 10468.8. Samples: 260791536. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:43,989][27935] Avg episode reward: [(0, '-45.730')] [2022-07-13 02:32:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5272.7). Total num frames: 130416640. Throughput: 0: 10537.8. Samples: 260854192. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:48,989][27935] Avg episode reward: [(0, '-45.721')] [2022-07-13 02:32:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5269.3). Total num frames: 130443264. Throughput: 0: 10534.8. Samples: 260885508. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:53,989][27935] Avg episode reward: [(0, '-45.609')] [2022-07-13 02:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5272.7). Total num frames: 130468864. Throughput: 0: 10448.7. Samples: 260945760. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:32:58,991][27935] Avg episode reward: [(0, '-46.013')] [2022-07-13 02:33:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5262.3). Total num frames: 130493440. Throughput: 0: 10337.8. Samples: 261004456. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:33:03,989][27935] Avg episode reward: [(0, '-45.513')] [2022-07-13 02:33:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5258.8). Total num frames: 130518016. Throughput: 0: 10327.3. Samples: 261035840. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:33:08,989][27935] Avg episode reward: [(0, '-46.486')] [2022-07-13 02:33:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5262.3). Total num frames: 130545664. Throughput: 0: 10314.6. Samples: 261099144. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:33:13,989][27935] Avg episode reward: [(0, '-46.321')] [2022-07-13 02:33:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5255.4). Total num frames: 130570240. Throughput: 0: 10334.4. Samples: 261163072. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:33:18,989][27935] Avg episode reward: [(0, '-46.006')] [2022-07-13 02:33:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5205.3, 300 sec: 5258.8). Total num frames: 130598912. Throughput: 0: 10341.0. Samples: 261195060. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 02:33:23,990][27935] Avg episode reward: [(0, '-46.211')] [2022-07-13 02:33:28,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5188.3, 300 sec: 5262.3). Total num frames: 130625536. Throughput: 0: 10390.4. Samples: 261259104. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:28,989][27935] Avg episode reward: [(0, '-46.248')] [2022-07-13 02:33:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5255.4). Total num frames: 130651136. Throughput: 0: 10412.6. Samples: 261322760. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:33,990][27935] Avg episode reward: [(0, '-46.338')] [2022-07-13 02:33:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5255.4). Total num frames: 130677760. Throughput: 0: 10421.2. Samples: 261354464. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:38,989][27935] Avg episode reward: [(0, '-46.721')] [2022-07-13 02:33:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5258.9). Total num frames: 130704384. Throughput: 0: 10508.2. Samples: 261418628. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:43,989][27935] Avg episode reward: [(0, '-46.294')] [2022-07-13 02:33:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5258.8). Total num frames: 130731008. Throughput: 0: 10610.9. Samples: 261481948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:48,991][27935] Avg episode reward: [(0, '-48.011')] [2022-07-13 02:33:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 130756608. Throughput: 0: 10625.2. Samples: 261513972. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:53,993][27935] Avg episode reward: [(0, '-48.368')] [2022-07-13 02:33:58,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 130784256. Throughput: 0: 10645.6. Samples: 261578196. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:33:58,990][27935] Avg episode reward: [(0, '-48.107')] [2022-07-13 02:34:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5262.3). Total num frames: 130808832. Throughput: 0: 10555.1. Samples: 261638052. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:03,989][27935] Avg episode reward: [(0, '-48.623')] [2022-07-13 02:34:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5262.3). Total num frames: 130836480. Throughput: 0: 10550.2. Samples: 261669820. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:08,989][27935] Avg episode reward: [(0, '-48.437')] [2022-07-13 02:34:13,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 130861056. Throughput: 0: 10549.4. Samples: 261733832. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:13,990][27935] Avg episode reward: [(0, '-48.920')] [2022-07-13 02:34:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5258.8). Total num frames: 130888704. Throughput: 0: 10548.7. Samples: 261797452. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:18,989][27935] Avg episode reward: [(0, '-48.123')] [2022-07-13 02:34:23,989][27935] Fps is (10 sec: 5427.4, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 130915328. Throughput: 0: 10551.6. Samples: 261829284. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:23,989][27935] Avg episode reward: [(0, '-46.868')] [2022-07-13 02:34:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5258.9). Total num frames: 130941952. Throughput: 0: 10530.0. Samples: 261892476. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:28,990][27935] Avg episode reward: [(0, '-47.248')] [2022-07-13 02:34:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 130968576. Throughput: 0: 10520.0. Samples: 261955348. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:33,989][27935] Avg episode reward: [(0, '-47.096')] [2022-07-13 02:34:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 130993152. Throughput: 0: 10511.6. Samples: 261986996. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:38,989][27935] Avg episode reward: [(0, '-46.378')] [2022-07-13 02:34:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5258.8). Total num frames: 131021824. Throughput: 0: 10508.4. Samples: 262051076. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:43,990][27935] Avg episode reward: [(0, '-46.631')] [2022-07-13 02:34:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 131047424. Throughput: 0: 10591.4. Samples: 262114664. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:48,993][27935] Avg episode reward: [(0, '-46.219')] [2022-07-13 02:34:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 131073024. Throughput: 0: 10592.7. Samples: 262146492. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:53,990][27935] Avg episode reward: [(0, '-45.773')] [2022-07-13 02:34:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5262.3). Total num frames: 131099648. Throughput: 0: 10592.6. Samples: 262210496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:34:58,989][27935] Avg episode reward: [(0, '-45.956')] [2022-07-13 02:35:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 131126272. Throughput: 0: 10503.8. Samples: 262270124. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:03,989][27935] Avg episode reward: [(0, '-45.060')] [2022-07-13 02:35:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 131150848. Throughput: 0: 10496.4. Samples: 262301624. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:08,989][27935] Avg episode reward: [(0, '-44.934')] [2022-07-13 02:35:13,991][27935] Fps is (10 sec: 5221.4, 60 sec: 5290.5, 300 sec: 5258.8). Total num frames: 131178496. Throughput: 0: 10514.1. Samples: 262365632. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:13,991][27935] Avg episode reward: [(0, '-45.335')] [2022-07-13 02:35:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 131205120. Throughput: 0: 10532.2. Samples: 262429296. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:18,989][27935] Avg episode reward: [(0, '-45.101')] [2022-07-13 02:35:23,989][27935] Fps is (10 sec: 5325.8, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 131231744. Throughput: 0: 10537.7. Samples: 262461192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:23,989][27935] Avg episode reward: [(0, '-45.355')] [2022-07-13 02:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5258.8). Total num frames: 131257344. Throughput: 0: 10536.5. Samples: 262525220. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 02:35:28,989][27935] Avg episode reward: [(0, '-45.840')] [2022-07-13 02:35:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 131284992. Throughput: 0: 10526.9. Samples: 262588376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:33,989][27935] Avg episode reward: [(0, '-46.636')] [2022-07-13 02:35:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5265.8). Total num frames: 131311616. Throughput: 0: 10519.3. Samples: 262619860. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:38,989][27935] Avg episode reward: [(0, '-46.449')] [2022-07-13 02:35:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 131338240. Throughput: 0: 10514.6. Samples: 262683652. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:43,989][27935] Avg episode reward: [(0, '-46.552')] [2022-07-13 02:35:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 131362816. Throughput: 0: 10591.3. Samples: 262746732. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:48,991][27935] Avg episode reward: [(0, '-47.275')] [2022-07-13 02:35:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5258.8). Total num frames: 131390464. Throughput: 0: 10596.5. Samples: 262778468. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:53,989][27935] Avg episode reward: [(0, '-47.544')] [2022-07-13 02:35:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 131416064. Throughput: 0: 10575.3. Samples: 262841500. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:35:58,989][27935] Avg episode reward: [(0, '-46.924')] [2022-07-13 02:36:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 131440640. Throughput: 0: 10489.6. Samples: 262901328. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:03,990][27935] Avg episode reward: [(0, '-46.584')] [2022-07-13 02:36:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 131467264. Throughput: 0: 10483.6. Samples: 262932956. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:08,989][27935] Avg episode reward: [(0, '-46.120')] [2022-07-13 02:36:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.7, 300 sec: 5255.4). Total num frames: 131493888. Throughput: 0: 10470.1. Samples: 262996376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:13,990][27935] Avg episode reward: [(0, '-46.854')] [2022-07-13 02:36:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5255.4). Total num frames: 131520512. Throughput: 0: 10451.6. Samples: 263058696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:18,989][27935] Avg episode reward: [(0, '-46.931')] [2022-07-13 02:36:23,990][27935] Fps is (10 sec: 5119.5, 60 sec: 5222.3, 300 sec: 5248.4). Total num frames: 131545088. Throughput: 0: 10449.6. Samples: 263090104. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:23,992][27935] Avg episode reward: [(0, '-46.771')] [2022-07-13 02:36:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 131571712. Throughput: 0: 10433.0. Samples: 263153136. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:28,989][27935] Avg episode reward: [(0, '-46.494')] [2022-07-13 02:36:33,992][27935] Fps is (10 sec: 5323.4, 60 sec: 5222.1, 300 sec: 5244.9). Total num frames: 131598336. Throughput: 0: 10425.7. Samples: 263215924. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:33,993][27935] Avg episode reward: [(0, '-46.541')] [2022-07-13 02:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5248.4). Total num frames: 131623936. Throughput: 0: 10428.8. Samples: 263247764. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:38,989][27935] Avg episode reward: [(0, '-45.730')] [2022-07-13 02:36:43,989][27935] Fps is (10 sec: 5429.1, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 131652608. Throughput: 0: 10451.7. Samples: 263311824. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:43,989][27935] Avg episode reward: [(0, '-46.391')] [2022-07-13 02:36:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 131678208. Throughput: 0: 10534.8. Samples: 263375396. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:48,989][27935] Avg episode reward: [(0, '-46.701')] [2022-07-13 02:36:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 131704832. Throughput: 0: 10527.7. Samples: 263406704. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:53,989][27935] Avg episode reward: [(0, '-47.268')] [2022-07-13 02:36:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 131729408. Throughput: 0: 10521.9. Samples: 263469860. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:36:58,989][27935] Avg episode reward: [(0, '-46.467')] [2022-07-13 02:37:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 131755008. Throughput: 0: 10461.2. Samples: 263529448. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:03,989][27935] Avg episode reward: [(0, '-46.672')] [2022-07-13 02:37:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 131781632. Throughput: 0: 10465.3. Samples: 263561032. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:08,989][27935] Avg episode reward: [(0, '-47.517')] [2022-07-13 02:37:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 131808256. Throughput: 0: 10464.5. Samples: 263624040. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:13,989][27935] Avg episode reward: [(0, '-48.222')] [2022-07-13 02:37:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 131833856. Throughput: 0: 10491.1. Samples: 263687988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:18,989][27935] Avg episode reward: [(0, '-48.994')] [2022-07-13 02:37:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.6, 300 sec: 5241.5). Total num frames: 131860480. Throughput: 0: 10505.4. Samples: 263720508. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:23,989][27935] Avg episode reward: [(0, '-48.322')] [2022-07-13 02:37:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 131886080. Throughput: 0: 10495.4. Samples: 263784116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:28,990][27935] Avg episode reward: [(0, '-47.893')] [2022-07-13 02:37:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.8, 300 sec: 5241.5). Total num frames: 131912704. Throughput: 0: 10492.6. Samples: 263847564. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 02:37:33,991][27935] Avg episode reward: [(0, '-48.206')] [2022-07-13 02:37:38,989][27935] Fps is (10 sec: 5632.0, 60 sec: 5307.7, 300 sec: 5258.8). Total num frames: 131942400. Throughput: 0: 10502.5. Samples: 263879316. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:37:38,991][27935] Avg episode reward: [(0, '-48.131')] [2022-07-13 02:37:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 131965952. Throughput: 0: 10477.4. Samples: 263941344. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:37:43,989][27935] Avg episode reward: [(0, '-47.633')] [2022-07-13 02:37:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 131991552. Throughput: 0: 10550.8. Samples: 264004236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:37:48,989][27935] Avg episode reward: [(0, '-45.939')] [2022-07-13 02:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 132018176. Throughput: 0: 10541.2. Samples: 264035388. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:37:53,989][27935] Avg episode reward: [(0, '-46.314')] [2022-07-13 02:37:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5255.4). Total num frames: 132043776. Throughput: 0: 10529.3. Samples: 264097856. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:37:58,991][27935] Avg episode reward: [(0, '-46.285')] [2022-07-13 02:38:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5255.4). Total num frames: 132068352. Throughput: 0: 10407.7. Samples: 264156332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:03,989][27935] Avg episode reward: [(0, '-46.004')] [2022-07-13 02:38:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5251.9). Total num frames: 132094976. Throughput: 0: 10373.8. Samples: 264187328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:08,989][27935] Avg episode reward: [(0, '-46.051')] [2022-07-13 02:38:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5255.4). Total num frames: 132120576. Throughput: 0: 10359.0. Samples: 264250272. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:13,990][27935] Avg episode reward: [(0, '-46.586')] [2022-07-13 02:38:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 132146176. Throughput: 0: 10336.5. Samples: 264312708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:18,989][27935] Avg episode reward: [(0, '-47.096')] [2022-07-13 02:38:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 132173824. Throughput: 0: 10330.9. Samples: 264344208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:23,991][27935] Avg episode reward: [(0, '-46.560')] [2022-07-13 02:38:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 132198400. Throughput: 0: 10330.9. Samples: 264406236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:28,991][27935] Avg episode reward: [(0, '-46.609')] [2022-07-13 02:38:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 132225024. Throughput: 0: 10318.0. Samples: 264468548. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:33,990][27935] Avg episode reward: [(0, '-46.776')] [2022-07-13 02:38:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5241.5). Total num frames: 132250624. Throughput: 0: 10329.7. Samples: 264500224. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:38,990][27935] Avg episode reward: [(0, '-47.138')] [2022-07-13 02:38:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5241.5). Total num frames: 132277248. Throughput: 0: 10335.6. Samples: 264562956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:43,989][27935] Avg episode reward: [(0, '-46.932')] [2022-07-13 02:38:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5241.5). Total num frames: 132302848. Throughput: 0: 10431.2. Samples: 264625736. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:48,989][27935] Avg episode reward: [(0, '-46.959')] [2022-07-13 02:38:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 132329472. Throughput: 0: 10441.8. Samples: 264657208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:53,989][27935] Avg episode reward: [(0, '-47.234')] [2022-07-13 02:38:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5241.5). Total num frames: 132355072. Throughput: 0: 10409.5. Samples: 264718700. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:38:58,989][27935] Avg episode reward: [(0, '-46.861')] [2022-07-13 02:39:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 132378624. Throughput: 0: 10284.1. Samples: 264775492. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:03,989][27935] Avg episode reward: [(0, '-47.462')] [2022-07-13 02:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5231.1). Total num frames: 132404224. Throughput: 0: 10276.3. Samples: 264806640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:08,989][27935] Avg episode reward: [(0, '-48.048')] [2022-07-13 02:39:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5224.1). Total num frames: 132429824. Throughput: 0: 10286.8. Samples: 264869144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:13,990][27935] Avg episode reward: [(0, '-46.588')] [2022-07-13 02:39:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5220.7). Total num frames: 132455424. Throughput: 0: 10278.5. Samples: 264931080. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:18,989][27935] Avg episode reward: [(0, '-45.999')] [2022-07-13 02:39:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5220.7). Total num frames: 132482048. Throughput: 0: 10281.5. Samples: 264962892. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:23,989][27935] Avg episode reward: [(0, '-47.440')] [2022-07-13 02:39:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 132508672. Throughput: 0: 10276.5. Samples: 265025400. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:28,989][27935] Avg episode reward: [(0, '-47.382')] [2022-07-13 02:39:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5220.7). Total num frames: 132533248. Throughput: 0: 10274.6. Samples: 265088092. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:33,989][27935] Avg episode reward: [(0, '-47.164')] [2022-07-13 02:39:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 132560896. Throughput: 0: 10275.4. Samples: 265119600. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 02:39:38,989][27935] Avg episode reward: [(0, '-46.320')] [2022-07-13 02:39:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 132586496. Throughput: 0: 10290.1. Samples: 265181752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:39:43,989][27935] Avg episode reward: [(0, '-46.556')] [2022-07-13 02:39:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 132612096. Throughput: 0: 10424.8. Samples: 265244608. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:39:48,990][27935] Avg episode reward: [(0, '-47.319')] [2022-07-13 02:39:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 132638720. Throughput: 0: 10430.7. Samples: 265276020. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:39:53,989][27935] Avg episode reward: [(0, '-46.880')] [2022-07-13 02:39:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5213.7). Total num frames: 132664320. Throughput: 0: 10437.0. Samples: 265338808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:39:58,990][27935] Avg episode reward: [(0, '-47.125')] [2022-07-13 02:40:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 132688896. Throughput: 0: 10359.4. Samples: 265397252. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:03,989][27935] Avg episode reward: [(0, '-47.641')] [2022-07-13 02:40:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 132715520. Throughput: 0: 10345.6. Samples: 265428444. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:08,989][27935] Avg episode reward: [(0, '-48.528')] [2022-07-13 02:40:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 132741120. Throughput: 0: 10353.1. Samples: 265491292. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:13,989][27935] Avg episode reward: [(0, '-47.566')] [2022-07-13 02:40:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 132767744. Throughput: 0: 10360.3. Samples: 265554304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:18,989][27935] Avg episode reward: [(0, '-48.096')] [2022-07-13 02:40:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 132793344. Throughput: 0: 10366.8. Samples: 265586104. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:23,990][27935] Avg episode reward: [(0, '-46.839')] [2022-07-13 02:40:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 132819968. Throughput: 0: 10382.2. Samples: 265648952. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:28,990][27935] Avg episode reward: [(0, '-47.426')] [2022-07-13 02:40:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 132845568. Throughput: 0: 10367.0. Samples: 265711124. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:33,989][27935] Avg episode reward: [(0, '-46.517')] [2022-07-13 02:40:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 132871168. Throughput: 0: 10365.9. Samples: 265742488. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:38,999][27935] Avg episode reward: [(0, '-46.656')] [2022-07-13 02:40:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 132899840. Throughput: 0: 10366.4. Samples: 265805296. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:43,989][27935] Avg episode reward: [(0, '-47.724')] [2022-07-13 02:40:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 132923392. Throughput: 0: 10461.2. Samples: 265868004. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:48,991][27935] Avg episode reward: [(0, '-48.794')] [2022-07-13 02:40:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 132951040. Throughput: 0: 10475.3. Samples: 265899832. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:53,989][27935] Avg episode reward: [(0, '-48.889')] [2022-07-13 02:40:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 132975616. Throughput: 0: 10472.5. Samples: 265962556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:40:58,990][27935] Avg episode reward: [(0, '-49.277')] [2022-07-13 02:41:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 133001216. Throughput: 0: 10375.7. Samples: 266021212. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:03,989][27935] Avg episode reward: [(0, '-48.843')] [2022-07-13 02:41:08,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 133026816. Throughput: 0: 10368.8. Samples: 266052700. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:08,989][27935] Avg episode reward: [(0, '-47.996')] [2022-07-13 02:41:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 133053440. Throughput: 0: 10352.3. Samples: 266114804. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:13,989][27935] Avg episode reward: [(0, '-47.717')] [2022-07-13 02:41:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.9). Total num frames: 133079040. Throughput: 0: 10347.8. Samples: 266176776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:18,989][27935] Avg episode reward: [(0, '-47.076')] [2022-07-13 02:41:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 133104640. Throughput: 0: 10352.6. Samples: 266208356. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:23,989][27935] Avg episode reward: [(0, '-46.508')] [2022-07-13 02:41:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 133131264. Throughput: 0: 10360.4. Samples: 266271512. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:28,989][27935] Avg episode reward: [(0, '-45.594')] [2022-07-13 02:41:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 133155840. Throughput: 0: 10345.7. Samples: 266333560. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:33,990][27935] Avg episode reward: [(0, '-46.090')] [2022-07-13 02:41:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 133183488. Throughput: 0: 10333.5. Samples: 266364840. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:38,991][27935] Avg episode reward: [(0, '-45.661')] [2022-07-13 02:41:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 133209088. Throughput: 0: 10341.3. Samples: 266427916. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 02:41:43,989][27935] Avg episode reward: [(0, '-45.669')] [2022-07-13 02:41:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 133234688. Throughput: 0: 10426.7. Samples: 266490412. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:41:48,989][27935] Avg episode reward: [(0, '-45.941')] [2022-07-13 02:41:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 133261312. Throughput: 0: 10424.1. Samples: 266521784. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:41:53,989][27935] Avg episode reward: [(0, '-46.795')] [2022-07-13 02:41:58,991][27935] Fps is (10 sec: 5221.1, 60 sec: 5188.1, 300 sec: 5192.9). Total num frames: 133286912. Throughput: 0: 10437.1. Samples: 266584500. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:41:58,992][27935] Avg episode reward: [(0, '-47.124')] [2022-07-13 02:42:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 133311488. Throughput: 0: 10347.3. Samples: 266642404. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:03,990][27935] Avg episode reward: [(0, '-47.509')] [2022-07-13 02:42:08,989][27935] Fps is (10 sec: 5018.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 133337088. Throughput: 0: 10343.1. Samples: 266673796. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:08,989][27935] Avg episode reward: [(0, '-47.474')] [2022-07-13 02:42:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 133363712. Throughput: 0: 10340.3. Samples: 266736824. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:13,989][27935] Avg episode reward: [(0, '-47.078')] [2022-07-13 02:42:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 133390336. Throughput: 0: 10356.7. Samples: 266799612. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:18,989][27935] Avg episode reward: [(0, '-46.791')] [2022-07-13 02:42:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 133416960. Throughput: 0: 10366.9. Samples: 266831348. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:23,989][27935] Avg episode reward: [(0, '-47.179')] [2022-07-13 02:42:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 133442560. Throughput: 0: 10354.2. Samples: 266893856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:28,989][27935] Avg episode reward: [(0, '-46.170')] [2022-07-13 02:42:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 133468160. Throughput: 0: 10348.4. Samples: 266956088. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:33,990][27935] Avg episode reward: [(0, '-45.335')] [2022-07-13 02:42:38,991][27935] Fps is (10 sec: 5119.0, 60 sec: 5171.0, 300 sec: 5179.0). Total num frames: 133493760. Throughput: 0: 10351.0. Samples: 266987600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:38,991][27935] Avg episode reward: [(0, '-45.962')] [2022-07-13 02:42:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 133520384. Throughput: 0: 10318.3. Samples: 267048796. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:43,989][27935] Avg episode reward: [(0, '-46.489')] [2022-07-13 02:42:48,989][27935] Fps is (10 sec: 5223.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 133545984. Throughput: 0: 10422.3. Samples: 267111408. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:48,989][27935] Avg episode reward: [(0, '-46.610')] [2022-07-13 02:42:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 133572608. Throughput: 0: 10419.7. Samples: 267142684. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:53,989][27935] Avg episode reward: [(0, '-46.514')] [2022-07-13 02:42:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.4, 300 sec: 5182.5). Total num frames: 133597184. Throughput: 0: 10418.4. Samples: 267205652. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:42:58,996][27935] Avg episode reward: [(0, '-47.509')] [2022-07-13 02:43:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 133622784. Throughput: 0: 10316.5. Samples: 267263856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:03,989][27935] Avg episode reward: [(0, '-48.180')] [2022-07-13 02:43:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 133647360. Throughput: 0: 10307.2. Samples: 267295172. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:08,989][27935] Avg episode reward: [(0, '-47.911')] [2022-07-13 02:43:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 133675008. Throughput: 0: 10301.7. Samples: 267357432. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:13,989][27935] Avg episode reward: [(0, '-47.285')] [2022-07-13 02:43:18,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 133701632. Throughput: 0: 10302.8. Samples: 267419716. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:18,989][27935] Avg episode reward: [(0, '-47.557')] [2022-07-13 02:43:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 133726208. Throughput: 0: 10313.1. Samples: 267451672. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:23,989][27935] Avg episode reward: [(0, '-47.331')] [2022-07-13 02:43:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 133751808. Throughput: 0: 10343.6. Samples: 267514260. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:28,989][27935] Avg episode reward: [(0, '-46.862')] [2022-07-13 02:43:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 133779456. Throughput: 0: 10324.5. Samples: 267576012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:33,989][27935] Avg episode reward: [(0, '-46.136')] [2022-07-13 02:43:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.3, 300 sec: 5172.1). Total num frames: 133803008. Throughput: 0: 10327.2. Samples: 267607408. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:38,989][27935] Avg episode reward: [(0, '-46.832')] [2022-07-13 02:43:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 133830656. Throughput: 0: 10326.0. Samples: 267670324. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 02:43:43,990][27935] Avg episode reward: [(0, '-46.949')] [2022-07-13 02:43:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 133855232. Throughput: 0: 10423.1. Samples: 267732896. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:43:48,989][27935] Avg episode reward: [(0, '-47.653')] [2022-07-13 02:43:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 133882880. Throughput: 0: 10415.0. Samples: 267763848. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:43:53,989][27935] Avg episode reward: [(0, '-47.136')] [2022-07-13 02:43:58,999][27935] Fps is (10 sec: 5217.2, 60 sec: 5170.3, 300 sec: 5182.3). Total num frames: 133907456. Throughput: 0: 10417.6. Samples: 267826328. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:43:58,999][27935] Avg episode reward: [(0, '-47.415')] [2022-07-13 02:44:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 133933056. Throughput: 0: 10325.9. Samples: 267884380. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:03,989][27935] Avg episode reward: [(0, '-48.247')] [2022-07-13 02:44:08,989][27935] Fps is (10 sec: 5125.1, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 133958656. Throughput: 0: 10312.6. Samples: 267915740. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:08,991][27935] Avg episode reward: [(0, '-48.451')] [2022-07-13 02:44:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 133985280. Throughput: 0: 10330.0. Samples: 267979108. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:13,989][27935] Avg episode reward: [(0, '-47.377')] [2022-07-13 02:44:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 134009856. Throughput: 0: 10348.3. Samples: 268041684. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:18,991][27935] Avg episode reward: [(0, '-47.154')] [2022-07-13 02:44:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 134036480. Throughput: 0: 10349.1. Samples: 268073116. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:23,991][27935] Avg episode reward: [(0, '-47.874')] [2022-07-13 02:44:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 134063104. Throughput: 0: 10336.4. Samples: 268135464. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:28,989][27935] Avg episode reward: [(0, '-47.544')] [2022-07-13 02:44:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 134089728. Throughput: 0: 10325.2. Samples: 268197528. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:33,989][27935] Avg episode reward: [(0, '-48.480')] [2022-07-13 02:44:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 134114304. Throughput: 0: 10340.8. Samples: 268229184. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:38,990][27935] Avg episode reward: [(0, '-48.546')] [2022-07-13 02:44:43,997][27935] Fps is (10 sec: 5217.9, 60 sec: 5187.5, 300 sec: 5185.8). Total num frames: 134141952. Throughput: 0: 10364.8. Samples: 268292728. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:43,999][27935] Avg episode reward: [(0, '-48.483')] [2022-07-13 02:44:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 134168576. Throughput: 0: 10474.7. Samples: 268355740. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:48,989][27935] Avg episode reward: [(0, '-48.542')] [2022-07-13 02:44:53,989][27935] Fps is (10 sec: 5329.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 134195200. Throughput: 0: 10476.4. Samples: 268387176. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:53,989][27935] Avg episode reward: [(0, '-48.925')] [2022-07-13 02:44:58,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5240.3, 300 sec: 5196.4). Total num frames: 134221824. Throughput: 0: 10460.8. Samples: 268449844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:44:58,989][27935] Avg episode reward: [(0, '-48.110')] [2022-07-13 02:45:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 134242304. Throughput: 0: 10318.6. Samples: 268506020. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:03,989][27935] Avg episode reward: [(0, '-47.337')] [2022-07-13 02:45:08,989][27935] Fps is (10 sec: 4710.3, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 134268928. Throughput: 0: 10288.3. Samples: 268536092. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:08,989][27935] Avg episode reward: [(0, '-46.767')] [2022-07-13 02:45:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 134293504. Throughput: 0: 10286.4. Samples: 268598352. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:13,989][27935] Avg episode reward: [(0, '-46.472')] [2022-07-13 02:45:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 134320128. Throughput: 0: 10283.2. Samples: 268660272. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:18,989][27935] Avg episode reward: [(0, '-46.153')] [2022-07-13 02:45:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 134345728. Throughput: 0: 10268.4. Samples: 268691264. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:23,989][27935] Avg episode reward: [(0, '-45.544')] [2022-07-13 02:45:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 134372352. Throughput: 0: 10246.9. Samples: 268753752. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:28,989][27935] Avg episode reward: [(0, '-46.038')] [2022-07-13 02:45:33,991][27935] Fps is (10 sec: 5221.5, 60 sec: 5136.9, 300 sec: 5175.5). Total num frames: 134397952. Throughput: 0: 10221.8. Samples: 268815740. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:33,991][27935] Avg episode reward: [(0, '-45.468')] [2022-07-13 02:45:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 134423552. Throughput: 0: 10219.7. Samples: 268847064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:38,989][27935] Avg episode reward: [(0, '-45.582')] [2022-07-13 02:45:43,989][27935] Fps is (10 sec: 5325.7, 60 sec: 5154.9, 300 sec: 5179.0). Total num frames: 134451200. Throughput: 0: 10225.7. Samples: 268910000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:43,989][27935] Avg episode reward: [(0, '-45.718')] [2022-07-13 02:45:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 134476800. Throughput: 0: 10369.6. Samples: 268972652. Policy #0 lag: (min: 0.0, avg: 9.6, max: 23.0) [2022-07-13 02:45:48,989][27935] Avg episode reward: [(0, '-46.491')] [2022-07-13 02:45:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5175.5). Total num frames: 134502400. Throughput: 0: 10405.8. Samples: 269004352. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:45:53,989][27935] Avg episode reward: [(0, '-46.786')] [2022-07-13 02:45:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5179.0). Total num frames: 134529024. Throughput: 0: 10425.9. Samples: 269067516. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:45:58,990][27935] Avg episode reward: [(0, '-46.379')] [2022-07-13 02:46:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 134554624. Throughput: 0: 10360.8. Samples: 269126508. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:03,991][27935] Avg episode reward: [(0, '-46.873')] [2022-07-13 02:46:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 134579200. Throughput: 0: 10375.3. Samples: 269158152. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:08,992][27935] Avg episode reward: [(0, '-46.727')] [2022-07-13 02:46:13,991][27935] Fps is (10 sec: 5118.8, 60 sec: 5205.1, 300 sec: 5175.5). Total num frames: 134605824. Throughput: 0: 10388.3. Samples: 269221252. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:13,992][27935] Avg episode reward: [(0, '-46.220')] [2022-07-13 02:46:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 134631424. Throughput: 0: 10400.7. Samples: 269283756. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:18,989][27935] Avg episode reward: [(0, '-45.705')] [2022-07-13 02:46:23,989][27935] Fps is (10 sec: 5223.6, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 134658048. Throughput: 0: 10409.2. Samples: 269315476. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:23,989][27935] Avg episode reward: [(0, '-44.910')] [2022-07-13 02:46:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 134683648. Throughput: 0: 10408.4. Samples: 269378380. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:28,989][27935] Avg episode reward: [(0, '-43.874')] [2022-07-13 02:46:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.5, 300 sec: 5175.5). Total num frames: 134710272. Throughput: 0: 9704.5. Samples: 269409352. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:33,989][27935] Avg episode reward: [(0, '-44.397')] [2022-07-13 02:46:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 134736896. Throughput: 0: 10382.0. Samples: 269471544. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:38,989][27935] Avg episode reward: [(0, '-44.774')] [2022-07-13 02:46:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 134763520. Throughput: 0: 10388.0. Samples: 269534976. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:43,989][27935] Avg episode reward: [(0, '-45.062')] [2022-07-13 02:46:48,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 134788096. Throughput: 0: 10472.8. Samples: 269597784. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:48,989][27935] Avg episode reward: [(0, '-45.156')] [2022-07-13 02:46:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5179.1). Total num frames: 134814720. Throughput: 0: 10460.4. Samples: 269628872. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:53,989][27935] Avg episode reward: [(0, '-44.688')] [2022-07-13 02:46:58,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 134841344. Throughput: 0: 10465.8. Samples: 269692188. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:46:58,989][27935] Avg episode reward: [(0, '-44.943')] [2022-07-13 02:47:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 134866944. Throughput: 0: 10385.4. Samples: 269751100. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:03,989][27935] Avg episode reward: [(0, '-44.413')] [2022-07-13 02:47:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 134891520. Throughput: 0: 10380.4. Samples: 269782592. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:08,997][27935] Avg episode reward: [(0, '-44.073')] [2022-07-13 02:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.6, 300 sec: 5182.5). Total num frames: 134919168. Throughput: 0: 10385.9. Samples: 269845748. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:13,989][27935] Avg episode reward: [(0, '-43.550')] [2022-07-13 02:47:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 134943744. Throughput: 0: 11093.7. Samples: 269908568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:18,989][27935] Avg episode reward: [(0, '-44.386')] [2022-07-13 02:47:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 134971392. Throughput: 0: 10421.0. Samples: 269940488. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:23,989][27935] Avg episode reward: [(0, '-44.597')] [2022-07-13 02:47:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 134995968. Throughput: 0: 10412.1. Samples: 270003520. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:28,992][27935] Avg episode reward: [(0, '-43.907')] [2022-07-13 02:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 135023616. Throughput: 0: 10419.2. Samples: 270066648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:33,989][27935] Avg episode reward: [(0, '-43.620')] [2022-07-13 02:47:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 135050240. Throughput: 0: 10424.6. Samples: 270097980. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:38,989][27935] Avg episode reward: [(0, '-43.951')] [2022-07-13 02:47:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 135074816. Throughput: 0: 10386.8. Samples: 270159596. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:43,989][27935] Avg episode reward: [(0, '-44.385')] [2022-07-13 02:47:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 135101440. Throughput: 0: 10484.1. Samples: 270222884. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:48,989][27935] Avg episode reward: [(0, '-44.004')] [2022-07-13 02:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 135127040. Throughput: 0: 10491.9. Samples: 270254728. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 02:47:53,989][27935] Avg episode reward: [(0, '-43.505')] [2022-07-13 02:47:58,990][27935] Fps is (10 sec: 5221.9, 60 sec: 5205.2, 300 sec: 5189.4). Total num frames: 135153664. Throughput: 0: 10477.0. Samples: 270317224. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:47:58,990][27935] Avg episode reward: [(0, '-43.922')] [2022-07-13 02:48:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 135178240. Throughput: 0: 10386.4. Samples: 270375956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:03,989][27935] Avg episode reward: [(0, '-44.928')] [2022-07-13 02:48:08,989][27935] Fps is (10 sec: 5018.1, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 135203840. Throughput: 0: 10380.1. Samples: 270407592. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:08,991][27935] Avg episode reward: [(0, '-44.525')] [2022-07-13 02:48:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 135230464. Throughput: 0: 10370.9. Samples: 270470212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:13,989][27935] Avg episode reward: [(0, '-44.994')] [2022-07-13 02:48:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 135257088. Throughput: 0: 10351.1. Samples: 270532448. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:18,989][27935] Avg episode reward: [(0, '-44.849')] [2022-07-13 02:48:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 135282688. Throughput: 0: 10349.2. Samples: 270563696. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:23,991][27935] Avg episode reward: [(0, '-45.220')] [2022-07-13 02:48:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 135309312. Throughput: 0: 10362.6. Samples: 270625912. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:28,990][27935] Avg episode reward: [(0, '-45.354')] [2022-07-13 02:48:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 135334912. Throughput: 0: 10322.1. Samples: 270687380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:33,990][27935] Avg episode reward: [(0, '-45.456')] [2022-07-13 02:48:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 135359488. Throughput: 0: 10316.2. Samples: 270718956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:38,990][27935] Avg episode reward: [(0, '-45.422')] [2022-07-13 02:48:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 135386112. Throughput: 0: 10301.4. Samples: 270780776. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:43,989][27935] Avg episode reward: [(0, '-45.824')] [2022-07-13 02:48:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 135411712. Throughput: 0: 10387.8. Samples: 270843408. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:48,989][27935] Avg episode reward: [(0, '-45.598')] [2022-07-13 02:48:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.6). Total num frames: 135438336. Throughput: 0: 10381.6. Samples: 270874764. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:53,989][27935] Avg episode reward: [(0, '-46.122')] [2022-07-13 02:48:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.3, 300 sec: 5189.4). Total num frames: 135463936. Throughput: 0: 10389.4. Samples: 270937736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:48:58,989][27935] Avg episode reward: [(0, '-45.652')] [2022-07-13 02:49:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 135488512. Throughput: 0: 10311.6. Samples: 270996472. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:03,991][27935] Avg episode reward: [(0, '-45.409')] [2022-07-13 02:49:08,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5188.2, 300 sec: 5185.9). Total num frames: 135515136. Throughput: 0: 10312.5. Samples: 271027760. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:08,991][27935] Avg episode reward: [(0, '-46.097')] [2022-07-13 02:49:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 135540736. Throughput: 0: 10318.2. Samples: 271090232. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:13,989][27935] Avg episode reward: [(0, '-45.934')] [2022-07-13 02:49:18,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 135567360. Throughput: 0: 10335.8. Samples: 271152492. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:18,989][27935] Avg episode reward: [(0, '-45.971')] [2022-07-13 02:49:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 135592960. Throughput: 0: 10343.5. Samples: 271184412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:23,989][27935] Avg episode reward: [(0, '-45.633')] [2022-07-13 02:49:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 135618560. Throughput: 0: 10365.2. Samples: 271247212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:28,989][27935] Avg episode reward: [(0, '-45.068')] [2022-07-13 02:49:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 135645184. Throughput: 0: 10375.9. Samples: 271310324. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:33,989][27935] Avg episode reward: [(0, '-45.923')] [2022-07-13 02:49:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.1). Total num frames: 135671808. Throughput: 0: 10378.9. Samples: 271341816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:38,989][27935] Avg episode reward: [(0, '-46.210')] [2022-07-13 02:49:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 135697408. Throughput: 0: 10370.6. Samples: 271404412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:43,989][27935] Avg episode reward: [(0, '-46.120')] [2022-07-13 02:49:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 135724032. Throughput: 0: 10455.6. Samples: 271466976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:48,991][27935] Avg episode reward: [(0, '-45.993')] [2022-07-13 02:49:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 135750656. Throughput: 0: 10460.6. Samples: 271498484. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:53,991][27935] Avg episode reward: [(0, '-46.587')] [2022-07-13 02:49:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 135776256. Throughput: 0: 10465.5. Samples: 271561180. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 02:49:58,989][27935] Avg episode reward: [(0, '-45.960')] [2022-07-13 02:50:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 135799808. Throughput: 0: 10382.1. Samples: 271619684. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:03,989][27935] Avg episode reward: [(0, '-45.766')] [2022-07-13 02:50:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 135826432. Throughput: 0: 10365.5. Samples: 271650860. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:08,989][27935] Avg episode reward: [(0, '-45.814')] [2022-07-13 02:50:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 135853056. Throughput: 0: 10368.8. Samples: 271713808. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:13,991][27935] Avg episode reward: [(0, '-46.342')] [2022-07-13 02:50:18,990][27935] Fps is (10 sec: 5221.9, 60 sec: 5188.2, 300 sec: 5196.4). Total num frames: 135878656. Throughput: 0: 10345.0. Samples: 271775860. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:18,990][27935] Avg episode reward: [(0, '-45.712')] [2022-07-13 02:50:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 135904256. Throughput: 0: 10343.6. Samples: 271807276. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:23,989][27935] Avg episode reward: [(0, '-45.188')] [2022-07-13 02:50:28,989][27935] Fps is (10 sec: 5325.3, 60 sec: 5222.4, 300 sec: 5199.9). Total num frames: 135931904. Throughput: 0: 10345.8. Samples: 271869972. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:28,989][27935] Avg episode reward: [(0, '-44.844')] [2022-07-13 02:50:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 135955456. Throughput: 0: 10332.4. Samples: 271931936. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:33,989][27935] Avg episode reward: [(0, '-45.525')] [2022-07-13 02:50:38,992][27935] Fps is (10 sec: 5118.1, 60 sec: 5188.0, 300 sec: 5192.8). Total num frames: 135983104. Throughput: 0: 10314.3. Samples: 271962664. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:38,993][27935] Avg episode reward: [(0, '-45.429')] [2022-07-13 02:50:43,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 136008704. Throughput: 0: 10317.8. Samples: 272025480. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:43,989][27935] Avg episode reward: [(0, '-46.031')] [2022-07-13 02:50:48,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 136033280. Throughput: 0: 10409.8. Samples: 272088124. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:48,989][27935] Avg episode reward: [(0, '-46.188')] [2022-07-13 02:50:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 136059904. Throughput: 0: 10411.8. Samples: 272119392. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:53,989][27935] Avg episode reward: [(0, '-46.004')] [2022-07-13 02:50:58,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 136087552. Throughput: 0: 10419.2. Samples: 272182676. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:50:58,990][27935] Avg episode reward: [(0, '-46.180')] [2022-07-13 02:51:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 136111104. Throughput: 0: 10350.2. Samples: 272241612. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:03,991][27935] Avg episode reward: [(0, '-46.943')] [2022-07-13 02:51:08,989][27935] Fps is (10 sec: 4812.9, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 136135680. Throughput: 0: 10309.9. Samples: 272271220. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:08,989][27935] Avg episode reward: [(0, '-46.349')] [2022-07-13 02:51:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 136160256. Throughput: 0: 10256.6. Samples: 272331520. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:13,989][27935] Avg episode reward: [(0, '-45.625')] [2022-07-13 02:51:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 136186880. Throughput: 0: 10240.0. Samples: 272392736. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:18,989][27935] Avg episode reward: [(0, '-45.520')] [2022-07-13 02:51:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 136212480. Throughput: 0: 10249.4. Samples: 272423852. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:23,989][27935] Avg episode reward: [(0, '-45.662')] [2022-07-13 02:51:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 136238080. Throughput: 0: 10240.1. Samples: 272486284. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:28,989][27935] Avg episode reward: [(0, '-45.597')] [2022-07-13 02:51:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5172.1). Total num frames: 136262656. Throughput: 0: 10227.2. Samples: 272548348. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:33,989][27935] Avg episode reward: [(0, '-44.583')] [2022-07-13 02:51:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.3, 300 sec: 5175.5). Total num frames: 136290304. Throughput: 0: 10216.1. Samples: 272579116. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:38,989][27935] Avg episode reward: [(0, '-44.601')] [2022-07-13 02:51:43,993][27935] Fps is (10 sec: 5425.2, 60 sec: 5136.7, 300 sec: 5182.4). Total num frames: 136316928. Throughput: 0: 10197.4. Samples: 272641596. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:43,993][27935] Avg episode reward: [(0, '-44.206')] [2022-07-13 02:51:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 136342528. Throughput: 0: 10275.6. Samples: 272704016. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:48,989][27935] Avg episode reward: [(0, '-43.495')] [2022-07-13 02:51:53,989][27935] Fps is (10 sec: 5121.9, 60 sec: 5137.1, 300 sec: 5175.5). Total num frames: 136368128. Throughput: 0: 10301.6. Samples: 272734792. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:53,990][27935] Avg episode reward: [(0, '-43.430')] [2022-07-13 02:51:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5179.0). Total num frames: 136394752. Throughput: 0: 10347.7. Samples: 272797164. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:51:58,989][27935] Avg episode reward: [(0, '-43.022')] [2022-07-13 02:52:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5172.1). Total num frames: 136417280. Throughput: 0: 10279.4. Samples: 272855308. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 02:52:03,991][27935] Avg episode reward: [(0, '-43.406')] [2022-07-13 02:52:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 136443904. Throughput: 0: 10276.5. Samples: 272886296. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:08,989][27935] Avg episode reward: [(0, '-43.882')] [2022-07-13 02:52:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 136469504. Throughput: 0: 10258.9. Samples: 272947932. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:13,989][27935] Avg episode reward: [(0, '-43.674')] [2022-07-13 02:52:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 136495104. Throughput: 0: 10256.2. Samples: 273009876. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:18,990][27935] Avg episode reward: [(0, '-44.030')] [2022-07-13 02:52:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 136521728. Throughput: 0: 10269.0. Samples: 273041220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:23,990][27935] Avg episode reward: [(0, '-43.526')] [2022-07-13 02:52:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 136547328. Throughput: 0: 10274.2. Samples: 273103896. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:28,989][27935] Avg episode reward: [(0, '-45.011')] [2022-07-13 02:52:34,000][27935] Fps is (10 sec: 5216.4, 60 sec: 5187.3, 300 sec: 5164.9). Total num frames: 136573952. Throughput: 0: 10263.7. Samples: 273166000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:34,001][27935] Avg episode reward: [(0, '-45.868')] [2022-07-13 02:52:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 136599552. Throughput: 0: 10274.6. Samples: 273197148. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:38,989][27935] Avg episode reward: [(0, '-46.216')] [2022-07-13 02:52:43,989][27935] Fps is (10 sec: 5125.9, 60 sec: 5137.4, 300 sec: 5165.1). Total num frames: 136625152. Throughput: 0: 10265.4. Samples: 273259108. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:43,989][27935] Avg episode reward: [(0, '-46.331')] [2022-07-13 02:52:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 136652800. Throughput: 0: 10381.7. Samples: 273322484. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:48,989][27935] Avg episode reward: [(0, '-46.380')] [2022-07-13 02:52:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 136678400. Throughput: 0: 10399.0. Samples: 273354252. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:53,989][27935] Avg episode reward: [(0, '-46.263')] [2022-07-13 02:52:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 136705024. Throughput: 0: 10443.5. Samples: 273417888. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:52:58,989][27935] Avg episode reward: [(0, '-45.093')] [2022-07-13 02:53:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 136728576. Throughput: 0: 10396.7. Samples: 273477728. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:03,989][27935] Avg episode reward: [(0, '-44.594')] [2022-07-13 02:53:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 136756224. Throughput: 0: 10402.2. Samples: 273509320. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:08,989][27935] Avg episode reward: [(0, '-43.116')] [2022-07-13 02:53:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 136781824. Throughput: 0: 10408.3. Samples: 273572272. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:13,990][27935] Avg episode reward: [(0, '-42.394')] [2022-07-13 02:53:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 136807424. Throughput: 0: 10429.3. Samples: 273635200. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:18,989][27935] Avg episode reward: [(0, '-43.430')] [2022-07-13 02:53:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 136835072. Throughput: 0: 10433.7. Samples: 273666664. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:23,989][27935] Avg episode reward: [(0, '-43.200')] [2022-07-13 02:53:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 136859648. Throughput: 0: 10458.7. Samples: 273729748. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:28,989][27935] Avg episode reward: [(0, '-42.027')] [2022-07-13 02:53:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5206.3, 300 sec: 5175.5). Total num frames: 136886272. Throughput: 0: 10454.5. Samples: 273792936. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:33,990][27935] Avg episode reward: [(0, '-42.643')] [2022-07-13 02:53:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 136912896. Throughput: 0: 10443.7. Samples: 273824220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:38,989][27935] Avg episode reward: [(0, '-43.622')] [2022-07-13 02:53:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5179.0). Total num frames: 136939520. Throughput: 0: 10434.1. Samples: 273887420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:43,989][27935] Avg episode reward: [(0, '-44.165')] [2022-07-13 02:53:48,992][27935] Fps is (10 sec: 5323.1, 60 sec: 5222.1, 300 sec: 5179.0). Total num frames: 136966144. Throughput: 0: 10498.4. Samples: 273950188. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:48,992][27935] Avg episode reward: [(0, '-43.881')] [2022-07-13 02:53:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 136992768. Throughput: 0: 10511.2. Samples: 273982324. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:53,989][27935] Avg episode reward: [(0, '-45.273')] [2022-07-13 02:53:58,989][27935] Fps is (10 sec: 5224.0, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 137018368. Throughput: 0: 10520.2. Samples: 274045680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:53:58,989][27935] Avg episode reward: [(0, '-45.145')] [2022-07-13 02:54:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 137041920. Throughput: 0: 10435.8. Samples: 274104808. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:54:03,989][27935] Avg episode reward: [(0, '-44.665')] [2022-07-13 02:54:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 137069568. Throughput: 0: 10425.1. Samples: 274135792. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 02:54:08,989][27935] Avg episode reward: [(0, '-44.734')] [2022-07-13 02:54:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 137095168. Throughput: 0: 10423.4. Samples: 274198800. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:13,989][27935] Avg episode reward: [(0, '-44.879')] [2022-07-13 02:54:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 137121792. Throughput: 0: 10409.7. Samples: 274261372. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:18,989][27935] Avg episode reward: [(0, '-44.829')] [2022-07-13 02:54:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 137146368. Throughput: 0: 10425.1. Samples: 274293352. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:23,989][27935] Avg episode reward: [(0, '-44.763')] [2022-07-13 02:54:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5186.0). Total num frames: 137175040. Throughput: 0: 10419.0. Samples: 274356276. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:28,990][27935] Avg episode reward: [(0, '-44.850')] [2022-07-13 02:54:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 137198592. Throughput: 0: 10416.6. Samples: 274418904. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:33,989][27935] Avg episode reward: [(0, '-45.559')] [2022-07-13 02:54:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 137226240. Throughput: 0: 10393.6. Samples: 274450036. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:38,990][27935] Avg episode reward: [(0, '-45.471')] [2022-07-13 02:54:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 137251840. Throughput: 0: 10376.7. Samples: 274512632. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:43,989][27935] Avg episode reward: [(0, '-45.434')] [2022-07-13 02:54:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.5, 300 sec: 5175.5). Total num frames: 137277440. Throughput: 0: 10452.2. Samples: 274575156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:48,991][27935] Avg episode reward: [(0, '-45.273')] [2022-07-13 02:54:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 137304064. Throughput: 0: 10470.0. Samples: 274606940. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:53,990][27935] Avg episode reward: [(0, '-44.818')] [2022-07-13 02:54:58,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5205.0, 300 sec: 5189.4). Total num frames: 137330688. Throughput: 0: 10471.5. Samples: 274670056. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:54:58,993][27935] Avg episode reward: [(0, '-44.491')] [2022-07-13 02:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 137354240. Throughput: 0: 10396.8. Samples: 274729228. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:03,989][27935] Avg episode reward: [(0, '-44.792')] [2022-07-13 02:55:08,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 137381888. Throughput: 0: 10383.6. Samples: 274760612. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:08,989][27935] Avg episode reward: [(0, '-44.800')] [2022-07-13 02:55:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 137407488. Throughput: 0: 10389.0. Samples: 274823780. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:13,989][27935] Avg episode reward: [(0, '-44.880')] [2022-07-13 02:55:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 137432064. Throughput: 0: 10394.5. Samples: 274886656. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:18,989][27935] Avg episode reward: [(0, '-45.013')] [2022-07-13 02:55:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 137460736. Throughput: 0: 10406.1. Samples: 274918312. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:23,989][27935] Avg episode reward: [(0, '-45.732')] [2022-07-13 02:55:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 137486336. Throughput: 0: 10409.1. Samples: 274981044. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:28,989][27935] Avg episode reward: [(0, '-45.560')] [2022-07-13 02:55:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 137511936. Throughput: 0: 10405.4. Samples: 275043400. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:33,989][27935] Avg episode reward: [(0, '-45.099')] [2022-07-13 02:55:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 137537536. Throughput: 0: 10382.4. Samples: 275074148. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:38,989][27935] Avg episode reward: [(0, '-44.790')] [2022-07-13 02:55:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 137563136. Throughput: 0: 10369.7. Samples: 275136656. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:43,989][27935] Avg episode reward: [(0, '-45.282')] [2022-07-13 02:55:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 137589760. Throughput: 0: 10426.7. Samples: 275198432. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:48,989][27935] Avg episode reward: [(0, '-44.852')] [2022-07-13 02:55:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 137615360. Throughput: 0: 10432.4. Samples: 275230068. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:53,989][27935] Avg episode reward: [(0, '-44.579')] [2022-07-13 02:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.6, 300 sec: 5189.4). Total num frames: 137641984. Throughput: 0: 10421.6. Samples: 275292752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:55:58,989][27935] Avg episode reward: [(0, '-44.585')] [2022-07-13 02:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 137665536. Throughput: 0: 10323.2. Samples: 275351200. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:56:03,992][27935] Avg episode reward: [(0, '-45.366')] [2022-07-13 02:56:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 137693184. Throughput: 0: 10319.6. Samples: 275382696. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:56:08,989][27935] Avg episode reward: [(0, '-45.951')] [2022-07-13 02:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 137717760. Throughput: 0: 10321.4. Samples: 275445508. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 02:56:13,989][27935] Avg episode reward: [(0, '-45.971')] [2022-07-13 02:56:18,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 137744384. Throughput: 0: 10312.9. Samples: 275507480. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:18,989][27935] Avg episode reward: [(0, '-46.146')] [2022-07-13 02:56:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 137771008. Throughput: 0: 10326.6. Samples: 275538844. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:23,989][27935] Avg episode reward: [(0, '-46.353')] [2022-07-13 02:56:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 137795584. Throughput: 0: 10342.5. Samples: 275602068. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:28,989][27935] Avg episode reward: [(0, '-46.288')] [2022-07-13 02:56:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 137822208. Throughput: 0: 10352.4. Samples: 275664288. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:33,989][27935] Avg episode reward: [(0, '-46.216')] [2022-07-13 02:56:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.5). Total num frames: 137847808. Throughput: 0: 10347.4. Samples: 275695700. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:38,989][27935] Avg episode reward: [(0, '-45.689')] [2022-07-13 02:56:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 137875456. Throughput: 0: 10349.8. Samples: 275758492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:43,996][27935] Avg episode reward: [(0, '-45.574')] [2022-07-13 02:56:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 137900032. Throughput: 0: 10444.3. Samples: 275821192. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:48,989][27935] Avg episode reward: [(0, '-45.221')] [2022-07-13 02:56:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 137926656. Throughput: 0: 10452.1. Samples: 275853040. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:53,993][27935] Avg episode reward: [(0, '-45.690')] [2022-07-13 02:56:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 137954304. Throughput: 0: 10439.9. Samples: 275915304. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:56:58,989][27935] Avg episode reward: [(0, '-46.407')] [2022-07-13 02:57:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 137977856. Throughput: 0: 10374.3. Samples: 275974324. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:03,989][27935] Avg episode reward: [(0, '-46.593')] [2022-07-13 02:57:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 138002432. Throughput: 0: 10374.2. Samples: 276005684. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:08,989][27935] Avg episode reward: [(0, '-47.345')] [2022-07-13 02:57:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 138028032. Throughput: 0: 10299.4. Samples: 276065540. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:13,989][27935] Avg episode reward: [(0, '-47.822')] [2022-07-13 02:57:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 138053632. Throughput: 0: 10298.1. Samples: 276127704. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:18,989][27935] Avg episode reward: [(0, '-48.477')] [2022-07-13 02:57:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 138080256. Throughput: 0: 10298.8. Samples: 276159144. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:23,989][27935] Avg episode reward: [(0, '-48.577')] [2022-07-13 02:57:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.6). Total num frames: 138106880. Throughput: 0: 10296.5. Samples: 276221832. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:28,989][27935] Avg episode reward: [(0, '-48.538')] [2022-07-13 02:57:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 138132480. Throughput: 0: 10289.7. Samples: 276284228. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:33,990][27935] Avg episode reward: [(0, '-48.766')] [2022-07-13 02:57:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 138158080. Throughput: 0: 10283.9. Samples: 276315816. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:38,989][27935] Avg episode reward: [(0, '-48.408')] [2022-07-13 02:57:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 138183680. Throughput: 0: 10255.6. Samples: 276376808. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:43,989][27935] Avg episode reward: [(0, '-47.915')] [2022-07-13 02:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 138210304. Throughput: 0: 10345.2. Samples: 276439860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:48,989][27935] Avg episode reward: [(0, '-47.431')] [2022-07-13 02:57:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 138236928. Throughput: 0: 10352.0. Samples: 276471524. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:53,990][27935] Avg episode reward: [(0, '-47.205')] [2022-07-13 02:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5199.8). Total num frames: 138262528. Throughput: 0: 10422.7. Samples: 276534560. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:57:58,989][27935] Avg episode reward: [(0, '-46.299')] [2022-07-13 02:58:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 138287104. Throughput: 0: 10354.8. Samples: 276593668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:58:03,990][27935] Avg episode reward: [(0, '-46.486')] [2022-07-13 02:58:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 138313728. Throughput: 0: 10358.9. Samples: 276625296. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:58:08,989][27935] Avg episode reward: [(0, '-46.315')] [2022-07-13 02:58:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 138340352. Throughput: 0: 10372.1. Samples: 276688576. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:58:13,989][27935] Avg episode reward: [(0, '-46.921')] [2022-07-13 02:58:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 138365952. Throughput: 0: 10384.3. Samples: 276751520. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 02:58:18,989][27935] Avg episode reward: [(0, '-47.697')] [2022-07-13 02:58:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 138390528. Throughput: 0: 10376.2. Samples: 276782744. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:23,989][27935] Avg episode reward: [(0, '-47.662')] [2022-07-13 02:58:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 138419200. Throughput: 0: 10411.0. Samples: 276845304. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:28,990][27935] Avg episode reward: [(0, '-47.629')] [2022-07-13 02:58:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 138442752. Throughput: 0: 10384.8. Samples: 276907176. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:33,991][27935] Avg episode reward: [(0, '-48.015')] [2022-07-13 02:58:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 138469376. Throughput: 0: 10366.5. Samples: 276938016. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:38,991][27935] Avg episode reward: [(0, '-47.361')] [2022-07-13 02:58:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.1). Total num frames: 138493952. Throughput: 0: 10344.4. Samples: 277000056. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:43,990][27935] Avg episode reward: [(0, '-47.289')] [2022-07-13 02:58:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 138521600. Throughput: 0: 10427.0. Samples: 277062884. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:48,989][27935] Avg episode reward: [(0, '-46.635')] [2022-07-13 02:58:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 138548224. Throughput: 0: 10417.3. Samples: 277094076. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:53,989][27935] Avg episode reward: [(0, '-45.616')] [2022-07-13 02:58:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 138573824. Throughput: 0: 10407.4. Samples: 277156908. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:58:58,990][27935] Avg episode reward: [(0, '-46.452')] [2022-07-13 02:59:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 138598400. Throughput: 0: 10320.8. Samples: 277215956. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:03,989][27935] Avg episode reward: [(0, '-45.989')] [2022-07-13 02:59:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 138625024. Throughput: 0: 10329.5. Samples: 277247572. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:08,989][27935] Avg episode reward: [(0, '-46.495')] [2022-07-13 02:59:13,995][27935] Fps is (10 sec: 5321.4, 60 sec: 5187.7, 300 sec: 5185.8). Total num frames: 138651648. Throughput: 0: 10350.2. Samples: 277311128. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:13,996][27935] Avg episode reward: [(0, '-45.953')] [2022-07-13 02:59:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 138677248. Throughput: 0: 10383.9. Samples: 277374452. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:18,989][27935] Avg episode reward: [(0, '-45.652')] [2022-07-13 02:59:23,989][27935] Fps is (10 sec: 5225.7, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 138703872. Throughput: 0: 10393.3. Samples: 277405712. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:23,989][27935] Avg episode reward: [(0, '-46.008')] [2022-07-13 02:59:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 138730496. Throughput: 0: 10416.9. Samples: 277468816. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:28,989][27935] Avg episode reward: [(0, '-46.010')] [2022-07-13 02:59:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 138756096. Throughput: 0: 10420.2. Samples: 277531792. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:33,989][27935] Avg episode reward: [(0, '-45.311')] [2022-07-13 02:59:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 138781696. Throughput: 0: 10423.7. Samples: 277563140. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:38,989][27935] Avg episode reward: [(0, '-44.920')] [2022-07-13 02:59:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 138807296. Throughput: 0: 10432.4. Samples: 277626368. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:43,989][27935] Avg episode reward: [(0, '-45.412')] [2022-07-13 02:59:48,992][27935] Fps is (10 sec: 5425.3, 60 sec: 5239.2, 300 sec: 5192.8). Total num frames: 138835968. Throughput: 0: 10516.7. Samples: 277689244. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:48,993][27935] Avg episode reward: [(0, '-45.829')] [2022-07-13 02:59:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 138860544. Throughput: 0: 10519.5. Samples: 277720952. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:53,989][27935] Avg episode reward: [(0, '-45.190')] [2022-07-13 02:59:58,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 138888192. Throughput: 0: 10515.7. Samples: 277784268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 02:59:58,990][27935] Avg episode reward: [(0, '-45.536')] [2022-07-13 03:00:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 138911744. Throughput: 0: 10417.9. Samples: 277843256. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:00:03,991][27935] Avg episode reward: [(0, '-45.675')] [2022-07-13 03:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 138938368. Throughput: 0: 10430.2. Samples: 277875072. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:00:08,991][27935] Avg episode reward: [(0, '-46.018')] [2022-07-13 03:00:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.9, 300 sec: 5196.4). Total num frames: 138964992. Throughput: 0: 10422.2. Samples: 277937816. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:00:13,989][27935] Avg episode reward: [(0, '-45.394')] [2022-07-13 03:00:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 138990592. Throughput: 0: 10416.3. Samples: 278000524. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:00:18,989][27935] Avg episode reward: [(0, '-45.742')] [2022-07-13 03:00:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 139016192. Throughput: 0: 10414.1. Samples: 278031776. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:00:23,989][27935] Avg episode reward: [(0, '-46.119')] [2022-07-13 03:00:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 139043840. Throughput: 0: 10396.6. Samples: 278094216. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:28,989][27935] Avg episode reward: [(0, '-45.220')] [2022-07-13 03:00:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 139068416. Throughput: 0: 10383.1. Samples: 278156448. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:33,990][27935] Avg episode reward: [(0, '-44.732')] [2022-07-13 03:00:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 139095040. Throughput: 0: 10383.9. Samples: 278188228. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:38,989][27935] Avg episode reward: [(0, '-44.532')] [2022-07-13 03:00:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 139119616. Throughput: 0: 10344.9. Samples: 278249788. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:43,989][27935] Avg episode reward: [(0, '-43.996')] [2022-07-13 03:00:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.5, 300 sec: 5189.4). Total num frames: 139146240. Throughput: 0: 10404.4. Samples: 278311452. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:48,990][27935] Avg episode reward: [(0, '-44.301')] [2022-07-13 03:00:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 139171840. Throughput: 0: 10393.6. Samples: 278342784. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:53,991][27935] Avg episode reward: [(0, '-44.610')] [2022-07-13 03:00:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 139197440. Throughput: 0: 10369.5. Samples: 278404444. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:00:58,989][27935] Avg episode reward: [(0, '-44.896')] [2022-07-13 03:01:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 139220992. Throughput: 0: 10250.8. Samples: 278461812. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:03,991][27935] Avg episode reward: [(0, '-44.908')] [2022-07-13 03:01:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 139247616. Throughput: 0: 10246.9. Samples: 278492888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:08,991][27935] Avg episode reward: [(0, '-46.392')] [2022-07-13 03:01:14,005][27935] Fps is (10 sec: 5214.1, 60 sec: 5135.7, 300 sec: 5182.2). Total num frames: 139273216. Throughput: 0: 10232.1. Samples: 278554824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:14,006][27935] Avg episode reward: [(0, '-46.865')] [2022-07-13 03:01:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 139298816. Throughput: 0: 10219.6. Samples: 278616332. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:18,989][27935] Avg episode reward: [(0, '-46.755')] [2022-07-13 03:01:23,989][27935] Fps is (10 sec: 5128.1, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 139324416. Throughput: 0: 10194.9. Samples: 278646996. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:23,989][27935] Avg episode reward: [(0, '-46.151')] [2022-07-13 03:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5175.5). Total num frames: 139348992. Throughput: 0: 10181.5. Samples: 278707956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:28,989][27935] Avg episode reward: [(0, '-45.882')] [2022-07-13 03:01:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5175.5). Total num frames: 139374592. Throughput: 0: 10161.3. Samples: 278768712. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:33,989][27935] Avg episode reward: [(0, '-46.074')] [2022-07-13 03:01:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5168.6). Total num frames: 139400192. Throughput: 0: 10143.6. Samples: 278799244. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:38,989][27935] Avg episode reward: [(0, '-45.192')] [2022-07-13 03:01:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5172.1). Total num frames: 139425792. Throughput: 0: 10119.5. Samples: 278859824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:43,989][27935] Avg episode reward: [(0, '-44.457')] [2022-07-13 03:01:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5168.6). Total num frames: 139451392. Throughput: 0: 10167.1. Samples: 278919332. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:48,989][27935] Avg episode reward: [(0, '-44.781')] [2022-07-13 03:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5151.2). Total num frames: 139473920. Throughput: 0: 10156.9. Samples: 278949948. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:53,989][27935] Avg episode reward: [(0, '-44.609')] [2022-07-13 03:01:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5161.7). Total num frames: 139500544. Throughput: 0: 10145.1. Samples: 279011192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:01:58,991][27935] Avg episode reward: [(0, '-43.884')] [2022-07-13 03:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5158.2). Total num frames: 139524096. Throughput: 0: 10038.8. Samples: 279068080. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:03,989][27935] Avg episode reward: [(0, '-43.713')] [2022-07-13 03:02:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5161.7). Total num frames: 139550720. Throughput: 0: 10031.7. Samples: 279098424. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:08,989][27935] Avg episode reward: [(0, '-43.137')] [2022-07-13 03:02:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5018.9, 300 sec: 5154.7). Total num frames: 139574272. Throughput: 0: 10030.0. Samples: 279159308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:13,990][27935] Avg episode reward: [(0, '-43.685')] [2022-07-13 03:02:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5151.2). Total num frames: 139599872. Throughput: 0: 10018.9. Samples: 279219560. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:18,989][27935] Avg episode reward: [(0, '-43.697')] [2022-07-13 03:02:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5147.8). Total num frames: 139625472. Throughput: 0: 10011.4. Samples: 279249756. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:23,989][27935] Avg episode reward: [(0, '-42.652')] [2022-07-13 03:02:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5144.3). Total num frames: 139650048. Throughput: 0: 10003.6. Samples: 279309984. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:02:28,989][27935] Avg episode reward: [(0, '-42.598')] [2022-07-13 03:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5140.8). Total num frames: 139674624. Throughput: 0: 10015.7. Samples: 279370040. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:33,989][27935] Avg episode reward: [(0, '-42.356')] [2022-07-13 03:02:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5140.8). Total num frames: 139700224. Throughput: 0: 10001.7. Samples: 279400024. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:38,989][27935] Avg episode reward: [(0, '-42.463')] [2022-07-13 03:02:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5137.4). Total num frames: 139725824. Throughput: 0: 9958.4. Samples: 279459320. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:43,989][27935] Avg episode reward: [(0, '-41.954')] [2022-07-13 03:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5130.4). Total num frames: 139750400. Throughput: 0: 10046.7. Samples: 279520180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:48,990][27935] Avg episode reward: [(0, '-41.579')] [2022-07-13 03:02:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5126.9). Total num frames: 139774976. Throughput: 0: 10058.0. Samples: 279551036. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:53,989][27935] Avg episode reward: [(0, '-42.068')] [2022-07-13 03:02:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5133.9). Total num frames: 139801600. Throughput: 0: 10064.5. Samples: 279612212. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:02:58,989][27935] Avg episode reward: [(0, '-41.899')] [2022-07-13 03:03:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5120.0). Total num frames: 139824128. Throughput: 0: 9403.4. Samples: 279642712. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:03,989][27935] Avg episode reward: [(0, '-41.928')] [2022-07-13 03:03:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5120.0). Total num frames: 139850752. Throughput: 0: 10011.9. Samples: 279700292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:08,989][27935] Avg episode reward: [(0, '-43.019')] [2022-07-13 03:03:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5120.0). Total num frames: 139876352. Throughput: 0: 10020.2. Samples: 279760892. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:13,989][27935] Avg episode reward: [(0, '-44.189')] [2022-07-13 03:03:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5116.5). Total num frames: 139899904. Throughput: 0: 10002.0. Samples: 279820132. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:18,989][27935] Avg episode reward: [(0, '-44.447')] [2022-07-13 03:03:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5106.1). Total num frames: 139925504. Throughput: 0: 10019.4. Samples: 279850896. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:23,989][27935] Avg episode reward: [(0, '-43.915')] [2022-07-13 03:03:28,997][27935] Fps is (10 sec: 5218.2, 60 sec: 5034.0, 300 sec: 5116.4). Total num frames: 139952128. Throughput: 0: 10048.5. Samples: 279911584. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:28,998][27935] Avg episode reward: [(0, '-43.566')] [2022-07-13 03:03:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5109.6). Total num frames: 139976704. Throughput: 0: 10052.0. Samples: 279972520. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:33,990][27935] Avg episode reward: [(0, '-43.888')] [2022-07-13 03:03:38,989][27935] Fps is (10 sec: 4919.2, 60 sec: 5017.6, 300 sec: 5109.6). Total num frames: 140001280. Throughput: 0: 10043.2. Samples: 280002980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:38,991][27935] Avg episode reward: [(0, '-44.942')] [2022-07-13 03:03:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5109.6). Total num frames: 140028928. Throughput: 0: 10036.7. Samples: 280063864. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:43,989][27935] Avg episode reward: [(0, '-43.875')] [2022-07-13 03:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5095.7). Total num frames: 140051456. Throughput: 0: 10713.1. Samples: 280124800. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:48,989][27935] Avg episode reward: [(0, '-43.807')] [2022-07-13 03:03:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5099.2). Total num frames: 140078080. Throughput: 0: 10117.7. Samples: 280155588. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:53,989][27935] Avg episode reward: [(0, '-44.783')] [2022-07-13 03:03:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5102.6). Total num frames: 140103680. Throughput: 0: 10115.6. Samples: 280216092. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:03:58,989][27935] Avg episode reward: [(0, '-45.128')] [2022-07-13 03:04:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5095.7). Total num frames: 140128256. Throughput: 0: 10084.6. Samples: 280273940. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:03,991][27935] Avg episode reward: [(0, '-44.973')] [2022-07-13 03:04:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5088.9). Total num frames: 140152832. Throughput: 0: 10081.6. Samples: 280304568. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:08,989][27935] Avg episode reward: [(0, '-45.776')] [2022-07-13 03:04:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5085.3). Total num frames: 140177408. Throughput: 0: 10051.5. Samples: 280363820. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:13,989][27935] Avg episode reward: [(0, '-46.148')] [2022-07-13 03:04:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 140200960. Throughput: 0: 10007.6. Samples: 280422860. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:18,989][27935] Avg episode reward: [(0, '-45.986')] [2022-07-13 03:04:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 140227584. Throughput: 0: 10000.6. Samples: 280453008. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:23,989][27935] Avg episode reward: [(0, '-45.852')] [2022-07-13 03:04:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4984.1, 300 sec: 5067.9). Total num frames: 140251136. Throughput: 0: 9978.3. Samples: 280512888. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:28,989][27935] Avg episode reward: [(0, '-45.593')] [2022-07-13 03:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5067.9). Total num frames: 140276736. Throughput: 0: 9950.7. Samples: 280572580. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:04:33,989][27935] Avg episode reward: [(0, '-46.397')] [2022-07-13 03:04:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5064.5). Total num frames: 140301312. Throughput: 0: 9935.2. Samples: 280602672. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:04:38,993][27935] Avg episode reward: [(0, '-45.681')] [2022-07-13 03:04:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5057.6). Total num frames: 140327936. Throughput: 0: 9938.0. Samples: 280663304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:04:43,989][27935] Avg episode reward: [(0, '-44.725')] [2022-07-13 03:04:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5054.0). Total num frames: 140351488. Throughput: 0: 9984.4. Samples: 280723240. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:04:48,989][27935] Avg episode reward: [(0, '-44.227')] [2022-07-13 03:04:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 5047.1). Total num frames: 140377088. Throughput: 0: 9971.6. Samples: 280753292. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:04:53,989][27935] Avg episode reward: [(0, '-43.840')] [2022-07-13 03:04:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5050.6). Total num frames: 140401664. Throughput: 0: 9991.3. Samples: 280813428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:04:58,989][27935] Avg episode reward: [(0, '-43.588')] [2022-07-13 03:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 5036.7). Total num frames: 140424192. Throughput: 0: 9908.3. Samples: 280868732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:03,989][27935] Avg episode reward: [(0, '-43.749')] [2022-07-13 03:05:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 5033.2). Total num frames: 140449792. Throughput: 0: 9894.7. Samples: 280898272. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:08,989][27935] Avg episode reward: [(0, '-43.490')] [2022-07-13 03:05:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 5026.3). Total num frames: 140473344. Throughput: 0: 9874.4. Samples: 280957236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:13,989][27935] Avg episode reward: [(0, '-43.709')] [2022-07-13 03:05:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 5019.3). Total num frames: 140496896. Throughput: 0: 9842.8. Samples: 281015508. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:18,989][27935] Avg episode reward: [(0, '-43.859')] [2022-07-13 03:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 5008.9). Total num frames: 140521472. Throughput: 0: 9834.4. Samples: 281045220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:23,989][27935] Avg episode reward: [(0, '-43.447')] [2022-07-13 03:05:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5015.9). Total num frames: 140548096. Throughput: 0: 9799.1. Samples: 281104264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:28,989][27935] Avg episode reward: [(0, '-43.070')] [2022-07-13 03:05:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 5005.5). Total num frames: 140571648. Throughput: 0: 9764.4. Samples: 281162640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:33,989][27935] Avg episode reward: [(0, '-43.666')] [2022-07-13 03:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 5005.5). Total num frames: 140596224. Throughput: 0: 9756.9. Samples: 281192352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:38,990][27935] Avg episode reward: [(0, '-44.795')] [2022-07-13 03:05:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5002.0). Total num frames: 140621824. Throughput: 0: 9761.1. Samples: 281252680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:43,989][27935] Avg episode reward: [(0, '-44.082')] [2022-07-13 03:05:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 5002.0). Total num frames: 140647424. Throughput: 0: 9863.1. Samples: 281312572. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:48,990][27935] Avg episode reward: [(0, '-44.360')] [2022-07-13 03:05:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4995.0). Total num frames: 140670976. Throughput: 0: 9879.7. Samples: 281342856. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:53,991][27935] Avg episode reward: [(0, '-44.330')] [2022-07-13 03:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5002.0). Total num frames: 140696576. Throughput: 0: 9909.4. Samples: 281403160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:05:58,989][27935] Avg episode reward: [(0, '-44.444')] [2022-07-13 03:06:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4991.6). Total num frames: 140720128. Throughput: 0: 9869.9. Samples: 281459652. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:03,991][27935] Avg episode reward: [(0, '-43.776')] [2022-07-13 03:06:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4988.4). Total num frames: 140744704. Throughput: 0: 9879.9. Samples: 281489816. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:08,991][27935] Avg episode reward: [(0, '-43.120')] [2022-07-13 03:06:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4966.4, 300 sec: 4991.6). Total num frames: 140771328. Throughput: 0: 9913.6. Samples: 281550376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:13,992][27935] Avg episode reward: [(0, '-42.928')] [2022-07-13 03:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4988.1). Total num frames: 140795904. Throughput: 0: 9938.4. Samples: 281609868. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:18,990][27935] Avg episode reward: [(0, '-42.755')] [2022-07-13 03:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4984.6). Total num frames: 140819456. Throughput: 0: 9944.4. Samples: 281639848. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:23,989][27935] Avg episode reward: [(0, '-42.952')] [2022-07-13 03:06:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4984.6). Total num frames: 140845056. Throughput: 0: 9946.2. Samples: 281700260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:28,989][27935] Avg episode reward: [(0, '-44.161')] [2022-07-13 03:06:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4981.2). Total num frames: 140869632. Throughput: 0: 9949.6. Samples: 281760304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:33,989][27935] Avg episode reward: [(0, '-43.979')] [2022-07-13 03:06:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 140897280. Throughput: 0: 9961.2. Samples: 281791112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 03:06:38,989][27935] Avg episode reward: [(0, '-43.829')] [2022-07-13 03:06:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4977.7). Total num frames: 140919808. Throughput: 0: 9964.5. Samples: 281851564. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:06:43,989][27935] Avg episode reward: [(0, '-44.290')] [2022-07-13 03:06:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 140946432. Throughput: 0: 10050.4. Samples: 281911920. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:06:48,989][27935] Avg episode reward: [(0, '-45.273')] [2022-07-13 03:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 140971008. Throughput: 0: 10056.3. Samples: 281942348. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:06:53,989][27935] Avg episode reward: [(0, '-45.798')] [2022-07-13 03:06:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4991.6). Total num frames: 140996608. Throughput: 0: 10075.7. Samples: 282003784. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:06:58,989][27935] Avg episode reward: [(0, '-45.479')] [2022-07-13 03:07:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4981.2). Total num frames: 141020160. Throughput: 0: 10017.1. Samples: 282060636. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:03,989][27935] Avg episode reward: [(0, '-45.183')] [2022-07-13 03:07:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 141046784. Throughput: 0: 10024.9. Samples: 282090968. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:08,990][27935] Avg episode reward: [(0, '-45.135')] [2022-07-13 03:07:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 141071360. Throughput: 0: 10030.5. Samples: 282151632. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:13,989][27935] Avg episode reward: [(0, '-44.274')] [2022-07-13 03:07:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 141096960. Throughput: 0: 10047.7. Samples: 282212452. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:18,989][27935] Avg episode reward: [(0, '-43.042')] [2022-07-13 03:07:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5051.7, 300 sec: 4991.6). Total num frames: 141122560. Throughput: 0: 10046.9. Samples: 282243220. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:23,989][27935] Avg episode reward: [(0, '-42.122')] [2022-07-13 03:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4988.1). Total num frames: 141146112. Throughput: 0: 10049.0. Samples: 282303768. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:28,990][27935] Avg episode reward: [(0, '-41.498')] [2022-07-13 03:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 4991.6). Total num frames: 141172736. Throughput: 0: 10056.8. Samples: 282364476. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:33,991][27935] Avg episode reward: [(0, '-41.577')] [2022-07-13 03:07:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 4984.6). Total num frames: 141196288. Throughput: 0: 10056.1. Samples: 282394872. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:38,989][27935] Avg episode reward: [(0, '-41.872')] [2022-07-13 03:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4995.0). Total num frames: 141223936. Throughput: 0: 10020.4. Samples: 282454700. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:43,989][27935] Avg episode reward: [(0, '-42.622')] [2022-07-13 03:07:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 141246464. Throughput: 0: 10107.6. Samples: 282515476. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:48,991][27935] Avg episode reward: [(0, '-43.085')] [2022-07-13 03:07:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 4988.1). Total num frames: 141273088. Throughput: 0: 10108.3. Samples: 282545840. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:53,989][27935] Avg episode reward: [(0, '-43.469')] [2022-07-13 03:07:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4998.5). Total num frames: 141298688. Throughput: 0: 10110.5. Samples: 282606604. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:07:58,990][27935] Avg episode reward: [(0, '-44.071')] [2022-07-13 03:08:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 4984.6). Total num frames: 141321216. Throughput: 0: 10016.4. Samples: 282663188. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:03,989][27935] Avg episode reward: [(0, '-44.788')] [2022-07-13 03:08:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 141348864. Throughput: 0: 10009.9. Samples: 282693668. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:08,989][27935] Avg episode reward: [(0, '-44.562')] [2022-07-13 03:08:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 141372416. Throughput: 0: 10024.8. Samples: 282754884. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:13,990][27935] Avg episode reward: [(0, '-43.951')] [2022-07-13 03:08:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 141398016. Throughput: 0: 10032.3. Samples: 282815928. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:18,989][27935] Avg episode reward: [(0, '-43.732')] [2022-07-13 03:08:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4991.7). Total num frames: 141424640. Throughput: 0: 10029.0. Samples: 282846176. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:23,989][27935] Avg episode reward: [(0, '-43.338')] [2022-07-13 03:08:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4988.1). Total num frames: 141448192. Throughput: 0: 10056.8. Samples: 282907256. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:28,989][27935] Avg episode reward: [(0, '-42.276')] [2022-07-13 03:08:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 4998.5). Total num frames: 141475840. Throughput: 0: 10061.0. Samples: 282968220. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:33,989][27935] Avg episode reward: [(0, '-41.180')] [2022-07-13 03:08:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 4988.1). Total num frames: 141500416. Throughput: 0: 10064.2. Samples: 282998728. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:38,989][27935] Avg episode reward: [(0, '-41.386')] [2022-07-13 03:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 141524992. Throughput: 0: 10072.3. Samples: 283059856. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 03:08:43,989][27935] Avg episode reward: [(0, '-42.395')] [2022-07-13 03:08:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 4984.6). Total num frames: 141548544. Throughput: 0: 10159.4. Samples: 283120360. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:08:48,989][27935] Avg episode reward: [(0, '-41.822')] [2022-07-13 03:08:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 4988.1). Total num frames: 141575168. Throughput: 0: 10163.1. Samples: 283151008. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:08:53,989][27935] Avg episode reward: [(0, '-42.346')] [2022-07-13 03:08:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 4991.6). Total num frames: 141600768. Throughput: 0: 10140.4. Samples: 283211200. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:08:58,989][27935] Avg episode reward: [(0, '-42.728')] [2022-07-13 03:09:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 4988.1). Total num frames: 141624320. Throughput: 0: 9439.0. Samples: 283240684. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:03,989][27935] Avg episode reward: [(0, '-43.790')] [2022-07-13 03:09:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 4988.1). Total num frames: 141648896. Throughput: 0: 9998.4. Samples: 283296104. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:08,989][27935] Avg episode reward: [(0, '-43.121')] [2022-07-13 03:09:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5034.7, 300 sec: 4995.0). Total num frames: 141674496. Throughput: 0: 9997.0. Samples: 283357120. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:13,989][27935] Avg episode reward: [(0, '-43.559')] [2022-07-13 03:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 4984.6). Total num frames: 141698048. Throughput: 0: 9315.2. Samples: 283387404. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:18,989][27935] Avg episode reward: [(0, '-42.647')] [2022-07-13 03:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 4991.6). Total num frames: 141723648. Throughput: 0: 9940.0. Samples: 283446028. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:23,989][27935] Avg episode reward: [(0, '-43.941')] [2022-07-13 03:09:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 4991.6). Total num frames: 141749248. Throughput: 0: 9949.7. Samples: 283507592. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:28,989][27935] Avg episode reward: [(0, '-42.697')] [2022-07-13 03:09:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 141774848. Throughput: 0: 9982.5. Samples: 283569572. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:33,989][27935] Avg episode reward: [(0, '-43.171')] [2022-07-13 03:09:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 4995.0). Total num frames: 141801472. Throughput: 0: 9998.9. Samples: 283600960. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:38,989][27935] Avg episode reward: [(0, '-42.731')] [2022-07-13 03:09:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 5005.5). Total num frames: 141828096. Throughput: 0: 10049.3. Samples: 283663416. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:43,989][27935] Avg episode reward: [(0, '-42.482')] [2022-07-13 03:09:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5005.5). Total num frames: 141853696. Throughput: 0: 10774.7. Samples: 283725544. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:48,989][27935] Avg episode reward: [(0, '-42.389')] [2022-07-13 03:09:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5005.5). Total num frames: 141878272. Throughput: 0: 10230.3. Samples: 283756468. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:53,989][27935] Avg episode reward: [(0, '-42.692')] [2022-07-13 03:09:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5019.3). Total num frames: 141904896. Throughput: 0: 10256.9. Samples: 283818680. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:09:58,990][27935] Avg episode reward: [(0, '-42.179')] [2022-07-13 03:10:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5008.9). Total num frames: 141927424. Throughput: 0: 10879.1. Samples: 283876964. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:03,989][27935] Avg episode reward: [(0, '-42.132')] [2022-07-13 03:10:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5022.8). Total num frames: 141955072. Throughput: 0: 10257.0. Samples: 283907592. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:08,989][27935] Avg episode reward: [(0, '-42.729')] [2022-07-13 03:10:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5029.8). Total num frames: 141980672. Throughput: 0: 10267.0. Samples: 283969608. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:13,989][27935] Avg episode reward: [(0, '-42.581')] [2022-07-13 03:10:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5033.2). Total num frames: 142006272. Throughput: 0: 10258.8. Samples: 284031220. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:18,989][27935] Avg episode reward: [(0, '-43.101')] [2022-07-13 03:10:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5026.3). Total num frames: 142030848. Throughput: 0: 10246.1. Samples: 284062036. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:24,003][27935] Avg episode reward: [(0, '-43.794')] [2022-07-13 03:10:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5043.6). Total num frames: 142059520. Throughput: 0: 10235.3. Samples: 284124004. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:28,990][27935] Avg episode reward: [(0, '-42.919')] [2022-07-13 03:10:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5036.7). Total num frames: 142082048. Throughput: 0: 10217.9. Samples: 284185348. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:33,989][27935] Avg episode reward: [(0, '-43.489')] [2022-07-13 03:10:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5043.6). Total num frames: 142109696. Throughput: 0: 10222.6. Samples: 284216484. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:38,989][27935] Avg episode reward: [(0, '-43.302')] [2022-07-13 03:10:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 142133248. Throughput: 0: 10228.9. Samples: 284278980. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:43,989][27935] Avg episode reward: [(0, '-42.845')] [2022-07-13 03:10:48,990][27935] Fps is (10 sec: 5221.7, 60 sec: 5136.9, 300 sec: 5054.0). Total num frames: 142161920. Throughput: 0: 10322.9. Samples: 284341508. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 03:10:48,991][27935] Avg episode reward: [(0, '-41.691')] [2022-07-13 03:10:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5154.1, 300 sec: 5054.0). Total num frames: 142187520. Throughput: 0: 10338.3. Samples: 284372816. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:10:53,990][27935] Avg episode reward: [(0, '-41.020')] [2022-07-13 03:10:58,989][27935] Fps is (10 sec: 5120.7, 60 sec: 5137.1, 300 sec: 5061.0). Total num frames: 142213120. Throughput: 0: 10369.3. Samples: 284436228. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:10:58,989][27935] Avg episode reward: [(0, '-41.881')] [2022-07-13 03:11:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5061.0). Total num frames: 142237696. Throughput: 0: 10317.1. Samples: 284495488. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:03,991][27935] Avg episode reward: [(0, '-41.525')] [2022-07-13 03:11:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5061.0). Total num frames: 142264320. Throughput: 0: 10319.5. Samples: 284526412. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:08,989][27935] Avg episode reward: [(0, '-41.832')] [2022-07-13 03:11:13,997][27935] Fps is (10 sec: 5320.6, 60 sec: 5170.5, 300 sec: 5067.8). Total num frames: 142290944. Throughput: 0: 10340.6. Samples: 284589412. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:13,997][27935] Avg episode reward: [(0, '-41.827')] [2022-07-13 03:11:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5067.9). Total num frames: 142314496. Throughput: 0: 10367.7. Samples: 284651896. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:18,989][27935] Avg episode reward: [(0, '-42.755')] [2022-07-13 03:11:23,989][27935] Fps is (10 sec: 5021.6, 60 sec: 5171.2, 300 sec: 5071.4). Total num frames: 142341120. Throughput: 0: 10366.0. Samples: 284682952. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:23,989][27935] Avg episode reward: [(0, '-43.718')] [2022-07-13 03:11:28,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5171.2, 300 sec: 5085.3). Total num frames: 142369792. Throughput: 0: 10385.0. Samples: 284746304. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:28,989][27935] Avg episode reward: [(0, '-42.690')] [2022-07-13 03:11:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5074.9). Total num frames: 142394368. Throughput: 0: 10380.3. Samples: 284808608. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:33,989][27935] Avg episode reward: [(0, '-43.881')] [2022-07-13 03:11:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5088.8). Total num frames: 142420992. Throughput: 0: 10387.8. Samples: 284840268. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:38,989][27935] Avg episode reward: [(0, '-44.610')] [2022-07-13 03:11:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5081.8). Total num frames: 142445568. Throughput: 0: 10361.8. Samples: 284902508. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:43,989][27935] Avg episode reward: [(0, '-44.873')] [2022-07-13 03:11:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.4, 300 sec: 5092.2). Total num frames: 142473216. Throughput: 0: 10453.7. Samples: 284965904. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:48,989][27935] Avg episode reward: [(0, '-44.205')] [2022-07-13 03:11:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5095.7). Total num frames: 142499840. Throughput: 0: 10463.3. Samples: 284997260. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:53,989][27935] Avg episode reward: [(0, '-43.778')] [2022-07-13 03:11:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5099.2). Total num frames: 142524416. Throughput: 0: 10469.6. Samples: 285060464. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:11:58,991][27935] Avg episode reward: [(0, '-43.961')] [2022-07-13 03:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5095.7). Total num frames: 142550016. Throughput: 0: 10389.8. Samples: 285119436. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:03,992][27935] Avg episode reward: [(0, '-43.719')] [2022-07-13 03:12:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5102.6). Total num frames: 142576640. Throughput: 0: 10403.5. Samples: 285151112. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:08,989][27935] Avg episode reward: [(0, '-43.511')] [2022-07-13 03:12:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.9, 300 sec: 5102.6). Total num frames: 142602240. Throughput: 0: 10377.4. Samples: 285213288. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:13,989][27935] Avg episode reward: [(0, '-42.750')] [2022-07-13 03:12:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5102.6). Total num frames: 142627840. Throughput: 0: 10365.6. Samples: 285275060. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:18,989][27935] Avg episode reward: [(0, '-42.002')] [2022-07-13 03:12:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5109.6). Total num frames: 142653440. Throughput: 0: 10352.2. Samples: 285306116. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:23,989][27935] Avg episode reward: [(0, '-43.878')] [2022-07-13 03:12:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5106.1). Total num frames: 142679040. Throughput: 0: 10344.7. Samples: 285368020. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:28,989][27935] Avg episode reward: [(0, '-44.085')] [2022-07-13 03:12:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5116.5). Total num frames: 142705664. Throughput: 0: 10298.1. Samples: 285429320. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:33,989][27935] Avg episode reward: [(0, '-44.686')] [2022-07-13 03:12:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5106.1). Total num frames: 142730240. Throughput: 0: 10310.6. Samples: 285461236. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:38,989][27935] Avg episode reward: [(0, '-44.447')] [2022-07-13 03:12:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5116.5). Total num frames: 142755840. Throughput: 0: 10250.2. Samples: 285521724. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:43,989][27935] Avg episode reward: [(0, '-45.107')] [2022-07-13 03:12:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5120.0). Total num frames: 142783488. Throughput: 0: 10336.2. Samples: 285584564. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:48,989][27935] Avg episode reward: [(0, '-45.649')] [2022-07-13 03:12:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 142809088. Throughput: 0: 10323.6. Samples: 285615672. Policy #0 lag: (min: 0.0, avg: 6.9, max: 17.0) [2022-07-13 03:12:53,990][27935] Avg episode reward: [(0, '-44.885')] [2022-07-13 03:12:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5130.4). Total num frames: 142834688. Throughput: 0: 10344.9. Samples: 285678808. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:12:58,989][27935] Avg episode reward: [(0, '-44.872')] [2022-07-13 03:13:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 142859264. Throughput: 0: 10282.4. Samples: 285737768. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:03,989][27935] Avg episode reward: [(0, '-44.121')] [2022-07-13 03:13:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 142884864. Throughput: 0: 10281.9. Samples: 285768804. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:08,989][27935] Avg episode reward: [(0, '-44.361')] [2022-07-13 03:13:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 142911488. Throughput: 0: 10303.7. Samples: 285831688. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:13,989][27935] Avg episode reward: [(0, '-44.392')] [2022-07-13 03:13:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 142937088. Throughput: 0: 10330.1. Samples: 285894176. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:18,989][27935] Avg episode reward: [(0, '-44.882')] [2022-07-13 03:13:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 142963712. Throughput: 0: 10319.1. Samples: 285925596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:23,989][27935] Avg episode reward: [(0, '-45.345')] [2022-07-13 03:13:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5126.9). Total num frames: 142988288. Throughput: 0: 10364.2. Samples: 285988112. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:28,989][27935] Avg episode reward: [(0, '-46.270')] [2022-07-13 03:13:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5137.4). Total num frames: 143015936. Throughput: 0: 10358.7. Samples: 286050704. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:33,989][27935] Avg episode reward: [(0, '-45.799')] [2022-07-13 03:13:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5140.8). Total num frames: 143041536. Throughput: 0: 10362.7. Samples: 286081996. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:38,991][27935] Avg episode reward: [(0, '-45.684')] [2022-07-13 03:13:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5154.7). Total num frames: 143069184. Throughput: 0: 10357.9. Samples: 286144916. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:43,990][27935] Avg episode reward: [(0, '-46.012')] [2022-07-13 03:13:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 143092736. Throughput: 0: 10429.9. Samples: 286207112. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:48,991][27935] Avg episode reward: [(0, '-46.131')] [2022-07-13 03:13:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 143120384. Throughput: 0: 10437.8. Samples: 286238504. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:53,990][27935] Avg episode reward: [(0, '-44.487')] [2022-07-13 03:13:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5161.7). Total num frames: 143147008. Throughput: 0: 10448.6. Samples: 286301876. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:13:58,989][27935] Avg episode reward: [(0, '-43.300')] [2022-07-13 03:14:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 143169536. Throughput: 0: 10374.7. Samples: 286361036. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:03,989][27935] Avg episode reward: [(0, '-43.155')] [2022-07-13 03:14:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5161.7). Total num frames: 143197184. Throughput: 0: 10366.3. Samples: 286392080. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:08,989][27935] Avg episode reward: [(0, '-43.432')] [2022-07-13 03:14:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 143222784. Throughput: 0: 10358.0. Samples: 286454220. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:13,989][27935] Avg episode reward: [(0, '-42.992')] [2022-07-13 03:14:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 143247360. Throughput: 0: 10341.7. Samples: 286516080. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:18,991][27935] Avg episode reward: [(0, '-42.227')] [2022-07-13 03:14:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 143275008. Throughput: 0: 10342.4. Samples: 286547404. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:23,989][27935] Avg episode reward: [(0, '-43.072')] [2022-07-13 03:14:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 143300608. Throughput: 0: 10340.2. Samples: 286610224. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:28,990][27935] Avg episode reward: [(0, '-44.039')] [2022-07-13 03:14:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 143326208. Throughput: 0: 10341.2. Samples: 286672468. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:33,989][27935] Avg episode reward: [(0, '-43.753')] [2022-07-13 03:14:38,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 143353856. Throughput: 0: 10344.6. Samples: 286704012. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:38,990][27935] Avg episode reward: [(0, '-44.038')] [2022-07-13 03:14:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 143379456. Throughput: 0: 10323.9. Samples: 286766452. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:43,998][27935] Avg episode reward: [(0, '-44.736')] [2022-07-13 03:14:48,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 143405056. Throughput: 0: 10405.0. Samples: 286829260. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:48,989][27935] Avg episode reward: [(0, '-44.582')] [2022-07-13 03:14:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 143429632. Throughput: 0: 10414.8. Samples: 286860744. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:53,989][27935] Avg episode reward: [(0, '-44.083')] [2022-07-13 03:14:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 143458304. Throughput: 0: 10426.8. Samples: 286923428. Policy #0 lag: (min: 0.0, avg: 10.1, max: 23.0) [2022-07-13 03:14:58,989][27935] Avg episode reward: [(0, '-43.634')] [2022-07-13 03:15:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 143480832. Throughput: 0: 10356.5. Samples: 286982124. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:03,989][27935] Avg episode reward: [(0, '-43.655')] [2022-07-13 03:15:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 143508480. Throughput: 0: 10365.3. Samples: 287013844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:08,989][27935] Avg episode reward: [(0, '-43.214')] [2022-07-13 03:15:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 143532032. Throughput: 0: 10342.4. Samples: 287075632. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:13,989][27935] Avg episode reward: [(0, '-42.832')] [2022-07-13 03:15:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 143558656. Throughput: 0: 10344.4. Samples: 287137968. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:18,990][27935] Avg episode reward: [(0, '-43.997')] [2022-07-13 03:15:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 143583232. Throughput: 0: 10308.3. Samples: 287167884. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:23,989][27935] Avg episode reward: [(0, '-44.049')] [2022-07-13 03:15:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 143609856. Throughput: 0: 10259.8. Samples: 287228144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:28,989][27935] Avg episode reward: [(0, '-43.881')] [2022-07-13 03:15:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 143635456. Throughput: 0: 10253.3. Samples: 287290660. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:33,989][27935] Avg episode reward: [(0, '-43.802')] [2022-07-13 03:15:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 143662080. Throughput: 0: 10255.6. Samples: 287322244. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:38,989][27935] Avg episode reward: [(0, '-43.731')] [2022-07-13 03:15:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5168.6). Total num frames: 143686656. Throughput: 0: 10248.8. Samples: 287384624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:43,991][27935] Avg episode reward: [(0, '-44.505')] [2022-07-13 03:15:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 143715328. Throughput: 0: 10345.0. Samples: 287447648. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:48,990][27935] Avg episode reward: [(0, '-44.508')] [2022-07-13 03:15:53,992][27935] Fps is (10 sec: 5323.0, 60 sec: 5170.9, 300 sec: 5175.5). Total num frames: 143739904. Throughput: 0: 10343.9. Samples: 287479356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:53,994][27935] Avg episode reward: [(0, '-43.693')] [2022-07-13 03:15:58,990][27935] Fps is (10 sec: 5324.0, 60 sec: 5171.1, 300 sec: 5189.4). Total num frames: 143768576. Throughput: 0: 10378.1. Samples: 287542660. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:15:58,991][27935] Avg episode reward: [(0, '-43.562')] [2022-07-13 03:16:03,989][27935] Fps is (10 sec: 5019.3, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 143790080. Throughput: 0: 10309.3. Samples: 287601884. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:03,989][27935] Avg episode reward: [(0, '-43.780')] [2022-07-13 03:16:08,989][27935] Fps is (10 sec: 4915.9, 60 sec: 5154.1, 300 sec: 5175.7). Total num frames: 143817728. Throughput: 0: 10346.9. Samples: 287633496. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:08,989][27935] Avg episode reward: [(0, '-43.464')] [2022-07-13 03:16:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 143843328. Throughput: 0: 10409.9. Samples: 287696588. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:13,989][27935] Avg episode reward: [(0, '-44.079')] [2022-07-13 03:16:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 143869952. Throughput: 0: 10426.7. Samples: 287759860. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:18,989][27935] Avg episode reward: [(0, '-44.081')] [2022-07-13 03:16:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 143895552. Throughput: 0: 10425.1. Samples: 287791372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:23,989][27935] Avg episode reward: [(0, '-45.116')] [2022-07-13 03:16:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 143923200. Throughput: 0: 10435.3. Samples: 287854212. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:28,989][27935] Avg episode reward: [(0, '-45.482')] [2022-07-13 03:16:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 143948800. Throughput: 0: 10429.5. Samples: 287916976. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:33,989][27935] Avg episode reward: [(0, '-45.329')] [2022-07-13 03:16:38,991][27935] Fps is (10 sec: 5118.8, 60 sec: 5205.1, 300 sec: 5182.4). Total num frames: 143974400. Throughput: 0: 10432.4. Samples: 287948800. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:38,992][27935] Avg episode reward: [(0, '-45.313')] [2022-07-13 03:16:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 144002048. Throughput: 0: 10438.9. Samples: 288012396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:43,989][27935] Avg episode reward: [(0, '-45.915')] [2022-07-13 03:16:48,989][27935] Fps is (10 sec: 5326.0, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 144027648. Throughput: 0: 10522.9. Samples: 288075416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:48,989][27935] Avg episode reward: [(0, '-44.192')] [2022-07-13 03:16:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.8, 300 sec: 5186.0). Total num frames: 144054272. Throughput: 0: 10528.4. Samples: 288107276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:53,989][27935] Avg episode reward: [(0, '-44.378')] [2022-07-13 03:16:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.4, 300 sec: 5186.0). Total num frames: 144079872. Throughput: 0: 10531.8. Samples: 288170520. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:16:58,990][27935] Avg episode reward: [(0, '-43.510')] [2022-07-13 03:17:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 144105472. Throughput: 0: 10434.7. Samples: 288229424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 03:17:03,989][27935] Avg episode reward: [(0, '-44.206')] [2022-07-13 03:17:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 144131072. Throughput: 0: 10434.5. Samples: 288260924. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:08,991][27935] Avg episode reward: [(0, '-42.980')] [2022-07-13 03:17:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 144156672. Throughput: 0: 10429.3. Samples: 288323532. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:13,989][27935] Avg episode reward: [(0, '-42.759')] [2022-07-13 03:17:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 144183296. Throughput: 0: 10421.9. Samples: 288385964. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:18,989][27935] Avg episode reward: [(0, '-43.304')] [2022-07-13 03:17:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 144209920. Throughput: 0: 10426.6. Samples: 288417972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:23,989][27935] Avg episode reward: [(0, '-41.841')] [2022-07-13 03:17:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 144235520. Throughput: 0: 10397.6. Samples: 288480288. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:28,989][27935] Avg episode reward: [(0, '-40.957')] [2022-07-13 03:17:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 144261120. Throughput: 0: 10393.3. Samples: 288543116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:33,990][27935] Avg episode reward: [(0, '-41.331')] [2022-07-13 03:17:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.6, 300 sec: 5192.9). Total num frames: 144287744. Throughput: 0: 10394.9. Samples: 288575048. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:38,989][27935] Avg episode reward: [(0, '-42.741')] [2022-07-13 03:17:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 144314368. Throughput: 0: 10373.8. Samples: 288637340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:43,989][27935] Avg episode reward: [(0, '-42.944')] [2022-07-13 03:17:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 144339968. Throughput: 0: 10478.4. Samples: 288700952. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:48,991][27935] Avg episode reward: [(0, '-42.639')] [2022-07-13 03:17:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 144367616. Throughput: 0: 10505.3. Samples: 288733660. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:53,990][27935] Avg episode reward: [(0, '-43.006')] [2022-07-13 03:17:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 144394240. Throughput: 0: 10534.4. Samples: 288797580. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:17:58,989][27935] Avg episode reward: [(0, '-43.638')] [2022-07-13 03:18:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 144418816. Throughput: 0: 10491.5. Samples: 288858080. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:03,991][27935] Avg episode reward: [(0, '-44.108')] [2022-07-13 03:18:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 144445440. Throughput: 0: 10498.7. Samples: 288890412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:08,989][27935] Avg episode reward: [(0, '-43.926')] [2022-07-13 03:18:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5206.8). Total num frames: 144473088. Throughput: 0: 10539.5. Samples: 288954568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:13,989][27935] Avg episode reward: [(0, '-42.887')] [2022-07-13 03:18:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5203.3). Total num frames: 144498688. Throughput: 0: 9847.5. Samples: 288986252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:18,990][27935] Avg episode reward: [(0, '-43.374')] [2022-07-13 03:18:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5213.7). Total num frames: 144526336. Throughput: 0: 10542.6. Samples: 289049464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:23,989][27935] Avg episode reward: [(0, '-43.563')] [2022-07-13 03:18:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5203.3). Total num frames: 144550912. Throughput: 0: 10537.2. Samples: 289111516. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:28,989][27935] Avg episode reward: [(0, '-43.840')] [2022-07-13 03:18:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5206.8). Total num frames: 144577536. Throughput: 0: 10519.2. Samples: 289174316. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:33,990][27935] Avg episode reward: [(0, '-43.770')] [2022-07-13 03:18:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5203.3). Total num frames: 144604160. Throughput: 0: 10496.9. Samples: 289206020. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:38,990][27935] Avg episode reward: [(0, '-43.459')] [2022-07-13 03:18:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5210.3). Total num frames: 144629760. Throughput: 0: 10483.5. Samples: 289269336. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:43,989][27935] Avg episode reward: [(0, '-43.956')] [2022-07-13 03:18:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5206.8). Total num frames: 144656384. Throughput: 0: 10533.7. Samples: 289332096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:48,989][27935] Avg episode reward: [(0, '-43.655')] [2022-07-13 03:18:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5206.8). Total num frames: 144683008. Throughput: 0: 10522.0. Samples: 289363900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:53,989][27935] Avg episode reward: [(0, '-43.640')] [2022-07-13 03:18:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 144708608. Throughput: 0: 10489.8. Samples: 289426608. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:18:58,989][27935] Avg episode reward: [(0, '-43.715')] [2022-07-13 03:19:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 144733184. Throughput: 0: 11100.6. Samples: 289485780. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:19:03,990][27935] Avg episode reward: [(0, '-43.234')] [2022-07-13 03:19:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 144759808. Throughput: 0: 10396.5. Samples: 289517308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 03:19:08,989][27935] Avg episode reward: [(0, '-43.419')] [2022-07-13 03:19:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 144785408. Throughput: 0: 10418.9. Samples: 289580368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:13,989][27935] Avg episode reward: [(0, '-43.139')] [2022-07-13 03:19:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 144811008. Throughput: 0: 10407.5. Samples: 289642656. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:18,989][27935] Avg episode reward: [(0, '-43.446')] [2022-07-13 03:19:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 144836608. Throughput: 0: 10406.2. Samples: 289674300. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:23,989][27935] Avg episode reward: [(0, '-42.861')] [2022-07-13 03:19:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 144864256. Throughput: 0: 10381.2. Samples: 289736488. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:28,989][27935] Avg episode reward: [(0, '-42.082')] [2022-07-13 03:19:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 144888832. Throughput: 0: 10382.1. Samples: 289799292. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:33,989][27935] Avg episode reward: [(0, '-43.100')] [2022-07-13 03:19:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 144916480. Throughput: 0: 10379.9. Samples: 289830996. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:38,989][27935] Avg episode reward: [(0, '-43.329')] [2022-07-13 03:19:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 144943104. Throughput: 0: 10396.9. Samples: 289894468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:43,989][27935] Avg episode reward: [(0, '-43.632')] [2022-07-13 03:19:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 144969728. Throughput: 0: 10478.0. Samples: 289957292. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:48,989][27935] Avg episode reward: [(0, '-44.087')] [2022-07-13 03:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 144995328. Throughput: 0: 10487.7. Samples: 289989256. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:53,990][27935] Avg episode reward: [(0, '-43.422')] [2022-07-13 03:19:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 145022976. Throughput: 0: 10479.1. Samples: 290051928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:19:58,991][27935] Avg episode reward: [(0, '-43.283')] [2022-07-13 03:20:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 145045504. Throughput: 0: 10416.9. Samples: 290111416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:03,991][27935] Avg episode reward: [(0, '-43.468')] [2022-07-13 03:20:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 145072128. Throughput: 0: 10417.7. Samples: 290143096. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:08,989][27935] Avg episode reward: [(0, '-43.525')] [2022-07-13 03:20:14,000][27935] Fps is (10 sec: 5318.6, 60 sec: 5221.4, 300 sec: 5220.5). Total num frames: 145098752. Throughput: 0: 10443.5. Samples: 290206568. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:14,001][27935] Avg episode reward: [(0, '-43.407')] [2022-07-13 03:20:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 145124352. Throughput: 0: 10454.7. Samples: 290269752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:18,989][27935] Avg episode reward: [(0, '-42.074')] [2022-07-13 03:20:23,989][27935] Fps is (10 sec: 5331.0, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 145152000. Throughput: 0: 10457.5. Samples: 290301584. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:23,989][27935] Avg episode reward: [(0, '-42.840')] [2022-07-13 03:20:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 145176576. Throughput: 0: 10443.4. Samples: 290364420. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:28,989][27935] Avg episode reward: [(0, '-42.647')] [2022-07-13 03:20:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 145203200. Throughput: 0: 10441.2. Samples: 290427144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:33,989][27935] Avg episode reward: [(0, '-42.785')] [2022-07-13 03:20:38,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 145230848. Throughput: 0: 10433.1. Samples: 290458744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:38,989][27935] Avg episode reward: [(0, '-43.906')] [2022-07-13 03:20:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 145255424. Throughput: 0: 10446.2. Samples: 290522008. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:43,989][27935] Avg episode reward: [(0, '-45.086')] [2022-07-13 03:20:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 145284096. Throughput: 0: 10537.1. Samples: 290585584. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:48,989][27935] Avg episode reward: [(0, '-46.166')] [2022-07-13 03:20:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5224.2). Total num frames: 145309696. Throughput: 0: 10544.7. Samples: 290617608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:53,989][27935] Avg episode reward: [(0, '-46.370')] [2022-07-13 03:20:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 145336320. Throughput: 0: 10567.1. Samples: 290681964. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:20:58,989][27935] Avg episode reward: [(0, '-44.997')] [2022-07-13 03:21:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 145361920. Throughput: 0: 9866.9. Samples: 290713764. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:21:03,989][27935] Avg episode reward: [(0, '-46.193')] [2022-07-13 03:21:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 145387520. Throughput: 0: 10469.8. Samples: 290772724. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:21:08,989][27935] Avg episode reward: [(0, '-46.919')] [2022-07-13 03:21:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5257.5, 300 sec: 5234.5). Total num frames: 145414144. Throughput: 0: 10471.5. Samples: 290835636. Policy #0 lag: (min: 0.0, avg: 8.9, max: 18.0) [2022-07-13 03:21:13,990][27935] Avg episode reward: [(0, '-45.188')] [2022-07-13 03:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 145438720. Throughput: 0: 10457.1. Samples: 290897716. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:18,989][27935] Avg episode reward: [(0, '-44.382')] [2022-07-13 03:21:23,998][27935] Fps is (10 sec: 5115.3, 60 sec: 5221.6, 300 sec: 5227.4). Total num frames: 145465344. Throughput: 0: 10451.6. Samples: 290929164. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:23,999][27935] Avg episode reward: [(0, '-44.532')] [2022-07-13 03:21:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 145490944. Throughput: 0: 10390.9. Samples: 290989600. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:28,989][27935] Avg episode reward: [(0, '-45.168')] [2022-07-13 03:21:33,989][27935] Fps is (10 sec: 5022.3, 60 sec: 5205.3, 300 sec: 5224.2). Total num frames: 145515520. Throughput: 0: 10354.0. Samples: 291051512. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:33,989][27935] Avg episode reward: [(0, '-43.981')] [2022-07-13 03:21:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 145542144. Throughput: 0: 10343.2. Samples: 291083052. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:38,989][27935] Avg episode reward: [(0, '-42.520')] [2022-07-13 03:21:43,993][27935] Fps is (10 sec: 5424.7, 60 sec: 5239.1, 300 sec: 5227.5). Total num frames: 145569792. Throughput: 0: 10330.3. Samples: 291146876. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:43,994][27935] Avg episode reward: [(0, '-42.115')] [2022-07-13 03:21:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 145596416. Throughput: 0: 11039.6. Samples: 291210548. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:48,989][27935] Avg episode reward: [(0, '-42.501')] [2022-07-13 03:21:53,989][27935] Fps is (10 sec: 5327.2, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 145623040. Throughput: 0: 10447.2. Samples: 291242848. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:53,989][27935] Avg episode reward: [(0, '-41.764')] [2022-07-13 03:21:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 145649664. Throughput: 0: 10456.7. Samples: 291306188. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:21:58,989][27935] Avg episode reward: [(0, '-41.004')] [2022-07-13 03:22:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 145673216. Throughput: 0: 10414.6. Samples: 291366372. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:03,989][27935] Avg episode reward: [(0, '-40.564')] [2022-07-13 03:22:08,991][27935] Fps is (10 sec: 5016.4, 60 sec: 5205.1, 300 sec: 5231.0). Total num frames: 145699840. Throughput: 0: 10424.4. Samples: 291398188. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:08,992][27935] Avg episode reward: [(0, '-40.767')] [2022-07-13 03:22:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 145726464. Throughput: 0: 10500.5. Samples: 291462124. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:13,989][27935] Avg episode reward: [(0, '-41.192')] [2022-07-13 03:22:18,989][27935] Fps is (10 sec: 5326.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 145753088. Throughput: 0: 10537.1. Samples: 291525680. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:18,989][27935] Avg episode reward: [(0, '-40.981')] [2022-07-13 03:22:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5240.3, 300 sec: 5234.5). Total num frames: 145779712. Throughput: 0: 10542.5. Samples: 291557464. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:23,989][27935] Avg episode reward: [(0, '-41.842')] [2022-07-13 03:22:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 145806336. Throughput: 0: 10550.9. Samples: 291621620. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:28,989][27935] Avg episode reward: [(0, '-42.654')] [2022-07-13 03:22:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 145832960. Throughput: 0: 10545.3. Samples: 291685088. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:33,990][27935] Avg episode reward: [(0, '-43.018')] [2022-07-13 03:22:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 145859584. Throughput: 0: 10539.1. Samples: 291717108. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:38,989][27935] Avg episode reward: [(0, '-42.644')] [2022-07-13 03:22:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.9, 300 sec: 5234.5). Total num frames: 145884160. Throughput: 0: 10522.2. Samples: 291779688. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:43,990][27935] Avg episode reward: [(0, '-42.703')] [2022-07-13 03:22:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 145912832. Throughput: 0: 10601.2. Samples: 291843424. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:48,990][27935] Avg episode reward: [(0, '-42.941')] [2022-07-13 03:22:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 145936384. Throughput: 0: 10604.8. Samples: 291875380. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:53,989][27935] Avg episode reward: [(0, '-41.247')] [2022-07-13 03:22:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 145966080. Throughput: 0: 10599.6. Samples: 291939104. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:22:58,989][27935] Avg episode reward: [(0, '-41.564')] [2022-07-13 03:23:03,991][27935] Fps is (10 sec: 5323.8, 60 sec: 5273.4, 300 sec: 5234.5). Total num frames: 145989632. Throughput: 0: 10518.7. Samples: 291999044. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:23:03,991][27935] Avg episode reward: [(0, '-41.165')] [2022-07-13 03:23:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.9, 300 sec: 5234.5). Total num frames: 146017280. Throughput: 0: 10526.1. Samples: 292031140. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:23:08,989][27935] Avg episode reward: [(0, '-39.968')] [2022-07-13 03:23:13,989][27935] Fps is (10 sec: 5428.3, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 146043904. Throughput: 0: 10528.6. Samples: 292095408. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:23:13,991][27935] Avg episode reward: [(0, '-40.249')] [2022-07-13 03:23:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 146069504. Throughput: 0: 10534.7. Samples: 292159148. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:23:18,991][27935] Avg episode reward: [(0, '-39.812')] [2022-07-13 03:23:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5241.5). Total num frames: 146097152. Throughput: 0: 10534.2. Samples: 292191148. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 03:23:23,989][27935] Avg episode reward: [(0, '-40.151')] [2022-07-13 03:23:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 146122752. Throughput: 0: 10540.2. Samples: 292253996. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:28,989][27935] Avg episode reward: [(0, '-40.678')] [2022-07-13 03:23:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 146147328. Throughput: 0: 10509.2. Samples: 292316340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:33,989][27935] Avg episode reward: [(0, '-41.796')] [2022-07-13 03:23:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 146173952. Throughput: 0: 10490.1. Samples: 292347436. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:38,989][27935] Avg episode reward: [(0, '-42.779')] [2022-07-13 03:23:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 146201600. Throughput: 0: 10477.8. Samples: 292410604. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:43,989][27935] Avg episode reward: [(0, '-41.944')] [2022-07-13 03:23:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 146228224. Throughput: 0: 10553.1. Samples: 292473912. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:48,992][27935] Avg episode reward: [(0, '-42.421')] [2022-07-13 03:23:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5238.0). Total num frames: 146253824. Throughput: 0: 10549.6. Samples: 292505872. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:53,989][27935] Avg episode reward: [(0, '-42.117')] [2022-07-13 03:23:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 146281472. Throughput: 0: 10559.7. Samples: 292570596. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:23:58,989][27935] Avg episode reward: [(0, '-42.555')] [2022-07-13 03:24:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.7, 300 sec: 5238.0). Total num frames: 146305024. Throughput: 0: 10489.1. Samples: 292631156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:03,989][27935] Avg episode reward: [(0, '-41.630')] [2022-07-13 03:24:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 146332672. Throughput: 0: 10496.3. Samples: 292663480. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:08,989][27935] Avg episode reward: [(0, '-41.561')] [2022-07-13 03:24:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 146359296. Throughput: 0: 10524.6. Samples: 292727604. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:13,989][27935] Avg episode reward: [(0, '-41.093')] [2022-07-13 03:24:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 146386944. Throughput: 0: 10554.5. Samples: 292791292. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:18,989][27935] Avg episode reward: [(0, '-41.591')] [2022-07-13 03:24:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 146411520. Throughput: 0: 10584.1. Samples: 292823720. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:23,989][27935] Avg episode reward: [(0, '-42.626')] [2022-07-13 03:24:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 146439168. Throughput: 0: 10588.5. Samples: 292887088. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:28,991][27935] Avg episode reward: [(0, '-42.903')] [2022-07-13 03:24:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5251.9). Total num frames: 146465792. Throughput: 0: 10591.5. Samples: 292950528. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:33,989][27935] Avg episode reward: [(0, '-43.850')] [2022-07-13 03:24:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5251.9). Total num frames: 146492416. Throughput: 0: 10582.5. Samples: 292982084. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:38,993][27935] Avg episode reward: [(0, '-43.396')] [2022-07-13 03:24:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5251.9). Total num frames: 146519040. Throughput: 0: 10553.8. Samples: 293045516. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:43,989][27935] Avg episode reward: [(0, '-43.397')] [2022-07-13 03:24:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5251.9). Total num frames: 146544640. Throughput: 0: 10638.0. Samples: 293109864. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:48,989][27935] Avg episode reward: [(0, '-42.123')] [2022-07-13 03:24:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5248.4). Total num frames: 146571264. Throughput: 0: 10637.2. Samples: 293142156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:53,990][27935] Avg episode reward: [(0, '-41.503')] [2022-07-13 03:24:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5265.8). Total num frames: 146598912. Throughput: 0: 10637.4. Samples: 293206288. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:24:58,989][27935] Avg episode reward: [(0, '-41.568')] [2022-07-13 03:25:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 146622464. Throughput: 0: 10558.8. Samples: 293266436. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:03,989][27935] Avg episode reward: [(0, '-41.368')] [2022-07-13 03:25:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5255.6). Total num frames: 146649088. Throughput: 0: 10552.0. Samples: 293298560. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:08,989][27935] Avg episode reward: [(0, '-41.104')] [2022-07-13 03:25:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 146676736. Throughput: 0: 10563.5. Samples: 293362444. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:13,989][27935] Avg episode reward: [(0, '-40.988')] [2022-07-13 03:25:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 146703360. Throughput: 0: 10570.1. Samples: 293426184. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:18,989][27935] Avg episode reward: [(0, '-40.739')] [2022-07-13 03:25:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5269.3). Total num frames: 146731008. Throughput: 0: 10589.7. Samples: 293458620. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:23,989][27935] Avg episode reward: [(0, '-41.167')] [2022-07-13 03:25:28,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5290.3, 300 sec: 5265.7). Total num frames: 146756608. Throughput: 0: 10586.5. Samples: 293521948. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 03:25:28,993][27935] Avg episode reward: [(0, '-41.763')] [2022-07-13 03:25:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5258.8). Total num frames: 146782208. Throughput: 0: 10568.4. Samples: 293585440. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:33,989][27935] Avg episode reward: [(0, '-40.838')] [2022-07-13 03:25:38,989][27935] Fps is (10 sec: 5224.3, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 146808832. Throughput: 0: 10557.7. Samples: 293617252. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:38,989][27935] Avg episode reward: [(0, '-41.366')] [2022-07-13 03:25:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 146836480. Throughput: 0: 10554.6. Samples: 293681244. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:43,989][27935] Avg episode reward: [(0, '-42.055')] [2022-07-13 03:25:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5265.8). Total num frames: 146863104. Throughput: 0: 10629.2. Samples: 293744752. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:48,989][27935] Avg episode reward: [(0, '-42.080')] [2022-07-13 03:25:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 146888704. Throughput: 0: 10630.0. Samples: 293776908. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:53,989][27935] Avg episode reward: [(0, '-41.963')] [2022-07-13 03:25:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 146915328. Throughput: 0: 10626.5. Samples: 293840636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:25:58,991][27935] Avg episode reward: [(0, '-42.704')] [2022-07-13 03:26:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5269.3). Total num frames: 146941952. Throughput: 0: 10542.5. Samples: 293900596. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:03,991][27935] Avg episode reward: [(0, '-41.385')] [2022-07-13 03:26:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5265.8). Total num frames: 146967552. Throughput: 0: 10538.5. Samples: 293932852. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:08,989][27935] Avg episode reward: [(0, '-41.598')] [2022-07-13 03:26:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5269.3). Total num frames: 146993152. Throughput: 0: 10558.6. Samples: 293997048. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:13,989][27935] Avg episode reward: [(0, '-41.440')] [2022-07-13 03:26:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5269.4). Total num frames: 147019776. Throughput: 0: 10555.3. Samples: 294060428. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:18,989][27935] Avg episode reward: [(0, '-40.283')] [2022-07-13 03:26:23,989][27935] Fps is (10 sec: 5426.8, 60 sec: 5273.5, 300 sec: 5276.2). Total num frames: 147047424. Throughput: 0: 10569.2. Samples: 294092872. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:23,991][27935] Avg episode reward: [(0, '-41.731')] [2022-07-13 03:26:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5291.0, 300 sec: 5283.1). Total num frames: 147074048. Throughput: 0: 10580.2. Samples: 294157352. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:28,989][27935] Avg episode reward: [(0, '-42.076')] [2022-07-13 03:26:33,991][27935] Fps is (10 sec: 5324.1, 60 sec: 5307.6, 300 sec: 5283.1). Total num frames: 147100672. Throughput: 0: 10586.1. Samples: 294221148. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:33,991][27935] Avg episode reward: [(0, '-42.484')] [2022-07-13 03:26:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5276.3). Total num frames: 147126272. Throughput: 0: 10573.8. Samples: 294252728. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:38,989][27935] Avg episode reward: [(0, '-42.311')] [2022-07-13 03:26:43,989][27935] Fps is (10 sec: 5325.8, 60 sec: 5290.7, 300 sec: 5279.7). Total num frames: 147153920. Throughput: 0: 10584.1. Samples: 294316920. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:43,989][27935] Avg episode reward: [(0, '-42.545')] [2022-07-13 03:26:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5276.2). Total num frames: 147179520. Throughput: 0: 10688.7. Samples: 294381588. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:48,989][27935] Avg episode reward: [(0, '-42.817')] [2022-07-13 03:26:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 147208192. Throughput: 0: 10687.9. Samples: 294413808. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:53,989][27935] Avg episode reward: [(0, '-42.346')] [2022-07-13 03:26:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 147234816. Throughput: 0: 10679.7. Samples: 294477636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:26:58,989][27935] Avg episode reward: [(0, '-41.389')] [2022-07-13 03:27:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5286.7). Total num frames: 147259392. Throughput: 0: 10610.6. Samples: 294537904. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:03,989][27935] Avg episode reward: [(0, '-41.695')] [2022-07-13 03:27:08,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5307.7, 300 sec: 5286.6). Total num frames: 147286016. Throughput: 0: 10606.9. Samples: 294570176. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:08,989][27935] Avg episode reward: [(0, '-41.250')] [2022-07-13 03:27:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 147311616. Throughput: 0: 10604.8. Samples: 294634568. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:13,989][27935] Avg episode reward: [(0, '-41.017')] [2022-07-13 03:27:18,990][27935] Fps is (10 sec: 5324.1, 60 sec: 5324.7, 300 sec: 5286.6). Total num frames: 147339264. Throughput: 0: 10609.5. Samples: 294698568. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:18,991][27935] Avg episode reward: [(0, '-41.445')] [2022-07-13 03:27:23,989][27935] Fps is (10 sec: 5632.1, 60 sec: 5341.9, 300 sec: 5293.6). Total num frames: 147367936. Throughput: 0: 10630.4. Samples: 294731096. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:23,990][27935] Avg episode reward: [(0, '-40.921')] [2022-07-13 03:27:28,989][27935] Fps is (10 sec: 5325.5, 60 sec: 5307.7, 300 sec: 5286.6). Total num frames: 147392512. Throughput: 0: 10633.0. Samples: 294795404. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:28,989][27935] Avg episode reward: [(0, '-40.334')] [2022-07-13 03:27:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5325.0, 300 sec: 5290.1). Total num frames: 147420160. Throughput: 0: 10550.0. Samples: 294856340. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 03:27:33,989][27935] Avg episode reward: [(0, '-40.638')] [2022-07-13 03:27:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 147444736. Throughput: 0: 10543.2. Samples: 294888252. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:27:38,989][27935] Avg episode reward: [(0, '-41.152')] [2022-07-13 03:27:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 147471360. Throughput: 0: 10525.2. Samples: 294951268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:27:43,989][27935] Avg episode reward: [(0, '-40.972')] [2022-07-13 03:27:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 147499008. Throughput: 0: 10626.3. Samples: 295016088. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:27:48,989][27935] Avg episode reward: [(0, '-40.334')] [2022-07-13 03:27:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 147524608. Throughput: 0: 10626.9. Samples: 295048384. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:27:53,989][27935] Avg episode reward: [(0, '-40.466')] [2022-07-13 03:27:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5297.1). Total num frames: 147552256. Throughput: 0: 10627.7. Samples: 295112812. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:27:58,989][27935] Avg episode reward: [(0, '-41.925')] [2022-07-13 03:28:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 147576832. Throughput: 0: 10545.7. Samples: 295173108. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:03,991][27935] Avg episode reward: [(0, '-42.287')] [2022-07-13 03:28:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 147603456. Throughput: 0: 10543.4. Samples: 295205548. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:08,989][27935] Avg episode reward: [(0, '-41.967')] [2022-07-13 03:28:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5341.9, 300 sec: 5297.0). Total num frames: 147632128. Throughput: 0: 10546.4. Samples: 295269992. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:13,989][27935] Avg episode reward: [(0, '-41.733')] [2022-07-13 03:28:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.8, 300 sec: 5286.6). Total num frames: 147656704. Throughput: 0: 10610.9. Samples: 295333832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:18,989][27935] Avg episode reward: [(0, '-42.079')] [2022-07-13 03:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 147684352. Throughput: 0: 10622.6. Samples: 295366268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:23,991][27935] Avg episode reward: [(0, '-43.790')] [2022-07-13 03:28:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 147709952. Throughput: 0: 10654.1. Samples: 295430704. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:28,991][27935] Avg episode reward: [(0, '-42.795')] [2022-07-13 03:28:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 147738624. Throughput: 0: 10625.8. Samples: 295494248. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:33,991][27935] Avg episode reward: [(0, '-43.161')] [2022-07-13 03:28:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 147764224. Throughput: 0: 10622.0. Samples: 295526372. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:38,989][27935] Avg episode reward: [(0, '-42.970')] [2022-07-13 03:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 147790848. Throughput: 0: 10627.7. Samples: 295591060. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:43,989][27935] Avg episode reward: [(0, '-43.505')] [2022-07-13 03:28:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 147817472. Throughput: 0: 10727.2. Samples: 295655832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:48,990][27935] Avg episode reward: [(0, '-43.096')] [2022-07-13 03:28:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 147845120. Throughput: 0: 10724.8. Samples: 295688164. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:53,989][27935] Avg episode reward: [(0, '-42.127')] [2022-07-13 03:28:58,989][27935] Fps is (10 sec: 5632.0, 60 sec: 5358.9, 300 sec: 5317.9). Total num frames: 147873792. Throughput: 0: 10742.5. Samples: 295753404. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:28:58,989][27935] Avg episode reward: [(0, '-42.251')] [2022-07-13 03:29:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 147896320. Throughput: 0: 10651.5. Samples: 295813148. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:03,989][27935] Avg episode reward: [(0, '-43.012')] [2022-07-13 03:29:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 147922944. Throughput: 0: 10648.3. Samples: 295845444. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:08,990][27935] Avg episode reward: [(0, '-42.557')] [2022-07-13 03:29:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 147950592. Throughput: 0: 10653.2. Samples: 295910100. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:13,989][27935] Avg episode reward: [(0, '-42.844')] [2022-07-13 03:29:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 147977216. Throughput: 0: 10671.1. Samples: 295974448. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:18,989][27935] Avg episode reward: [(0, '-42.322')] [2022-07-13 03:29:23,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5358.9, 300 sec: 5310.9). Total num frames: 148005888. Throughput: 0: 10676.4. Samples: 296006808. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:23,989][27935] Avg episode reward: [(0, '-43.046')] [2022-07-13 03:29:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5304.0). Total num frames: 148030464. Throughput: 0: 10682.2. Samples: 296071760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:28,989][27935] Avg episode reward: [(0, '-43.055')] [2022-07-13 03:29:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 148058112. Throughput: 0: 10664.0. Samples: 296135712. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:33,989][27935] Avg episode reward: [(0, '-43.060')] [2022-07-13 03:29:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 148084736. Throughput: 0: 10658.8. Samples: 296167812. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 03:29:38,989][27935] Avg episode reward: [(0, '-42.777')] [2022-07-13 03:29:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 148110336. Throughput: 0: 10641.5. Samples: 296232272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:29:43,990][27935] Avg episode reward: [(0, '-43.148')] [2022-07-13 03:29:48,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5376.0, 300 sec: 5317.9). Total num frames: 148140032. Throughput: 0: 10735.3. Samples: 296296236. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:29:48,989][27935] Avg episode reward: [(0, '-43.065')] [2022-07-13 03:29:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 148163584. Throughput: 0: 10723.5. Samples: 296328000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:29:53,989][27935] Avg episode reward: [(0, '-44.021')] [2022-07-13 03:29:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5321.3). Total num frames: 148192256. Throughput: 0: 10722.0. Samples: 296392588. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:29:58,989][27935] Avg episode reward: [(0, '-44.214')] [2022-07-13 03:30:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5310.9). Total num frames: 148215808. Throughput: 0: 10620.9. Samples: 296452388. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:03,989][27935] Avg episode reward: [(0, '-43.245')] [2022-07-13 03:30:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5341.9, 300 sec: 5310.9). Total num frames: 148243456. Throughput: 0: 10605.6. Samples: 296484060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:08,989][27935] Avg episode reward: [(0, '-43.815')] [2022-07-13 03:30:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5307.4). Total num frames: 148269056. Throughput: 0: 10572.6. Samples: 296547528. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:13,989][27935] Avg episode reward: [(0, '-44.302')] [2022-07-13 03:30:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 148295680. Throughput: 0: 10531.2. Samples: 296609616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:18,991][27935] Avg episode reward: [(0, '-44.664')] [2022-07-13 03:30:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5300.6). Total num frames: 148320256. Throughput: 0: 10496.0. Samples: 296640132. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:23,989][27935] Avg episode reward: [(0, '-42.697')] [2022-07-13 03:30:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5300.5). Total num frames: 148345856. Throughput: 0: 10416.2. Samples: 296701000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:28,989][27935] Avg episode reward: [(0, '-42.247')] [2022-07-13 03:30:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5297.0). Total num frames: 148371456. Throughput: 0: 10325.4. Samples: 296760880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:33,989][27935] Avg episode reward: [(0, '-42.945')] [2022-07-13 03:30:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5286.6). Total num frames: 148396032. Throughput: 0: 10278.2. Samples: 296790520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:38,989][27935] Avg episode reward: [(0, '-42.706')] [2022-07-13 03:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5279.7). Total num frames: 148420608. Throughput: 0: 10190.9. Samples: 296851176. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:43,989][27935] Avg episode reward: [(0, '-42.297')] [2022-07-13 03:30:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5283.1). Total num frames: 148447232. Throughput: 0: 10236.5. Samples: 296913032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:48,989][27935] Avg episode reward: [(0, '-42.207')] [2022-07-13 03:30:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5283.1). Total num frames: 148473856. Throughput: 0: 10248.0. Samples: 296945220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:53,990][27935] Avg episode reward: [(0, '-41.832')] [2022-07-13 03:30:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5283.1). Total num frames: 148500480. Throughput: 0: 10259.8. Samples: 297009220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:30:58,989][27935] Avg episode reward: [(0, '-42.876')] [2022-07-13 03:31:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5279.7). Total num frames: 148525056. Throughput: 0: 10206.4. Samples: 297068904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:03,989][27935] Avg episode reward: [(0, '-42.211')] [2022-07-13 03:31:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5286.6). Total num frames: 148552704. Throughput: 0: 10239.2. Samples: 297100896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:08,990][27935] Avg episode reward: [(0, '-41.865')] [2022-07-13 03:31:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5283.1). Total num frames: 148578304. Throughput: 0: 10311.4. Samples: 297165012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:13,989][27935] Avg episode reward: [(0, '-41.029')] [2022-07-13 03:31:18,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5137.1, 300 sec: 5276.2). Total num frames: 148603904. Throughput: 0: 10394.8. Samples: 297228648. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:18,989][27935] Avg episode reward: [(0, '-40.717')] [2022-07-13 03:31:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5279.7). Total num frames: 148631552. Throughput: 0: 10436.0. Samples: 297260140. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:23,989][27935] Avg episode reward: [(0, '-40.878')] [2022-07-13 03:31:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5272.8). Total num frames: 148656128. Throughput: 0: 10528.9. Samples: 297324976. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:28,989][27935] Avg episode reward: [(0, '-40.547')] [2022-07-13 03:31:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5286.6). Total num frames: 148685824. Throughput: 0: 10552.7. Samples: 297387904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:33,989][27935] Avg episode reward: [(0, '-40.906')] [2022-07-13 03:31:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5276.2). Total num frames: 148710400. Throughput: 0: 10551.0. Samples: 297420016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:38,990][27935] Avg episode reward: [(0, '-41.060')] [2022-07-13 03:31:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 148738048. Throughput: 0: 10554.0. Samples: 297484148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 03:31:43,989][27935] Avg episode reward: [(0, '-40.533')] [2022-07-13 03:31:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 148764672. Throughput: 0: 10649.1. Samples: 297548112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:31:48,989][27935] Avg episode reward: [(0, '-41.285')] [2022-07-13 03:31:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 148791296. Throughput: 0: 10657.2. Samples: 297580472. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:31:53,989][27935] Avg episode reward: [(0, '-41.251')] [2022-07-13 03:31:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 148817920. Throughput: 0: 10666.0. Samples: 297644984. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:31:58,992][27935] Avg episode reward: [(0, '-40.646')] [2022-07-13 03:32:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 148842496. Throughput: 0: 10602.6. Samples: 297705764. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:03,989][27935] Avg episode reward: [(0, '-40.357')] [2022-07-13 03:32:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 148870144. Throughput: 0: 10614.5. Samples: 297737792. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:08,989][27935] Avg episode reward: [(0, '-40.127')] [2022-07-13 03:32:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5283.2). Total num frames: 148897792. Throughput: 0: 10607.5. Samples: 297802312. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:13,989][27935] Avg episode reward: [(0, '-40.660')] [2022-07-13 03:32:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5272.7). Total num frames: 148923392. Throughput: 0: 10633.8. Samples: 297866424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:18,989][27935] Avg episode reward: [(0, '-40.628')] [2022-07-13 03:32:23,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5324.6, 300 sec: 5283.1). Total num frames: 148951040. Throughput: 0: 10627.2. Samples: 297898268. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:23,992][27935] Avg episode reward: [(0, '-40.729')] [2022-07-13 03:32:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5358.9, 300 sec: 5279.7). Total num frames: 148977664. Throughput: 0: 10643.8. Samples: 297963120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:28,989][27935] Avg episode reward: [(0, '-41.135')] [2022-07-13 03:32:33,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5290.7, 300 sec: 5283.1). Total num frames: 149003264. Throughput: 0: 10632.3. Samples: 298026564. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:33,989][27935] Avg episode reward: [(0, '-41.351')] [2022-07-13 03:32:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 149029888. Throughput: 0: 10617.6. Samples: 298058264. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:38,989][27935] Avg episode reward: [(0, '-40.517')] [2022-07-13 03:32:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 149057536. Throughput: 0: 10566.7. Samples: 298120484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:43,989][27935] Avg episode reward: [(0, '-41.355')] [2022-07-13 03:32:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5283.1). Total num frames: 149083136. Throughput: 0: 10647.7. Samples: 298184908. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:48,991][27935] Avg episode reward: [(0, '-41.549')] [2022-07-13 03:32:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5279.7). Total num frames: 149109760. Throughput: 0: 10653.2. Samples: 298217184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:53,989][27935] Avg episode reward: [(0, '-40.755')] [2022-07-13 03:32:58,996][27935] Fps is (10 sec: 5320.8, 60 sec: 5307.1, 300 sec: 5286.5). Total num frames: 149136384. Throughput: 0: 10648.5. Samples: 298281572. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:32:58,997][27935] Avg episode reward: [(0, '-41.739')] [2022-07-13 03:33:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5283.1). Total num frames: 149161984. Throughput: 0: 10557.5. Samples: 298341512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:03,989][27935] Avg episode reward: [(0, '-41.675')] [2022-07-13 03:33:08,997][27935] Fps is (10 sec: 5119.9, 60 sec: 5290.0, 300 sec: 5272.6). Total num frames: 149187584. Throughput: 0: 10552.5. Samples: 298373184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:08,997][27935] Avg episode reward: [(0, '-41.889')] [2022-07-13 03:33:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5273.6, 300 sec: 5279.7). Total num frames: 149214208. Throughput: 0: 10543.1. Samples: 298437560. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:13,989][27935] Avg episode reward: [(0, '-42.035')] [2022-07-13 03:33:18,989][27935] Fps is (10 sec: 5328.9, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 149240832. Throughput: 0: 10556.9. Samples: 298501624. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:18,989][27935] Avg episode reward: [(0, '-40.783')] [2022-07-13 03:33:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5273.8, 300 sec: 5279.7). Total num frames: 149267456. Throughput: 0: 10560.9. Samples: 298533504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:23,989][27935] Avg episode reward: [(0, '-40.223')] [2022-07-13 03:33:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5273.6, 300 sec: 5272.7). Total num frames: 149294080. Throughput: 0: 10605.2. Samples: 298597720. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:28,989][27935] Avg episode reward: [(0, '-39.570')] [2022-07-13 03:33:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 149320704. Throughput: 0: 10556.3. Samples: 298659940. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:33,989][27935] Avg episode reward: [(0, '-39.966')] [2022-07-13 03:33:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5269.3). Total num frames: 149345280. Throughput: 0: 10504.1. Samples: 298689868. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:38,989][27935] Avg episode reward: [(0, '-40.973')] [2022-07-13 03:33:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5272.7). Total num frames: 149372928. Throughput: 0: 10494.0. Samples: 298753724. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:43,990][27935] Avg episode reward: [(0, '-41.711')] [2022-07-13 03:33:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5265.8). Total num frames: 149398528. Throughput: 0: 10583.7. Samples: 298817780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:48,989][27935] Avg episode reward: [(0, '-41.857')] [2022-07-13 03:33:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 149426176. Throughput: 0: 10593.1. Samples: 298849792. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 03:33:53,989][27935] Avg episode reward: [(0, '-42.561')] [2022-07-13 03:33:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5274.3, 300 sec: 5276.2). Total num frames: 149452800. Throughput: 0: 10589.9. Samples: 298914104. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:33:58,989][27935] Avg episode reward: [(0, '-41.884')] [2022-07-13 03:34:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5269.3). Total num frames: 149477376. Throughput: 0: 10513.3. Samples: 298974720. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:03,989][27935] Avg episode reward: [(0, '-42.276')] [2022-07-13 03:34:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5257.2, 300 sec: 5262.3). Total num frames: 149502976. Throughput: 0: 10508.9. Samples: 299006404. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:08,989][27935] Avg episode reward: [(0, '-40.541')] [2022-07-13 03:34:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5269.3). Total num frames: 149531648. Throughput: 0: 10517.9. Samples: 299071024. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:13,989][27935] Avg episode reward: [(0, '-39.159')] [2022-07-13 03:34:18,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5262.3). Total num frames: 149558272. Throughput: 0: 10548.3. Samples: 299134612. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:18,989][27935] Avg episode reward: [(0, '-40.641')] [2022-07-13 03:34:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5265.8). Total num frames: 149583872. Throughput: 0: 10592.2. Samples: 299166516. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:23,990][27935] Avg episode reward: [(0, '-41.338')] [2022-07-13 03:34:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 149610496. Throughput: 0: 10592.3. Samples: 299230376. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:28,989][27935] Avg episode reward: [(0, '-41.485')] [2022-07-13 03:34:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 149637120. Throughput: 0: 10582.7. Samples: 299294000. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:33,990][27935] Avg episode reward: [(0, '-41.494')] [2022-07-13 03:34:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5269.3). Total num frames: 149664768. Throughput: 0: 10583.6. Samples: 299326052. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:38,989][27935] Avg episode reward: [(0, '-42.558')] [2022-07-13 03:34:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5255.4). Total num frames: 149690368. Throughput: 0: 10571.6. Samples: 299389824. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:43,989][27935] Avg episode reward: [(0, '-42.245')] [2022-07-13 03:34:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5272.7). Total num frames: 149719040. Throughput: 0: 10647.4. Samples: 299453852. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:48,990][27935] Avg episode reward: [(0, '-42.492')] [2022-07-13 03:34:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5255.4). Total num frames: 149742592. Throughput: 0: 10654.3. Samples: 299485848. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:53,989][27935] Avg episode reward: [(0, '-41.466')] [2022-07-13 03:34:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5272.7). Total num frames: 149771264. Throughput: 0: 10634.1. Samples: 299549556. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:34:58,990][27935] Avg episode reward: [(0, '-40.307')] [2022-07-13 03:35:03,993][27935] Fps is (10 sec: 5322.8, 60 sec: 5307.4, 300 sec: 5262.3). Total num frames: 149795840. Throughput: 0: 10550.7. Samples: 299609436. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:03,995][27935] Avg episode reward: [(0, '-40.128')] [2022-07-13 03:35:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5307.7, 300 sec: 5262.3). Total num frames: 149821440. Throughput: 0: 10564.4. Samples: 299641916. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:08,989][27935] Avg episode reward: [(0, '-40.255')] [2022-07-13 03:35:13,989][27935] Fps is (10 sec: 5224.4, 60 sec: 5273.6, 300 sec: 5262.3). Total num frames: 149848064. Throughput: 0: 10572.8. Samples: 299706152. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:13,989][27935] Avg episode reward: [(0, '-40.746')] [2022-07-13 03:35:18,991][27935] Fps is (10 sec: 5425.8, 60 sec: 5290.4, 300 sec: 5272.7). Total num frames: 149875712. Throughput: 0: 10578.2. Samples: 299770044. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:18,992][27935] Avg episode reward: [(0, '-41.702')] [2022-07-13 03:35:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5276.2). Total num frames: 149902336. Throughput: 0: 10591.4. Samples: 299802664. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:23,990][27935] Avg episode reward: [(0, '-41.965')] [2022-07-13 03:35:28,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5290.7, 300 sec: 5276.2). Total num frames: 149927936. Throughput: 0: 10606.3. Samples: 299867108. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:28,989][27935] Avg episode reward: [(0, '-42.522')] [2022-07-13 03:35:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5290.1). Total num frames: 149956608. Throughput: 0: 10597.0. Samples: 299930716. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:33,989][27935] Avg episode reward: [(0, '-44.519')] [2022-07-13 03:35:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 149982208. Throughput: 0: 10607.8. Samples: 299963200. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:38,989][27935] Avg episode reward: [(0, '-43.806')] [2022-07-13 03:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 150008832. Throughput: 0: 10614.3. Samples: 300027200. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:43,989][27935] Avg episode reward: [(0, '-43.046')] [2022-07-13 03:35:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 150035456. Throughput: 0: 10713.6. Samples: 300091508. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:48,989][27935] Avg episode reward: [(0, '-43.805')] [2022-07-13 03:35:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5297.0). Total num frames: 150063104. Throughput: 0: 10708.5. Samples: 300123800. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:53,989][27935] Avg episode reward: [(0, '-42.731')] [2022-07-13 03:35:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 150089728. Throughput: 0: 10690.7. Samples: 300187232. Policy #0 lag: (min: 0.0, avg: 8.1, max: 18.0) [2022-07-13 03:35:58,991][27935] Avg episode reward: [(0, '-42.174')] [2022-07-13 03:36:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5291.0, 300 sec: 5290.1). Total num frames: 150113280. Throughput: 0: 10613.0. Samples: 300247600. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:03,989][27935] Avg episode reward: [(0, '-41.710')] [2022-07-13 03:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 150139904. Throughput: 0: 10595.7. Samples: 300279468. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:08,989][27935] Avg episode reward: [(0, '-42.782')] [2022-07-13 03:36:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 150167552. Throughput: 0: 10587.1. Samples: 300343528. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:13,989][27935] Avg episode reward: [(0, '-42.055')] [2022-07-13 03:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.8, 300 sec: 5286.6). Total num frames: 150191104. Throughput: 0: 10581.5. Samples: 300406884. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:18,989][27935] Avg episode reward: [(0, '-42.239')] [2022-07-13 03:36:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 150220800. Throughput: 0: 10569.5. Samples: 300438828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:23,990][27935] Avg episode reward: [(0, '-42.975')] [2022-07-13 03:36:28,989][27935] Fps is (10 sec: 5632.0, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 150247424. Throughput: 0: 10577.2. Samples: 300503172. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:28,989][27935] Avg episode reward: [(0, '-43.284')] [2022-07-13 03:36:33,989][27935] Fps is (10 sec: 5324.5, 60 sec: 5290.6, 300 sec: 5300.5). Total num frames: 150274048. Throughput: 0: 10565.0. Samples: 300566936. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:33,991][27935] Avg episode reward: [(0, '-41.954')] [2022-07-13 03:36:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 150300672. Throughput: 0: 10551.5. Samples: 300598616. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:38,989][27935] Avg episode reward: [(0, '-40.561')] [2022-07-13 03:36:43,989][27935] Fps is (10 sec: 5222.7, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 150326272. Throughput: 0: 10557.0. Samples: 300662296. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:43,989][27935] Avg episode reward: [(0, '-39.960')] [2022-07-13 03:36:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 150353920. Throughput: 0: 10650.6. Samples: 300726876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:48,990][27935] Avg episode reward: [(0, '-39.050')] [2022-07-13 03:36:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 150379520. Throughput: 0: 10664.9. Samples: 300759388. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:53,991][27935] Avg episode reward: [(0, '-38.337')] [2022-07-13 03:36:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5304.0). Total num frames: 150407168. Throughput: 0: 10675.1. Samples: 300823908. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:36:58,991][27935] Avg episode reward: [(0, '-38.348')] [2022-07-13 03:37:03,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 150433792. Throughput: 0: 10601.6. Samples: 300883956. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:03,989][27935] Avg episode reward: [(0, '-39.720')] [2022-07-13 03:37:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5293.6). Total num frames: 150459392. Throughput: 0: 10613.2. Samples: 300916420. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:08,992][27935] Avg episode reward: [(0, '-40.601')] [2022-07-13 03:37:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 150484992. Throughput: 0: 10610.3. Samples: 300980636. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:13,990][27935] Avg episode reward: [(0, '-40.240')] [2022-07-13 03:37:18,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5358.9, 300 sec: 5293.6). Total num frames: 150512640. Throughput: 0: 10612.0. Samples: 301044472. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:19,000][27935] Avg episode reward: [(0, '-40.976')] [2022-07-13 03:37:23,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 150540288. Throughput: 0: 10624.6. Samples: 301076724. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:23,989][27935] Avg episode reward: [(0, '-40.690')] [2022-07-13 03:37:28,989][27935] Fps is (10 sec: 5324.6, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 150565888. Throughput: 0: 10636.5. Samples: 301140944. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:28,990][27935] Avg episode reward: [(0, '-40.271')] [2022-07-13 03:37:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.8, 300 sec: 5297.0). Total num frames: 150592512. Throughput: 0: 10620.3. Samples: 301204788. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:33,989][27935] Avg episode reward: [(0, '-40.530')] [2022-07-13 03:37:38,989][27935] Fps is (10 sec: 5222.6, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 150618112. Throughput: 0: 10615.9. Samples: 301237104. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:38,996][27935] Avg episode reward: [(0, '-40.635')] [2022-07-13 03:37:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 150645760. Throughput: 0: 10571.3. Samples: 301299616. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:43,989][27935] Avg episode reward: [(0, '-41.703')] [2022-07-13 03:37:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 150671360. Throughput: 0: 10672.1. Samples: 301364200. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:48,989][27935] Avg episode reward: [(0, '-41.964')] [2022-07-13 03:37:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5300.6). Total num frames: 150700032. Throughput: 0: 10666.1. Samples: 301396396. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:53,989][27935] Avg episode reward: [(0, '-42.389')] [2022-07-13 03:37:58,989][27935] Fps is (10 sec: 5632.0, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 150727680. Throughput: 0: 10682.8. Samples: 301461360. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:37:58,991][27935] Avg episode reward: [(0, '-42.245')] [2022-07-13 03:38:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5304.1). Total num frames: 150752256. Throughput: 0: 10615.2. Samples: 301522156. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:38:03,994][27935] Avg episode reward: [(0, '-41.815')] [2022-07-13 03:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 150777856. Throughput: 0: 10617.0. Samples: 301554488. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:08,989][27935] Avg episode reward: [(0, '-41.507')] [2022-07-13 03:38:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5304.0). Total num frames: 150805504. Throughput: 0: 10615.9. Samples: 301618656. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:13,989][27935] Avg episode reward: [(0, '-40.880')] [2022-07-13 03:38:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 150832128. Throughput: 0: 10615.0. Samples: 301682464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:18,989][27935] Avg episode reward: [(0, '-40.910')] [2022-07-13 03:38:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 150858752. Throughput: 0: 10616.1. Samples: 301714828. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:23,989][27935] Avg episode reward: [(0, '-41.079')] [2022-07-13 03:38:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 150885376. Throughput: 0: 10663.5. Samples: 301779472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:28,989][27935] Avg episode reward: [(0, '-41.354')] [2022-07-13 03:38:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5310.9). Total num frames: 150912000. Throughput: 0: 10645.3. Samples: 301843236. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:33,989][27935] Avg episode reward: [(0, '-41.349')] [2022-07-13 03:38:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 150938624. Throughput: 0: 10646.0. Samples: 301875468. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:38,989][27935] Avg episode reward: [(0, '-42.217')] [2022-07-13 03:38:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5310.9). Total num frames: 150965248. Throughput: 0: 10638.7. Samples: 301940100. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:43,989][27935] Avg episode reward: [(0, '-41.639')] [2022-07-13 03:38:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 150991872. Throughput: 0: 10710.3. Samples: 302004120. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:48,989][27935] Avg episode reward: [(0, '-42.385')] [2022-07-13 03:38:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5307.4). Total num frames: 151018496. Throughput: 0: 10707.7. Samples: 302036336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:53,989][27935] Avg episode reward: [(0, '-42.434')] [2022-07-13 03:38:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5317.9). Total num frames: 151046144. Throughput: 0: 10700.8. Samples: 302100192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:38:58,989][27935] Avg episode reward: [(0, '-41.583')] [2022-07-13 03:39:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5314.4). Total num frames: 151070720. Throughput: 0: 10603.6. Samples: 302159624. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:03,989][27935] Avg episode reward: [(0, '-41.018')] [2022-07-13 03:39:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 151097344. Throughput: 0: 10599.1. Samples: 302191788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:08,989][27935] Avg episode reward: [(0, '-40.244')] [2022-07-13 03:39:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5304.0). Total num frames: 151122944. Throughput: 0: 10580.3. Samples: 302255584. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:13,989][27935] Avg episode reward: [(0, '-39.908')] [2022-07-13 03:39:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5307.4). Total num frames: 151149568. Throughput: 0: 10575.8. Samples: 302319148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:18,989][27935] Avg episode reward: [(0, '-39.571')] [2022-07-13 03:39:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5307.4). Total num frames: 151176192. Throughput: 0: 10564.9. Samples: 302350888. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:23,990][27935] Avg episode reward: [(0, '-39.312')] [2022-07-13 03:39:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5310.9). Total num frames: 151203840. Throughput: 0: 10554.4. Samples: 302415048. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:28,989][27935] Avg episode reward: [(0, '-38.598')] [2022-07-13 03:39:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5304.0). Total num frames: 151229440. Throughput: 0: 10544.1. Samples: 302478604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:33,989][27935] Avg episode reward: [(0, '-39.311')] [2022-07-13 03:39:38,992][27935] Fps is (10 sec: 5220.9, 60 sec: 5290.4, 300 sec: 5307.4). Total num frames: 151256064. Throughput: 0: 10508.3. Samples: 302509240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:38,998][27935] Avg episode reward: [(0, '-38.959')] [2022-07-13 03:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5293.6). Total num frames: 151280640. Throughput: 0: 10472.0. Samples: 302571432. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:43,989][27935] Avg episode reward: [(0, '-37.863')] [2022-07-13 03:39:48,989][27935] Fps is (10 sec: 5326.4, 60 sec: 5290.7, 300 sec: 5310.9). Total num frames: 151309312. Throughput: 0: 10579.2. Samples: 302635688. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:48,990][27935] Avg episode reward: [(0, '-37.687')] [2022-07-13 03:39:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5300.5). Total num frames: 151334912. Throughput: 0: 10581.2. Samples: 302667940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:53,989][27935] Avg episode reward: [(0, '-38.281')] [2022-07-13 03:39:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5311.0). Total num frames: 151362560. Throughput: 0: 10578.4. Samples: 302731612. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:39:58,989][27935] Avg episode reward: [(0, '-39.987')] [2022-07-13 03:40:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5300.5). Total num frames: 151385088. Throughput: 0: 10496.7. Samples: 302791500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:40:03,989][27935] Avg episode reward: [(0, '-40.329')] [2022-07-13 03:40:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5304.0). Total num frames: 151412736. Throughput: 0: 10494.2. Samples: 302823128. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 03:40:08,989][27935] Avg episode reward: [(0, '-40.744')] [2022-07-13 03:40:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5297.1). Total num frames: 151438336. Throughput: 0: 10486.0. Samples: 302886916. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:13,989][27935] Avg episode reward: [(0, '-41.724')] [2022-07-13 03:40:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5300.5). Total num frames: 151465984. Throughput: 0: 10474.5. Samples: 302949956. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:18,989][27935] Avg episode reward: [(0, '-41.516')] [2022-07-13 03:40:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5300.5). Total num frames: 151491584. Throughput: 0: 10497.5. Samples: 302981596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:23,989][27935] Avg episode reward: [(0, '-41.276')] [2022-07-13 03:40:29,004][27935] Fps is (10 sec: 5112.0, 60 sec: 5221.0, 300 sec: 5289.8). Total num frames: 151517184. Throughput: 0: 10522.8. Samples: 303045120. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:29,005][27935] Avg episode reward: [(0, '-40.599')] [2022-07-13 03:40:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5297.0). Total num frames: 151544832. Throughput: 0: 10519.9. Samples: 303109084. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:33,989][27935] Avg episode reward: [(0, '-39.932')] [2022-07-13 03:40:38,989][27935] Fps is (10 sec: 5435.7, 60 sec: 5256.8, 300 sec: 5297.0). Total num frames: 151571456. Throughput: 0: 10517.5. Samples: 303141228. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:38,989][27935] Avg episode reward: [(0, '-39.139')] [2022-07-13 03:40:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 151597056. Throughput: 0: 10525.7. Samples: 303205268. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:43,989][27935] Avg episode reward: [(0, '-38.674')] [2022-07-13 03:40:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 151625728. Throughput: 0: 10617.9. Samples: 303269304. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:48,989][27935] Avg episode reward: [(0, '-38.590')] [2022-07-13 03:40:53,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 151652352. Throughput: 0: 10636.9. Samples: 303301788. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:53,989][27935] Avg episode reward: [(0, '-38.482')] [2022-07-13 03:40:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5304.0). Total num frames: 151677952. Throughput: 0: 10648.4. Samples: 303366092. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:40:58,990][27935] Avg episode reward: [(0, '-37.502')] [2022-07-13 03:41:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 151702528. Throughput: 0: 10579.3. Samples: 303426024. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:03,989][27935] Avg episode reward: [(0, '-38.281')] [2022-07-13 03:41:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 151730176. Throughput: 0: 10584.2. Samples: 303457884. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:08,989][27935] Avg episode reward: [(0, '-37.757')] [2022-07-13 03:41:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5307.4). Total num frames: 151756800. Throughput: 0: 10614.8. Samples: 303522620. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:13,989][27935] Avg episode reward: [(0, '-37.777')] [2022-07-13 03:41:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 151783424. Throughput: 0: 10603.4. Samples: 303586240. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:18,989][27935] Avg episode reward: [(0, '-38.362')] [2022-07-13 03:41:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 151809024. Throughput: 0: 10603.5. Samples: 303618388. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:23,989][27935] Avg episode reward: [(0, '-37.673')] [2022-07-13 03:41:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5343.3, 300 sec: 5300.5). Total num frames: 151837696. Throughput: 0: 10602.0. Samples: 303682360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:28,989][27935] Avg episode reward: [(0, '-37.535')] [2022-07-13 03:41:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 151863296. Throughput: 0: 10599.3. Samples: 303746272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:33,989][27935] Avg episode reward: [(0, '-35.823')] [2022-07-13 03:41:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 151889920. Throughput: 0: 10584.4. Samples: 303778088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:38,989][27935] Avg episode reward: [(0, '-35.585')] [2022-07-13 03:41:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 151917568. Throughput: 0: 10576.4. Samples: 303842028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:43,989][27935] Avg episode reward: [(0, '-35.287')] [2022-07-13 03:41:48,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5290.7, 300 sec: 5300.5). Total num frames: 151943168. Throughput: 0: 10668.5. Samples: 303906108. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:48,989][27935] Avg episode reward: [(0, '-35.396')] [2022-07-13 03:41:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 151970816. Throughput: 0: 10690.6. Samples: 303938960. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:53,989][27935] Avg episode reward: [(0, '-35.540')] [2022-07-13 03:41:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 151997440. Throughput: 0: 10699.7. Samples: 304004104. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:41:58,989][27935] Avg episode reward: [(0, '-36.926')] [2022-07-13 03:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 152022016. Throughput: 0: 10636.2. Samples: 304064868. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:42:03,989][27935] Avg episode reward: [(0, '-37.703')] [2022-07-13 03:42:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 152049664. Throughput: 0: 10636.2. Samples: 304097016. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:42:08,989][27935] Avg episode reward: [(0, '-37.040')] [2022-07-13 03:42:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 152075264. Throughput: 0: 10639.9. Samples: 304161156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:42:13,989][27935] Avg episode reward: [(0, '-37.475')] [2022-07-13 03:42:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 152103936. Throughput: 0: 10641.3. Samples: 304225132. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 03:42:18,989][27935] Avg episode reward: [(0, '-38.573')] [2022-07-13 03:42:23,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5358.9, 300 sec: 5304.0). Total num frames: 152130560. Throughput: 0: 10657.7. Samples: 304257684. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:23,989][27935] Avg episode reward: [(0, '-39.123')] [2022-07-13 03:42:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 152157184. Throughput: 0: 10687.9. Samples: 304322984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:28,989][27935] Avg episode reward: [(0, '-39.248')] [2022-07-13 03:42:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 152183808. Throughput: 0: 10682.6. Samples: 304386824. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:33,989][27935] Avg episode reward: [(0, '-39.324')] [2022-07-13 03:42:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5358.9, 300 sec: 5307.4). Total num frames: 152211456. Throughput: 0: 10682.7. Samples: 304419680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:38,989][27935] Avg episode reward: [(0, '-39.821')] [2022-07-13 03:42:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 152237056. Throughput: 0: 10630.7. Samples: 304482484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:43,989][27935] Avg episode reward: [(0, '-39.375')] [2022-07-13 03:42:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 152263680. Throughput: 0: 10699.5. Samples: 304546344. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:48,989][27935] Avg episode reward: [(0, '-39.216')] [2022-07-13 03:42:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5297.0). Total num frames: 152290304. Throughput: 0: 10710.4. Samples: 304578984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:53,989][27935] Avg episode reward: [(0, '-38.956')] [2022-07-13 03:42:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 152316928. Throughput: 0: 10717.4. Samples: 304643440. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:42:58,989][27935] Avg episode reward: [(0, '-39.747')] [2022-07-13 03:43:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 152341504. Throughput: 0: 10622.1. Samples: 304703128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:03,989][27935] Avg episode reward: [(0, '-39.763')] [2022-07-13 03:43:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5300.5). Total num frames: 152369152. Throughput: 0: 10608.6. Samples: 304735072. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:08,989][27935] Avg episode reward: [(0, '-41.068')] [2022-07-13 03:43:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5341.9, 300 sec: 5300.5). Total num frames: 152395776. Throughput: 0: 10586.6. Samples: 304799380. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:13,989][27935] Avg episode reward: [(0, '-41.975')] [2022-07-13 03:43:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 152422400. Throughput: 0: 10590.8. Samples: 304863412. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:18,989][27935] Avg episode reward: [(0, '-40.623')] [2022-07-13 03:43:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 152448000. Throughput: 0: 10572.2. Samples: 304895428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:23,989][27935] Avg episode reward: [(0, '-40.620')] [2022-07-13 03:43:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 152475648. Throughput: 0: 10616.0. Samples: 304960204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:28,989][27935] Avg episode reward: [(0, '-40.036')] [2022-07-13 03:43:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 152502272. Throughput: 0: 10625.8. Samples: 305024504. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:33,989][27935] Avg episode reward: [(0, '-37.937')] [2022-07-13 03:43:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 152529920. Throughput: 0: 10622.2. Samples: 305056984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:38,989][27935] Avg episode reward: [(0, '-36.728')] [2022-07-13 03:43:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5341.9, 300 sec: 5307.4). Total num frames: 152557568. Throughput: 0: 10629.1. Samples: 305121748. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:43,989][27935] Avg episode reward: [(0, '-35.177')] [2022-07-13 03:43:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5304.0). Total num frames: 152583168. Throughput: 0: 10731.4. Samples: 305186040. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:48,989][27935] Avg episode reward: [(0, '-34.861')] [2022-07-13 03:43:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5341.9, 300 sec: 5304.0). Total num frames: 152610816. Throughput: 0: 10743.8. Samples: 305218544. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:53,990][27935] Avg episode reward: [(0, '-36.068')] [2022-07-13 03:43:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5310.9). Total num frames: 152637440. Throughput: 0: 10750.4. Samples: 305283148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:43:58,989][27935] Avg episode reward: [(0, '-37.862')] [2022-07-13 03:44:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5341.9, 300 sec: 5304.0). Total num frames: 152662016. Throughput: 0: 10665.3. Samples: 305343348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:44:03,991][27935] Avg episode reward: [(0, '-38.871')] [2022-07-13 03:44:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 152688640. Throughput: 0: 10680.7. Samples: 305376060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:44:08,989][27935] Avg episode reward: [(0, '-38.318')] [2022-07-13 03:44:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5310.9). Total num frames: 152716288. Throughput: 0: 10676.6. Samples: 305440652. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:44:13,990][27935] Avg episode reward: [(0, '-39.610')] [2022-07-13 03:44:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 152741888. Throughput: 0: 10662.7. Samples: 305504324. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:44:18,991][27935] Avg episode reward: [(0, '-39.719')] [2022-07-13 03:44:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5358.9, 300 sec: 5307.4). Total num frames: 152769536. Throughput: 0: 10650.1. Samples: 305536240. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 03:44:23,990][27935] Avg episode reward: [(0, '-37.825')] [2022-07-13 03:44:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5304.0). Total num frames: 152794112. Throughput: 0: 10641.9. Samples: 305600636. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:28,989][27935] Avg episode reward: [(0, '-36.871')] [2022-07-13 03:44:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5324.8, 300 sec: 5307.5). Total num frames: 152821760. Throughput: 0: 10617.3. Samples: 305663820. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:33,989][27935] Avg episode reward: [(0, '-36.572')] [2022-07-13 03:44:38,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5324.8, 300 sec: 5317.9). Total num frames: 152849408. Throughput: 0: 10606.9. Samples: 305695856. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:38,989][27935] Avg episode reward: [(0, '-35.898')] [2022-07-13 03:44:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5307.4). Total num frames: 152875008. Throughput: 0: 10600.1. Samples: 305760152. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:43,989][27935] Avg episode reward: [(0, '-36.469')] [2022-07-13 03:44:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5341.9, 300 sec: 5317.9). Total num frames: 152903680. Throughput: 0: 10689.2. Samples: 305824364. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:48,990][27935] Avg episode reward: [(0, '-36.274')] [2022-07-13 03:44:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5307.4). Total num frames: 152928256. Throughput: 0: 10666.7. Samples: 305856064. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:53,990][27935] Avg episode reward: [(0, '-36.291')] [2022-07-13 03:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5324.8). Total num frames: 152955904. Throughput: 0: 10660.5. Samples: 305920376. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:44:58,989][27935] Avg episode reward: [(0, '-36.813')] [2022-07-13 03:45:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5314.4). Total num frames: 152980480. Throughput: 0: 10586.0. Samples: 305980696. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:03,989][27935] Avg episode reward: [(0, '-36.758')] [2022-07-13 03:45:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5307.7, 300 sec: 5317.9). Total num frames: 153007104. Throughput: 0: 10586.9. Samples: 306012652. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:08,989][27935] Avg episode reward: [(0, '-36.602')] [2022-07-13 03:45:13,991][27935] Fps is (10 sec: 5323.4, 60 sec: 5290.4, 300 sec: 5314.3). Total num frames: 153033728. Throughput: 0: 10582.3. Samples: 306076868. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:13,992][27935] Avg episode reward: [(0, '-36.747')] [2022-07-13 03:45:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5324.8, 300 sec: 5321.3). Total num frames: 153061376. Throughput: 0: 10592.6. Samples: 306140488. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:18,990][27935] Avg episode reward: [(0, '-35.543')] [2022-07-13 03:45:23,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5273.6, 300 sec: 5318.1). Total num frames: 153085952. Throughput: 0: 10576.7. Samples: 306171808. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:23,989][27935] Avg episode reward: [(0, '-35.371')] [2022-07-13 03:45:28,993][27935] Fps is (10 sec: 5220.4, 60 sec: 5324.5, 300 sec: 5317.8). Total num frames: 153113600. Throughput: 0: 10580.2. Samples: 306236300. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:28,993][27935] Avg episode reward: [(0, '-33.628')] [2022-07-13 03:45:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5317.9). Total num frames: 153140224. Throughput: 0: 10562.8. Samples: 306299688. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:33,989][27935] Avg episode reward: [(0, '-31.432')] [2022-07-13 03:45:38,989][27935] Fps is (10 sec: 5429.3, 60 sec: 5307.7, 300 sec: 5324.8). Total num frames: 153167872. Throughput: 0: 10578.7. Samples: 306332104. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:38,989][27935] Avg episode reward: [(0, '-31.272')] [2022-07-13 03:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5307.4). Total num frames: 153191424. Throughput: 0: 10513.2. Samples: 306393472. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:43,990][27935] Avg episode reward: [(0, '-30.260')] [2022-07-13 03:45:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5307.4). Total num frames: 153218048. Throughput: 0: 10567.8. Samples: 306456248. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:48,991][27935] Avg episode reward: [(0, '-30.978')] [2022-07-13 03:45:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5314.4). Total num frames: 153245696. Throughput: 0: 10566.1. Samples: 306488128. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:53,989][27935] Avg episode reward: [(0, '-31.384')] [2022-07-13 03:45:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5321.3). Total num frames: 153272320. Throughput: 0: 10571.7. Samples: 306552568. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:45:58,994][27935] Avg episode reward: [(0, '-32.160')] [2022-07-13 03:46:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5307.4). Total num frames: 153295872. Throughput: 0: 10485.9. Samples: 306612352. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:03,989][27935] Avg episode reward: [(0, '-33.916')] [2022-07-13 03:46:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5310.9). Total num frames: 153323520. Throughput: 0: 10502.7. Samples: 306644428. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:08,989][27935] Avg episode reward: [(0, '-34.428')] [2022-07-13 03:46:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.9, 300 sec: 5314.4). Total num frames: 153351168. Throughput: 0: 10493.1. Samples: 306708448. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:13,989][27935] Avg episode reward: [(0, '-34.443')] [2022-07-13 03:46:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5307.4). Total num frames: 153374720. Throughput: 0: 10499.6. Samples: 306772168. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:18,989][27935] Avg episode reward: [(0, '-34.573')] [2022-07-13 03:46:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5304.0). Total num frames: 153402368. Throughput: 0: 10484.4. Samples: 306803900. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:23,989][27935] Avg episode reward: [(0, '-36.707')] [2022-07-13 03:46:28,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5273.9, 300 sec: 5310.9). Total num frames: 153430016. Throughput: 0: 10557.3. Samples: 306868552. Policy #0 lag: (min: 0.0, avg: 10.6, max: 25.0) [2022-07-13 03:46:28,989][27935] Avg episode reward: [(0, '-36.200')] [2022-07-13 03:46:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5307.4). Total num frames: 153455616. Throughput: 0: 10564.6. Samples: 306931656. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:33,990][27935] Avg episode reward: [(0, '-35.646')] [2022-07-13 03:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5304.0). Total num frames: 153482240. Throughput: 0: 10569.2. Samples: 306963744. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:38,989][27935] Avg episode reward: [(0, '-34.999')] [2022-07-13 03:46:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5310.9). Total num frames: 153509888. Throughput: 0: 10576.3. Samples: 307028500. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:43,989][27935] Avg episode reward: [(0, '-35.342')] [2022-07-13 03:46:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5307.4). Total num frames: 153536512. Throughput: 0: 10664.9. Samples: 307092272. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:48,989][27935] Avg episode reward: [(0, '-33.823')] [2022-07-13 03:46:53,992][27935] Fps is (10 sec: 5323.0, 60 sec: 5290.4, 300 sec: 5307.4). Total num frames: 153563136. Throughput: 0: 10658.4. Samples: 307124092. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:53,993][27935] Avg episode reward: [(0, '-32.991')] [2022-07-13 03:46:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5310.9). Total num frames: 153588736. Throughput: 0: 10668.2. Samples: 307188516. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:46:58,989][27935] Avg episode reward: [(0, '-32.226')] [2022-07-13 03:47:03,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5324.8, 300 sec: 5307.4). Total num frames: 153615360. Throughput: 0: 10572.4. Samples: 307247928. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:03,989][27935] Avg episode reward: [(0, '-31.830')] [2022-07-13 03:47:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5307.4). Total num frames: 153640960. Throughput: 0: 10579.6. Samples: 307279984. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:08,989][27935] Avg episode reward: [(0, '-32.371')] [2022-07-13 03:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5300.5). Total num frames: 153667584. Throughput: 0: 10557.3. Samples: 307343632. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:13,989][27935] Avg episode reward: [(0, '-32.731')] [2022-07-13 03:47:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 153693184. Throughput: 0: 10581.0. Samples: 307407800. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:18,989][27935] Avg episode reward: [(0, '-32.418')] [2022-07-13 03:47:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 153720832. Throughput: 0: 10581.2. Samples: 307439896. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:23,990][27935] Avg episode reward: [(0, '-31.355')] [2022-07-13 03:47:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5300.5). Total num frames: 153747456. Throughput: 0: 10556.6. Samples: 307503548. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:28,989][27935] Avg episode reward: [(0, '-30.555')] [2022-07-13 03:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 153773056. Throughput: 0: 10543.5. Samples: 307566728. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:33,990][27935] Avg episode reward: [(0, '-30.766')] [2022-07-13 03:47:38,991][27935] Fps is (10 sec: 5323.4, 60 sec: 5307.5, 300 sec: 5300.5). Total num frames: 153800704. Throughput: 0: 10546.0. Samples: 307598652. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:38,992][27935] Avg episode reward: [(0, '-29.553')] [2022-07-13 03:47:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5300.5). Total num frames: 153827328. Throughput: 0: 10506.9. Samples: 307661328. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:43,989][27935] Avg episode reward: [(0, '-28.236')] [2022-07-13 03:47:48,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 153852928. Throughput: 0: 10617.0. Samples: 307725692. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:48,989][27935] Avg episode reward: [(0, '-28.403')] [2022-07-13 03:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.9, 300 sec: 5297.0). Total num frames: 153879552. Throughput: 0: 10622.7. Samples: 307758004. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:53,989][27935] Avg episode reward: [(0, '-30.590')] [2022-07-13 03:47:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5307.4). Total num frames: 153907200. Throughput: 0: 10631.5. Samples: 307822048. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:47:58,989][27935] Avg episode reward: [(0, '-31.031')] [2022-07-13 03:48:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5297.0). Total num frames: 153931776. Throughput: 0: 10545.5. Samples: 307882348. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:03,989][27935] Avg episode reward: [(0, '-31.439')] [2022-07-13 03:48:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 153958400. Throughput: 0: 10548.2. Samples: 307914564. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:08,989][27935] Avg episode reward: [(0, '-31.406')] [2022-07-13 03:48:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 153986048. Throughput: 0: 10570.3. Samples: 307979212. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:13,989][27935] Avg episode reward: [(0, '-32.176')] [2022-07-13 03:48:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 154011648. Throughput: 0: 10588.1. Samples: 308043192. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:18,989][27935] Avg episode reward: [(0, '-32.213')] [2022-07-13 03:48:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5300.5). Total num frames: 154039296. Throughput: 0: 10592.7. Samples: 308075296. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:23,989][27935] Avg episode reward: [(0, '-32.217')] [2022-07-13 03:48:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 154064896. Throughput: 0: 10606.9. Samples: 308138640. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:28,989][27935] Avg episode reward: [(0, '-32.032')] [2022-07-13 03:48:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 154090496. Throughput: 0: 10581.1. Samples: 308201840. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:33,990][27935] Avg episode reward: [(0, '-31.492')] [2022-07-13 03:48:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.8, 300 sec: 5286.6). Total num frames: 154117120. Throughput: 0: 10580.2. Samples: 308234112. Policy #0 lag: (min: 1.0, avg: 9.8, max: 21.0) [2022-07-13 03:48:38,989][27935] Avg episode reward: [(0, '-31.447')] [2022-07-13 03:48:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 154145792. Throughput: 0: 10576.4. Samples: 308297984. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:48:43,989][27935] Avg episode reward: [(0, '-30.631')] [2022-07-13 03:48:48,999][27935] Fps is (10 sec: 5421.6, 60 sec: 5306.8, 300 sec: 5289.9). Total num frames: 154171392. Throughput: 0: 10650.1. Samples: 308361712. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:48:49,000][27935] Avg episode reward: [(0, '-30.293')] [2022-07-13 03:48:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 154198016. Throughput: 0: 10647.5. Samples: 308393700. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:48:53,989][27935] Avg episode reward: [(0, '-29.911')] [2022-07-13 03:48:58,989][27935] Fps is (10 sec: 5330.4, 60 sec: 5290.7, 300 sec: 5297.0). Total num frames: 154224640. Throughput: 0: 10639.9. Samples: 308458008. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:48:58,989][27935] Avg episode reward: [(0, '-30.245')] [2022-07-13 03:49:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5307.7, 300 sec: 5293.6). Total num frames: 154250240. Throughput: 0: 10550.7. Samples: 308517972. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:03,989][27935] Avg episode reward: [(0, '-30.757')] [2022-07-13 03:49:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 154275840. Throughput: 0: 10549.4. Samples: 308550020. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:08,989][27935] Avg episode reward: [(0, '-29.791')] [2022-07-13 03:49:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 154303488. Throughput: 0: 10565.5. Samples: 308614088. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:13,989][27935] Avg episode reward: [(0, '-29.513')] [2022-07-13 03:49:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 154329088. Throughput: 0: 10574.3. Samples: 308677684. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:18,989][27935] Avg episode reward: [(0, '-28.490')] [2022-07-13 03:49:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5273.6, 300 sec: 5293.6). Total num frames: 154355712. Throughput: 0: 10572.8. Samples: 308709888. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:23,989][27935] Avg episode reward: [(0, '-26.870')] [2022-07-13 03:49:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 154382336. Throughput: 0: 10574.2. Samples: 308773824. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:28,989][27935] Avg episode reward: [(0, '-26.883')] [2022-07-13 03:49:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5286.6). Total num frames: 154408960. Throughput: 0: 10558.3. Samples: 308836724. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:33,989][27935] Avg episode reward: [(0, '-26.921')] [2022-07-13 03:49:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 154435584. Throughput: 0: 10555.9. Samples: 308868716. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:38,993][27935] Avg episode reward: [(0, '-27.656')] [2022-07-13 03:49:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5283.1). Total num frames: 154462208. Throughput: 0: 10548.3. Samples: 308932680. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:43,989][27935] Avg episode reward: [(0, '-26.541')] [2022-07-13 03:49:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5274.5, 300 sec: 5286.6). Total num frames: 154487808. Throughput: 0: 10638.1. Samples: 308996688. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:48,989][27935] Avg episode reward: [(0, '-27.691')] [2022-07-13 03:49:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 154516480. Throughput: 0: 10638.9. Samples: 309028772. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:53,989][27935] Avg episode reward: [(0, '-26.442')] [2022-07-13 03:49:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5297.0). Total num frames: 154543104. Throughput: 0: 10648.9. Samples: 309093288. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:49:58,989][27935] Avg episode reward: [(0, '-25.762')] [2022-07-13 03:50:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5256.5, 300 sec: 5283.1). Total num frames: 154565632. Throughput: 0: 10570.0. Samples: 309153336. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:03,989][27935] Avg episode reward: [(0, '-26.589')] [2022-07-13 03:50:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5290.7, 300 sec: 5286.7). Total num frames: 154593280. Throughput: 0: 10562.9. Samples: 309185220. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:08,989][27935] Avg episode reward: [(0, '-26.384')] [2022-07-13 03:50:13,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 154620928. Throughput: 0: 10569.5. Samples: 309249452. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:13,989][27935] Avg episode reward: [(0, '-26.835')] [2022-07-13 03:50:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5290.7, 300 sec: 5290.1). Total num frames: 154646528. Throughput: 0: 10585.0. Samples: 309313048. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:18,989][27935] Avg episode reward: [(0, '-27.621')] [2022-07-13 03:50:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5290.2). Total num frames: 154674176. Throughput: 0: 10589.5. Samples: 309345244. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:23,990][27935] Avg episode reward: [(0, '-27.372')] [2022-07-13 03:50:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 154700800. Throughput: 0: 10582.1. Samples: 309408876. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:28,990][27935] Avg episode reward: [(0, '-28.343')] [2022-07-13 03:50:33,997][27935] Fps is (10 sec: 5116.0, 60 sec: 5272.9, 300 sec: 5279.5). Total num frames: 154725376. Throughput: 0: 10553.0. Samples: 309471656. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:33,997][27935] Avg episode reward: [(0, '-27.735')] [2022-07-13 03:50:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5293.6). Total num frames: 154753024. Throughput: 0: 10550.2. Samples: 309503532. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:38,989][27935] Avg episode reward: [(0, '-28.406')] [2022-07-13 03:50:43,989][27935] Fps is (10 sec: 5329.0, 60 sec: 5273.6, 300 sec: 5290.1). Total num frames: 154778624. Throughput: 0: 10530.8. Samples: 309567172. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 03:50:43,989][27935] Avg episode reward: [(0, '-28.052')] [2022-07-13 03:50:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5307.7, 300 sec: 5290.1). Total num frames: 154806272. Throughput: 0: 10596.1. Samples: 309630160. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:50:48,989][27935] Avg episode reward: [(0, '-26.432')] [2022-07-13 03:50:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5283.1). Total num frames: 154830848. Throughput: 0: 10596.3. Samples: 309662052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:50:53,989][27935] Avg episode reward: [(0, '-26.974')] [2022-07-13 03:50:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5297.0). Total num frames: 154858496. Throughput: 0: 10586.8. Samples: 309725860. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:50:58,989][27935] Avg episode reward: [(0, '-26.938')] [2022-07-13 03:51:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5286.6). Total num frames: 154883072. Throughput: 0: 10492.8. Samples: 309785224. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:03,989][27935] Avg episode reward: [(0, '-26.067')] [2022-07-13 03:51:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 154908672. Throughput: 0: 10480.5. Samples: 309816868. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:08,989][27935] Avg episode reward: [(0, '-25.563')] [2022-07-13 03:51:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5290.1). Total num frames: 154935296. Throughput: 0: 10471.8. Samples: 309880108. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:13,989][27935] Avg episode reward: [(0, '-23.713')] [2022-07-13 03:51:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5286.6). Total num frames: 154961920. Throughput: 0: 10478.6. Samples: 309943112. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:18,992][27935] Avg episode reward: [(0, '-25.653')] [2022-07-13 03:51:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5283.1). Total num frames: 154988544. Throughput: 0: 10471.5. Samples: 309974748. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:23,989][27935] Avg episode reward: [(0, '-23.387')] [2022-07-13 03:51:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5283.1). Total num frames: 155014144. Throughput: 0: 10472.6. Samples: 310038440. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:28,989][27935] Avg episode reward: [(0, '-22.629')] [2022-07-13 03:51:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5274.3, 300 sec: 5286.6). Total num frames: 155041792. Throughput: 0: 10468.4. Samples: 310101240. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:33,990][27935] Avg episode reward: [(0, '-22.366')] [2022-07-13 03:51:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5279.7). Total num frames: 155067392. Throughput: 0: 10468.0. Samples: 310133112. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:38,989][27935] Avg episode reward: [(0, '-21.863')] [2022-07-13 03:51:43,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5273.3, 300 sec: 5283.1). Total num frames: 155095040. Throughput: 0: 10475.4. Samples: 310197292. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:43,996][27935] Avg episode reward: [(0, '-22.405')] [2022-07-13 03:51:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5272.8). Total num frames: 155118592. Throughput: 0: 10519.7. Samples: 310258612. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:48,989][27935] Avg episode reward: [(0, '-22.457')] [2022-07-13 03:51:53,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 155146240. Throughput: 0: 10515.2. Samples: 310290052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:53,989][27935] Avg episode reward: [(0, '-24.562')] [2022-07-13 03:51:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5279.7). Total num frames: 155172864. Throughput: 0: 10538.6. Samples: 310354344. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:51:58,989][27935] Avg episode reward: [(0, '-23.864')] [2022-07-13 03:52:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5279.7). Total num frames: 155198464. Throughput: 0: 10459.7. Samples: 310413796. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:03,989][27935] Avg episode reward: [(0, '-24.091')] [2022-07-13 03:52:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 155224064. Throughput: 0: 10459.1. Samples: 310445408. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:08,989][27935] Avg episode reward: [(0, '-24.326')] [2022-07-13 03:52:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5239.5, 300 sec: 5276.2). Total num frames: 155249664. Throughput: 0: 10461.2. Samples: 310509196. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:13,989][27935] Avg episode reward: [(0, '-24.820')] [2022-07-13 03:52:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 155277312. Throughput: 0: 10477.5. Samples: 310572728. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:18,989][27935] Avg episode reward: [(0, '-22.431')] [2022-07-13 03:52:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5269.3). Total num frames: 155301888. Throughput: 0: 10477.1. Samples: 310604580. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:23,989][27935] Avg episode reward: [(0, '-21.567')] [2022-07-13 03:52:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5276.2). Total num frames: 155329536. Throughput: 0: 10453.6. Samples: 310667668. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:28,991][27935] Avg episode reward: [(0, '-22.822')] [2022-07-13 03:52:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5269.3). Total num frames: 155355136. Throughput: 0: 10478.5. Samples: 310730144. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:33,990][27935] Avg episode reward: [(0, '-22.103')] [2022-07-13 03:52:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5272.7). Total num frames: 155382784. Throughput: 0: 10489.2. Samples: 310762068. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:38,990][27935] Avg episode reward: [(0, '-21.002')] [2022-07-13 03:52:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.6, 300 sec: 5265.8). Total num frames: 155406336. Throughput: 0: 10455.6. Samples: 310824848. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:43,990][27935] Avg episode reward: [(0, '-21.963')] [2022-07-13 03:52:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5269.3). Total num frames: 155433984. Throughput: 0: 10531.5. Samples: 310887712. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:48,989][27935] Avg episode reward: [(0, '-19.541')] [2022-07-13 03:52:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5265.8). Total num frames: 155460608. Throughput: 0: 10535.5. Samples: 310919504. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 03:52:53,989][27935] Avg episode reward: [(0, '-18.305')] [2022-07-13 03:52:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5269.3). Total num frames: 155486208. Throughput: 0: 10526.6. Samples: 310982892. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:52:58,989][27935] Avg episode reward: [(0, '-19.334')] [2022-07-13 03:53:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5265.8). Total num frames: 155511808. Throughput: 0: 10426.3. Samples: 311041912. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:03,989][27935] Avg episode reward: [(0, '-19.251')] [2022-07-13 03:53:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5255.4). Total num frames: 155536384. Throughput: 0: 10413.1. Samples: 311073168. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:08,989][27935] Avg episode reward: [(0, '-18.232')] [2022-07-13 03:53:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5258.8). Total num frames: 155563008. Throughput: 0: 10397.8. Samples: 311135572. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:13,989][27935] Avg episode reward: [(0, '-19.010')] [2022-07-13 03:53:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5248.4). Total num frames: 155587584. Throughput: 0: 10400.8. Samples: 311198180. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:18,989][27935] Avg episode reward: [(0, '-19.123')] [2022-07-13 03:53:23,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5256.5, 300 sec: 5262.3). Total num frames: 155617280. Throughput: 0: 10386.3. Samples: 311229452. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:23,989][27935] Avg episode reward: [(0, '-18.720')] [2022-07-13 03:53:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5255.4). Total num frames: 155640832. Throughput: 0: 10385.5. Samples: 311292196. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:28,990][27935] Avg episode reward: [(0, '-19.040')] [2022-07-13 03:53:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5251.9). Total num frames: 155666432. Throughput: 0: 10368.3. Samples: 311354284. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:33,990][27935] Avg episode reward: [(0, '-16.894')] [2022-07-13 03:53:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5245.0). Total num frames: 155693056. Throughput: 0: 10348.7. Samples: 311385196. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:38,989][27935] Avg episode reward: [(0, '-17.196')] [2022-07-13 03:53:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5248.6). Total num frames: 155719680. Throughput: 0: 10333.9. Samples: 311447920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:43,990][27935] Avg episode reward: [(0, '-16.886')] [2022-07-13 03:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5245.0). Total num frames: 155745280. Throughput: 0: 10401.7. Samples: 311509988. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:48,991][27935] Avg episode reward: [(0, '-16.946')] [2022-07-13 03:53:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5245.0). Total num frames: 155771904. Throughput: 0: 10401.0. Samples: 311541212. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:53,991][27935] Avg episode reward: [(0, '-16.585')] [2022-07-13 03:53:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5241.5). Total num frames: 155796480. Throughput: 0: 10411.9. Samples: 311604108. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:53:58,991][27935] Avg episode reward: [(0, '-16.915')] [2022-07-13 03:54:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5245.0). Total num frames: 155823104. Throughput: 0: 10307.1. Samples: 311662000. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:03,989][27935] Avg episode reward: [(0, '-18.208')] [2022-07-13 03:54:08,990][27935] Fps is (10 sec: 5017.0, 60 sec: 5171.1, 300 sec: 5231.1). Total num frames: 155846656. Throughput: 0: 10302.7. Samples: 311693084. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:08,990][27935] Avg episode reward: [(0, '-20.351')] [2022-07-13 03:54:13,991][27935] Fps is (10 sec: 5016.5, 60 sec: 5171.0, 300 sec: 5234.5). Total num frames: 155873280. Throughput: 0: 10300.1. Samples: 311755724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:13,992][27935] Avg episode reward: [(0, '-19.616')] [2022-07-13 03:54:18,989][27935] Fps is (10 sec: 5223.0, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 155898880. Throughput: 0: 10312.3. Samples: 311818340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:18,989][27935] Avg episode reward: [(0, '-18.839')] [2022-07-13 03:54:23,989][27935] Fps is (10 sec: 5223.5, 60 sec: 5137.1, 300 sec: 5231.1). Total num frames: 155925504. Throughput: 0: 10316.1. Samples: 311849420. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:23,990][27935] Avg episode reward: [(0, '-18.806')] [2022-07-13 03:54:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 155951104. Throughput: 0: 10299.5. Samples: 311911396. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:28,989][27935] Avg episode reward: [(0, '-17.075')] [2022-07-13 03:54:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5217.2). Total num frames: 155974656. Throughput: 0: 10294.1. Samples: 311973224. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:33,991][27935] Avg episode reward: [(0, '-14.565')] [2022-07-13 03:54:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 156003328. Throughput: 0: 10292.6. Samples: 312004380. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:38,991][27935] Avg episode reward: [(0, '-15.354')] [2022-07-13 03:54:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 156029952. Throughput: 0: 10286.6. Samples: 312067004. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:43,990][27935] Avg episode reward: [(0, '-14.903')] [2022-07-13 03:54:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 156055552. Throughput: 0: 10387.0. Samples: 312129416. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:48,991][27935] Avg episode reward: [(0, '-15.338')] [2022-07-13 03:54:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5210.3). Total num frames: 156080128. Throughput: 0: 10376.9. Samples: 312160032. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:53,990][27935] Avg episode reward: [(0, '-16.156')] [2022-07-13 03:54:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 156106752. Throughput: 0: 10365.7. Samples: 312222156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 03:54:58,989][27935] Avg episode reward: [(0, '-16.492')] [2022-07-13 03:55:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5213.7). Total num frames: 156131328. Throughput: 0: 10274.6. Samples: 312280696. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:03,989][27935] Avg episode reward: [(0, '-16.731')] [2022-07-13 03:55:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.2, 300 sec: 5203.3). Total num frames: 156155904. Throughput: 0: 10275.2. Samples: 312311804. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:08,989][27935] Avg episode reward: [(0, '-15.492')] [2022-07-13 03:55:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.3, 300 sec: 5206.8). Total num frames: 156182528. Throughput: 0: 10272.5. Samples: 312373660. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:13,989][27935] Avg episode reward: [(0, '-15.831')] [2022-07-13 03:55:18,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 156209152. Throughput: 0: 10277.9. Samples: 312435732. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:18,989][27935] Avg episode reward: [(0, '-15.028')] [2022-07-13 03:55:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 156234752. Throughput: 0: 10290.1. Samples: 312467432. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:23,989][27935] Avg episode reward: [(0, '-15.622')] [2022-07-13 03:55:28,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5137.1, 300 sec: 5200.0). Total num frames: 156259328. Throughput: 0: 10274.8. Samples: 312529368. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:28,989][27935] Avg episode reward: [(0, '-13.993')] [2022-07-13 03:55:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 156285952. Throughput: 0: 10242.7. Samples: 312590336. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:33,989][27935] Avg episode reward: [(0, '-13.641')] [2022-07-13 03:55:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 156311552. Throughput: 0: 10250.7. Samples: 312621312. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:38,989][27935] Avg episode reward: [(0, '-14.182')] [2022-07-13 03:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5186.0). Total num frames: 156336128. Throughput: 0: 10245.2. Samples: 312683188. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:43,989][27935] Avg episode reward: [(0, '-14.931')] [2022-07-13 03:55:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 156363776. Throughput: 0: 10321.5. Samples: 312745164. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:48,989][27935] Avg episode reward: [(0, '-14.086')] [2022-07-13 03:55:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 156389376. Throughput: 0: 10325.9. Samples: 312776468. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:53,991][27935] Avg episode reward: [(0, '-13.119')] [2022-07-13 03:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 156416000. Throughput: 0: 10338.9. Samples: 312838912. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:55:58,989][27935] Avg episode reward: [(0, '-15.355')] [2022-07-13 03:56:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5186.0). Total num frames: 156438528. Throughput: 0: 10267.9. Samples: 312897788. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:03,991][27935] Avg episode reward: [(0, '-16.827')] [2022-07-13 03:56:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 156465152. Throughput: 0: 10249.4. Samples: 312928656. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:08,990][27935] Avg episode reward: [(0, '-19.399')] [2022-07-13 03:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 156490752. Throughput: 0: 10245.1. Samples: 312990400. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:13,989][27935] Avg episode reward: [(0, '-19.488')] [2022-07-13 03:56:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 156517376. Throughput: 0: 10268.4. Samples: 313052412. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:18,989][27935] Avg episode reward: [(0, '-18.356')] [2022-07-13 03:56:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5179.0). Total num frames: 156541952. Throughput: 0: 10274.0. Samples: 313083640. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:23,990][27935] Avg episode reward: [(0, '-18.848')] [2022-07-13 03:56:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 156567552. Throughput: 0: 10281.6. Samples: 313145860. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:28,991][27935] Avg episode reward: [(0, '-15.816')] [2022-07-13 03:56:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 156595200. Throughput: 0: 10282.4. Samples: 313207872. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:33,989][27935] Avg episode reward: [(0, '-13.590')] [2022-07-13 03:56:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5168.7). Total num frames: 156619776. Throughput: 0: 10283.2. Samples: 313239212. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:38,989][27935] Avg episode reward: [(0, '-13.388')] [2022-07-13 03:56:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 156647424. Throughput: 0: 10310.1. Samples: 313302864. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:43,989][27935] Avg episode reward: [(0, '-11.502')] [2022-07-13 03:56:48,996][27935] Fps is (10 sec: 5423.1, 60 sec: 5170.5, 300 sec: 5178.9). Total num frames: 156674048. Throughput: 0: 10393.6. Samples: 313365576. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:48,997][27935] Avg episode reward: [(0, '-12.843')] [2022-07-13 03:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 156699648. Throughput: 0: 10409.9. Samples: 313397100. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:53,989][27935] Avg episode reward: [(0, '-13.883')] [2022-07-13 03:56:58,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 156725248. Throughput: 0: 10440.2. Samples: 313460208. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:56:58,989][27935] Avg episode reward: [(0, '-15.862')] [2022-07-13 03:57:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 156749824. Throughput: 0: 10377.3. Samples: 313519392. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 03:57:03,989][27935] Avg episode reward: [(0, '-16.554')] [2022-07-13 03:57:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 156776448. Throughput: 0: 10382.2. Samples: 313550840. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:08,989][27935] Avg episode reward: [(0, '-17.183')] [2022-07-13 03:57:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 156802048. Throughput: 0: 10403.0. Samples: 313613996. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:13,989][27935] Avg episode reward: [(0, '-16.628')] [2022-07-13 03:57:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 156828672. Throughput: 0: 10415.1. Samples: 313676552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:18,989][27935] Avg episode reward: [(0, '-15.633')] [2022-07-13 03:57:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 156856320. Throughput: 0: 10424.7. Samples: 313708324. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:23,989][27935] Avg episode reward: [(0, '-16.091')] [2022-07-13 03:57:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 156880896. Throughput: 0: 10422.0. Samples: 313771852. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:28,989][27935] Avg episode reward: [(0, '-16.985')] [2022-07-13 03:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 156907520. Throughput: 0: 10420.6. Samples: 313834424. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:33,989][27935] Avg episode reward: [(0, '-16.088')] [2022-07-13 03:57:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 156933120. Throughput: 0: 10415.8. Samples: 313865812. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:38,989][27935] Avg episode reward: [(0, '-14.599')] [2022-07-13 03:57:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 156959744. Throughput: 0: 10390.1. Samples: 313927760. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:43,989][27935] Avg episode reward: [(0, '-13.913')] [2022-07-13 03:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.9, 300 sec: 5168.6). Total num frames: 156985344. Throughput: 0: 10447.9. Samples: 313989548. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:48,989][27935] Avg episode reward: [(0, '-12.871')] [2022-07-13 03:57:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 157009920. Throughput: 0: 10410.7. Samples: 314019324. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:53,989][27935] Avg episode reward: [(0, '-12.443')] [2022-07-13 03:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 157037568. Throughput: 0: 10397.6. Samples: 314081888. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:57:58,989][27935] Avg episode reward: [(0, '-12.117')] [2022-07-13 03:58:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 157061120. Throughput: 0: 10325.7. Samples: 314141208. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:03,989][27935] Avg episode reward: [(0, '-12.297')] [2022-07-13 03:58:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 157086720. Throughput: 0: 10329.0. Samples: 314173128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:08,990][27935] Avg episode reward: [(0, '-14.773')] [2022-07-13 03:58:13,993][27935] Fps is (10 sec: 5220.3, 60 sec: 5187.9, 300 sec: 5172.0). Total num frames: 157113344. Throughput: 0: 10316.3. Samples: 314236128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:13,993][27935] Avg episode reward: [(0, '-16.517')] [2022-07-13 03:58:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 157140992. Throughput: 0: 10323.8. Samples: 314298996. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:18,989][27935] Avg episode reward: [(0, '-16.306')] [2022-07-13 03:58:23,989][27935] Fps is (10 sec: 5326.9, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 157166592. Throughput: 0: 10338.0. Samples: 314331024. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:23,989][27935] Avg episode reward: [(0, '-16.256')] [2022-07-13 03:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 157191168. Throughput: 0: 10367.0. Samples: 314394276. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:28,989][27935] Avg episode reward: [(0, '-16.834')] [2022-07-13 03:58:33,990][27935] Fps is (10 sec: 5221.8, 60 sec: 5188.2, 300 sec: 5172.0). Total num frames: 157218816. Throughput: 0: 10386.9. Samples: 314456972. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:33,990][27935] Avg episode reward: [(0, '-17.534')] [2022-07-13 03:58:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 157244416. Throughput: 0: 10426.0. Samples: 314488492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:38,989][27935] Avg episode reward: [(0, '-16.518')] [2022-07-13 03:58:43,989][27935] Fps is (10 sec: 5325.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 157272064. Throughput: 0: 10442.0. Samples: 314551780. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:43,989][27935] Avg episode reward: [(0, '-16.060')] [2022-07-13 03:58:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 157297664. Throughput: 0: 10534.1. Samples: 314615244. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:48,989][27935] Avg episode reward: [(0, '-16.617')] [2022-07-13 03:58:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 157325312. Throughput: 0: 10518.5. Samples: 314646460. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:53,989][27935] Avg episode reward: [(0, '-14.302')] [2022-07-13 03:58:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 157349888. Throughput: 0: 10519.8. Samples: 314709476. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:58:58,989][27935] Avg episode reward: [(0, '-14.469')] [2022-07-13 03:59:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 157375488. Throughput: 0: 10451.0. Samples: 314769292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:59:03,989][27935] Avg episode reward: [(0, '-14.110')] [2022-07-13 03:59:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5182.5). Total num frames: 157402112. Throughput: 0: 10448.2. Samples: 314801196. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:59:08,989][27935] Avg episode reward: [(0, '-13.428')] [2022-07-13 03:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.8, 300 sec: 5182.5). Total num frames: 157427712. Throughput: 0: 10434.3. Samples: 314863820. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 03:59:13,992][27935] Avg episode reward: [(0, '-14.259')] [2022-07-13 03:59:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 157453312. Throughput: 0: 10446.1. Samples: 314927036. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:18,989][27935] Avg episode reward: [(0, '-14.015')] [2022-07-13 03:59:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 157480960. Throughput: 0: 10449.7. Samples: 314958728. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:23,989][27935] Avg episode reward: [(0, '-15.124')] [2022-07-13 03:59:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5192.9). Total num frames: 157506560. Throughput: 0: 10452.8. Samples: 315022156. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:28,989][27935] Avg episode reward: [(0, '-14.338')] [2022-07-13 03:59:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.6, 300 sec: 5186.0). Total num frames: 157533184. Throughput: 0: 9739.7. Samples: 315053528. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:33,989][27935] Avg episode reward: [(0, '-16.126')] [2022-07-13 03:59:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5186.0). Total num frames: 157559808. Throughput: 0: 10447.5. Samples: 315116596. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:38,989][27935] Avg episode reward: [(0, '-16.020')] [2022-07-13 03:59:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 157586432. Throughput: 0: 10457.2. Samples: 315180052. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:43,989][27935] Avg episode reward: [(0, '-16.937')] [2022-07-13 03:59:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 157612032. Throughput: 0: 10541.9. Samples: 315243680. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:48,989][27935] Avg episode reward: [(0, '-15.142')] [2022-07-13 03:59:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 157638656. Throughput: 0: 10544.5. Samples: 315275700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:53,989][27935] Avg episode reward: [(0, '-13.886')] [2022-07-13 03:59:58,996][27935] Fps is (10 sec: 5320.8, 60 sec: 5255.9, 300 sec: 5199.7). Total num frames: 157665280. Throughput: 0: 10565.3. Samples: 315339336. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 03:59:58,997][27935] Avg episode reward: [(0, '-14.293')] [2022-07-13 04:00:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 157689856. Throughput: 0: 10488.1. Samples: 315399000. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:03,989][27935] Avg episode reward: [(0, '-14.132')] [2022-07-13 04:00:08,989][27935] Fps is (10 sec: 5021.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 157715456. Throughput: 0: 10490.8. Samples: 315430816. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:08,989][27935] Avg episode reward: [(0, '-10.932')] [2022-07-13 04:00:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 157742080. Throughput: 0: 10484.4. Samples: 315493956. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:13,990][27935] Avg episode reward: [(0, '-10.983')] [2022-07-13 04:00:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5199.8). Total num frames: 157768704. Throughput: 0: 10478.1. Samples: 315525044. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:18,989][27935] Avg episode reward: [(0, '-10.743')] [2022-07-13 04:00:23,989][27935] Fps is (10 sec: 5426.9, 60 sec: 5256.5, 300 sec: 5210.2). Total num frames: 157796352. Throughput: 0: 10488.8. Samples: 315588596. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:23,990][27935] Avg episode reward: [(0, '-10.673')] [2022-07-13 04:00:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 157820928. Throughput: 0: 10482.9. Samples: 315651784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:28,989][27935] Avg episode reward: [(0, '-12.179')] [2022-07-13 04:00:33,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 157847552. Throughput: 0: 10463.9. Samples: 315714556. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:33,989][27935] Avg episode reward: [(0, '-11.446')] [2022-07-13 04:00:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 157874176. Throughput: 0: 10450.8. Samples: 315745984. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:38,989][27935] Avg episode reward: [(0, '-13.399')] [2022-07-13 04:00:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 157899776. Throughput: 0: 10430.0. Samples: 315808608. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:43,989][27935] Avg episode reward: [(0, '-15.287')] [2022-07-13 04:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 157926400. Throughput: 0: 10491.8. Samples: 315871132. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:48,989][27935] Avg episode reward: [(0, '-14.021')] [2022-07-13 04:00:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 157953024. Throughput: 0: 10476.4. Samples: 315902252. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:53,989][27935] Avg episode reward: [(0, '-13.961')] [2022-07-13 04:00:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5240.1, 300 sec: 5224.1). Total num frames: 157979648. Throughput: 0: 10496.5. Samples: 315966300. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:00:58,989][27935] Avg episode reward: [(0, '-13.235')] [2022-07-13 04:01:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 158002176. Throughput: 0: 11138.8. Samples: 316026288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:01:03,989][27935] Avg episode reward: [(0, '-11.974')] [2022-07-13 04:01:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 158030848. Throughput: 0: 10437.9. Samples: 316058296. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:01:08,989][27935] Avg episode reward: [(0, '-11.527')] [2022-07-13 04:01:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 158056448. Throughput: 0: 10449.9. Samples: 316122028. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:01:13,996][27935] Avg episode reward: [(0, '-11.841')] [2022-07-13 04:01:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 158082048. Throughput: 0: 10456.8. Samples: 316185112. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:01:18,989][27935] Avg episode reward: [(0, '-12.124')] [2022-07-13 04:01:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.5, 300 sec: 5227.6). Total num frames: 158109696. Throughput: 0: 10462.9. Samples: 316216816. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:23,989][27935] Avg episode reward: [(0, '-12.817')] [2022-07-13 04:01:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 158136320. Throughput: 0: 10486.7. Samples: 316280512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:28,989][27935] Avg episode reward: [(0, '-14.271')] [2022-07-13 04:01:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 158161920. Throughput: 0: 10494.0. Samples: 316343364. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:33,991][27935] Avg episode reward: [(0, '-14.345')] [2022-07-13 04:01:38,990][27935] Fps is (10 sec: 5221.6, 60 sec: 5239.3, 300 sec: 5224.1). Total num frames: 158188544. Throughput: 0: 10501.4. Samples: 316374832. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:38,991][27935] Avg episode reward: [(0, '-14.735')] [2022-07-13 04:01:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5220.8). Total num frames: 158214144. Throughput: 0: 10483.0. Samples: 316438036. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:43,990][27935] Avg episode reward: [(0, '-13.979')] [2022-07-13 04:01:48,996][27935] Fps is (10 sec: 5321.6, 60 sec: 5255.9, 300 sec: 5227.5). Total num frames: 158241792. Throughput: 0: 10550.0. Samples: 316501120. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:48,997][27935] Avg episode reward: [(0, '-13.921')] [2022-07-13 04:01:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 158266368. Throughput: 0: 10536.9. Samples: 316532456. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:53,989][27935] Avg episode reward: [(0, '-12.713')] [2022-07-13 04:01:58,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 158292992. Throughput: 0: 10521.2. Samples: 316595480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:01:58,989][27935] Avg episode reward: [(0, '-12.583')] [2022-07-13 04:02:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 158317568. Throughput: 0: 10430.9. Samples: 316654500. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:03,989][27935] Avg episode reward: [(0, '-13.226')] [2022-07-13 04:02:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158344192. Throughput: 0: 10428.3. Samples: 316686088. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:08,989][27935] Avg episode reward: [(0, '-13.889')] [2022-07-13 04:02:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 158369792. Throughput: 0: 10412.4. Samples: 316749068. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:13,989][27935] Avg episode reward: [(0, '-12.977')] [2022-07-13 04:02:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 158395392. Throughput: 0: 10412.9. Samples: 316811944. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:18,989][27935] Avg episode reward: [(0, '-11.153')] [2022-07-13 04:02:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158423040. Throughput: 0: 10414.1. Samples: 316843448. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:23,989][27935] Avg episode reward: [(0, '-11.779')] [2022-07-13 04:02:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 158447616. Throughput: 0: 10420.0. Samples: 316906936. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:28,990][27935] Avg episode reward: [(0, '-11.910')] [2022-07-13 04:02:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158475264. Throughput: 0: 10417.7. Samples: 316969836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:33,989][27935] Avg episode reward: [(0, '-10.479')] [2022-07-13 04:02:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.5, 300 sec: 5224.1). Total num frames: 158500864. Throughput: 0: 10427.3. Samples: 317001684. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:38,989][27935] Avg episode reward: [(0, '-9.180')] [2022-07-13 04:02:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 158528512. Throughput: 0: 10403.6. Samples: 317063644. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:43,989][27935] Avg episode reward: [(0, '-8.319')] [2022-07-13 04:02:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.9, 300 sec: 5231.1). Total num frames: 158553088. Throughput: 0: 10501.1. Samples: 317127048. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:48,989][27935] Avg episode reward: [(0, '-10.966')] [2022-07-13 04:02:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158579712. Throughput: 0: 10508.0. Samples: 317158948. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:53,989][27935] Avg episode reward: [(0, '-12.463')] [2022-07-13 04:02:58,989][27935] Fps is (10 sec: 5324.5, 60 sec: 5222.3, 300 sec: 5238.0). Total num frames: 158606336. Throughput: 0: 10525.3. Samples: 317222712. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:02:58,990][27935] Avg episode reward: [(0, '-11.991')] [2022-07-13 04:03:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 158630912. Throughput: 0: 10455.8. Samples: 317282456. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:03,989][27935] Avg episode reward: [(0, '-11.661')] [2022-07-13 04:03:08,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5222.4, 300 sec: 5234.6). Total num frames: 158657536. Throughput: 0: 10468.5. Samples: 317314532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:08,989][27935] Avg episode reward: [(0, '-12.351')] [2022-07-13 04:03:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 158685184. Throughput: 0: 10463.5. Samples: 317377796. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:13,989][27935] Avg episode reward: [(0, '-13.780')] [2022-07-13 04:03:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158708736. Throughput: 0: 10461.7. Samples: 317440612. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:18,989][27935] Avg episode reward: [(0, '-14.443')] [2022-07-13 04:03:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 158738432. Throughput: 0: 10453.8. Samples: 317472104. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:23,991][27935] Avg episode reward: [(0, '-13.655')] [2022-07-13 04:03:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 158761984. Throughput: 0: 10485.1. Samples: 317535472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:03:28,990][27935] Avg episode reward: [(0, '-13.288')] [2022-07-13 04:03:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 158789632. Throughput: 0: 10465.5. Samples: 317597996. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:33,989][27935] Avg episode reward: [(0, '-14.871')] [2022-07-13 04:03:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 158814208. Throughput: 0: 10459.0. Samples: 317629604. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:38,989][27935] Avg episode reward: [(0, '-14.751')] [2022-07-13 04:03:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 158841856. Throughput: 0: 10471.1. Samples: 317693904. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:43,989][27935] Avg episode reward: [(0, '-15.230')] [2022-07-13 04:03:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 158868480. Throughput: 0: 10555.0. Samples: 317757432. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:48,989][27935] Avg episode reward: [(0, '-15.649')] [2022-07-13 04:03:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 158895104. Throughput: 0: 10541.5. Samples: 317788900. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:53,989][27935] Avg episode reward: [(0, '-14.514')] [2022-07-13 04:03:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 158920704. Throughput: 0: 10489.6. Samples: 317849828. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:03:58,989][27935] Avg episode reward: [(0, '-16.313')] [2022-07-13 04:04:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 158945280. Throughput: 0: 10414.3. Samples: 317909256. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:03,989][27935] Avg episode reward: [(0, '-15.048')] [2022-07-13 04:04:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 158970880. Throughput: 0: 10423.7. Samples: 317941172. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:09,000][27935] Avg episode reward: [(0, '-13.890')] [2022-07-13 04:04:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 158997504. Throughput: 0: 10421.1. Samples: 318004420. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:13,989][27935] Avg episode reward: [(0, '-12.030')] [2022-07-13 04:04:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 159023104. Throughput: 0: 10425.2. Samples: 318067128. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:18,989][27935] Avg episode reward: [(0, '-11.365')] [2022-07-13 04:04:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 159050752. Throughput: 0: 10436.4. Samples: 318099244. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:23,989][27935] Avg episode reward: [(0, '-12.288')] [2022-07-13 04:04:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 159077376. Throughput: 0: 10420.4. Samples: 318162820. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:28,989][27935] Avg episode reward: [(0, '-12.593')] [2022-07-13 04:04:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159104000. Throughput: 0: 10395.9. Samples: 318225248. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:33,989][27935] Avg episode reward: [(0, '-13.101')] [2022-07-13 04:04:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 159128576. Throughput: 0: 10404.4. Samples: 318257096. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:38,989][27935] Avg episode reward: [(0, '-13.173')] [2022-07-13 04:04:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 159156224. Throughput: 0: 10462.7. Samples: 318320648. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:43,989][27935] Avg episode reward: [(0, '-13.882')] [2022-07-13 04:04:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159182848. Throughput: 0: 10546.4. Samples: 318383844. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:48,989][27935] Avg episode reward: [(0, '-16.434')] [2022-07-13 04:04:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.2). Total num frames: 159208448. Throughput: 0: 10534.5. Samples: 318415224. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:53,990][27935] Avg episode reward: [(0, '-14.268')] [2022-07-13 04:04:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 159235072. Throughput: 0: 10534.1. Samples: 318478456. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:04:58,990][27935] Avg episode reward: [(0, '-14.175')] [2022-07-13 04:05:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159259648. Throughput: 0: 10455.5. Samples: 318537624. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:03,990][27935] Avg episode reward: [(0, '-12.621')] [2022-07-13 04:05:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 159285248. Throughput: 0: 10453.2. Samples: 318569640. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:08,989][27935] Avg episode reward: [(0, '-12.990')] [2022-07-13 04:05:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 159311872. Throughput: 0: 10449.8. Samples: 318633060. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:13,989][27935] Avg episode reward: [(0, '-14.281')] [2022-07-13 04:05:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 159338496. Throughput: 0: 10462.6. Samples: 318696068. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:18,989][27935] Avg episode reward: [(0, '-11.481')] [2022-07-13 04:05:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159365120. Throughput: 0: 10462.7. Samples: 318727920. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:23,989][27935] Avg episode reward: [(0, '-12.732')] [2022-07-13 04:05:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159391744. Throughput: 0: 10465.2. Samples: 318791584. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:28,989][27935] Avg episode reward: [(0, '-11.935')] [2022-07-13 04:05:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 159417344. Throughput: 0: 10452.2. Samples: 318854192. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:05:33,990][27935] Avg episode reward: [(0, '-10.923')] [2022-07-13 04:05:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 159443968. Throughput: 0: 10462.9. Samples: 318886056. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:05:38,989][27935] Avg episode reward: [(0, '-12.677')] [2022-07-13 04:05:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159470592. Throughput: 0: 10474.0. Samples: 318949788. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:05:43,989][27935] Avg episode reward: [(0, '-11.333')] [2022-07-13 04:05:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 159496192. Throughput: 0: 10558.8. Samples: 319012772. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:05:48,989][27935] Avg episode reward: [(0, '-10.176')] [2022-07-13 04:05:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 159521792. Throughput: 0: 10549.5. Samples: 319044368. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:05:53,989][27935] Avg episode reward: [(0, '-8.900')] [2022-07-13 04:05:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 159549440. Throughput: 0: 10526.4. Samples: 319106748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:05:58,989][27935] Avg episode reward: [(0, '-9.238')] [2022-07-13 04:06:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 159574016. Throughput: 0: 10436.3. Samples: 319165700. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:03,989][27935] Avg episode reward: [(0, '-10.783')] [2022-07-13 04:06:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 159600640. Throughput: 0: 10439.0. Samples: 319197676. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:08,989][27935] Avg episode reward: [(0, '-10.195')] [2022-07-13 04:06:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 159626240. Throughput: 0: 10436.3. Samples: 319261220. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:13,989][27935] Avg episode reward: [(0, '-10.324')] [2022-07-13 04:06:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 159652864. Throughput: 0: 10424.2. Samples: 319323280. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:18,989][27935] Avg episode reward: [(0, '-12.492')] [2022-07-13 04:06:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 159677440. Throughput: 0: 10416.7. Samples: 319354808. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:23,989][27935] Avg episode reward: [(0, '-11.380')] [2022-07-13 04:06:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 159704064. Throughput: 0: 10409.0. Samples: 319418192. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:28,989][27935] Avg episode reward: [(0, '-13.139')] [2022-07-13 04:06:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 159730688. Throughput: 0: 10394.2. Samples: 319480512. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:33,989][27935] Avg episode reward: [(0, '-14.894')] [2022-07-13 04:06:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 159756288. Throughput: 0: 10388.7. Samples: 319511860. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:38,989][27935] Avg episode reward: [(0, '-16.404')] [2022-07-13 04:06:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5220.8). Total num frames: 159781888. Throughput: 0: 10403.2. Samples: 319574892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:43,989][27935] Avg episode reward: [(0, '-16.971')] [2022-07-13 04:06:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 159809536. Throughput: 0: 10460.5. Samples: 319636424. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:48,989][27935] Avg episode reward: [(0, '-16.089')] [2022-07-13 04:06:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 159834112. Throughput: 0: 10455.3. Samples: 319668164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:53,989][27935] Avg episode reward: [(0, '-16.610')] [2022-07-13 04:06:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 159860736. Throughput: 0: 10417.6. Samples: 319730012. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:06:58,989][27935] Avg episode reward: [(0, '-15.745')] [2022-07-13 04:07:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 159884288. Throughput: 0: 10353.4. Samples: 319789184. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:03,989][27935] Avg episode reward: [(0, '-13.578')] [2022-07-13 04:07:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 159911936. Throughput: 0: 10354.2. Samples: 319820748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:08,989][27935] Avg episode reward: [(0, '-12.344')] [2022-07-13 04:07:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 159937536. Throughput: 0: 10354.3. Samples: 319884136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:13,989][27935] Avg episode reward: [(0, '-10.774')] [2022-07-13 04:07:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 159963136. Throughput: 0: 10359.9. Samples: 319946708. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:18,995][27935] Avg episode reward: [(0, '-12.132')] [2022-07-13 04:07:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 159989760. Throughput: 0: 10358.0. Samples: 319977972. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:23,989][27935] Avg episode reward: [(0, '-12.759')] [2022-07-13 04:07:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 160016384. Throughput: 0: 10357.1. Samples: 320040960. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:28,989][27935] Avg episode reward: [(0, '-13.154')] [2022-07-13 04:07:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 160041984. Throughput: 0: 10376.5. Samples: 320103368. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:33,990][27935] Avg episode reward: [(0, '-13.291')] [2022-07-13 04:07:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 160067584. Throughput: 0: 10372.1. Samples: 320134908. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:38,989][27935] Avg episode reward: [(0, '-11.702')] [2022-07-13 04:07:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 160095232. Throughput: 0: 10372.4. Samples: 320196768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 04:07:43,989][27935] Avg episode reward: [(0, '-13.100')] [2022-07-13 04:07:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 160120832. Throughput: 0: 10454.1. Samples: 320259616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:07:48,989][27935] Avg episode reward: [(0, '-11.155')] [2022-07-13 04:07:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 160146432. Throughput: 0: 10465.7. Samples: 320291704. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:07:53,989][27935] Avg episode reward: [(0, '-10.841')] [2022-07-13 04:07:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 160173056. Throughput: 0: 10466.2. Samples: 320355116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:07:58,999][27935] Avg episode reward: [(0, '-10.644')] [2022-07-13 04:08:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 160197632. Throughput: 0: 10405.0. Samples: 320414932. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:03,990][27935] Avg episode reward: [(0, '-10.864')] [2022-07-13 04:08:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 160225280. Throughput: 0: 10421.0. Samples: 320446916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:08,991][27935] Avg episode reward: [(0, '-11.210')] [2022-07-13 04:08:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 160250880. Throughput: 0: 10446.7. Samples: 320511060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:13,989][27935] Avg episode reward: [(0, '-9.787')] [2022-07-13 04:08:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 160277504. Throughput: 0: 10477.4. Samples: 320574852. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:18,991][27935] Avg episode reward: [(0, '-10.089')] [2022-07-13 04:08:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 160305152. Throughput: 0: 10484.6. Samples: 320606716. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:23,989][27935] Avg episode reward: [(0, '-9.752')] [2022-07-13 04:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 160330752. Throughput: 0: 10527.4. Samples: 320670500. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:28,990][27935] Avg episode reward: [(0, '-8.384')] [2022-07-13 04:08:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 160357376. Throughput: 0: 10525.2. Samples: 320733248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:33,989][27935] Avg episode reward: [(0, '-7.017')] [2022-07-13 04:08:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 160384000. Throughput: 0: 10509.0. Samples: 320764608. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:38,990][27935] Avg episode reward: [(0, '-8.799')] [2022-07-13 04:08:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 160409600. Throughput: 0: 10509.0. Samples: 320828020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:43,989][27935] Avg episode reward: [(0, '-10.952')] [2022-07-13 04:08:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 160436224. Throughput: 0: 10584.0. Samples: 320891212. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:48,989][27935] Avg episode reward: [(0, '-11.486')] [2022-07-13 04:08:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 160461824. Throughput: 0: 10582.5. Samples: 320923128. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:53,990][27935] Avg episode reward: [(0, '-11.350')] [2022-07-13 04:08:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 160489472. Throughput: 0: 10573.5. Samples: 320986868. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:08:58,990][27935] Avg episode reward: [(0, '-12.709')] [2022-07-13 04:09:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 160513024. Throughput: 0: 10489.1. Samples: 321046860. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:03,989][27935] Avg episode reward: [(0, '-12.501')] [2022-07-13 04:09:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 160539648. Throughput: 0: 10481.3. Samples: 321078376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:08,989][27935] Avg episode reward: [(0, '-11.034')] [2022-07-13 04:09:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 160567296. Throughput: 0: 10487.3. Samples: 321142428. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:13,990][27935] Avg episode reward: [(0, '-10.054')] [2022-07-13 04:09:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 160592896. Throughput: 0: 10508.6. Samples: 321206136. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:18,989][27935] Avg episode reward: [(0, '-9.586')] [2022-07-13 04:09:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 160619520. Throughput: 0: 10515.5. Samples: 321237808. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:23,989][27935] Avg episode reward: [(0, '-10.547')] [2022-07-13 04:09:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 160646144. Throughput: 0: 10522.8. Samples: 321301544. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:28,990][27935] Avg episode reward: [(0, '-11.137')] [2022-07-13 04:09:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 160671744. Throughput: 0: 10520.7. Samples: 321364644. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:33,989][27935] Avg episode reward: [(0, '-10.657')] [2022-07-13 04:09:38,993][27935] Fps is (10 sec: 5322.8, 60 sec: 5256.2, 300 sec: 5231.0). Total num frames: 160699392. Throughput: 0: 10513.3. Samples: 321396268. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:38,993][27935] Avg episode reward: [(0, '-10.587')] [2022-07-13 04:09:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 160724992. Throughput: 0: 10500.3. Samples: 321459380. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:43,990][27935] Avg episode reward: [(0, '-10.783')] [2022-07-13 04:09:48,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 160752640. Throughput: 0: 10572.3. Samples: 321522616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 04:09:48,990][27935] Avg episode reward: [(0, '-12.346')] [2022-07-13 04:09:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 160778240. Throughput: 0: 10580.8. Samples: 321554512. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:09:53,989][27935] Avg episode reward: [(0, '-12.071')] [2022-07-13 04:09:58,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 160802816. Throughput: 0: 10523.8. Samples: 321616000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:09:58,989][27935] Avg episode reward: [(0, '-11.759')] [2022-07-13 04:10:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 160826368. Throughput: 0: 10390.2. Samples: 321673696. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:03,989][27935] Avg episode reward: [(0, '-12.529')] [2022-07-13 04:10:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 160852992. Throughput: 0: 10388.8. Samples: 321705304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:08,989][27935] Avg episode reward: [(0, '-12.544')] [2022-07-13 04:10:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 160879616. Throughput: 0: 10391.5. Samples: 321769160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:13,989][27935] Avg episode reward: [(0, '-13.442')] [2022-07-13 04:10:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 160906240. Throughput: 0: 10399.9. Samples: 321832640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:18,989][27935] Avg episode reward: [(0, '-14.052')] [2022-07-13 04:10:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 160933888. Throughput: 0: 10395.8. Samples: 321864040. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:23,989][27935] Avg episode reward: [(0, '-12.730')] [2022-07-13 04:10:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 160958464. Throughput: 0: 10402.2. Samples: 321927480. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:28,989][27935] Avg episode reward: [(0, '-13.740')] [2022-07-13 04:10:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 160986112. Throughput: 0: 10403.5. Samples: 321990772. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:33,989][27935] Avg episode reward: [(0, '-12.209')] [2022-07-13 04:10:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.7, 300 sec: 5227.6). Total num frames: 161012736. Throughput: 0: 10396.3. Samples: 322022348. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:38,989][27935] Avg episode reward: [(0, '-11.648')] [2022-07-13 04:10:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 161037312. Throughput: 0: 10447.1. Samples: 322086120. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:43,990][27935] Avg episode reward: [(0, '-10.522')] [2022-07-13 04:10:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 161065984. Throughput: 0: 10570.4. Samples: 322149364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:48,989][27935] Avg episode reward: [(0, '-11.187')] [2022-07-13 04:10:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 161090560. Throughput: 0: 10561.4. Samples: 322180568. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:53,989][27935] Avg episode reward: [(0, '-11.917')] [2022-07-13 04:10:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 161117184. Throughput: 0: 10533.2. Samples: 322243152. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:10:58,989][27935] Avg episode reward: [(0, '-11.039')] [2022-07-13 04:11:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 161140736. Throughput: 0: 10401.3. Samples: 322300700. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:03,989][27935] Avg episode reward: [(0, '-11.414')] [2022-07-13 04:11:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 161166336. Throughput: 0: 10382.0. Samples: 322331228. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:08,989][27935] Avg episode reward: [(0, '-11.348')] [2022-07-13 04:11:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5210.2). Total num frames: 161189888. Throughput: 0: 10319.0. Samples: 322391836. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:13,989][27935] Avg episode reward: [(0, '-9.438')] [2022-07-13 04:11:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 161217536. Throughput: 0: 10284.1. Samples: 322453556. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:18,989][27935] Avg episode reward: [(0, '-10.053')] [2022-07-13 04:11:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 161243136. Throughput: 0: 10268.9. Samples: 322484448. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:23,993][27935] Avg episode reward: [(0, '-8.979')] [2022-07-13 04:11:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 161268736. Throughput: 0: 10248.1. Samples: 322547284. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:28,989][27935] Avg episode reward: [(0, '-8.905')] [2022-07-13 04:11:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 161295360. Throughput: 0: 10211.8. Samples: 322608896. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:33,989][27935] Avg episode reward: [(0, '-10.621')] [2022-07-13 04:11:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5217.2). Total num frames: 161320960. Throughput: 0: 10208.6. Samples: 322639956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:38,989][27935] Avg episode reward: [(0, '-11.566')] [2022-07-13 04:11:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 161347584. Throughput: 0: 10212.5. Samples: 322702712. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:43,989][27935] Avg episode reward: [(0, '-11.947')] [2022-07-13 04:11:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5217.2). Total num frames: 161373184. Throughput: 0: 10332.8. Samples: 322765676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:48,989][27935] Avg episode reward: [(0, '-11.651')] [2022-07-13 04:11:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 161399808. Throughput: 0: 10355.1. Samples: 322797208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:53,989][27935] Avg episode reward: [(0, '-11.821')] [2022-07-13 04:11:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5227.6). Total num frames: 161426432. Throughput: 0: 10406.2. Samples: 322860116. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 04:11:58,989][27935] Avg episode reward: [(0, '-10.532')] [2022-07-13 04:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5213.7). Total num frames: 161449984. Throughput: 0: 10339.6. Samples: 322918836. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:03,989][27935] Avg episode reward: [(0, '-9.458')] [2022-07-13 04:12:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5137.1, 300 sec: 5210.3). Total num frames: 161474560. Throughput: 0: 10347.5. Samples: 322950084. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:08,989][27935] Avg episode reward: [(0, '-9.295')] [2022-07-13 04:12:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 161503232. Throughput: 0: 10368.9. Samples: 323013884. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:13,991][27935] Avg episode reward: [(0, '-8.607')] [2022-07-13 04:12:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 161528832. Throughput: 0: 10382.4. Samples: 323076104. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:18,989][27935] Avg episode reward: [(0, '-7.895')] [2022-07-13 04:12:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 161553408. Throughput: 0: 10387.3. Samples: 323107384. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:23,989][27935] Avg episode reward: [(0, '-9.160')] [2022-07-13 04:12:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 161580032. Throughput: 0: 10389.8. Samples: 323170256. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:28,989][27935] Avg episode reward: [(0, '-7.562')] [2022-07-13 04:12:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 161606656. Throughput: 0: 10387.0. Samples: 323233092. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:33,989][27935] Avg episode reward: [(0, '-9.869')] [2022-07-13 04:12:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5210.2). Total num frames: 161632256. Throughput: 0: 10385.0. Samples: 323264532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:38,989][27935] Avg episode reward: [(0, '-9.597')] [2022-07-13 04:12:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 161658880. Throughput: 0: 10347.2. Samples: 323325740. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:43,989][27935] Avg episode reward: [(0, '-10.296')] [2022-07-13 04:12:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 161683456. Throughput: 0: 10444.2. Samples: 323388824. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:48,989][27935] Avg episode reward: [(0, '-11.027')] [2022-07-13 04:12:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 161711104. Throughput: 0: 10456.7. Samples: 323420636. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:53,989][27935] Avg episode reward: [(0, '-11.151')] [2022-07-13 04:12:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 161737728. Throughput: 0: 10436.6. Samples: 323483532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:12:58,990][27935] Avg episode reward: [(0, '-10.795')] [2022-07-13 04:13:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 161761280. Throughput: 0: 10368.6. Samples: 323542692. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:03,989][27935] Avg episode reward: [(0, '-11.635')] [2022-07-13 04:13:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 161787904. Throughput: 0: 10374.3. Samples: 323574228. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:08,991][27935] Avg episode reward: [(0, '-11.171')] [2022-07-13 04:13:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 161814528. Throughput: 0: 10390.9. Samples: 323637848. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:13,989][27935] Avg episode reward: [(0, '-10.048')] [2022-07-13 04:13:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 161841152. Throughput: 0: 10394.5. Samples: 323700844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:18,989][27935] Avg episode reward: [(0, '-10.502')] [2022-07-13 04:13:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 161866752. Throughput: 0: 10396.8. Samples: 323732388. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:23,989][27935] Avg episode reward: [(0, '-12.015')] [2022-07-13 04:13:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 161893376. Throughput: 0: 10430.2. Samples: 323795100. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:28,990][27935] Avg episode reward: [(0, '-13.846')] [2022-07-13 04:13:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 161917952. Throughput: 0: 10345.4. Samples: 323854368. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:33,989][27935] Avg episode reward: [(0, '-11.966')] [2022-07-13 04:13:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 161942528. Throughput: 0: 10296.2. Samples: 323883964. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:38,989][27935] Avg episode reward: [(0, '-12.208')] [2022-07-13 04:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 161967104. Throughput: 0: 10237.6. Samples: 323944224. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:43,989][27935] Avg episode reward: [(0, '-12.796')] [2022-07-13 04:13:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 161992704. Throughput: 0: 10249.9. Samples: 324003940. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:48,989][27935] Avg episode reward: [(0, '-12.533')] [2022-07-13 04:13:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 162017280. Throughput: 0: 10212.4. Samples: 324033788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:53,989][27935] Avg episode reward: [(0, '-12.358')] [2022-07-13 04:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5182.5). Total num frames: 162041856. Throughput: 0: 10155.2. Samples: 324094832. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:13:58,990][27935] Avg episode reward: [(0, '-11.585')] [2022-07-13 04:14:03,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 162067456. Throughput: 0: 10074.3. Samples: 324154188. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:14:03,991][27935] Avg episode reward: [(0, '-10.647')] [2022-07-13 04:14:08,990][27935] Fps is (10 sec: 5221.9, 60 sec: 5102.8, 300 sec: 5175.5). Total num frames: 162094080. Throughput: 0: 10072.1. Samples: 324185644. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 04:14:08,990][27935] Avg episode reward: [(0, '-9.707')] [2022-07-13 04:14:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 162120704. Throughput: 0: 10092.7. Samples: 324249272. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:13,990][27935] Avg episode reward: [(0, '-10.292')] [2022-07-13 04:14:18,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5085.9, 300 sec: 5175.5). Total num frames: 162146304. Throughput: 0: 10175.8. Samples: 324312280. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:18,989][27935] Avg episode reward: [(0, '-12.118')] [2022-07-13 04:14:23,991][27935] Fps is (10 sec: 5118.8, 60 sec: 5085.7, 300 sec: 5172.0). Total num frames: 162171904. Throughput: 0: 10223.5. Samples: 324344044. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:23,992][27935] Avg episode reward: [(0, '-11.740')] [2022-07-13 04:14:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 162199552. Throughput: 0: 10278.0. Samples: 324406732. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:28,989][27935] Avg episode reward: [(0, '-11.238')] [2022-07-13 04:14:33,989][27935] Fps is (10 sec: 5326.1, 60 sec: 5120.0, 300 sec: 5172.1). Total num frames: 162225152. Throughput: 0: 10345.2. Samples: 324469472. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:33,989][27935] Avg episode reward: [(0, '-10.618')] [2022-07-13 04:14:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 162251776. Throughput: 0: 10390.2. Samples: 324501348. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:38,989][27935] Avg episode reward: [(0, '-11.232')] [2022-07-13 04:14:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 162278400. Throughput: 0: 10442.0. Samples: 324564720. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:43,989][27935] Avg episode reward: [(0, '-10.764')] [2022-07-13 04:14:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 162304000. Throughput: 0: 10522.2. Samples: 324627688. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:48,990][27935] Avg episode reward: [(0, '-10.898')] [2022-07-13 04:14:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 162331648. Throughput: 0: 10529.6. Samples: 324659464. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:53,989][27935] Avg episode reward: [(0, '-12.140')] [2022-07-13 04:14:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 162356224. Throughput: 0: 10519.5. Samples: 324722648. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:14:58,990][27935] Avg episode reward: [(0, '-11.244')] [2022-07-13 04:15:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 162380800. Throughput: 0: 9818.6. Samples: 324754116. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:03,991][27935] Avg episode reward: [(0, '-11.309')] [2022-07-13 04:15:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.4, 300 sec: 5175.5). Total num frames: 162406400. Throughput: 0: 10434.8. Samples: 324813584. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:08,989][27935] Avg episode reward: [(0, '-11.756')] [2022-07-13 04:15:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 162435072. Throughput: 0: 10452.8. Samples: 324877108. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:13,989][27935] Avg episode reward: [(0, '-12.694')] [2022-07-13 04:15:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 162460672. Throughput: 0: 10462.7. Samples: 324940292. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:18,989][27935] Avg episode reward: [(0, '-12.592')] [2022-07-13 04:15:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.6, 300 sec: 5175.5). Total num frames: 162485248. Throughput: 0: 10454.6. Samples: 324971804. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:23,989][27935] Avg episode reward: [(0, '-12.249')] [2022-07-13 04:15:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 162512896. Throughput: 0: 10449.4. Samples: 325034944. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:28,989][27935] Avg episode reward: [(0, '-11.425')] [2022-07-13 04:15:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 162539520. Throughput: 0: 10440.0. Samples: 325097488. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:33,989][27935] Avg episode reward: [(0, '-11.743')] [2022-07-13 04:15:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 162565120. Throughput: 0: 10433.8. Samples: 325128984. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:38,990][27935] Avg episode reward: [(0, '-11.820')] [2022-07-13 04:15:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 162591744. Throughput: 0: 10434.6. Samples: 325192204. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:43,990][27935] Avg episode reward: [(0, '-10.986')] [2022-07-13 04:15:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 162617344. Throughput: 0: 11139.7. Samples: 325255404. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:48,991][27935] Avg episode reward: [(0, '-11.181')] [2022-07-13 04:15:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 162643968. Throughput: 0: 10516.5. Samples: 325286828. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:53,989][27935] Avg episode reward: [(0, '-11.396')] [2022-07-13 04:15:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 162669568. Throughput: 0: 10512.4. Samples: 325350164. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:15:58,989][27935] Avg episode reward: [(0, '-14.030')] [2022-07-13 04:16:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 162692096. Throughput: 0: 10368.4. Samples: 325406868. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:16:03,990][27935] Avg episode reward: [(0, '-13.570')] [2022-07-13 04:16:08,991][27935] Fps is (10 sec: 5118.6, 60 sec: 5239.2, 300 sec: 5189.4). Total num frames: 162720768. Throughput: 0: 10363.7. Samples: 325438200. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:16:09,001][27935] Avg episode reward: [(0, '-13.719')] [2022-07-13 04:16:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 162745344. Throughput: 0: 10359.2. Samples: 325501108. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 04:16:13,989][27935] Avg episode reward: [(0, '-13.301')] [2022-07-13 04:16:18,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 162772992. Throughput: 0: 9660.1. Samples: 325532192. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:18,989][27935] Avg episode reward: [(0, '-13.242')] [2022-07-13 04:16:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 162798592. Throughput: 0: 10337.8. Samples: 325594184. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:23,989][27935] Avg episode reward: [(0, '-11.459')] [2022-07-13 04:16:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 162824192. Throughput: 0: 10328.1. Samples: 325656968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:28,996][27935] Avg episode reward: [(0, '-8.858')] [2022-07-13 04:16:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 162849792. Throughput: 0: 10295.3. Samples: 325718692. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:33,989][27935] Avg episode reward: [(0, '-9.172')] [2022-07-13 04:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 162874368. Throughput: 0: 10294.1. Samples: 325750064. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:38,989][27935] Avg episode reward: [(0, '-8.507')] [2022-07-13 04:16:44,002][27935] Fps is (10 sec: 5317.6, 60 sec: 5187.1, 300 sec: 5185.7). Total num frames: 162903040. Throughput: 0: 10283.7. Samples: 325813068. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:44,003][27935] Avg episode reward: [(0, '-6.841')] [2022-07-13 04:16:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 162928640. Throughput: 0: 10417.3. Samples: 325875648. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:48,990][27935] Avg episode reward: [(0, '-7.493')] [2022-07-13 04:16:53,989][27935] Fps is (10 sec: 5126.9, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 162954240. Throughput: 0: 10426.7. Samples: 325907372. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:53,989][27935] Avg episode reward: [(0, '-8.078')] [2022-07-13 04:16:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 162979840. Throughput: 0: 10427.6. Samples: 325970348. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:16:58,989][27935] Avg episode reward: [(0, '-10.320')] [2022-07-13 04:17:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 163005440. Throughput: 0: 11039.1. Samples: 326028952. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:03,991][27935] Avg episode reward: [(0, '-10.195')] [2022-07-13 04:17:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.4, 300 sec: 5179.0). Total num frames: 163031040. Throughput: 0: 10360.4. Samples: 326060400. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:08,989][27935] Avg episode reward: [(0, '-9.298')] [2022-07-13 04:17:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 163057664. Throughput: 0: 10364.6. Samples: 326123376. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:13,989][27935] Avg episode reward: [(0, '-10.807')] [2022-07-13 04:17:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 163084288. Throughput: 0: 10393.1. Samples: 326186380. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:18,989][27935] Avg episode reward: [(0, '-11.703')] [2022-07-13 04:17:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 163109888. Throughput: 0: 10399.6. Samples: 326218044. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:23,989][27935] Avg episode reward: [(0, '-11.308')] [2022-07-13 04:17:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 163136512. Throughput: 0: 10405.4. Samples: 326281172. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:28,989][27935] Avg episode reward: [(0, '-11.601')] [2022-07-13 04:17:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 163162112. Throughput: 0: 10406.5. Samples: 326343940. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:33,989][27935] Avg episode reward: [(0, '-12.163')] [2022-07-13 04:17:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 163188736. Throughput: 0: 10411.9. Samples: 326375908. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:38,989][27935] Avg episode reward: [(0, '-14.188')] [2022-07-13 04:17:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5189.4, 300 sec: 5189.4). Total num frames: 163214336. Throughput: 0: 10389.2. Samples: 326437864. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:43,989][27935] Avg episode reward: [(0, '-15.142')] [2022-07-13 04:17:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 163240960. Throughput: 0: 10478.6. Samples: 326500488. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:48,989][27935] Avg episode reward: [(0, '-15.170')] [2022-07-13 04:17:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 163267584. Throughput: 0: 10487.7. Samples: 326532348. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:53,990][27935] Avg episode reward: [(0, '-13.948')] [2022-07-13 04:17:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 163293184. Throughput: 0: 10489.4. Samples: 326595400. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:17:58,989][27935] Avg episode reward: [(0, '-14.626')] [2022-07-13 04:18:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 163317760. Throughput: 0: 10405.7. Samples: 326654636. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:18:03,991][27935] Avg episode reward: [(0, '-14.422')] [2022-07-13 04:18:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 163343360. Throughput: 0: 10398.7. Samples: 326685984. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:18:08,990][27935] Avg episode reward: [(0, '-11.621')] [2022-07-13 04:18:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 163369984. Throughput: 0: 10408.4. Samples: 326749552. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:18:13,990][27935] Avg episode reward: [(0, '-10.780')] [2022-07-13 04:18:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 163396608. Throughput: 0: 9711.6. Samples: 326780960. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:18:18,989][27935] Avg episode reward: [(0, '-10.439')] [2022-07-13 04:18:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 163422208. Throughput: 0: 10417.2. Samples: 326844680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 04:18:23,989][27935] Avg episode reward: [(0, '-10.231')] [2022-07-13 04:18:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 163450880. Throughput: 0: 10451.7. Samples: 326908192. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:28,989][27935] Avg episode reward: [(0, '-7.918')] [2022-07-13 04:18:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 163474432. Throughput: 0: 10458.4. Samples: 326971116. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:33,989][27935] Avg episode reward: [(0, '-7.375')] [2022-07-13 04:18:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 163502080. Throughput: 0: 10451.1. Samples: 327002648. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:38,990][27935] Avg episode reward: [(0, '-6.246')] [2022-07-13 04:18:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 163527680. Throughput: 0: 10456.1. Samples: 327065924. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:43,989][27935] Avg episode reward: [(0, '-8.886')] [2022-07-13 04:18:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 163554304. Throughput: 0: 10548.5. Samples: 327129316. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:48,989][27935] Avg episode reward: [(0, '-9.878')] [2022-07-13 04:18:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 163581952. Throughput: 0: 10558.8. Samples: 327161132. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:53,989][27935] Avg episode reward: [(0, '-11.493')] [2022-07-13 04:18:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 163607552. Throughput: 0: 10544.7. Samples: 327224064. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:18:58,989][27935] Avg episode reward: [(0, '-12.444')] [2022-07-13 04:19:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 163631104. Throughput: 0: 11162.9. Samples: 327283292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:03,989][27935] Avg episode reward: [(0, '-12.972')] [2022-07-13 04:19:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5210.2). Total num frames: 163657728. Throughput: 0: 10444.5. Samples: 327314684. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:08,989][27935] Avg episode reward: [(0, '-14.629')] [2022-07-13 04:19:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 163684352. Throughput: 0: 10439.0. Samples: 327377948. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:13,990][27935] Avg episode reward: [(0, '-14.591')] [2022-07-13 04:19:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 163710976. Throughput: 0: 10452.3. Samples: 327441468. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:18,989][27935] Avg episode reward: [(0, '-12.723')] [2022-07-13 04:19:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5213.7). Total num frames: 163737600. Throughput: 0: 10458.1. Samples: 327473260. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:23,989][27935] Avg episode reward: [(0, '-12.300')] [2022-07-13 04:19:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 163764224. Throughput: 0: 10448.7. Samples: 327536116. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:28,990][27935] Avg episode reward: [(0, '-12.768')] [2022-07-13 04:19:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5213.7). Total num frames: 163789824. Throughput: 0: 10439.6. Samples: 327599100. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:33,989][27935] Avg episode reward: [(0, '-11.878')] [2022-07-13 04:19:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 163814400. Throughput: 0: 10423.0. Samples: 327630168. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:38,989][27935] Avg episode reward: [(0, '-10.894')] [2022-07-13 04:19:43,991][27935] Fps is (10 sec: 5221.5, 60 sec: 5239.3, 300 sec: 5213.7). Total num frames: 163842048. Throughput: 0: 10435.7. Samples: 327693688. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:43,992][27935] Avg episode reward: [(0, '-12.581')] [2022-07-13 04:19:48,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 163868672. Throughput: 0: 10516.9. Samples: 327756552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:48,989][27935] Avg episode reward: [(0, '-13.486')] [2022-07-13 04:19:53,989][27935] Fps is (10 sec: 5325.8, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 163895296. Throughput: 0: 10525.8. Samples: 327788344. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:53,989][27935] Avg episode reward: [(0, '-13.256')] [2022-07-13 04:19:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 163920896. Throughput: 0: 10514.8. Samples: 327851116. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:19:58,998][27935] Avg episode reward: [(0, '-13.148')] [2022-07-13 04:20:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 163945472. Throughput: 0: 10417.4. Samples: 327910252. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:03,989][27935] Avg episode reward: [(0, '-15.506')] [2022-07-13 04:20:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 163972096. Throughput: 0: 10408.2. Samples: 327941628. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:08,989][27935] Avg episode reward: [(0, '-16.711')] [2022-07-13 04:20:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 163998720. Throughput: 0: 10428.5. Samples: 328005396. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:13,989][27935] Avg episode reward: [(0, '-16.570')] [2022-07-13 04:20:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 164024320. Throughput: 0: 10431.0. Samples: 328068496. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:18,989][27935] Avg episode reward: [(0, '-13.651')] [2022-07-13 04:20:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 164050944. Throughput: 0: 10450.7. Samples: 328100448. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:23,989][27935] Avg episode reward: [(0, '-14.349')] [2022-07-13 04:20:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 164078592. Throughput: 0: 10448.8. Samples: 328163864. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 04:20:28,989][27935] Avg episode reward: [(0, '-13.676')] [2022-07-13 04:20:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 164102144. Throughput: 0: 10445.9. Samples: 328226620. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:33,989][27935] Avg episode reward: [(0, '-12.303')] [2022-07-13 04:20:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 164130816. Throughput: 0: 10433.8. Samples: 328257864. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:38,989][27935] Avg episode reward: [(0, '-12.081')] [2022-07-13 04:20:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.6, 300 sec: 5217.2). Total num frames: 164156416. Throughput: 0: 10438.3. Samples: 328320840. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:43,989][27935] Avg episode reward: [(0, '-12.408')] [2022-07-13 04:20:48,992][27935] Fps is (10 sec: 5118.5, 60 sec: 5222.1, 300 sec: 5213.7). Total num frames: 164182016. Throughput: 0: 10526.6. Samples: 328383980. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:48,992][27935] Avg episode reward: [(0, '-13.779')] [2022-07-13 04:20:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 164208640. Throughput: 0: 10541.5. Samples: 328415996. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:53,990][27935] Avg episode reward: [(0, '-14.445')] [2022-07-13 04:20:58,989][27935] Fps is (10 sec: 5326.3, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 164235264. Throughput: 0: 10528.8. Samples: 328479192. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:20:58,989][27935] Avg episode reward: [(0, '-14.130')] [2022-07-13 04:21:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 164259840. Throughput: 0: 10447.8. Samples: 328538648. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:03,991][27935] Avg episode reward: [(0, '-12.698')] [2022-07-13 04:21:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 164285440. Throughput: 0: 10436.7. Samples: 328570100. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:08,989][27935] Avg episode reward: [(0, '-13.092')] [2022-07-13 04:21:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 164311040. Throughput: 0: 10441.1. Samples: 328633716. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:13,989][27935] Avg episode reward: [(0, '-13.127')] [2022-07-13 04:21:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 164339712. Throughput: 0: 10436.0. Samples: 328696240. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:18,989][27935] Avg episode reward: [(0, '-12.822')] [2022-07-13 04:21:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 164364288. Throughput: 0: 10443.0. Samples: 328727800. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:23,989][27935] Avg episode reward: [(0, '-12.839')] [2022-07-13 04:21:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 164390912. Throughput: 0: 10450.4. Samples: 328791108. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:28,990][27935] Avg episode reward: [(0, '-12.384')] [2022-07-13 04:21:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 164416512. Throughput: 0: 10429.6. Samples: 328853284. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:33,990][27935] Avg episode reward: [(0, '-11.626')] [2022-07-13 04:21:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.9). Total num frames: 164443136. Throughput: 0: 10411.7. Samples: 328884524. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:38,989][27935] Avg episode reward: [(0, '-11.949')] [2022-07-13 04:21:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 164469760. Throughput: 0: 10414.2. Samples: 328947832. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:43,990][27935] Avg episode reward: [(0, '-12.779')] [2022-07-13 04:21:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.6, 300 sec: 5224.1). Total num frames: 164495360. Throughput: 0: 10491.5. Samples: 329010764. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:48,990][27935] Avg episode reward: [(0, '-12.649')] [2022-07-13 04:21:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 164521984. Throughput: 0: 10499.0. Samples: 329042556. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:53,992][27935] Avg episode reward: [(0, '-11.778')] [2022-07-13 04:21:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 164549632. Throughput: 0: 10489.4. Samples: 329105740. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:21:58,989][27935] Avg episode reward: [(0, '-11.038')] [2022-07-13 04:22:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 164573184. Throughput: 0: 10393.8. Samples: 329163960. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:03,989][27935] Avg episode reward: [(0, '-13.412')] [2022-07-13 04:22:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 164595712. Throughput: 0: 10363.0. Samples: 329194136. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:08,989][27935] Avg episode reward: [(0, '-13.473')] [2022-07-13 04:22:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 164624384. Throughput: 0: 10325.9. Samples: 329255772. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:13,989][27935] Avg episode reward: [(0, '-13.254')] [2022-07-13 04:22:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 164649984. Throughput: 0: 10351.3. Samples: 329319092. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:18,989][27935] Avg episode reward: [(0, '-15.046')] [2022-07-13 04:22:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 164676608. Throughput: 0: 10363.4. Samples: 329350876. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:23,989][27935] Avg episode reward: [(0, '-15.584')] [2022-07-13 04:22:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 164702208. Throughput: 0: 10361.6. Samples: 329414104. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:28,995][27935] Avg episode reward: [(0, '-16.472')] [2022-07-13 04:22:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 164727808. Throughput: 0: 10373.2. Samples: 329477556. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:33,989][27935] Avg episode reward: [(0, '-15.279')] [2022-07-13 04:22:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 164756480. Throughput: 0: 10369.3. Samples: 329509176. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 04:22:38,989][27935] Avg episode reward: [(0, '-12.817')] [2022-07-13 04:22:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 164781056. Throughput: 0: 10349.6. Samples: 329571472. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:22:43,989][27935] Avg episode reward: [(0, '-11.159')] [2022-07-13 04:22:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 164806656. Throughput: 0: 10462.8. Samples: 329634784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:22:48,989][27935] Avg episode reward: [(0, '-8.481')] [2022-07-13 04:22:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 164834304. Throughput: 0: 10504.1. Samples: 329666820. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:22:53,989][27935] Avg episode reward: [(0, '-8.185')] [2022-07-13 04:22:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 164860928. Throughput: 0: 10552.2. Samples: 329730620. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:22:58,989][27935] Avg episode reward: [(0, '-6.794')] [2022-07-13 04:23:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 164885504. Throughput: 0: 10470.2. Samples: 329790252. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:03,989][27935] Avg episode reward: [(0, '-10.139')] [2022-07-13 04:23:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 164912128. Throughput: 0: 10478.8. Samples: 329822420. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:08,990][27935] Avg episode reward: [(0, '-11.475')] [2022-07-13 04:23:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 164938752. Throughput: 0: 10479.5. Samples: 329885684. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:13,989][27935] Avg episode reward: [(0, '-12.386')] [2022-07-13 04:23:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 164964352. Throughput: 0: 10462.6. Samples: 329948372. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:18,989][27935] Avg episode reward: [(0, '-13.390')] [2022-07-13 04:23:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 164989952. Throughput: 0: 10469.2. Samples: 329980292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:23,990][27935] Avg episode reward: [(0, '-13.481')] [2022-07-13 04:23:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 165017600. Throughput: 0: 10499.6. Samples: 330043956. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:28,989][27935] Avg episode reward: [(0, '-15.150')] [2022-07-13 04:23:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 165044224. Throughput: 0: 10487.8. Samples: 330106736. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:33,991][27935] Avg episode reward: [(0, '-15.078')] [2022-07-13 04:23:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 165069824. Throughput: 0: 10473.3. Samples: 330138120. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:38,990][27935] Avg episode reward: [(0, '-14.661')] [2022-07-13 04:23:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 165096448. Throughput: 0: 10457.4. Samples: 330201204. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:43,989][27935] Avg episode reward: [(0, '-14.802')] [2022-07-13 04:23:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 165122048. Throughput: 0: 10526.7. Samples: 330263952. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:48,989][27935] Avg episode reward: [(0, '-14.465')] [2022-07-13 04:23:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 165149696. Throughput: 0: 10517.1. Samples: 330295688. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:53,989][27935] Avg episode reward: [(0, '-14.765')] [2022-07-13 04:23:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 165174272. Throughput: 0: 10525.6. Samples: 330359336. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:23:58,989][27935] Avg episode reward: [(0, '-13.660')] [2022-07-13 04:24:03,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5239.2, 300 sec: 5227.5). Total num frames: 165199872. Throughput: 0: 10464.3. Samples: 330419300. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:03,993][27935] Avg episode reward: [(0, '-11.316')] [2022-07-13 04:24:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 165225472. Throughput: 0: 10454.1. Samples: 330450724. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:08,989][27935] Avg episode reward: [(0, '-11.910')] [2022-07-13 04:24:13,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 165253120. Throughput: 0: 10451.5. Samples: 330514276. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:13,990][27935] Avg episode reward: [(0, '-12.223')] [2022-07-13 04:24:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 165278720. Throughput: 0: 10454.2. Samples: 330577176. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:18,989][27935] Avg episode reward: [(0, '-10.983')] [2022-07-13 04:24:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 165306368. Throughput: 0: 10468.4. Samples: 330609196. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:23,989][27935] Avg episode reward: [(0, '-12.313')] [2022-07-13 04:24:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 165331968. Throughput: 0: 10477.7. Samples: 330672700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:28,989][27935] Avg episode reward: [(0, '-13.150')] [2022-07-13 04:24:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 165358592. Throughput: 0: 10492.3. Samples: 330736104. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:33,989][27935] Avg episode reward: [(0, '-12.817')] [2022-07-13 04:24:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 165384192. Throughput: 0: 10483.7. Samples: 330767456. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:38,989][27935] Avg episode reward: [(0, '-13.335')] [2022-07-13 04:24:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 165409792. Throughput: 0: 10475.5. Samples: 330830732. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:43,989][27935] Avg episode reward: [(0, '-12.533')] [2022-07-13 04:24:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 165437440. Throughput: 0: 10543.0. Samples: 330893700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 04:24:48,989][27935] Avg episode reward: [(0, '-13.652')] [2022-07-13 04:24:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 165463040. Throughput: 0: 10542.1. Samples: 330925120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:24:53,989][27935] Avg episode reward: [(0, '-10.739')] [2022-07-13 04:24:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 165489664. Throughput: 0: 10542.5. Samples: 330988688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:24:58,989][27935] Avg episode reward: [(0, '-9.888')] [2022-07-13 04:25:03,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5222.5, 300 sec: 5224.1). Total num frames: 165513216. Throughput: 0: 10464.9. Samples: 331048116. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:03,991][27935] Avg episode reward: [(0, '-10.465')] [2022-07-13 04:25:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 165540864. Throughput: 0: 10454.0. Samples: 331079628. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:08,989][27935] Avg episode reward: [(0, '-10.830')] [2022-07-13 04:25:13,989][27935] Fps is (10 sec: 5530.7, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 165568512. Throughput: 0: 10462.6. Samples: 331143516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:13,989][27935] Avg episode reward: [(0, '-11.230')] [2022-07-13 04:25:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 165593088. Throughput: 0: 10457.9. Samples: 331206708. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:18,989][27935] Avg episode reward: [(0, '-9.341')] [2022-07-13 04:25:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 165619712. Throughput: 0: 10468.3. Samples: 331238528. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:23,989][27935] Avg episode reward: [(0, '-11.056')] [2022-07-13 04:25:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 165647360. Throughput: 0: 10482.1. Samples: 331302428. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:28,990][27935] Avg episode reward: [(0, '-10.967')] [2022-07-13 04:25:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 165672960. Throughput: 0: 10487.7. Samples: 331365648. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:33,990][27935] Avg episode reward: [(0, '-12.785')] [2022-07-13 04:25:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 165699584. Throughput: 0: 10489.8. Samples: 331397160. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:38,989][27935] Avg episode reward: [(0, '-13.022')] [2022-07-13 04:25:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 165725184. Throughput: 0: 10478.9. Samples: 331460240. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:43,990][27935] Avg episode reward: [(0, '-11.965')] [2022-07-13 04:25:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 165751808. Throughput: 0: 10559.2. Samples: 331523260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:48,989][27935] Avg episode reward: [(0, '-13.171')] [2022-07-13 04:25:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 165778432. Throughput: 0: 10546.9. Samples: 331554236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:53,989][27935] Avg episode reward: [(0, '-13.447')] [2022-07-13 04:25:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 165805056. Throughput: 0: 10552.0. Samples: 331618356. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:25:58,989][27935] Avg episode reward: [(0, '-13.191')] [2022-07-13 04:26:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5273.8, 300 sec: 5234.5). Total num frames: 165829632. Throughput: 0: 10458.8. Samples: 331677352. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:03,989][27935] Avg episode reward: [(0, '-12.361')] [2022-07-13 04:26:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5234.6). Total num frames: 165855232. Throughput: 0: 10451.7. Samples: 331708856. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:08,989][27935] Avg episode reward: [(0, '-10.418')] [2022-07-13 04:26:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 165880832. Throughput: 0: 10435.4. Samples: 331772020. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:13,989][27935] Avg episode reward: [(0, '-11.753')] [2022-07-13 04:26:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 165907456. Throughput: 0: 10438.1. Samples: 331835364. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:18,989][27935] Avg episode reward: [(0, '-14.700')] [2022-07-13 04:26:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 165935104. Throughput: 0: 10452.4. Samples: 331867516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:23,992][27935] Avg episode reward: [(0, '-13.294')] [2022-07-13 04:26:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 165961728. Throughput: 0: 10454.8. Samples: 331930704. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:28,989][27935] Avg episode reward: [(0, '-12.585')] [2022-07-13 04:26:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 165986304. Throughput: 0: 10460.5. Samples: 331993980. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:33,989][27935] Avg episode reward: [(0, '-12.993')] [2022-07-13 04:26:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 166013952. Throughput: 0: 10467.0. Samples: 332025252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:38,989][27935] Avg episode reward: [(0, '-14.092')] [2022-07-13 04:26:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 166039552. Throughput: 0: 10454.0. Samples: 332088788. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:43,989][27935] Avg episode reward: [(0, '-12.556')] [2022-07-13 04:26:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 166066176. Throughput: 0: 10549.0. Samples: 332152056. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:48,989][27935] Avg episode reward: [(0, '-12.745')] [2022-07-13 04:26:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 166093824. Throughput: 0: 10560.5. Samples: 332184080. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 04:26:53,989][27935] Avg episode reward: [(0, '-13.191')] [2022-07-13 04:26:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 166119424. Throughput: 0: 10570.3. Samples: 332247684. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:26:58,989][27935] Avg episode reward: [(0, '-15.111')] [2022-07-13 04:27:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 166144000. Throughput: 0: 10491.5. Samples: 332307480. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:03,989][27935] Avg episode reward: [(0, '-15.257')] [2022-07-13 04:27:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 166169600. Throughput: 0: 10480.8. Samples: 332339152. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:08,989][27935] Avg episode reward: [(0, '-14.185')] [2022-07-13 04:27:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 166196224. Throughput: 0: 10480.9. Samples: 332402344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:13,989][27935] Avg episode reward: [(0, '-13.343')] [2022-07-13 04:27:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 166222848. Throughput: 0: 10472.0. Samples: 332465220. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:18,989][27935] Avg episode reward: [(0, '-13.475')] [2022-07-13 04:27:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 166249472. Throughput: 0: 10488.1. Samples: 332497216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:23,989][27935] Avg episode reward: [(0, '-12.087')] [2022-07-13 04:27:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 166275072. Throughput: 0: 10469.6. Samples: 332559920. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:28,990][27935] Avg episode reward: [(0, '-13.331')] [2022-07-13 04:27:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 166300672. Throughput: 0: 10449.0. Samples: 332622260. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:33,989][27935] Avg episode reward: [(0, '-13.216')] [2022-07-13 04:27:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 166328320. Throughput: 0: 10435.2. Samples: 332653664. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:38,990][27935] Avg episode reward: [(0, '-15.526')] [2022-07-13 04:27:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 166352896. Throughput: 0: 10389.8. Samples: 332715224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:43,989][27935] Avg episode reward: [(0, '-15.084')] [2022-07-13 04:27:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 166379520. Throughput: 0: 10457.9. Samples: 332778088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:48,989][27935] Avg episode reward: [(0, '-14.106')] [2022-07-13 04:27:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5234.5). Total num frames: 166405120. Throughput: 0: 10448.4. Samples: 332809328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:53,990][27935] Avg episode reward: [(0, '-14.014')] [2022-07-13 04:27:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 166432768. Throughput: 0: 10450.0. Samples: 332872592. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:27:58,990][27935] Avg episode reward: [(0, '-12.520')] [2022-07-13 04:28:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 166455296. Throughput: 0: 10378.6. Samples: 332932256. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:03,990][27935] Avg episode reward: [(0, '-11.976')] [2022-07-13 04:28:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 166481920. Throughput: 0: 10361.3. Samples: 332963476. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:08,990][27935] Avg episode reward: [(0, '-10.692')] [2022-07-13 04:28:13,991][27935] Fps is (10 sec: 5221.0, 60 sec: 5188.0, 300 sec: 5231.0). Total num frames: 166507520. Throughput: 0: 10300.0. Samples: 333023448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:13,992][27935] Avg episode reward: [(0, '-10.238')] [2022-07-13 04:28:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5234.5). Total num frames: 166534144. Throughput: 0: 10293.6. Samples: 333085472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:18,989][27935] Avg episode reward: [(0, '-10.311')] [2022-07-13 04:28:23,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5154.1, 300 sec: 5224.1). Total num frames: 166558720. Throughput: 0: 10293.2. Samples: 333116856. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:23,989][27935] Avg episode reward: [(0, '-7.998')] [2022-07-13 04:28:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5220.7). Total num frames: 166584320. Throughput: 0: 10337.6. Samples: 333180416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:28,989][27935] Avg episode reward: [(0, '-9.260')] [2022-07-13 04:28:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 166612992. Throughput: 0: 10330.2. Samples: 333242948. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:33,989][27935] Avg episode reward: [(0, '-10.117')] [2022-07-13 04:28:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5224.1). Total num frames: 166637568. Throughput: 0: 10321.4. Samples: 333273792. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:38,989][27935] Avg episode reward: [(0, '-9.898')] [2022-07-13 04:28:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 166663168. Throughput: 0: 10309.1. Samples: 333336500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:43,989][27935] Avg episode reward: [(0, '-9.890')] [2022-07-13 04:28:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 166688768. Throughput: 0: 10358.4. Samples: 333398384. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:48,989][27935] Avg episode reward: [(0, '-10.333')] [2022-07-13 04:28:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 166715392. Throughput: 0: 10358.9. Samples: 333429628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:53,989][27935] Avg episode reward: [(0, '-11.714')] [2022-07-13 04:28:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5224.2). Total num frames: 166740992. Throughput: 0: 10424.6. Samples: 333492528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:28:58,991][27935] Avg episode reward: [(0, '-10.537')] [2022-07-13 04:29:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 166765568. Throughput: 0: 10339.6. Samples: 333550752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 04:29:03,989][27935] Avg episode reward: [(0, '-10.516')] [2022-07-13 04:29:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 166792192. Throughput: 0: 10341.9. Samples: 333582244. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:08,989][27935] Avg episode reward: [(0, '-10.168')] [2022-07-13 04:29:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.4, 300 sec: 5217.2). Total num frames: 166817792. Throughput: 0: 10323.8. Samples: 333644988. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:13,990][27935] Avg episode reward: [(0, '-10.285')] [2022-07-13 04:29:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 166844416. Throughput: 0: 10321.1. Samples: 333707400. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:18,989][27935] Avg episode reward: [(0, '-9.660')] [2022-07-13 04:29:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 166870016. Throughput: 0: 10334.0. Samples: 333738824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:23,989][27935] Avg episode reward: [(0, '-7.814')] [2022-07-13 04:29:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 166896640. Throughput: 0: 10326.3. Samples: 333801184. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:28,989][27935] Avg episode reward: [(0, '-9.582')] [2022-07-13 04:29:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5210.3). Total num frames: 166921216. Throughput: 0: 10334.7. Samples: 333863444. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:33,999][27935] Avg episode reward: [(0, '-9.432')] [2022-07-13 04:29:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 166948864. Throughput: 0: 10329.6. Samples: 333894460. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:38,989][27935] Avg episode reward: [(0, '-9.907')] [2022-07-13 04:29:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 166973440. Throughput: 0: 10317.1. Samples: 333956796. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:43,989][27935] Avg episode reward: [(0, '-9.069')] [2022-07-13 04:29:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 167000064. Throughput: 0: 10404.4. Samples: 334018952. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:48,989][27935] Avg episode reward: [(0, '-10.154')] [2022-07-13 04:29:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 167024640. Throughput: 0: 10383.6. Samples: 334049504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:53,989][27935] Avg episode reward: [(0, '-10.641')] [2022-07-13 04:29:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5213.8). Total num frames: 167051264. Throughput: 0: 10369.9. Samples: 334111632. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:29:58,989][27935] Avg episode reward: [(0, '-11.507')] [2022-07-13 04:30:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 167075840. Throughput: 0: 10266.2. Samples: 334169380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:03,989][27935] Avg episode reward: [(0, '-10.708')] [2022-07-13 04:30:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 167100416. Throughput: 0: 10258.8. Samples: 334200468. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:08,990][27935] Avg episode reward: [(0, '-11.284')] [2022-07-13 04:30:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5192.9). Total num frames: 167124992. Throughput: 0: 10249.7. Samples: 334262420. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:13,991][27935] Avg episode reward: [(0, '-11.611')] [2022-07-13 04:30:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 167153664. Throughput: 0: 10244.3. Samples: 334324436. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:18,990][27935] Avg episode reward: [(0, '-12.091')] [2022-07-13 04:30:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 167178240. Throughput: 0: 10252.8. Samples: 334355836. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:23,990][27935] Avg episode reward: [(0, '-11.892')] [2022-07-13 04:30:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 167204864. Throughput: 0: 10259.3. Samples: 334418464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:28,989][27935] Avg episode reward: [(0, '-11.613')] [2022-07-13 04:30:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 167229440. Throughput: 0: 10248.8. Samples: 334480148. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:33,989][27935] Avg episode reward: [(0, '-11.069')] [2022-07-13 04:30:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 167257088. Throughput: 0: 10257.7. Samples: 334511100. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:38,989][27935] Avg episode reward: [(0, '-11.835')] [2022-07-13 04:30:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 167281664. Throughput: 0: 10256.5. Samples: 334573176. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:43,989][27935] Avg episode reward: [(0, '-11.345')] [2022-07-13 04:30:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 167307264. Throughput: 0: 10348.7. Samples: 334635072. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:48,991][27935] Avg episode reward: [(0, '-11.150')] [2022-07-13 04:30:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 167332864. Throughput: 0: 10338.9. Samples: 334665720. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:53,989][27935] Avg episode reward: [(0, '-9.959')] [2022-07-13 04:30:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 167360512. Throughput: 0: 10347.9. Samples: 334728076. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:30:58,989][27935] Avg episode reward: [(0, '-11.383')] [2022-07-13 04:31:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5175.5). Total num frames: 167382016. Throughput: 0: 10262.6. Samples: 334786252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:31:03,989][27935] Avg episode reward: [(0, '-11.488')] [2022-07-13 04:31:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 167409664. Throughput: 0: 10263.4. Samples: 334817688. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:31:08,989][27935] Avg episode reward: [(0, '-11.053')] [2022-07-13 04:31:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 167435264. Throughput: 0: 10259.9. Samples: 334880160. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 04:31:13,990][27935] Avg episode reward: [(0, '-10.085')] [2022-07-13 04:31:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5175.5). Total num frames: 167461888. Throughput: 0: 10270.2. Samples: 334942308. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:18,989][27935] Avg episode reward: [(0, '-10.071')] [2022-07-13 04:31:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5165.1). Total num frames: 167485440. Throughput: 0: 10263.7. Samples: 334972968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:23,989][27935] Avg episode reward: [(0, '-10.601')] [2022-07-13 04:31:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5175.5). Total num frames: 167513088. Throughput: 0: 10274.5. Samples: 335035528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:28,990][27935] Avg episode reward: [(0, '-12.384')] [2022-07-13 04:31:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 167539712. Throughput: 0: 9577.0. Samples: 335066036. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:33,995][27935] Avg episode reward: [(0, '-11.123')] [2022-07-13 04:31:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 167565312. Throughput: 0: 10300.6. Samples: 335129248. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:38,989][27935] Avg episode reward: [(0, '-11.760')] [2022-07-13 04:31:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 167591936. Throughput: 0: 10317.0. Samples: 335192340. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:43,989][27935] Avg episode reward: [(0, '-12.122')] [2022-07-13 04:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 167616512. Throughput: 0: 10416.3. Samples: 335254988. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:48,989][27935] Avg episode reward: [(0, '-11.317')] [2022-07-13 04:31:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 167644160. Throughput: 0: 10400.5. Samples: 335285712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:53,989][27935] Avg episode reward: [(0, '-11.749')] [2022-07-13 04:31:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 167669760. Throughput: 0: 10407.0. Samples: 335348472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:31:58,991][27935] Avg episode reward: [(0, '-10.154')] [2022-07-13 04:32:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 167694336. Throughput: 0: 10335.2. Samples: 335407392. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:03,989][27935] Avg episode reward: [(0, '-11.072')] [2022-07-13 04:32:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 167720960. Throughput: 0: 10361.2. Samples: 335439220. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:08,989][27935] Avg episode reward: [(0, '-11.322')] [2022-07-13 04:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 167746560. Throughput: 0: 10376.8. Samples: 335502484. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:13,991][27935] Avg episode reward: [(0, '-12.135')] [2022-07-13 04:32:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5161.7). Total num frames: 167772160. Throughput: 0: 11095.1. Samples: 335565316. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:18,991][27935] Avg episode reward: [(0, '-13.451')] [2022-07-13 04:32:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5168.6). Total num frames: 167799808. Throughput: 0: 10382.8. Samples: 335596472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:23,989][27935] Avg episode reward: [(0, '-13.471')] [2022-07-13 04:32:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 167825408. Throughput: 0: 10379.0. Samples: 335659396. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:28,990][27935] Avg episode reward: [(0, '-13.329')] [2022-07-13 04:32:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5161.7). Total num frames: 167851008. Throughput: 0: 10383.0. Samples: 335722224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:33,989][27935] Avg episode reward: [(0, '-12.903')] [2022-07-13 04:32:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5161.7). Total num frames: 167875584. Throughput: 0: 10393.5. Samples: 335753420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:38,989][27935] Avg episode reward: [(0, '-9.662')] [2022-07-13 04:32:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 167904256. Throughput: 0: 10367.8. Samples: 335815024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:43,989][27935] Avg episode reward: [(0, '-10.522')] [2022-07-13 04:32:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 167928832. Throughput: 0: 9756.3. Samples: 335846424. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:48,989][27935] Avg episode reward: [(0, '-9.312')] [2022-07-13 04:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 167954432. Throughput: 0: 10436.7. Samples: 335908872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:53,992][27935] Avg episode reward: [(0, '-9.481')] [2022-07-13 04:32:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 167982080. Throughput: 0: 10441.4. Samples: 335972348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:32:58,990][27935] Avg episode reward: [(0, '-10.522')] [2022-07-13 04:33:03,991][27935] Fps is (10 sec: 5221.4, 60 sec: 5205.2, 300 sec: 5168.6). Total num frames: 168006656. Throughput: 0: 9750.3. Samples: 336004100. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:33:03,992][27935] Avg episode reward: [(0, '-8.503')] [2022-07-13 04:33:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 168032256. Throughput: 0: 10374.0. Samples: 336063304. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:33:08,989][27935] Avg episode reward: [(0, '-8.522')] [2022-07-13 04:33:13,989][27935] Fps is (10 sec: 5121.0, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 168057856. Throughput: 0: 10383.0. Samples: 336126632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:33:13,990][27935] Avg episode reward: [(0, '-9.224')] [2022-07-13 04:33:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5179.0). Total num frames: 168086528. Throughput: 0: 10390.2. Samples: 336189784. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:33:18,989][27935] Avg episode reward: [(0, '-11.177')] [2022-07-13 04:33:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 168111104. Throughput: 0: 10397.5. Samples: 336221308. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 04:33:23,989][27935] Avg episode reward: [(0, '-10.123')] [2022-07-13 04:33:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 168136704. Throughput: 0: 10421.9. Samples: 336284012. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:28,989][27935] Avg episode reward: [(0, '-9.993')] [2022-07-13 04:33:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 168162304. Throughput: 0: 11101.8. Samples: 336346004. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:33,989][27935] Avg episode reward: [(0, '-11.384')] [2022-07-13 04:33:38,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 168188928. Throughput: 0: 10401.4. Samples: 336376936. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:38,989][27935] Avg episode reward: [(0, '-12.258')] [2022-07-13 04:33:43,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5188.2, 300 sec: 5175.5). Total num frames: 168215552. Throughput: 0: 10390.7. Samples: 336439932. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:43,990][27935] Avg episode reward: [(0, '-11.624')] [2022-07-13 04:33:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 168242176. Throughput: 0: 11082.9. Samples: 336502808. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:48,991][27935] Avg episode reward: [(0, '-11.295')] [2022-07-13 04:33:53,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 168266752. Throughput: 0: 10451.4. Samples: 336533616. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:53,989][27935] Avg episode reward: [(0, '-13.657')] [2022-07-13 04:33:58,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5188.2, 300 sec: 5179.0). Total num frames: 168293376. Throughput: 0: 10422.2. Samples: 336595632. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:33:58,990][27935] Avg episode reward: [(0, '-14.053')] [2022-07-13 04:34:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.4, 300 sec: 5172.1). Total num frames: 168317952. Throughput: 0: 10317.5. Samples: 336654072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:03,991][27935] Avg episode reward: [(0, '-14.684')] [2022-07-13 04:34:08,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 168344576. Throughput: 0: 10305.2. Samples: 336685044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:08,989][27935] Avg episode reward: [(0, '-14.664')] [2022-07-13 04:34:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 168368128. Throughput: 0: 10269.3. Samples: 336746128. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:13,991][27935] Avg episode reward: [(0, '-15.598')] [2022-07-13 04:34:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 168394752. Throughput: 0: 10229.8. Samples: 336806344. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:18,989][27935] Avg episode reward: [(0, '-14.411')] [2022-07-13 04:34:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 168419328. Throughput: 0: 10233.1. Samples: 336837424. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:23,989][27935] Avg episode reward: [(0, '-13.350')] [2022-07-13 04:34:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 168444928. Throughput: 0: 10211.5. Samples: 336899448. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:28,989][27935] Avg episode reward: [(0, '-13.892')] [2022-07-13 04:34:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 168471552. Throughput: 0: 10190.9. Samples: 336961400. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:33,990][27935] Avg episode reward: [(0, '-13.004')] [2022-07-13 04:34:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 168496128. Throughput: 0: 10185.9. Samples: 336991980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:38,989][27935] Avg episode reward: [(0, '-12.160')] [2022-07-13 04:34:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 168523776. Throughput: 0: 10190.1. Samples: 337054184. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:43,989][27935] Avg episode reward: [(0, '-12.565')] [2022-07-13 04:34:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5165.1). Total num frames: 168548352. Throughput: 0: 10268.8. Samples: 337116168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:48,989][27935] Avg episode reward: [(0, '-12.292')] [2022-07-13 04:34:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 168573952. Throughput: 0: 10275.5. Samples: 337147440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:53,989][27935] Avg episode reward: [(0, '-12.688')] [2022-07-13 04:34:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5168.6). Total num frames: 168600576. Throughput: 0: 10300.4. Samples: 337209648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:34:58,990][27935] Avg episode reward: [(0, '-11.767')] [2022-07-13 04:35:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5165.1). Total num frames: 168624128. Throughput: 0: 10263.3. Samples: 337268192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:03,989][27935] Avg episode reward: [(0, '-11.456')] [2022-07-13 04:35:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5175.5). Total num frames: 168651776. Throughput: 0: 10269.5. Samples: 337299552. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:08,989][27935] Avg episode reward: [(0, '-12.186')] [2022-07-13 04:35:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 168676352. Throughput: 0: 10279.9. Samples: 337362044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:13,989][27935] Avg episode reward: [(0, '-12.235')] [2022-07-13 04:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5165.1). Total num frames: 168701952. Throughput: 0: 9589.5. Samples: 337392928. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:18,989][27935] Avg episode reward: [(0, '-15.168')] [2022-07-13 04:35:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 168728576. Throughput: 0: 10308.6. Samples: 337455868. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:23,989][27935] Avg episode reward: [(0, '-13.917')] [2022-07-13 04:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 168754176. Throughput: 0: 10306.3. Samples: 337517968. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:35:28,989][27935] Avg episode reward: [(0, '-12.915')] [2022-07-13 04:35:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 168779776. Throughput: 0: 10313.2. Samples: 337580264. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:33,989][27935] Avg episode reward: [(0, '-14.407')] [2022-07-13 04:35:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 168805376. Throughput: 0: 10297.9. Samples: 337610844. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:38,989][27935] Avg episode reward: [(0, '-13.390')] [2022-07-13 04:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 168832000. Throughput: 0: 10316.0. Samples: 337673868. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:43,989][27935] Avg episode reward: [(0, '-11.884')] [2022-07-13 04:35:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 168857600. Throughput: 0: 10423.9. Samples: 337737268. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:48,989][27935] Avg episode reward: [(0, '-11.289')] [2022-07-13 04:35:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 168885248. Throughput: 0: 10433.9. Samples: 337769076. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:53,989][27935] Avg episode reward: [(0, '-9.367')] [2022-07-13 04:35:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 168911872. Throughput: 0: 10443.6. Samples: 337832004. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:35:58,989][27935] Avg episode reward: [(0, '-11.141')] [2022-07-13 04:36:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 168935424. Throughput: 0: 11070.0. Samples: 337891076. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:03,989][27935] Avg episode reward: [(0, '-10.487')] [2022-07-13 04:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 168962048. Throughput: 0: 10349.1. Samples: 337921576. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:08,989][27935] Avg episode reward: [(0, '-9.522')] [2022-07-13 04:36:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 168986624. Throughput: 0: 10350.7. Samples: 337983752. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:13,989][27935] Avg episode reward: [(0, '-10.072')] [2022-07-13 04:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 169013248. Throughput: 0: 10334.9. Samples: 338045336. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:18,991][27935] Avg episode reward: [(0, '-10.423')] [2022-07-13 04:36:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 169038848. Throughput: 0: 10343.6. Samples: 338076304. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:23,989][27935] Avg episode reward: [(0, '-11.772')] [2022-07-13 04:36:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 169064448. Throughput: 0: 10306.4. Samples: 338137656. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:28,991][27935] Avg episode reward: [(0, '-11.799')] [2022-07-13 04:36:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 169089024. Throughput: 0: 10275.9. Samples: 338199684. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:33,989][27935] Avg episode reward: [(0, '-11.134')] [2022-07-13 04:36:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 169115648. Throughput: 0: 10246.5. Samples: 338230168. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:38,990][27935] Avg episode reward: [(0, '-13.157')] [2022-07-13 04:36:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 169141248. Throughput: 0: 10234.0. Samples: 338292536. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:43,989][27935] Avg episode reward: [(0, '-11.933')] [2022-07-13 04:36:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 169167872. Throughput: 0: 10303.6. Samples: 338354736. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:48,989][27935] Avg episode reward: [(0, '-13.655')] [2022-07-13 04:36:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 169193472. Throughput: 0: 10316.4. Samples: 338385816. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:53,989][27935] Avg episode reward: [(0, '-12.399')] [2022-07-13 04:36:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 169220096. Throughput: 0: 10328.0. Samples: 338448512. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:36:58,990][27935] Avg episode reward: [(0, '-12.552')] [2022-07-13 04:37:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 169245696. Throughput: 0: 10253.0. Samples: 338506720. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:03,991][27935] Avg episode reward: [(0, '-10.599')] [2022-07-13 04:37:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 169269248. Throughput: 0: 10269.3. Samples: 338538424. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:08,989][27935] Avg episode reward: [(0, '-10.467')] [2022-07-13 04:37:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 169297920. Throughput: 0: 10320.7. Samples: 338602088. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:13,989][27935] Avg episode reward: [(0, '-11.473')] [2022-07-13 04:37:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 169322496. Throughput: 0: 10337.2. Samples: 338664860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:18,989][27935] Avg episode reward: [(0, '-11.672')] [2022-07-13 04:37:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 169350144. Throughput: 0: 10366.3. Samples: 338696652. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:23,989][27935] Avg episode reward: [(0, '-10.797')] [2022-07-13 04:37:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 169373696. Throughput: 0: 10368.0. Samples: 338759096. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:28,989][27935] Avg episode reward: [(0, '-11.067')] [2022-07-13 04:37:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 169401344. Throughput: 0: 10379.1. Samples: 338821796. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:33,989][27935] Avg episode reward: [(0, '-10.145')] [2022-07-13 04:37:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 169427968. Throughput: 0: 10384.7. Samples: 338853128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 04:37:38,989][27935] Avg episode reward: [(0, '-9.772')] [2022-07-13 04:37:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 169453568. Throughput: 0: 10368.8. Samples: 338915108. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:37:43,990][27935] Avg episode reward: [(0, '-10.551')] [2022-07-13 04:37:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 169479168. Throughput: 0: 10477.9. Samples: 338978224. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:37:48,989][27935] Avg episode reward: [(0, '-11.445')] [2022-07-13 04:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 169505792. Throughput: 0: 10482.5. Samples: 339010136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:37:53,990][27935] Avg episode reward: [(0, '-10.479')] [2022-07-13 04:37:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 169532416. Throughput: 0: 10471.3. Samples: 339073296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:37:58,989][27935] Avg episode reward: [(0, '-8.645')] [2022-07-13 04:38:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 169555968. Throughput: 0: 10391.5. Samples: 339132476. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:03,989][27935] Avg episode reward: [(0, '-10.158')] [2022-07-13 04:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5168.6). Total num frames: 169582592. Throughput: 0: 10386.6. Samples: 339164048. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:08,990][27935] Avg episode reward: [(0, '-12.345')] [2022-07-13 04:38:13,998][27935] Fps is (10 sec: 5217.5, 60 sec: 5170.4, 300 sec: 5158.0). Total num frames: 169608192. Throughput: 0: 10397.4. Samples: 339227076. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:13,999][27935] Avg episode reward: [(0, '-9.046')] [2022-07-13 04:38:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5168.6). Total num frames: 169635840. Throughput: 0: 10397.7. Samples: 339289692. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:18,989][27935] Avg episode reward: [(0, '-8.794')] [2022-07-13 04:38:23,989][27935] Fps is (10 sec: 5432.3, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 169662464. Throughput: 0: 10405.5. Samples: 339321376. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:23,989][27935] Avg episode reward: [(0, '-9.322')] [2022-07-13 04:38:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5172.1). Total num frames: 169688064. Throughput: 0: 10438.4. Samples: 339384836. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:28,990][27935] Avg episode reward: [(0, '-9.127')] [2022-07-13 04:38:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 169713664. Throughput: 0: 10432.9. Samples: 339447704. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:33,989][27935] Avg episode reward: [(0, '-10.478')] [2022-07-13 04:38:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 169741312. Throughput: 0: 10421.4. Samples: 339479100. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:38,989][27935] Avg episode reward: [(0, '-7.840')] [2022-07-13 04:38:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5168.6). Total num frames: 169766912. Throughput: 0: 10435.7. Samples: 339542904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:43,989][27935] Avg episode reward: [(0, '-8.866')] [2022-07-13 04:38:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 169793536. Throughput: 0: 10534.5. Samples: 339606528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:48,989][27935] Avg episode reward: [(0, '-9.427')] [2022-07-13 04:38:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5175.5). Total num frames: 169820160. Throughput: 0: 10540.7. Samples: 339638380. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:53,989][27935] Avg episode reward: [(0, '-10.259')] [2022-07-13 04:38:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 169846784. Throughput: 0: 10548.1. Samples: 339701640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:38:58,998][27935] Avg episode reward: [(0, '-10.776')] [2022-07-13 04:39:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5172.1). Total num frames: 169870336. Throughput: 0: 10461.3. Samples: 339760452. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:03,989][27935] Avg episode reward: [(0, '-11.727')] [2022-07-13 04:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 169895936. Throughput: 0: 10465.2. Samples: 339792312. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:08,989][27935] Avg episode reward: [(0, '-11.972')] [2022-07-13 04:39:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5257.4, 300 sec: 5182.5). Total num frames: 169923584. Throughput: 0: 10478.0. Samples: 339856348. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:13,989][27935] Avg episode reward: [(0, '-10.777')] [2022-07-13 04:39:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 169950208. Throughput: 0: 10494.2. Samples: 339919944. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:18,989][27935] Avg episode reward: [(0, '-11.302')] [2022-07-13 04:39:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 169976832. Throughput: 0: 10508.5. Samples: 339951984. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:23,989][27935] Avg episode reward: [(0, '-12.859')] [2022-07-13 04:39:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5189.4). Total num frames: 170002432. Throughput: 0: 10496.8. Samples: 340015260. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:28,989][27935] Avg episode reward: [(0, '-13.926')] [2022-07-13 04:39:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5199.8). Total num frames: 170030080. Throughput: 0: 10483.1. Samples: 340078268. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:33,989][27935] Avg episode reward: [(0, '-15.720')] [2022-07-13 04:39:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 170055680. Throughput: 0: 10472.6. Samples: 340109648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:38,989][27935] Avg episode reward: [(0, '-15.078')] [2022-07-13 04:39:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5199.8). Total num frames: 170082304. Throughput: 0: 10475.2. Samples: 340173024. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:43,989][27935] Avg episode reward: [(0, '-15.631')] [2022-07-13 04:39:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5203.3). Total num frames: 170108928. Throughput: 0: 10586.9. Samples: 340236864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 04:39:48,989][27935] Avg episode reward: [(0, '-15.818')] [2022-07-13 04:39:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5206.8). Total num frames: 170136576. Throughput: 0: 10598.3. Samples: 340269236. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:39:53,989][27935] Avg episode reward: [(0, '-14.769')] [2022-07-13 04:39:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5210.2). Total num frames: 170161152. Throughput: 0: 10583.2. Samples: 340332592. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:39:58,989][27935] Avg episode reward: [(0, '-12.936')] [2022-07-13 04:40:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5256.5, 300 sec: 5199.8). Total num frames: 170185728. Throughput: 0: 10486.8. Samples: 340391848. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:03,989][27935] Avg episode reward: [(0, '-9.564')] [2022-07-13 04:40:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5290.7, 300 sec: 5210.3). Total num frames: 170213376. Throughput: 0: 10474.3. Samples: 340423328. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:08,989][27935] Avg episode reward: [(0, '-9.255')] [2022-07-13 04:40:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5213.7). Total num frames: 170240000. Throughput: 0: 10481.8. Samples: 340486944. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:13,989][27935] Avg episode reward: [(0, '-8.710')] [2022-07-13 04:40:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 170264576. Throughput: 0: 10432.8. Samples: 340547744. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:18,989][27935] Avg episode reward: [(0, '-9.656')] [2022-07-13 04:40:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 170290176. Throughput: 0: 10433.1. Samples: 340579136. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:23,989][27935] Avg episode reward: [(0, '-8.699')] [2022-07-13 04:40:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 170316800. Throughput: 0: 10446.0. Samples: 340643096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:28,990][27935] Avg episode reward: [(0, '-11.408')] [2022-07-13 04:40:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 170342400. Throughput: 0: 10430.8. Samples: 340706248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:33,990][27935] Avg episode reward: [(0, '-11.282')] [2022-07-13 04:40:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 170370048. Throughput: 0: 10406.7. Samples: 340737540. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:38,989][27935] Avg episode reward: [(0, '-11.947')] [2022-07-13 04:40:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 170397696. Throughput: 0: 10421.7. Samples: 340801568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:43,989][27935] Avg episode reward: [(0, '-11.876')] [2022-07-13 04:40:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 170422272. Throughput: 0: 10512.5. Samples: 340864912. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:48,989][27935] Avg episode reward: [(0, '-11.634')] [2022-07-13 04:40:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 170448896. Throughput: 0: 10514.1. Samples: 340896460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:53,989][27935] Avg episode reward: [(0, '-11.020')] [2022-07-13 04:40:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 170475520. Throughput: 0: 10498.6. Samples: 340959380. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:40:58,989][27935] Avg episode reward: [(0, '-8.357')] [2022-07-13 04:41:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 170500096. Throughput: 0: 10456.5. Samples: 341018284. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:03,989][27935] Avg episode reward: [(0, '-9.591')] [2022-07-13 04:41:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 170526720. Throughput: 0: 10467.4. Samples: 341050168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:08,989][27935] Avg episode reward: [(0, '-9.059')] [2022-07-13 04:41:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 170552320. Throughput: 0: 10468.5. Samples: 341114180. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:13,990][27935] Avg episode reward: [(0, '-10.995')] [2022-07-13 04:41:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 170579968. Throughput: 0: 10458.7. Samples: 341176892. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:18,989][27935] Avg episode reward: [(0, '-10.742')] [2022-07-13 04:41:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 170604544. Throughput: 0: 10470.4. Samples: 341208708. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:23,989][27935] Avg episode reward: [(0, '-11.120')] [2022-07-13 04:41:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 170632192. Throughput: 0: 10451.3. Samples: 341271876. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:28,991][27935] Avg episode reward: [(0, '-11.500')] [2022-07-13 04:41:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 170655744. Throughput: 0: 10423.1. Samples: 341333952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:33,989][27935] Avg episode reward: [(0, '-11.907')] [2022-07-13 04:41:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 170684416. Throughput: 0: 10422.2. Samples: 341365460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:38,989][27935] Avg episode reward: [(0, '-11.751')] [2022-07-13 04:41:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 170708992. Throughput: 0: 10424.8. Samples: 341428496. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:43,989][27935] Avg episode reward: [(0, '-11.635')] [2022-07-13 04:41:48,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5222.1, 300 sec: 5227.5). Total num frames: 170735616. Throughput: 0: 10528.8. Samples: 341492120. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:48,993][27935] Avg episode reward: [(0, '-12.544')] [2022-07-13 04:41:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 170763264. Throughput: 0: 10536.9. Samples: 341524328. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:53,990][27935] Avg episode reward: [(0, '-11.525')] [2022-07-13 04:41:58,989][27935] Fps is (10 sec: 5429.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 170789888. Throughput: 0: 10530.4. Samples: 341588048. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 04:41:58,989][27935] Avg episode reward: [(0, '-12.781')] [2022-07-13 04:42:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 170812416. Throughput: 0: 10452.5. Samples: 341647252. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:03,989][27935] Avg episode reward: [(0, '-11.297')] [2022-07-13 04:42:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 170841088. Throughput: 0: 10446.9. Samples: 341678820. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:08,989][27935] Avg episode reward: [(0, '-10.555')] [2022-07-13 04:42:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 170866688. Throughput: 0: 10429.5. Samples: 341741204. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:13,989][27935] Avg episode reward: [(0, '-9.260')] [2022-07-13 04:42:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 170890240. Throughput: 0: 10453.5. Samples: 341804360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:18,989][27935] Avg episode reward: [(0, '-10.506')] [2022-07-13 04:42:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 170919936. Throughput: 0: 10450.5. Samples: 341835732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:23,989][27935] Avg episode reward: [(0, '-9.911')] [2022-07-13 04:42:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 170944512. Throughput: 0: 10459.1. Samples: 341899156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:28,989][27935] Avg episode reward: [(0, '-8.510')] [2022-07-13 04:42:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 170971136. Throughput: 0: 10444.5. Samples: 341962084. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:33,991][27935] Avg episode reward: [(0, '-9.331')] [2022-07-13 04:42:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 170998784. Throughput: 0: 10434.4. Samples: 341993876. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:38,991][27935] Avg episode reward: [(0, '-8.968')] [2022-07-13 04:42:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 171022336. Throughput: 0: 10389.9. Samples: 342055592. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:43,990][27935] Avg episode reward: [(0, '-9.204')] [2022-07-13 04:42:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.8, 300 sec: 5234.5). Total num frames: 171049984. Throughput: 0: 10468.2. Samples: 342118320. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:48,989][27935] Avg episode reward: [(0, '-8.654')] [2022-07-13 04:42:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 171075584. Throughput: 0: 10478.6. Samples: 342150356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:53,989][27935] Avg episode reward: [(0, '-10.163')] [2022-07-13 04:42:58,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 171103232. Throughput: 0: 10503.7. Samples: 342213872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:42:58,989][27935] Avg episode reward: [(0, '-9.784')] [2022-07-13 04:43:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 171126784. Throughput: 0: 10420.6. Samples: 342273288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:03,991][27935] Avg episode reward: [(0, '-11.209')] [2022-07-13 04:43:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5234.7). Total num frames: 171152384. Throughput: 0: 10427.1. Samples: 342304952. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:08,991][27935] Avg episode reward: [(0, '-11.505')] [2022-07-13 04:43:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 171181056. Throughput: 0: 10437.6. Samples: 342368848. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:13,989][27935] Avg episode reward: [(0, '-10.446')] [2022-07-13 04:43:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 171205632. Throughput: 0: 10438.1. Samples: 342431800. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:18,989][27935] Avg episode reward: [(0, '-10.738')] [2022-07-13 04:43:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 171233280. Throughput: 0: 10444.3. Samples: 342463868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:23,989][27935] Avg episode reward: [(0, '-10.123')] [2022-07-13 04:43:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 171258880. Throughput: 0: 10481.6. Samples: 342527264. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:28,989][27935] Avg episode reward: [(0, '-9.424')] [2022-07-13 04:43:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 171285504. Throughput: 0: 10488.0. Samples: 342590280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:33,989][27935] Avg episode reward: [(0, '-8.885')] [2022-07-13 04:43:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 171312128. Throughput: 0: 10472.8. Samples: 342621632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:38,989][27935] Avg episode reward: [(0, '-10.076')] [2022-07-13 04:43:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 171337728. Throughput: 0: 10455.7. Samples: 342684380. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:43,989][27935] Avg episode reward: [(0, '-11.108')] [2022-07-13 04:43:48,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5239.2, 300 sec: 5234.5). Total num frames: 171364352. Throughput: 0: 10537.2. Samples: 342747500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:48,993][27935] Avg episode reward: [(0, '-13.220')] [2022-07-13 04:43:53,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5239.4, 300 sec: 5231.1). Total num frames: 171389952. Throughput: 0: 10538.6. Samples: 342779196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:53,990][27935] Avg episode reward: [(0, '-12.215')] [2022-07-13 04:43:58,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 171417600. Throughput: 0: 10536.0. Samples: 342842968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:43:58,989][27935] Avg episode reward: [(0, '-13.719')] [2022-07-13 04:44:03,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 171441152. Throughput: 0: 10458.1. Samples: 342902416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:44:03,991][27935] Avg episode reward: [(0, '-12.250')] [2022-07-13 04:44:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 171467776. Throughput: 0: 10441.7. Samples: 342933744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 04:44:08,989][27935] Avg episode reward: [(0, '-12.490')] [2022-07-13 04:44:13,991][27935] Fps is (10 sec: 5323.6, 60 sec: 5222.2, 300 sec: 5234.5). Total num frames: 171494400. Throughput: 0: 10451.5. Samples: 342997608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:13,992][27935] Avg episode reward: [(0, '-12.123')] [2022-07-13 04:44:18,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 171520000. Throughput: 0: 10439.1. Samples: 343060040. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:18,991][27935] Avg episode reward: [(0, '-11.294')] [2022-07-13 04:44:23,989][27935] Fps is (10 sec: 5326.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 171547648. Throughput: 0: 10453.9. Samples: 343092060. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:23,989][27935] Avg episode reward: [(0, '-10.509')] [2022-07-13 04:44:28,989][27935] Fps is (10 sec: 5324.5, 60 sec: 5239.4, 300 sec: 5231.1). Total num frames: 171573248. Throughput: 0: 10463.2. Samples: 343155228. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:28,991][27935] Avg episode reward: [(0, '-13.172')] [2022-07-13 04:44:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 171599872. Throughput: 0: 10442.6. Samples: 343217380. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:33,989][27935] Avg episode reward: [(0, '-13.034')] [2022-07-13 04:44:38,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 171624448. Throughput: 0: 10431.7. Samples: 343248612. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:38,989][27935] Avg episode reward: [(0, '-13.275')] [2022-07-13 04:44:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 171651072. Throughput: 0: 10413.9. Samples: 343311592. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:43,989][27935] Avg episode reward: [(0, '-12.759')] [2022-07-13 04:44:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.7, 300 sec: 5224.1). Total num frames: 171677696. Throughput: 0: 10485.5. Samples: 343374264. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:48,990][27935] Avg episode reward: [(0, '-12.062')] [2022-07-13 04:44:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.5, 300 sec: 5227.6). Total num frames: 171703296. Throughput: 0: 10485.1. Samples: 343405572. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:53,990][27935] Avg episode reward: [(0, '-11.006')] [2022-07-13 04:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 171729920. Throughput: 0: 10467.7. Samples: 343468628. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:44:58,990][27935] Avg episode reward: [(0, '-11.709')] [2022-07-13 04:45:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 171752448. Throughput: 0: 10395.7. Samples: 343527848. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:03,989][27935] Avg episode reward: [(0, '-11.011')] [2022-07-13 04:45:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 171781120. Throughput: 0: 10383.8. Samples: 343559332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:08,989][27935] Avg episode reward: [(0, '-11.494')] [2022-07-13 04:45:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.5, 300 sec: 5227.6). Total num frames: 171806720. Throughput: 0: 10377.4. Samples: 343622204. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:13,991][27935] Avg episode reward: [(0, '-9.910')] [2022-07-13 04:45:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 171832320. Throughput: 0: 10394.4. Samples: 343685128. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:18,989][27935] Avg episode reward: [(0, '-10.977')] [2022-07-13 04:45:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 171858944. Throughput: 0: 10388.8. Samples: 343716108. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:23,989][27935] Avg episode reward: [(0, '-10.050')] [2022-07-13 04:45:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 171883520. Throughput: 0: 10381.6. Samples: 343778764. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:28,992][27935] Avg episode reward: [(0, '-7.558')] [2022-07-13 04:45:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 171911168. Throughput: 0: 9676.5. Samples: 343809704. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:33,989][27935] Avg episode reward: [(0, '-8.115')] [2022-07-13 04:45:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 171936768. Throughput: 0: 10359.5. Samples: 343871752. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:38,989][27935] Avg episode reward: [(0, '-8.562')] [2022-07-13 04:45:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 171963392. Throughput: 0: 10352.9. Samples: 343934508. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:43,989][27935] Avg episode reward: [(0, '-10.278')] [2022-07-13 04:45:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 171990016. Throughput: 0: 10432.6. Samples: 343997316. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:48,989][27935] Avg episode reward: [(0, '-8.969')] [2022-07-13 04:45:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 172015616. Throughput: 0: 10431.1. Samples: 344028732. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:53,989][27935] Avg episode reward: [(0, '-9.821')] [2022-07-13 04:45:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 172040192. Throughput: 0: 10429.3. Samples: 344091524. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:45:58,989][27935] Avg episode reward: [(0, '-10.612')] [2022-07-13 04:46:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 172065792. Throughput: 0: 10350.0. Samples: 344150876. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:46:03,989][27935] Avg episode reward: [(0, '-10.091')] [2022-07-13 04:46:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 172092416. Throughput: 0: 10356.4. Samples: 344182144. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:46:08,991][27935] Avg episode reward: [(0, '-9.744')] [2022-07-13 04:46:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 172118016. Throughput: 0: 10355.5. Samples: 344244760. Policy #0 lag: (min: 0.0, avg: 9.8, max: 22.0) [2022-07-13 04:46:13,989][27935] Avg episode reward: [(0, '-8.249')] [2022-07-13 04:46:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5217.2). Total num frames: 172143616. Throughput: 0: 11054.1. Samples: 344307140. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:18,989][27935] Avg episode reward: [(0, '-7.734')] [2022-07-13 04:46:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5210.3). Total num frames: 172169216. Throughput: 0: 10329.3. Samples: 344336568. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:23,989][27935] Avg episode reward: [(0, '-9.456')] [2022-07-13 04:46:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 172193792. Throughput: 0: 10294.0. Samples: 344397740. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:28,989][27935] Avg episode reward: [(0, '-10.640')] [2022-07-13 04:46:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5206.8). Total num frames: 172220416. Throughput: 0: 10259.0. Samples: 344458972. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:33,989][27935] Avg episode reward: [(0, '-11.970')] [2022-07-13 04:46:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5206.8). Total num frames: 172244992. Throughput: 0: 10255.1. Samples: 344490212. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:38,989][27935] Avg episode reward: [(0, '-13.816')] [2022-07-13 04:46:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5206.8). Total num frames: 172271616. Throughput: 0: 10242.0. Samples: 344552416. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:43,989][27935] Avg episode reward: [(0, '-15.193')] [2022-07-13 04:46:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5199.8). Total num frames: 172297216. Throughput: 0: 10319.3. Samples: 344615244. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:48,989][27935] Avg episode reward: [(0, '-16.849')] [2022-07-13 04:46:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5199.8). Total num frames: 172323840. Throughput: 0: 10317.0. Samples: 344646408. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:53,989][27935] Avg episode reward: [(0, '-16.147')] [2022-07-13 04:46:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 172350464. Throughput: 0: 10332.4. Samples: 344709716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:46:58,989][27935] Avg episode reward: [(0, '-14.631')] [2022-07-13 04:47:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 172376064. Throughput: 0: 10260.3. Samples: 344768852. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:03,991][27935] Avg episode reward: [(0, '-13.786')] [2022-07-13 04:47:08,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5137.1, 300 sec: 5199.8). Total num frames: 172400640. Throughput: 0: 10313.3. Samples: 344800668. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:08,989][27935] Avg episode reward: [(0, '-13.455')] [2022-07-13 04:47:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5210.3). Total num frames: 172427264. Throughput: 0: 10355.9. Samples: 344863756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:13,989][27935] Avg episode reward: [(0, '-11.764')] [2022-07-13 04:47:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 172453888. Throughput: 0: 10387.1. Samples: 344926392. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:18,989][27935] Avg episode reward: [(0, '-11.481')] [2022-07-13 04:47:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 172479488. Throughput: 0: 10380.8. Samples: 344957348. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:23,989][27935] Avg episode reward: [(0, '-10.924')] [2022-07-13 04:47:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 172506112. Throughput: 0: 10390.5. Samples: 345019988. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:28,997][27935] Avg episode reward: [(0, '-10.195')] [2022-07-13 04:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 172531712. Throughput: 0: 10398.7. Samples: 345083184. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:33,989][27935] Avg episode reward: [(0, '-9.701')] [2022-07-13 04:47:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 172558336. Throughput: 0: 10398.3. Samples: 345114332. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:38,989][27935] Avg episode reward: [(0, '-9.567')] [2022-07-13 04:47:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 172581888. Throughput: 0: 10354.2. Samples: 345175656. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:43,989][27935] Avg episode reward: [(0, '-10.944')] [2022-07-13 04:47:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 172609536. Throughput: 0: 10439.3. Samples: 345238620. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:48,989][27935] Avg episode reward: [(0, '-11.140')] [2022-07-13 04:47:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 172636160. Throughput: 0: 10432.0. Samples: 345270108. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:53,989][27935] Avg episode reward: [(0, '-10.514')] [2022-07-13 04:47:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 172662784. Throughput: 0: 10438.7. Samples: 345333496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:47:58,989][27935] Avg episode reward: [(0, '-10.352')] [2022-07-13 04:48:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 172686336. Throughput: 0: 10369.8. Samples: 345393032. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:48:03,989][27935] Avg episode reward: [(0, '-10.562')] [2022-07-13 04:48:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 172712960. Throughput: 0: 10385.1. Samples: 345424676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:48:08,989][27935] Avg episode reward: [(0, '-8.864')] [2022-07-13 04:48:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 172738560. Throughput: 0: 10399.3. Samples: 345487956. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:48:13,989][27935] Avg episode reward: [(0, '-10.042')] [2022-07-13 04:48:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 172766208. Throughput: 0: 10391.7. Samples: 345550812. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:48:18,989][27935] Avg episode reward: [(0, '-9.340')] [2022-07-13 04:48:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 172792832. Throughput: 0: 10400.0. Samples: 345582332. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 04:48:23,989][27935] Avg episode reward: [(0, '-9.417')] [2022-07-13 04:48:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 172817408. Throughput: 0: 10437.3. Samples: 345645336. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:28,989][27935] Avg episode reward: [(0, '-10.562')] [2022-07-13 04:48:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 172845056. Throughput: 0: 10423.5. Samples: 345707676. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:33,989][27935] Avg episode reward: [(0, '-9.886')] [2022-07-13 04:48:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 172869632. Throughput: 0: 10428.2. Samples: 345739376. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:38,990][27935] Avg episode reward: [(0, '-13.358')] [2022-07-13 04:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5196.4). Total num frames: 172897280. Throughput: 0: 10406.2. Samples: 345801776. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:43,990][27935] Avg episode reward: [(0, '-11.817')] [2022-07-13 04:48:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 172922880. Throughput: 0: 10484.0. Samples: 345864812. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:48,989][27935] Avg episode reward: [(0, '-12.257')] [2022-07-13 04:48:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 172949504. Throughput: 0: 10486.5. Samples: 345896568. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:53,990][27935] Avg episode reward: [(0, '-11.648')] [2022-07-13 04:48:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 172975104. Throughput: 0: 10488.3. Samples: 345959928. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:48:58,990][27935] Avg episode reward: [(0, '-11.031')] [2022-07-13 04:49:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 172999680. Throughput: 0: 10404.8. Samples: 346019028. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:03,989][27935] Avg episode reward: [(0, '-11.198')] [2022-07-13 04:49:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5189.5). Total num frames: 173025280. Throughput: 0: 10404.7. Samples: 346050544. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:08,989][27935] Avg episode reward: [(0, '-10.543')] [2022-07-13 04:49:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 173052928. Throughput: 0: 10414.9. Samples: 346114008. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:13,989][27935] Avg episode reward: [(0, '-9.601')] [2022-07-13 04:49:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 173078528. Throughput: 0: 10443.2. Samples: 346177620. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:18,991][27935] Avg episode reward: [(0, '-9.521')] [2022-07-13 04:49:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 173104128. Throughput: 0: 10429.2. Samples: 346208692. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:23,990][27935] Avg episode reward: [(0, '-10.859')] [2022-07-13 04:49:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 173131776. Throughput: 0: 10434.8. Samples: 346271344. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:28,989][27935] Avg episode reward: [(0, '-12.677')] [2022-07-13 04:49:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 173156352. Throughput: 0: 10425.4. Samples: 346333956. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:33,989][27935] Avg episode reward: [(0, '-14.276')] [2022-07-13 04:49:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 173182976. Throughput: 0: 10424.9. Samples: 346365688. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:38,990][27935] Avg episode reward: [(0, '-14.213')] [2022-07-13 04:49:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 173209600. Throughput: 0: 10418.5. Samples: 346428760. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:43,990][27935] Avg episode reward: [(0, '-15.144')] [2022-07-13 04:49:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 173236224. Throughput: 0: 10505.9. Samples: 346491792. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:48,991][27935] Avg episode reward: [(0, '-15.777')] [2022-07-13 04:49:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 173261824. Throughput: 0: 10507.0. Samples: 346523360. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:53,990][27935] Avg episode reward: [(0, '-15.194')] [2022-07-13 04:49:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 173288448. Throughput: 0: 10496.4. Samples: 346586344. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:49:58,991][27935] Avg episode reward: [(0, '-11.971')] [2022-07-13 04:50:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 173313024. Throughput: 0: 10387.5. Samples: 346645056. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:03,989][27935] Avg episode reward: [(0, '-9.557')] [2022-07-13 04:50:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 173339648. Throughput: 0: 10397.2. Samples: 346676564. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:08,990][27935] Avg episode reward: [(0, '-9.085')] [2022-07-13 04:50:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 173364224. Throughput: 0: 10411.8. Samples: 346739876. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:13,989][27935] Avg episode reward: [(0, '-7.965')] [2022-07-13 04:50:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 173391872. Throughput: 0: 10405.2. Samples: 346802188. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:18,989][27935] Avg episode reward: [(0, '-8.458')] [2022-07-13 04:50:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 173418496. Throughput: 0: 10395.5. Samples: 346833484. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:23,990][27935] Avg episode reward: [(0, '-8.253')] [2022-07-13 04:50:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 173443072. Throughput: 0: 10384.8. Samples: 346896076. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:28,989][27935] Avg episode reward: [(0, '-8.673')] [2022-07-13 04:50:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 173468672. Throughput: 0: 10381.8. Samples: 346958972. Policy #0 lag: (min: 0.0, avg: 10.6, max: 22.0) [2022-07-13 04:50:33,989][27935] Avg episode reward: [(0, '-8.851')] [2022-07-13 04:50:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 173496320. Throughput: 0: 10378.3. Samples: 346990384. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:50:38,989][27935] Avg episode reward: [(0, '-9.635')] [2022-07-13 04:50:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 173521920. Throughput: 0: 10380.3. Samples: 347053456. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:50:43,991][27935] Avg episode reward: [(0, '-10.310')] [2022-07-13 04:50:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 173548544. Throughput: 0: 10478.9. Samples: 347116604. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:50:48,989][27935] Avg episode reward: [(0, '-8.862')] [2022-07-13 04:50:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 173574144. Throughput: 0: 10480.1. Samples: 347148168. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:50:53,990][27935] Avg episode reward: [(0, '-9.458')] [2022-07-13 04:50:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 173601792. Throughput: 0: 10469.7. Samples: 347211012. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:50:58,989][27935] Avg episode reward: [(0, '-10.451')] [2022-07-13 04:51:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 173625344. Throughput: 0: 10395.4. Samples: 347269980. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:03,989][27935] Avg episode reward: [(0, '-10.663')] [2022-07-13 04:51:08,991][27935] Fps is (10 sec: 4811.8, 60 sec: 5171.0, 300 sec: 5192.9). Total num frames: 173649920. Throughput: 0: 10380.4. Samples: 347300624. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:08,991][27935] Avg episode reward: [(0, '-10.509')] [2022-07-13 04:51:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 173675520. Throughput: 0: 10340.3. Samples: 347361392. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:13,990][27935] Avg episode reward: [(0, '-9.575')] [2022-07-13 04:51:18,989][27935] Fps is (10 sec: 5223.5, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 173702144. Throughput: 0: 10296.1. Samples: 347422296. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:18,990][27935] Avg episode reward: [(0, '-8.923')] [2022-07-13 04:51:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 173726720. Throughput: 0: 10294.0. Samples: 347453612. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:23,989][27935] Avg episode reward: [(0, '-10.386')] [2022-07-13 04:51:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 173754368. Throughput: 0: 10290.6. Samples: 347516532. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:28,989][27935] Avg episode reward: [(0, '-9.121')] [2022-07-13 04:51:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 173779968. Throughput: 0: 10266.7. Samples: 347578608. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:33,989][27935] Avg episode reward: [(0, '-10.365')] [2022-07-13 04:51:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 173805568. Throughput: 0: 10262.1. Samples: 347609964. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:38,989][27935] Avg episode reward: [(0, '-11.755')] [2022-07-13 04:51:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 173832192. Throughput: 0: 10254.6. Samples: 347672468. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:43,989][27935] Avg episode reward: [(0, '-12.668')] [2022-07-13 04:51:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 173858816. Throughput: 0: 10342.8. Samples: 347735404. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:48,989][27935] Avg episode reward: [(0, '-14.625')] [2022-07-13 04:51:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 173883392. Throughput: 0: 10373.3. Samples: 347767400. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:53,990][27935] Avg episode reward: [(0, '-14.045')] [2022-07-13 04:51:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 173911040. Throughput: 0: 10430.0. Samples: 347830740. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:51:58,989][27935] Avg episode reward: [(0, '-13.226')] [2022-07-13 04:52:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 173935616. Throughput: 0: 10405.4. Samples: 347890536. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:03,989][27935] Avg episode reward: [(0, '-13.433')] [2022-07-13 04:52:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.5, 300 sec: 5203.3). Total num frames: 173962240. Throughput: 0: 10420.4. Samples: 347922528. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:08,990][27935] Avg episode reward: [(0, '-13.381')] [2022-07-13 04:52:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 173987840. Throughput: 0: 10442.6. Samples: 347986448. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:13,990][27935] Avg episode reward: [(0, '-13.670')] [2022-07-13 04:52:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 174015488. Throughput: 0: 10469.4. Samples: 348049732. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:18,991][27935] Avg episode reward: [(0, '-12.524')] [2022-07-13 04:52:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 174041088. Throughput: 0: 10475.5. Samples: 348081360. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:23,989][27935] Avg episode reward: [(0, '-11.636')] [2022-07-13 04:52:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 174065664. Throughput: 0: 10429.9. Samples: 348141812. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:28,989][27935] Avg episode reward: [(0, '-10.894')] [2022-07-13 04:52:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 174092288. Throughput: 0: 10419.4. Samples: 348204276. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:33,989][27935] Avg episode reward: [(0, '-12.329')] [2022-07-13 04:52:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 174118912. Throughput: 0: 10408.2. Samples: 348235768. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:38,989][27935] Avg episode reward: [(0, '-9.998')] [2022-07-13 04:52:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 174145536. Throughput: 0: 10388.4. Samples: 348298216. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 04:52:43,989][27935] Avg episode reward: [(0, '-9.849')] [2022-07-13 04:52:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 174170112. Throughput: 0: 10456.1. Samples: 348361060. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:52:48,989][27935] Avg episode reward: [(0, '-9.981')] [2022-07-13 04:52:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 174196736. Throughput: 0: 10459.8. Samples: 348393220. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:52:53,989][27935] Avg episode reward: [(0, '-10.908')] [2022-07-13 04:52:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 174223360. Throughput: 0: 10446.0. Samples: 348456520. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:52:58,990][27935] Avg episode reward: [(0, '-11.101')] [2022-07-13 04:53:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 174248960. Throughput: 0: 10358.3. Samples: 348515856. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:03,990][27935] Avg episode reward: [(0, '-11.119')] [2022-07-13 04:53:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 174274560. Throughput: 0: 10358.4. Samples: 348547488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:08,989][27935] Avg episode reward: [(0, '-12.201')] [2022-07-13 04:53:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 174300160. Throughput: 0: 10417.0. Samples: 348610576. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:13,990][27935] Avg episode reward: [(0, '-10.510')] [2022-07-13 04:53:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 174327808. Throughput: 0: 10417.5. Samples: 348673064. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:18,991][27935] Avg episode reward: [(0, '-11.273')] [2022-07-13 04:53:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 174353408. Throughput: 0: 10422.6. Samples: 348704784. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:23,989][27935] Avg episode reward: [(0, '-10.916')] [2022-07-13 04:53:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 174379008. Throughput: 0: 10440.9. Samples: 348768056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:28,989][27935] Avg episode reward: [(0, '-10.152')] [2022-07-13 04:53:33,991][27935] Fps is (10 sec: 5323.6, 60 sec: 5239.3, 300 sec: 5210.2). Total num frames: 174406656. Throughput: 0: 10426.6. Samples: 348830280. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:33,991][27935] Avg episode reward: [(0, '-10.844')] [2022-07-13 04:53:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 174431232. Throughput: 0: 10415.1. Samples: 348861900. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:38,989][27935] Avg episode reward: [(0, '-10.717')] [2022-07-13 04:53:43,989][27935] Fps is (10 sec: 5121.1, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 174457856. Throughput: 0: 10417.5. Samples: 348925308. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:43,989][27935] Avg episode reward: [(0, '-10.555')] [2022-07-13 04:53:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 174484480. Throughput: 0: 10509.4. Samples: 348988776. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:48,989][27935] Avg episode reward: [(0, '-10.455')] [2022-07-13 04:53:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 174510080. Throughput: 0: 10512.2. Samples: 349020536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:53,989][27935] Avg episode reward: [(0, '-10.654')] [2022-07-13 04:53:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 174538752. Throughput: 0: 10518.7. Samples: 349083916. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:53:58,989][27935] Avg episode reward: [(0, '-9.385')] [2022-07-13 04:54:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 174561280. Throughput: 0: 10458.6. Samples: 349143700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:03,989][27935] Avg episode reward: [(0, '-8.465')] [2022-07-13 04:54:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 174588928. Throughput: 0: 10460.8. Samples: 349175520. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:08,990][27935] Avg episode reward: [(0, '-10.313')] [2022-07-13 04:54:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5210.3). Total num frames: 174615552. Throughput: 0: 10478.9. Samples: 349239608. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:13,989][27935] Avg episode reward: [(0, '-11.585')] [2022-07-13 04:54:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 174641152. Throughput: 0: 10499.9. Samples: 349302752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:18,991][27935] Avg episode reward: [(0, '-11.277')] [2022-07-13 04:54:23,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 174666752. Throughput: 0: 10504.9. Samples: 349334624. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:23,990][27935] Avg episode reward: [(0, '-10.209')] [2022-07-13 04:54:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 174695424. Throughput: 0: 10491.4. Samples: 349397420. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:28,991][27935] Avg episode reward: [(0, '-9.528')] [2022-07-13 04:54:33,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5222.6, 300 sec: 5210.3). Total num frames: 174720000. Throughput: 0: 10489.1. Samples: 349460788. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:33,989][27935] Avg episode reward: [(0, '-8.162')] [2022-07-13 04:54:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5210.3). Total num frames: 174746624. Throughput: 0: 10481.5. Samples: 349492204. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:38,989][27935] Avg episode reward: [(0, '-7.285')] [2022-07-13 04:54:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5210.3). Total num frames: 174773248. Throughput: 0: 10492.4. Samples: 349556072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:43,989][27935] Avg episode reward: [(0, '-8.220')] [2022-07-13 04:54:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5213.7). Total num frames: 174799872. Throughput: 0: 10563.8. Samples: 349619072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:48,989][27935] Avg episode reward: [(0, '-9.860')] [2022-07-13 04:54:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5210.2). Total num frames: 174825472. Throughput: 0: 10555.8. Samples: 349650532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 04:54:53,989][27935] Avg episode reward: [(0, '-10.695')] [2022-07-13 04:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 174852096. Throughput: 0: 10536.4. Samples: 349713744. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:54:58,989][27935] Avg episode reward: [(0, '-11.865')] [2022-07-13 04:55:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5210.2). Total num frames: 174876672. Throughput: 0: 10457.9. Samples: 349773360. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:03,989][27935] Avg episode reward: [(0, '-12.441')] [2022-07-13 04:55:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 174904320. Throughput: 0: 10450.4. Samples: 349804888. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:08,989][27935] Avg episode reward: [(0, '-13.689')] [2022-07-13 04:55:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.2). Total num frames: 174928896. Throughput: 0: 10462.2. Samples: 349868220. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:13,989][27935] Avg episode reward: [(0, '-10.143')] [2022-07-13 04:55:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5213.7). Total num frames: 174956544. Throughput: 0: 10457.6. Samples: 349931380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:18,989][27935] Avg episode reward: [(0, '-10.463')] [2022-07-13 04:55:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5256.6, 300 sec: 5217.2). Total num frames: 174982144. Throughput: 0: 10475.2. Samples: 349963588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:23,989][27935] Avg episode reward: [(0, '-10.332')] [2022-07-13 04:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 175008768. Throughput: 0: 10462.9. Samples: 350026904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:28,989][27935] Avg episode reward: [(0, '-11.597')] [2022-07-13 04:55:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 175034368. Throughput: 0: 9768.0. Samples: 350058632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:33,989][27935] Avg episode reward: [(0, '-10.771')] [2022-07-13 04:55:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 175062016. Throughput: 0: 10478.4. Samples: 350122060. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:38,989][27935] Avg episode reward: [(0, '-10.975')] [2022-07-13 04:55:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 175088640. Throughput: 0: 10483.7. Samples: 350185508. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:43,989][27935] Avg episode reward: [(0, '-11.376')] [2022-07-13 04:55:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 175113216. Throughput: 0: 10558.3. Samples: 350248484. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:48,989][27935] Avg episode reward: [(0, '-11.286')] [2022-07-13 04:55:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 175140864. Throughput: 0: 10557.7. Samples: 350279984. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:53,989][27935] Avg episode reward: [(0, '-12.020')] [2022-07-13 04:55:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 175168512. Throughput: 0: 10574.0. Samples: 350344048. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:55:58,989][27935] Avg episode reward: [(0, '-11.661')] [2022-07-13 04:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5224.2). Total num frames: 175191040. Throughput: 0: 10502.0. Samples: 350403968. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:03,989][27935] Avg episode reward: [(0, '-13.871')] [2022-07-13 04:56:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 175218688. Throughput: 0: 10485.4. Samples: 350435432. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:08,991][27935] Avg episode reward: [(0, '-12.805')] [2022-07-13 04:56:13,991][27935] Fps is (10 sec: 5426.0, 60 sec: 5273.4, 300 sec: 5231.0). Total num frames: 175245312. Throughput: 0: 10507.1. Samples: 350499748. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:13,992][27935] Avg episode reward: [(0, '-12.965')] [2022-07-13 04:56:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 175271936. Throughput: 0: 11206.4. Samples: 350562920. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:18,991][27935] Avg episode reward: [(0, '-12.714')] [2022-07-13 04:56:23,989][27935] Fps is (10 sec: 5223.6, 60 sec: 5256.5, 300 sec: 5231.1). Total num frames: 175297536. Throughput: 0: 10505.5. Samples: 350594808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:23,990][27935] Avg episode reward: [(0, '-10.775')] [2022-07-13 04:56:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 175325184. Throughput: 0: 10521.9. Samples: 350658992. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:28,989][27935] Avg episode reward: [(0, '-13.206')] [2022-07-13 04:56:33,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5307.7, 300 sec: 5245.0). Total num frames: 175352832. Throughput: 0: 10517.1. Samples: 350721752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:33,989][27935] Avg episode reward: [(0, '-11.376')] [2022-07-13 04:56:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 175377408. Throughput: 0: 10528.2. Samples: 350753752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:38,989][27935] Avg episode reward: [(0, '-11.758')] [2022-07-13 04:56:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 175405056. Throughput: 0: 10528.8. Samples: 350817844. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:43,989][27935] Avg episode reward: [(0, '-14.223')] [2022-07-13 04:56:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5307.7, 300 sec: 5248.4). Total num frames: 175431680. Throughput: 0: 10592.2. Samples: 350880616. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:48,989][27935] Avg episode reward: [(0, '-13.041')] [2022-07-13 04:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 175457280. Throughput: 0: 10601.6. Samples: 350912504. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:53,989][27935] Avg episode reward: [(0, '-12.762')] [2022-07-13 04:56:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 175482880. Throughput: 0: 10588.4. Samples: 350976200. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:56:58,989][27935] Avg episode reward: [(0, '-10.444')] [2022-07-13 04:57:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5238.0). Total num frames: 175507456. Throughput: 0: 10500.0. Samples: 351035420. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 04:57:03,991][27935] Avg episode reward: [(0, '-10.292')] [2022-07-13 04:57:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5245.0). Total num frames: 175535104. Throughput: 0: 10490.2. Samples: 351066868. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:08,990][27935] Avg episode reward: [(0, '-9.812')] [2022-07-13 04:57:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.7, 300 sec: 5238.0). Total num frames: 175560704. Throughput: 0: 10474.0. Samples: 351130324. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:13,990][27935] Avg episode reward: [(0, '-8.263')] [2022-07-13 04:57:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5241.5). Total num frames: 175587328. Throughput: 0: 9778.0. Samples: 351161764. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:18,991][27935] Avg episode reward: [(0, '-8.383')] [2022-07-13 04:57:23,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5273.4, 300 sec: 5248.4). Total num frames: 175613952. Throughput: 0: 10481.5. Samples: 351225448. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:23,993][27935] Avg episode reward: [(0, '-8.298')] [2022-07-13 04:57:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 175640576. Throughput: 0: 10476.4. Samples: 351289280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:28,989][27935] Avg episode reward: [(0, '-8.114')] [2022-07-13 04:57:33,989][27935] Fps is (10 sec: 5223.7, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 175666176. Throughput: 0: 10467.5. Samples: 351351652. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:33,989][27935] Avg episode reward: [(0, '-7.991')] [2022-07-13 04:57:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 175692800. Throughput: 0: 10459.6. Samples: 351383188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:38,989][27935] Avg episode reward: [(0, '-7.575')] [2022-07-13 04:57:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 175718400. Throughput: 0: 10415.9. Samples: 351444916. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:43,989][27935] Avg episode reward: [(0, '-6.925')] [2022-07-13 04:57:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 175744000. Throughput: 0: 10505.8. Samples: 351508180. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:48,989][27935] Avg episode reward: [(0, '-6.893')] [2022-07-13 04:57:53,991][27935] Fps is (10 sec: 5323.5, 60 sec: 5239.3, 300 sec: 5248.4). Total num frames: 175771648. Throughput: 0: 10515.1. Samples: 351540072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:53,992][27935] Avg episode reward: [(0, '-9.587')] [2022-07-13 04:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 175796224. Throughput: 0: 10520.1. Samples: 351603728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:57:58,989][27935] Avg episode reward: [(0, '-9.668')] [2022-07-13 04:58:03,989][27935] Fps is (10 sec: 4916.4, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 175820800. Throughput: 0: 11142.2. Samples: 351663164. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:03,991][27935] Avg episode reward: [(0, '-8.430')] [2022-07-13 04:58:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 175848448. Throughput: 0: 10430.7. Samples: 351694804. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:08,990][27935] Avg episode reward: [(0, '-9.030')] [2022-07-13 04:58:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 175875072. Throughput: 0: 10417.1. Samples: 351758052. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:13,991][27935] Avg episode reward: [(0, '-10.830')] [2022-07-13 04:58:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 175899648. Throughput: 0: 10427.1. Samples: 351820872. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:18,990][27935] Avg episode reward: [(0, '-11.812')] [2022-07-13 04:58:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.6, 300 sec: 5248.4). Total num frames: 175927296. Throughput: 0: 10428.9. Samples: 351852488. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:23,991][27935] Avg episode reward: [(0, '-9.224')] [2022-07-13 04:58:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5234.6). Total num frames: 175950848. Throughput: 0: 10423.5. Samples: 351913972. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:28,991][27935] Avg episode reward: [(0, '-10.758')] [2022-07-13 04:58:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 175978496. Throughput: 0: 10354.1. Samples: 351974116. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:33,989][27935] Avg episode reward: [(0, '-10.825')] [2022-07-13 04:58:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5241.5). Total num frames: 176004096. Throughput: 0: 10339.9. Samples: 352005344. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:38,990][27935] Avg episode reward: [(0, '-10.249')] [2022-07-13 04:58:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5234.5). Total num frames: 176028672. Throughput: 0: 10314.3. Samples: 352067872. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:43,989][27935] Avg episode reward: [(0, '-10.130')] [2022-07-13 04:58:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 176055296. Throughput: 0: 10381.0. Samples: 352130308. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:48,989][27935] Avg episode reward: [(0, '-10.579')] [2022-07-13 04:58:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.4, 300 sec: 5231.1). Total num frames: 176081920. Throughput: 0: 10371.6. Samples: 352161528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:53,989][27935] Avg episode reward: [(0, '-10.007')] [2022-07-13 04:58:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 176108544. Throughput: 0: 10361.5. Samples: 352224320. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:58:58,989][27935] Avg episode reward: [(0, '-9.456')] [2022-07-13 04:59:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 176131072. Throughput: 0: 10281.6. Samples: 352283544. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:59:03,990][27935] Avg episode reward: [(0, '-10.118')] [2022-07-13 04:59:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5231.1). Total num frames: 176158720. Throughput: 0: 10271.0. Samples: 352314684. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:59:08,989][27935] Avg episode reward: [(0, '-9.144')] [2022-07-13 04:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5227.6). Total num frames: 176183296. Throughput: 0: 10292.7. Samples: 352377144. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 04:59:13,989][27935] Avg episode reward: [(0, '-7.927')] [2022-07-13 04:59:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5231.1). Total num frames: 176209920. Throughput: 0: 10340.6. Samples: 352439444. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:18,989][27935] Avg episode reward: [(0, '-7.244')] [2022-07-13 04:59:23,997][27935] Fps is (10 sec: 5320.7, 60 sec: 5153.5, 300 sec: 5224.0). Total num frames: 176236544. Throughput: 0: 10341.8. Samples: 352470804. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:23,997][27935] Avg episode reward: [(0, '-5.760')] [2022-07-13 04:59:29,005][27935] Fps is (10 sec: 5214.2, 60 sec: 5186.9, 300 sec: 5227.3). Total num frames: 176262144. Throughput: 0: 10337.5. Samples: 352533224. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:29,005][27935] Avg episode reward: [(0, '-7.461')] [2022-07-13 04:59:33,989][27935] Fps is (10 sec: 5226.5, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 176288768. Throughput: 0: 10336.5. Samples: 352595452. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:33,989][27935] Avg episode reward: [(0, '-8.862')] [2022-07-13 04:59:38,989][27935] Fps is (10 sec: 5128.1, 60 sec: 5154.1, 300 sec: 5220.7). Total num frames: 176313344. Throughput: 0: 10341.3. Samples: 352626888. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:38,989][27935] Avg episode reward: [(0, '-9.352')] [2022-07-13 04:59:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5220.7). Total num frames: 176339968. Throughput: 0: 10335.5. Samples: 352689416. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:43,989][27935] Avg episode reward: [(0, '-8.856')] [2022-07-13 04:59:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 176365568. Throughput: 0: 10412.4. Samples: 352752104. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:48,989][27935] Avg episode reward: [(0, '-11.327')] [2022-07-13 04:59:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 176393216. Throughput: 0: 10414.6. Samples: 352783340. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:53,989][27935] Avg episode reward: [(0, '-12.166')] [2022-07-13 04:59:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 176418816. Throughput: 0: 10436.2. Samples: 352846772. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 04:59:58,989][27935] Avg episode reward: [(0, '-10.827')] [2022-07-13 05:00:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 176442368. Throughput: 0: 10370.7. Samples: 352906124. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:03,989][27935] Avg episode reward: [(0, '-10.847')] [2022-07-13 05:00:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 176470016. Throughput: 0: 10377.0. Samples: 352937688. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:08,989][27935] Avg episode reward: [(0, '-9.884')] [2022-07-13 05:00:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 176495616. Throughput: 0: 10401.4. Samples: 353001120. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:13,989][27935] Avg episode reward: [(0, '-9.336')] [2022-07-13 05:00:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 176522240. Throughput: 0: 10426.9. Samples: 353064664. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:18,989][27935] Avg episode reward: [(0, '-9.950')] [2022-07-13 05:00:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5206.0, 300 sec: 5220.7). Total num frames: 176548864. Throughput: 0: 10431.6. Samples: 353096308. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:23,989][27935] Avg episode reward: [(0, '-10.599')] [2022-07-13 05:00:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5240.9, 300 sec: 5227.6). Total num frames: 176576512. Throughput: 0: 10450.6. Samples: 353159692. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:28,989][27935] Avg episode reward: [(0, '-10.308')] [2022-07-13 05:00:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 176601088. Throughput: 0: 10436.1. Samples: 353221728. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:33,993][27935] Avg episode reward: [(0, '-11.040')] [2022-07-13 05:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 176626688. Throughput: 0: 10435.5. Samples: 353252936. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:38,989][27935] Avg episode reward: [(0, '-11.718')] [2022-07-13 05:00:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 176653312. Throughput: 0: 10417.8. Samples: 353315572. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:43,989][27935] Avg episode reward: [(0, '-13.148')] [2022-07-13 05:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 176678912. Throughput: 0: 10496.1. Samples: 353378448. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:48,989][27935] Avg episode reward: [(0, '-12.251')] [2022-07-13 05:00:53,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5205.3, 300 sec: 5210.2). Total num frames: 176705536. Throughput: 0: 10478.7. Samples: 353409240. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:53,990][27935] Avg episode reward: [(0, '-11.023')] [2022-07-13 05:00:58,993][27935] Fps is (10 sec: 5220.1, 60 sec: 5205.0, 300 sec: 5220.6). Total num frames: 176731136. Throughput: 0: 10466.3. Samples: 353472148. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:00:58,994][27935] Avg episode reward: [(0, '-12.349')] [2022-07-13 05:01:03,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5239.4, 300 sec: 5213.7). Total num frames: 176756736. Throughput: 0: 10354.6. Samples: 353530624. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:01:03,990][27935] Avg episode reward: [(0, '-12.081')] [2022-07-13 05:01:08,989][27935] Fps is (10 sec: 4917.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 176780288. Throughput: 0: 10352.4. Samples: 353562168. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:01:08,989][27935] Avg episode reward: [(0, '-12.554')] [2022-07-13 05:01:13,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 176807936. Throughput: 0: 10327.0. Samples: 353624408. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:01:13,989][27935] Avg episode reward: [(0, '-14.476')] [2022-07-13 05:01:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 176833536. Throughput: 0: 10327.4. Samples: 353686460. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:01:18,989][27935] Avg episode reward: [(0, '-14.081')] [2022-07-13 05:01:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 176859136. Throughput: 0: 10325.0. Samples: 353717560. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 05:01:23,989][27935] Avg episode reward: [(0, '-15.761')] [2022-07-13 05:01:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 176885760. Throughput: 0: 10323.9. Samples: 353780148. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:28,989][27935] Avg episode reward: [(0, '-15.762')] [2022-07-13 05:01:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 176911360. Throughput: 0: 10282.6. Samples: 353841164. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:33,991][27935] Avg episode reward: [(0, '-13.354')] [2022-07-13 05:01:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 176937984. Throughput: 0: 10295.6. Samples: 353872532. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:38,989][27935] Avg episode reward: [(0, '-12.104')] [2022-07-13 05:01:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 176962560. Throughput: 0: 10289.1. Samples: 353935112. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:43,989][27935] Avg episode reward: [(0, '-10.540')] [2022-07-13 05:01:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 176989184. Throughput: 0: 10380.4. Samples: 353997736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:48,991][27935] Avg episode reward: [(0, '-10.646')] [2022-07-13 05:01:53,989][27935] Fps is (10 sec: 5324.6, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 177015808. Throughput: 0: 10374.0. Samples: 354029000. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:53,991][27935] Avg episode reward: [(0, '-9.953')] [2022-07-13 05:01:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.6, 300 sec: 5199.8). Total num frames: 177041408. Throughput: 0: 10383.6. Samples: 354091668. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:01:58,990][27935] Avg episode reward: [(0, '-8.691')] [2022-07-13 05:02:03,989][27935] Fps is (10 sec: 4915.3, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 177064960. Throughput: 0: 10307.5. Samples: 354150296. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:03,989][27935] Avg episode reward: [(0, '-9.148')] [2022-07-13 05:02:08,991][27935] Fps is (10 sec: 5016.3, 60 sec: 5188.0, 300 sec: 5189.4). Total num frames: 177091584. Throughput: 0: 10315.0. Samples: 354181760. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:08,993][27935] Avg episode reward: [(0, '-8.680')] [2022-07-13 05:02:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 177118208. Throughput: 0: 10307.2. Samples: 354243972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:13,990][27935] Avg episode reward: [(0, '-11.376')] [2022-07-13 05:02:18,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 177142784. Throughput: 0: 10339.8. Samples: 354306456. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:18,989][27935] Avg episode reward: [(0, '-10.572')] [2022-07-13 05:02:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 177169408. Throughput: 0: 10335.4. Samples: 354337624. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:23,991][27935] Avg episode reward: [(0, '-10.618')] [2022-07-13 05:02:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 177196032. Throughput: 0: 10344.6. Samples: 354400620. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:28,990][27935] Avg episode reward: [(0, '-11.598')] [2022-07-13 05:02:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 177220608. Throughput: 0: 10317.0. Samples: 354462000. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:33,991][27935] Avg episode reward: [(0, '-11.418')] [2022-07-13 05:02:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 177247232. Throughput: 0: 10319.1. Samples: 354493356. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:38,991][27935] Avg episode reward: [(0, '-13.030')] [2022-07-13 05:02:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 177272832. Throughput: 0: 10308.4. Samples: 354555548. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:43,989][27935] Avg episode reward: [(0, '-10.251')] [2022-07-13 05:02:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.1). Total num frames: 177299456. Throughput: 0: 10393.2. Samples: 354617992. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:48,989][27935] Avg episode reward: [(0, '-12.095')] [2022-07-13 05:02:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 177325056. Throughput: 0: 10380.5. Samples: 354648856. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:53,989][27935] Avg episode reward: [(0, '-10.276')] [2022-07-13 05:02:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 177350656. Throughput: 0: 10374.8. Samples: 354710836. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:02:58,989][27935] Avg episode reward: [(0, '-11.437')] [2022-07-13 05:03:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 177375232. Throughput: 0: 10293.6. Samples: 354769668. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:03,989][27935] Avg episode reward: [(0, '-11.632')] [2022-07-13 05:03:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.4, 300 sec: 5172.1). Total num frames: 177400832. Throughput: 0: 10303.4. Samples: 354801276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:08,989][27935] Avg episode reward: [(0, '-10.255')] [2022-07-13 05:03:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 177428480. Throughput: 0: 10310.4. Samples: 354864588. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:13,989][27935] Avg episode reward: [(0, '-10.138')] [2022-07-13 05:03:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 177454080. Throughput: 0: 10340.0. Samples: 354927300. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:18,989][27935] Avg episode reward: [(0, '-7.132')] [2022-07-13 05:03:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 177480704. Throughput: 0: 10342.8. Samples: 354958784. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:23,989][27935] Avg episode reward: [(0, '-7.930')] [2022-07-13 05:03:28,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 177505280. Throughput: 0: 10349.3. Samples: 355021268. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:28,989][27935] Avg episode reward: [(0, '-7.592')] [2022-07-13 05:03:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 177531904. Throughput: 0: 10347.2. Samples: 355083616. Policy #0 lag: (min: 0.0, avg: 8.7, max: 21.0) [2022-07-13 05:03:33,989][27935] Avg episode reward: [(0, '-9.649')] [2022-07-13 05:03:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 177558528. Throughput: 0: 10362.1. Samples: 355115152. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:03:38,989][27935] Avg episode reward: [(0, '-8.646')] [2022-07-13 05:03:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 177584128. Throughput: 0: 10382.9. Samples: 355178068. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:03:43,990][27935] Avg episode reward: [(0, '-8.281')] [2022-07-13 05:03:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 177610752. Throughput: 0: 10477.9. Samples: 355241172. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:03:48,989][27935] Avg episode reward: [(0, '-10.357')] [2022-07-13 05:03:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 177636352. Throughput: 0: 10472.0. Samples: 355272516. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:03:53,991][27935] Avg episode reward: [(0, '-10.468')] [2022-07-13 05:03:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 177664000. Throughput: 0: 10463.1. Samples: 355335428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:03:58,989][27935] Avg episode reward: [(0, '-9.671')] [2022-07-13 05:04:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 177687552. Throughput: 0: 10369.5. Samples: 355393928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:03,991][27935] Avg episode reward: [(0, '-8.355')] [2022-07-13 05:04:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 177713152. Throughput: 0: 10362.0. Samples: 355425072. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:08,989][27935] Avg episode reward: [(0, '-9.687')] [2022-07-13 05:04:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 177739776. Throughput: 0: 10375.3. Samples: 355488156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:13,989][27935] Avg episode reward: [(0, '-10.309')] [2022-07-13 05:04:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.1). Total num frames: 177766400. Throughput: 0: 10381.2. Samples: 355550772. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:18,989][27935] Avg episode reward: [(0, '-10.460')] [2022-07-13 05:04:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.8). Total num frames: 177790976. Throughput: 0: 10378.5. Samples: 355582184. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:23,990][27935] Avg episode reward: [(0, '-11.574')] [2022-07-13 05:04:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 177817600. Throughput: 0: 10377.8. Samples: 355645068. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:28,991][27935] Avg episode reward: [(0, '-10.295')] [2022-07-13 05:04:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 177842176. Throughput: 0: 10304.0. Samples: 355704852. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:33,989][27935] Avg episode reward: [(0, '-10.169')] [2022-07-13 05:04:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 177868800. Throughput: 0: 10284.9. Samples: 355735336. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:38,990][27935] Avg episode reward: [(0, '-9.353')] [2022-07-13 05:04:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 177895424. Throughput: 0: 10274.5. Samples: 355797780. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:43,990][27935] Avg episode reward: [(0, '-9.367')] [2022-07-13 05:04:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 177921024. Throughput: 0: 10374.3. Samples: 355860772. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:48,989][27935] Avg episode reward: [(0, '-8.070')] [2022-07-13 05:04:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 177947648. Throughput: 0: 10378.1. Samples: 355892084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:53,989][27935] Avg episode reward: [(0, '-8.300')] [2022-07-13 05:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 177972224. Throughput: 0: 10371.5. Samples: 355954872. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:04:58,989][27935] Avg episode reward: [(0, '-9.232')] [2022-07-13 05:05:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 177997824. Throughput: 0: 10280.8. Samples: 356013408. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:03,989][27935] Avg episode reward: [(0, '-9.006')] [2022-07-13 05:05:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 178022400. Throughput: 0: 10276.4. Samples: 356044620. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:08,989][27935] Avg episode reward: [(0, '-10.313')] [2022-07-13 05:05:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 178049024. Throughput: 0: 10260.1. Samples: 356106772. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:13,991][27935] Avg episode reward: [(0, '-8.974')] [2022-07-13 05:05:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 178074624. Throughput: 0: 10328.4. Samples: 356169632. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:18,989][27935] Avg episode reward: [(0, '-9.428')] [2022-07-13 05:05:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 178102272. Throughput: 0: 10348.9. Samples: 356201036. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:23,989][27935] Avg episode reward: [(0, '-9.905')] [2022-07-13 05:05:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 178125824. Throughput: 0: 10353.7. Samples: 356263696. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:28,989][27935] Avg episode reward: [(0, '-10.376')] [2022-07-13 05:05:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 178153472. Throughput: 0: 10329.9. Samples: 356325616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:33,989][27935] Avg episode reward: [(0, '-9.502')] [2022-07-13 05:05:38,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 178180096. Throughput: 0: 10324.7. Samples: 356356696. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:38,989][27935] Avg episode reward: [(0, '-8.131')] [2022-07-13 05:05:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 178205696. Throughput: 0: 10326.6. Samples: 356419568. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 05:05:43,989][27935] Avg episode reward: [(0, '-9.057')] [2022-07-13 05:05:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 178230272. Throughput: 0: 10422.7. Samples: 356482428. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:05:48,991][27935] Avg episode reward: [(0, '-8.802')] [2022-07-13 05:05:53,992][27935] Fps is (10 sec: 5118.6, 60 sec: 5153.9, 300 sec: 5172.1). Total num frames: 178256896. Throughput: 0: 10419.6. Samples: 356513532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:05:53,994][27935] Avg episode reward: [(0, '-9.075')] [2022-07-13 05:05:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 178284544. Throughput: 0: 10421.3. Samples: 356575732. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:05:58,989][27935] Avg episode reward: [(0, '-8.620')] [2022-07-13 05:06:03,989][27935] Fps is (10 sec: 5121.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 178308096. Throughput: 0: 10316.4. Samples: 356633872. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:03,989][27935] Avg episode reward: [(0, '-9.335')] [2022-07-13 05:06:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 178334720. Throughput: 0: 10312.3. Samples: 356665088. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:08,989][27935] Avg episode reward: [(0, '-9.922')] [2022-07-13 05:06:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 178358272. Throughput: 0: 10328.1. Samples: 356728460. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:13,989][27935] Avg episode reward: [(0, '-8.971')] [2022-07-13 05:06:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 178386944. Throughput: 0: 10333.8. Samples: 356790636. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:18,989][27935] Avg episode reward: [(0, '-10.750')] [2022-07-13 05:06:23,990][27935] Fps is (10 sec: 5324.2, 60 sec: 5154.0, 300 sec: 5172.0). Total num frames: 178411520. Throughput: 0: 10341.3. Samples: 356822068. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:23,991][27935] Avg episode reward: [(0, '-11.976')] [2022-07-13 05:06:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 178437120. Throughput: 0: 10341.4. Samples: 356884932. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:28,989][27935] Avg episode reward: [(0, '-10.410')] [2022-07-13 05:06:33,989][27935] Fps is (10 sec: 5325.5, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 178464768. Throughput: 0: 10323.5. Samples: 356946984. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:33,989][27935] Avg episode reward: [(0, '-11.478')] [2022-07-13 05:06:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 178490368. Throughput: 0: 10329.3. Samples: 356978320. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:38,990][27935] Avg episode reward: [(0, '-13.329')] [2022-07-13 05:06:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 178516992. Throughput: 0: 10356.1. Samples: 357041756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:43,990][27935] Avg episode reward: [(0, '-15.385')] [2022-07-13 05:06:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 178542592. Throughput: 0: 10459.6. Samples: 357104552. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:48,989][27935] Avg episode reward: [(0, '-14.298')] [2022-07-13 05:06:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.6, 300 sec: 5179.0). Total num frames: 178569216. Throughput: 0: 10473.8. Samples: 357136408. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:53,990][27935] Avg episode reward: [(0, '-14.098')] [2022-07-13 05:06:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 178595840. Throughput: 0: 10463.7. Samples: 357199328. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:06:58,989][27935] Avg episode reward: [(0, '-13.829')] [2022-07-13 05:07:03,990][27935] Fps is (10 sec: 5017.1, 60 sec: 5188.2, 300 sec: 5179.0). Total num frames: 178619392. Throughput: 0: 10389.2. Samples: 357258160. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:03,990][27935] Avg episode reward: [(0, '-12.125')] [2022-07-13 05:07:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 178646016. Throughput: 0: 10387.5. Samples: 357289492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:08,989][27935] Avg episode reward: [(0, '-12.968')] [2022-07-13 05:07:13,989][27935] Fps is (10 sec: 5325.3, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 178672640. Throughput: 0: 10390.7. Samples: 357352516. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:13,990][27935] Avg episode reward: [(0, '-12.634')] [2022-07-13 05:07:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 178698240. Throughput: 0: 10403.1. Samples: 357415124. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:18,989][27935] Avg episode reward: [(0, '-10.917')] [2022-07-13 05:07:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5179.0). Total num frames: 178723840. Throughput: 0: 10412.7. Samples: 357446892. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:23,989][27935] Avg episode reward: [(0, '-13.000')] [2022-07-13 05:07:28,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 178749440. Throughput: 0: 10398.7. Samples: 357509696. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:28,989][27935] Avg episode reward: [(0, '-16.138')] [2022-07-13 05:07:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 178777088. Throughput: 0: 10387.0. Samples: 357571968. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:33,989][27935] Avg episode reward: [(0, '-17.175')] [2022-07-13 05:07:38,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 178801664. Throughput: 0: 10369.9. Samples: 357603056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:38,989][27935] Avg episode reward: [(0, '-13.774')] [2022-07-13 05:07:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 178827264. Throughput: 0: 10338.8. Samples: 357664572. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:43,990][27935] Avg episode reward: [(0, '-13.399')] [2022-07-13 05:07:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 178852864. Throughput: 0: 10413.4. Samples: 357726752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:48,989][27935] Avg episode reward: [(0, '-13.213')] [2022-07-13 05:07:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 178879488. Throughput: 0: 10412.4. Samples: 357758052. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 05:07:53,989][27935] Avg episode reward: [(0, '-12.555')] [2022-07-13 05:07:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 178905088. Throughput: 0: 10390.1. Samples: 357820068. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:07:58,991][27935] Avg episode reward: [(0, '-10.963')] [2022-07-13 05:08:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.2, 300 sec: 5179.0). Total num frames: 178928640. Throughput: 0: 10289.7. Samples: 357878160. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:03,991][27935] Avg episode reward: [(0, '-8.076')] [2022-07-13 05:08:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 178956288. Throughput: 0: 10274.0. Samples: 357909224. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:08,989][27935] Avg episode reward: [(0, '-10.102')] [2022-07-13 05:08:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 178981888. Throughput: 0: 10280.4. Samples: 357972316. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:13,990][27935] Avg episode reward: [(0, '-11.505')] [2022-07-13 05:08:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 179007488. Throughput: 0: 10289.3. Samples: 358034988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:18,989][27935] Avg episode reward: [(0, '-11.226')] [2022-07-13 05:08:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 179034112. Throughput: 0: 10307.8. Samples: 358066904. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:23,989][27935] Avg episode reward: [(0, '-12.383')] [2022-07-13 05:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 179060736. Throughput: 0: 10345.9. Samples: 358130136. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:28,989][27935] Avg episode reward: [(0, '-12.411')] [2022-07-13 05:08:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 179087360. Throughput: 0: 10359.4. Samples: 358192924. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:33,989][27935] Avg episode reward: [(0, '-12.087')] [2022-07-13 05:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 179111936. Throughput: 0: 10364.9. Samples: 358224472. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:38,990][27935] Avg episode reward: [(0, '-15.870')] [2022-07-13 05:08:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 179138560. Throughput: 0: 10380.0. Samples: 358287168. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:43,989][27935] Avg episode reward: [(0, '-15.362')] [2022-07-13 05:08:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 179165184. Throughput: 0: 10491.7. Samples: 358350288. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:48,989][27935] Avg episode reward: [(0, '-14.668')] [2022-07-13 05:08:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 179191808. Throughput: 0: 10507.6. Samples: 358382064. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:53,989][27935] Avg episode reward: [(0, '-12.073')] [2022-07-13 05:08:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 179217408. Throughput: 0: 10503.8. Samples: 358444988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:08:58,989][27935] Avg episode reward: [(0, '-11.425')] [2022-07-13 05:09:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 179243008. Throughput: 0: 10430.7. Samples: 358504368. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:03,989][27935] Avg episode reward: [(0, '-11.994')] [2022-07-13 05:09:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 179266560. Throughput: 0: 10425.1. Samples: 358536036. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:08,989][27935] Avg episode reward: [(0, '-8.876')] [2022-07-13 05:09:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 179295232. Throughput: 0: 10423.6. Samples: 358599196. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:13,990][27935] Avg episode reward: [(0, '-8.919')] [2022-07-13 05:09:19,000][27935] Fps is (10 sec: 5523.2, 60 sec: 5238.5, 300 sec: 5189.2). Total num frames: 179321856. Throughput: 0: 10406.9. Samples: 358661356. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:19,002][27935] Avg episode reward: [(0, '-7.480')] [2022-07-13 05:09:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 179347456. Throughput: 0: 10413.0. Samples: 358693056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:23,989][27935] Avg episode reward: [(0, '-8.042')] [2022-07-13 05:09:28,989][27935] Fps is (10 sec: 5228.5, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 179374080. Throughput: 0: 10414.7. Samples: 358755828. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:28,989][27935] Avg episode reward: [(0, '-8.212')] [2022-07-13 05:09:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 179399680. Throughput: 0: 10393.2. Samples: 358817984. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:33,990][27935] Avg episode reward: [(0, '-9.075')] [2022-07-13 05:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 179423232. Throughput: 0: 10383.7. Samples: 358849332. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:38,989][27935] Avg episode reward: [(0, '-9.813')] [2022-07-13 05:09:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5196.4). Total num frames: 179453952. Throughput: 0: 10389.8. Samples: 358912528. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:43,989][27935] Avg episode reward: [(0, '-10.660')] [2022-07-13 05:09:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 179477504. Throughput: 0: 10475.7. Samples: 358975776. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:48,989][27935] Avg episode reward: [(0, '-10.442')] [2022-07-13 05:09:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 179505152. Throughput: 0: 10478.7. Samples: 359007576. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:53,989][27935] Avg episode reward: [(0, '-10.238')] [2022-07-13 05:09:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 179530752. Throughput: 0: 10471.4. Samples: 359070408. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:09:58,991][27935] Avg episode reward: [(0, '-10.499')] [2022-07-13 05:10:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 179555328. Throughput: 0: 10406.7. Samples: 359129536. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 05:10:03,989][27935] Avg episode reward: [(0, '-10.287')] [2022-07-13 05:10:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 179579904. Throughput: 0: 10394.4. Samples: 359160804. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:08,990][27935] Avg episode reward: [(0, '-9.848')] [2022-07-13 05:10:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 179607552. Throughput: 0: 10395.9. Samples: 359223644. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:13,990][27935] Avg episode reward: [(0, '-9.206')] [2022-07-13 05:10:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5189.3, 300 sec: 5189.4). Total num frames: 179633152. Throughput: 0: 10416.3. Samples: 359286716. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:18,991][27935] Avg episode reward: [(0, '-9.927')] [2022-07-13 05:10:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 179658752. Throughput: 0: 10418.9. Samples: 359318184. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:23,989][27935] Avg episode reward: [(0, '-9.336')] [2022-07-13 05:10:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 179686400. Throughput: 0: 10414.0. Samples: 359381160. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:28,989][27935] Avg episode reward: [(0, '-8.808')] [2022-07-13 05:10:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 179710976. Throughput: 0: 10387.0. Samples: 359443192. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:33,989][27935] Avg episode reward: [(0, '-9.976')] [2022-07-13 05:10:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 179737600. Throughput: 0: 10344.3. Samples: 359473068. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:38,989][27935] Avg episode reward: [(0, '-9.581')] [2022-07-13 05:10:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 179762176. Throughput: 0: 10302.3. Samples: 359534012. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:43,989][27935] Avg episode reward: [(0, '-8.942')] [2022-07-13 05:10:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 179789824. Throughput: 0: 10389.6. Samples: 359597068. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:48,989][27935] Avg episode reward: [(0, '-9.406')] [2022-07-13 05:10:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 179815424. Throughput: 0: 10405.6. Samples: 359629056. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:53,989][27935] Avg episode reward: [(0, '-8.576')] [2022-07-13 05:10:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 179841024. Throughput: 0: 10405.5. Samples: 359691892. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:10:58,989][27935] Avg episode reward: [(0, '-8.503')] [2022-07-13 05:11:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 179865600. Throughput: 0: 10335.6. Samples: 359751816. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:03,989][27935] Avg episode reward: [(0, '-8.140')] [2022-07-13 05:11:08,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5222.3, 300 sec: 5203.3). Total num frames: 179893248. Throughput: 0: 10342.8. Samples: 359783616. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:08,990][27935] Avg episode reward: [(0, '-8.962')] [2022-07-13 05:11:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 179918848. Throughput: 0: 10345.7. Samples: 359846716. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:13,989][27935] Avg episode reward: [(0, '-9.786')] [2022-07-13 05:11:18,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 179944448. Throughput: 0: 10365.3. Samples: 359909632. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:18,989][27935] Avg episode reward: [(0, '-9.909')] [2022-07-13 05:11:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 179971072. Throughput: 0: 10399.4. Samples: 359941040. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:23,989][27935] Avg episode reward: [(0, '-9.940')] [2022-07-13 05:11:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 179996672. Throughput: 0: 10442.6. Samples: 360003928. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:28,989][27935] Avg episode reward: [(0, '-10.048')] [2022-07-13 05:11:33,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 180023296. Throughput: 0: 10423.4. Samples: 360066124. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:33,989][27935] Avg episode reward: [(0, '-8.272')] [2022-07-13 05:11:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 180049920. Throughput: 0: 10415.0. Samples: 360097732. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:38,989][27935] Avg episode reward: [(0, '-7.357')] [2022-07-13 05:11:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 180075520. Throughput: 0: 10411.6. Samples: 360160412. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:43,989][27935] Avg episode reward: [(0, '-7.793')] [2022-07-13 05:11:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 180102144. Throughput: 0: 10477.1. Samples: 360223284. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:48,989][27935] Avg episode reward: [(0, '-7.180')] [2022-07-13 05:11:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 180127744. Throughput: 0: 10473.7. Samples: 360254924. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:53,989][27935] Avg episode reward: [(0, '-8.105')] [2022-07-13 05:11:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180154368. Throughput: 0: 10469.7. Samples: 360317852. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:11:58,989][27935] Avg episode reward: [(0, '-7.628')] [2022-07-13 05:12:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 180178944. Throughput: 0: 10380.8. Samples: 360376768. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:12:03,989][27935] Avg episode reward: [(0, '-8.461')] [2022-07-13 05:12:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 180204544. Throughput: 0: 10380.4. Samples: 360408160. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:12:08,989][27935] Avg episode reward: [(0, '-9.199')] [2022-07-13 05:12:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 180231168. Throughput: 0: 10377.1. Samples: 360470896. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:12:13,989][27935] Avg episode reward: [(0, '-8.579')] [2022-07-13 05:12:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 180257792. Throughput: 0: 10393.0. Samples: 360533808. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:18,989][27935] Avg episode reward: [(0, '-10.115')] [2022-07-13 05:12:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 180282368. Throughput: 0: 10390.5. Samples: 360565304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:23,990][27935] Avg episode reward: [(0, '-9.836')] [2022-07-13 05:12:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 180308992. Throughput: 0: 10414.0. Samples: 360629040. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:28,990][27935] Avg episode reward: [(0, '-10.959')] [2022-07-13 05:12:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180336640. Throughput: 0: 10404.6. Samples: 360691492. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:33,990][27935] Avg episode reward: [(0, '-11.059')] [2022-07-13 05:12:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 180362240. Throughput: 0: 10408.4. Samples: 360723304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:38,989][27935] Avg episode reward: [(0, '-10.939')] [2022-07-13 05:12:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 180387840. Throughput: 0: 10380.8. Samples: 360784988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:43,989][27935] Avg episode reward: [(0, '-10.439')] [2022-07-13 05:12:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 180413440. Throughput: 0: 10475.6. Samples: 360848168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:48,989][27935] Avg episode reward: [(0, '-9.325')] [2022-07-13 05:12:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 180441088. Throughput: 0: 10489.1. Samples: 360880168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:53,989][27935] Avg episode reward: [(0, '-8.794')] [2022-07-13 05:12:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 180466688. Throughput: 0: 10498.1. Samples: 360943312. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:12:58,989][27935] Avg episode reward: [(0, '-8.528')] [2022-07-13 05:13:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 180491264. Throughput: 0: 10409.4. Samples: 361002232. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:03,989][27935] Avg episode reward: [(0, '-8.341')] [2022-07-13 05:13:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 180517888. Throughput: 0: 10409.8. Samples: 361033744. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:08,989][27935] Avg episode reward: [(0, '-8.956')] [2022-07-13 05:13:13,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5222.4, 300 sec: 5210.2). Total num frames: 180544512. Throughput: 0: 10380.9. Samples: 361096180. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:13,989][27935] Avg episode reward: [(0, '-9.587')] [2022-07-13 05:13:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 180569088. Throughput: 0: 10379.5. Samples: 361158568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:18,989][27935] Avg episode reward: [(0, '-9.549')] [2022-07-13 05:13:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180595712. Throughput: 0: 10381.9. Samples: 361190488. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:23,991][27935] Avg episode reward: [(0, '-9.650')] [2022-07-13 05:13:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 180621312. Throughput: 0: 10410.1. Samples: 361253444. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:28,990][27935] Avg episode reward: [(0, '-9.804')] [2022-07-13 05:13:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 180648960. Throughput: 0: 10390.7. Samples: 361315752. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:33,989][27935] Avg episode reward: [(0, '-10.702')] [2022-07-13 05:13:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 180673536. Throughput: 0: 10379.6. Samples: 361347252. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:38,989][27935] Avg episode reward: [(0, '-11.683')] [2022-07-13 05:13:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 180700160. Throughput: 0: 10359.6. Samples: 361409492. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:43,989][27935] Avg episode reward: [(0, '-11.817')] [2022-07-13 05:13:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180726784. Throughput: 0: 10449.9. Samples: 361472480. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:48,989][27935] Avg episode reward: [(0, '-12.248')] [2022-07-13 05:13:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 180753408. Throughput: 0: 10459.3. Samples: 361504412. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:53,989][27935] Avg episode reward: [(0, '-12.828')] [2022-07-13 05:13:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 180779008. Throughput: 0: 10478.0. Samples: 361567688. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:13:58,991][27935] Avg episode reward: [(0, '-13.808')] [2022-07-13 05:14:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 180803584. Throughput: 0: 10408.5. Samples: 361626952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:14:03,991][27935] Avg episode reward: [(0, '-12.242')] [2022-07-13 05:14:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 180830208. Throughput: 0: 10405.3. Samples: 361658728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:14:08,989][27935] Avg episode reward: [(0, '-12.125')] [2022-07-13 05:14:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.5). Total num frames: 180856832. Throughput: 0: 10410.5. Samples: 361721916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:14:13,996][27935] Avg episode reward: [(0, '-9.908')] [2022-07-13 05:14:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180882432. Throughput: 0: 10412.6. Samples: 361784320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:14:18,989][27935] Avg episode reward: [(0, '-9.437')] [2022-07-13 05:14:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 180908032. Throughput: 0: 10413.5. Samples: 361815860. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 05:14:23,989][27935] Avg episode reward: [(0, '-8.690')] [2022-07-13 05:14:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 180934656. Throughput: 0: 10437.4. Samples: 361879176. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:28,989][27935] Avg episode reward: [(0, '-7.214')] [2022-07-13 05:14:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 180961280. Throughput: 0: 10410.5. Samples: 361940952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:33,989][27935] Avg episode reward: [(0, '-7.187')] [2022-07-13 05:14:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 180986880. Throughput: 0: 10406.4. Samples: 361972700. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:38,989][27935] Avg episode reward: [(0, '-7.722')] [2022-07-13 05:14:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 181012480. Throughput: 0: 10407.1. Samples: 362036008. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:43,989][27935] Avg episode reward: [(0, '-8.225')] [2022-07-13 05:14:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 181039104. Throughput: 0: 10477.4. Samples: 362098436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:48,989][27935] Avg episode reward: [(0, '-8.380')] [2022-07-13 05:14:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 181065728. Throughput: 0: 10481.2. Samples: 362130380. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:53,990][27935] Avg episode reward: [(0, '-10.402')] [2022-07-13 05:14:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181091328. Throughput: 0: 10484.3. Samples: 362193708. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:14:58,989][27935] Avg episode reward: [(0, '-9.766')] [2022-07-13 05:15:03,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5222.1, 300 sec: 5210.2). Total num frames: 181116928. Throughput: 0: 9803.6. Samples: 362225516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:03,993][27935] Avg episode reward: [(0, '-10.842')] [2022-07-13 05:15:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 181143552. Throughput: 0: 10419.7. Samples: 362284748. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:08,989][27935] Avg episode reward: [(0, '-9.288')] [2022-07-13 05:15:13,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181169152. Throughput: 0: 10405.0. Samples: 362347404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:13,989][27935] Avg episode reward: [(0, '-10.453')] [2022-07-13 05:15:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181194752. Throughput: 0: 10431.3. Samples: 362410360. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:18,989][27935] Avg episode reward: [(0, '-9.389')] [2022-07-13 05:15:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 181221376. Throughput: 0: 10434.5. Samples: 362442252. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:23,989][27935] Avg episode reward: [(0, '-8.717')] [2022-07-13 05:15:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 181249024. Throughput: 0: 10428.8. Samples: 362505304. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:28,989][27935] Avg episode reward: [(0, '-10.075')] [2022-07-13 05:15:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181273600. Throughput: 0: 10434.4. Samples: 362567984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:33,989][27935] Avg episode reward: [(0, '-10.447')] [2022-07-13 05:15:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 181301248. Throughput: 0: 10421.5. Samples: 362599348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:38,992][27935] Avg episode reward: [(0, '-11.526')] [2022-07-13 05:15:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 181325824. Throughput: 0: 10417.1. Samples: 362662476. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:43,989][27935] Avg episode reward: [(0, '-12.688')] [2022-07-13 05:15:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181351424. Throughput: 0: 11082.9. Samples: 362724208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:48,991][27935] Avg episode reward: [(0, '-13.330')] [2022-07-13 05:15:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 181378048. Throughput: 0: 10450.6. Samples: 362755024. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:53,991][27935] Avg episode reward: [(0, '-14.983')] [2022-07-13 05:15:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 181404672. Throughput: 0: 10449.5. Samples: 362817632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:15:58,993][27935] Avg episode reward: [(0, '-14.868')] [2022-07-13 05:16:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.6, 300 sec: 5203.3). Total num frames: 181428224. Throughput: 0: 10358.0. Samples: 362876468. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:03,989][27935] Avg episode reward: [(0, '-13.200')] [2022-07-13 05:16:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 181453824. Throughput: 0: 10350.9. Samples: 362908044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:08,989][27935] Avg episode reward: [(0, '-13.830')] [2022-07-13 05:16:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 181482496. Throughput: 0: 10357.1. Samples: 362971372. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:13,989][27935] Avg episode reward: [(0, '-12.162')] [2022-07-13 05:16:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 181506048. Throughput: 0: 10357.9. Samples: 363034088. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:18,989][27935] Avg episode reward: [(0, '-10.717')] [2022-07-13 05:16:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 181532672. Throughput: 0: 10346.5. Samples: 363064940. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:23,989][27935] Avg episode reward: [(0, '-10.069')] [2022-07-13 05:16:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 181560320. Throughput: 0: 10367.2. Samples: 363129000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:28,989][27935] Avg episode reward: [(0, '-9.750')] [2022-07-13 05:16:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 181586944. Throughput: 0: 10378.6. Samples: 363191244. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 05:16:33,989][27935] Avg episode reward: [(0, '-9.976')] [2022-07-13 05:16:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 181611520. Throughput: 0: 10398.8. Samples: 363222972. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:16:38,989][27935] Avg episode reward: [(0, '-12.079')] [2022-07-13 05:16:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 181637120. Throughput: 0: 10361.1. Samples: 363283880. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:16:43,989][27935] Avg episode reward: [(0, '-14.314')] [2022-07-13 05:16:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181663744. Throughput: 0: 10428.3. Samples: 363345744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:16:48,989][27935] Avg episode reward: [(0, '-14.632')] [2022-07-13 05:16:53,996][27935] Fps is (10 sec: 5218.4, 60 sec: 5187.6, 300 sec: 5203.2). Total num frames: 181689344. Throughput: 0: 10427.7. Samples: 363377372. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:16:53,997][27935] Avg episode reward: [(0, '-15.469')] [2022-07-13 05:16:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 181714944. Throughput: 0: 10429.5. Samples: 363440700. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:16:58,989][27935] Avg episode reward: [(0, '-16.752')] [2022-07-13 05:17:03,989][27935] Fps is (10 sec: 5123.9, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181740544. Throughput: 0: 10339.2. Samples: 363499352. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:03,989][27935] Avg episode reward: [(0, '-16.338')] [2022-07-13 05:17:08,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 181767168. Throughput: 0: 10358.0. Samples: 363531052. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:08,989][27935] Avg episode reward: [(0, '-15.045')] [2022-07-13 05:17:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 181790720. Throughput: 0: 10325.9. Samples: 363593668. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:13,989][27935] Avg episode reward: [(0, '-14.282')] [2022-07-13 05:17:18,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 181818368. Throughput: 0: 10317.3. Samples: 363655524. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:18,989][27935] Avg episode reward: [(0, '-12.846')] [2022-07-13 05:17:23,989][27935] Fps is (10 sec: 5529.7, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 181846016. Throughput: 0: 10313.3. Samples: 363687072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:23,989][27935] Avg episode reward: [(0, '-13.770')] [2022-07-13 05:17:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 181870592. Throughput: 0: 10362.5. Samples: 363750192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:28,989][27935] Avg episode reward: [(0, '-13.928')] [2022-07-13 05:17:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 181896192. Throughput: 0: 10367.8. Samples: 363812296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:33,989][27935] Avg episode reward: [(0, '-12.853')] [2022-07-13 05:17:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 181921792. Throughput: 0: 10368.6. Samples: 363843880. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:38,989][27935] Avg episode reward: [(0, '-14.174')] [2022-07-13 05:17:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 181948416. Throughput: 0: 10332.7. Samples: 363905672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:43,989][27935] Avg episode reward: [(0, '-11.514')] [2022-07-13 05:17:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 181974016. Throughput: 0: 10418.5. Samples: 363968184. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:48,989][27935] Avg episode reward: [(0, '-13.272')] [2022-07-13 05:17:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.9, 300 sec: 5199.8). Total num frames: 182000640. Throughput: 0: 10417.5. Samples: 363999836. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:53,989][27935] Avg episode reward: [(0, '-12.821')] [2022-07-13 05:17:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 182026240. Throughput: 0: 10426.5. Samples: 364062860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:17:58,989][27935] Avg episode reward: [(0, '-9.290')] [2022-07-13 05:18:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 182051840. Throughput: 0: 10349.0. Samples: 364121228. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:03,989][27935] Avg episode reward: [(0, '-9.834')] [2022-07-13 05:18:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 182076416. Throughput: 0: 10341.9. Samples: 364152460. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:08,989][27935] Avg episode reward: [(0, '-8.091')] [2022-07-13 05:18:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 182104064. Throughput: 0: 10331.8. Samples: 364215124. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:13,989][27935] Avg episode reward: [(0, '-9.477')] [2022-07-13 05:18:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 182128640. Throughput: 0: 10332.2. Samples: 364277244. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:18,989][27935] Avg episode reward: [(0, '-8.108')] [2022-07-13 05:18:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 182155264. Throughput: 0: 10326.6. Samples: 364308576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:23,989][27935] Avg episode reward: [(0, '-7.376')] [2022-07-13 05:18:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 182180864. Throughput: 0: 10346.8. Samples: 364371280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:28,989][27935] Avg episode reward: [(0, '-8.238')] [2022-07-13 05:18:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 182206464. Throughput: 0: 10334.2. Samples: 364433224. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:33,989][27935] Avg episode reward: [(0, '-10.026')] [2022-07-13 05:18:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 182233088. Throughput: 0: 10329.6. Samples: 364464668. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:38,989][27935] Avg episode reward: [(0, '-10.179')] [2022-07-13 05:18:43,989][27935] Fps is (10 sec: 5324.4, 60 sec: 5188.2, 300 sec: 5196.4). Total num frames: 182259712. Throughput: 0: 10323.6. Samples: 364527428. Policy #0 lag: (min: 0.0, avg: 9.4, max: 19.0) [2022-07-13 05:18:43,990][27935] Avg episode reward: [(0, '-9.648')] [2022-07-13 05:18:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 182285312. Throughput: 0: 10406.3. Samples: 364589512. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:18:48,989][27935] Avg episode reward: [(0, '-12.087')] [2022-07-13 05:18:53,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 182310912. Throughput: 0: 10410.2. Samples: 364620920. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:18:53,991][27935] Avg episode reward: [(0, '-11.228')] [2022-07-13 05:18:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 182338560. Throughput: 0: 10409.2. Samples: 364683540. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:18:58,989][27935] Avg episode reward: [(0, '-11.372')] [2022-07-13 05:19:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 182361088. Throughput: 0: 10333.3. Samples: 364742244. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:03,991][27935] Avg episode reward: [(0, '-10.970')] [2022-07-13 05:19:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 182388736. Throughput: 0: 10325.8. Samples: 364773236. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:08,991][27935] Avg episode reward: [(0, '-11.292')] [2022-07-13 05:19:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 182413312. Throughput: 0: 10330.4. Samples: 364836148. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:13,989][27935] Avg episode reward: [(0, '-10.800')] [2022-07-13 05:19:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 182439936. Throughput: 0: 10346.9. Samples: 364898836. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:18,989][27935] Avg episode reward: [(0, '-9.808')] [2022-07-13 05:19:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 182465536. Throughput: 0: 10343.7. Samples: 364930136. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:23,990][27935] Avg episode reward: [(0, '-7.851')] [2022-07-13 05:19:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 182492160. Throughput: 0: 10344.3. Samples: 364992916. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:28,989][27935] Avg episode reward: [(0, '-8.808')] [2022-07-13 05:19:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 182518784. Throughput: 0: 10368.2. Samples: 365056080. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:33,991][27935] Avg episode reward: [(0, '-7.849')] [2022-07-13 05:19:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 182543360. Throughput: 0: 10367.9. Samples: 365087476. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:38,990][27935] Avg episode reward: [(0, '-8.154')] [2022-07-13 05:19:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 182571008. Throughput: 0: 10374.1. Samples: 365150372. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:43,989][27935] Avg episode reward: [(0, '-9.682')] [2022-07-13 05:19:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 182596608. Throughput: 0: 10472.9. Samples: 365213524. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:48,989][27935] Avg episode reward: [(0, '-9.504')] [2022-07-13 05:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 182623232. Throughput: 0: 10483.7. Samples: 365245004. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:53,990][27935] Avg episode reward: [(0, '-9.926')] [2022-07-13 05:19:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 182649856. Throughput: 0: 10481.7. Samples: 365307824. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:19:58,989][27935] Avg episode reward: [(0, '-9.045')] [2022-07-13 05:20:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 182673408. Throughput: 0: 10389.0. Samples: 365366340. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:03,989][27935] Avg episode reward: [(0, '-10.857')] [2022-07-13 05:20:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 182700032. Throughput: 0: 10389.6. Samples: 365397668. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:08,989][27935] Avg episode reward: [(0, '-10.389')] [2022-07-13 05:20:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 182725632. Throughput: 0: 10403.8. Samples: 365461088. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:13,989][27935] Avg episode reward: [(0, '-10.392')] [2022-07-13 05:20:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 182753280. Throughput: 0: 10417.6. Samples: 365524872. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:18,989][27935] Avg episode reward: [(0, '-11.379')] [2022-07-13 05:20:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 182778880. Throughput: 0: 10412.3. Samples: 365556028. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:23,989][27935] Avg episode reward: [(0, '-14.190')] [2022-07-13 05:20:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 182804480. Throughput: 0: 10417.7. Samples: 365619168. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:28,989][27935] Avg episode reward: [(0, '-14.529')] [2022-07-13 05:20:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 182830080. Throughput: 0: 10400.2. Samples: 365681532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:33,989][27935] Avg episode reward: [(0, '-13.990')] [2022-07-13 05:20:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5192.9). Total num frames: 182857728. Throughput: 0: 10395.8. Samples: 365712816. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:38,989][27935] Avg episode reward: [(0, '-13.322')] [2022-07-13 05:20:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 182883328. Throughput: 0: 10405.1. Samples: 365776052. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:43,989][27935] Avg episode reward: [(0, '-13.336')] [2022-07-13 05:20:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 182910976. Throughput: 0: 10501.9. Samples: 365838928. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:48,989][27935] Avg episode reward: [(0, '-11.069')] [2022-07-13 05:20:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 182935552. Throughput: 0: 10509.7. Samples: 365870604. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 05:20:53,989][27935] Avg episode reward: [(0, '-9.967')] [2022-07-13 05:20:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 182962176. Throughput: 0: 10501.4. Samples: 365933652. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:20:58,989][27935] Avg episode reward: [(0, '-9.676')] [2022-07-13 05:21:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 182987776. Throughput: 0: 10393.9. Samples: 365992596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:03,989][27935] Avg episode reward: [(0, '-9.666')] [2022-07-13 05:21:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 183013376. Throughput: 0: 10398.6. Samples: 366023964. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:08,989][27935] Avg episode reward: [(0, '-9.714')] [2022-07-13 05:21:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 183040000. Throughput: 0: 10400.2. Samples: 366087176. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:13,989][27935] Avg episode reward: [(0, '-10.021')] [2022-07-13 05:21:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 183065600. Throughput: 0: 10406.3. Samples: 366149816. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:18,990][27935] Avg episode reward: [(0, '-10.958')] [2022-07-13 05:21:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 183091200. Throughput: 0: 10406.2. Samples: 366181096. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:23,989][27935] Avg episode reward: [(0, '-8.967')] [2022-07-13 05:21:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 183116800. Throughput: 0: 10389.2. Samples: 366243568. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:28,990][27935] Avg episode reward: [(0, '-10.326')] [2022-07-13 05:21:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 183143424. Throughput: 0: 10378.9. Samples: 366305980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:33,992][27935] Avg episode reward: [(0, '-10.309')] [2022-07-13 05:21:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 183168000. Throughput: 0: 10365.9. Samples: 366337068. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:38,989][27935] Avg episode reward: [(0, '-8.797')] [2022-07-13 05:21:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 183196672. Throughput: 0: 10367.6. Samples: 366400192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:43,989][27935] Avg episode reward: [(0, '-9.385')] [2022-07-13 05:21:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5189.6). Total num frames: 183220224. Throughput: 0: 10457.2. Samples: 366463172. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:48,989][27935] Avg episode reward: [(0, '-7.447')] [2022-07-13 05:21:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 183248896. Throughput: 0: 10465.9. Samples: 366494928. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:53,989][27935] Avg episode reward: [(0, '-7.528')] [2022-07-13 05:21:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 183275520. Throughput: 0: 10466.0. Samples: 366558144. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:21:58,989][27935] Avg episode reward: [(0, '-7.856')] [2022-07-13 05:22:03,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 183299072. Throughput: 0: 10384.3. Samples: 366617112. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:03,989][27935] Avg episode reward: [(0, '-5.785')] [2022-07-13 05:22:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 183323648. Throughput: 0: 10390.4. Samples: 366648664. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:08,989][27935] Avg episode reward: [(0, '-7.472')] [2022-07-13 05:22:13,990][27935] Fps is (10 sec: 5221.8, 60 sec: 5188.2, 300 sec: 5196.3). Total num frames: 183351296. Throughput: 0: 10405.4. Samples: 366711824. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:13,990][27935] Avg episode reward: [(0, '-10.076')] [2022-07-13 05:22:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 183377920. Throughput: 0: 10409.2. Samples: 366774392. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:18,989][27935] Avg episode reward: [(0, '-9.988')] [2022-07-13 05:22:23,989][27935] Fps is (10 sec: 5223.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 183403520. Throughput: 0: 10424.4. Samples: 366806168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:23,989][27935] Avg episode reward: [(0, '-9.157')] [2022-07-13 05:22:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 183429120. Throughput: 0: 10410.5. Samples: 366868664. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:28,989][27935] Avg episode reward: [(0, '-9.222')] [2022-07-13 05:22:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 183455744. Throughput: 0: 10402.6. Samples: 366931288. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:33,989][27935] Avg episode reward: [(0, '-9.571')] [2022-07-13 05:22:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 183481344. Throughput: 0: 10397.5. Samples: 366962816. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:38,989][27935] Avg episode reward: [(0, '-9.853')] [2022-07-13 05:22:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 183506944. Throughput: 0: 10357.0. Samples: 367024208. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:43,989][27935] Avg episode reward: [(0, '-8.521')] [2022-07-13 05:22:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 183532544. Throughput: 0: 10383.2. Samples: 367084356. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:48,990][27935] Avg episode reward: [(0, '-9.934')] [2022-07-13 05:22:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 183558144. Throughput: 0: 10379.2. Samples: 367115728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:53,991][27935] Avg episode reward: [(0, '-11.065')] [2022-07-13 05:22:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 183584768. Throughput: 0: 10369.5. Samples: 367178440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:22:58,989][27935] Avg episode reward: [(0, '-10.547')] [2022-07-13 05:23:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 183607296. Throughput: 0: 10293.3. Samples: 367237592. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:23:03,989][27935] Avg episode reward: [(0, '-10.126')] [2022-07-13 05:23:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 183635968. Throughput: 0: 10286.3. Samples: 367269052. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 05:23:08,991][27935] Avg episode reward: [(0, '-8.755')] [2022-07-13 05:23:13,995][27935] Fps is (10 sec: 5526.1, 60 sec: 5187.8, 300 sec: 5199.7). Total num frames: 183662592. Throughput: 0: 10298.0. Samples: 367332140. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:13,996][27935] Avg episode reward: [(0, '-10.064')] [2022-07-13 05:23:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 183688192. Throughput: 0: 10312.6. Samples: 367395356. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:18,989][27935] Avg episode reward: [(0, '-10.371')] [2022-07-13 05:23:23,989][27935] Fps is (10 sec: 5123.3, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 183713792. Throughput: 0: 10324.7. Samples: 367427428. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:23,989][27935] Avg episode reward: [(0, '-10.293')] [2022-07-13 05:23:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 183740416. Throughput: 0: 10341.2. Samples: 367489560. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:28,989][27935] Avg episode reward: [(0, '-12.195')] [2022-07-13 05:23:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 183767040. Throughput: 0: 10391.6. Samples: 367551976. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:33,989][27935] Avg episode reward: [(0, '-13.264')] [2022-07-13 05:23:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 183791616. Throughput: 0: 10391.9. Samples: 367583364. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:38,989][27935] Avg episode reward: [(0, '-12.917')] [2022-07-13 05:23:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 183819264. Throughput: 0: 10396.6. Samples: 367646288. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:43,989][27935] Avg episode reward: [(0, '-13.042')] [2022-07-13 05:23:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 183844864. Throughput: 0: 10474.8. Samples: 367708956. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:48,989][27935] Avg episode reward: [(0, '-13.078')] [2022-07-13 05:23:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 183870464. Throughput: 0: 10477.0. Samples: 367740516. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:53,991][27935] Avg episode reward: [(0, '-15.607')] [2022-07-13 05:23:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 183897088. Throughput: 0: 10477.6. Samples: 367803564. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:23:58,989][27935] Avg episode reward: [(0, '-15.176')] [2022-07-13 05:24:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 183921664. Throughput: 0: 10390.6. Samples: 367862932. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:03,989][27935] Avg episode reward: [(0, '-13.864')] [2022-07-13 05:24:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 183948288. Throughput: 0: 10377.8. Samples: 367894428. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:08,989][27935] Avg episode reward: [(0, '-13.798')] [2022-07-13 05:24:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.8, 300 sec: 5199.8). Total num frames: 183973888. Throughput: 0: 10405.7. Samples: 367957816. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:13,990][27935] Avg episode reward: [(0, '-12.834')] [2022-07-13 05:24:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 184001536. Throughput: 0: 10418.0. Samples: 368020784. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:18,989][27935] Avg episode reward: [(0, '-12.168')] [2022-07-13 05:24:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 184027136. Throughput: 0: 10425.7. Samples: 368052520. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:23,989][27935] Avg episode reward: [(0, '-9.501')] [2022-07-13 05:24:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184052736. Throughput: 0: 10426.8. Samples: 368115496. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:28,989][27935] Avg episode reward: [(0, '-8.414')] [2022-07-13 05:24:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 184078336. Throughput: 0: 10415.5. Samples: 368177652. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:33,989][27935] Avg episode reward: [(0, '-8.459')] [2022-07-13 05:24:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 184105984. Throughput: 0: 10421.7. Samples: 368209492. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:38,989][27935] Avg episode reward: [(0, '-7.862')] [2022-07-13 05:24:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 184132608. Throughput: 0: 10419.3. Samples: 368272432. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:43,989][27935] Avg episode reward: [(0, '-7.943')] [2022-07-13 05:24:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184157184. Throughput: 0: 10494.7. Samples: 368335192. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:48,989][27935] Avg episode reward: [(0, '-8.588')] [2022-07-13 05:24:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 184183808. Throughput: 0: 10493.1. Samples: 368366616. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:53,990][27935] Avg episode reward: [(0, '-8.558')] [2022-07-13 05:24:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 184209408. Throughput: 0: 10486.2. Samples: 368429696. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:24:58,989][27935] Avg episode reward: [(0, '-7.571')] [2022-07-13 05:25:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 184236032. Throughput: 0: 10404.4. Samples: 368488980. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:25:03,989][27935] Avg episode reward: [(0, '-8.364')] [2022-07-13 05:25:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184260608. Throughput: 0: 10405.1. Samples: 368520748. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:25:08,991][27935] Avg episode reward: [(0, '-7.363')] [2022-07-13 05:25:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 184288256. Throughput: 0: 10414.0. Samples: 368584128. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:25:13,989][27935] Avg episode reward: [(0, '-8.265')] [2022-07-13 05:25:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 184312832. Throughput: 0: 10426.5. Samples: 368646844. Policy #0 lag: (min: 0.0, avg: 10.7, max: 22.0) [2022-07-13 05:25:18,989][27935] Avg episode reward: [(0, '-7.876')] [2022-07-13 05:25:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184339456. Throughput: 0: 10416.6. Samples: 368678240. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:23,991][27935] Avg episode reward: [(0, '-7.534')] [2022-07-13 05:25:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184365056. Throughput: 0: 10411.0. Samples: 368740928. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:28,990][27935] Avg episode reward: [(0, '-9.070')] [2022-07-13 05:25:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 184392704. Throughput: 0: 10419.1. Samples: 368804052. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:33,990][27935] Avg episode reward: [(0, '-9.339')] [2022-07-13 05:25:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184418304. Throughput: 0: 10414.7. Samples: 368835280. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:38,991][27935] Avg episode reward: [(0, '-11.689')] [2022-07-13 05:25:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184443904. Throughput: 0: 10401.3. Samples: 368897756. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:43,989][27935] Avg episode reward: [(0, '-11.632')] [2022-07-13 05:25:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184468480. Throughput: 0: 10468.9. Samples: 368960080. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:48,991][27935] Avg episode reward: [(0, '-10.900')] [2022-07-13 05:25:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 184497152. Throughput: 0: 10458.8. Samples: 368991396. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:53,989][27935] Avg episode reward: [(0, '-12.255')] [2022-07-13 05:25:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184521728. Throughput: 0: 10442.8. Samples: 369054052. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:25:58,989][27935] Avg episode reward: [(0, '-10.975')] [2022-07-13 05:26:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 184547328. Throughput: 0: 10363.5. Samples: 369113200. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:03,989][27935] Avg episode reward: [(0, '-12.943')] [2022-07-13 05:26:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 184571904. Throughput: 0: 10364.3. Samples: 369144632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:08,990][27935] Avg episode reward: [(0, '-13.200')] [2022-07-13 05:26:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 184599552. Throughput: 0: 10366.8. Samples: 369207436. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:13,989][27935] Avg episode reward: [(0, '-12.879')] [2022-07-13 05:26:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184625152. Throughput: 0: 9657.8. Samples: 369238652. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:18,990][27935] Avg episode reward: [(0, '-13.558')] [2022-07-13 05:26:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184651776. Throughput: 0: 10355.6. Samples: 369301280. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:23,990][27935] Avg episode reward: [(0, '-12.933')] [2022-07-13 05:26:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184677376. Throughput: 0: 10351.6. Samples: 369363580. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:28,989][27935] Avg episode reward: [(0, '-13.173')] [2022-07-13 05:26:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 184701952. Throughput: 0: 10344.4. Samples: 369425576. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:33,989][27935] Avg episode reward: [(0, '-12.460')] [2022-07-13 05:26:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184729600. Throughput: 0: 10342.0. Samples: 369456788. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:38,990][27935] Avg episode reward: [(0, '-14.197')] [2022-07-13 05:26:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 184754176. Throughput: 0: 10341.5. Samples: 369519420. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:43,989][27935] Avg episode reward: [(0, '-14.137')] [2022-07-13 05:26:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 184781824. Throughput: 0: 10427.8. Samples: 369582452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:48,989][27935] Avg episode reward: [(0, '-13.674')] [2022-07-13 05:26:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184808448. Throughput: 0: 10435.0. Samples: 369614208. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:53,989][27935] Avg episode reward: [(0, '-13.337')] [2022-07-13 05:26:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 184834048. Throughput: 0: 10434.6. Samples: 369676992. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:26:58,989][27935] Avg episode reward: [(0, '-13.760')] [2022-07-13 05:27:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 184858624. Throughput: 0: 11050.6. Samples: 369735928. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:03,990][27935] Avg episode reward: [(0, '-13.879')] [2022-07-13 05:27:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 184883200. Throughput: 0: 10354.8. Samples: 369767248. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:08,990][27935] Avg episode reward: [(0, '-10.633')] [2022-07-13 05:27:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184910848. Throughput: 0: 10359.8. Samples: 369829772. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:13,989][27935] Avg episode reward: [(0, '-10.879')] [2022-07-13 05:27:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 184937472. Throughput: 0: 10373.7. Samples: 369892392. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:18,990][27935] Avg episode reward: [(0, '-11.347')] [2022-07-13 05:27:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 184962048. Throughput: 0: 10383.4. Samples: 369924040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:23,990][27935] Avg episode reward: [(0, '-10.930')] [2022-07-13 05:27:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 184988672. Throughput: 0: 10390.7. Samples: 369987004. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 05:27:28,989][27935] Avg episode reward: [(0, '-11.633')] [2022-07-13 05:27:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 185015296. Throughput: 0: 10379.0. Samples: 370049508. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:33,990][27935] Avg episode reward: [(0, '-13.523')] [2022-07-13 05:27:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 185040896. Throughput: 0: 10383.5. Samples: 370081468. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:38,990][27935] Avg episode reward: [(0, '-13.977')] [2022-07-13 05:27:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 185066496. Throughput: 0: 10363.4. Samples: 370143344. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:43,989][27935] Avg episode reward: [(0, '-13.263')] [2022-07-13 05:27:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 185093120. Throughput: 0: 10446.8. Samples: 370206032. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:48,989][27935] Avg episode reward: [(0, '-11.736')] [2022-07-13 05:27:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 185120768. Throughput: 0: 10452.5. Samples: 370237612. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:54,000][27935] Avg episode reward: [(0, '-13.084')] [2022-07-13 05:27:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 185145344. Throughput: 0: 10450.1. Samples: 370300024. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:27:58,989][27935] Avg episode reward: [(0, '-10.854')] [2022-07-13 05:28:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 185169920. Throughput: 0: 9755.7. Samples: 370331396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:03,989][27935] Avg episode reward: [(0, '-9.978')] [2022-07-13 05:28:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5196.5). Total num frames: 185195520. Throughput: 0: 10354.8. Samples: 370390008. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:08,990][27935] Avg episode reward: [(0, '-9.293')] [2022-07-13 05:28:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 185222144. Throughput: 0: 10350.3. Samples: 370452768. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:13,989][27935] Avg episode reward: [(0, '-10.078')] [2022-07-13 05:28:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 185247744. Throughput: 0: 10359.6. Samples: 370515688. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:18,989][27935] Avg episode reward: [(0, '-11.034')] [2022-07-13 05:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 185274368. Throughput: 0: 10349.0. Samples: 370547172. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:23,989][27935] Avg episode reward: [(0, '-9.788')] [2022-07-13 05:28:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 185300992. Throughput: 0: 10367.6. Samples: 370609884. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:28,989][27935] Avg episode reward: [(0, '-10.384')] [2022-07-13 05:28:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 185326592. Throughput: 0: 10367.0. Samples: 370672548. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:33,992][27935] Avg episode reward: [(0, '-8.678')] [2022-07-13 05:28:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 185352192. Throughput: 0: 10358.8. Samples: 370703760. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:38,989][27935] Avg episode reward: [(0, '-8.607')] [2022-07-13 05:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 185378816. Throughput: 0: 10358.8. Samples: 370766172. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:43,989][27935] Avg episode reward: [(0, '-8.365')] [2022-07-13 05:28:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 185404416. Throughput: 0: 11019.2. Samples: 370827260. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:48,989][27935] Avg episode reward: [(0, '-7.092')] [2022-07-13 05:28:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 185428992. Throughput: 0: 10375.8. Samples: 370856920. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:53,989][27935] Avg episode reward: [(0, '-7.634')] [2022-07-13 05:28:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 185455616. Throughput: 0: 10366.3. Samples: 370919252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:28:58,989][27935] Avg episode reward: [(0, '-9.294')] [2022-07-13 05:29:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 185479168. Throughput: 0: 10270.6. Samples: 370977864. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:03,989][27935] Avg episode reward: [(0, '-10.048')] [2022-07-13 05:29:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 185504768. Throughput: 0: 10264.1. Samples: 371009056. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:08,989][27935] Avg episode reward: [(0, '-10.446')] [2022-07-13 05:29:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 185531392. Throughput: 0: 10264.9. Samples: 371071804. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:13,989][27935] Avg episode reward: [(0, '-11.020')] [2022-07-13 05:29:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 185558016. Throughput: 0: 10260.7. Samples: 371134280. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:18,989][27935] Avg episode reward: [(0, '-10.943')] [2022-07-13 05:29:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 185583616. Throughput: 0: 10266.2. Samples: 371165740. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:23,989][27935] Avg episode reward: [(0, '-10.655')] [2022-07-13 05:29:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 185610240. Throughput: 0: 10272.6. Samples: 371228440. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:28,989][27935] Avg episode reward: [(0, '-8.943')] [2022-07-13 05:29:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 185635840. Throughput: 0: 10302.2. Samples: 371290860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:33,989][27935] Avg episode reward: [(0, '-9.681')] [2022-07-13 05:29:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 185661440. Throughput: 0: 10338.0. Samples: 371322128. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 05:29:38,989][27935] Avg episode reward: [(0, '-9.675')] [2022-07-13 05:29:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 185687040. Throughput: 0: 10338.6. Samples: 371384488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:29:43,989][27935] Avg episode reward: [(0, '-8.854')] [2022-07-13 05:29:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 185713664. Throughput: 0: 10429.0. Samples: 371447168. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:29:48,989][27935] Avg episode reward: [(0, '-8.821')] [2022-07-13 05:29:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 185740288. Throughput: 0: 10431.0. Samples: 371478452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:29:53,989][27935] Avg episode reward: [(0, '-8.987')] [2022-07-13 05:29:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 185766912. Throughput: 0: 10436.9. Samples: 371541464. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:29:58,991][27935] Avg episode reward: [(0, '-9.553')] [2022-07-13 05:30:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 185790464. Throughput: 0: 10354.1. Samples: 371600216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:03,991][27935] Avg episode reward: [(0, '-9.116')] [2022-07-13 05:30:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 185817088. Throughput: 0: 10357.8. Samples: 371631840. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:08,989][27935] Avg episode reward: [(0, '-7.444')] [2022-07-13 05:30:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 185841664. Throughput: 0: 10364.0. Samples: 371694820. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:13,989][27935] Avg episode reward: [(0, '-7.607')] [2022-07-13 05:30:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 185870336. Throughput: 0: 10372.6. Samples: 371757628. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:18,989][27935] Avg episode reward: [(0, '-8.674')] [2022-07-13 05:30:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 185894912. Throughput: 0: 10372.6. Samples: 371788896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:23,992][27935] Avg episode reward: [(0, '-7.569')] [2022-07-13 05:30:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 185920512. Throughput: 0: 10375.4. Samples: 371851380. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:28,989][27935] Avg episode reward: [(0, '-6.636')] [2022-07-13 05:30:33,992][27935] Fps is (10 sec: 5118.4, 60 sec: 5170.9, 300 sec: 5179.0). Total num frames: 185946112. Throughput: 0: 10362.9. Samples: 371913528. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:33,992][27935] Avg episode reward: [(0, '-7.206')] [2022-07-13 05:30:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 185972736. Throughput: 0: 10350.3. Samples: 371944216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:38,989][27935] Avg episode reward: [(0, '-8.368')] [2022-07-13 05:30:43,989][27935] Fps is (10 sec: 5224.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 185998336. Throughput: 0: 10339.3. Samples: 372006732. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:43,989][27935] Avg episode reward: [(0, '-5.808')] [2022-07-13 05:30:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186024960. Throughput: 0: 10420.7. Samples: 372069148. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:48,990][27935] Avg episode reward: [(0, '-6.439')] [2022-07-13 05:30:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 186050560. Throughput: 0: 10420.9. Samples: 372100780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:53,991][27935] Avg episode reward: [(0, '-9.536')] [2022-07-13 05:30:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 186077184. Throughput: 0: 10424.1. Samples: 372163904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:30:58,989][27935] Avg episode reward: [(0, '-9.548')] [2022-07-13 05:31:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 186101760. Throughput: 0: 10338.8. Samples: 372222872. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:03,996][27935] Avg episode reward: [(0, '-8.875')] [2022-07-13 05:31:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 186127360. Throughput: 0: 10341.6. Samples: 372254268. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:08,989][27935] Avg episode reward: [(0, '-8.085')] [2022-07-13 05:31:13,990][27935] Fps is (10 sec: 5324.1, 60 sec: 5222.3, 300 sec: 5185.9). Total num frames: 186155008. Throughput: 0: 10365.3. Samples: 372317832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:13,991][27935] Avg episode reward: [(0, '-11.237')] [2022-07-13 05:31:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 186180608. Throughput: 0: 10371.5. Samples: 372380216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:18,992][27935] Avg episode reward: [(0, '-12.311')] [2022-07-13 05:31:23,989][27935] Fps is (10 sec: 5120.6, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 186206208. Throughput: 0: 10386.8. Samples: 372411624. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:23,989][27935] Avg episode reward: [(0, '-10.974')] [2022-07-13 05:31:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 186231808. Throughput: 0: 10396.4. Samples: 372474568. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:28,989][27935] Avg episode reward: [(0, '-11.895')] [2022-07-13 05:31:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.6, 300 sec: 5182.5). Total num frames: 186258432. Throughput: 0: 10385.8. Samples: 372536508. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:33,989][27935] Avg episode reward: [(0, '-12.010')] [2022-07-13 05:31:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 186284032. Throughput: 0: 10372.9. Samples: 372567560. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:38,989][27935] Avg episode reward: [(0, '-13.334')] [2022-07-13 05:31:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 186311680. Throughput: 0: 10379.4. Samples: 372630976. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:43,989][27935] Avg episode reward: [(0, '-10.326')] [2022-07-13 05:31:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186336256. Throughput: 0: 10452.7. Samples: 372693244. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:31:48,989][27935] Avg episode reward: [(0, '-9.722')] [2022-07-13 05:31:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 186362880. Throughput: 0: 10448.1. Samples: 372724432. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:31:53,996][27935] Avg episode reward: [(0, '-10.545')] [2022-07-13 05:31:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 186390528. Throughput: 0: 10438.3. Samples: 372787544. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:31:58,990][27935] Avg episode reward: [(0, '-10.598')] [2022-07-13 05:32:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 186413056. Throughput: 0: 10343.7. Samples: 372845680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:03,989][27935] Avg episode reward: [(0, '-10.696')] [2022-07-13 05:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186438656. Throughput: 0: 10338.7. Samples: 372876864. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:08,989][27935] Avg episode reward: [(0, '-11.028')] [2022-07-13 05:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.3, 300 sec: 5179.0). Total num frames: 186465280. Throughput: 0: 10335.8. Samples: 372939680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:13,989][27935] Avg episode reward: [(0, '-10.384')] [2022-07-13 05:32:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 186490880. Throughput: 0: 10358.9. Samples: 373002656. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:18,989][27935] Avg episode reward: [(0, '-10.175')] [2022-07-13 05:32:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 186518528. Throughput: 0: 10377.8. Samples: 373034560. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:23,989][27935] Avg episode reward: [(0, '-10.362')] [2022-07-13 05:32:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186543104. Throughput: 0: 10372.0. Samples: 373097716. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:28,989][27935] Avg episode reward: [(0, '-8.550')] [2022-07-13 05:32:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 186569728. Throughput: 0: 10374.6. Samples: 373160100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:33,989][27935] Avg episode reward: [(0, '-6.040')] [2022-07-13 05:32:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 186596352. Throughput: 0: 10369.0. Samples: 373191036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:38,989][27935] Avg episode reward: [(0, '-7.745')] [2022-07-13 05:32:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 186621952. Throughput: 0: 10341.7. Samples: 373252920. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:43,989][27935] Avg episode reward: [(0, '-6.600')] [2022-07-13 05:32:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 186647552. Throughput: 0: 10445.6. Samples: 373315732. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:48,989][27935] Avg episode reward: [(0, '-6.521')] [2022-07-13 05:32:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 186675200. Throughput: 0: 10449.7. Samples: 373347100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:53,989][27935] Avg episode reward: [(0, '-7.472')] [2022-07-13 05:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 186699776. Throughput: 0: 10442.9. Samples: 373409608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:32:58,989][27935] Avg episode reward: [(0, '-8.488')] [2022-07-13 05:33:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 186723328. Throughput: 0: 10339.4. Samples: 373467928. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:03,989][27935] Avg episode reward: [(0, '-9.139')] [2022-07-13 05:33:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186749952. Throughput: 0: 10314.0. Samples: 373498688. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:08,989][27935] Avg episode reward: [(0, '-8.660')] [2022-07-13 05:33:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 186776576. Throughput: 0: 10310.5. Samples: 373561688. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:13,989][27935] Avg episode reward: [(0, '-8.827')] [2022-07-13 05:33:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186802176. Throughput: 0: 10312.5. Samples: 373624164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:18,989][27935] Avg episode reward: [(0, '-9.378')] [2022-07-13 05:33:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 186828800. Throughput: 0: 10326.7. Samples: 373655736. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:23,989][27935] Avg episode reward: [(0, '-10.484')] [2022-07-13 05:33:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 186854400. Throughput: 0: 10340.9. Samples: 373718260. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:28,989][27935] Avg episode reward: [(0, '-10.815')] [2022-07-13 05:33:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 186880000. Throughput: 0: 10332.6. Samples: 373780700. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:33,990][27935] Avg episode reward: [(0, '-12.483')] [2022-07-13 05:33:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 186906624. Throughput: 0: 10324.6. Samples: 373811708. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:38,990][27935] Avg episode reward: [(0, '-12.061')] [2022-07-13 05:33:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 186933248. Throughput: 0: 10338.3. Samples: 373874832. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:43,989][27935] Avg episode reward: [(0, '-11.755')] [2022-07-13 05:33:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 186958848. Throughput: 0: 10437.7. Samples: 373937624. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:48,990][27935] Avg episode reward: [(0, '-11.068')] [2022-07-13 05:33:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 186984448. Throughput: 0: 10456.8. Samples: 373969244. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:53,990][27935] Avg episode reward: [(0, '-10.315')] [2022-07-13 05:33:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 187012096. Throughput: 0: 10454.5. Samples: 374032140. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:33:58,989][27935] Avg episode reward: [(0, '-10.132')] [2022-07-13 05:34:04,013][27935] Fps is (10 sec: 5107.9, 60 sec: 5203.3, 300 sec: 5189.0). Total num frames: 187035648. Throughput: 0: 10370.7. Samples: 374091092. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 05:34:04,013][27935] Avg episode reward: [(0, '-9.758')] [2022-07-13 05:34:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 187061248. Throughput: 0: 10372.6. Samples: 374122504. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:08,989][27935] Avg episode reward: [(0, '-9.083')] [2022-07-13 05:34:13,989][27935] Fps is (10 sec: 5234.8, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 187087872. Throughput: 0: 10387.9. Samples: 374185716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:13,989][27935] Avg episode reward: [(0, '-9.085')] [2022-07-13 05:34:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 187115520. Throughput: 0: 10402.5. Samples: 374248812. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:18,991][27935] Avg episode reward: [(0, '-11.612')] [2022-07-13 05:34:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 187141120. Throughput: 0: 10415.5. Samples: 374280404. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:23,989][27935] Avg episode reward: [(0, '-13.014')] [2022-07-13 05:34:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 187166720. Throughput: 0: 10406.9. Samples: 374343144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:28,989][27935] Avg episode reward: [(0, '-13.517')] [2022-07-13 05:34:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 187193344. Throughput: 0: 10406.4. Samples: 374405912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:33,989][27935] Avg episode reward: [(0, '-14.388')] [2022-07-13 05:34:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 187219968. Throughput: 0: 10402.8. Samples: 374437372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:38,989][27935] Avg episode reward: [(0, '-15.956')] [2022-07-13 05:34:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 187244544. Throughput: 0: 10398.5. Samples: 374500072. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:43,990][27935] Avg episode reward: [(0, '-14.263')] [2022-07-13 05:34:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 187271168. Throughput: 0: 10474.0. Samples: 374562172. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:48,989][27935] Avg episode reward: [(0, '-13.950')] [2022-07-13 05:34:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5186.0). Total num frames: 187296768. Throughput: 0: 10448.3. Samples: 374592676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:53,989][27935] Avg episode reward: [(0, '-15.097')] [2022-07-13 05:34:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 187322368. Throughput: 0: 10387.4. Samples: 374653148. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:34:58,989][27935] Avg episode reward: [(0, '-14.022')] [2022-07-13 05:35:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5173.2, 300 sec: 5182.5). Total num frames: 187345920. Throughput: 0: 10277.9. Samples: 374711320. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:03,989][27935] Avg episode reward: [(0, '-9.335')] [2022-07-13 05:35:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 187370496. Throughput: 0: 10266.1. Samples: 374742380. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:08,989][27935] Avg episode reward: [(0, '-7.367')] [2022-07-13 05:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 187398144. Throughput: 0: 10258.7. Samples: 374804784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:13,995][27935] Avg episode reward: [(0, '-7.558')] [2022-07-13 05:35:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 187423744. Throughput: 0: 10239.8. Samples: 374866704. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:18,989][27935] Avg episode reward: [(0, '-7.694')] [2022-07-13 05:35:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5179.0). Total num frames: 187448320. Throughput: 0: 10240.4. Samples: 374898192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:23,989][27935] Avg episode reward: [(0, '-6.674')] [2022-07-13 05:35:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 187475968. Throughput: 0: 10236.9. Samples: 374960732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:28,989][27935] Avg episode reward: [(0, '-7.934')] [2022-07-13 05:35:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 187501568. Throughput: 0: 10235.4. Samples: 375022764. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:33,989][27935] Avg episode reward: [(0, '-9.193')] [2022-07-13 05:35:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 187527168. Throughput: 0: 10242.8. Samples: 375053600. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:38,991][27935] Avg episode reward: [(0, '-10.767')] [2022-07-13 05:35:43,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 187553792. Throughput: 0: 10295.5. Samples: 375116444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:43,989][27935] Avg episode reward: [(0, '-11.086')] [2022-07-13 05:35:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 187579392. Throughput: 0: 10370.0. Samples: 375177972. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:48,989][27935] Avg episode reward: [(0, '-9.826')] [2022-07-13 05:35:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 187606016. Throughput: 0: 10376.9. Samples: 375209340. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:53,990][27935] Avg episode reward: [(0, '-9.570')] [2022-07-13 05:35:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 187631616. Throughput: 0: 10382.8. Samples: 375272008. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:35:58,990][27935] Avg episode reward: [(0, '-9.838')] [2022-07-13 05:36:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 187655168. Throughput: 0: 10297.8. Samples: 375330104. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:36:03,991][27935] Avg episode reward: [(0, '-8.695')] [2022-07-13 05:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5175.6). Total num frames: 187681792. Throughput: 0: 10286.6. Samples: 375361088. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:36:08,989][27935] Avg episode reward: [(0, '-7.969')] [2022-07-13 05:36:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 187708416. Throughput: 0: 10292.8. Samples: 375423908. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 05:36:13,989][27935] Avg episode reward: [(0, '-7.630')] [2022-07-13 05:36:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 187734016. Throughput: 0: 10290.3. Samples: 375485828. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:18,989][27935] Avg episode reward: [(0, '-8.312')] [2022-07-13 05:36:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 187757568. Throughput: 0: 10298.1. Samples: 375517016. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:23,989][27935] Avg episode reward: [(0, '-8.865')] [2022-07-13 05:36:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 187786240. Throughput: 0: 10295.4. Samples: 375579740. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:28,989][27935] Avg episode reward: [(0, '-8.319')] [2022-07-13 05:36:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 187811840. Throughput: 0: 10301.9. Samples: 375641556. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:33,990][27935] Avg episode reward: [(0, '-8.145')] [2022-07-13 05:36:38,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5170.9, 300 sec: 5172.0). Total num frames: 187837440. Throughput: 0: 10284.4. Samples: 375672176. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:38,993][27935] Avg episode reward: [(0, '-9.222')] [2022-07-13 05:36:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 187863040. Throughput: 0: 10286.2. Samples: 375734888. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:43,989][27935] Avg episode reward: [(0, '-9.642')] [2022-07-13 05:36:48,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 187888640. Throughput: 0: 10378.8. Samples: 375797148. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:48,989][27935] Avg episode reward: [(0, '-10.950')] [2022-07-13 05:36:53,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 187915264. Throughput: 0: 10385.9. Samples: 375828452. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:53,989][27935] Avg episode reward: [(0, '-9.134')] [2022-07-13 05:36:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 187940864. Throughput: 0: 10386.8. Samples: 375891316. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:36:58,990][27935] Avg episode reward: [(0, '-10.049')] [2022-07-13 05:37:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 187965440. Throughput: 0: 10327.9. Samples: 375950584. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:03,989][27935] Avg episode reward: [(0, '-11.610')] [2022-07-13 05:37:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 187991040. Throughput: 0: 10328.0. Samples: 375981776. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:08,989][27935] Avg episode reward: [(0, '-11.473')] [2022-07-13 05:37:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 188017664. Throughput: 0: 10321.5. Samples: 376044208. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:13,989][27935] Avg episode reward: [(0, '-11.361')] [2022-07-13 05:37:18,991][27935] Fps is (10 sec: 5221.1, 60 sec: 5153.9, 300 sec: 5168.6). Total num frames: 188043264. Throughput: 0: 10324.7. Samples: 376106192. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:18,993][27935] Avg episode reward: [(0, '-11.684')] [2022-07-13 05:37:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 188066816. Throughput: 0: 10302.9. Samples: 376135772. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:23,989][27935] Avg episode reward: [(0, '-12.785')] [2022-07-13 05:37:28,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 188094464. Throughput: 0: 10252.6. Samples: 376196252. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:28,990][27935] Avg episode reward: [(0, '-14.084')] [2022-07-13 05:37:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 188119040. Throughput: 0: 10230.5. Samples: 376257520. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:33,990][27935] Avg episode reward: [(0, '-12.025')] [2022-07-13 05:37:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.4, 300 sec: 5165.1). Total num frames: 188145664. Throughput: 0: 10214.7. Samples: 376288116. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:38,989][27935] Avg episode reward: [(0, '-11.878')] [2022-07-13 05:37:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 188170240. Throughput: 0: 10175.0. Samples: 376349192. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:43,990][27935] Avg episode reward: [(0, '-12.142')] [2022-07-13 05:37:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5144.3). Total num frames: 188192768. Throughput: 0: 10156.0. Samples: 376407604. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:48,990][27935] Avg episode reward: [(0, '-11.523')] [2022-07-13 05:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5151.2). Total num frames: 188219392. Throughput: 0: 10156.7. Samples: 376438828. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:53,989][27935] Avg episode reward: [(0, '-10.240')] [2022-07-13 05:37:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5151.2). Total num frames: 188242944. Throughput: 0: 10058.7. Samples: 376496848. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:37:58,989][27935] Avg episode reward: [(0, '-11.011')] [2022-07-13 05:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 5000.5, 300 sec: 5137.4). Total num frames: 188265472. Throughput: 0: 9893.6. Samples: 376551380. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:38:03,989][27935] Avg episode reward: [(0, '-9.925')] [2022-07-13 05:38:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5133.9). Total num frames: 188291072. Throughput: 0: 9889.6. Samples: 376580804. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:38:08,989][27935] Avg episode reward: [(0, '-11.135')] [2022-07-13 05:38:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5126.9). Total num frames: 188314624. Throughput: 0: 9865.2. Samples: 376640188. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:38:13,989][27935] Avg episode reward: [(0, '-10.209')] [2022-07-13 05:38:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.5, 300 sec: 5123.5). Total num frames: 188340224. Throughput: 0: 9807.0. Samples: 376698836. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:38:18,989][27935] Avg episode reward: [(0, '-11.603')] [2022-07-13 05:38:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5116.5). Total num frames: 188363776. Throughput: 0: 9789.7. Samples: 376728652. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 05:38:23,989][27935] Avg episode reward: [(0, '-10.963')] [2022-07-13 05:38:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5116.5). Total num frames: 188389376. Throughput: 0: 9751.5. Samples: 376788012. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:28,989][27935] Avg episode reward: [(0, '-11.022')] [2022-07-13 05:38:33,995][27935] Fps is (10 sec: 5014.7, 60 sec: 4914.7, 300 sec: 5109.5). Total num frames: 188413952. Throughput: 0: 9778.5. Samples: 376847696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:33,995][27935] Avg episode reward: [(0, '-10.959')] [2022-07-13 05:38:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5106.1). Total num frames: 188439552. Throughput: 0: 9742.8. Samples: 376877252. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:38,989][27935] Avg episode reward: [(0, '-9.887')] [2022-07-13 05:38:43,989][27935] Fps is (10 sec: 5020.5, 60 sec: 4898.1, 300 sec: 5102.6). Total num frames: 188464128. Throughput: 0: 9788.7. Samples: 376937340. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:43,989][27935] Avg episode reward: [(0, '-10.374')] [2022-07-13 05:38:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 5102.6). Total num frames: 188489728. Throughput: 0: 9893.2. Samples: 376996572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:48,989][27935] Avg episode reward: [(0, '-10.573')] [2022-07-13 05:38:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 5088.8). Total num frames: 188513280. Throughput: 0: 9915.6. Samples: 377027004. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:53,989][27935] Avg episode reward: [(0, '-11.835')] [2022-07-13 05:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 5092.6). Total num frames: 188537856. Throughput: 0: 9848.3. Samples: 377083360. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:38:58,989][27935] Avg episode reward: [(0, '-15.787')] [2022-07-13 05:39:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4881.1, 300 sec: 5074.9). Total num frames: 188558336. Throughput: 0: 9713.0. Samples: 377135920. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:03,989][27935] Avg episode reward: [(0, '-16.309')] [2022-07-13 05:39:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4846.9, 300 sec: 5064.5). Total num frames: 188581888. Throughput: 0: 9685.2. Samples: 377164484. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:08,989][27935] Avg episode reward: [(0, '-16.365')] [2022-07-13 05:39:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 5050.6). Total num frames: 188605440. Throughput: 0: 9630.0. Samples: 377221364. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:13,989][27935] Avg episode reward: [(0, '-16.012')] [2022-07-13 05:39:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 5050.6). Total num frames: 188631040. Throughput: 0: 9598.0. Samples: 377279548. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:18,989][27935] Avg episode reward: [(0, '-15.150')] [2022-07-13 05:39:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5040.2). Total num frames: 188653568. Throughput: 0: 9595.2. Samples: 377309036. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:23,989][27935] Avg episode reward: [(0, '-15.158')] [2022-07-13 05:39:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 5040.2). Total num frames: 188680192. Throughput: 0: 9568.5. Samples: 377367920. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:28,989][27935] Avg episode reward: [(0, '-12.765')] [2022-07-13 05:39:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4830.3, 300 sec: 5029.7). Total num frames: 188703744. Throughput: 0: 9556.4. Samples: 377426608. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:33,989][27935] Avg episode reward: [(0, '-9.608')] [2022-07-13 05:39:38,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 5029.7). Total num frames: 188728320. Throughput: 0: 9529.5. Samples: 377455832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:38,989][27935] Avg episode reward: [(0, '-9.012')] [2022-07-13 05:39:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 5019.3). Total num frames: 188751872. Throughput: 0: 9584.0. Samples: 377514640. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:43,989][27935] Avg episode reward: [(0, '-8.068')] [2022-07-13 05:39:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 5015.9). Total num frames: 188776448. Throughput: 0: 9723.3. Samples: 377573468. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:48,989][27935] Avg episode reward: [(0, '-7.383')] [2022-07-13 05:39:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 5015.9). Total num frames: 188802048. Throughput: 0: 9737.5. Samples: 377602672. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:53,990][27935] Avg episode reward: [(0, '-8.419')] [2022-07-13 05:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 5015.9). Total num frames: 188825600. Throughput: 0: 9777.4. Samples: 377661348. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:39:58,989][27935] Avg episode reward: [(0, '-10.405')] [2022-07-13 05:40:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 5008.9). Total num frames: 188848128. Throughput: 0: 9703.1. Samples: 377716188. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:03,989][27935] Avg episode reward: [(0, '-10.854')] [2022-07-13 05:40:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4998.5). Total num frames: 188872704. Throughput: 0: 9699.6. Samples: 377745520. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:08,990][27935] Avg episode reward: [(0, '-10.257')] [2022-07-13 05:40:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4995.0). Total num frames: 188897280. Throughput: 0: 9674.8. Samples: 377803288. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:13,990][27935] Avg episode reward: [(0, '-11.305')] [2022-07-13 05:40:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4988.1). Total num frames: 188919808. Throughput: 0: 9668.8. Samples: 377861704. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:18,989][27935] Avg episode reward: [(0, '-11.843')] [2022-07-13 05:40:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4981.2). Total num frames: 188945408. Throughput: 0: 9668.2. Samples: 377890900. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:23,990][27935] Avg episode reward: [(0, '-12.879')] [2022-07-13 05:40:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4977.7). Total num frames: 188969984. Throughput: 0: 9670.5. Samples: 377949812. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:28,989][27935] Avg episode reward: [(0, '-12.754')] [2022-07-13 05:40:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4977.7). Total num frames: 188995584. Throughput: 0: 9670.2. Samples: 378008624. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 05:40:33,990][27935] Avg episode reward: [(0, '-10.926')] [2022-07-13 05:40:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4963.8). Total num frames: 189018112. Throughput: 0: 9673.8. Samples: 378037992. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:40:38,990][27935] Avg episode reward: [(0, '-9.537')] [2022-07-13 05:40:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4960.3). Total num frames: 189042688. Throughput: 0: 9667.8. Samples: 378096400. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:40:43,989][27935] Avg episode reward: [(0, '-10.449')] [2022-07-13 05:40:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4956.9). Total num frames: 189068288. Throughput: 0: 9753.8. Samples: 378155108. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:40:48,989][27935] Avg episode reward: [(0, '-10.634')] [2022-07-13 05:40:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4953.4). Total num frames: 189092864. Throughput: 0: 9760.8. Samples: 378184756. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:40:53,989][27935] Avg episode reward: [(0, '-9.337')] [2022-07-13 05:40:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4949.9). Total num frames: 189115392. Throughput: 0: 9753.0. Samples: 378242172. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:40:58,990][27935] Avg episode reward: [(0, '-8.973')] [2022-07-13 05:41:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4936.0). Total num frames: 189137920. Throughput: 0: 9647.5. Samples: 378295840. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:03,989][27935] Avg episode reward: [(0, '-8.581')] [2022-07-13 05:41:08,991][27935] Fps is (10 sec: 4914.0, 60 sec: 4863.8, 300 sec: 4936.0). Total num frames: 189164544. Throughput: 0: 9684.9. Samples: 378326744. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:08,992][27935] Avg episode reward: [(0, '-9.516')] [2022-07-13 05:41:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4846.9, 300 sec: 4929.1). Total num frames: 189188096. Throughput: 0: 9707.2. Samples: 378386636. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:13,989][27935] Avg episode reward: [(0, '-10.955')] [2022-07-13 05:41:18,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4898.1, 300 sec: 4936.0). Total num frames: 189213696. Throughput: 0: 9729.5. Samples: 378446452. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:18,989][27935] Avg episode reward: [(0, '-11.622')] [2022-07-13 05:41:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4922.1). Total num frames: 189238272. Throughput: 0: 9706.4. Samples: 378474780. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:23,990][27935] Avg episode reward: [(0, '-12.228')] [2022-07-13 05:41:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4864.0, 300 sec: 4915.2). Total num frames: 189261824. Throughput: 0: 9674.7. Samples: 378531760. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:28,989][27935] Avg episode reward: [(0, '-11.591')] [2022-07-13 05:41:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4904.8). Total num frames: 189284352. Throughput: 0: 9677.8. Samples: 378590608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:33,989][27935] Avg episode reward: [(0, '-10.657')] [2022-07-13 05:41:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4908.3). Total num frames: 189310976. Throughput: 0: 9670.9. Samples: 378619948. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:38,990][27935] Avg episode reward: [(0, '-9.875')] [2022-07-13 05:41:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4901.3). Total num frames: 189334528. Throughput: 0: 9706.6. Samples: 378678968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:43,990][27935] Avg episode reward: [(0, '-8.608')] [2022-07-13 05:41:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4894.4). Total num frames: 189359104. Throughput: 0: 9834.5. Samples: 378738392. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:48,989][27935] Avg episode reward: [(0, '-8.829')] [2022-07-13 05:41:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4894.4). Total num frames: 189384704. Throughput: 0: 9811.0. Samples: 378768216. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:53,989][27935] Avg episode reward: [(0, '-6.898')] [2022-07-13 05:41:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 189407232. Throughput: 0: 9793.1. Samples: 378827324. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:41:58,990][27935] Avg episode reward: [(0, '-7.599')] [2022-07-13 05:42:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 189431808. Throughput: 0: 9690.2. Samples: 378882508. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:03,989][27935] Avg episode reward: [(0, '-7.634')] [2022-07-13 05:42:08,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 189456384. Throughput: 0: 9718.6. Samples: 378912136. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:08,992][27935] Avg episode reward: [(0, '-8.548')] [2022-07-13 05:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 189479936. Throughput: 0: 9735.4. Samples: 378969856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:13,990][27935] Avg episode reward: [(0, '-9.783')] [2022-07-13 05:42:18,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 189504512. Throughput: 0: 9722.5. Samples: 379028120. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:18,989][27935] Avg episode reward: [(0, '-11.501')] [2022-07-13 05:42:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 189529088. Throughput: 0: 9718.5. Samples: 379057280. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:23,989][27935] Avg episode reward: [(0, '-9.679')] [2022-07-13 05:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 189553664. Throughput: 0: 9685.8. Samples: 379114828. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:28,989][27935] Avg episode reward: [(0, '-8.893')] [2022-07-13 05:42:33,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4880.5, 300 sec: 4852.6). Total num frames: 189577216. Throughput: 0: 9659.7. Samples: 379173152. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:33,997][27935] Avg episode reward: [(0, '-9.416')] [2022-07-13 05:42:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 189601792. Throughput: 0: 9654.5. Samples: 379202668. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:38,989][27935] Avg episode reward: [(0, '-8.304')] [2022-07-13 05:42:43,989][27935] Fps is (10 sec: 4816.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 189625344. Throughput: 0: 9628.1. Samples: 379260588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:43,989][27935] Avg episode reward: [(0, '-7.472')] [2022-07-13 05:42:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 189650944. Throughput: 0: 9704.1. Samples: 379319192. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 05:42:48,989][27935] Avg episode reward: [(0, '-8.083')] [2022-07-13 05:42:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 189673472. Throughput: 0: 9704.5. Samples: 379348820. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:42:53,989][27935] Avg episode reward: [(0, '-6.305')] [2022-07-13 05:42:58,999][27935] Fps is (10 sec: 4807.8, 60 sec: 4863.2, 300 sec: 4859.5). Total num frames: 189699072. Throughput: 0: 9732.1. Samples: 379407900. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:42:59,000][27935] Avg episode reward: [(0, '-7.700')] [2022-07-13 05:43:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 189721600. Throughput: 0: 9664.3. Samples: 379463016. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:03,997][27935] Avg episode reward: [(0, '-9.372')] [2022-07-13 05:43:08,989][27935] Fps is (10 sec: 4715.3, 60 sec: 4830.0, 300 sec: 4852.7). Total num frames: 189746176. Throughput: 0: 9680.2. Samples: 379492888. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:08,989][27935] Avg episode reward: [(0, '-10.503')] [2022-07-13 05:43:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 189771776. Throughput: 0: 9710.9. Samples: 379551820. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:13,989][27935] Avg episode reward: [(0, '-10.585')] [2022-07-13 05:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 189795328. Throughput: 0: 9724.6. Samples: 379610684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:18,991][27935] Avg episode reward: [(0, '-11.360')] [2022-07-13 05:43:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 189818880. Throughput: 0: 9704.8. Samples: 379639384. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:23,989][27935] Avg episode reward: [(0, '-11.376')] [2022-07-13 05:43:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.4). Total num frames: 189842432. Throughput: 0: 9703.6. Samples: 379697252. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:28,989][27935] Avg episode reward: [(0, '-13.339')] [2022-07-13 05:43:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.5, 300 sec: 4842.3). Total num frames: 189868032. Throughput: 0: 9681.1. Samples: 379754844. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:33,989][27935] Avg episode reward: [(0, '-14.440')] [2022-07-13 05:43:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 189891584. Throughput: 0: 9671.7. Samples: 379784048. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:38,989][27935] Avg episode reward: [(0, '-12.295')] [2022-07-13 05:43:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 189917184. Throughput: 0: 9672.4. Samples: 379843060. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:43,990][27935] Avg episode reward: [(0, '-14.528')] [2022-07-13 05:43:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 189941760. Throughput: 0: 9754.1. Samples: 379901952. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:48,989][27935] Avg episode reward: [(0, '-13.652')] [2022-07-13 05:43:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 189965312. Throughput: 0: 9744.5. Samples: 379931392. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:53,989][27935] Avg episode reward: [(0, '-13.742')] [2022-07-13 05:43:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.8, 300 sec: 4852.7). Total num frames: 189989888. Throughput: 0: 9726.1. Samples: 379989492. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:43:58,989][27935] Avg episode reward: [(0, '-11.657')] [2022-07-13 05:44:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 190012416. Throughput: 0: 9625.4. Samples: 380043828. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:03,989][27935] Avg episode reward: [(0, '-12.814')] [2022-07-13 05:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 190035968. Throughput: 0: 9634.3. Samples: 380072928. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:08,990][27935] Avg episode reward: [(0, '-12.001')] [2022-07-13 05:44:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 190061568. Throughput: 0: 9642.8. Samples: 380131176. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:13,991][27935] Avg episode reward: [(0, '-11.191')] [2022-07-13 05:44:18,992][27935] Fps is (10 sec: 5015.8, 60 sec: 4846.6, 300 sec: 4856.1). Total num frames: 190086144. Throughput: 0: 9667.9. Samples: 380189936. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:18,993][27935] Avg episode reward: [(0, '-9.605')] [2022-07-13 05:44:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 190109696. Throughput: 0: 9661.6. Samples: 380218820. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:23,990][27935] Avg episode reward: [(0, '-10.660')] [2022-07-13 05:44:28,989][27935] Fps is (10 sec: 4712.1, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 190133248. Throughput: 0: 9633.2. Samples: 380276552. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:28,989][27935] Avg episode reward: [(0, '-10.016')] [2022-07-13 05:44:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 190156800. Throughput: 0: 9616.0. Samples: 380334672. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:33,989][27935] Avg episode reward: [(0, '-10.009')] [2022-07-13 05:44:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 190182400. Throughput: 0: 9614.6. Samples: 380364048. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:38,989][27935] Avg episode reward: [(0, '-8.616')] [2022-07-13 05:44:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 190205952. Throughput: 0: 9632.4. Samples: 380422952. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:43,989][27935] Avg episode reward: [(0, '-9.003')] [2022-07-13 05:44:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 190230528. Throughput: 0: 9716.8. Samples: 380481084. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:48,989][27935] Avg episode reward: [(0, '-9.910')] [2022-07-13 05:44:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 190255104. Throughput: 0: 9731.4. Samples: 380510840. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:53,989][27935] Avg episode reward: [(0, '-9.468')] [2022-07-13 05:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 190279680. Throughput: 0: 9744.0. Samples: 380569656. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 05:44:58,989][27935] Avg episode reward: [(0, '-9.362')] [2022-07-13 05:45:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 190302208. Throughput: 0: 9660.4. Samples: 380624620. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:03,989][27935] Avg episode reward: [(0, '-10.905')] [2022-07-13 05:45:08,998][27935] Fps is (10 sec: 4808.5, 60 sec: 4863.3, 300 sec: 4849.1). Total num frames: 190327808. Throughput: 0: 9667.9. Samples: 380653964. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:08,998][27935] Avg episode reward: [(0, '-10.428')] [2022-07-13 05:45:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 190352384. Throughput: 0: 9691.2. Samples: 380712656. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:13,989][27935] Avg episode reward: [(0, '-9.557')] [2022-07-13 05:45:18,989][27935] Fps is (10 sec: 4817.1, 60 sec: 4830.2, 300 sec: 4849.2). Total num frames: 190375936. Throughput: 0: 9711.6. Samples: 380771696. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:18,989][27935] Avg episode reward: [(0, '-7.770')] [2022-07-13 05:45:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 190400512. Throughput: 0: 9710.3. Samples: 380801012. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:23,989][27935] Avg episode reward: [(0, '-7.937')] [2022-07-13 05:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 190424064. Throughput: 0: 9711.2. Samples: 380859956. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:28,989][27935] Avg episode reward: [(0, '-7.386')] [2022-07-13 05:45:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 190449664. Throughput: 0: 9728.4. Samples: 380918864. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:33,989][27935] Avg episode reward: [(0, '-5.263')] [2022-07-13 05:45:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 190474240. Throughput: 0: 9718.4. Samples: 380948168. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:38,989][27935] Avg episode reward: [(0, '-5.896')] [2022-07-13 05:45:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 190499840. Throughput: 0: 9728.6. Samples: 381007444. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:43,989][27935] Avg episode reward: [(0, '-7.385')] [2022-07-13 05:45:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 190523392. Throughput: 0: 9813.6. Samples: 381066232. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:48,989][27935] Avg episode reward: [(0, '-7.123')] [2022-07-13 05:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 190548992. Throughput: 0: 9825.4. Samples: 381096016. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:53,990][27935] Avg episode reward: [(0, '-7.606')] [2022-07-13 05:45:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 190572544. Throughput: 0: 9839.1. Samples: 381155412. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:45:58,989][27935] Avg episode reward: [(0, '-10.301')] [2022-07-13 05:46:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4849.3). Total num frames: 190595072. Throughput: 0: 9752.0. Samples: 381210536. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:03,989][27935] Avg episode reward: [(0, '-10.249')] [2022-07-13 05:46:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.8, 300 sec: 4856.2). Total num frames: 190620672. Throughput: 0: 9769.2. Samples: 381240624. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:08,989][27935] Avg episode reward: [(0, '-10.818')] [2022-07-13 05:46:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 190645248. Throughput: 0: 9775.8. Samples: 381299868. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:13,989][27935] Avg episode reward: [(0, '-9.904')] [2022-07-13 05:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 190669824. Throughput: 0: 9770.5. Samples: 381358536. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:18,991][27935] Avg episode reward: [(0, '-10.566')] [2022-07-13 05:46:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 190693376. Throughput: 0: 9763.2. Samples: 381387512. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:23,989][27935] Avg episode reward: [(0, '-10.134')] [2022-07-13 05:46:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 190717952. Throughput: 0: 9763.6. Samples: 381446808. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:28,989][27935] Avg episode reward: [(0, '-9.611')] [2022-07-13 05:46:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 190743552. Throughput: 0: 9753.8. Samples: 381505152. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:33,989][27935] Avg episode reward: [(0, '-9.811')] [2022-07-13 05:46:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 190767104. Throughput: 0: 9753.5. Samples: 381534924. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:38,989][27935] Avg episode reward: [(0, '-10.646')] [2022-07-13 05:46:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 190790656. Throughput: 0: 9749.6. Samples: 381594144. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:43,990][27935] Avg episode reward: [(0, '-9.467')] [2022-07-13 05:46:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 190817280. Throughput: 0: 9834.0. Samples: 381653068. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:48,989][27935] Avg episode reward: [(0, '-8.964')] [2022-07-13 05:46:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 190840832. Throughput: 0: 9824.7. Samples: 381682736. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:53,989][27935] Avg episode reward: [(0, '-9.562')] [2022-07-13 05:46:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 190866432. Throughput: 0: 9823.0. Samples: 381741904. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:46:58,989][27935] Avg episode reward: [(0, '-9.882')] [2022-07-13 05:47:03,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4881.0, 300 sec: 4852.7). Total num frames: 190887936. Throughput: 0: 9703.2. Samples: 381795184. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:47:03,991][27935] Avg episode reward: [(0, '-10.703')] [2022-07-13 05:47:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 190911488. Throughput: 0: 9705.3. Samples: 381824252. Policy #0 lag: (min: 0.0, avg: 10.5, max: 22.0) [2022-07-13 05:47:08,990][27935] Avg episode reward: [(0, '-10.247')] [2022-07-13 05:47:13,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 190936064. Throughput: 0: 9694.2. Samples: 381883048. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:13,990][27935] Avg episode reward: [(0, '-12.402')] [2022-07-13 05:47:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 190960640. Throughput: 0: 9701.9. Samples: 381941736. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:18,991][27935] Avg episode reward: [(0, '-13.418')] [2022-07-13 05:47:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 190986240. Throughput: 0: 9687.1. Samples: 381970844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:23,989][27935] Avg episode reward: [(0, '-14.558')] [2022-07-13 05:47:28,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4881.1, 300 sec: 4859.8). Total num frames: 191010816. Throughput: 0: 9690.0. Samples: 382030192. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:28,990][27935] Avg episode reward: [(0, '-13.804')] [2022-07-13 05:47:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 191035392. Throughput: 0: 9685.7. Samples: 382088924. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:33,989][27935] Avg episode reward: [(0, '-12.511')] [2022-07-13 05:47:38,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4880.9, 300 sec: 4863.1). Total num frames: 191059968. Throughput: 0: 9689.2. Samples: 382118772. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:38,991][27935] Avg episode reward: [(0, '-11.851')] [2022-07-13 05:47:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 191084544. Throughput: 0: 9677.6. Samples: 382177396. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:43,989][27935] Avg episode reward: [(0, '-12.085')] [2022-07-13 05:47:48,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 191108096. Throughput: 0: 9805.4. Samples: 382236424. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:48,989][27935] Avg episode reward: [(0, '-10.458')] [2022-07-13 05:47:53,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4863.9, 300 sec: 4859.8). Total num frames: 191132672. Throughput: 0: 9815.0. Samples: 382265944. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:53,991][27935] Avg episode reward: [(0, '-9.203')] [2022-07-13 05:47:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 191158272. Throughput: 0: 9829.3. Samples: 382325364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:47:58,989][27935] Avg episode reward: [(0, '-9.241')] [2022-07-13 05:48:03,989][27935] Fps is (10 sec: 4711.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 191179776. Throughput: 0: 9756.7. Samples: 382380788. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:03,989][27935] Avg episode reward: [(0, '-9.443')] [2022-07-13 05:48:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4863.1). Total num frames: 191206400. Throughput: 0: 9770.5. Samples: 382410516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:08,989][27935] Avg episode reward: [(0, '-8.501')] [2022-07-13 05:48:14,005][27935] Fps is (10 sec: 4907.0, 60 sec: 4879.7, 300 sec: 4859.4). Total num frames: 191228928. Throughput: 0: 9760.0. Samples: 382469556. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:14,007][27935] Avg episode reward: [(0, '-9.395')] [2022-07-13 05:48:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 191254528. Throughput: 0: 9780.6. Samples: 382529052. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:18,989][27935] Avg episode reward: [(0, '-9.218')] [2022-07-13 05:48:23,989][27935] Fps is (10 sec: 5026.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 191279104. Throughput: 0: 9773.1. Samples: 382558540. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:23,989][27935] Avg episode reward: [(0, '-9.218')] [2022-07-13 05:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 191304704. Throughput: 0: 9800.4. Samples: 382618412. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:28,989][27935] Avg episode reward: [(0, '-9.930')] [2022-07-13 05:48:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 191329280. Throughput: 0: 9799.3. Samples: 382677392. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:33,989][27935] Avg episode reward: [(0, '-9.391')] [2022-07-13 05:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.3, 300 sec: 4870.1). Total num frames: 191353856. Throughput: 0: 9807.6. Samples: 382707272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:38,989][27935] Avg episode reward: [(0, '-9.011')] [2022-07-13 05:48:43,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 191377408. Throughput: 0: 9806.5. Samples: 382766656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:43,989][27935] Avg episode reward: [(0, '-8.982')] [2022-07-13 05:48:48,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4932.3, 300 sec: 4877.0). Total num frames: 191404032. Throughput: 0: 9888.4. Samples: 382825764. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:48,989][27935] Avg episode reward: [(0, '-9.578')] [2022-07-13 05:48:53,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4898.3, 300 sec: 4870.1). Total num frames: 191426560. Throughput: 0: 9888.2. Samples: 382855484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:53,991][27935] Avg episode reward: [(0, '-10.359')] [2022-07-13 05:48:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 191451136. Throughput: 0: 9896.7. Samples: 382914744. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:48:58,990][27935] Avg episode reward: [(0, '-8.732')] [2022-07-13 05:49:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4877.0). Total num frames: 191474688. Throughput: 0: 9793.6. Samples: 382969764. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:49:03,989][27935] Avg episode reward: [(0, '-7.721')] [2022-07-13 05:49:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 191500288. Throughput: 0: 9801.2. Samples: 382999596. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:49:08,989][27935] Avg episode reward: [(0, '-7.795')] [2022-07-13 05:49:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4933.6, 300 sec: 4877.1). Total num frames: 191524864. Throughput: 0: 9789.5. Samples: 383058940. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:49:13,989][27935] Avg episode reward: [(0, '-8.278')] [2022-07-13 05:49:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 191549440. Throughput: 0: 9785.0. Samples: 383117716. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:49:18,989][27935] Avg episode reward: [(0, '-8.536')] [2022-07-13 05:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 191574016. Throughput: 0: 9778.6. Samples: 383147308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 05:49:23,989][27935] Avg episode reward: [(0, '-7.770')] [2022-07-13 05:49:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 191597568. Throughput: 0: 9767.0. Samples: 383206168. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:28,989][27935] Avg episode reward: [(0, '-6.560')] [2022-07-13 05:49:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 191623168. Throughput: 0: 9747.6. Samples: 383264408. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:33,989][27935] Avg episode reward: [(0, '-7.967')] [2022-07-13 05:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 191646720. Throughput: 0: 9744.2. Samples: 383293972. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:38,989][27935] Avg episode reward: [(0, '-8.092')] [2022-07-13 05:49:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 191672320. Throughput: 0: 9742.8. Samples: 383353168. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:43,989][27935] Avg episode reward: [(0, '-8.884')] [2022-07-13 05:49:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 191696896. Throughput: 0: 9839.0. Samples: 383412520. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:48,989][27935] Avg episode reward: [(0, '-7.988')] [2022-07-13 05:49:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4887.4). Total num frames: 191721472. Throughput: 0: 9838.7. Samples: 383442336. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:53,989][27935] Avg episode reward: [(0, '-8.834')] [2022-07-13 05:49:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4894.4). Total num frames: 191746048. Throughput: 0: 9837.2. Samples: 383501612. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:49:58,989][27935] Avg episode reward: [(0, '-9.131')] [2022-07-13 05:50:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4884.1). Total num frames: 191768576. Throughput: 0: 9750.1. Samples: 383556468. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:03,991][27935] Avg episode reward: [(0, '-8.017')] [2022-07-13 05:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 191792128. Throughput: 0: 9739.7. Samples: 383585596. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:08,989][27935] Avg episode reward: [(0, '-7.623')] [2022-07-13 05:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 191816704. Throughput: 0: 9738.4. Samples: 383644396. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:13,990][27935] Avg episode reward: [(0, '-8.073')] [2022-07-13 05:50:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 191842304. Throughput: 0: 9751.8. Samples: 383703240. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:18,989][27935] Avg episode reward: [(0, '-7.384')] [2022-07-13 05:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 191865856. Throughput: 0: 9744.1. Samples: 383732456. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:23,989][27935] Avg episode reward: [(0, '-7.482')] [2022-07-13 05:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4887.4). Total num frames: 191891456. Throughput: 0: 9739.2. Samples: 383791432. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:28,989][27935] Avg episode reward: [(0, '-6.225')] [2022-07-13 05:50:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 191915008. Throughput: 0: 9715.2. Samples: 383849704. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:33,989][27935] Avg episode reward: [(0, '-8.573')] [2022-07-13 05:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 191939584. Throughput: 0: 9699.2. Samples: 383878800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:38,989][27935] Avg episode reward: [(0, '-8.228')] [2022-07-13 05:50:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 191964160. Throughput: 0: 9693.9. Samples: 383937836. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:43,989][27935] Avg episode reward: [(0, '-9.315')] [2022-07-13 05:50:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 191987712. Throughput: 0: 9781.8. Samples: 383996648. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:48,989][27935] Avg episode reward: [(0, '-10.555')] [2022-07-13 05:50:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 192013312. Throughput: 0: 9791.3. Samples: 384026204. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:53,989][27935] Avg episode reward: [(0, '-10.834')] [2022-07-13 05:50:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4890.9). Total num frames: 192037888. Throughput: 0: 9785.4. Samples: 384084740. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:50:58,989][27935] Avg episode reward: [(0, '-9.060')] [2022-07-13 05:51:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 192059392. Throughput: 0: 9696.2. Samples: 384139568. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:03,989][27935] Avg episode reward: [(0, '-9.219')] [2022-07-13 05:51:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 192084992. Throughput: 0: 9693.1. Samples: 384168644. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:08,989][27935] Avg episode reward: [(0, '-8.175')] [2022-07-13 05:51:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 192108544. Throughput: 0: 9698.9. Samples: 384227884. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:13,992][27935] Avg episode reward: [(0, '-8.204')] [2022-07-13 05:51:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4880.5). Total num frames: 192133120. Throughput: 0: 9706.1. Samples: 384286480. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:18,996][27935] Avg episode reward: [(0, '-9.083')] [2022-07-13 05:51:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 192157696. Throughput: 0: 9710.0. Samples: 384315752. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:23,989][27935] Avg episode reward: [(0, '-10.172')] [2022-07-13 05:51:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 192182272. Throughput: 0: 9701.8. Samples: 384374416. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:28,989][27935] Avg episode reward: [(0, '-10.673')] [2022-07-13 05:51:33,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 192206848. Throughput: 0: 9693.6. Samples: 384432860. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 05:51:33,989][27935] Avg episode reward: [(0, '-11.409')] [2022-07-13 05:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 192231424. Throughput: 0: 9688.0. Samples: 384462164. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:51:38,989][27935] Avg episode reward: [(0, '-11.088')] [2022-07-13 05:51:43,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 192256000. Throughput: 0: 9705.2. Samples: 384521476. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:51:43,992][27935] Avg episode reward: [(0, '-11.884')] [2022-07-13 05:51:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 192280576. Throughput: 0: 9786.9. Samples: 384579980. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:51:48,989][27935] Avg episode reward: [(0, '-12.770')] [2022-07-13 05:51:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 192304128. Throughput: 0: 9786.0. Samples: 384609016. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:51:53,989][27935] Avg episode reward: [(0, '-11.331')] [2022-07-13 05:51:58,991][27935] Fps is (10 sec: 4709.6, 60 sec: 4829.7, 300 sec: 4880.5). Total num frames: 192327680. Throughput: 0: 9767.9. Samples: 384667456. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:51:58,991][27935] Avg episode reward: [(0, '-9.833')] [2022-07-13 05:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 192350208. Throughput: 0: 9670.6. Samples: 384721656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:03,989][27935] Avg episode reward: [(0, '-9.198')] [2022-07-13 05:52:08,989][27935] Fps is (10 sec: 4813.6, 60 sec: 4846.9, 300 sec: 4880.5). Total num frames: 192375808. Throughput: 0: 9670.0. Samples: 384750904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:08,989][27935] Avg episode reward: [(0, '-9.076')] [2022-07-13 05:52:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 192399360. Throughput: 0: 9653.8. Samples: 384808836. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:13,989][27935] Avg episode reward: [(0, '-8.438')] [2022-07-13 05:52:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 192422912. Throughput: 0: 9651.0. Samples: 384867156. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:18,989][27935] Avg episode reward: [(0, '-7.725')] [2022-07-13 05:52:23,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4846.6, 300 sec: 4873.5). Total num frames: 192448512. Throughput: 0: 9647.1. Samples: 384896316. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:23,993][27935] Avg episode reward: [(0, '-8.997')] [2022-07-13 05:52:28,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4829.8, 300 sec: 4870.1). Total num frames: 192472064. Throughput: 0: 9624.6. Samples: 384954588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:28,990][27935] Avg episode reward: [(0, '-9.443')] [2022-07-13 05:52:33,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4846.9, 300 sec: 4873.6). Total num frames: 192497664. Throughput: 0: 9613.6. Samples: 385012592. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:33,989][27935] Avg episode reward: [(0, '-9.320')] [2022-07-13 05:52:38,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4812.8, 300 sec: 4866.6). Total num frames: 192520192. Throughput: 0: 9621.4. Samples: 385041980. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:38,989][27935] Avg episode reward: [(0, '-9.688')] [2022-07-13 05:52:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 192545792. Throughput: 0: 9603.9. Samples: 385099616. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:43,989][27935] Avg episode reward: [(0, '-9.756')] [2022-07-13 05:52:48,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4795.7, 300 sec: 4866.6). Total num frames: 192568320. Throughput: 0: 9689.9. Samples: 385157700. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:48,989][27935] Avg episode reward: [(0, '-10.965')] [2022-07-13 05:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 192593920. Throughput: 0: 9692.5. Samples: 385187068. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:53,989][27935] Avg episode reward: [(0, '-8.954')] [2022-07-13 05:52:58,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4830.0, 300 sec: 4873.5). Total num frames: 192617472. Throughput: 0: 9702.8. Samples: 385245460. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:52:58,989][27935] Avg episode reward: [(0, '-8.536')] [2022-07-13 05:53:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 192642048. Throughput: 0: 9614.1. Samples: 385299788. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:03,989][27935] Avg episode reward: [(0, '-7.225')] [2022-07-13 05:53:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4866.9). Total num frames: 192664576. Throughput: 0: 9614.1. Samples: 385328916. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:08,989][27935] Avg episode reward: [(0, '-8.322')] [2022-07-13 05:53:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4856.2). Total num frames: 192687104. Throughput: 0: 9575.7. Samples: 385385492. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:13,989][27935] Avg episode reward: [(0, '-8.756')] [2022-07-13 05:53:18,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4812.5, 300 sec: 4856.1). Total num frames: 192711680. Throughput: 0: 9566.4. Samples: 385443112. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:18,993][27935] Avg episode reward: [(0, '-10.272')] [2022-07-13 05:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.9, 300 sec: 4849.2). Total num frames: 192735232. Throughput: 0: 9566.1. Samples: 385472456. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:23,989][27935] Avg episode reward: [(0, '-9.042')] [2022-07-13 05:53:28,989][27935] Fps is (10 sec: 5019.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 192761856. Throughput: 0: 9583.9. Samples: 385530892. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:28,989][27935] Avg episode reward: [(0, '-8.659')] [2022-07-13 05:53:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4849.2). Total num frames: 192784384. Throughput: 0: 9576.8. Samples: 385588656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:33,989][27935] Avg episode reward: [(0, '-8.536')] [2022-07-13 05:53:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 192808960. Throughput: 0: 9574.9. Samples: 385617940. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:38,989][27935] Avg episode reward: [(0, '-6.852')] [2022-07-13 05:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4842.3). Total num frames: 192832512. Throughput: 0: 9576.6. Samples: 385676408. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 05:53:43,989][27935] Avg episode reward: [(0, '-6.313')] [2022-07-13 05:53:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 192859136. Throughput: 0: 9660.1. Samples: 385734492. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:53:48,989][27935] Avg episode reward: [(0, '-6.995')] [2022-07-13 05:53:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 192881664. Throughput: 0: 9656.6. Samples: 385763464. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:53:53,989][27935] Avg episode reward: [(0, '-6.228')] [2022-07-13 05:53:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 192906240. Throughput: 0: 9690.8. Samples: 385821576. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:53:58,989][27935] Avg episode reward: [(0, '-8.052')] [2022-07-13 05:54:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4842.3). Total num frames: 192928768. Throughput: 0: 9061.7. Samples: 385850860. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:03,989][27935] Avg episode reward: [(0, '-9.001')] [2022-07-13 05:54:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 192952320. Throughput: 0: 9624.9. Samples: 385905576. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:08,989][27935] Avg episode reward: [(0, '-9.622')] [2022-07-13 05:54:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 192979968. Throughput: 0: 9691.4. Samples: 385967004. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:13,989][27935] Avg episode reward: [(0, '-9.596')] [2022-07-13 05:54:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4898.4, 300 sec: 4852.7). Total num frames: 193005568. Throughput: 0: 9816.5. Samples: 386030400. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:18,989][27935] Avg episode reward: [(0, '-10.634')] [2022-07-13 05:54:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4949.3, 300 sec: 4863.1). Total num frames: 193032192. Throughput: 0: 9872.5. Samples: 386062204. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:23,989][27935] Avg episode reward: [(0, '-9.853')] [2022-07-13 05:54:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4932.3, 300 sec: 4863.1). Total num frames: 193057792. Throughput: 0: 9977.0. Samples: 386125372. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:28,989][27935] Avg episode reward: [(0, '-10.659')] [2022-07-13 05:54:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 4870.1). Total num frames: 193083392. Throughput: 0: 10077.1. Samples: 386187960. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:33,989][27935] Avg episode reward: [(0, '-9.664')] [2022-07-13 05:54:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5034.7, 300 sec: 4877.0). Total num frames: 193111040. Throughput: 0: 10130.2. Samples: 386219324. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:38,990][27935] Avg episode reward: [(0, '-10.098')] [2022-07-13 05:54:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5068.8, 300 sec: 4880.5). Total num frames: 193136640. Throughput: 0: 10257.2. Samples: 386283148. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:43,989][27935] Avg episode reward: [(0, '-10.508')] [2022-07-13 05:54:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 4890.9). Total num frames: 193164288. Throughput: 0: 11008.9. Samples: 386346260. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:48,990][27935] Avg episode reward: [(0, '-11.196')] [2022-07-13 05:54:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 4894.4). Total num frames: 193189888. Throughput: 0: 10500.9. Samples: 386378116. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:53,989][27935] Avg episode reward: [(0, '-11.322')] [2022-07-13 05:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 4908.3). Total num frames: 193216512. Throughput: 0: 10551.5. Samples: 386441820. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:54:58,989][27935] Avg episode reward: [(0, '-11.098')] [2022-07-13 05:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 4908.3). Total num frames: 193240064. Throughput: 0: 10455.1. Samples: 386500880. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:03,989][27935] Avg episode reward: [(0, '-10.716')] [2022-07-13 05:55:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 4918.7). Total num frames: 193267712. Throughput: 0: 10445.8. Samples: 386532264. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:08,992][27935] Avg episode reward: [(0, '-10.113')] [2022-07-13 05:55:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 4918.7). Total num frames: 193293312. Throughput: 0: 10453.5. Samples: 386595780. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:13,989][27935] Avg episode reward: [(0, '-9.125')] [2022-07-13 05:55:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4929.1). Total num frames: 193319936. Throughput: 0: 10459.3. Samples: 386658628. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:18,989][27935] Avg episode reward: [(0, '-8.392')] [2022-07-13 05:55:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4925.6). Total num frames: 193344512. Throughput: 0: 10469.1. Samples: 386690436. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:23,989][27935] Avg episode reward: [(0, '-9.469')] [2022-07-13 05:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4939.5). Total num frames: 193372160. Throughput: 0: 10468.8. Samples: 386754244. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:28,989][27935] Avg episode reward: [(0, '-7.984')] [2022-07-13 05:55:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 4946.4). Total num frames: 193398784. Throughput: 0: 10475.1. Samples: 386817640. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:33,989][27935] Avg episode reward: [(0, '-8.314')] [2022-07-13 05:55:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 4953.4). Total num frames: 193425408. Throughput: 0: 10471.6. Samples: 386849336. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:38,989][27935] Avg episode reward: [(0, '-8.728')] [2022-07-13 05:55:43,992][27935] Fps is (10 sec: 5425.3, 60 sec: 5273.3, 300 sec: 4967.2). Total num frames: 193453056. Throughput: 0: 10484.2. Samples: 386913644. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:43,993][27935] Avg episode reward: [(0, '-10.028')] [2022-07-13 05:55:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4963.8). Total num frames: 193477632. Throughput: 0: 10560.7. Samples: 386976112. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:48,989][27935] Avg episode reward: [(0, '-10.436')] [2022-07-13 05:55:53,989][27935] Fps is (10 sec: 5224.2, 60 sec: 5256.5, 300 sec: 4974.2). Total num frames: 193505280. Throughput: 0: 10569.7. Samples: 387007900. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:53,989][27935] Avg episode reward: [(0, '-8.556')] [2022-07-13 05:55:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 4991.6). Total num frames: 193531904. Throughput: 0: 10577.1. Samples: 387071748. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 05:55:58,989][27935] Avg episode reward: [(0, '-8.016')] [2022-07-13 05:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 4984.6). Total num frames: 193555456. Throughput: 0: 10495.8. Samples: 387130940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:03,989][27935] Avg episode reward: [(0, '-7.053')] [2022-07-13 05:56:08,994][27935] Fps is (10 sec: 5014.8, 60 sec: 5239.0, 300 sec: 4994.9). Total num frames: 193582080. Throughput: 0: 10481.7. Samples: 387162172. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:08,999][27935] Avg episode reward: [(0, '-4.639')] [2022-07-13 05:56:14,001][27935] Fps is (10 sec: 5318.5, 60 sec: 5255.5, 300 sec: 5001.8). Total num frames: 193608704. Throughput: 0: 10470.8. Samples: 387225556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:14,001][27935] Avg episode reward: [(0, '-3.986')] [2022-07-13 05:56:18,989][27935] Fps is (10 sec: 5327.8, 60 sec: 5256.5, 300 sec: 5008.9). Total num frames: 193635328. Throughput: 0: 10446.8. Samples: 387287748. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:18,989][27935] Avg episode reward: [(0, '-5.567')] [2022-07-13 05:56:23,989][27935] Fps is (10 sec: 5126.1, 60 sec: 5256.5, 300 sec: 5008.9). Total num frames: 193659904. Throughput: 0: 10438.3. Samples: 387319060. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:23,989][27935] Avg episode reward: [(0, '-4.942')] [2022-07-13 05:56:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5015.9). Total num frames: 193686528. Throughput: 0: 10422.1. Samples: 387382600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:28,989][27935] Avg episode reward: [(0, '-6.773')] [2022-07-13 05:56:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5022.8). Total num frames: 193713152. Throughput: 0: 10417.8. Samples: 387444912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:33,989][27935] Avg episode reward: [(0, '-9.694')] [2022-07-13 05:56:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5029.7). Total num frames: 193739776. Throughput: 0: 10408.3. Samples: 387476272. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:38,989][27935] Avg episode reward: [(0, '-10.645')] [2022-07-13 05:56:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.6, 300 sec: 5033.2). Total num frames: 193765376. Throughput: 0: 10412.9. Samples: 387540328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:43,989][27935] Avg episode reward: [(0, '-10.535')] [2022-07-13 05:56:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5043.6). Total num frames: 193792000. Throughput: 0: 10491.8. Samples: 387603068. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:48,991][27935] Avg episode reward: [(0, '-7.452')] [2022-07-13 05:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5050.6). Total num frames: 193817600. Throughput: 0: 10504.9. Samples: 387634836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:53,990][27935] Avg episode reward: [(0, '-8.156')] [2022-07-13 05:56:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5067.9). Total num frames: 193845248. Throughput: 0: 10511.8. Samples: 387698464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:56:58,989][27935] Avg episode reward: [(0, '-7.923')] [2022-07-13 05:57:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5061.0). Total num frames: 193868800. Throughput: 0: 10454.9. Samples: 387758220. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:03,989][27935] Avg episode reward: [(0, '-5.437')] [2022-07-13 05:57:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5240.0, 300 sec: 5074.9). Total num frames: 193896448. Throughput: 0: 10461.9. Samples: 387789844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:08,990][27935] Avg episode reward: [(0, '-5.656')] [2022-07-13 05:57:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5223.4, 300 sec: 5081.8). Total num frames: 193922048. Throughput: 0: 10460.8. Samples: 387853336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:13,989][27935] Avg episode reward: [(0, '-5.596')] [2022-07-13 05:57:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5088.8). Total num frames: 193949696. Throughput: 0: 10489.1. Samples: 387916920. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:18,991][27935] Avg episode reward: [(0, '-7.494')] [2022-07-13 05:57:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5095.7). Total num frames: 193975296. Throughput: 0: 10500.6. Samples: 387948800. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:23,989][27935] Avg episode reward: [(0, '-7.948')] [2022-07-13 05:57:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5095.7). Total num frames: 194000896. Throughput: 0: 10474.0. Samples: 388011660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:28,989][27935] Avg episode reward: [(0, '-6.532')] [2022-07-13 05:57:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5109.6). Total num frames: 194027520. Throughput: 0: 10483.8. Samples: 388074840. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:33,989][27935] Avg episode reward: [(0, '-6.718')] [2022-07-13 05:57:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5113.1). Total num frames: 194054144. Throughput: 0: 10475.3. Samples: 388106224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:38,989][27935] Avg episode reward: [(0, '-6.527')] [2022-07-13 05:57:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5123.5). Total num frames: 194079744. Throughput: 0: 10429.5. Samples: 388167792. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:43,989][27935] Avg episode reward: [(0, '-8.474')] [2022-07-13 05:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5126.9). Total num frames: 194106368. Throughput: 0: 10506.3. Samples: 388231004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:48,989][27935] Avg episode reward: [(0, '-6.953')] [2022-07-13 05:57:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5130.4). Total num frames: 194130944. Throughput: 0: 10508.6. Samples: 388262732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:53,989][27935] Avg episode reward: [(0, '-7.341')] [2022-07-13 05:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5140.8). Total num frames: 194158592. Throughput: 0: 10509.9. Samples: 388326280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:57:58,990][27935] Avg episode reward: [(0, '-8.184')] [2022-07-13 05:58:03,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5151.2). Total num frames: 194184192. Throughput: 0: 10414.3. Samples: 388385564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:58:03,991][27935] Avg episode reward: [(0, '-7.949')] [2022-07-13 05:58:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5161.7). Total num frames: 194209792. Throughput: 0: 10412.2. Samples: 388417348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 22.0) [2022-07-13 05:58:08,991][27935] Avg episode reward: [(0, '-7.718')] [2022-07-13 05:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5165.2). Total num frames: 194235392. Throughput: 0: 10421.2. Samples: 388480616. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:13,990][27935] Avg episode reward: [(0, '-7.080')] [2022-07-13 05:58:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 194264064. Throughput: 0: 10425.0. Samples: 388543964. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:18,989][27935] Avg episode reward: [(0, '-8.096')] [2022-07-13 05:58:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5179.0). Total num frames: 194289664. Throughput: 0: 10435.1. Samples: 388575804. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:23,989][27935] Avg episode reward: [(0, '-7.238')] [2022-07-13 05:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5186.0). Total num frames: 194314240. Throughput: 0: 10470.8. Samples: 388638980. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:28,989][27935] Avg episode reward: [(0, '-7.851')] [2022-07-13 05:58:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 194341888. Throughput: 0: 10461.8. Samples: 388701784. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:33,989][27935] Avg episode reward: [(0, '-8.629')] [2022-07-13 05:58:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 194368512. Throughput: 0: 10470.3. Samples: 388733896. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:38,989][27935] Avg episode reward: [(0, '-9.602')] [2022-07-13 05:58:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 194394112. Throughput: 0: 10449.6. Samples: 388796512. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:43,989][27935] Avg episode reward: [(0, '-9.203')] [2022-07-13 05:58:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 194418688. Throughput: 0: 10538.0. Samples: 388859776. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:48,989][27935] Avg episode reward: [(0, '-10.556')] [2022-07-13 05:58:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5224.1). Total num frames: 194447360. Throughput: 0: 10537.5. Samples: 388891536. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:53,990][27935] Avg episode reward: [(0, '-10.748')] [2022-07-13 05:58:58,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 194473984. Throughput: 0: 10554.1. Samples: 388955552. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:58:58,990][27935] Avg episode reward: [(0, '-12.040')] [2022-07-13 05:59:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 194497536. Throughput: 0: 10477.9. Samples: 389015468. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:03,989][27935] Avg episode reward: [(0, '-11.522')] [2022-07-13 05:59:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 194525184. Throughput: 0: 10478.8. Samples: 389047352. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:08,990][27935] Avg episode reward: [(0, '-10.797')] [2022-07-13 05:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 194549760. Throughput: 0: 10469.2. Samples: 389110096. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:13,991][27935] Avg episode reward: [(0, '-12.068')] [2022-07-13 05:59:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 194576384. Throughput: 0: 10426.2. Samples: 389170964. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:18,989][27935] Avg episode reward: [(0, '-11.535')] [2022-07-13 05:59:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 194601984. Throughput: 0: 10417.7. Samples: 389202692. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:23,989][27935] Avg episode reward: [(0, '-8.717')] [2022-07-13 05:59:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 194628608. Throughput: 0: 10436.2. Samples: 389266140. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:28,990][27935] Avg episode reward: [(0, '-8.989')] [2022-07-13 05:59:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 194654208. Throughput: 0: 10436.4. Samples: 389329416. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:33,990][27935] Avg episode reward: [(0, '-7.402')] [2022-07-13 05:59:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 194681856. Throughput: 0: 10439.3. Samples: 389361304. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:38,991][27935] Avg episode reward: [(0, '-7.957')] [2022-07-13 05:59:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 194707456. Throughput: 0: 10430.7. Samples: 389424932. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:43,989][27935] Avg episode reward: [(0, '-7.282')] [2022-07-13 05:59:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 194734080. Throughput: 0: 10491.5. Samples: 389487584. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:48,989][27935] Avg episode reward: [(0, '-7.385')] [2022-07-13 05:59:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 194759680. Throughput: 0: 10491.7. Samples: 389519480. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:53,990][27935] Avg episode reward: [(0, '-9.918')] [2022-07-13 05:59:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 194788352. Throughput: 0: 10524.3. Samples: 389583688. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 05:59:58,990][27935] Avg episode reward: [(0, '-9.327')] [2022-07-13 06:00:03,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 194812928. Throughput: 0: 10499.2. Samples: 389643424. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 06:00:03,989][27935] Avg episode reward: [(0, '-8.657')] [2022-07-13 06:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 194838528. Throughput: 0: 10502.4. Samples: 389675300. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 06:00:08,990][27935] Avg episode reward: [(0, '-9.245')] [2022-07-13 06:00:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 194864128. Throughput: 0: 10507.5. Samples: 389738976. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 06:00:13,989][27935] Avg episode reward: [(0, '-10.327')] [2022-07-13 06:00:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 194892800. Throughput: 0: 10506.1. Samples: 389802188. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 06:00:18,989][27935] Avg episode reward: [(0, '-10.230')] [2022-07-13 06:00:23,989][27935] Fps is (10 sec: 5427.3, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 194918400. Throughput: 0: 10505.6. Samples: 389834056. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 06:00:23,989][27935] Avg episode reward: [(0, '-9.481')] [2022-07-13 06:00:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 194945024. Throughput: 0: 10495.5. Samples: 389897228. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:28,989][27935] Avg episode reward: [(0, '-8.675')] [2022-07-13 06:00:33,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 194969600. Throughput: 0: 10509.1. Samples: 389960496. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:33,990][27935] Avg episode reward: [(0, '-9.603')] [2022-07-13 06:00:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.6). Total num frames: 194997248. Throughput: 0: 10508.4. Samples: 389992356. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:38,989][27935] Avg episode reward: [(0, '-9.282')] [2022-07-13 06:00:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 195023872. Throughput: 0: 10495.4. Samples: 390055980. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:43,989][27935] Avg episode reward: [(0, '-8.924')] [2022-07-13 06:00:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 195049472. Throughput: 0: 10579.1. Samples: 390119484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:48,989][27935] Avg episode reward: [(0, '-6.197')] [2022-07-13 06:00:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5234.5). Total num frames: 195076096. Throughput: 0: 10573.8. Samples: 390151120. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:53,989][27935] Avg episode reward: [(0, '-7.061')] [2022-07-13 06:00:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 195102720. Throughput: 0: 10567.0. Samples: 390214488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:00:58,989][27935] Avg episode reward: [(0, '-8.345')] [2022-07-13 06:01:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.1). Total num frames: 195127296. Throughput: 0: 10469.4. Samples: 390273312. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:03,989][27935] Avg episode reward: [(0, '-9.148')] [2022-07-13 06:01:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5238.2). Total num frames: 195153920. Throughput: 0: 10469.4. Samples: 390305180. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:08,989][27935] Avg episode reward: [(0, '-9.145')] [2022-07-13 06:01:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 195179520. Throughput: 0: 10480.9. Samples: 390368868. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:13,989][27935] Avg episode reward: [(0, '-9.621')] [2022-07-13 06:01:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 195207168. Throughput: 0: 10469.0. Samples: 390431600. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:18,989][27935] Avg episode reward: [(0, '-10.441')] [2022-07-13 06:01:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195232768. Throughput: 0: 10466.9. Samples: 390463364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:23,990][27935] Avg episode reward: [(0, '-9.195')] [2022-07-13 06:01:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195259392. Throughput: 0: 10475.0. Samples: 390527356. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:28,989][27935] Avg episode reward: [(0, '-8.803')] [2022-07-13 06:01:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 195283968. Throughput: 0: 10445.2. Samples: 390589516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:33,991][27935] Avg episode reward: [(0, '-8.067')] [2022-07-13 06:01:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5248.4). Total num frames: 195313664. Throughput: 0: 10443.2. Samples: 390621064. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:38,989][27935] Avg episode reward: [(0, '-9.041')] [2022-07-13 06:01:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195338240. Throughput: 0: 10445.7. Samples: 390684544. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:43,989][27935] Avg episode reward: [(0, '-9.966')] [2022-07-13 06:01:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 195364864. Throughput: 0: 10541.8. Samples: 390747692. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:48,989][27935] Avg episode reward: [(0, '-8.684')] [2022-07-13 06:01:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 195390464. Throughput: 0: 10542.9. Samples: 390779608. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:53,991][27935] Avg episode reward: [(0, '-9.675')] [2022-07-13 06:01:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 195418112. Throughput: 0: 10551.5. Samples: 390843684. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:01:58,989][27935] Avg episode reward: [(0, '-10.003')] [2022-07-13 06:02:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 195441664. Throughput: 0: 10481.1. Samples: 390903248. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:03,996][27935] Avg episode reward: [(0, '-10.830')] [2022-07-13 06:02:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195468288. Throughput: 0: 10473.8. Samples: 390934684. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:08,989][27935] Avg episode reward: [(0, '-11.549')] [2022-07-13 06:02:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 195493888. Throughput: 0: 10467.4. Samples: 390998388. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:13,989][27935] Avg episode reward: [(0, '-13.158')] [2022-07-13 06:02:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195521536. Throughput: 0: 10474.7. Samples: 391060876. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:18,989][27935] Avg episode reward: [(0, '-12.264')] [2022-07-13 06:02:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195547136. Throughput: 0: 10486.1. Samples: 391092940. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:23,989][27935] Avg episode reward: [(0, '-11.745')] [2022-07-13 06:02:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 195573760. Throughput: 0: 10498.4. Samples: 391156972. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:28,989][27935] Avg episode reward: [(0, '-11.128')] [2022-07-13 06:02:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5245.0). Total num frames: 195601408. Throughput: 0: 10506.6. Samples: 391220488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 06:02:33,989][27935] Avg episode reward: [(0, '-11.944')] [2022-07-13 06:02:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5248.4). Total num frames: 195628032. Throughput: 0: 10508.1. Samples: 391252472. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:02:38,989][27935] Avg episode reward: [(0, '-9.518')] [2022-07-13 06:02:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 195653632. Throughput: 0: 10475.8. Samples: 391315096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:02:43,989][27935] Avg episode reward: [(0, '-9.343')] [2022-07-13 06:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 195678208. Throughput: 0: 10553.5. Samples: 391378156. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:02:48,989][27935] Avg episode reward: [(0, '-8.749')] [2022-07-13 06:02:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 195705856. Throughput: 0: 10559.7. Samples: 391409872. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:02:53,989][27935] Avg episode reward: [(0, '-10.376')] [2022-07-13 06:02:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 195731456. Throughput: 0: 10544.1. Samples: 391472872. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:02:58,989][27935] Avg episode reward: [(0, '-9.778')] [2022-07-13 06:03:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 195757056. Throughput: 0: 10459.9. Samples: 391531572. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:03,989][27935] Avg episode reward: [(0, '-8.733')] [2022-07-13 06:03:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 195781632. Throughput: 0: 10450.4. Samples: 391563208. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:08,989][27935] Avg episode reward: [(0, '-8.621')] [2022-07-13 06:03:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 195809280. Throughput: 0: 10437.1. Samples: 391626644. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:13,989][27935] Avg episode reward: [(0, '-7.861')] [2022-07-13 06:03:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 195834880. Throughput: 0: 10415.7. Samples: 391689196. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:18,989][27935] Avg episode reward: [(0, '-8.491')] [2022-07-13 06:03:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 195861504. Throughput: 0: 10410.2. Samples: 391720932. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:23,989][27935] Avg episode reward: [(0, '-6.348')] [2022-07-13 06:03:28,991][27935] Fps is (10 sec: 5221.4, 60 sec: 5222.2, 300 sec: 5238.0). Total num frames: 195887104. Throughput: 0: 10429.7. Samples: 391784452. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:28,992][27935] Avg episode reward: [(0, '-6.240')] [2022-07-13 06:03:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 195913728. Throughput: 0: 10429.6. Samples: 391847488. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:33,989][27935] Avg episode reward: [(0, '-6.525')] [2022-07-13 06:03:38,989][27935] Fps is (10 sec: 5428.3, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 195941376. Throughput: 0: 10428.8. Samples: 391879168. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:38,989][27935] Avg episode reward: [(0, '-5.817')] [2022-07-13 06:03:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5245.0). Total num frames: 195965952. Throughput: 0: 10437.6. Samples: 391942564. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:43,989][27935] Avg episode reward: [(0, '-6.526')] [2022-07-13 06:03:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 195992576. Throughput: 0: 10530.3. Samples: 392005436. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:48,989][27935] Avg episode reward: [(0, '-6.993')] [2022-07-13 06:03:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 196020224. Throughput: 0: 10537.3. Samples: 392037388. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:53,989][27935] Avg episode reward: [(0, '-8.601')] [2022-07-13 06:03:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5251.9). Total num frames: 196046848. Throughput: 0: 10543.2. Samples: 392101088. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:03:58,990][27935] Avg episode reward: [(0, '-8.815')] [2022-07-13 06:04:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 196071424. Throughput: 0: 10470.6. Samples: 392160372. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:03,989][27935] Avg episode reward: [(0, '-8.926')] [2022-07-13 06:04:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 196097024. Throughput: 0: 10469.2. Samples: 392192048. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:08,991][27935] Avg episode reward: [(0, '-9.774')] [2022-07-13 06:04:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 196123648. Throughput: 0: 10470.3. Samples: 392255596. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:13,989][27935] Avg episode reward: [(0, '-10.223')] [2022-07-13 06:04:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 196150272. Throughput: 0: 10456.3. Samples: 392318020. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:18,989][27935] Avg episode reward: [(0, '-9.244')] [2022-07-13 06:04:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 196175872. Throughput: 0: 10452.5. Samples: 392349532. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:23,989][27935] Avg episode reward: [(0, '-8.665')] [2022-07-13 06:04:28,997][27935] Fps is (10 sec: 5218.3, 60 sec: 5256.0, 300 sec: 5248.3). Total num frames: 196202496. Throughput: 0: 10454.5. Samples: 392413100. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:28,997][27935] Avg episode reward: [(0, '-7.989')] [2022-07-13 06:04:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 196229120. Throughput: 0: 10472.4. Samples: 392476696. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:33,989][27935] Avg episode reward: [(0, '-6.738')] [2022-07-13 06:04:38,989][27935] Fps is (10 sec: 5226.5, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 196254720. Throughput: 0: 10460.1. Samples: 392508092. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:38,989][27935] Avg episode reward: [(0, '-5.886')] [2022-07-13 06:04:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 196281344. Throughput: 0: 10458.0. Samples: 392571700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:43,989][27935] Avg episode reward: [(0, '-5.983')] [2022-07-13 06:04:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 196307968. Throughput: 0: 10543.0. Samples: 392634808. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 06:04:48,989][27935] Avg episode reward: [(0, '-6.498')] [2022-07-13 06:04:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 196333568. Throughput: 0: 10536.2. Samples: 392666176. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:04:53,989][27935] Avg episode reward: [(0, '-7.726')] [2022-07-13 06:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 196359168. Throughput: 0: 10513.4. Samples: 392728696. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:04:58,989][27935] Avg episode reward: [(0, '-8.457')] [2022-07-13 06:05:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5241.5). Total num frames: 196384768. Throughput: 0: 10440.0. Samples: 392787820. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:03,989][27935] Avg episode reward: [(0, '-8.887')] [2022-07-13 06:05:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5245.0). Total num frames: 196411392. Throughput: 0: 10447.2. Samples: 392819656. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:08,989][27935] Avg episode reward: [(0, '-8.819')] [2022-07-13 06:05:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 196436992. Throughput: 0: 10452.2. Samples: 392883368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:13,989][27935] Avg episode reward: [(0, '-7.101')] [2022-07-13 06:05:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 196462592. Throughput: 0: 10394.9. Samples: 392944468. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:18,989][27935] Avg episode reward: [(0, '-6.680')] [2022-07-13 06:05:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 196489216. Throughput: 0: 10387.6. Samples: 392975532. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:23,989][27935] Avg episode reward: [(0, '-7.076')] [2022-07-13 06:05:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5206.0, 300 sec: 5238.0). Total num frames: 196514816. Throughput: 0: 10386.5. Samples: 393039092. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:28,990][27935] Avg episode reward: [(0, '-7.154')] [2022-07-13 06:05:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 196540416. Throughput: 0: 10396.2. Samples: 393102636. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:33,989][27935] Avg episode reward: [(0, '-5.948')] [2022-07-13 06:05:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 196569088. Throughput: 0: 10395.2. Samples: 393133960. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:38,989][27935] Avg episode reward: [(0, '-7.267')] [2022-07-13 06:05:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 196593664. Throughput: 0: 10406.8. Samples: 393197000. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:43,989][27935] Avg episode reward: [(0, '-8.044')] [2022-07-13 06:05:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 196620288. Throughput: 0: 10482.2. Samples: 393259520. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:48,989][27935] Avg episode reward: [(0, '-8.562')] [2022-07-13 06:05:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 196646912. Throughput: 0: 10480.8. Samples: 393291292. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:53,989][27935] Avg episode reward: [(0, '-9.013')] [2022-07-13 06:05:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 196672512. Throughput: 0: 10466.2. Samples: 393354348. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:05:58,989][27935] Avg episode reward: [(0, '-8.626')] [2022-07-13 06:06:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 196697088. Throughput: 0: 10421.7. Samples: 393413444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:03,989][27935] Avg episode reward: [(0, '-7.040')] [2022-07-13 06:06:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 196722688. Throughput: 0: 10433.4. Samples: 393445036. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:08,989][27935] Avg episode reward: [(0, '-8.156')] [2022-07-13 06:06:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 196750336. Throughput: 0: 10433.4. Samples: 393508596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:13,989][27935] Avg episode reward: [(0, '-7.743')] [2022-07-13 06:06:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 196775936. Throughput: 0: 10427.2. Samples: 393571860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:18,989][27935] Avg episode reward: [(0, '-6.691')] [2022-07-13 06:06:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 196802560. Throughput: 0: 10430.1. Samples: 393603316. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:23,991][27935] Avg episode reward: [(0, '-6.277')] [2022-07-13 06:06:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 196829184. Throughput: 0: 10431.0. Samples: 393666396. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:28,989][27935] Avg episode reward: [(0, '-6.745')] [2022-07-13 06:06:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 196856832. Throughput: 0: 10448.2. Samples: 393729688. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:33,990][27935] Avg episode reward: [(0, '-6.683')] [2022-07-13 06:06:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 196880384. Throughput: 0: 10446.9. Samples: 393761404. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:38,990][27935] Avg episode reward: [(0, '-6.322')] [2022-07-13 06:06:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 196908032. Throughput: 0: 10453.5. Samples: 393824756. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:43,989][27935] Avg episode reward: [(0, '-6.701')] [2022-07-13 06:06:48,991][27935] Fps is (10 sec: 5323.4, 60 sec: 5222.2, 300 sec: 5231.0). Total num frames: 196933632. Throughput: 0: 10541.9. Samples: 393887856. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:48,992][27935] Avg episode reward: [(0, '-5.927')] [2022-07-13 06:06:53,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 196961280. Throughput: 0: 10547.0. Samples: 393919652. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:53,989][27935] Avg episode reward: [(0, '-5.297')] [2022-07-13 06:06:58,989][27935] Fps is (10 sec: 5326.2, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 196986880. Throughput: 0: 10536.2. Samples: 393982724. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 06:06:58,989][27935] Avg episode reward: [(0, '-6.662')] [2022-07-13 06:07:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 197010432. Throughput: 0: 10449.6. Samples: 394042092. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:03,989][27935] Avg episode reward: [(0, '-7.189')] [2022-07-13 06:07:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 197038080. Throughput: 0: 10447.0. Samples: 394073432. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:08,989][27935] Avg episode reward: [(0, '-8.209')] [2022-07-13 06:07:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 197063680. Throughput: 0: 10463.2. Samples: 394137240. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:13,989][27935] Avg episode reward: [(0, '-7.880')] [2022-07-13 06:07:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 197090304. Throughput: 0: 10453.9. Samples: 394200112. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:18,989][27935] Avg episode reward: [(0, '-8.192')] [2022-07-13 06:07:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 197116928. Throughput: 0: 10459.4. Samples: 394232076. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:23,989][27935] Avg episode reward: [(0, '-10.338')] [2022-07-13 06:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 197142528. Throughput: 0: 10469.6. Samples: 394295888. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:28,989][27935] Avg episode reward: [(0, '-7.332')] [2022-07-13 06:07:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 197169152. Throughput: 0: 10470.4. Samples: 394358996. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:33,990][27935] Avg episode reward: [(0, '-7.047')] [2022-07-13 06:07:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5231.1). Total num frames: 197196800. Throughput: 0: 10466.1. Samples: 394390624. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:38,989][27935] Avg episode reward: [(0, '-7.714')] [2022-07-13 06:07:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 197221376. Throughput: 0: 10450.9. Samples: 394453012. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:43,989][27935] Avg episode reward: [(0, '-9.080')] [2022-07-13 06:07:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.7, 300 sec: 5227.6). Total num frames: 197248000. Throughput: 0: 10547.6. Samples: 394516732. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:48,989][27935] Avg episode reward: [(0, '-10.219')] [2022-07-13 06:07:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 197274624. Throughput: 0: 10554.9. Samples: 394548400. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:53,989][27935] Avg episode reward: [(0, '-10.230')] [2022-07-13 06:07:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 197301248. Throughput: 0: 10539.8. Samples: 394611532. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:07:58,990][27935] Avg episode reward: [(0, '-9.838')] [2022-07-13 06:08:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 197325824. Throughput: 0: 10463.0. Samples: 394670948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:03,989][27935] Avg episode reward: [(0, '-9.199')] [2022-07-13 06:08:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 197352448. Throughput: 0: 10458.1. Samples: 394702688. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:08,991][27935] Avg episode reward: [(0, '-9.817')] [2022-07-13 06:08:13,989][27935] Fps is (10 sec: 5324.6, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 197379072. Throughput: 0: 10448.0. Samples: 394766052. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:13,990][27935] Avg episode reward: [(0, '-8.397')] [2022-07-13 06:08:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 197404672. Throughput: 0: 10438.6. Samples: 394828732. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:18,989][27935] Avg episode reward: [(0, '-8.843')] [2022-07-13 06:08:23,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 197430272. Throughput: 0: 10446.1. Samples: 394860700. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:23,990][27935] Avg episode reward: [(0, '-8.576')] [2022-07-13 06:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 197457920. Throughput: 0: 10459.4. Samples: 394923684. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:28,989][27935] Avg episode reward: [(0, '-8.864')] [2022-07-13 06:08:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 197483520. Throughput: 0: 10443.6. Samples: 394986692. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:33,989][27935] Avg episode reward: [(0, '-8.676')] [2022-07-13 06:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 197509120. Throughput: 0: 10438.9. Samples: 395018152. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:38,989][27935] Avg episode reward: [(0, '-8.277')] [2022-07-13 06:08:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5234.5). Total num frames: 197536768. Throughput: 0: 10452.9. Samples: 395081912. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:43,989][27935] Avg episode reward: [(0, '-7.319')] [2022-07-13 06:08:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 197562368. Throughput: 0: 10533.9. Samples: 395144976. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:48,989][27935] Avg episode reward: [(0, '-5.975')] [2022-07-13 06:08:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 197588992. Throughput: 0: 10524.2. Samples: 395176276. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:53,989][27935] Avg episode reward: [(0, '-6.530')] [2022-07-13 06:08:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 197615616. Throughput: 0: 10511.2. Samples: 395239052. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:08:58,990][27935] Avg episode reward: [(0, '-6.206')] [2022-07-13 06:09:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 197639168. Throughput: 0: 10424.8. Samples: 395297848. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:09:03,991][27935] Avg episode reward: [(0, '-6.974')] [2022-07-13 06:09:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 197664768. Throughput: 0: 10414.0. Samples: 395329328. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:09:08,990][27935] Avg episode reward: [(0, '-7.607')] [2022-07-13 06:09:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.4, 300 sec: 5224.1). Total num frames: 197691392. Throughput: 0: 10419.5. Samples: 395392560. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 06:09:13,990][27935] Avg episode reward: [(0, '-8.067')] [2022-07-13 06:09:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5231.1). Total num frames: 197719040. Throughput: 0: 10406.7. Samples: 395454992. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:18,989][27935] Avg episode reward: [(0, '-7.560')] [2022-07-13 06:09:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.7). Total num frames: 197744640. Throughput: 0: 10405.6. Samples: 395486404. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:23,989][27935] Avg episode reward: [(0, '-9.045')] [2022-07-13 06:09:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 197768192. Throughput: 0: 10368.3. Samples: 395548484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:28,989][27935] Avg episode reward: [(0, '-7.851')] [2022-07-13 06:09:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 197795840. Throughput: 0: 10337.7. Samples: 395610172. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:33,989][27935] Avg episode reward: [(0, '-6.403')] [2022-07-13 06:09:38,989][27935] Fps is (10 sec: 5324.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 197821440. Throughput: 0: 10339.8. Samples: 395641576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:38,990][27935] Avg episode reward: [(0, '-6.729')] [2022-07-13 06:09:44,004][27935] Fps is (10 sec: 5112.0, 60 sec: 5169.9, 300 sec: 5216.9). Total num frames: 197847040. Throughput: 0: 10323.1. Samples: 395703752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:44,008][27935] Avg episode reward: [(0, '-5.286')] [2022-07-13 06:09:48,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 197872640. Throughput: 0: 10397.1. Samples: 395765716. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:48,989][27935] Avg episode reward: [(0, '-4.805')] [2022-07-13 06:09:53,989][27935] Fps is (10 sec: 5230.6, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 197899264. Throughput: 0: 10390.7. Samples: 395796908. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:53,989][27935] Avg episode reward: [(0, '-5.060')] [2022-07-13 06:09:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5217.2). Total num frames: 197923840. Throughput: 0: 10371.4. Samples: 395859272. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:09:58,991][27935] Avg episode reward: [(0, '-6.176')] [2022-07-13 06:10:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 197949440. Throughput: 0: 10272.7. Samples: 395917264. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:03,989][27935] Avg episode reward: [(0, '-5.844')] [2022-07-13 06:10:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 197975040. Throughput: 0: 10273.5. Samples: 395948712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:08,989][27935] Avg episode reward: [(0, '-7.373')] [2022-07-13 06:10:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 198001664. Throughput: 0: 10280.9. Samples: 396011124. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:13,990][27935] Avg episode reward: [(0, '-7.938')] [2022-07-13 06:10:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5213.7). Total num frames: 198027264. Throughput: 0: 10297.2. Samples: 396073544. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:18,989][27935] Avg episode reward: [(0, '-10.038')] [2022-07-13 06:10:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5213.7). Total num frames: 198052864. Throughput: 0: 10296.1. Samples: 396104896. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:23,989][27935] Avg episode reward: [(0, '-10.594')] [2022-07-13 06:10:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 198078464. Throughput: 0: 10314.9. Samples: 396167760. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:28,989][27935] Avg episode reward: [(0, '-9.136')] [2022-07-13 06:10:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5206.8). Total num frames: 198105088. Throughput: 0: 10308.0. Samples: 396229576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:33,990][27935] Avg episode reward: [(0, '-8.581')] [2022-07-13 06:10:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.3, 300 sec: 5213.7). Total num frames: 198131712. Throughput: 0: 10299.2. Samples: 396260372. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:38,989][27935] Avg episode reward: [(0, '-7.655')] [2022-07-13 06:10:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5155.5, 300 sec: 5206.8). Total num frames: 198156288. Throughput: 0: 10297.7. Samples: 396322668. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:43,989][27935] Avg episode reward: [(0, '-8.297')] [2022-07-13 06:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 198181888. Throughput: 0: 10379.1. Samples: 396384324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:48,989][27935] Avg episode reward: [(0, '-7.312')] [2022-07-13 06:10:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5206.8). Total num frames: 198208512. Throughput: 0: 10372.0. Samples: 396415452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:53,990][27935] Avg episode reward: [(0, '-6.180')] [2022-07-13 06:10:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 198235136. Throughput: 0: 10368.7. Samples: 396477716. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:10:58,990][27935] Avg episode reward: [(0, '-6.538')] [2022-07-13 06:11:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5203.3). Total num frames: 198257664. Throughput: 0: 10275.7. Samples: 396535952. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:11:03,989][27935] Avg episode reward: [(0, '-6.414')] [2022-07-13 06:11:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 198283264. Throughput: 0: 10270.8. Samples: 396567080. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:11:08,990][27935] Avg episode reward: [(0, '-6.394')] [2022-07-13 06:11:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 198310912. Throughput: 0: 10266.0. Samples: 396629732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:11:13,989][27935] Avg episode reward: [(0, '-4.502')] [2022-07-13 06:11:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 198336512. Throughput: 0: 10272.3. Samples: 396691832. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:11:18,989][27935] Avg episode reward: [(0, '-5.765')] [2022-07-13 06:11:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 198361088. Throughput: 0: 10252.9. Samples: 396721752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:11:23,989][27935] Avg episode reward: [(0, '-5.921')] [2022-07-13 06:11:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 198385664. Throughput: 0: 10213.6. Samples: 396782280. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:28,989][27935] Avg episode reward: [(0, '-8.094')] [2022-07-13 06:11:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 198413312. Throughput: 0: 10213.5. Samples: 396843932. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:33,989][27935] Avg episode reward: [(0, '-11.702')] [2022-07-13 06:11:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5189.4). Total num frames: 198438912. Throughput: 0: 10212.4. Samples: 396875008. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:38,992][27935] Avg episode reward: [(0, '-12.267')] [2022-07-13 06:11:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5186.0). Total num frames: 198463488. Throughput: 0: 10221.4. Samples: 396937680. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:43,989][27935] Avg episode reward: [(0, '-11.954')] [2022-07-13 06:11:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 198490112. Throughput: 0: 10318.5. Samples: 397000284. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:48,989][27935] Avg episode reward: [(0, '-10.846')] [2022-07-13 06:11:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5186.0). Total num frames: 198516736. Throughput: 0: 10331.2. Samples: 397031984. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:53,989][27935] Avg episode reward: [(0, '-11.130')] [2022-07-13 06:11:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5192.9). Total num frames: 198542336. Throughput: 0: 10328.0. Samples: 397094492. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:11:58,989][27935] Avg episode reward: [(0, '-10.618')] [2022-07-13 06:12:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 198566912. Throughput: 0: 10248.4. Samples: 397153008. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:03,989][27935] Avg episode reward: [(0, '-6.961')] [2022-07-13 06:12:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 198593536. Throughput: 0: 10283.4. Samples: 397184504. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:08,989][27935] Avg episode reward: [(0, '-6.570')] [2022-07-13 06:12:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 198619136. Throughput: 0: 10328.0. Samples: 397247040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:13,989][27935] Avg episode reward: [(0, '-6.996')] [2022-07-13 06:12:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 198644736. Throughput: 0: 10341.6. Samples: 397309304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:18,989][27935] Avg episode reward: [(0, '-7.621')] [2022-07-13 06:12:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 198670336. Throughput: 0: 10349.0. Samples: 397340712. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:23,989][27935] Avg episode reward: [(0, '-6.668')] [2022-07-13 06:12:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 198697984. Throughput: 0: 10341.0. Samples: 397403024. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:28,989][27935] Avg episode reward: [(0, '-7.914')] [2022-07-13 06:12:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 198722560. Throughput: 0: 10339.5. Samples: 397465560. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:33,989][27935] Avg episode reward: [(0, '-7.590')] [2022-07-13 06:12:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 198750208. Throughput: 0: 10333.9. Samples: 397497008. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:38,990][27935] Avg episode reward: [(0, '-7.065')] [2022-07-13 06:12:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 198774784. Throughput: 0: 10350.7. Samples: 397560272. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:43,989][27935] Avg episode reward: [(0, '-8.443')] [2022-07-13 06:12:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 198801408. Throughput: 0: 10443.4. Samples: 397622960. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:48,989][27935] Avg episode reward: [(0, '-7.729')] [2022-07-13 06:12:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 198828032. Throughput: 0: 10446.8. Samples: 397654612. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:53,990][27935] Avg episode reward: [(0, '-8.372')] [2022-07-13 06:12:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 198853632. Throughput: 0: 10456.7. Samples: 397717592. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:12:58,989][27935] Avg episode reward: [(0, '-7.060')] [2022-07-13 06:13:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 198879232. Throughput: 0: 10375.3. Samples: 397776192. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:03,989][27935] Avg episode reward: [(0, '-7.336')] [2022-07-13 06:13:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 198903808. Throughput: 0: 10382.8. Samples: 397807940. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:08,989][27935] Avg episode reward: [(0, '-8.049')] [2022-07-13 06:13:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 198932480. Throughput: 0: 10395.6. Samples: 397870824. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:13,989][27935] Avg episode reward: [(0, '-8.045')] [2022-07-13 06:13:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 198956032. Throughput: 0: 10377.0. Samples: 397932524. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:18,989][27935] Avg episode reward: [(0, '-6.812')] [2022-07-13 06:13:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 198982656. Throughput: 0: 10373.0. Samples: 397963792. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:23,989][27935] Avg episode reward: [(0, '-8.237')] [2022-07-13 06:13:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 199007232. Throughput: 0: 10350.2. Samples: 398026032. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:28,989][27935] Avg episode reward: [(0, '-7.438')] [2022-07-13 06:13:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 199034880. Throughput: 0: 10336.3. Samples: 398088092. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:33,989][27935] Avg episode reward: [(0, '-8.060')] [2022-07-13 06:13:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 199060480. Throughput: 0: 10324.7. Samples: 398119224. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 06:13:38,990][27935] Avg episode reward: [(0, '-8.793')] [2022-07-13 06:13:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5168.6). Total num frames: 199087104. Throughput: 0: 10315.5. Samples: 398181788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:13:43,990][27935] Avg episode reward: [(0, '-8.187')] [2022-07-13 06:13:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 199112704. Throughput: 0: 10394.9. Samples: 398243964. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:13:48,989][27935] Avg episode reward: [(0, '-9.888')] [2022-07-13 06:13:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5161.7). Total num frames: 199138304. Throughput: 0: 10385.3. Samples: 398275280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:13:53,991][27935] Avg episode reward: [(0, '-9.377')] [2022-07-13 06:13:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 199163904. Throughput: 0: 10377.6. Samples: 398337816. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:13:58,989][27935] Avg episode reward: [(0, '-9.016')] [2022-07-13 06:14:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 199187456. Throughput: 0: 10288.2. Samples: 398395492. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:03,989][27935] Avg episode reward: [(0, '-8.176')] [2022-07-13 06:14:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 199215104. Throughput: 0: 10288.1. Samples: 398426756. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:08,989][27935] Avg episode reward: [(0, '-8.201')] [2022-07-13 06:14:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 199239680. Throughput: 0: 10286.1. Samples: 398488908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:13,989][27935] Avg episode reward: [(0, '-7.308')] [2022-07-13 06:14:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 199266304. Throughput: 0: 10281.9. Samples: 398550776. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:18,989][27935] Avg episode reward: [(0, '-6.408')] [2022-07-13 06:14:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 199290880. Throughput: 0: 10286.7. Samples: 398582128. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:23,989][27935] Avg episode reward: [(0, '-7.024')] [2022-07-13 06:14:28,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 199317504. Throughput: 0: 10264.8. Samples: 398643708. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:28,991][27935] Avg episode reward: [(0, '-7.701')] [2022-07-13 06:14:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5151.3). Total num frames: 199341056. Throughput: 0: 10255.5. Samples: 398705464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:33,989][27935] Avg episode reward: [(0, '-6.801')] [2022-07-13 06:14:38,992][27935] Fps is (10 sec: 5118.6, 60 sec: 5136.8, 300 sec: 5158.4). Total num frames: 199368704. Throughput: 0: 10245.5. Samples: 398736360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:38,993][27935] Avg episode reward: [(0, '-6.144')] [2022-07-13 06:14:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5158.2). Total num frames: 199394304. Throughput: 0: 10235.3. Samples: 398798404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:43,989][27935] Avg episode reward: [(0, '-8.092')] [2022-07-13 06:14:48,989][27935] Fps is (10 sec: 5223.9, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 199420928. Throughput: 0: 10314.3. Samples: 398859636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:48,989][27935] Avg episode reward: [(0, '-9.315')] [2022-07-13 06:14:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5158.2). Total num frames: 199445504. Throughput: 0: 10309.3. Samples: 398890672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:53,989][27935] Avg episode reward: [(0, '-10.619')] [2022-07-13 06:14:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 199472128. Throughput: 0: 10304.3. Samples: 398952600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:14:58,989][27935] Avg episode reward: [(0, '-10.160')] [2022-07-13 06:15:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 199495680. Throughput: 0: 10208.3. Samples: 399010148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:03,989][27935] Avg episode reward: [(0, '-10.981')] [2022-07-13 06:15:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 199521280. Throughput: 0: 10205.2. Samples: 399041364. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:08,989][27935] Avg episode reward: [(0, '-11.204')] [2022-07-13 06:15:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 199546880. Throughput: 0: 10210.0. Samples: 399103156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:13,990][27935] Avg episode reward: [(0, '-9.152')] [2022-07-13 06:15:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 199572480. Throughput: 0: 10200.3. Samples: 399164476. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:18,989][27935] Avg episode reward: [(0, '-9.353')] [2022-07-13 06:15:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 199599104. Throughput: 0: 10206.7. Samples: 399195632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:23,990][27935] Avg episode reward: [(0, '-8.736')] [2022-07-13 06:15:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 199625728. Throughput: 0: 10219.1. Samples: 399258264. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:28,989][27935] Avg episode reward: [(0, '-9.039')] [2022-07-13 06:15:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 199650304. Throughput: 0: 10232.2. Samples: 399320084. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:33,989][27935] Avg episode reward: [(0, '-8.406')] [2022-07-13 06:15:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.3, 300 sec: 5154.7). Total num frames: 199676928. Throughput: 0: 10237.0. Samples: 399351336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:38,989][27935] Avg episode reward: [(0, '-7.637')] [2022-07-13 06:15:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 199703552. Throughput: 0: 10262.4. Samples: 399414408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:43,989][27935] Avg episode reward: [(0, '-9.256')] [2022-07-13 06:15:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 199728128. Throughput: 0: 10364.9. Samples: 399476568. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 06:15:48,989][27935] Avg episode reward: [(0, '-8.653')] [2022-07-13 06:15:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 199753728. Throughput: 0: 10372.5. Samples: 399508124. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:15:53,989][27935] Avg episode reward: [(0, '-9.298')] [2022-07-13 06:15:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 199781376. Throughput: 0: 10385.9. Samples: 399570520. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:15:58,990][27935] Avg episode reward: [(0, '-8.451')] [2022-07-13 06:16:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 199803904. Throughput: 0: 10307.7. Samples: 399628324. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:03,989][27935] Avg episode reward: [(0, '-8.244')] [2022-07-13 06:16:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 199831552. Throughput: 0: 10315.1. Samples: 399659812. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:08,989][27935] Avg episode reward: [(0, '-8.033')] [2022-07-13 06:16:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 199856128. Throughput: 0: 10314.1. Samples: 399722400. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:13,989][27935] Avg episode reward: [(0, '-10.697')] [2022-07-13 06:16:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5154.7). Total num frames: 199881728. Throughput: 0: 10311.7. Samples: 399784112. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:18,991][27935] Avg episode reward: [(0, '-9.551')] [2022-07-13 06:16:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 199909376. Throughput: 0: 10301.0. Samples: 399814880. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:23,990][27935] Avg episode reward: [(0, '-8.468')] [2022-07-13 06:16:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 199932928. Throughput: 0: 10269.6. Samples: 399876540. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:28,991][27935] Avg episode reward: [(0, '-9.235')] [2022-07-13 06:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 199957504. Throughput: 0: 10230.8. Samples: 399936956. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:33,990][27935] Avg episode reward: [(0, '-9.935')] [2022-07-13 06:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 199983104. Throughput: 0: 10210.6. Samples: 399967600. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:38,989][27935] Avg episode reward: [(0, '-9.927')] [2022-07-13 06:16:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 200010752. Throughput: 0: 10205.2. Samples: 400029752. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:43,995][27935] Avg episode reward: [(0, '-7.894')] [2022-07-13 06:16:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 200036352. Throughput: 0: 10301.9. Samples: 400091908. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:48,989][27935] Avg episode reward: [(0, '-7.017')] [2022-07-13 06:16:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 200061952. Throughput: 0: 10297.1. Samples: 400123180. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:53,989][27935] Avg episode reward: [(0, '-6.834')] [2022-07-13 06:16:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5154.7). Total num frames: 200087552. Throughput: 0: 10300.6. Samples: 400185928. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:16:58,989][27935] Avg episode reward: [(0, '-5.393')] [2022-07-13 06:17:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 200113152. Throughput: 0: 10216.1. Samples: 400243836. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:03,989][27935] Avg episode reward: [(0, '-5.209')] [2022-07-13 06:17:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5147.8). Total num frames: 200137728. Throughput: 0: 10217.5. Samples: 400274668. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:08,989][27935] Avg episode reward: [(0, '-10.012')] [2022-07-13 06:17:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 200163328. Throughput: 0: 10233.3. Samples: 400337040. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:13,989][27935] Avg episode reward: [(0, '-9.565')] [2022-07-13 06:17:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 200189952. Throughput: 0: 10263.9. Samples: 400398832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:18,991][27935] Avg episode reward: [(0, '-7.857')] [2022-07-13 06:17:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5147.8). Total num frames: 200216576. Throughput: 0: 10278.2. Samples: 400430120. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:23,989][27935] Avg episode reward: [(0, '-11.143')] [2022-07-13 06:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5140.8). Total num frames: 200239104. Throughput: 0: 10223.1. Samples: 400489792. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:28,990][27935] Avg episode reward: [(0, '-11.731')] [2022-07-13 06:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 200265728. Throughput: 0: 9516.5. Samples: 400520152. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:33,989][27935] Avg episode reward: [(0, '-10.986')] [2022-07-13 06:17:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 200290304. Throughput: 0: 10191.6. Samples: 400581804. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:38,989][27935] Avg episode reward: [(0, '-7.653')] [2022-07-13 06:17:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 200317952. Throughput: 0: 10148.9. Samples: 400642628. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:43,989][27935] Avg episode reward: [(0, '-8.236')] [2022-07-13 06:17:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5133.9). Total num frames: 200342528. Throughput: 0: 10249.1. Samples: 400705044. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:48,989][27935] Avg episode reward: [(0, '-10.191')] [2022-07-13 06:17:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 200369152. Throughput: 0: 10256.0. Samples: 400736188. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:53,989][27935] Avg episode reward: [(0, '-8.612')] [2022-07-13 06:17:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 200395776. Throughput: 0: 10275.1. Samples: 400799420. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:17:58,989][27935] Avg episode reward: [(0, '-9.437')] [2022-07-13 06:18:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 200419328. Throughput: 0: 10205.2. Samples: 400858064. Policy #0 lag: (min: 0.0, avg: 8.0, max: 17.0) [2022-07-13 06:18:03,991][27935] Avg episode reward: [(0, '-9.242')] [2022-07-13 06:18:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 200443904. Throughput: 0: 10191.2. Samples: 400888724. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:08,989][27935] Avg episode reward: [(0, '-8.650')] [2022-07-13 06:18:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 200471552. Throughput: 0: 10256.5. Samples: 400951336. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:13,989][27935] Avg episode reward: [(0, '-7.746')] [2022-07-13 06:18:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 200496128. Throughput: 0: 10974.3. Samples: 401013996. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:18,989][27935] Avg episode reward: [(0, '-6.717')] [2022-07-13 06:18:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 200523776. Throughput: 0: 10291.4. Samples: 401044916. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:23,989][27935] Avg episode reward: [(0, '-6.412')] [2022-07-13 06:18:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 200549376. Throughput: 0: 10318.1. Samples: 401106944. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:28,989][27935] Avg episode reward: [(0, '-6.149')] [2022-07-13 06:18:33,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 200573952. Throughput: 0: 10314.1. Samples: 401169180. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:33,991][27935] Avg episode reward: [(0, '-3.622')] [2022-07-13 06:18:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5130.4). Total num frames: 200600576. Throughput: 0: 10307.8. Samples: 401200040. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:38,989][27935] Avg episode reward: [(0, '-4.715')] [2022-07-13 06:18:43,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 200626176. Throughput: 0: 10278.8. Samples: 401261968. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:43,989][27935] Avg episode reward: [(0, '-6.411')] [2022-07-13 06:18:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 200652800. Throughput: 0: 10344.6. Samples: 401323572. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:48,989][27935] Avg episode reward: [(0, '-6.596')] [2022-07-13 06:18:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5133.9). Total num frames: 200678400. Throughput: 0: 10351.9. Samples: 401354560. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:53,989][27935] Avg episode reward: [(0, '-6.653')] [2022-07-13 06:18:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 200702976. Throughput: 0: 10346.2. Samples: 401416916. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:18:58,989][27935] Avg episode reward: [(0, '-5.956')] [2022-07-13 06:19:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 200727552. Throughput: 0: 10243.6. Samples: 401474956. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:03,989][27935] Avg episode reward: [(0, '-8.924')] [2022-07-13 06:19:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 200753152. Throughput: 0: 10243.3. Samples: 401505864. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:08,989][27935] Avg episode reward: [(0, '-9.034')] [2022-07-13 06:19:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 200778752. Throughput: 0: 10235.5. Samples: 401567544. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:13,989][27935] Avg episode reward: [(0, '-9.107')] [2022-07-13 06:19:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 200804352. Throughput: 0: 10232.8. Samples: 401629656. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:18,989][27935] Avg episode reward: [(0, '-8.259')] [2022-07-13 06:19:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 200830976. Throughput: 0: 10235.9. Samples: 401660656. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:23,989][27935] Avg episode reward: [(0, '-8.176')] [2022-07-13 06:19:28,990][27935] Fps is (10 sec: 5221.9, 60 sec: 5119.9, 300 sec: 5137.3). Total num frames: 200856576. Throughput: 0: 10245.7. Samples: 401723036. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:28,990][27935] Avg episode reward: [(0, '-8.873')] [2022-07-13 06:19:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5130.5). Total num frames: 200882176. Throughput: 0: 10233.4. Samples: 401784076. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:33,989][27935] Avg episode reward: [(0, '-7.952')] [2022-07-13 06:19:38,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 200908800. Throughput: 0: 10226.4. Samples: 401814748. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:38,989][27935] Avg episode reward: [(0, '-7.790')] [2022-07-13 06:19:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 200934400. Throughput: 0: 10234.7. Samples: 401877476. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:43,990][27935] Avg episode reward: [(0, '-7.204')] [2022-07-13 06:19:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5137.4). Total num frames: 200961024. Throughput: 0: 10322.4. Samples: 401939464. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:48,989][27935] Avg episode reward: [(0, '-6.669')] [2022-07-13 06:19:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5126.9). Total num frames: 200984576. Throughput: 0: 10325.9. Samples: 401970528. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:53,989][27935] Avg episode reward: [(0, '-7.785')] [2022-07-13 06:19:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 201012224. Throughput: 0: 10328.4. Samples: 402032320. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:19:58,989][27935] Avg episode reward: [(0, '-7.219')] [2022-07-13 06:20:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 201035776. Throughput: 0: 10236.3. Samples: 402090288. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:20:03,989][27935] Avg episode reward: [(0, '-7.063')] [2022-07-13 06:20:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 201060352. Throughput: 0: 10230.8. Samples: 402121044. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:20:08,989][27935] Avg episode reward: [(0, '-7.590')] [2022-07-13 06:20:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 201086976. Throughput: 0: 10219.2. Samples: 402182892. Policy #0 lag: (min: 0.0, avg: 8.1, max: 21.0) [2022-07-13 06:20:13,990][27935] Avg episode reward: [(0, '-8.130')] [2022-07-13 06:20:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 201112576. Throughput: 0: 10231.0. Samples: 402244472. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:18,989][27935] Avg episode reward: [(0, '-8.425')] [2022-07-13 06:20:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 201138176. Throughput: 0: 10235.2. Samples: 402275332. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:23,991][27935] Avg episode reward: [(0, '-9.608')] [2022-07-13 06:20:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 201164800. Throughput: 0: 10205.4. Samples: 402336720. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:28,990][27935] Avg episode reward: [(0, '-8.978')] [2022-07-13 06:20:33,989][27935] Fps is (10 sec: 5017.3, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 201188352. Throughput: 0: 10201.7. Samples: 402398544. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:33,991][27935] Avg episode reward: [(0, '-9.636')] [2022-07-13 06:20:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 201216000. Throughput: 0: 10202.8. Samples: 402429656. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:38,989][27935] Avg episode reward: [(0, '-9.932')] [2022-07-13 06:20:43,989][27935] Fps is (10 sec: 5325.1, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 201241600. Throughput: 0: 10211.5. Samples: 402491836. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:43,989][27935] Avg episode reward: [(0, '-8.849')] [2022-07-13 06:20:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 201267200. Throughput: 0: 10308.0. Samples: 402554148. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:48,989][27935] Avg episode reward: [(0, '-7.836')] [2022-07-13 06:20:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 201291776. Throughput: 0: 10314.3. Samples: 402585188. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:53,989][27935] Avg episode reward: [(0, '-6.205')] [2022-07-13 06:20:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5140.8). Total num frames: 201320448. Throughput: 0: 10323.6. Samples: 402647452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:20:58,989][27935] Avg episode reward: [(0, '-6.920')] [2022-07-13 06:21:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 201344000. Throughput: 0: 10246.9. Samples: 402705584. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:03,989][27935] Avg episode reward: [(0, '-8.110')] [2022-07-13 06:21:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 201367552. Throughput: 0: 10249.4. Samples: 402736556. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:08,990][27935] Avg episode reward: [(0, '-9.037')] [2022-07-13 06:21:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5130.4). Total num frames: 201395200. Throughput: 0: 10260.9. Samples: 402798460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:13,989][27935] Avg episode reward: [(0, '-9.462')] [2022-07-13 06:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 201418752. Throughput: 0: 10242.1. Samples: 402859436. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:18,989][27935] Avg episode reward: [(0, '-8.255')] [2022-07-13 06:21:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 201445376. Throughput: 0: 10235.7. Samples: 402890264. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:23,990][27935] Avg episode reward: [(0, '-10.164')] [2022-07-13 06:21:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5130.4). Total num frames: 201470976. Throughput: 0: 10227.5. Samples: 402952072. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:28,989][27935] Avg episode reward: [(0, '-10.751')] [2022-07-13 06:21:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.2, 300 sec: 5133.9). Total num frames: 201497600. Throughput: 0: 10181.6. Samples: 403012320. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:33,989][27935] Avg episode reward: [(0, '-10.131')] [2022-07-13 06:21:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 201521152. Throughput: 0: 10172.5. Samples: 403042952. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:38,989][27935] Avg episode reward: [(0, '-7.707')] [2022-07-13 06:21:43,999][27935] Fps is (10 sec: 5012.2, 60 sec: 5102.0, 300 sec: 5123.3). Total num frames: 201547776. Throughput: 0: 10147.8. Samples: 403104212. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:44,000][27935] Avg episode reward: [(0, '-7.459')] [2022-07-13 06:21:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 201573376. Throughput: 0: 10212.4. Samples: 403165144. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:48,989][27935] Avg episode reward: [(0, '-7.965')] [2022-07-13 06:21:53,989][27935] Fps is (10 sec: 5125.5, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 201598976. Throughput: 0: 10213.9. Samples: 403196180. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:53,990][27935] Avg episode reward: [(0, '-8.048')] [2022-07-13 06:21:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5120.0). Total num frames: 201623552. Throughput: 0: 10211.2. Samples: 403257964. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:21:58,989][27935] Avg episode reward: [(0, '-7.891')] [2022-07-13 06:22:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5120.0). Total num frames: 201648128. Throughput: 0: 10134.2. Samples: 403315476. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:03,989][27935] Avg episode reward: [(0, '-8.711')] [2022-07-13 06:22:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 201673728. Throughput: 0: 10144.2. Samples: 403346752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:08,989][27935] Avg episode reward: [(0, '-9.074')] [2022-07-13 06:22:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 201700352. Throughput: 0: 10133.4. Samples: 403408076. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:13,989][27935] Avg episode reward: [(0, '-8.467')] [2022-07-13 06:22:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 201724928. Throughput: 0: 10162.4. Samples: 403469628. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:18,989][27935] Avg episode reward: [(0, '-9.629')] [2022-07-13 06:22:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5123.5). Total num frames: 201750528. Throughput: 0: 10169.5. Samples: 403500580. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:23,991][27935] Avg episode reward: [(0, '-8.896')] [2022-07-13 06:22:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5123.5). Total num frames: 201777152. Throughput: 0: 10168.6. Samples: 403561692. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 06:22:28,989][27935] Avg episode reward: [(0, '-9.303')] [2022-07-13 06:22:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5123.5). Total num frames: 201801728. Throughput: 0: 10175.1. Samples: 403623024. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:33,989][27935] Avg episode reward: [(0, '-8.112')] [2022-07-13 06:22:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5116.5). Total num frames: 201827328. Throughput: 0: 10177.1. Samples: 403654148. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:38,989][27935] Avg episode reward: [(0, '-8.333')] [2022-07-13 06:22:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.8, 300 sec: 5120.0). Total num frames: 201852928. Throughput: 0: 10144.3. Samples: 403714456. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:43,989][27935] Avg episode reward: [(0, '-8.311')] [2022-07-13 06:22:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 201878528. Throughput: 0: 10252.2. Samples: 403776824. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:48,991][27935] Avg episode reward: [(0, '-7.756')] [2022-07-13 06:22:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5113.1). Total num frames: 201904128. Throughput: 0: 10253.0. Samples: 403808136. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:53,989][27935] Avg episode reward: [(0, '-7.609')] [2022-07-13 06:22:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5126.9). Total num frames: 201931776. Throughput: 0: 10270.4. Samples: 403870244. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:22:58,989][27935] Avg episode reward: [(0, '-7.620')] [2022-07-13 06:23:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 201954304. Throughput: 0: 10198.7. Samples: 403928568. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:03,989][27935] Avg episode reward: [(0, '-7.428')] [2022-07-13 06:23:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5113.1). Total num frames: 201979904. Throughput: 0: 10188.1. Samples: 403959044. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:08,989][27935] Avg episode reward: [(0, '-6.918')] [2022-07-13 06:23:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5120.0). Total num frames: 202006528. Throughput: 0: 10208.3. Samples: 404021064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:13,989][27935] Avg episode reward: [(0, '-8.166')] [2022-07-13 06:23:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 202032128. Throughput: 0: 9526.3. Samples: 404051708. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:18,989][27935] Avg episode reward: [(0, '-6.941')] [2022-07-13 06:23:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 202055680. Throughput: 0: 10216.4. Samples: 404113888. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:23,989][27935] Avg episode reward: [(0, '-8.405')] [2022-07-13 06:23:28,992][27935] Fps is (10 sec: 5118.2, 60 sec: 5102.6, 300 sec: 5116.5). Total num frames: 202083328. Throughput: 0: 10253.8. Samples: 404175912. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:28,993][27935] Avg episode reward: [(0, '-9.096')] [2022-07-13 06:23:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 202106880. Throughput: 0: 10172.7. Samples: 404234596. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:33,990][27935] Avg episode reward: [(0, '-9.334')] [2022-07-13 06:23:38,989][27935] Fps is (10 sec: 5019.4, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 202133504. Throughput: 0: 10146.6. Samples: 404264732. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:38,990][27935] Avg episode reward: [(0, '-7.572')] [2022-07-13 06:23:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5102.6). Total num frames: 202158080. Throughput: 0: 10127.7. Samples: 404325992. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:43,990][27935] Avg episode reward: [(0, '-7.240')] [2022-07-13 06:23:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5106.1). Total num frames: 202184704. Throughput: 0: 10207.9. Samples: 404387924. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:48,990][27935] Avg episode reward: [(0, '-7.927')] [2022-07-13 06:23:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5109.6). Total num frames: 202210304. Throughput: 0: 10219.5. Samples: 404418920. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:53,989][27935] Avg episode reward: [(0, '-7.284')] [2022-07-13 06:23:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 202236928. Throughput: 0: 10214.1. Samples: 404480696. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:23:58,989][27935] Avg episode reward: [(0, '-7.486')] [2022-07-13 06:24:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5102.6). Total num frames: 202258432. Throughput: 0: 10813.7. Samples: 404538324. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:03,991][27935] Avg episode reward: [(0, '-8.142')] [2022-07-13 06:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 202285056. Throughput: 0: 10111.5. Samples: 404568908. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:08,990][27935] Avg episode reward: [(0, '-8.605')] [2022-07-13 06:24:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5109.6). Total num frames: 202311680. Throughput: 0: 10104.2. Samples: 404630564. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:13,989][27935] Avg episode reward: [(0, '-10.453')] [2022-07-13 06:24:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5102.6). Total num frames: 202336256. Throughput: 0: 10168.5. Samples: 404692180. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:18,989][27935] Avg episode reward: [(0, '-9.896')] [2022-07-13 06:24:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5102.7). Total num frames: 202361856. Throughput: 0: 10187.3. Samples: 404723160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:23,989][27935] Avg episode reward: [(0, '-11.606')] [2022-07-13 06:24:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5086.2, 300 sec: 5106.1). Total num frames: 202388480. Throughput: 0: 10190.8. Samples: 404784580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:28,990][27935] Avg episode reward: [(0, '-11.530')] [2022-07-13 06:24:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5095.7). Total num frames: 202412032. Throughput: 0: 10167.7. Samples: 404845472. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:33,989][27935] Avg episode reward: [(0, '-10.858')] [2022-07-13 06:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5095.7). Total num frames: 202437632. Throughput: 0: 10154.7. Samples: 404875884. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:38,989][27935] Avg episode reward: [(0, '-10.723')] [2022-07-13 06:24:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5095.7). Total num frames: 202464256. Throughput: 0: 10156.7. Samples: 404937748. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 06:24:43,989][27935] Avg episode reward: [(0, '-10.625')] [2022-07-13 06:24:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5102.6). Total num frames: 202489856. Throughput: 0: 10239.6. Samples: 404999104. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:24:48,990][27935] Avg episode reward: [(0, '-9.688')] [2022-07-13 06:24:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5095.7). Total num frames: 202515456. Throughput: 0: 10247.1. Samples: 405030028. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:24:53,989][27935] Avg episode reward: [(0, '-7.906')] [2022-07-13 06:24:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5102.6). Total num frames: 202541056. Throughput: 0: 10253.9. Samples: 405091992. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:24:58,989][27935] Avg episode reward: [(0, '-6.241')] [2022-07-13 06:25:03,990][27935] Fps is (10 sec: 4914.4, 60 sec: 5102.8, 300 sec: 5099.1). Total num frames: 202564608. Throughput: 0: 10174.3. Samples: 405150040. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:03,991][27935] Avg episode reward: [(0, '-6.593')] [2022-07-13 06:25:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5102.6). Total num frames: 202592256. Throughput: 0: 10174.2. Samples: 405181000. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:08,990][27935] Avg episode reward: [(0, '-6.617')] [2022-07-13 06:25:13,990][27935] Fps is (10 sec: 5222.5, 60 sec: 5085.7, 300 sec: 5099.1). Total num frames: 202616832. Throughput: 0: 10169.3. Samples: 405242212. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:13,991][27935] Avg episode reward: [(0, '-6.647')] [2022-07-13 06:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5099.2). Total num frames: 202642432. Throughput: 0: 10190.6. Samples: 405304048. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:18,989][27935] Avg episode reward: [(0, '-8.302')] [2022-07-13 06:25:23,989][27935] Fps is (10 sec: 5120.8, 60 sec: 5102.9, 300 sec: 5095.7). Total num frames: 202668032. Throughput: 0: 10197.2. Samples: 405334756. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:23,989][27935] Avg episode reward: [(0, '-10.898')] [2022-07-13 06:25:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5102.7). Total num frames: 202693632. Throughput: 0: 10200.6. Samples: 405396776. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:28,989][27935] Avg episode reward: [(0, '-10.045')] [2022-07-13 06:25:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5095.7). Total num frames: 202719232. Throughput: 0: 10188.4. Samples: 405457584. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:33,989][27935] Avg episode reward: [(0, '-9.565')] [2022-07-13 06:25:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5095.7). Total num frames: 202744832. Throughput: 0: 10179.7. Samples: 405488116. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:38,989][27935] Avg episode reward: [(0, '-9.564')] [2022-07-13 06:25:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 202769408. Throughput: 0: 10156.4. Samples: 405549032. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:43,990][27935] Avg episode reward: [(0, '-9.753')] [2022-07-13 06:25:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5099.2). Total num frames: 202796032. Throughput: 0: 10221.3. Samples: 405609980. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:48,989][27935] Avg episode reward: [(0, '-8.742')] [2022-07-13 06:25:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 202820608. Throughput: 0: 10211.3. Samples: 405640508. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:53,989][27935] Avg episode reward: [(0, '-7.675')] [2022-07-13 06:25:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 202846208. Throughput: 0: 10206.2. Samples: 405701476. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:25:58,989][27935] Avg episode reward: [(0, '-7.650')] [2022-07-13 06:26:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.9, 300 sec: 5088.8). Total num frames: 202868736. Throughput: 0: 10095.8. Samples: 405758360. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:03,989][27935] Avg episode reward: [(0, '-8.523')] [2022-07-13 06:26:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 202896384. Throughput: 0: 10095.8. Samples: 405789068. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:08,989][27935] Avg episode reward: [(0, '-7.983')] [2022-07-13 06:26:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.9, 300 sec: 5088.8). Total num frames: 202919936. Throughput: 0: 10076.4. Samples: 405850216. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:13,989][27935] Avg episode reward: [(0, '-7.907')] [2022-07-13 06:26:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5081.8). Total num frames: 202944512. Throughput: 0: 10057.2. Samples: 405910156. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:18,989][27935] Avg episode reward: [(0, '-6.942')] [2022-07-13 06:26:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5085.3). Total num frames: 202971136. Throughput: 0: 10054.9. Samples: 405940588. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:23,989][27935] Avg episode reward: [(0, '-6.470')] [2022-07-13 06:26:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 202995712. Throughput: 0: 10053.3. Samples: 406001432. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:28,989][27935] Avg episode reward: [(0, '-5.135')] [2022-07-13 06:26:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5088.8). Total num frames: 203022336. Throughput: 0: 10030.5. Samples: 406061352. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:33,989][27935] Avg episode reward: [(0, '-5.514')] [2022-07-13 06:26:38,991][27935] Fps is (10 sec: 5016.4, 60 sec: 5017.4, 300 sec: 5078.5). Total num frames: 203045888. Throughput: 0: 10030.5. Samples: 406091904. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:38,992][27935] Avg episode reward: [(0, '-4.828')] [2022-07-13 06:26:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 203072512. Throughput: 0: 10041.6. Samples: 406153348. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:43,989][27935] Avg episode reward: [(0, '-4.398')] [2022-07-13 06:26:48,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5017.6, 300 sec: 5078.3). Total num frames: 203097088. Throughput: 0: 10133.6. Samples: 406214372. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:48,989][27935] Avg episode reward: [(0, '-6.411')] [2022-07-13 06:26:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5081.8). Total num frames: 203122688. Throughput: 0: 10135.8. Samples: 406245180. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 06:26:53,990][27935] Avg episode reward: [(0, '-8.465')] [2022-07-13 06:26:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5085.3). Total num frames: 203148288. Throughput: 0: 10149.5. Samples: 406306944. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:26:58,990][27935] Avg episode reward: [(0, '-8.646')] [2022-07-13 06:27:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 203172864. Throughput: 0: 10090.2. Samples: 406364216. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:03,989][27935] Avg episode reward: [(0, '-9.968')] [2022-07-13 06:27:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 203197440. Throughput: 0: 10093.3. Samples: 406394788. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:08,989][27935] Avg episode reward: [(0, '-9.419')] [2022-07-13 06:27:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 203224064. Throughput: 0: 10101.1. Samples: 406455984. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:13,989][27935] Avg episode reward: [(0, '-9.662')] [2022-07-13 06:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 203247616. Throughput: 0: 10127.0. Samples: 406517068. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:18,989][27935] Avg episode reward: [(0, '-9.147')] [2022-07-13 06:27:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 203274240. Throughput: 0: 10131.8. Samples: 406547812. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:23,990][27935] Avg episode reward: [(0, '-8.713')] [2022-07-13 06:27:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 203299840. Throughput: 0: 10129.0. Samples: 406609152. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:28,990][27935] Avg episode reward: [(0, '-7.346')] [2022-07-13 06:27:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 203326464. Throughput: 0: 10116.0. Samples: 406669592. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:33,989][27935] Avg episode reward: [(0, '-6.696')] [2022-07-13 06:27:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.9, 300 sec: 5071.4). Total num frames: 203348992. Throughput: 0: 10110.3. Samples: 406700144. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:38,989][27935] Avg episode reward: [(0, '-6.787')] [2022-07-13 06:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5071.4). Total num frames: 203374592. Throughput: 0: 10076.5. Samples: 406760384. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:43,989][27935] Avg episode reward: [(0, '-6.436')] [2022-07-13 06:27:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 203400192. Throughput: 0: 10156.7. Samples: 406821268. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:48,989][27935] Avg episode reward: [(0, '-7.138')] [2022-07-13 06:27:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 203426816. Throughput: 0: 10156.0. Samples: 406851808. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:53,991][27935] Avg episode reward: [(0, '-5.810')] [2022-07-13 06:27:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 203452416. Throughput: 0: 10166.8. Samples: 406913488. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:27:58,989][27935] Avg episode reward: [(0, '-6.174')] [2022-07-13 06:28:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 203474944. Throughput: 0: 10084.3. Samples: 406970860. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:03,991][27935] Avg episode reward: [(0, '-4.957')] [2022-07-13 06:28:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 203500544. Throughput: 0: 10080.8. Samples: 407001448. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:08,989][27935] Avg episode reward: [(0, '-5.345')] [2022-07-13 06:28:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 203527168. Throughput: 0: 10085.7. Samples: 407063008. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:13,989][27935] Avg episode reward: [(0, '-5.186')] [2022-07-13 06:28:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 203552768. Throughput: 0: 10105.9. Samples: 407124356. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:18,989][27935] Avg episode reward: [(0, '-4.656')] [2022-07-13 06:28:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 203577344. Throughput: 0: 10107.9. Samples: 407155000. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:23,989][27935] Avg episode reward: [(0, '-4.603')] [2022-07-13 06:28:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 203604992. Throughput: 0: 10154.5. Samples: 407217336. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:28,989][27935] Avg episode reward: [(0, '-5.414')] [2022-07-13 06:28:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 203628544. Throughput: 0: 10147.0. Samples: 407277884. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:33,989][27935] Avg episode reward: [(0, '-5.093')] [2022-07-13 06:28:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 203655168. Throughput: 0: 10149.8. Samples: 407308548. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:38,989][27935] Avg episode reward: [(0, '-6.414')] [2022-07-13 06:28:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 203679744. Throughput: 0: 10148.3. Samples: 407370164. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:43,989][27935] Avg episode reward: [(0, '-6.363')] [2022-07-13 06:28:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 203705344. Throughput: 0: 10235.3. Samples: 407431448. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:48,989][27935] Avg episode reward: [(0, '-7.213')] [2022-07-13 06:28:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 203731968. Throughput: 0: 10241.9. Samples: 407462332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:53,989][27935] Avg episode reward: [(0, '-7.624')] [2022-07-13 06:28:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 203757568. Throughput: 0: 10236.5. Samples: 407523648. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:28:58,989][27935] Avg episode reward: [(0, '-8.853')] [2022-07-13 06:29:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 203780096. Throughput: 0: 10155.2. Samples: 407581340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:29:03,989][27935] Avg episode reward: [(0, '-9.614')] [2022-07-13 06:29:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5071.4). Total num frames: 203807744. Throughput: 0: 10159.9. Samples: 407612196. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 06:29:08,989][27935] Avg episode reward: [(0, '-10.627')] [2022-07-13 06:29:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 203832320. Throughput: 0: 10146.5. Samples: 407673928. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:13,989][27935] Avg episode reward: [(0, '-10.430')] [2022-07-13 06:29:18,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 203857920. Throughput: 0: 10164.8. Samples: 407735300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:18,989][27935] Avg episode reward: [(0, '-10.325')] [2022-07-13 06:29:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 203882496. Throughput: 0: 10165.9. Samples: 407766012. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:23,989][27935] Avg episode reward: [(0, '-10.990')] [2022-07-13 06:29:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 203909120. Throughput: 0: 10160.1. Samples: 407827368. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:28,989][27935] Avg episode reward: [(0, '-10.070')] [2022-07-13 06:29:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 203933696. Throughput: 0: 10132.5. Samples: 407887412. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:33,989][27935] Avg episode reward: [(0, '-9.114')] [2022-07-13 06:29:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 203958272. Throughput: 0: 10095.4. Samples: 407916624. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:38,989][27935] Avg episode reward: [(0, '-6.479')] [2022-07-13 06:29:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 203983872. Throughput: 0: 10089.8. Samples: 407977688. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:43,990][27935] Avg episode reward: [(0, '-6.272')] [2022-07-13 06:29:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 204008448. Throughput: 0: 10170.5. Samples: 408039012. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:48,996][27935] Avg episode reward: [(0, '-6.067')] [2022-07-13 06:29:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 204035072. Throughput: 0: 10160.3. Samples: 408069408. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:53,989][27935] Avg episode reward: [(0, '-6.203')] [2022-07-13 06:29:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5068.0). Total num frames: 204059648. Throughput: 0: 10143.6. Samples: 408130388. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:29:58,989][27935] Avg episode reward: [(0, '-7.143')] [2022-07-13 06:30:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 204085248. Throughput: 0: 10053.3. Samples: 408187696. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:03,989][27935] Avg episode reward: [(0, '-6.417')] [2022-07-13 06:30:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 204109824. Throughput: 0: 10056.6. Samples: 408218560. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:08,989][27935] Avg episode reward: [(0, '-8.629')] [2022-07-13 06:30:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 204136448. Throughput: 0: 10065.2. Samples: 408280300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:13,989][27935] Avg episode reward: [(0, '-9.776')] [2022-07-13 06:30:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 204161024. Throughput: 0: 10096.0. Samples: 408341732. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:18,989][27935] Avg episode reward: [(0, '-10.072')] [2022-07-13 06:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 204185600. Throughput: 0: 10121.7. Samples: 408372100. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:23,989][27935] Avg episode reward: [(0, '-10.367')] [2022-07-13 06:30:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 204212224. Throughput: 0: 10129.4. Samples: 408433512. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:28,992][27935] Avg episode reward: [(0, '-9.845')] [2022-07-13 06:30:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 204236800. Throughput: 0: 10126.1. Samples: 408494688. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:33,989][27935] Avg episode reward: [(0, '-8.470')] [2022-07-13 06:30:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 204263424. Throughput: 0: 10131.2. Samples: 408525312. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:38,989][27935] Avg episode reward: [(0, '-7.732')] [2022-07-13 06:30:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 204288000. Throughput: 0: 10142.2. Samples: 408586788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:43,999][27935] Avg episode reward: [(0, '-6.952')] [2022-07-13 06:30:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5064.5). Total num frames: 204314624. Throughput: 0: 10214.7. Samples: 408647356. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:48,989][27935] Avg episode reward: [(0, '-6.738')] [2022-07-13 06:30:53,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 204338176. Throughput: 0: 10199.1. Samples: 408677520. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:53,989][27935] Avg episode reward: [(0, '-7.198')] [2022-07-13 06:30:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 204364800. Throughput: 0: 10199.8. Samples: 408739292. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:30:58,989][27935] Avg episode reward: [(0, '-6.893')] [2022-07-13 06:31:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 204388352. Throughput: 0: 10108.3. Samples: 408796604. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:31:03,989][27935] Avg episode reward: [(0, '-8.060')] [2022-07-13 06:31:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 204413952. Throughput: 0: 10119.7. Samples: 408827488. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:31:08,989][27935] Avg episode reward: [(0, '-7.477')] [2022-07-13 06:31:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 204439552. Throughput: 0: 10116.8. Samples: 408888768. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:31:13,989][27935] Avg episode reward: [(0, '-9.785')] [2022-07-13 06:31:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 204465152. Throughput: 0: 10096.4. Samples: 408949028. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:31:18,989][27935] Avg episode reward: [(0, '-9.785')] [2022-07-13 06:31:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 204489728. Throughput: 0: 10099.0. Samples: 408979768. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 06:31:23,989][27935] Avg episode reward: [(0, '-8.764')] [2022-07-13 06:31:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 204515328. Throughput: 0: 10099.8. Samples: 409041276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:28,989][27935] Avg episode reward: [(0, '-7.311')] [2022-07-13 06:31:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5068.0). Total num frames: 204540928. Throughput: 0: 10109.2. Samples: 409102268. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:33,989][27935] Avg episode reward: [(0, '-7.024')] [2022-07-13 06:31:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 204567552. Throughput: 0: 10122.3. Samples: 409133024. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:38,990][27935] Avg episode reward: [(0, '-7.089')] [2022-07-13 06:31:43,997][27935] Fps is (10 sec: 5320.6, 60 sec: 5102.3, 300 sec: 5074.7). Total num frames: 204594176. Throughput: 0: 10131.9. Samples: 409195308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:43,997][27935] Avg episode reward: [(0, '-5.448')] [2022-07-13 06:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 204618752. Throughput: 0: 10221.2. Samples: 409256560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:48,989][27935] Avg episode reward: [(0, '-4.693')] [2022-07-13 06:31:53,989][27935] Fps is (10 sec: 4919.1, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 204643328. Throughput: 0: 10217.8. Samples: 409287288. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:53,990][27935] Avg episode reward: [(0, '-5.463')] [2022-07-13 06:31:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 204669952. Throughput: 0: 10227.2. Samples: 409348992. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:31:58,989][27935] Avg episode reward: [(0, '-6.148')] [2022-07-13 06:32:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 204693504. Throughput: 0: 10170.0. Samples: 409406676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:03,989][27935] Avg episode reward: [(0, '-7.603')] [2022-07-13 06:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 204718080. Throughput: 0: 10165.8. Samples: 409437228. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:08,989][27935] Avg episode reward: [(0, '-6.856')] [2022-07-13 06:32:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 204745728. Throughput: 0: 10164.0. Samples: 409498656. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:13,989][27935] Avg episode reward: [(0, '-7.086')] [2022-07-13 06:32:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 204770304. Throughput: 0: 10170.6. Samples: 409559944. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:18,989][27935] Avg episode reward: [(0, '-7.469')] [2022-07-13 06:32:23,991][27935] Fps is (10 sec: 4914.0, 60 sec: 5085.7, 300 sec: 5067.9). Total num frames: 204794880. Throughput: 0: 10174.0. Samples: 409590880. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:23,992][27935] Avg episode reward: [(0, '-7.696')] [2022-07-13 06:32:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 204821504. Throughput: 0: 10154.6. Samples: 409652184. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:28,990][27935] Avg episode reward: [(0, '-8.835')] [2022-07-13 06:32:33,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 204846080. Throughput: 0: 10128.7. Samples: 409712352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:33,989][27935] Avg episode reward: [(0, '-8.628')] [2022-07-13 06:32:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 204872704. Throughput: 0: 10112.0. Samples: 409742328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:38,989][27935] Avg episode reward: [(0, '-9.359')] [2022-07-13 06:32:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5018.3, 300 sec: 5067.9). Total num frames: 204895232. Throughput: 0: 10080.8. Samples: 409802628. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:43,989][27935] Avg episode reward: [(0, '-9.052')] [2022-07-13 06:32:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 204922880. Throughput: 0: 10161.7. Samples: 409863952. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:48,990][27935] Avg episode reward: [(0, '-7.983')] [2022-07-13 06:32:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 204948480. Throughput: 0: 10168.4. Samples: 409894808. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:53,990][27935] Avg episode reward: [(0, '-7.059')] [2022-07-13 06:32:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 204973056. Throughput: 0: 10174.3. Samples: 409956500. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:32:58,990][27935] Avg episode reward: [(0, '-7.739')] [2022-07-13 06:33:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 204996608. Throughput: 0: 10083.6. Samples: 410013708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:03,989][27935] Avg episode reward: [(0, '-7.459')] [2022-07-13 06:33:08,994][27935] Fps is (10 sec: 5015.0, 60 sec: 5085.4, 300 sec: 5071.3). Total num frames: 205023232. Throughput: 0: 10079.2. Samples: 410044472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:08,996][27935] Avg episode reward: [(0, '-8.764')] [2022-07-13 06:33:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 205048832. Throughput: 0: 10090.7. Samples: 410106264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:13,989][27935] Avg episode reward: [(0, '-8.964')] [2022-07-13 06:33:19,005][27935] Fps is (10 sec: 5012.2, 60 sec: 5050.4, 300 sec: 5071.1). Total num frames: 205073408. Throughput: 0: 10104.0. Samples: 410167192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:19,005][27935] Avg episode reward: [(0, '-8.954')] [2022-07-13 06:33:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.1, 300 sec: 5067.9). Total num frames: 205100032. Throughput: 0: 10125.9. Samples: 410197996. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:23,989][27935] Avg episode reward: [(0, '-7.850')] [2022-07-13 06:33:28,989][27935] Fps is (10 sec: 5128.1, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 205124608. Throughput: 0: 10155.0. Samples: 410259604. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:28,990][27935] Avg episode reward: [(0, '-7.458')] [2022-07-13 06:33:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 205151232. Throughput: 0: 10147.1. Samples: 410320572. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:33:33,989][27935] Avg episode reward: [(0, '-7.199')] [2022-07-13 06:33:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 205175808. Throughput: 0: 10146.0. Samples: 410351376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:33:38,989][27935] Avg episode reward: [(0, '-5.137')] [2022-07-13 06:33:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 205202432. Throughput: 0: 10140.4. Samples: 410412816. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:33:43,989][27935] Avg episode reward: [(0, '-6.421')] [2022-07-13 06:33:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 205228032. Throughput: 0: 10230.6. Samples: 410474084. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:33:48,989][27935] Avg episode reward: [(0, '-6.415')] [2022-07-13 06:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 205251584. Throughput: 0: 10224.4. Samples: 410504516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:33:53,989][27935] Avg episode reward: [(0, '-6.842')] [2022-07-13 06:33:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 205279232. Throughput: 0: 10216.7. Samples: 410566016. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:33:58,990][27935] Avg episode reward: [(0, '-7.344')] [2022-07-13 06:34:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 205302784. Throughput: 0: 10143.7. Samples: 410623496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:03,991][27935] Avg episode reward: [(0, '-6.872')] [2022-07-13 06:34:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5069.2, 300 sec: 5067.9). Total num frames: 205327360. Throughput: 0: 10130.4. Samples: 410653864. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:08,991][27935] Avg episode reward: [(0, '-6.418')] [2022-07-13 06:34:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 205353984. Throughput: 0: 10136.2. Samples: 410715732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:13,989][27935] Avg episode reward: [(0, '-5.268')] [2022-07-13 06:34:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5087.2, 300 sec: 5071.4). Total num frames: 205378560. Throughput: 0: 10144.9. Samples: 410777092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:18,989][27935] Avg episode reward: [(0, '-4.019')] [2022-07-13 06:34:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 205404160. Throughput: 0: 10148.7. Samples: 410808068. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:23,989][27935] Avg episode reward: [(0, '-4.027')] [2022-07-13 06:34:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 205429760. Throughput: 0: 10149.1. Samples: 410869524. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:28,989][27935] Avg episode reward: [(0, '-5.303')] [2022-07-13 06:34:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 205455360. Throughput: 0: 10160.9. Samples: 410931324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:33,991][27935] Avg episode reward: [(0, '-7.937')] [2022-07-13 06:34:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 205481984. Throughput: 0: 10166.6. Samples: 410962012. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:38,989][27935] Avg episode reward: [(0, '-7.465')] [2022-07-13 06:34:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 205507584. Throughput: 0: 10174.7. Samples: 411023880. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:43,990][27935] Avg episode reward: [(0, '-8.717')] [2022-07-13 06:34:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 205533184. Throughput: 0: 10256.6. Samples: 411085044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:48,990][27935] Avg episode reward: [(0, '-9.428')] [2022-07-13 06:34:53,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5102.8, 300 sec: 5078.3). Total num frames: 205557760. Throughput: 0: 10268.1. Samples: 411115952. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:53,991][27935] Avg episode reward: [(0, '-9.404')] [2022-07-13 06:34:58,991][27935] Fps is (10 sec: 5118.7, 60 sec: 5085.6, 300 sec: 5081.8). Total num frames: 205584384. Throughput: 0: 10266.3. Samples: 411177744. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:34:58,993][27935] Avg episode reward: [(0, '-7.138')] [2022-07-13 06:35:03,989][27935] Fps is (10 sec: 5018.6, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 205607936. Throughput: 0: 10181.1. Samples: 411235244. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:04,002][27935] Avg episode reward: [(0, '-7.003')] [2022-07-13 06:35:08,989][27935] Fps is (10 sec: 4814.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 205632512. Throughput: 0: 10180.9. Samples: 411266208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:08,989][27935] Avg episode reward: [(0, '-7.083')] [2022-07-13 06:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 205660160. Throughput: 0: 10187.8. Samples: 411327976. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:13,989][27935] Avg episode reward: [(0, '-8.721')] [2022-07-13 06:35:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 205684736. Throughput: 0: 10176.2. Samples: 411389252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:18,989][27935] Avg episode reward: [(0, '-7.715')] [2022-07-13 06:35:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 205711360. Throughput: 0: 10180.6. Samples: 411420140. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:23,989][27935] Avg episode reward: [(0, '-10.282')] [2022-07-13 06:35:28,997][27935] Fps is (10 sec: 5013.7, 60 sec: 5085.2, 300 sec: 5078.2). Total num frames: 205734912. Throughput: 0: 10170.2. Samples: 411481620. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:28,997][27935] Avg episode reward: [(0, '-10.328')] [2022-07-13 06:35:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 205762560. Throughput: 0: 9490.7. Samples: 411512124. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:33,989][27935] Avg episode reward: [(0, '-10.072')] [2022-07-13 06:35:38,989][27935] Fps is (10 sec: 5124.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 205786112. Throughput: 0: 10134.8. Samples: 411571996. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:38,993][27935] Avg episode reward: [(0, '-8.722')] [2022-07-13 06:35:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 205811712. Throughput: 0: 10086.7. Samples: 411631620. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:43,989][27935] Avg episode reward: [(0, '-7.205')] [2022-07-13 06:35:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 205836288. Throughput: 0: 10175.6. Samples: 411693144. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 06:35:48,989][27935] Avg episode reward: [(0, '-6.817')] [2022-07-13 06:35:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5086.0, 300 sec: 5078.3). Total num frames: 205862912. Throughput: 0: 10168.4. Samples: 411723784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:35:53,989][27935] Avg episode reward: [(0, '-6.064')] [2022-07-13 06:35:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5069.0, 300 sec: 5085.3). Total num frames: 205888512. Throughput: 0: 10154.0. Samples: 411784904. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:35:58,989][27935] Avg episode reward: [(0, '-3.549')] [2022-07-13 06:36:03,996][27935] Fps is (10 sec: 4809.1, 60 sec: 5051.1, 300 sec: 5074.7). Total num frames: 205911040. Throughput: 0: 10069.1. Samples: 411842440. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:03,997][27935] Avg episode reward: [(0, '-4.283')] [2022-07-13 06:36:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 205935616. Throughput: 0: 10052.4. Samples: 411872500. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:08,989][27935] Avg episode reward: [(0, '-4.493')] [2022-07-13 06:36:13,989][27935] Fps is (10 sec: 5021.4, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 205961216. Throughput: 0: 9995.6. Samples: 411931344. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:13,989][27935] Avg episode reward: [(0, '-4.343')] [2022-07-13 06:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 205986816. Throughput: 0: 10689.0. Samples: 411993128. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:18,989][27935] Avg episode reward: [(0, '-6.236')] [2022-07-13 06:36:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 206012416. Throughput: 0: 10045.6. Samples: 412024048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:23,989][27935] Avg episode reward: [(0, '-6.303')] [2022-07-13 06:36:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5035.3, 300 sec: 5071.4). Total num frames: 206036992. Throughput: 0: 10088.7. Samples: 412085612. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:28,989][27935] Avg episode reward: [(0, '-6.026')] [2022-07-13 06:36:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 206063616. Throughput: 0: 10079.9. Samples: 412146740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:33,989][27935] Avg episode reward: [(0, '-5.690')] [2022-07-13 06:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5068.1). Total num frames: 206089216. Throughput: 0: 10083.9. Samples: 412177560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:38,990][27935] Avg episode reward: [(0, '-5.238')] [2022-07-13 06:36:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 206115840. Throughput: 0: 10103.9. Samples: 412239580. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:43,995][27935] Avg episode reward: [(0, '-6.259')] [2022-07-13 06:36:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 206140416. Throughput: 0: 10200.5. Samples: 412301384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:48,989][27935] Avg episode reward: [(0, '-5.590')] [2022-07-13 06:36:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 206166016. Throughput: 0: 10209.7. Samples: 412331936. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:53,989][27935] Avg episode reward: [(0, '-5.493')] [2022-07-13 06:36:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 206191616. Throughput: 0: 10264.3. Samples: 412393236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:36:58,989][27935] Avg episode reward: [(0, '-6.910')] [2022-07-13 06:37:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5086.5, 300 sec: 5078.3). Total num frames: 206216192. Throughput: 0: 10171.3. Samples: 412450836. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:03,989][27935] Avg episode reward: [(0, '-7.051')] [2022-07-13 06:37:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 206239744. Throughput: 0: 10161.7. Samples: 412481324. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:08,989][27935] Avg episode reward: [(0, '-7.618')] [2022-07-13 06:37:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 206268416. Throughput: 0: 10171.0. Samples: 412543308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:13,989][27935] Avg episode reward: [(0, '-7.805')] [2022-07-13 06:37:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5120.0, 300 sec: 5081.9). Total num frames: 206294016. Throughput: 0: 10173.3. Samples: 412604540. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:18,989][27935] Avg episode reward: [(0, '-8.507')] [2022-07-13 06:37:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 206317568. Throughput: 0: 10177.7. Samples: 412635556. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:23,989][27935] Avg episode reward: [(0, '-8.190')] [2022-07-13 06:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 206343168. Throughput: 0: 10172.2. Samples: 412697328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:28,989][27935] Avg episode reward: [(0, '-7.452')] [2022-07-13 06:37:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 206368768. Throughput: 0: 10156.4. Samples: 412758424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:33,989][27935] Avg episode reward: [(0, '-6.957')] [2022-07-13 06:37:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5085.3). Total num frames: 206395392. Throughput: 0: 10158.5. Samples: 412789068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:38,993][27935] Avg episode reward: [(0, '-8.047')] [2022-07-13 06:37:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 206418944. Throughput: 0: 10139.1. Samples: 412849496. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:43,989][27935] Avg episode reward: [(0, '-7.940')] [2022-07-13 06:37:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 206446592. Throughput: 0: 10230.5. Samples: 412911208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:48,989][27935] Avg episode reward: [(0, '-7.242')] [2022-07-13 06:37:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 206471168. Throughput: 0: 10237.9. Samples: 412942032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:53,989][27935] Avg episode reward: [(0, '-7.914')] [2022-07-13 06:37:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 206496768. Throughput: 0: 10232.3. Samples: 413003760. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:37:58,989][27935] Avg episode reward: [(0, '-7.313')] [2022-07-13 06:38:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5075.0). Total num frames: 206520320. Throughput: 0: 10149.1. Samples: 413061248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 06:38:03,989][27935] Avg episode reward: [(0, '-7.556')] [2022-07-13 06:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 206546944. Throughput: 0: 10139.9. Samples: 413091852. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:08,989][27935] Avg episode reward: [(0, '-7.563')] [2022-07-13 06:38:13,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5068.8, 300 sec: 5082.1). Total num frames: 206572544. Throughput: 0: 10137.6. Samples: 413153524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:13,990][27935] Avg episode reward: [(0, '-8.295')] [2022-07-13 06:38:18,992][27935] Fps is (10 sec: 4913.4, 60 sec: 5034.4, 300 sec: 5071.3). Total num frames: 206596096. Throughput: 0: 10142.3. Samples: 413214864. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:18,995][27935] Avg episode reward: [(0, '-7.682')] [2022-07-13 06:38:23,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 206623744. Throughput: 0: 10144.2. Samples: 413245556. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:23,989][27935] Avg episode reward: [(0, '-7.794')] [2022-07-13 06:38:28,989][27935] Fps is (10 sec: 5326.7, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 206649344. Throughput: 0: 10167.5. Samples: 413307036. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:28,989][27935] Avg episode reward: [(0, '-6.880')] [2022-07-13 06:38:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 206674944. Throughput: 0: 10148.4. Samples: 413367884. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:33,989][27935] Avg episode reward: [(0, '-7.783')] [2022-07-13 06:38:38,992][27935] Fps is (10 sec: 5118.6, 60 sec: 5085.6, 300 sec: 5078.3). Total num frames: 206700544. Throughput: 0: 10145.2. Samples: 413398596. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:38,992][27935] Avg episode reward: [(0, '-7.083')] [2022-07-13 06:38:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 206725120. Throughput: 0: 10138.2. Samples: 413459980. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:43,989][27935] Avg episode reward: [(0, '-6.484')] [2022-07-13 06:38:48,989][27935] Fps is (10 sec: 5018.8, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 206750720. Throughput: 0: 10229.3. Samples: 413521572. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:48,990][27935] Avg episode reward: [(0, '-5.058')] [2022-07-13 06:38:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 206776320. Throughput: 0: 10229.7. Samples: 413552188. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:53,989][27935] Avg episode reward: [(0, '-5.176')] [2022-07-13 06:38:58,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 206801920. Throughput: 0: 10230.7. Samples: 413613900. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:38:58,990][27935] Avg episode reward: [(0, '-6.381')] [2022-07-13 06:39:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 206825472. Throughput: 0: 10137.3. Samples: 413671008. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:03,989][27935] Avg episode reward: [(0, '-6.970')] [2022-07-13 06:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 206851072. Throughput: 0: 10136.8. Samples: 413701712. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:08,989][27935] Avg episode reward: [(0, '-6.203')] [2022-07-13 06:39:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 206876672. Throughput: 0: 10142.4. Samples: 413763444. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:13,989][27935] Avg episode reward: [(0, '-8.124')] [2022-07-13 06:39:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.3, 300 sec: 5081.8). Total num frames: 206903296. Throughput: 0: 10156.3. Samples: 413824916. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:18,989][27935] Avg episode reward: [(0, '-7.645')] [2022-07-13 06:39:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 206927872. Throughput: 0: 10164.6. Samples: 413855972. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:23,989][27935] Avg episode reward: [(0, '-7.852')] [2022-07-13 06:39:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 206954496. Throughput: 0: 10171.1. Samples: 413917680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:28,990][27935] Avg episode reward: [(0, '-7.861')] [2022-07-13 06:39:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 206979072. Throughput: 0: 10165.0. Samples: 413978992. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:33,991][27935] Avg episode reward: [(0, '-7.630')] [2022-07-13 06:39:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5069.0, 300 sec: 5074.9). Total num frames: 207004672. Throughput: 0: 10163.5. Samples: 414009544. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:38,989][27935] Avg episode reward: [(0, '-6.186')] [2022-07-13 06:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 207030272. Throughput: 0: 10156.8. Samples: 414070956. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:43,990][27935] Avg episode reward: [(0, '-6.633')] [2022-07-13 06:39:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5103.0, 300 sec: 5081.9). Total num frames: 207056896. Throughput: 0: 10250.4. Samples: 414132276. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:48,989][27935] Avg episode reward: [(0, '-6.214')] [2022-07-13 06:39:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 207081472. Throughput: 0: 10250.6. Samples: 414162988. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:53,989][27935] Avg episode reward: [(0, '-6.744')] [2022-07-13 06:39:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5085.3). Total num frames: 207108096. Throughput: 0: 10243.5. Samples: 414224400. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:39:58,999][27935] Avg episode reward: [(0, '-6.153')] [2022-07-13 06:40:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 207130624. Throughput: 0: 10154.1. Samples: 414281848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:40:03,989][27935] Avg episode reward: [(0, '-4.634')] [2022-07-13 06:40:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 207156224. Throughput: 0: 10144.3. Samples: 414312464. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:40:08,989][27935] Avg episode reward: [(0, '-5.472')] [2022-07-13 06:40:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 207181824. Throughput: 0: 10140.4. Samples: 414374000. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:40:13,989][27935] Avg episode reward: [(0, '-4.810')] [2022-07-13 06:40:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 207208448. Throughput: 0: 10132.1. Samples: 414434936. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 06:40:18,989][27935] Avg episode reward: [(0, '-4.750')] [2022-07-13 06:40:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.5). Total num frames: 207233024. Throughput: 0: 10132.9. Samples: 414465524. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:23,989][27935] Avg episode reward: [(0, '-5.645')] [2022-07-13 06:40:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 207258624. Throughput: 0: 10126.3. Samples: 414526640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:28,989][27935] Avg episode reward: [(0, '-6.474')] [2022-07-13 06:40:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 207284224. Throughput: 0: 10120.2. Samples: 414587684. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:33,989][27935] Avg episode reward: [(0, '-6.731')] [2022-07-13 06:40:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 207309824. Throughput: 0: 10115.3. Samples: 414618176. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:38,989][27935] Avg episode reward: [(0, '-6.180')] [2022-07-13 06:40:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 207334400. Throughput: 0: 10117.5. Samples: 414679688. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:43,989][27935] Avg episode reward: [(0, '-7.281')] [2022-07-13 06:40:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 207361024. Throughput: 0: 10207.0. Samples: 414741164. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:48,989][27935] Avg episode reward: [(0, '-7.384')] [2022-07-13 06:40:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 207386624. Throughput: 0: 10211.4. Samples: 414771976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:53,989][27935] Avg episode reward: [(0, '-6.861')] [2022-07-13 06:40:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.9). Total num frames: 207412224. Throughput: 0: 10210.6. Samples: 414833476. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:40:58,989][27935] Avg episode reward: [(0, '-7.213')] [2022-07-13 06:41:03,995][27935] Fps is (10 sec: 4912.0, 60 sec: 5085.3, 300 sec: 5085.2). Total num frames: 207435776. Throughput: 0: 10128.3. Samples: 414890776. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:03,996][27935] Avg episode reward: [(0, '-6.465')] [2022-07-13 06:41:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 207461376. Throughput: 0: 10124.3. Samples: 414921116. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:08,989][27935] Avg episode reward: [(0, '-5.248')] [2022-07-13 06:41:13,989][27935] Fps is (10 sec: 4918.4, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 207484928. Throughput: 0: 10122.7. Samples: 414982160. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:13,989][27935] Avg episode reward: [(0, '-4.645')] [2022-07-13 06:41:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 207511552. Throughput: 0: 9438.7. Samples: 415012424. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:18,989][27935] Avg episode reward: [(0, '-7.139')] [2022-07-13 06:41:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 207536128. Throughput: 0: 10120.0. Samples: 415073576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:24,005][27935] Avg episode reward: [(0, '-6.454')] [2022-07-13 06:41:28,995][27935] Fps is (10 sec: 5117.1, 60 sec: 5068.3, 300 sec: 5081.7). Total num frames: 207562752. Throughput: 0: 10114.7. Samples: 415134908. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:28,995][27935] Avg episode reward: [(0, '-5.717')] [2022-07-13 06:41:33,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 207588352. Throughput: 0: 10094.1. Samples: 415195396. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:33,989][27935] Avg episode reward: [(0, '-7.794')] [2022-07-13 06:41:38,989][27935] Fps is (10 sec: 5122.9, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 207613952. Throughput: 0: 10084.4. Samples: 415225776. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:38,989][27935] Avg episode reward: [(0, '-7.432')] [2022-07-13 06:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 207637504. Throughput: 0: 10041.9. Samples: 415285360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:43,989][27935] Avg episode reward: [(0, '-5.797')] [2022-07-13 06:41:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 207663104. Throughput: 0: 10105.4. Samples: 415345452. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:48,989][27935] Avg episode reward: [(0, '-3.885')] [2022-07-13 06:41:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 207689728. Throughput: 0: 10115.7. Samples: 415376324. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:53,990][27935] Avg episode reward: [(0, '-3.950')] [2022-07-13 06:41:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 207714304. Throughput: 0: 10126.4. Samples: 415437848. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:41:58,989][27935] Avg episode reward: [(0, '-4.442')] [2022-07-13 06:42:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5035.2, 300 sec: 5078.3). Total num frames: 207737856. Throughput: 0: 10727.1. Samples: 415495144. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:03,989][27935] Avg episode reward: [(0, '-5.648')] [2022-07-13 06:42:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5064.5). Total num frames: 207762432. Throughput: 0: 10039.8. Samples: 415525368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:08,990][27935] Avg episode reward: [(0, '-3.637')] [2022-07-13 06:42:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 207789056. Throughput: 0: 10041.9. Samples: 415586736. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:13,989][27935] Avg episode reward: [(0, '-4.338')] [2022-07-13 06:42:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 207814656. Throughput: 0: 10051.7. Samples: 415647724. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:18,990][27935] Avg episode reward: [(0, '-5.469')] [2022-07-13 06:42:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 207839232. Throughput: 0: 10057.3. Samples: 415678356. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:23,990][27935] Avg episode reward: [(0, '-6.419')] [2022-07-13 06:42:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5052.2, 300 sec: 5074.9). Total num frames: 207865856. Throughput: 0: 10096.8. Samples: 415739716. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:28,990][27935] Avg episode reward: [(0, '-7.165')] [2022-07-13 06:42:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 207890432. Throughput: 0: 10104.4. Samples: 415800152. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:33,990][27935] Avg episode reward: [(0, '-6.435')] [2022-07-13 06:42:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 207916032. Throughput: 0: 10088.7. Samples: 415830316. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:38,989][27935] Avg episode reward: [(0, '-6.543')] [2022-07-13 06:42:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 207939584. Throughput: 0: 10042.0. Samples: 415889736. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:43,989][27935] Avg episode reward: [(0, '-5.697')] [2022-07-13 06:42:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5061.0). Total num frames: 207964160. Throughput: 0: 10119.8. Samples: 415950536. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:48,989][27935] Avg episode reward: [(0, '-6.140')] [2022-07-13 06:42:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5064.5). Total num frames: 207990784. Throughput: 0: 10121.6. Samples: 415980840. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:53,990][27935] Avg episode reward: [(0, '-5.859')] [2022-07-13 06:42:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5067.9). Total num frames: 208015360. Throughput: 0: 10116.8. Samples: 416041992. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:42:58,990][27935] Avg episode reward: [(0, '-3.480')] [2022-07-13 06:43:03,990][27935] Fps is (10 sec: 4812.3, 60 sec: 5017.5, 300 sec: 5057.5). Total num frames: 208038912. Throughput: 0: 10036.1. Samples: 416099356. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:03,990][27935] Avg episode reward: [(0, '-5.025')] [2022-07-13 06:43:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 208065536. Throughput: 0: 10029.6. Samples: 416129688. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:08,989][27935] Avg episode reward: [(0, '-6.480')] [2022-07-13 06:43:13,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5034.7, 300 sec: 5068.0). Total num frames: 208091136. Throughput: 0: 10019.1. Samples: 416190576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:13,989][27935] Avg episode reward: [(0, '-7.730')] [2022-07-13 06:43:18,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 208115712. Throughput: 0: 10023.4. Samples: 416251208. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:18,990][27935] Avg episode reward: [(0, '-7.911')] [2022-07-13 06:43:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 208141312. Throughput: 0: 10037.2. Samples: 416281988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:23,989][27935] Avg episode reward: [(0, '-7.689')] [2022-07-13 06:43:28,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 208166912. Throughput: 0: 10066.2. Samples: 416342716. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:28,989][27935] Avg episode reward: [(0, '-9.217')] [2022-07-13 06:43:33,991][27935] Fps is (10 sec: 5016.5, 60 sec: 5017.4, 300 sec: 5054.1). Total num frames: 208191488. Throughput: 0: 10059.4. Samples: 416403232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:33,991][27935] Avg episode reward: [(0, '-9.453')] [2022-07-13 06:43:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5057.5). Total num frames: 208217088. Throughput: 0: 10058.9. Samples: 416433492. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:38,991][27935] Avg episode reward: [(0, '-9.331')] [2022-07-13 06:43:43,989][27935] Fps is (10 sec: 5121.1, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 208242688. Throughput: 0: 10059.0. Samples: 416494648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:43,989][27935] Avg episode reward: [(0, '-7.918')] [2022-07-13 06:43:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 208268288. Throughput: 0: 10138.3. Samples: 416555568. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:48,989][27935] Avg episode reward: [(0, '-6.898')] [2022-07-13 06:43:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 208293888. Throughput: 0: 10140.2. Samples: 416585996. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:53,989][27935] Avg episode reward: [(0, '-7.685')] [2022-07-13 06:43:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 208319488. Throughput: 0: 10153.9. Samples: 416647500. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:43:58,989][27935] Avg episode reward: [(0, '-7.164')] [2022-07-13 06:44:03,989][27935] Fps is (10 sec: 4710.1, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 208340992. Throughput: 0: 10078.1. Samples: 416704728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:03,990][27935] Avg episode reward: [(0, '-6.436')] [2022-07-13 06:44:08,989][27935] Fps is (10 sec: 4915.1, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 208368640. Throughput: 0: 10077.8. Samples: 416735492. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:08,990][27935] Avg episode reward: [(0, '-5.092')] [2022-07-13 06:44:13,989][27935] Fps is (10 sec: 5222.7, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 208393216. Throughput: 0: 10074.9. Samples: 416796088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:13,989][27935] Avg episode reward: [(0, '-5.896')] [2022-07-13 06:44:18,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5051.8, 300 sec: 5054.0). Total num frames: 208418816. Throughput: 0: 10086.2. Samples: 416857088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:18,991][27935] Avg episode reward: [(0, '-5.844')] [2022-07-13 06:44:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 208443392. Throughput: 0: 10089.2. Samples: 416887504. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:23,989][27935] Avg episode reward: [(0, '-6.222')] [2022-07-13 06:44:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 208468992. Throughput: 0: 10090.0. Samples: 416948696. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:28,991][27935] Avg episode reward: [(0, '-5.710')] [2022-07-13 06:44:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5069.0, 300 sec: 5054.0). Total num frames: 208495616. Throughput: 0: 10080.6. Samples: 417009196. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:33,990][27935] Avg episode reward: [(0, '-5.695')] [2022-07-13 06:44:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 208519168. Throughput: 0: 10079.6. Samples: 417039576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:38,989][27935] Avg episode reward: [(0, '-5.519')] [2022-07-13 06:44:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 208545792. Throughput: 0: 10067.4. Samples: 417100532. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 06:44:43,989][27935] Avg episode reward: [(0, '-5.816')] [2022-07-13 06:44:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 208571392. Throughput: 0: 10128.1. Samples: 417160488. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:44:48,989][27935] Avg episode reward: [(0, '-4.925')] [2022-07-13 06:44:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5040.2). Total num frames: 208594944. Throughput: 0: 10125.1. Samples: 417191120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:44:53,989][27935] Avg episode reward: [(0, '-4.127')] [2022-07-13 06:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5050.6). Total num frames: 208620544. Throughput: 0: 10134.8. Samples: 417252152. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:44:58,989][27935] Avg episode reward: [(0, '-3.915')] [2022-07-13 06:45:04,000][27935] Fps is (10 sec: 5011.8, 60 sec: 5067.9, 300 sec: 5046.9). Total num frames: 208645120. Throughput: 0: 10059.1. Samples: 417309864. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:04,001][27935] Avg episode reward: [(0, '-4.599')] [2022-07-13 06:45:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 208670720. Throughput: 0: 10067.3. Samples: 417340532. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:08,989][27935] Avg episode reward: [(0, '-5.671')] [2022-07-13 06:45:13,989][27935] Fps is (10 sec: 5023.4, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 208695296. Throughput: 0: 10074.4. Samples: 417402044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:13,989][27935] Avg episode reward: [(0, '-5.417')] [2022-07-13 06:45:18,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 208722944. Throughput: 0: 10088.7. Samples: 417463188. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:18,991][27935] Avg episode reward: [(0, '-5.255')] [2022-07-13 06:45:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 208747520. Throughput: 0: 10098.2. Samples: 417493996. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:23,989][27935] Avg episode reward: [(0, '-5.399')] [2022-07-13 06:45:28,989][27935] Fps is (10 sec: 5017.7, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 208773120. Throughput: 0: 10106.8. Samples: 417555340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:28,990][27935] Avg episode reward: [(0, '-5.823')] [2022-07-13 06:45:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 208798720. Throughput: 0: 10129.3. Samples: 417616308. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:33,992][27935] Avg episode reward: [(0, '-5.379')] [2022-07-13 06:45:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 208824320. Throughput: 0: 10125.8. Samples: 417646780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:38,989][27935] Avg episode reward: [(0, '-4.042')] [2022-07-13 06:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 208849920. Throughput: 0: 10132.0. Samples: 417708092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:43,989][27935] Avg episode reward: [(0, '-4.183')] [2022-07-13 06:45:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 208875520. Throughput: 0: 10213.7. Samples: 417769360. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:48,989][27935] Avg episode reward: [(0, '-4.414')] [2022-07-13 06:45:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 208900096. Throughput: 0: 10206.9. Samples: 417799844. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:53,989][27935] Avg episode reward: [(0, '-4.303')] [2022-07-13 06:45:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5050.7). Total num frames: 208925696. Throughput: 0: 10199.0. Samples: 417861000. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:45:58,989][27935] Avg episode reward: [(0, '-4.029')] [2022-07-13 06:46:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5069.8, 300 sec: 5043.6). Total num frames: 208949248. Throughput: 0: 10109.8. Samples: 417918128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:03,989][27935] Avg episode reward: [(0, '-4.805')] [2022-07-13 06:46:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 208974848. Throughput: 0: 10106.2. Samples: 417948776. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:08,989][27935] Avg episode reward: [(0, '-4.995')] [2022-07-13 06:46:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5050.6). Total num frames: 209001472. Throughput: 0: 10108.2. Samples: 418010208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:13,989][27935] Avg episode reward: [(0, '-5.132')] [2022-07-13 06:46:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 209026048. Throughput: 0: 10114.2. Samples: 418071448. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:18,989][27935] Avg episode reward: [(0, '-4.938')] [2022-07-13 06:46:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5043.7). Total num frames: 209050624. Throughput: 0: 10110.4. Samples: 418101748. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:23,990][27935] Avg episode reward: [(0, '-5.410')] [2022-07-13 06:46:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5043.6). Total num frames: 209076224. Throughput: 0: 10109.1. Samples: 418163000. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:28,989][27935] Avg episode reward: [(0, '-5.999')] [2022-07-13 06:46:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5047.1). Total num frames: 209102848. Throughput: 0: 10089.7. Samples: 418223396. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:33,989][27935] Avg episode reward: [(0, '-6.894')] [2022-07-13 06:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 209128448. Throughput: 0: 10089.2. Samples: 418253860. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:38,989][27935] Avg episode reward: [(0, '-5.744')] [2022-07-13 06:46:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 209154048. Throughput: 0: 10091.5. Samples: 418315116. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:43,989][27935] Avg episode reward: [(0, '-4.497')] [2022-07-13 06:46:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5047.1). Total num frames: 209178624. Throughput: 0: 10181.5. Samples: 418376296. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:48,990][27935] Avg episode reward: [(0, '-4.257')] [2022-07-13 06:46:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 209204224. Throughput: 0: 10179.9. Samples: 418406872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:53,989][27935] Avg episode reward: [(0, '-6.480')] [2022-07-13 06:46:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 209229824. Throughput: 0: 10190.0. Samples: 418468756. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 06:46:58,991][27935] Avg episode reward: [(0, '-6.309')] [2022-07-13 06:47:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 209253376. Throughput: 0: 10106.6. Samples: 418526244. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:03,989][27935] Avg episode reward: [(0, '-6.130')] [2022-07-13 06:47:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5054.0). Total num frames: 209280000. Throughput: 0: 10130.1. Samples: 418557604. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:08,989][27935] Avg episode reward: [(0, '-5.734')] [2022-07-13 06:47:14,002][27935] Fps is (10 sec: 5215.3, 60 sec: 5067.6, 300 sec: 5053.8). Total num frames: 209305600. Throughput: 0: 10123.6. Samples: 418618700. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:14,004][27935] Avg episode reward: [(0, '-9.326')] [2022-07-13 06:47:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 209330176. Throughput: 0: 10129.9. Samples: 418679240. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:18,989][27935] Avg episode reward: [(0, '-9.560')] [2022-07-13 06:47:23,989][27935] Fps is (10 sec: 5024.5, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 209355776. Throughput: 0: 10128.2. Samples: 418709628. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:23,989][27935] Avg episode reward: [(0, '-8.472')] [2022-07-13 06:47:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 209380352. Throughput: 0: 10132.9. Samples: 418771096. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:28,989][27935] Avg episode reward: [(0, '-9.400')] [2022-07-13 06:47:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 209405952. Throughput: 0: 10122.7. Samples: 418831816. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:33,989][27935] Avg episode reward: [(0, '-9.287')] [2022-07-13 06:47:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 209431552. Throughput: 0: 10124.1. Samples: 418862456. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:38,989][27935] Avg episode reward: [(0, '-6.910')] [2022-07-13 06:47:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 209456128. Throughput: 0: 10076.5. Samples: 418922200. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:43,989][27935] Avg episode reward: [(0, '-6.710')] [2022-07-13 06:47:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 209480704. Throughput: 0: 10105.3. Samples: 418980984. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:48,989][27935] Avg episode reward: [(0, '-7.604')] [2022-07-13 06:47:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.5). Total num frames: 209507328. Throughput: 0: 10075.9. Samples: 419011020. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:53,991][27935] Avg episode reward: [(0, '-7.953')] [2022-07-13 06:47:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 209531904. Throughput: 0: 10087.5. Samples: 419072500. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:47:58,990][27935] Avg episode reward: [(0, '-8.018')] [2022-07-13 06:48:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5017.6, 300 sec: 5047.1). Total num frames: 209554432. Throughput: 0: 10018.3. Samples: 419130064. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:03,991][27935] Avg episode reward: [(0, '-6.579')] [2022-07-13 06:48:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5050.6). Total num frames: 209581056. Throughput: 0: 10025.1. Samples: 419160756. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:08,989][27935] Avg episode reward: [(0, '-6.087')] [2022-07-13 06:48:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5018.7, 300 sec: 5054.1). Total num frames: 209606656. Throughput: 0: 10020.2. Samples: 419222004. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:13,990][27935] Avg episode reward: [(0, '-9.963')] [2022-07-13 06:48:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5054.0). Total num frames: 209632256. Throughput: 0: 10022.8. Samples: 419282840. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:18,989][27935] Avg episode reward: [(0, '-8.436')] [2022-07-13 06:48:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5054.0). Total num frames: 209657856. Throughput: 0: 10022.5. Samples: 419313468. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:23,990][27935] Avg episode reward: [(0, '-7.846')] [2022-07-13 06:48:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5057.6). Total num frames: 209683456. Throughput: 0: 10066.8. Samples: 419375208. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:28,989][27935] Avg episode reward: [(0, '-7.265')] [2022-07-13 06:48:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5054.0). Total num frames: 209708032. Throughput: 0: 10119.0. Samples: 419436340. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:33,989][27935] Avg episode reward: [(0, '-7.843')] [2022-07-13 06:48:38,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5034.4, 300 sec: 5054.0). Total num frames: 209733632. Throughput: 0: 10128.2. Samples: 419466824. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:38,993][27935] Avg episode reward: [(0, '-8.215')] [2022-07-13 06:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 209760256. Throughput: 0: 10129.9. Samples: 419528344. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:43,989][27935] Avg episode reward: [(0, '-5.874')] [2022-07-13 06:48:48,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5068.8, 300 sec: 5054.0). Total num frames: 209784832. Throughput: 0: 10215.5. Samples: 419589760. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:48,989][27935] Avg episode reward: [(0, '-6.241')] [2022-07-13 06:48:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5057.5). Total num frames: 209811456. Throughput: 0: 10226.2. Samples: 419620936. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:53,989][27935] Avg episode reward: [(0, '-6.143')] [2022-07-13 06:48:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 209837056. Throughput: 0: 10233.5. Samples: 419682512. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:48:58,989][27935] Avg episode reward: [(0, '-5.818')] [2022-07-13 06:49:03,990][27935] Fps is (10 sec: 4812.0, 60 sec: 5085.7, 300 sec: 5054.0). Total num frames: 209859584. Throughput: 0: 10153.7. Samples: 419739772. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:49:03,991][27935] Avg episode reward: [(0, '-6.057')] [2022-07-13 06:49:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 209886208. Throughput: 0: 10162.9. Samples: 419770800. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:49:08,989][27935] Avg episode reward: [(0, '-5.694')] [2022-07-13 06:49:13,989][27935] Fps is (10 sec: 5223.2, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 209911808. Throughput: 0: 10171.4. Samples: 419832920. Policy #0 lag: (min: 0.0, avg: 9.9, max: 19.0) [2022-07-13 06:49:13,989][27935] Avg episode reward: [(0, '-4.448')] [2022-07-13 06:49:18,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 209936384. Throughput: 0: 10172.5. Samples: 419894104. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:18,994][27935] Avg episode reward: [(0, '-3.627')] [2022-07-13 06:49:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 209963008. Throughput: 0: 10179.3. Samples: 419924856. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:23,989][27935] Avg episode reward: [(0, '-5.024')] [2022-07-13 06:49:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5061.0). Total num frames: 209988608. Throughput: 0: 10183.3. Samples: 419986592. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:28,989][27935] Avg episode reward: [(0, '-6.061')] [2022-07-13 06:49:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 210013184. Throughput: 0: 10174.7. Samples: 420047620. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:33,989][27935] Avg episode reward: [(0, '-6.711')] [2022-07-13 06:49:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5103.2, 300 sec: 5064.5). Total num frames: 210039808. Throughput: 0: 10158.4. Samples: 420078064. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:38,989][27935] Avg episode reward: [(0, '-7.532')] [2022-07-13 06:49:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 210065408. Throughput: 0: 10162.0. Samples: 420139804. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:43,989][27935] Avg episode reward: [(0, '-8.063')] [2022-07-13 06:49:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210091008. Throughput: 0: 10244.9. Samples: 420200776. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:48,989][27935] Avg episode reward: [(0, '-8.598')] [2022-07-13 06:49:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 210115584. Throughput: 0: 10241.8. Samples: 420231680. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:53,989][27935] Avg episode reward: [(0, '-7.774')] [2022-07-13 06:49:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5075.1). Total num frames: 210142208. Throughput: 0: 10227.4. Samples: 420293152. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:49:58,989][27935] Avg episode reward: [(0, '-6.029')] [2022-07-13 06:50:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5086.0, 300 sec: 5064.5). Total num frames: 210164736. Throughput: 0: 10134.2. Samples: 420350140. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:03,990][27935] Avg episode reward: [(0, '-6.513')] [2022-07-13 06:50:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 210191360. Throughput: 0: 10133.3. Samples: 420380856. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:08,990][27935] Avg episode reward: [(0, '-6.933')] [2022-07-13 06:50:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 210215936. Throughput: 0: 10129.0. Samples: 420442396. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:13,989][27935] Avg episode reward: [(0, '-5.939')] [2022-07-13 06:50:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 210242560. Throughput: 0: 9453.3. Samples: 420473020. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:18,990][27935] Avg episode reward: [(0, '-6.428')] [2022-07-13 06:50:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 210268160. Throughput: 0: 10147.7. Samples: 420534708. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:23,991][27935] Avg episode reward: [(0, '-6.821')] [2022-07-13 06:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210294784. Throughput: 0: 10151.8. Samples: 420596636. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:28,990][27935] Avg episode reward: [(0, '-6.975')] [2022-07-13 06:50:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 210317312. Throughput: 0: 10163.2. Samples: 420658120. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:33,989][27935] Avg episode reward: [(0, '-7.061')] [2022-07-13 06:50:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210345984. Throughput: 0: 10163.7. Samples: 420689048. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:38,990][27935] Avg episode reward: [(0, '-7.115')] [2022-07-13 06:50:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210371584. Throughput: 0: 10186.8. Samples: 420751560. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:43,989][27935] Avg episode reward: [(0, '-5.797')] [2022-07-13 06:50:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 210397184. Throughput: 0: 10271.8. Samples: 420812372. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:48,991][27935] Avg episode reward: [(0, '-5.088')] [2022-07-13 06:50:53,989][27935] Fps is (10 sec: 4915.3, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 210420736. Throughput: 0: 10274.2. Samples: 420843196. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:53,989][27935] Avg episode reward: [(0, '-6.779')] [2022-07-13 06:50:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 210448384. Throughput: 0: 10273.7. Samples: 420904712. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:50:58,989][27935] Avg episode reward: [(0, '-7.426')] [2022-07-13 06:51:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 210471936. Throughput: 0: 10870.5. Samples: 420962192. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:03,990][27935] Avg episode reward: [(0, '-6.598')] [2022-07-13 06:51:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210497536. Throughput: 0: 10186.6. Samples: 420993104. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:08,990][27935] Avg episode reward: [(0, '-6.040')] [2022-07-13 06:51:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 210522112. Throughput: 0: 10164.8. Samples: 421054052. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:13,989][27935] Avg episode reward: [(0, '-5.861')] [2022-07-13 06:51:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 210547712. Throughput: 0: 10148.5. Samples: 421114804. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:18,991][27935] Avg episode reward: [(0, '-5.995')] [2022-07-13 06:51:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 210573312. Throughput: 0: 10142.5. Samples: 421145460. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:23,989][27935] Avg episode reward: [(0, '-4.494')] [2022-07-13 06:51:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 210598912. Throughput: 0: 10108.2. Samples: 421206428. Policy #0 lag: (min: 0.0, avg: 7.7, max: 18.0) [2022-07-13 06:51:28,989][27935] Avg episode reward: [(0, '-5.423')] [2022-07-13 06:51:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 210623488. Throughput: 0: 10086.9. Samples: 421266284. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:33,989][27935] Avg episode reward: [(0, '-4.522')] [2022-07-13 06:51:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 210649088. Throughput: 0: 10076.8. Samples: 421296652. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:38,989][27935] Avg episode reward: [(0, '-4.595')] [2022-07-13 06:51:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 210674688. Throughput: 0: 10083.4. Samples: 421358464. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:43,989][27935] Avg episode reward: [(0, '-4.825')] [2022-07-13 06:51:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 210700288. Throughput: 0: 10166.3. Samples: 421419676. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:48,989][27935] Avg episode reward: [(0, '-4.117')] [2022-07-13 06:51:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 210724864. Throughput: 0: 10168.9. Samples: 421450704. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:53,992][27935] Avg episode reward: [(0, '-2.708')] [2022-07-13 06:51:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 210751488. Throughput: 0: 10199.1. Samples: 421513012. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:51:58,997][27935] Avg episode reward: [(0, '-2.813')] [2022-07-13 06:52:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 210775040. Throughput: 0: 10121.6. Samples: 421570276. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:03,989][27935] Avg episode reward: [(0, '-3.657')] [2022-07-13 06:52:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5068.2). Total num frames: 210800640. Throughput: 0: 10125.4. Samples: 421601104. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:08,989][27935] Avg episode reward: [(0, '-4.562')] [2022-07-13 06:52:13,998][27935] Fps is (10 sec: 5217.8, 60 sec: 5085.1, 300 sec: 5074.7). Total num frames: 210827264. Throughput: 0: 10151.2. Samples: 421663320. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:13,998][27935] Avg episode reward: [(0, '-4.323')] [2022-07-13 06:52:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 210851840. Throughput: 0: 10185.1. Samples: 421724612. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:18,989][27935] Avg episode reward: [(0, '-5.464')] [2022-07-13 06:52:23,989][27935] Fps is (10 sec: 5022.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 210877440. Throughput: 0: 10190.6. Samples: 421755228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:23,989][27935] Avg episode reward: [(0, '-5.823')] [2022-07-13 06:52:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 210904064. Throughput: 0: 10183.4. Samples: 421816716. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:28,989][27935] Avg episode reward: [(0, '-6.513')] [2022-07-13 06:52:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 210928640. Throughput: 0: 10177.6. Samples: 421877668. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:33,989][27935] Avg episode reward: [(0, '-8.349')] [2022-07-13 06:52:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 210954240. Throughput: 0: 10166.0. Samples: 421908172. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:38,989][27935] Avg episode reward: [(0, '-7.497')] [2022-07-13 06:52:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 210979840. Throughput: 0: 10121.9. Samples: 421968496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:43,989][27935] Avg episode reward: [(0, '-6.502')] [2022-07-13 06:52:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 211004416. Throughput: 0: 10213.1. Samples: 422029864. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:48,989][27935] Avg episode reward: [(0, '-5.280')] [2022-07-13 06:52:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 211031040. Throughput: 0: 10215.8. Samples: 422060816. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:53,989][27935] Avg episode reward: [(0, '-5.441')] [2022-07-13 06:52:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 211055616. Throughput: 0: 10205.7. Samples: 422122488. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:52:58,989][27935] Avg episode reward: [(0, '-5.489')] [2022-07-13 06:53:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5085.3). Total num frames: 211081216. Throughput: 0: 10127.8. Samples: 422180364. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:03,989][27935] Avg episode reward: [(0, '-4.718')] [2022-07-13 06:53:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 211105792. Throughput: 0: 10140.2. Samples: 422211536. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:08,989][27935] Avg episode reward: [(0, '-4.766')] [2022-07-13 06:53:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5069.5, 300 sec: 5081.8). Total num frames: 211131392. Throughput: 0: 10143.0. Samples: 422273152. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:13,989][27935] Avg episode reward: [(0, '-6.024')] [2022-07-13 06:53:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5085.3). Total num frames: 211158016. Throughput: 0: 10142.0. Samples: 422334060. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:18,991][27935] Avg episode reward: [(0, '-6.359')] [2022-07-13 06:53:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 211182592. Throughput: 0: 10148.6. Samples: 422364860. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:23,990][27935] Avg episode reward: [(0, '-5.776')] [2022-07-13 06:53:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 211209216. Throughput: 0: 10179.3. Samples: 422426564. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:28,989][27935] Avg episode reward: [(0, '-6.376')] [2022-07-13 06:53:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 211233792. Throughput: 0: 10166.6. Samples: 422487360. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:33,991][27935] Avg episode reward: [(0, '-6.101')] [2022-07-13 06:53:38,989][27935] Fps is (10 sec: 5017.3, 60 sec: 5085.8, 300 sec: 5081.8). Total num frames: 211259392. Throughput: 0: 10161.4. Samples: 422518084. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:38,991][27935] Avg episode reward: [(0, '-5.409')] [2022-07-13 06:53:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 211284992. Throughput: 0: 10164.5. Samples: 422579892. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 06:53:43,989][27935] Avg episode reward: [(0, '-3.606')] [2022-07-13 06:53:48,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 211310592. Throughput: 0: 10221.3. Samples: 422640320. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:53:48,995][27935] Avg episode reward: [(0, '-3.559')] [2022-07-13 06:53:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 211334144. Throughput: 0: 10176.8. Samples: 422669492. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:53:53,989][27935] Avg episode reward: [(0, '-4.515')] [2022-07-13 06:53:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5085.3). Total num frames: 211359744. Throughput: 0: 10171.9. Samples: 422730888. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:53:58,990][27935] Avg episode reward: [(0, '-4.147')] [2022-07-13 06:54:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 211385344. Throughput: 0: 10092.8. Samples: 422788236. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:03,990][27935] Avg episode reward: [(0, '-4.254')] [2022-07-13 06:54:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 211410944. Throughput: 0: 10086.5. Samples: 422818752. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:08,989][27935] Avg episode reward: [(0, '-4.215')] [2022-07-13 06:54:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 211434496. Throughput: 0: 10081.5. Samples: 422880232. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:13,989][27935] Avg episode reward: [(0, '-4.589')] [2022-07-13 06:54:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 211460096. Throughput: 0: 10102.0. Samples: 422941948. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:18,991][27935] Avg episode reward: [(0, '-5.669')] [2022-07-13 06:54:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 211487744. Throughput: 0: 10099.3. Samples: 422972544. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:23,990][27935] Avg episode reward: [(0, '-6.404')] [2022-07-13 06:54:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 211512320. Throughput: 0: 10083.1. Samples: 423033632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:28,989][27935] Avg episode reward: [(0, '-6.007')] [2022-07-13 06:54:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 211537920. Throughput: 0: 10086.4. Samples: 423094208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:33,989][27935] Avg episode reward: [(0, '-5.810')] [2022-07-13 06:54:38,991][27935] Fps is (10 sec: 5016.6, 60 sec: 5051.6, 300 sec: 5074.8). Total num frames: 211562496. Throughput: 0: 10113.8. Samples: 423124632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:38,991][27935] Avg episode reward: [(0, '-6.814')] [2022-07-13 06:54:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 211588096. Throughput: 0: 10116.1. Samples: 423186112. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:43,989][27935] Avg episode reward: [(0, '-7.570')] [2022-07-13 06:54:48,989][27935] Fps is (10 sec: 5223.4, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 211614720. Throughput: 0: 10215.8. Samples: 423247948. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:48,991][27935] Avg episode reward: [(0, '-6.961')] [2022-07-13 06:54:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 211640320. Throughput: 0: 10214.5. Samples: 423278404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:53,989][27935] Avg episode reward: [(0, '-6.240')] [2022-07-13 06:54:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 211664896. Throughput: 0: 10215.7. Samples: 423339940. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:54:58,989][27935] Avg episode reward: [(0, '-6.028')] [2022-07-13 06:55:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 211689472. Throughput: 0: 10129.2. Samples: 423397760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:03,989][27935] Avg episode reward: [(0, '-6.355')] [2022-07-13 06:55:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 211714048. Throughput: 0: 10136.1. Samples: 423428668. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:08,989][27935] Avg episode reward: [(0, '-7.417')] [2022-07-13 06:55:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 211740672. Throughput: 0: 10150.5. Samples: 423490404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:13,990][27935] Avg episode reward: [(0, '-6.747')] [2022-07-13 06:55:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 211766272. Throughput: 0: 10161.0. Samples: 423551452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:18,991][27935] Avg episode reward: [(0, '-6.228')] [2022-07-13 06:55:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 211791872. Throughput: 0: 10168.4. Samples: 423582192. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:23,990][27935] Avg episode reward: [(0, '-6.927')] [2022-07-13 06:55:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5081.8). Total num frames: 211816448. Throughput: 0: 10167.1. Samples: 423643632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:28,990][27935] Avg episode reward: [(0, '-6.698')] [2022-07-13 06:55:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 211842048. Throughput: 0: 9462.4. Samples: 423673756. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:33,990][27935] Avg episode reward: [(0, '-6.324')] [2022-07-13 06:55:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5103.1, 300 sec: 5074.9). Total num frames: 211868672. Throughput: 0: 10135.3. Samples: 423734492. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:38,990][27935] Avg episode reward: [(0, '-4.567')] [2022-07-13 06:55:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 211893248. Throughput: 0: 10137.8. Samples: 423796140. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:43,990][27935] Avg episode reward: [(0, '-4.493')] [2022-07-13 06:55:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 211918848. Throughput: 0: 10219.0. Samples: 423857616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:48,989][27935] Avg episode reward: [(0, '-5.156')] [2022-07-13 06:55:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 211944448. Throughput: 0: 10216.8. Samples: 423888424. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 06:55:53,990][27935] Avg episode reward: [(0, '-5.402')] [2022-07-13 06:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 211971072. Throughput: 0: 10219.8. Samples: 423950296. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:55:58,989][27935] Avg episode reward: [(0, '-6.093')] [2022-07-13 06:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 211994624. Throughput: 0: 10147.7. Samples: 424008096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:03,989][27935] Avg episode reward: [(0, '-6.672')] [2022-07-13 06:56:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 212019200. Throughput: 0: 10150.3. Samples: 424038956. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:08,989][27935] Avg episode reward: [(0, '-6.519')] [2022-07-13 06:56:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 212045824. Throughput: 0: 10161.3. Samples: 424100892. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:13,989][27935] Avg episode reward: [(0, '-6.877')] [2022-07-13 06:56:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 212071424. Throughput: 0: 10858.5. Samples: 424162388. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:18,991][27935] Avg episode reward: [(0, '-7.428')] [2022-07-13 06:56:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 212097024. Throughput: 0: 10179.3. Samples: 424192560. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:23,990][27935] Avg episode reward: [(0, '-5.683')] [2022-07-13 06:56:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 212122624. Throughput: 0: 10185.0. Samples: 424254464. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:28,989][27935] Avg episode reward: [(0, '-5.292')] [2022-07-13 06:56:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 212148224. Throughput: 0: 10167.0. Samples: 424315132. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:33,990][27935] Avg episode reward: [(0, '-5.578')] [2022-07-13 06:56:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.8). Total num frames: 212173824. Throughput: 0: 10154.2. Samples: 424345364. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:38,990][27935] Avg episode reward: [(0, '-7.363')] [2022-07-13 06:56:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 212199424. Throughput: 0: 10127.2. Samples: 424406020. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:43,989][27935] Avg episode reward: [(0, '-6.833')] [2022-07-13 06:56:49,005][27935] Fps is (10 sec: 5009.6, 60 sec: 5084.5, 300 sec: 5081.5). Total num frames: 212224000. Throughput: 0: 10189.8. Samples: 424466800. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:49,005][27935] Avg episode reward: [(0, '-6.473')] [2022-07-13 06:56:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 212248576. Throughput: 0: 10180.9. Samples: 424497096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:53,989][27935] Avg episode reward: [(0, '-8.662')] [2022-07-13 06:56:58,989][27935] Fps is (10 sec: 4923.0, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 212273152. Throughput: 0: 10156.2. Samples: 424557920. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:56:58,989][27935] Avg episode reward: [(0, '-8.625')] [2022-07-13 06:57:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 212297728. Throughput: 0: 10070.9. Samples: 424615580. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:03,989][27935] Avg episode reward: [(0, '-7.619')] [2022-07-13 06:57:08,992][27935] Fps is (10 sec: 5016.0, 60 sec: 5068.5, 300 sec: 5071.5). Total num frames: 212323328. Throughput: 0: 10078.3. Samples: 424646116. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:08,993][27935] Avg episode reward: [(0, '-7.663')] [2022-07-13 06:57:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 212349952. Throughput: 0: 10068.0. Samples: 424707524. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:13,989][27935] Avg episode reward: [(0, '-7.417')] [2022-07-13 06:57:18,989][27935] Fps is (10 sec: 5121.6, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 212374528. Throughput: 0: 10078.5. Samples: 424768664. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:18,989][27935] Avg episode reward: [(0, '-8.478')] [2022-07-13 06:57:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 212400128. Throughput: 0: 10089.1. Samples: 424799376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:23,989][27935] Avg episode reward: [(0, '-7.109')] [2022-07-13 06:57:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 212425728. Throughput: 0: 10095.7. Samples: 424860328. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:28,989][27935] Avg episode reward: [(0, '-6.736')] [2022-07-13 06:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 212451328. Throughput: 0: 10102.9. Samples: 424921272. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:33,989][27935] Avg episode reward: [(0, '-5.839')] [2022-07-13 06:57:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5067.9). Total num frames: 212474880. Throughput: 0: 10103.1. Samples: 424951736. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:38,990][27935] Avg episode reward: [(0, '-4.545')] [2022-07-13 06:57:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 212501504. Throughput: 0: 10081.7. Samples: 425011596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:43,990][27935] Avg episode reward: [(0, '-4.342')] [2022-07-13 06:57:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5053.1, 300 sec: 5071.4). Total num frames: 212527104. Throughput: 0: 10164.4. Samples: 425072980. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:48,991][27935] Avg episode reward: [(0, '-6.171')] [2022-07-13 06:57:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 212552704. Throughput: 0: 10173.4. Samples: 425103884. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:53,990][27935] Avg episode reward: [(0, '-6.031')] [2022-07-13 06:57:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 212577280. Throughput: 0: 10173.8. Samples: 425165344. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:57:58,991][27935] Avg episode reward: [(0, '-5.636')] [2022-07-13 06:58:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 212601856. Throughput: 0: 10095.7. Samples: 425222968. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:58:03,989][27935] Avg episode reward: [(0, '-5.766')] [2022-07-13 06:58:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5069.1, 300 sec: 5071.4). Total num frames: 212627456. Throughput: 0: 10096.3. Samples: 425253708. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 06:58:08,989][27935] Avg episode reward: [(0, '-5.668')] [2022-07-13 06:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 212653056. Throughput: 0: 10083.1. Samples: 425314068. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:13,989][27935] Avg episode reward: [(0, '-5.520')] [2022-07-13 06:58:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 212676608. Throughput: 0: 10087.1. Samples: 425375192. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:18,989][27935] Avg episode reward: [(0, '-5.359')] [2022-07-13 06:58:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 212704256. Throughput: 0: 10085.9. Samples: 425405600. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:23,989][27935] Avg episode reward: [(0, '-4.256')] [2022-07-13 06:58:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 212728832. Throughput: 0: 10117.7. Samples: 425466892. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:28,992][27935] Avg episode reward: [(0, '-4.876')] [2022-07-13 06:58:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 212754432. Throughput: 0: 10119.9. Samples: 425528376. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:33,989][27935] Avg episode reward: [(0, '-4.769')] [2022-07-13 06:58:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 212779008. Throughput: 0: 10120.8. Samples: 425559320. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:38,989][27935] Avg episode reward: [(0, '-4.514')] [2022-07-13 06:58:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 212805632. Throughput: 0: 10130.3. Samples: 425621208. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:43,989][27935] Avg episode reward: [(0, '-4.420')] [2022-07-13 06:58:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 212831232. Throughput: 0: 10215.7. Samples: 425682676. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:48,989][27935] Avg episode reward: [(0, '-4.756')] [2022-07-13 06:58:53,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 212857856. Throughput: 0: 10229.3. Samples: 425714028. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:53,989][27935] Avg episode reward: [(0, '-4.023')] [2022-07-13 06:58:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 212882432. Throughput: 0: 10255.0. Samples: 425775544. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:58:58,990][27935] Avg episode reward: [(0, '-4.330')] [2022-07-13 06:59:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 212907008. Throughput: 0: 10188.9. Samples: 425833692. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:03,989][27935] Avg episode reward: [(0, '-3.467')] [2022-07-13 06:59:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 212933632. Throughput: 0: 10201.3. Samples: 425864660. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:08,990][27935] Avg episode reward: [(0, '-5.051')] [2022-07-13 06:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 212959232. Throughput: 0: 10210.3. Samples: 425926356. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:13,989][27935] Avg episode reward: [(0, '-6.437')] [2022-07-13 06:59:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5071.4). Total num frames: 212983808. Throughput: 0: 10209.1. Samples: 425987784. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:18,989][27935] Avg episode reward: [(0, '-5.291')] [2022-07-13 06:59:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 213010432. Throughput: 0: 10211.7. Samples: 426018848. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:23,989][27935] Avg episode reward: [(0, '-4.454')] [2022-07-13 06:59:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 213033984. Throughput: 0: 10186.2. Samples: 426079588. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:28,992][27935] Avg episode reward: [(0, '-5.228')] [2022-07-13 06:59:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5078.4). Total num frames: 213060608. Throughput: 0: 10163.9. Samples: 426140052. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:33,991][27935] Avg episode reward: [(0, '-6.723')] [2022-07-13 06:59:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 213085184. Throughput: 0: 10154.7. Samples: 426170988. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:38,989][27935] Avg episode reward: [(0, '-9.885')] [2022-07-13 06:59:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5081.8). Total num frames: 213113856. Throughput: 0: 10165.1. Samples: 426232972. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:43,990][27935] Avg episode reward: [(0, '-10.548')] [2022-07-13 06:59:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 213137408. Throughput: 0: 10232.4. Samples: 426294148. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:48,991][27935] Avg episode reward: [(0, '-10.414')] [2022-07-13 06:59:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 213161984. Throughput: 0: 10220.3. Samples: 426324576. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:53,991][27935] Avg episode reward: [(0, '-10.684')] [2022-07-13 06:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 213186560. Throughput: 0: 10169.0. Samples: 426383960. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 06:59:58,989][27935] Avg episode reward: [(0, '-10.953')] [2022-07-13 07:00:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5074.9). Total num frames: 213211136. Throughput: 0: 10057.0. Samples: 426440348. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 07:00:03,989][27935] Avg episode reward: [(0, '-9.475')] [2022-07-13 07:00:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 213236736. Throughput: 0: 10047.8. Samples: 426471000. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 07:00:08,990][27935] Avg episode reward: [(0, '-8.596')] [2022-07-13 07:00:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 213261312. Throughput: 0: 10066.0. Samples: 426532560. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 07:00:13,989][27935] Avg episode reward: [(0, '-5.817')] [2022-07-13 07:00:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 213286912. Throughput: 0: 10093.2. Samples: 426594248. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 07:00:18,989][27935] Avg episode reward: [(0, '-4.727')] [2022-07-13 07:00:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 213313536. Throughput: 0: 10086.8. Samples: 426624896. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 07:00:23,989][27935] Avg episode reward: [(0, '-4.566')] [2022-07-13 07:00:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 213338112. Throughput: 0: 10078.1. Samples: 426686488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:28,989][27935] Avg episode reward: [(0, '-4.385')] [2022-07-13 07:00:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 213364736. Throughput: 0: 10055.1. Samples: 426746628. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:33,989][27935] Avg episode reward: [(0, '-3.448')] [2022-07-13 07:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 213388288. Throughput: 0: 10064.7. Samples: 426777488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:38,989][27935] Avg episode reward: [(0, '-2.944')] [2022-07-13 07:00:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 213414912. Throughput: 0: 10104.3. Samples: 426838656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:43,989][27935] Avg episode reward: [(0, '-2.970')] [2022-07-13 07:00:48,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 213440512. Throughput: 0: 10199.1. Samples: 426899308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:48,989][27935] Avg episode reward: [(0, '-3.149')] [2022-07-13 07:00:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 213466112. Throughput: 0: 10199.4. Samples: 426929972. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:53,989][27935] Avg episode reward: [(0, '-1.617')] [2022-07-13 07:00:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 213489664. Throughput: 0: 10190.3. Samples: 426991124. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:00:58,991][27935] Avg episode reward: [(0, '-4.244')] [2022-07-13 07:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 213513216. Throughput: 0: 10069.1. Samples: 427047356. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:03,991][27935] Avg episode reward: [(0, '-6.380')] [2022-07-13 07:01:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 213538816. Throughput: 0: 10064.8. Samples: 427077812. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:08,989][27935] Avg episode reward: [(0, '-6.868')] [2022-07-13 07:01:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 213566464. Throughput: 0: 10063.3. Samples: 427139336. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:13,991][27935] Avg episode reward: [(0, '-7.444')] [2022-07-13 07:01:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 213590016. Throughput: 0: 10081.8. Samples: 427200312. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:18,989][27935] Avg episode reward: [(0, '-7.388')] [2022-07-13 07:01:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5064.5). Total num frames: 213616640. Throughput: 0: 10073.2. Samples: 427230780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:23,991][27935] Avg episode reward: [(0, '-8.613')] [2022-07-13 07:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 213640192. Throughput: 0: 10076.1. Samples: 427292080. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:28,990][27935] Avg episode reward: [(0, '-8.308')] [2022-07-13 07:01:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 213666816. Throughput: 0: 10064.3. Samples: 427352204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:33,989][27935] Avg episode reward: [(0, '-7.965')] [2022-07-13 07:01:39,005][27935] Fps is (10 sec: 5214.1, 60 sec: 5067.5, 300 sec: 5060.7). Total num frames: 213692416. Throughput: 0: 10056.1. Samples: 427382656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:39,005][27935] Avg episode reward: [(0, '-7.505')] [2022-07-13 07:01:43,991][27935] Fps is (10 sec: 5119.1, 60 sec: 5051.6, 300 sec: 5064.7). Total num frames: 213718016. Throughput: 0: 10059.0. Samples: 427443796. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:43,991][27935] Avg episode reward: [(0, '-6.023')] [2022-07-13 07:01:48,989][27935] Fps is (10 sec: 5025.6, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 213742592. Throughput: 0: 10179.2. Samples: 427505420. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:48,989][27935] Avg episode reward: [(0, '-6.175')] [2022-07-13 07:01:53,989][27935] Fps is (10 sec: 5120.9, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 213769216. Throughput: 0: 10184.8. Samples: 427536128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:53,989][27935] Avg episode reward: [(0, '-5.045')] [2022-07-13 07:01:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 213794816. Throughput: 0: 10178.5. Samples: 427597368. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:01:58,989][27935] Avg episode reward: [(0, '-4.706')] [2022-07-13 07:02:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5051.7, 300 sec: 5061.0). Total num frames: 213816320. Throughput: 0: 10096.3. Samples: 427654644. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:03,989][27935] Avg episode reward: [(0, '-4.199')] [2022-07-13 07:02:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 213842944. Throughput: 0: 10092.3. Samples: 427684932. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:08,989][27935] Avg episode reward: [(0, '-3.417')] [2022-07-13 07:02:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 5067.9). Total num frames: 213869568. Throughput: 0: 10097.2. Samples: 427746456. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:13,989][27935] Avg episode reward: [(0, '-3.932')] [2022-07-13 07:02:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 213894144. Throughput: 0: 10127.7. Samples: 427807952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:18,989][27935] Avg episode reward: [(0, '-4.526')] [2022-07-13 07:02:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 213920768. Throughput: 0: 10144.2. Samples: 427838984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:23,989][27935] Avg episode reward: [(0, '-5.535')] [2022-07-13 07:02:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5064.5). Total num frames: 213945344. Throughput: 0: 10156.2. Samples: 427900808. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:28,989][27935] Avg episode reward: [(0, '-5.480')] [2022-07-13 07:02:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 213970944. Throughput: 0: 10143.5. Samples: 427961880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:33,990][27935] Avg episode reward: [(0, '-6.022')] [2022-07-13 07:02:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5087.2, 300 sec: 5071.4). Total num frames: 213997568. Throughput: 0: 10150.8. Samples: 427992916. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 07:02:38,989][27935] Avg episode reward: [(0, '-6.271')] [2022-07-13 07:02:43,991][27935] Fps is (10 sec: 5118.9, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 214022144. Throughput: 0: 10140.8. Samples: 428053724. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:02:44,004][27935] Avg episode reward: [(0, '-6.453')] [2022-07-13 07:02:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 214048768. Throughput: 0: 10236.1. Samples: 428115268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:02:48,989][27935] Avg episode reward: [(0, '-5.575')] [2022-07-13 07:02:53,989][27935] Fps is (10 sec: 5223.5, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 214074368. Throughput: 0: 10261.1. Samples: 428146680. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:02:53,989][27935] Avg episode reward: [(0, '-4.826')] [2022-07-13 07:02:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 214100992. Throughput: 0: 10261.7. Samples: 428208232. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:02:58,989][27935] Avg episode reward: [(0, '-5.073')] [2022-07-13 07:03:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 214122496. Throughput: 0: 10168.1. Samples: 428265516. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:03,989][27935] Avg episode reward: [(0, '-6.389')] [2022-07-13 07:03:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 214149120. Throughput: 0: 10161.9. Samples: 428296268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:08,989][27935] Avg episode reward: [(0, '-4.633')] [2022-07-13 07:03:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 214174720. Throughput: 0: 10170.3. Samples: 428358472. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:13,990][27935] Avg episode reward: [(0, '-6.202')] [2022-07-13 07:03:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5071.4). Total num frames: 214200320. Throughput: 0: 10181.1. Samples: 428420028. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:18,989][27935] Avg episode reward: [(0, '-6.314')] [2022-07-13 07:03:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 214226944. Throughput: 0: 10178.1. Samples: 428450932. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:23,990][27935] Avg episode reward: [(0, '-7.238')] [2022-07-13 07:03:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5078.3). Total num frames: 214252544. Throughput: 0: 10205.9. Samples: 428512968. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:28,989][27935] Avg episode reward: [(0, '-7.596')] [2022-07-13 07:03:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 214276096. Throughput: 0: 10190.8. Samples: 428573852. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:33,989][27935] Avg episode reward: [(0, '-7.342')] [2022-07-13 07:03:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5078.3). Total num frames: 214303744. Throughput: 0: 10175.6. Samples: 428604580. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:38,989][27935] Avg episode reward: [(0, '-7.517')] [2022-07-13 07:03:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.2, 300 sec: 5078.3). Total num frames: 214329344. Throughput: 0: 10182.2. Samples: 428666432. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:43,989][27935] Avg episode reward: [(0, '-6.696')] [2022-07-13 07:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 214353920. Throughput: 0: 9593.7. Samples: 428697232. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:48,991][27935] Avg episode reward: [(0, '-5.561')] [2022-07-13 07:03:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 214379520. Throughput: 0: 10275.6. Samples: 428758672. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:53,989][27935] Avg episode reward: [(0, '-5.646')] [2022-07-13 07:03:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 214405120. Throughput: 0: 10264.8. Samples: 428820388. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:03:58,990][27935] Avg episode reward: [(0, '-6.092')] [2022-07-13 07:04:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5071.4). Total num frames: 214429696. Throughput: 0: 10175.7. Samples: 428877936. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:03,989][27935] Avg episode reward: [(0, '-8.206')] [2022-07-13 07:04:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5074.9). Total num frames: 214456320. Throughput: 0: 10176.8. Samples: 428908888. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:08,990][27935] Avg episode reward: [(0, '-8.937')] [2022-07-13 07:04:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 214479872. Throughput: 0: 10167.8. Samples: 428970520. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:13,989][27935] Avg episode reward: [(0, '-8.214')] [2022-07-13 07:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5067.9). Total num frames: 214505472. Throughput: 0: 10183.1. Samples: 429032092. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:18,989][27935] Avg episode reward: [(0, '-9.011')] [2022-07-13 07:04:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5078.3). Total num frames: 214532096. Throughput: 0: 10181.2. Samples: 429062732. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:23,989][27935] Avg episode reward: [(0, '-9.218')] [2022-07-13 07:04:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5074.9). Total num frames: 214557696. Throughput: 0: 10170.6. Samples: 429124108. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:28,989][27935] Avg episode reward: [(0, '-7.871')] [2022-07-13 07:04:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5074.9). Total num frames: 214582272. Throughput: 0: 10854.0. Samples: 429185660. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:33,989][27935] Avg episode reward: [(0, '-6.684')] [2022-07-13 07:04:38,996][27935] Fps is (10 sec: 5116.2, 60 sec: 5085.2, 300 sec: 5067.8). Total num frames: 214608896. Throughput: 0: 10179.7. Samples: 429216836. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:38,997][27935] Avg episode reward: [(0, '-5.762')] [2022-07-13 07:04:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 214633472. Throughput: 0: 10193.6. Samples: 429279100. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:43,989][27935] Avg episode reward: [(0, '-5.424')] [2022-07-13 07:04:48,989][27935] Fps is (10 sec: 5226.3, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 214661120. Throughput: 0: 10283.7. Samples: 429340700. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:48,991][27935] Avg episode reward: [(0, '-5.525')] [2022-07-13 07:04:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 214685696. Throughput: 0: 10281.6. Samples: 429371560. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 07:04:53,995][27935] Avg episode reward: [(0, '-4.826')] [2022-07-13 07:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5088.8). Total num frames: 214712320. Throughput: 0: 10290.1. Samples: 429433572. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:04:58,989][27935] Avg episode reward: [(0, '-4.695')] [2022-07-13 07:05:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 214735872. Throughput: 0: 10196.8. Samples: 429490948. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:03,989][27935] Avg episode reward: [(0, '-3.912')] [2022-07-13 07:05:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5088.8). Total num frames: 214762496. Throughput: 0: 10198.0. Samples: 429521644. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:08,990][27935] Avg episode reward: [(0, '-3.998')] [2022-07-13 07:05:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 214786048. Throughput: 0: 10211.9. Samples: 429583644. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:13,989][27935] Avg episode reward: [(0, '-4.936')] [2022-07-13 07:05:18,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5120.0, 300 sec: 5081.8). Total num frames: 214812672. Throughput: 0: 10223.4. Samples: 429645716. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:18,990][27935] Avg episode reward: [(0, '-6.194')] [2022-07-13 07:05:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5120.0, 300 sec: 5088.8). Total num frames: 214839296. Throughput: 0: 10215.6. Samples: 429676460. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:23,989][27935] Avg episode reward: [(0, '-6.989')] [2022-07-13 07:05:28,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 214864896. Throughput: 0: 10197.1. Samples: 429737968. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:28,989][27935] Avg episode reward: [(0, '-7.028')] [2022-07-13 07:05:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5088.8). Total num frames: 214889472. Throughput: 0: 10186.6. Samples: 429799096. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:33,990][27935] Avg episode reward: [(0, '-8.189')] [2022-07-13 07:05:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5103.6, 300 sec: 5085.3). Total num frames: 214915072. Throughput: 0: 10178.8. Samples: 429829608. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:38,990][27935] Avg episode reward: [(0, '-8.917')] [2022-07-13 07:05:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 214940672. Throughput: 0: 10173.9. Samples: 429891396. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:43,990][27935] Avg episode reward: [(0, '-7.580')] [2022-07-13 07:05:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5092.2). Total num frames: 214968320. Throughput: 0: 10274.9. Samples: 429953320. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:48,989][27935] Avg episode reward: [(0, '-6.988')] [2022-07-13 07:05:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 214991872. Throughput: 0: 10282.6. Samples: 429984360. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:53,989][27935] Avg episode reward: [(0, '-6.564')] [2022-07-13 07:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5099.2). Total num frames: 215017472. Throughput: 0: 10234.8. Samples: 430044208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:05:58,989][27935] Avg episode reward: [(0, '-6.262')] [2022-07-13 07:06:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215040000. Throughput: 0: 10111.7. Samples: 430100740. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:03,989][27935] Avg episode reward: [(0, '-5.700')] [2022-07-13 07:06:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5085.3). Total num frames: 215066624. Throughput: 0: 10105.6. Samples: 430131212. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:08,989][27935] Avg episode reward: [(0, '-5.213')] [2022-07-13 07:06:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 215092224. Throughput: 0: 10114.9. Samples: 430193140. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:13,989][27935] Avg episode reward: [(0, '-5.568')] [2022-07-13 07:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 215117824. Throughput: 0: 10111.8. Samples: 430254128. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:18,989][27935] Avg episode reward: [(0, '-5.044')] [2022-07-13 07:06:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5095.7). Total num frames: 215143424. Throughput: 0: 10114.2. Samples: 430284748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:23,989][27935] Avg episode reward: [(0, '-5.859')] [2022-07-13 07:06:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 215169024. Throughput: 0: 10096.4. Samples: 430345736. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:28,989][27935] Avg episode reward: [(0, '-5.730')] [2022-07-13 07:06:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5085.6). Total num frames: 215192576. Throughput: 0: 10079.4. Samples: 430406892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:33,989][27935] Avg episode reward: [(0, '-5.811')] [2022-07-13 07:06:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5092.3). Total num frames: 215220224. Throughput: 0: 10069.4. Samples: 430437484. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:38,989][27935] Avg episode reward: [(0, '-5.262')] [2022-07-13 07:06:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 215244800. Throughput: 0: 10110.1. Samples: 430499160. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:43,989][27935] Avg episode reward: [(0, '-6.192')] [2022-07-13 07:06:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5092.2). Total num frames: 215271424. Throughput: 0: 10219.0. Samples: 430560596. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:48,990][27935] Avg episode reward: [(0, '-6.636')] [2022-07-13 07:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215296000. Throughput: 0: 10228.4. Samples: 430591488. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:53,989][27935] Avg episode reward: [(0, '-6.380')] [2022-07-13 07:06:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5099.2). Total num frames: 215320576. Throughput: 0: 10211.8. Samples: 430652672. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:06:58,989][27935] Avg episode reward: [(0, '-4.603')] [2022-07-13 07:07:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5095.7). Total num frames: 215346176. Throughput: 0: 10131.6. Samples: 430710052. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:07:03,989][27935] Avg episode reward: [(0, '-4.747')] [2022-07-13 07:07:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215370752. Throughput: 0: 10134.2. Samples: 430740788. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 07:07:08,990][27935] Avg episode reward: [(0, '-6.126')] [2022-07-13 07:07:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5095.7). Total num frames: 215397376. Throughput: 0: 10152.3. Samples: 430802588. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:13,992][27935] Avg episode reward: [(0, '-5.111')] [2022-07-13 07:07:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215421952. Throughput: 0: 10157.6. Samples: 430863984. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:18,989][27935] Avg episode reward: [(0, '-5.048')] [2022-07-13 07:07:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5099.2). Total num frames: 215449600. Throughput: 0: 10164.0. Samples: 430894864. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:23,989][27935] Avg episode reward: [(0, '-5.463')] [2022-07-13 07:07:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5092.2). Total num frames: 215473152. Throughput: 0: 10170.4. Samples: 430956828. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:28,989][27935] Avg episode reward: [(0, '-5.104')] [2022-07-13 07:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5092.2). Total num frames: 215499776. Throughput: 0: 10164.9. Samples: 431018016. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:33,989][27935] Avg episode reward: [(0, '-5.514')] [2022-07-13 07:07:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5095.7). Total num frames: 215525376. Throughput: 0: 10158.0. Samples: 431048600. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:38,989][27935] Avg episode reward: [(0, '-4.674')] [2022-07-13 07:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 215550976. Throughput: 0: 10153.2. Samples: 431109564. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:43,989][27935] Avg episode reward: [(0, '-4.006')] [2022-07-13 07:07:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215575552. Throughput: 0: 10248.6. Samples: 431171240. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:48,989][27935] Avg episode reward: [(0, '-4.782')] [2022-07-13 07:07:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5088.8). Total num frames: 215602176. Throughput: 0: 10235.7. Samples: 431201396. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:53,989][27935] Avg episode reward: [(0, '-4.022')] [2022-07-13 07:07:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5099.2). Total num frames: 215626752. Throughput: 0: 10234.5. Samples: 431263140. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:07:58,989][27935] Avg episode reward: [(0, '-4.616')] [2022-07-13 07:08:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 215651328. Throughput: 0: 10142.8. Samples: 431320408. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:03,989][27935] Avg episode reward: [(0, '-6.127')] [2022-07-13 07:08:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 215676928. Throughput: 0: 10143.4. Samples: 431351316. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:08,989][27935] Avg episode reward: [(0, '-6.763')] [2022-07-13 07:08:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215701504. Throughput: 0: 10131.5. Samples: 431412748. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:13,989][27935] Avg episode reward: [(0, '-8.742')] [2022-07-13 07:08:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 215727104. Throughput: 0: 10128.1. Samples: 431473780. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:18,989][27935] Avg episode reward: [(0, '-8.609')] [2022-07-13 07:08:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215753728. Throughput: 0: 10127.4. Samples: 431504332. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:23,989][27935] Avg episode reward: [(0, '-8.134')] [2022-07-13 07:08:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215777280. Throughput: 0: 10134.6. Samples: 431565620. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:28,991][27935] Avg episode reward: [(0, '-9.098')] [2022-07-13 07:08:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 215802880. Throughput: 0: 10132.6. Samples: 431627204. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:33,989][27935] Avg episode reward: [(0, '-7.399')] [2022-07-13 07:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 215828480. Throughput: 0: 10144.7. Samples: 431657908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:38,989][27935] Avg episode reward: [(0, '-6.870')] [2022-07-13 07:08:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215855104. Throughput: 0: 10142.2. Samples: 431719540. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:43,989][27935] Avg episode reward: [(0, '-4.998')] [2022-07-13 07:08:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5092.2). Total num frames: 215881728. Throughput: 0: 10226.4. Samples: 431780596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:48,989][27935] Avg episode reward: [(0, '-6.325')] [2022-07-13 07:08:53,996][27935] Fps is (10 sec: 5013.9, 60 sec: 5051.1, 300 sec: 5085.2). Total num frames: 215905280. Throughput: 0: 10221.6. Samples: 431811364. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:53,997][27935] Avg episode reward: [(0, '-7.735')] [2022-07-13 07:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 215931904. Throughput: 0: 10218.2. Samples: 431872568. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:08:58,989][27935] Avg episode reward: [(0, '-7.298')] [2022-07-13 07:09:03,989][27935] Fps is (10 sec: 4918.9, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 215954432. Throughput: 0: 10121.4. Samples: 431929244. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:09:03,989][27935] Avg episode reward: [(0, '-6.281')] [2022-07-13 07:09:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 215981056. Throughput: 0: 10116.2. Samples: 431959560. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:09:08,989][27935] Avg episode reward: [(0, '-5.549')] [2022-07-13 07:09:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5085.3). Total num frames: 216005632. Throughput: 0: 10106.0. Samples: 432020392. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:09:13,989][27935] Avg episode reward: [(0, '-4.956')] [2022-07-13 07:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 216030208. Throughput: 0: 10101.1. Samples: 432081752. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:09:18,989][27935] Avg episode reward: [(0, '-4.596')] [2022-07-13 07:09:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 216056832. Throughput: 0: 10092.4. Samples: 432112064. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 07:09:23,989][27935] Avg episode reward: [(0, '-2.353')] [2022-07-13 07:09:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5085.3). Total num frames: 216082432. Throughput: 0: 10084.9. Samples: 432173360. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:28,989][27935] Avg episode reward: [(0, '-2.635')] [2022-07-13 07:09:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5081.9). Total num frames: 216108032. Throughput: 0: 10076.3. Samples: 432234028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:33,989][27935] Avg episode reward: [(0, '-4.514')] [2022-07-13 07:09:38,990][27935] Fps is (10 sec: 5119.6, 60 sec: 5085.8, 300 sec: 5085.3). Total num frames: 216133632. Throughput: 0: 10069.6. Samples: 432264428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:38,990][27935] Avg episode reward: [(0, '-7.129')] [2022-07-13 07:09:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 216159232. Throughput: 0: 10076.3. Samples: 432326000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:43,989][27935] Avg episode reward: [(0, '-7.202')] [2022-07-13 07:09:48,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 216184832. Throughput: 0: 10177.1. Samples: 432387212. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:48,989][27935] Avg episode reward: [(0, '-6.814')] [2022-07-13 07:09:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5069.4, 300 sec: 5074.9). Total num frames: 216209408. Throughput: 0: 10179.6. Samples: 432417644. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:53,991][27935] Avg episode reward: [(0, '-6.415')] [2022-07-13 07:09:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 216235008. Throughput: 0: 10193.1. Samples: 432479080. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:09:58,989][27935] Avg episode reward: [(0, '-5.655')] [2022-07-13 07:10:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 216258560. Throughput: 0: 10106.7. Samples: 432536556. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:03,991][27935] Avg episode reward: [(0, '-5.080')] [2022-07-13 07:10:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 216284160. Throughput: 0: 10111.2. Samples: 432567068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:08,990][27935] Avg episode reward: [(0, '-5.067')] [2022-07-13 07:10:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 216307712. Throughput: 0: 10082.4. Samples: 432627068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:13,989][27935] Avg episode reward: [(0, '-4.554')] [2022-07-13 07:10:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5067.9). Total num frames: 216334336. Throughput: 0: 10065.5. Samples: 432686976. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:18,989][27935] Avg episode reward: [(0, '-4.401')] [2022-07-13 07:10:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5064.5). Total num frames: 216358912. Throughput: 0: 10073.2. Samples: 432717716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:23,990][27935] Avg episode reward: [(0, '-4.309')] [2022-07-13 07:10:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5067.9). Total num frames: 216384512. Throughput: 0: 10053.7. Samples: 432778416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:28,991][27935] Avg episode reward: [(0, '-5.143')] [2022-07-13 07:10:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5061.0). Total num frames: 216408064. Throughput: 0: 10010.6. Samples: 432837692. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:33,990][27935] Avg episode reward: [(0, '-5.393')] [2022-07-13 07:10:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.6, 300 sec: 5061.0). Total num frames: 216433664. Throughput: 0: 9963.6. Samples: 432866004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:38,991][27935] Avg episode reward: [(0, '-4.505')] [2022-07-13 07:10:43,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4983.5, 300 sec: 5050.6). Total num frames: 216458240. Throughput: 0: 9949.6. Samples: 432926812. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:43,989][27935] Avg episode reward: [(0, '-3.888')] [2022-07-13 07:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5057.5). Total num frames: 216483840. Throughput: 0: 10024.0. Samples: 432987636. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:48,990][27935] Avg episode reward: [(0, '-4.474')] [2022-07-13 07:10:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5054.0). Total num frames: 216508416. Throughput: 0: 10025.6. Samples: 433018220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:53,989][27935] Avg episode reward: [(0, '-4.850')] [2022-07-13 07:10:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5067.9). Total num frames: 216535040. Throughput: 0: 10032.5. Samples: 433078528. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:10:58,989][27935] Avg episode reward: [(0, '-4.039')] [2022-07-13 07:11:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 5050.6). Total num frames: 216556544. Throughput: 0: 9894.5. Samples: 433132228. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:03,989][27935] Avg episode reward: [(0, '-3.451')] [2022-07-13 07:11:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4932.3, 300 sec: 5043.6). Total num frames: 216580096. Throughput: 0: 9857.3. Samples: 433161296. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:08,992][27935] Avg episode reward: [(0, '-4.136')] [2022-07-13 07:11:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5043.6). Total num frames: 216605696. Throughput: 0: 9823.4. Samples: 433220472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:13,989][27935] Avg episode reward: [(0, '-4.263')] [2022-07-13 07:11:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 5040.2). Total num frames: 216630272. Throughput: 0: 9833.9. Samples: 433280216. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:18,989][27935] Avg episode reward: [(0, '-5.385')] [2022-07-13 07:11:23,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4949.3, 300 sec: 5040.2). Total num frames: 216655872. Throughput: 0: 9858.0. Samples: 433309616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:23,990][27935] Avg episode reward: [(0, '-3.817')] [2022-07-13 07:11:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 5043.6). Total num frames: 216680448. Throughput: 0: 9797.9. Samples: 433367716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:28,989][27935] Avg episode reward: [(0, '-4.141')] [2022-07-13 07:11:33,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4898.1, 300 sec: 5022.8). Total num frames: 216701952. Throughput: 0: 9732.2. Samples: 433425588. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:33,989][27935] Avg episode reward: [(0, '-3.449')] [2022-07-13 07:11:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 5022.8). Total num frames: 216726528. Throughput: 0: 9696.2. Samples: 433454548. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:11:38,989][27935] Avg episode reward: [(0, '-3.765')] [2022-07-13 07:11:44,000][27935] Fps is (10 sec: 4909.9, 60 sec: 4880.2, 300 sec: 5015.7). Total num frames: 216751104. Throughput: 0: 9669.0. Samples: 433513736. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:11:44,000][27935] Avg episode reward: [(0, '-3.985')] [2022-07-13 07:11:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 5022.8). Total num frames: 216777728. Throughput: 0: 9803.6. Samples: 433573388. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:11:48,989][27935] Avg episode reward: [(0, '-4.124')] [2022-07-13 07:11:53,989][27935] Fps is (10 sec: 5023.0, 60 sec: 4881.1, 300 sec: 5019.3). Total num frames: 216801280. Throughput: 0: 9809.6. Samples: 433602728. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:11:53,989][27935] Avg episode reward: [(0, '-4.197')] [2022-07-13 07:11:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 5012.4). Total num frames: 216824832. Throughput: 0: 9812.9. Samples: 433662052. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:11:58,989][27935] Avg episode reward: [(0, '-4.814')] [2022-07-13 07:12:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 5005.5). Total num frames: 216847360. Throughput: 0: 9669.3. Samples: 433715336. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:03,989][27935] Avg episode reward: [(0, '-5.411')] [2022-07-13 07:12:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 5005.5). Total num frames: 216873984. Throughput: 0: 9668.9. Samples: 433744712. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:08,989][27935] Avg episode reward: [(0, '-6.088')] [2022-07-13 07:12:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4998.5). Total num frames: 216896512. Throughput: 0: 9700.8. Samples: 433804252. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:13,991][27935] Avg episode reward: [(0, '-6.284')] [2022-07-13 07:12:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4991.6). Total num frames: 216922112. Throughput: 0: 9718.9. Samples: 433862936. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:18,989][27935] Avg episode reward: [(0, '-5.989')] [2022-07-13 07:12:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4991.6). Total num frames: 216945664. Throughput: 0: 9718.7. Samples: 433891888. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:23,989][27935] Avg episode reward: [(0, '-4.482')] [2022-07-13 07:12:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4974.2). Total num frames: 216967168. Throughput: 0: 9595.8. Samples: 433945444. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:28,989][27935] Avg episode reward: [(0, '-4.551')] [2022-07-13 07:12:33,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4795.7, 300 sec: 4963.8). Total num frames: 216989696. Throughput: 0: 9465.3. Samples: 433999328. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:33,990][27935] Avg episode reward: [(0, '-3.849')] [2022-07-13 07:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4963.8). Total num frames: 217015296. Throughput: 0: 9470.0. Samples: 434028876. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:38,989][27935] Avg episode reward: [(0, '-3.449')] [2022-07-13 07:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4779.5, 300 sec: 4956.9). Total num frames: 217037824. Throughput: 0: 9464.2. Samples: 434087940. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:43,990][27935] Avg episode reward: [(0, '-3.265')] [2022-07-13 07:12:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4949.9). Total num frames: 217062400. Throughput: 0: 9558.8. Samples: 434145480. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:48,989][27935] Avg episode reward: [(0, '-3.298')] [2022-07-13 07:12:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4953.4). Total num frames: 217088000. Throughput: 0: 9538.6. Samples: 434173948. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:53,989][27935] Avg episode reward: [(0, '-3.071')] [2022-07-13 07:12:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4943.0). Total num frames: 217109504. Throughput: 0: 9495.5. Samples: 434231548. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:12:58,989][27935] Avg episode reward: [(0, '-4.631')] [2022-07-13 07:13:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4936.0). Total num frames: 217133056. Throughput: 0: 9394.5. Samples: 434285688. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:03,989][27935] Avg episode reward: [(0, '-4.811')] [2022-07-13 07:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4936.0). Total num frames: 217157632. Throughput: 0: 9394.4. Samples: 434314636. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:08,989][27935] Avg episode reward: [(0, '-5.987')] [2022-07-13 07:13:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4727.5, 300 sec: 4925.6). Total num frames: 217180160. Throughput: 0: 9490.8. Samples: 434372532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:13,989][27935] Avg episode reward: [(0, '-6.903')] [2022-07-13 07:13:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4925.6). Total num frames: 217206784. Throughput: 0: 8966.0. Samples: 434402800. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:18,993][27935] Avg episode reward: [(0, '-6.884')] [2022-07-13 07:13:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4744.5, 300 sec: 4925.6). Total num frames: 217230336. Throughput: 0: 9633.9. Samples: 434462400. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:23,989][27935] Avg episode reward: [(0, '-6.782')] [2022-07-13 07:13:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4929.1). Total num frames: 217256960. Throughput: 0: 9658.0. Samples: 434522552. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:28,989][27935] Avg episode reward: [(0, '-6.243')] [2022-07-13 07:13:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4922.1). Total num frames: 217280512. Throughput: 0: 9702.2. Samples: 434582080. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:33,989][27935] Avg episode reward: [(0, '-6.539')] [2022-07-13 07:13:38,992][27935] Fps is (10 sec: 4606.4, 60 sec: 4795.4, 300 sec: 4908.2). Total num frames: 217303040. Throughput: 0: 9690.1. Samples: 434610036. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:38,993][27935] Avg episode reward: [(0, '-6.938')] [2022-07-13 07:13:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4901.3). Total num frames: 217327616. Throughput: 0: 9644.1. Samples: 434665532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:43,989][27935] Avg episode reward: [(0, '-5.969')] [2022-07-13 07:13:48,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4812.8, 300 sec: 4901.4). Total num frames: 217351168. Throughput: 0: 9680.4. Samples: 434721308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:48,996][27935] Avg episode reward: [(0, '-5.642')] [2022-07-13 07:13:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4890.9). Total num frames: 217374720. Throughput: 0: 9663.8. Samples: 434749508. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 07:13:53,989][27935] Avg episode reward: [(0, '-6.077')] [2022-07-13 07:13:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4890.9). Total num frames: 217397248. Throughput: 0: 9623.9. Samples: 434805608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:13:58,989][27935] Avg episode reward: [(0, '-8.085')] [2022-07-13 07:14:03,990][27935] Fps is (10 sec: 4505.1, 60 sec: 4778.6, 300 sec: 4877.0). Total num frames: 217419776. Throughput: 0: 10117.5. Samples: 434858100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:03,990][27935] Avg episode reward: [(0, '-7.334')] [2022-07-13 07:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4877.0). Total num frames: 217444352. Throughput: 0: 9436.1. Samples: 434887024. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:08,989][27935] Avg episode reward: [(0, '-6.429')] [2022-07-13 07:14:13,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4778.7, 300 sec: 4870.1). Total num frames: 217466880. Throughput: 0: 9364.3. Samples: 434943944. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:13,989][27935] Avg episode reward: [(0, '-7.287')] [2022-07-13 07:14:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4859.7). Total num frames: 217490432. Throughput: 0: 9305.7. Samples: 435000836. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:18,989][27935] Avg episode reward: [(0, '-7.225')] [2022-07-13 07:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4856.2). Total num frames: 217515008. Throughput: 0: 9322.0. Samples: 435029492. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:23,989][27935] Avg episode reward: [(0, '-5.916')] [2022-07-13 07:14:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4849.2). Total num frames: 217538560. Throughput: 0: 9389.0. Samples: 435088036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:28,989][27935] Avg episode reward: [(0, '-5.082')] [2022-07-13 07:14:34,001][27935] Fps is (10 sec: 4909.2, 60 sec: 4726.5, 300 sec: 4849.1). Total num frames: 217564160. Throughput: 0: 9425.7. Samples: 435145580. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:34,003][27935] Avg episode reward: [(0, '-7.060')] [2022-07-13 07:14:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.8, 300 sec: 4842.3). Total num frames: 217587712. Throughput: 0: 9469.4. Samples: 435175632. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:38,989][27935] Avg episode reward: [(0, '-8.804')] [2022-07-13 07:14:43,989][27935] Fps is (10 sec: 4818.7, 60 sec: 4744.5, 300 sec: 4838.8). Total num frames: 217612288. Throughput: 0: 9532.9. Samples: 435234588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:43,989][27935] Avg episode reward: [(0, '-7.995')] [2022-07-13 07:14:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4835.4). Total num frames: 217635840. Throughput: 0: 9623.7. Samples: 435291156. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:48,989][27935] Avg episode reward: [(0, '-8.282')] [2022-07-13 07:14:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4828.4). Total num frames: 217659392. Throughput: 0: 9613.8. Samples: 435319644. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:53,990][27935] Avg episode reward: [(0, '-7.539')] [2022-07-13 07:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 217683968. Throughput: 0: 9631.6. Samples: 435377368. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:14:58,989][27935] Avg episode reward: [(0, '-7.866')] [2022-07-13 07:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.7, 300 sec: 4818.0). Total num frames: 217705472. Throughput: 0: 9563.4. Samples: 435431188. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:03,989][27935] Avg episode reward: [(0, '-8.260')] [2022-07-13 07:15:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4821.5). Total num frames: 217730048. Throughput: 0: 9570.6. Samples: 435460168. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:08,989][27935] Avg episode reward: [(0, '-5.782')] [2022-07-13 07:15:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 217754624. Throughput: 0: 9588.8. Samples: 435519532. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:13,989][27935] Avg episode reward: [(0, '-5.174')] [2022-07-13 07:15:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 217780224. Throughput: 0: 9636.5. Samples: 435579104. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:18,989][27935] Avg episode reward: [(0, '-5.066')] [2022-07-13 07:15:23,991][27935] Fps is (10 sec: 5016.6, 60 sec: 4829.7, 300 sec: 4814.5). Total num frames: 217804800. Throughput: 0: 9636.2. Samples: 435609280. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:23,991][27935] Avg episode reward: [(0, '-5.832')] [2022-07-13 07:15:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4898.1, 300 sec: 4828.4). Total num frames: 217832448. Throughput: 0: 9703.6. Samples: 435671252. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:28,989][27935] Avg episode reward: [(0, '-6.513')] [2022-07-13 07:15:33,989][27935] Fps is (10 sec: 5018.6, 60 sec: 4847.9, 300 sec: 4818.0). Total num frames: 217854976. Throughput: 0: 9772.4. Samples: 435730912. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:33,989][27935] Avg episode reward: [(0, '-6.658')] [2022-07-13 07:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4824.9). Total num frames: 217881600. Throughput: 0: 9775.3. Samples: 435759532. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:38,989][27935] Avg episode reward: [(0, '-5.283')] [2022-07-13 07:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 217904128. Throughput: 0: 9793.6. Samples: 435818080. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:43,990][27935] Avg episode reward: [(0, '-6.284')] [2022-07-13 07:15:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4818.0). Total num frames: 217929728. Throughput: 0: 9915.6. Samples: 435877388. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:48,991][27935] Avg episode reward: [(0, '-7.403')] [2022-07-13 07:15:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4807.6). Total num frames: 217953280. Throughput: 0: 9924.7. Samples: 435906780. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:53,989][27935] Avg episode reward: [(0, '-6.783')] [2022-07-13 07:15:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4824.9). Total num frames: 217979904. Throughput: 0: 9985.2. Samples: 435968868. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:15:58,990][27935] Avg episode reward: [(0, '-7.667')] [2022-07-13 07:16:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4821.5). Total num frames: 218002432. Throughput: 0: 9922.0. Samples: 436025596. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:16:03,989][27935] Avg episode reward: [(0, '-8.340')] [2022-07-13 07:16:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 4821.5). Total num frames: 218028032. Throughput: 0: 9907.1. Samples: 436055080. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 07:16:08,990][27935] Avg episode reward: [(0, '-8.830')] [2022-07-13 07:16:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 4821.5). Total num frames: 218052608. Throughput: 0: 9845.7. Samples: 436114308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:13,990][27935] Avg episode reward: [(0, '-10.178')] [2022-07-13 07:16:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 4818.0). Total num frames: 218077184. Throughput: 0: 9837.6. Samples: 436173604. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:18,989][27935] Avg episode reward: [(0, '-10.134')] [2022-07-13 07:16:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.5, 300 sec: 4818.0). Total num frames: 218101760. Throughput: 0: 9841.9. Samples: 436202420. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:23,989][27935] Avg episode reward: [(0, '-11.870')] [2022-07-13 07:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4825.0). Total num frames: 218125312. Throughput: 0: 9862.1. Samples: 436261876. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:28,990][27935] Avg episode reward: [(0, '-10.530')] [2022-07-13 07:16:33,997][27935] Fps is (10 sec: 4706.7, 60 sec: 4897.5, 300 sec: 4821.4). Total num frames: 218148864. Throughput: 0: 9823.8. Samples: 436319536. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:33,997][27935] Avg episode reward: [(0, '-8.473')] [2022-07-13 07:16:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4825.1). Total num frames: 218174464. Throughput: 0: 9819.0. Samples: 436348636. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:38,989][27935] Avg episode reward: [(0, '-8.287')] [2022-07-13 07:16:43,989][27935] Fps is (10 sec: 5021.5, 60 sec: 4915.2, 300 sec: 4818.0). Total num frames: 218199040. Throughput: 0: 9744.4. Samples: 436407364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:43,989][27935] Avg episode reward: [(0, '-8.506')] [2022-07-13 07:16:48,999][27935] Fps is (10 sec: 5012.6, 60 sec: 4914.4, 300 sec: 4824.8). Total num frames: 218224640. Throughput: 0: 9854.7. Samples: 436469156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:48,999][27935] Avg episode reward: [(0, '-7.182')] [2022-07-13 07:16:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4828.4). Total num frames: 218249216. Throughput: 0: 9859.4. Samples: 436498752. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:53,989][27935] Avg episode reward: [(0, '-6.648')] [2022-07-13 07:16:58,989][27935] Fps is (10 sec: 4920.1, 60 sec: 4898.1, 300 sec: 4835.4). Total num frames: 218273792. Throughput: 0: 9839.7. Samples: 436557092. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:16:58,989][27935] Avg episode reward: [(0, '-4.933')] [2022-07-13 07:17:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4821.5). Total num frames: 218296320. Throughput: 0: 9748.6. Samples: 436612292. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:03,989][27935] Avg episode reward: [(0, '-4.645')] [2022-07-13 07:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 218319872. Throughput: 0: 9759.6. Samples: 436641600. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:08,989][27935] Avg episode reward: [(0, '-6.865')] [2022-07-13 07:17:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4898.1, 300 sec: 4828.4). Total num frames: 218346496. Throughput: 0: 9790.0. Samples: 436702428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:13,991][27935] Avg episode reward: [(0, '-7.327')] [2022-07-13 07:17:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4831.9). Total num frames: 218371072. Throughput: 0: 9812.7. Samples: 436761032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:18,990][27935] Avg episode reward: [(0, '-7.093')] [2022-07-13 07:17:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 218395648. Throughput: 0: 9805.4. Samples: 436789880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:23,989][27935] Avg episode reward: [(0, '-6.475')] [2022-07-13 07:17:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 218419200. Throughput: 0: 9782.4. Samples: 436847572. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:28,989][27935] Avg episode reward: [(0, '-6.460')] [2022-07-13 07:17:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.8, 300 sec: 4842.3). Total num frames: 218443776. Throughput: 0: 9693.9. Samples: 436905284. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:33,989][27935] Avg episode reward: [(0, '-6.006')] [2022-07-13 07:17:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 218466304. Throughput: 0: 9676.2. Samples: 436934180. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:38,989][27935] Avg episode reward: [(0, '-5.260')] [2022-07-13 07:17:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 218489856. Throughput: 0: 9649.1. Samples: 436991300. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:43,989][27935] Avg episode reward: [(0, '-4.584')] [2022-07-13 07:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.7, 300 sec: 4838.8). Total num frames: 218515456. Throughput: 0: 9717.6. Samples: 437049584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:48,989][27935] Avg episode reward: [(0, '-5.802')] [2022-07-13 07:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 218539008. Throughput: 0: 9724.5. Samples: 437079204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:53,991][27935] Avg episode reward: [(0, '-6.240')] [2022-07-13 07:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 218564608. Throughput: 0: 9657.4. Samples: 437137012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:17:58,989][27935] Avg episode reward: [(0, '-7.706')] [2022-07-13 07:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 218586112. Throughput: 0: 9568.9. Samples: 437191632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:18:03,991][27935] Avg episode reward: [(0, '-7.718')] [2022-07-13 07:18:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 218609664. Throughput: 0: 9570.2. Samples: 437220540. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:18:08,989][27935] Avg episode reward: [(0, '-9.116')] [2022-07-13 07:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 218634240. Throughput: 0: 9571.1. Samples: 437278272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:18:13,990][27935] Avg episode reward: [(0, '-8.831')] [2022-07-13 07:18:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 218658816. Throughput: 0: 9571.5. Samples: 437336000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:18:18,989][27935] Avg episode reward: [(0, '-9.129')] [2022-07-13 07:18:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 218683392. Throughput: 0: 9595.1. Samples: 437365960. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 07:18:23,989][27935] Avg episode reward: [(0, '-8.822')] [2022-07-13 07:18:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 218708992. Throughput: 0: 9702.9. Samples: 437427932. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:28,991][27935] Avg episode reward: [(0, '-7.918')] [2022-07-13 07:18:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 218735616. Throughput: 0: 9785.8. Samples: 437489944. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:33,990][27935] Avg episode reward: [(0, '-7.486')] [2022-07-13 07:18:38,989][27935] Fps is (10 sec: 5222.2, 60 sec: 4915.2, 300 sec: 4859.7). Total num frames: 218761216. Throughput: 0: 9821.9. Samples: 437521192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:38,991][27935] Avg episode reward: [(0, '-7.437')] [2022-07-13 07:18:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 4870.1). Total num frames: 218787840. Throughput: 0: 9933.9. Samples: 437584036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:43,989][27935] Avg episode reward: [(0, '-6.614')] [2022-07-13 07:18:48,989][27935] Fps is (10 sec: 5325.0, 60 sec: 4983.5, 300 sec: 4880.5). Total num frames: 218814464. Throughput: 0: 10121.2. Samples: 437647084. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:48,989][27935] Avg episode reward: [(0, '-5.222')] [2022-07-13 07:18:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5034.7, 300 sec: 4894.4). Total num frames: 218841088. Throughput: 0: 10191.7. Samples: 437679164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:53,995][27935] Avg episode reward: [(0, '-4.500')] [2022-07-13 07:18:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 4908.3). Total num frames: 218867712. Throughput: 0: 10310.8. Samples: 437742256. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:18:58,989][27935] Avg episode reward: [(0, '-5.658')] [2022-07-13 07:19:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 4901.3). Total num frames: 218890240. Throughput: 0: 10354.0. Samples: 437801928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:03,989][27935] Avg episode reward: [(0, '-4.922')] [2022-07-13 07:19:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 4922.1). Total num frames: 218918912. Throughput: 0: 10392.3. Samples: 437833612. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:08,989][27935] Avg episode reward: [(0, '-5.192')] [2022-07-13 07:19:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 4925.6). Total num frames: 218943488. Throughput: 0: 10423.8. Samples: 437897004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:13,989][27935] Avg episode reward: [(0, '-4.442')] [2022-07-13 07:19:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4936.0). Total num frames: 218971136. Throughput: 0: 10455.6. Samples: 437960444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:18,989][27935] Avg episode reward: [(0, '-5.234')] [2022-07-13 07:19:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 4946.4). Total num frames: 218997760. Throughput: 0: 10468.1. Samples: 437992252. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:23,989][27935] Avg episode reward: [(0, '-5.952')] [2022-07-13 07:19:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4946.6). Total num frames: 219023360. Throughput: 0: 10473.8. Samples: 438055356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:28,989][27935] Avg episode reward: [(0, '-6.144')] [2022-07-13 07:19:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4956.9). Total num frames: 219049984. Throughput: 0: 10474.9. Samples: 438118456. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:33,989][27935] Avg episode reward: [(0, '-7.119')] [2022-07-13 07:19:39,001][27935] Fps is (10 sec: 5216.3, 60 sec: 5238.5, 300 sec: 4960.1). Total num frames: 219075584. Throughput: 0: 10462.8. Samples: 438150112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:39,001][27935] Avg episode reward: [(0, '-6.830')] [2022-07-13 07:19:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4970.7). Total num frames: 219102208. Throughput: 0: 10466.1. Samples: 438213228. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:43,989][27935] Avg episode reward: [(0, '-8.345')] [2022-07-13 07:19:48,989][27935] Fps is (10 sec: 5331.1, 60 sec: 5239.5, 300 sec: 4981.2). Total num frames: 219128832. Throughput: 0: 10538.0. Samples: 438276136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:48,989][27935] Avg episode reward: [(0, '-8.597')] [2022-07-13 07:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4984.6). Total num frames: 219154432. Throughput: 0: 10532.7. Samples: 438307584. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:53,989][27935] Avg episode reward: [(0, '-7.179')] [2022-07-13 07:19:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5002.0). Total num frames: 219181056. Throughput: 0: 10527.3. Samples: 438370732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:19:58,989][27935] Avg episode reward: [(0, '-6.854')] [2022-07-13 07:20:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 4998.5). Total num frames: 219204608. Throughput: 0: 10435.8. Samples: 438430056. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:03,989][27935] Avg episode reward: [(0, '-6.193')] [2022-07-13 07:20:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5008.9). Total num frames: 219232256. Throughput: 0: 10441.6. Samples: 438462124. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:08,990][27935] Avg episode reward: [(0, '-7.469')] [2022-07-13 07:20:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5008.9). Total num frames: 219257856. Throughput: 0: 10398.9. Samples: 438523304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:13,989][27935] Avg episode reward: [(0, '-6.947')] [2022-07-13 07:20:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5009.0). Total num frames: 219282432. Throughput: 0: 10362.9. Samples: 438584784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:18,989][27935] Avg episode reward: [(0, '-6.796')] [2022-07-13 07:20:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 4998.5). Total num frames: 219307008. Throughput: 0: 10321.2. Samples: 438614444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:23,990][27935] Avg episode reward: [(0, '-6.434')] [2022-07-13 07:20:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5008.9). Total num frames: 219332608. Throughput: 0: 10268.4. Samples: 438675308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:28,989][27935] Avg episode reward: [(0, '-8.006')] [2022-07-13 07:20:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5002.0). Total num frames: 219357184. Throughput: 0: 10170.8. Samples: 438733820. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:33,990][27935] Avg episode reward: [(0, '-9.098')] [2022-07-13 07:20:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5086.9, 300 sec: 5005.5). Total num frames: 219380736. Throughput: 0: 10111.4. Samples: 438762596. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:20:38,989][27935] Avg episode reward: [(0, '-8.894')] [2022-07-13 07:20:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5002.0). Total num frames: 219405312. Throughput: 0: 10004.3. Samples: 438820924. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:20:43,989][27935] Avg episode reward: [(0, '-7.448')] [2022-07-13 07:20:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5005.5). Total num frames: 219429888. Throughput: 0: 9970.1. Samples: 438878712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:20:48,991][27935] Avg episode reward: [(0, '-7.767')] [2022-07-13 07:20:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4983.5, 300 sec: 4995.0). Total num frames: 219453440. Throughput: 0: 9906.8. Samples: 438907932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:20:53,990][27935] Avg episode reward: [(0, '-7.991')] [2022-07-13 07:20:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5005.5). Total num frames: 219479040. Throughput: 0: 9841.4. Samples: 438966168. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:20:58,989][27935] Avg episode reward: [(0, '-7.186')] [2022-07-13 07:21:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4915.2, 300 sec: 4988.1). Total num frames: 219499520. Throughput: 0: 9677.9. Samples: 439020292. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:03,989][27935] Avg episode reward: [(0, '-5.688')] [2022-07-13 07:21:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4991.6). Total num frames: 219525120. Throughput: 0: 9669.5. Samples: 439049572. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:08,989][27935] Avg episode reward: [(0, '-4.755')] [2022-07-13 07:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4991.6). Total num frames: 219549696. Throughput: 0: 9650.9. Samples: 439109600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:13,989][27935] Avg episode reward: [(0, '-4.771')] [2022-07-13 07:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4998.5). Total num frames: 219576320. Throughput: 0: 9706.9. Samples: 439170628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:18,989][27935] Avg episode reward: [(0, '-5.539')] [2022-07-13 07:21:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4998.5). Total num frames: 219599872. Throughput: 0: 9743.3. Samples: 439201044. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:23,990][27935] Avg episode reward: [(0, '-5.192')] [2022-07-13 07:21:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 5012.5). Total num frames: 219627520. Throughput: 0: 9822.9. Samples: 439262956. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:28,991][27935] Avg episode reward: [(0, '-4.677')] [2022-07-13 07:21:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 5005.5). Total num frames: 219651072. Throughput: 0: 9899.2. Samples: 439324176. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:33,991][27935] Avg episode reward: [(0, '-3.832')] [2022-07-13 07:21:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 5012.4). Total num frames: 219677696. Throughput: 0: 9911.0. Samples: 439353928. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:38,989][27935] Avg episode reward: [(0, '-3.999')] [2022-07-13 07:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5002.1). Total num frames: 219700224. Throughput: 0: 9904.5. Samples: 439411872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:43,989][27935] Avg episode reward: [(0, '-3.818')] [2022-07-13 07:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 5005.4). Total num frames: 219725824. Throughput: 0: 10010.0. Samples: 439470744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:48,990][27935] Avg episode reward: [(0, '-4.172')] [2022-07-13 07:21:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 5005.5). Total num frames: 219750400. Throughput: 0: 10000.1. Samples: 439499576. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:53,989][27935] Avg episode reward: [(0, '-4.849')] [2022-07-13 07:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 5008.9). Total num frames: 219773952. Throughput: 0: 9977.9. Samples: 439558604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:21:58,989][27935] Avg episode reward: [(0, '-4.375')] [2022-07-13 07:22:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4949.3, 300 sec: 5005.5). Total num frames: 219796480. Throughput: 0: 9833.2. Samples: 439613120. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:03,989][27935] Avg episode reward: [(0, '-4.908')] [2022-07-13 07:22:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4915.2, 300 sec: 4995.0). Total num frames: 219820032. Throughput: 0: 9807.9. Samples: 439642400. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:08,992][27935] Avg episode reward: [(0, '-6.874')] [2022-07-13 07:22:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4998.5). Total num frames: 219845632. Throughput: 0: 9760.6. Samples: 439702184. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:13,989][27935] Avg episode reward: [(0, '-8.252')] [2022-07-13 07:22:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4998.5). Total num frames: 219870208. Throughput: 0: 9701.3. Samples: 439760736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:18,989][27935] Avg episode reward: [(0, '-8.288')] [2022-07-13 07:22:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5008.9). Total num frames: 219896832. Throughput: 0: 9708.5. Samples: 439790812. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:23,989][27935] Avg episode reward: [(0, '-7.226')] [2022-07-13 07:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 5002.0). Total num frames: 219919360. Throughput: 0: 9779.4. Samples: 439851944. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:28,989][27935] Avg episode reward: [(0, '-7.062')] [2022-07-13 07:22:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 5019.3). Total num frames: 219947008. Throughput: 0: 9783.6. Samples: 439911004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:33,989][27935] Avg episode reward: [(0, '-8.568')] [2022-07-13 07:22:38,996][27935] Fps is (10 sec: 5218.5, 60 sec: 4897.5, 300 sec: 5022.7). Total num frames: 219971584. Throughput: 0: 9826.2. Samples: 439941828. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:38,997][27935] Avg episode reward: [(0, '-7.375')] [2022-07-13 07:22:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4949.3, 300 sec: 5022.8). Total num frames: 219997184. Throughput: 0: 9857.5. Samples: 440002192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:43,989][27935] Avg episode reward: [(0, '-6.600')] [2022-07-13 07:22:48,989][27935] Fps is (10 sec: 5021.4, 60 sec: 4932.3, 300 sec: 5026.3). Total num frames: 220021760. Throughput: 0: 9991.1. Samples: 440062720. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:48,989][27935] Avg episode reward: [(0, '-8.602')] [2022-07-13 07:22:53,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4932.2, 300 sec: 5022.8). Total num frames: 220046336. Throughput: 0: 10001.6. Samples: 440092476. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 07:22:53,990][27935] Avg episode reward: [(0, '-8.057')] [2022-07-13 07:22:59,009][27935] Fps is (10 sec: 5109.8, 60 sec: 4981.8, 300 sec: 5039.8). Total num frames: 220072960. Throughput: 0: 10005.3. Samples: 440152620. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:22:59,009][27935] Avg episode reward: [(0, '-8.310')] [2022-07-13 07:23:03,989][27935] Fps is (10 sec: 4915.4, 60 sec: 4983.5, 300 sec: 5036.7). Total num frames: 220095488. Throughput: 0: 9974.1. Samples: 440209572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:03,989][27935] Avg episode reward: [(0, '-6.702')] [2022-07-13 07:23:08,989][27935] Fps is (10 sec: 4822.4, 60 sec: 5017.6, 300 sec: 5040.2). Total num frames: 220121088. Throughput: 0: 9992.3. Samples: 440240468. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:08,989][27935] Avg episode reward: [(0, '-6.211')] [2022-07-13 07:23:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5040.2). Total num frames: 220145664. Throughput: 0: 10006.7. Samples: 440302248. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:13,992][27935] Avg episode reward: [(0, '-5.917')] [2022-07-13 07:23:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5050.6). Total num frames: 220173312. Throughput: 0: 10056.6. Samples: 440363552. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:18,989][27935] Avg episode reward: [(0, '-5.892')] [2022-07-13 07:23:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5017.6, 300 sec: 5047.1). Total num frames: 220197888. Throughput: 0: 10064.4. Samples: 440394648. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:23,990][27935] Avg episode reward: [(0, '-6.399')] [2022-07-13 07:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 220222464. Throughput: 0: 10066.7. Samples: 440455192. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:28,989][27935] Avg episode reward: [(0, '-6.543')] [2022-07-13 07:23:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5040.2). Total num frames: 220248064. Throughput: 0: 10072.6. Samples: 440515988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:33,989][27935] Avg episode reward: [(0, '-6.744')] [2022-07-13 07:23:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5052.4, 300 sec: 5040.2). Total num frames: 220274688. Throughput: 0: 10101.1. Samples: 440547020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:38,989][27935] Avg episode reward: [(0, '-7.572')] [2022-07-13 07:23:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 220299264. Throughput: 0: 10142.3. Samples: 440608820. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:43,989][27935] Avg episode reward: [(0, '-5.509')] [2022-07-13 07:23:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5029.7). Total num frames: 220324864. Throughput: 0: 10248.0. Samples: 440670732. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:48,989][27935] Avg episode reward: [(0, '-3.666')] [2022-07-13 07:23:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5103.0, 300 sec: 5033.2). Total num frames: 220352512. Throughput: 0: 10260.3. Samples: 440702180. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:53,989][27935] Avg episode reward: [(0, '-4.132')] [2022-07-13 07:23:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5070.5, 300 sec: 5040.2). Total num frames: 220377088. Throughput: 0: 10281.4. Samples: 440764908. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:23:58,989][27935] Avg episode reward: [(0, '-5.171')] [2022-07-13 07:24:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5026.3). Total num frames: 220401664. Throughput: 0: 10188.8. Samples: 440822048. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:03,989][27935] Avg episode reward: [(0, '-6.871')] [2022-07-13 07:24:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5026.3). Total num frames: 220426240. Throughput: 0: 10175.8. Samples: 440852556. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:08,989][27935] Avg episode reward: [(0, '-7.695')] [2022-07-13 07:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5015.9). Total num frames: 220450816. Throughput: 0: 10133.7. Samples: 440911208. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:13,989][27935] Avg episode reward: [(0, '-7.330')] [2022-07-13 07:24:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5015.9). Total num frames: 220477440. Throughput: 0: 10161.9. Samples: 440973276. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:18,989][27935] Avg episode reward: [(0, '-8.078')] [2022-07-13 07:24:23,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5102.6, 300 sec: 5019.3). Total num frames: 220504064. Throughput: 0: 10165.5. Samples: 441004504. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:23,993][27935] Avg episode reward: [(0, '-7.599')] [2022-07-13 07:24:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5012.4). Total num frames: 220528640. Throughput: 0: 10196.8. Samples: 441067676. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:28,989][27935] Avg episode reward: [(0, '-6.547')] [2022-07-13 07:24:33,989][27935] Fps is (10 sec: 5224.3, 60 sec: 5137.1, 300 sec: 5019.5). Total num frames: 220556288. Throughput: 0: 10201.3. Samples: 441129792. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:33,989][27935] Avg episode reward: [(0, '-5.781')] [2022-07-13 07:24:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5012.4). Total num frames: 220580864. Throughput: 0: 10194.3. Samples: 441160924. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:38,989][27935] Avg episode reward: [(0, '-6.025')] [2022-07-13 07:24:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5008.9). Total num frames: 220606464. Throughput: 0: 10169.6. Samples: 441222540. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:43,989][27935] Avg episode reward: [(0, '-6.939')] [2022-07-13 07:24:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5012.4). Total num frames: 220633088. Throughput: 0: 10289.8. Samples: 441285088. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:48,989][27935] Avg episode reward: [(0, '-7.065')] [2022-07-13 07:24:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5008.9). Total num frames: 220658688. Throughput: 0: 10298.5. Samples: 441315988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:53,989][27935] Avg episode reward: [(0, '-6.941')] [2022-07-13 07:24:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5015.9). Total num frames: 220684288. Throughput: 0: 10357.6. Samples: 441377300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:24:58,989][27935] Avg episode reward: [(0, '-7.300')] [2022-07-13 07:25:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5002.0). Total num frames: 220707840. Throughput: 0: 10281.2. Samples: 441435928. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:25:03,989][27935] Avg episode reward: [(0, '-6.942')] [2022-07-13 07:25:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5005.5). Total num frames: 220734464. Throughput: 0: 10288.7. Samples: 441467456. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 07:25:08,989][27935] Avg episode reward: [(0, '-7.611')] [2022-07-13 07:25:13,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5188.3, 300 sec: 5015.9). Total num frames: 220762112. Throughput: 0: 10306.2. Samples: 441531456. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:13,991][27935] Avg episode reward: [(0, '-6.154')] [2022-07-13 07:25:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5019.3). Total num frames: 220787712. Throughput: 0: 10339.8. Samples: 441595084. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:18,991][27935] Avg episode reward: [(0, '-6.463')] [2022-07-13 07:25:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.6, 300 sec: 5026.3). Total num frames: 220815360. Throughput: 0: 10359.6. Samples: 441627104. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:23,992][27935] Avg episode reward: [(0, '-6.122')] [2022-07-13 07:25:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5029.8). Total num frames: 220840960. Throughput: 0: 10420.4. Samples: 441691456. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:29,000][27935] Avg episode reward: [(0, '-7.058')] [2022-07-13 07:25:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5036.7). Total num frames: 220866560. Throughput: 0: 10409.0. Samples: 441753492. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:33,989][27935] Avg episode reward: [(0, '-6.519')] [2022-07-13 07:25:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5040.2). Total num frames: 220892160. Throughput: 0: 10405.9. Samples: 441784252. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:38,989][27935] Avg episode reward: [(0, '-5.513')] [2022-07-13 07:25:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5043.6). Total num frames: 220917760. Throughput: 0: 10366.6. Samples: 441843796. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:43,989][27935] Avg episode reward: [(0, '-5.869')] [2022-07-13 07:25:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5043.6). Total num frames: 220941312. Throughput: 0: 10365.7. Samples: 441902384. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:48,989][27935] Avg episode reward: [(0, '-5.926')] [2022-07-13 07:25:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5120.0, 300 sec: 5040.2). Total num frames: 220965888. Throughput: 0: 10323.4. Samples: 441932008. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:53,989][27935] Avg episode reward: [(0, '-5.491')] [2022-07-13 07:25:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5057.5). Total num frames: 220991488. Throughput: 0: 10251.7. Samples: 441992784. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:25:58,989][27935] Avg episode reward: [(0, '-4.957')] [2022-07-13 07:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 221012992. Throughput: 0: 10059.0. Samples: 442047740. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:03,989][27935] Avg episode reward: [(0, '-5.919')] [2022-07-13 07:26:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5050.6). Total num frames: 221039616. Throughput: 0: 10015.2. Samples: 442077788. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:08,989][27935] Avg episode reward: [(0, '-7.119')] [2022-07-13 07:26:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5068.8, 300 sec: 5050.6). Total num frames: 221066240. Throughput: 0: 9960.8. Samples: 442139692. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:13,989][27935] Avg episode reward: [(0, '-5.203')] [2022-07-13 07:26:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5050.6). Total num frames: 221089792. Throughput: 0: 9931.8. Samples: 442200424. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:18,989][27935] Avg episode reward: [(0, '-5.122')] [2022-07-13 07:26:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5047.1). Total num frames: 221116416. Throughput: 0: 9929.6. Samples: 442231084. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:23,989][27935] Avg episode reward: [(0, '-6.570')] [2022-07-13 07:26:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5050.6). Total num frames: 221140992. Throughput: 0: 9979.9. Samples: 442292892. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:28,989][27935] Avg episode reward: [(0, '-6.722')] [2022-07-13 07:26:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5050.6). Total num frames: 221167616. Throughput: 0: 10028.7. Samples: 442353676. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:33,989][27935] Avg episode reward: [(0, '-6.925')] [2022-07-13 07:26:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5057.5). Total num frames: 221192192. Throughput: 0: 10066.1. Samples: 442384984. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:38,989][27935] Avg episode reward: [(0, '-7.167')] [2022-07-13 07:26:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5017.6, 300 sec: 5061.0). Total num frames: 221218816. Throughput: 0: 10048.7. Samples: 442444976. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:43,989][27935] Avg episode reward: [(0, '-7.868')] [2022-07-13 07:26:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5061.0). Total num frames: 221243392. Throughput: 0: 10183.4. Samples: 442505992. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:48,989][27935] Avg episode reward: [(0, '-9.107')] [2022-07-13 07:26:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5071.4). Total num frames: 221270016. Throughput: 0: 10199.5. Samples: 442536768. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:53,989][27935] Avg episode reward: [(0, '-10.183')] [2022-07-13 07:26:58,990][27935] Fps is (10 sec: 5221.6, 60 sec: 5068.7, 300 sec: 5081.8). Total num frames: 221295616. Throughput: 0: 10239.9. Samples: 442600504. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:26:58,992][27935] Avg episode reward: [(0, '-8.404')] [2022-07-13 07:27:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5085.3). Total num frames: 221320192. Throughput: 0: 10206.0. Samples: 442659692. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:03,990][27935] Avg episode reward: [(0, '-7.255')] [2022-07-13 07:27:08,989][27935] Fps is (10 sec: 5120.7, 60 sec: 5120.0, 300 sec: 5088.8). Total num frames: 221346816. Throughput: 0: 10232.5. Samples: 442691548. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:08,990][27935] Avg episode reward: [(0, '-7.374')] [2022-07-13 07:27:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5088.8). Total num frames: 221371392. Throughput: 0: 10266.7. Samples: 442754896. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:13,989][27935] Avg episode reward: [(0, '-7.131')] [2022-07-13 07:27:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5095.7). Total num frames: 221400064. Throughput: 0: 10311.5. Samples: 442817696. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:18,989][27935] Avg episode reward: [(0, '-5.564')] [2022-07-13 07:27:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5102.6). Total num frames: 221424640. Throughput: 0: 10318.0. Samples: 442849296. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:23,991][27935] Avg episode reward: [(0, '-6.149')] [2022-07-13 07:27:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5099.2). Total num frames: 221451264. Throughput: 0: 10370.4. Samples: 442911644. Policy #0 lag: (min: 0.0, avg: 10.3, max: 19.0) [2022-07-13 07:27:28,990][27935] Avg episode reward: [(0, '-6.097')] [2022-07-13 07:27:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5102.8). Total num frames: 221476864. Throughput: 0: 10404.8. Samples: 442974208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:33,990][27935] Avg episode reward: [(0, '-6.828')] [2022-07-13 07:27:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5106.1). Total num frames: 221503488. Throughput: 0: 10409.5. Samples: 443005196. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:38,989][27935] Avg episode reward: [(0, '-6.022')] [2022-07-13 07:27:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5106.1). Total num frames: 221528064. Throughput: 0: 10315.6. Samples: 443064692. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:43,989][27935] Avg episode reward: [(0, '-5.456')] [2022-07-13 07:27:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5106.1). Total num frames: 221552640. Throughput: 0: 10345.6. Samples: 443125244. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:48,989][27935] Avg episode reward: [(0, '-6.606')] [2022-07-13 07:27:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5103.0). Total num frames: 221578240. Throughput: 0: 10320.0. Samples: 443155948. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:53,989][27935] Avg episode reward: [(0, '-6.162')] [2022-07-13 07:27:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.2, 300 sec: 5113.1). Total num frames: 221603840. Throughput: 0: 10242.9. Samples: 443215828. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:27:58,989][27935] Avg episode reward: [(0, '-5.647')] [2022-07-13 07:28:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5106.1). Total num frames: 221627392. Throughput: 0: 10136.6. Samples: 443273844. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:03,989][27935] Avg episode reward: [(0, '-5.444')] [2022-07-13 07:28:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 221651968. Throughput: 0: 10119.1. Samples: 443304656. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:08,989][27935] Avg episode reward: [(0, '-4.929')] [2022-07-13 07:28:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5102.9, 300 sec: 5099.2). Total num frames: 221677568. Throughput: 0: 10096.5. Samples: 443365988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:13,989][27935] Avg episode reward: [(0, '-4.310')] [2022-07-13 07:28:18,993][27935] Fps is (10 sec: 5220.2, 60 sec: 5068.5, 300 sec: 5106.0). Total num frames: 221704192. Throughput: 0: 10067.3. Samples: 443427280. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:18,993][27935] Avg episode reward: [(0, '-4.639')] [2022-07-13 07:28:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5109.6). Total num frames: 221729792. Throughput: 0: 10067.1. Samples: 443458216. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:23,990][27935] Avg episode reward: [(0, '-3.354')] [2022-07-13 07:28:28,989][27935] Fps is (10 sec: 5122.1, 60 sec: 5068.8, 300 sec: 5109.6). Total num frames: 221755392. Throughput: 0: 10105.3. Samples: 443519432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:28,989][27935] Avg episode reward: [(0, '-3.448')] [2022-07-13 07:28:33,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5068.8, 300 sec: 5106.1). Total num frames: 221780992. Throughput: 0: 10154.2. Samples: 443582180. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:33,991][27935] Avg episode reward: [(0, '-4.796')] [2022-07-13 07:28:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5113.1). Total num frames: 221807616. Throughput: 0: 10162.3. Samples: 443613252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:38,991][27935] Avg episode reward: [(0, '-4.454')] [2022-07-13 07:28:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5109.6). Total num frames: 221832192. Throughput: 0: 10231.3. Samples: 443676236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:43,989][27935] Avg episode reward: [(0, '-4.895')] [2022-07-13 07:28:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5113.1). Total num frames: 221860864. Throughput: 0: 10345.8. Samples: 443739404. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:48,989][27935] Avg episode reward: [(0, '-5.056')] [2022-07-13 07:28:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5137.1, 300 sec: 5116.5). Total num frames: 221886464. Throughput: 0: 10367.3. Samples: 443771184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:53,989][27935] Avg episode reward: [(0, '-5.736')] [2022-07-13 07:28:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5120.0). Total num frames: 221912064. Throughput: 0: 10370.6. Samples: 443832664. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:28:58,989][27935] Avg episode reward: [(0, '-6.020')] [2022-07-13 07:29:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5120.0, 300 sec: 5113.1). Total num frames: 221934592. Throughput: 0: 10223.0. Samples: 443887272. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:03,989][27935] Avg episode reward: [(0, '-5.027')] [2022-07-13 07:29:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 5085.9, 300 sec: 5106.1). Total num frames: 221957120. Throughput: 0: 10168.0. Samples: 443915776. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:08,989][27935] Avg episode reward: [(0, '-6.127')] [2022-07-13 07:29:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5068.8, 300 sec: 5099.2). Total num frames: 221981696. Throughput: 0: 10085.9. Samples: 443973296. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:13,989][27935] Avg episode reward: [(0, '-5.577')] [2022-07-13 07:29:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5035.0, 300 sec: 5092.3). Total num frames: 222006272. Throughput: 0: 9969.3. Samples: 444030800. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:18,989][27935] Avg episode reward: [(0, '-6.048')] [2022-07-13 07:29:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 5017.6, 300 sec: 5092.2). Total num frames: 222030848. Throughput: 0: 9923.6. Samples: 444059812. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:23,989][27935] Avg episode reward: [(0, '-6.054')] [2022-07-13 07:29:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 5074.9). Total num frames: 222053376. Throughput: 0: 9843.9. Samples: 444119212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:28,989][27935] Avg episode reward: [(0, '-6.674')] [2022-07-13 07:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5085.3). Total num frames: 222081024. Throughput: 0: 9776.0. Samples: 444179324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:33,989][27935] Avg episode reward: [(0, '-5.561')] [2022-07-13 07:29:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5078.3). Total num frames: 222104576. Throughput: 0: 9731.5. Samples: 444209100. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:38,989][27935] Avg episode reward: [(0, '-4.494')] [2022-07-13 07:29:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5081.8). Total num frames: 222132224. Throughput: 0: 9744.1. Samples: 444271148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 07:29:43,990][27935] Avg episode reward: [(0, '-4.211')] [2022-07-13 07:29:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4932.3, 300 sec: 5078.3). Total num frames: 222156800. Throughput: 0: 9911.2. Samples: 444333276. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:29:48,989][27935] Avg episode reward: [(0, '-5.713')] [2022-07-13 07:29:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 5081.8). Total num frames: 222183424. Throughput: 0: 9977.4. Samples: 444364760. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:29:53,989][27935] Avg episode reward: [(0, '-5.496')] [2022-07-13 07:29:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 4966.4, 300 sec: 5092.2). Total num frames: 222210048. Throughput: 0: 10104.7. Samples: 444428008. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:29:58,989][27935] Avg episode reward: [(0, '-5.120')] [2022-07-13 07:30:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4983.5, 300 sec: 5081.8). Total num frames: 222233600. Throughput: 0: 10127.0. Samples: 444486516. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:03,991][27935] Avg episode reward: [(0, '-4.069')] [2022-07-13 07:30:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 222260224. Throughput: 0: 10170.7. Samples: 444517492. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:08,989][27935] Avg episode reward: [(0, '-4.672')] [2022-07-13 07:30:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5074.9). Total num frames: 222284800. Throughput: 0: 10219.6. Samples: 444579096. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:13,989][27935] Avg episode reward: [(0, '-6.663')] [2022-07-13 07:30:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5071.4). Total num frames: 222311424. Throughput: 0: 10228.1. Samples: 444639588. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:18,989][27935] Avg episode reward: [(0, '-6.304')] [2022-07-13 07:30:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5064.5). Total num frames: 222334976. Throughput: 0: 10257.4. Samples: 444670684. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:23,989][27935] Avg episode reward: [(0, '-6.836')] [2022-07-13 07:30:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5071.4). Total num frames: 222362624. Throughput: 0: 10267.3. Samples: 444733176. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:28,989][27935] Avg episode reward: [(0, '-9.286')] [2022-07-13 07:30:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5067.9). Total num frames: 222387200. Throughput: 0: 10273.2. Samples: 444795572. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:33,989][27935] Avg episode reward: [(0, '-9.735')] [2022-07-13 07:30:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5067.9). Total num frames: 222412800. Throughput: 0: 10257.7. Samples: 444826356. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:38,990][27935] Avg episode reward: [(0, '-10.930')] [2022-07-13 07:30:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5081.8). Total num frames: 222440448. Throughput: 0: 10244.4. Samples: 444889004. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:43,990][27935] Avg episode reward: [(0, '-9.652')] [2022-07-13 07:30:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5085.3). Total num frames: 222466048. Throughput: 0: 10346.0. Samples: 444952088. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:48,990][27935] Avg episode reward: [(0, '-9.581')] [2022-07-13 07:30:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5088.8). Total num frames: 222492672. Throughput: 0: 10363.1. Samples: 444983832. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:53,990][27935] Avg episode reward: [(0, '-10.183')] [2022-07-13 07:30:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5102.6). Total num frames: 222518272. Throughput: 0: 10390.3. Samples: 445046660. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:30:58,991][27935] Avg episode reward: [(0, '-9.645')] [2022-07-13 07:31:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5099.2). Total num frames: 222543872. Throughput: 0: 10353.8. Samples: 445105508. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:03,991][27935] Avg episode reward: [(0, '-7.515')] [2022-07-13 07:31:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5095.7). Total num frames: 222569472. Throughput: 0: 10360.9. Samples: 445136924. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:08,989][27935] Avg episode reward: [(0, '-5.789')] [2022-07-13 07:31:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5106.1). Total num frames: 222596096. Throughput: 0: 10368.7. Samples: 445199768. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:13,989][27935] Avg episode reward: [(0, '-4.684')] [2022-07-13 07:31:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5102.6). Total num frames: 222621696. Throughput: 0: 10384.7. Samples: 445262884. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:18,989][27935] Avg episode reward: [(0, '-5.249')] [2022-07-13 07:31:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5109.6). Total num frames: 222648320. Throughput: 0: 10392.9. Samples: 445294036. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:23,989][27935] Avg episode reward: [(0, '-5.233')] [2022-07-13 07:31:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5102.6). Total num frames: 222672896. Throughput: 0: 10383.6. Samples: 445356268. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:28,989][27935] Avg episode reward: [(0, '-4.596')] [2022-07-13 07:31:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5106.1). Total num frames: 222698496. Throughput: 0: 10296.5. Samples: 445415432. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:33,989][27935] Avg episode reward: [(0, '-6.467')] [2022-07-13 07:31:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5102.6). Total num frames: 222724096. Throughput: 0: 10271.9. Samples: 445446068. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:38,989][27935] Avg episode reward: [(0, '-5.182')] [2022-07-13 07:31:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5102.6). Total num frames: 222748672. Throughput: 0: 10239.6. Samples: 445507440. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:43,989][27935] Avg episode reward: [(0, '-4.960')] [2022-07-13 07:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5102.6). Total num frames: 222775296. Throughput: 0: 10299.6. Samples: 445568992. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:48,989][27935] Avg episode reward: [(0, '-4.436')] [2022-07-13 07:31:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5099.2). Total num frames: 222799872. Throughput: 0: 10292.6. Samples: 445600092. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:53,991][27935] Avg episode reward: [(0, '-3.365')] [2022-07-13 07:31:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5102.6). Total num frames: 222825472. Throughput: 0: 10249.6. Samples: 445661000. Policy #0 lag: (min: 0.0, avg: 7.7, max: 19.0) [2022-07-13 07:31:58,990][27935] Avg episode reward: [(0, '-3.068')] [2022-07-13 07:32:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5092.2). Total num frames: 222849024. Throughput: 0: 10116.2. Samples: 445718112. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:03,989][27935] Avg episode reward: [(0, '-1.522')] [2022-07-13 07:32:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5085.9, 300 sec: 5095.7). Total num frames: 222874624. Throughput: 0: 10097.4. Samples: 445748420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:08,989][27935] Avg episode reward: [(0, '-2.284')] [2022-07-13 07:32:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 222899200. Throughput: 0: 10048.2. Samples: 445808436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:13,989][27935] Avg episode reward: [(0, '-4.202')] [2022-07-13 07:32:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5088.8). Total num frames: 222925824. Throughput: 0: 10097.2. Samples: 445869804. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:18,989][27935] Avg episode reward: [(0, '-4.608')] [2022-07-13 07:32:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5081.8). Total num frames: 222950400. Throughput: 0: 10103.8. Samples: 445900740. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:23,989][27935] Avg episode reward: [(0, '-4.882')] [2022-07-13 07:32:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 222974976. Throughput: 0: 10092.0. Samples: 445961580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:28,989][27935] Avg episode reward: [(0, '-5.131')] [2022-07-13 07:32:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 223001600. Throughput: 0: 10070.3. Samples: 446022156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:33,989][27935] Avg episode reward: [(0, '-5.233')] [2022-07-13 07:32:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5081.8). Total num frames: 223027200. Throughput: 0: 10060.4. Samples: 446052808. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:38,989][27935] Avg episode reward: [(0, '-5.511')] [2022-07-13 07:32:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5078.3). Total num frames: 223050752. Throughput: 0: 10025.9. Samples: 446112168. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:43,989][27935] Avg episode reward: [(0, '-5.375')] [2022-07-13 07:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5074.9). Total num frames: 223075328. Throughput: 0: 10078.5. Samples: 446171644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:48,991][27935] Avg episode reward: [(0, '-4.702')] [2022-07-13 07:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5074.9). Total num frames: 223100928. Throughput: 0: 10058.0. Samples: 446201032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:53,990][27935] Avg episode reward: [(0, '-5.386')] [2022-07-13 07:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5034.7, 300 sec: 5085.3). Total num frames: 223127552. Throughput: 0: 10084.6. Samples: 446262240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:32:58,990][27935] Avg episode reward: [(0, '-4.285')] [2022-07-13 07:33:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5017.6, 300 sec: 5078.3). Total num frames: 223150080. Throughput: 0: 9985.5. Samples: 446319152. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:03,991][27935] Avg episode reward: [(0, '-6.484')] [2022-07-13 07:33:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5078.3). Total num frames: 223175680. Throughput: 0: 9964.6. Samples: 446349148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:08,989][27935] Avg episode reward: [(0, '-6.875')] [2022-07-13 07:33:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5074.9). Total num frames: 223201280. Throughput: 0: 9980.8. Samples: 446410716. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:13,990][27935] Avg episode reward: [(0, '-6.778')] [2022-07-13 07:33:18,999][27935] Fps is (10 sec: 5012.2, 60 sec: 4999.6, 300 sec: 5071.2). Total num frames: 223225856. Throughput: 0: 9980.2. Samples: 446471372. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:19,001][27935] Avg episode reward: [(0, '-5.467')] [2022-07-13 07:33:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 223251456. Throughput: 0: 9947.3. Samples: 446500436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:23,989][27935] Avg episode reward: [(0, '-5.799')] [2022-07-13 07:33:28,989][27935] Fps is (10 sec: 5023.0, 60 sec: 5017.6, 300 sec: 5067.9). Total num frames: 223276032. Throughput: 0: 10004.0. Samples: 446562348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:28,989][27935] Avg episode reward: [(0, '-5.323')] [2022-07-13 07:33:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5064.5). Total num frames: 223301632. Throughput: 0: 10046.3. Samples: 446623728. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:33,989][27935] Avg episode reward: [(0, '-5.975')] [2022-07-13 07:33:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5000.5, 300 sec: 5067.9). Total num frames: 223327232. Throughput: 0: 10071.4. Samples: 446654244. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:38,989][27935] Avg episode reward: [(0, '-4.800')] [2022-07-13 07:33:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5057.5). Total num frames: 223352832. Throughput: 0: 10092.6. Samples: 446716408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:43,989][27935] Avg episode reward: [(0, '-3.953')] [2022-07-13 07:33:48,992][27935] Fps is (10 sec: 5220.5, 60 sec: 5068.5, 300 sec: 5060.9). Total num frames: 223379456. Throughput: 0: 10187.5. Samples: 446777628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:48,993][27935] Avg episode reward: [(0, '-5.429')] [2022-07-13 07:33:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5068.8, 300 sec: 5061.0). Total num frames: 223405056. Throughput: 0: 10212.5. Samples: 446808712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:53,989][27935] Avg episode reward: [(0, '-4.484')] [2022-07-13 07:33:58,989][27935] Fps is (10 sec: 5121.9, 60 sec: 5051.7, 300 sec: 5071.4). Total num frames: 223430656. Throughput: 0: 10226.5. Samples: 446870908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:33:58,989][27935] Avg episode reward: [(0, '-5.681')] [2022-07-13 07:34:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5081.8). Total num frames: 223456256. Throughput: 0: 10170.4. Samples: 446928932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:34:03,991][27935] Avg episode reward: [(0, '-6.330')] [2022-07-13 07:34:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5068.8, 300 sec: 5078.3). Total num frames: 223479808. Throughput: 0: 10205.0. Samples: 446959660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:34:08,990][27935] Avg episode reward: [(0, '-4.940')] [2022-07-13 07:34:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5078.3). Total num frames: 223504384. Throughput: 0: 10166.0. Samples: 447019820. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 07:34:13,989][27935] Avg episode reward: [(0, '-5.616')] [2022-07-13 07:34:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5052.6, 300 sec: 5078.3). Total num frames: 223528960. Throughput: 0: 10068.2. Samples: 447076796. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:18,991][27935] Avg episode reward: [(0, '-5.729')] [2022-07-13 07:34:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5081.8). Total num frames: 223552512. Throughput: 0: 10027.8. Samples: 447105496. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:23,989][27935] Avg episode reward: [(0, '-6.987')] [2022-07-13 07:34:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5071.4). Total num frames: 223577088. Throughput: 0: 9916.9. Samples: 447162668. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:28,991][27935] Avg episode reward: [(0, '-6.224')] [2022-07-13 07:34:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4966.4, 300 sec: 5067.9). Total num frames: 223599616. Throughput: 0: 9814.6. Samples: 447219248. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:33,991][27935] Avg episode reward: [(0, '-5.626')] [2022-07-13 07:34:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4949.3, 300 sec: 5057.5). Total num frames: 223624192. Throughput: 0: 9778.8. Samples: 447248760. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:38,989][27935] Avg episode reward: [(0, '-6.103')] [2022-07-13 07:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 5054.0). Total num frames: 223647744. Throughput: 0: 9680.3. Samples: 447306524. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:43,989][27935] Avg episode reward: [(0, '-6.311')] [2022-07-13 07:34:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.4, 300 sec: 5050.6). Total num frames: 223673344. Throughput: 0: 9702.1. Samples: 447365528. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:48,991][27935] Avg episode reward: [(0, '-5.793')] [2022-07-13 07:34:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 5043.6). Total num frames: 223697920. Throughput: 0: 9691.6. Samples: 447395784. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:53,989][27935] Avg episode reward: [(0, '-3.340')] [2022-07-13 07:34:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 5050.6). Total num frames: 223723520. Throughput: 0: 9716.0. Samples: 447457040. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:34:58,991][27935] Avg episode reward: [(0, '-2.907')] [2022-07-13 07:35:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 5043.6). Total num frames: 223748096. Throughput: 0: 9738.6. Samples: 447515032. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:03,991][27935] Avg episode reward: [(0, '-3.559')] [2022-07-13 07:35:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 5050.6). Total num frames: 223774720. Throughput: 0: 9778.8. Samples: 447545540. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:08,989][27935] Avg episode reward: [(0, '-2.857')] [2022-07-13 07:35:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5040.2). Total num frames: 223798272. Throughput: 0: 9870.8. Samples: 447606856. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:13,990][27935] Avg episode reward: [(0, '-2.513')] [2022-07-13 07:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 5050.6). Total num frames: 223824896. Throughput: 0: 9981.9. Samples: 447668432. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:18,989][27935] Avg episode reward: [(0, '-2.360')] [2022-07-13 07:35:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 5043.6). Total num frames: 223850496. Throughput: 0: 10019.6. Samples: 447699644. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:23,989][27935] Avg episode reward: [(0, '-2.802')] [2022-07-13 07:35:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5047.1). Total num frames: 223876096. Throughput: 0: 10126.3. Samples: 447762208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:28,989][27935] Avg episode reward: [(0, '-4.072')] [2022-07-13 07:35:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5047.1). Total num frames: 223901696. Throughput: 0: 10179.5. Samples: 447823604. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:33,989][27935] Avg episode reward: [(0, '-3.965')] [2022-07-13 07:35:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 223927296. Throughput: 0: 10199.8. Samples: 447854776. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:38,990][27935] Avg episode reward: [(0, '-4.284')] [2022-07-13 07:35:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5043.6). Total num frames: 223953920. Throughput: 0: 10227.4. Samples: 447917272. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:43,989][27935] Avg episode reward: [(0, '-3.726')] [2022-07-13 07:35:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5043.6). Total num frames: 223980544. Throughput: 0: 10312.8. Samples: 447979108. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:48,989][27935] Avg episode reward: [(0, '-3.482')] [2022-07-13 07:35:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5040.2). Total num frames: 224005120. Throughput: 0: 10325.9. Samples: 448010204. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:53,989][27935] Avg episode reward: [(0, '-4.465')] [2022-07-13 07:35:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5043.6). Total num frames: 224031744. Throughput: 0: 10348.8. Samples: 448072552. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:35:58,989][27935] Avg episode reward: [(0, '-3.566')] [2022-07-13 07:36:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5040.2). Total num frames: 224056320. Throughput: 0: 10286.9. Samples: 448131340. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:03,989][27935] Avg episode reward: [(0, '-3.059')] [2022-07-13 07:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5036.7). Total num frames: 224081920. Throughput: 0: 10283.8. Samples: 448162416. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:08,989][27935] Avg episode reward: [(0, '-2.819')] [2022-07-13 07:36:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5040.2). Total num frames: 224108544. Throughput: 0: 10285.3. Samples: 448225048. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:13,989][27935] Avg episode reward: [(0, '-3.071')] [2022-07-13 07:36:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5033.2). Total num frames: 224133120. Throughput: 0: 10249.6. Samples: 448284836. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:18,989][27935] Avg episode reward: [(0, '-4.029')] [2022-07-13 07:36:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5036.7). Total num frames: 224158720. Throughput: 0: 10237.8. Samples: 448315476. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:23,989][27935] Avg episode reward: [(0, '-4.814')] [2022-07-13 07:36:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5036.7). Total num frames: 224184320. Throughput: 0: 10198.6. Samples: 448376208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 07:36:28,989][27935] Avg episode reward: [(0, '-4.670')] [2022-07-13 07:36:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5033.2). Total num frames: 224208896. Throughput: 0: 10176.5. Samples: 448437052. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:33,989][27935] Avg episode reward: [(0, '-5.062')] [2022-07-13 07:36:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5033.2). Total num frames: 224233472. Throughput: 0: 10168.9. Samples: 448467804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:38,989][27935] Avg episode reward: [(0, '-5.016')] [2022-07-13 07:36:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5033.2). Total num frames: 224260096. Throughput: 0: 10156.4. Samples: 448529588. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:43,989][27935] Avg episode reward: [(0, '-4.539')] [2022-07-13 07:36:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5036.7). Total num frames: 224285696. Throughput: 0: 10190.1. Samples: 448589896. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:48,989][27935] Avg episode reward: [(0, '-4.531')] [2022-07-13 07:36:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5036.7). Total num frames: 224311296. Throughput: 0: 10160.5. Samples: 448619640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:53,989][27935] Avg episode reward: [(0, '-4.280')] [2022-07-13 07:36:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5036.7). Total num frames: 224334848. Throughput: 0: 10090.9. Samples: 448679136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:36:58,989][27935] Avg episode reward: [(0, '-5.136')] [2022-07-13 07:37:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5033.2). Total num frames: 224359424. Throughput: 0: 10062.8. Samples: 448737664. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:03,991][27935] Avg episode reward: [(0, '-6.023')] [2022-07-13 07:37:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 224384000. Throughput: 0: 10062.5. Samples: 448768288. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:08,989][27935] Avg episode reward: [(0, '-6.623')] [2022-07-13 07:37:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5029.7). Total num frames: 224409600. Throughput: 0: 10070.6. Samples: 448829384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:13,989][27935] Avg episode reward: [(0, '-7.803')] [2022-07-13 07:37:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5029.7). Total num frames: 224434176. Throughput: 0: 10054.7. Samples: 448889512. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:18,989][27935] Avg episode reward: [(0, '-6.626')] [2022-07-13 07:37:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 224461824. Throughput: 0: 10055.7. Samples: 448920312. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:23,991][27935] Avg episode reward: [(0, '-6.800')] [2022-07-13 07:37:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5026.3). Total num frames: 224484352. Throughput: 0: 10024.4. Samples: 448980688. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:28,989][27935] Avg episode reward: [(0, '-6.339')] [2022-07-13 07:37:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5034.7, 300 sec: 5029.7). Total num frames: 224510976. Throughput: 0: 9995.4. Samples: 449039688. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:33,989][27935] Avg episode reward: [(0, '-4.381')] [2022-07-13 07:37:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 224535552. Throughput: 0: 9996.5. Samples: 449069480. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:38,989][27935] Avg episode reward: [(0, '-4.965')] [2022-07-13 07:37:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5036.7). Total num frames: 224561152. Throughput: 0: 10024.6. Samples: 449130244. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:43,989][27935] Avg episode reward: [(0, '-4.759')] [2022-07-13 07:37:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5033.2). Total num frames: 224585728. Throughput: 0: 10074.9. Samples: 449191036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:48,991][27935] Avg episode reward: [(0, '-4.538')] [2022-07-13 07:37:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5029.7). Total num frames: 224611328. Throughput: 0: 10066.4. Samples: 449221276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:53,989][27935] Avg episode reward: [(0, '-4.058')] [2022-07-13 07:37:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5040.2). Total num frames: 224636928. Throughput: 0: 10078.6. Samples: 449282920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:37:58,991][27935] Avg episode reward: [(0, '-5.878')] [2022-07-13 07:38:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5000.5, 300 sec: 5029.7). Total num frames: 224659456. Throughput: 0: 9988.6. Samples: 449339000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:03,991][27935] Avg episode reward: [(0, '-5.868')] [2022-07-13 07:38:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5029.8). Total num frames: 224685056. Throughput: 0: 9964.4. Samples: 449368712. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:08,989][27935] Avg episode reward: [(0, '-5.214')] [2022-07-13 07:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5000.5, 300 sec: 5029.9). Total num frames: 224709632. Throughput: 0: 9954.3. Samples: 449428632. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:13,989][27935] Avg episode reward: [(0, '-6.039')] [2022-07-13 07:38:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5034.7, 300 sec: 5033.2). Total num frames: 224736256. Throughput: 0: 10022.7. Samples: 449490708. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:18,989][27935] Avg episode reward: [(0, '-5.681')] [2022-07-13 07:38:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4983.5, 300 sec: 5033.2). Total num frames: 224760832. Throughput: 0: 10064.8. Samples: 449522396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:23,991][27935] Avg episode reward: [(0, '-5.223')] [2022-07-13 07:38:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 224789504. Throughput: 0: 10108.9. Samples: 449585144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:28,990][27935] Avg episode reward: [(0, '-5.749')] [2022-07-13 07:38:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5051.7, 300 sec: 5040.2). Total num frames: 224814080. Throughput: 0: 10150.5. Samples: 449647808. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:33,989][27935] Avg episode reward: [(0, '-5.864')] [2022-07-13 07:38:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5043.6). Total num frames: 224840704. Throughput: 0: 10170.8. Samples: 449678960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:38,989][27935] Avg episode reward: [(0, '-6.493')] [2022-07-13 07:38:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5043.7). Total num frames: 224867328. Throughput: 0: 10216.3. Samples: 449742652. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 07:38:43,989][27935] Avg episode reward: [(0, '-6.427')] [2022-07-13 07:38:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5043.6). Total num frames: 224892928. Throughput: 0: 10354.5. Samples: 449804952. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:38:48,989][27935] Avg episode reward: [(0, '-6.326')] [2022-07-13 07:38:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5050.6). Total num frames: 224920576. Throughput: 0: 10402.0. Samples: 449836800. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:38:53,989][27935] Avg episode reward: [(0, '-6.545')] [2022-07-13 07:38:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5043.6). Total num frames: 224944128. Throughput: 0: 10471.3. Samples: 449899840. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:38:58,989][27935] Avg episode reward: [(0, '-6.832')] [2022-07-13 07:39:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5154.1, 300 sec: 5047.1). Total num frames: 224968704. Throughput: 0: 10392.9. Samples: 449958388. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:03,989][27935] Avg episode reward: [(0, '-6.695')] [2022-07-13 07:39:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5057.5). Total num frames: 224996352. Throughput: 0: 10385.1. Samples: 449989724. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:08,989][27935] Avg episode reward: [(0, '-7.411')] [2022-07-13 07:39:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5061.0). Total num frames: 225021952. Throughput: 0: 10395.5. Samples: 450052940. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:13,989][27935] Avg episode reward: [(0, '-7.423')] [2022-07-13 07:39:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5067.9). Total num frames: 225047552. Throughput: 0: 9701.9. Samples: 450084392. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:18,996][27935] Avg episode reward: [(0, '-6.796')] [2022-07-13 07:39:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5074.9). Total num frames: 225074176. Throughput: 0: 10399.4. Samples: 450146932. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:23,989][27935] Avg episode reward: [(0, '-6.616')] [2022-07-13 07:39:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5085.3). Total num frames: 225099776. Throughput: 0: 10366.0. Samples: 450209120. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:28,990][27935] Avg episode reward: [(0, '-6.959')] [2022-07-13 07:39:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5095.7). Total num frames: 225127424. Throughput: 0: 10366.3. Samples: 450271436. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:33,992][27935] Avg episode reward: [(0, '-6.413')] [2022-07-13 07:39:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5099.2). Total num frames: 225152000. Throughput: 0: 10355.7. Samples: 450302808. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:38,989][27935] Avg episode reward: [(0, '-7.067')] [2022-07-13 07:39:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5102.6). Total num frames: 225178624. Throughput: 0: 10355.7. Samples: 450365844. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:43,989][27935] Avg episode reward: [(0, '-6.600')] [2022-07-13 07:39:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5106.1). Total num frames: 225204224. Throughput: 0: 10441.6. Samples: 450428260. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:48,989][27935] Avg episode reward: [(0, '-7.734')] [2022-07-13 07:39:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5109.6). Total num frames: 225230848. Throughput: 0: 10445.6. Samples: 450459776. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:53,989][27935] Avg episode reward: [(0, '-7.399')] [2022-07-13 07:39:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5116.5). Total num frames: 225257472. Throughput: 0: 10437.4. Samples: 450522624. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:39:58,989][27935] Avg episode reward: [(0, '-5.924')] [2022-07-13 07:40:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5102.6). Total num frames: 225280000. Throughput: 0: 11055.7. Samples: 450581900. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:03,989][27935] Avg episode reward: [(0, '-7.616')] [2022-07-13 07:40:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5120.0). Total num frames: 225308672. Throughput: 0: 10375.6. Samples: 450613836. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:08,989][27935] Avg episode reward: [(0, '-6.640')] [2022-07-13 07:40:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5113.1). Total num frames: 225333248. Throughput: 0: 10400.4. Samples: 450677136. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:13,989][27935] Avg episode reward: [(0, '-7.235')] [2022-07-13 07:40:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5116.5). Total num frames: 225359872. Throughput: 0: 10412.0. Samples: 450739976. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:18,991][27935] Avg episode reward: [(0, '-6.274')] [2022-07-13 07:40:23,991][27935] Fps is (10 sec: 5425.8, 60 sec: 5222.2, 300 sec: 5123.4). Total num frames: 225387520. Throughput: 0: 10424.1. Samples: 450771920. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:23,993][27935] Avg episode reward: [(0, '-6.755')] [2022-07-13 07:40:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5123.5). Total num frames: 225413120. Throughput: 0: 10425.9. Samples: 450835008. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:28,989][27935] Avg episode reward: [(0, '-7.447')] [2022-07-13 07:40:33,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5205.3, 300 sec: 5126.9). Total num frames: 225439744. Throughput: 0: 10429.8. Samples: 450897600. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:33,989][27935] Avg episode reward: [(0, '-6.137')] [2022-07-13 07:40:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5123.5). Total num frames: 225465344. Throughput: 0: 10423.8. Samples: 450928848. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:38,989][27935] Avg episode reward: [(0, '-6.105')] [2022-07-13 07:40:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5123.5). Total num frames: 225491968. Throughput: 0: 10433.7. Samples: 450992140. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:43,989][27935] Avg episode reward: [(0, '-5.443')] [2022-07-13 07:40:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5130.4). Total num frames: 225518592. Throughput: 0: 10512.4. Samples: 451054960. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:48,989][27935] Avg episode reward: [(0, '-6.157')] [2022-07-13 07:40:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5123.5). Total num frames: 225543168. Throughput: 0: 10505.5. Samples: 451086584. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:53,989][27935] Avg episode reward: [(0, '-7.649')] [2022-07-13 07:40:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5130.4). Total num frames: 225569792. Throughput: 0: 10501.1. Samples: 451149684. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:40:58,989][27935] Avg episode reward: [(0, '-7.043')] [2022-07-13 07:41:03,990][27935] Fps is (10 sec: 5119.5, 60 sec: 5239.4, 300 sec: 5126.9). Total num frames: 225594368. Throughput: 0: 10403.8. Samples: 451208160. Policy #0 lag: (min: 0.0, avg: 10.3, max: 21.0) [2022-07-13 07:41:03,990][27935] Avg episode reward: [(0, '-5.692')] [2022-07-13 07:41:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5126.9). Total num frames: 225620992. Throughput: 0: 10389.3. Samples: 451239412. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:08,989][27935] Avg episode reward: [(0, '-4.667')] [2022-07-13 07:41:13,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5222.4, 300 sec: 5130.4). Total num frames: 225646592. Throughput: 0: 10391.6. Samples: 451302632. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:13,989][27935] Avg episode reward: [(0, '-5.330')] [2022-07-13 07:41:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5133.9). Total num frames: 225673216. Throughput: 0: 10375.3. Samples: 451364488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:18,989][27935] Avg episode reward: [(0, '-3.746')] [2022-07-13 07:41:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.5, 300 sec: 5133.9). Total num frames: 225698816. Throughput: 0: 10370.8. Samples: 451395536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:23,989][27935] Avg episode reward: [(0, '-3.657')] [2022-07-13 07:41:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5137.4). Total num frames: 225724416. Throughput: 0: 10369.3. Samples: 451458760. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:28,989][27935] Avg episode reward: [(0, '-3.429')] [2022-07-13 07:41:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5137.4). Total num frames: 225748992. Throughput: 0: 10356.5. Samples: 451521004. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:33,989][27935] Avg episode reward: [(0, '-3.511')] [2022-07-13 07:41:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5144.3). Total num frames: 225777664. Throughput: 0: 10358.5. Samples: 451552716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:38,989][27935] Avg episode reward: [(0, '-4.493')] [2022-07-13 07:41:43,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5205.3, 300 sec: 5147.8). Total num frames: 225804288. Throughput: 0: 10364.3. Samples: 451616080. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:43,989][27935] Avg episode reward: [(0, '-4.232')] [2022-07-13 07:41:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5147.8). Total num frames: 225829888. Throughput: 0: 10462.5. Samples: 451678960. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:48,989][27935] Avg episode reward: [(0, '-5.761')] [2022-07-13 07:41:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5154.7). Total num frames: 225855488. Throughput: 0: 10466.2. Samples: 451710392. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:53,996][27935] Avg episode reward: [(0, '-6.180')] [2022-07-13 07:41:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5161.7). Total num frames: 225882112. Throughput: 0: 10472.4. Samples: 451773888. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:41:58,989][27935] Avg episode reward: [(0, '-6.755')] [2022-07-13 07:42:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.4, 300 sec: 5158.2). Total num frames: 225905664. Throughput: 0: 10411.5. Samples: 451833004. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:03,989][27935] Avg episode reward: [(0, '-7.741')] [2022-07-13 07:42:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5168.6). Total num frames: 225934336. Throughput: 0: 10427.0. Samples: 451864752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:08,989][27935] Avg episode reward: [(0, '-7.422')] [2022-07-13 07:42:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5172.1). Total num frames: 225959936. Throughput: 0: 10432.7. Samples: 451928232. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:13,989][27935] Avg episode reward: [(0, '-8.159')] [2022-07-13 07:42:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5165.1). Total num frames: 225985536. Throughput: 0: 10451.5. Samples: 451991320. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:18,989][27935] Avg episode reward: [(0, '-5.939')] [2022-07-13 07:42:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 226010112. Throughput: 0: 10395.5. Samples: 452020512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:23,990][27935] Avg episode reward: [(0, '-5.632')] [2022-07-13 07:42:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 226035712. Throughput: 0: 10368.1. Samples: 452082644. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:28,989][27935] Avg episode reward: [(0, '-4.985')] [2022-07-13 07:42:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 226062336. Throughput: 0: 10364.4. Samples: 452145356. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:33,989][27935] Avg episode reward: [(0, '-4.018')] [2022-07-13 07:42:38,997][27935] Fps is (10 sec: 5320.6, 60 sec: 5187.6, 300 sec: 5178.9). Total num frames: 226088960. Throughput: 0: 10360.7. Samples: 452176704. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:38,998][27935] Avg episode reward: [(0, '-3.659')] [2022-07-13 07:42:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 226114560. Throughput: 0: 10313.5. Samples: 452237996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:43,989][27935] Avg episode reward: [(0, '-3.321')] [2022-07-13 07:42:48,989][27935] Fps is (10 sec: 5124.0, 60 sec: 5171.2, 300 sec: 5182.5). Total num frames: 226140160. Throughput: 0: 10397.1. Samples: 452300872. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:48,989][27935] Avg episode reward: [(0, '-3.321')] [2022-07-13 07:42:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 226166784. Throughput: 0: 10389.1. Samples: 452332264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:53,989][27935] Avg episode reward: [(0, '-4.613')] [2022-07-13 07:42:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 226191360. Throughput: 0: 10373.1. Samples: 452395020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:42:58,989][27935] Avg episode reward: [(0, '-7.037')] [2022-07-13 07:43:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 226216960. Throughput: 0: 10260.3. Samples: 452453036. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:43:03,989][27935] Avg episode reward: [(0, '-6.436')] [2022-07-13 07:43:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 226243584. Throughput: 0: 10308.6. Samples: 452484400. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:43:08,989][27935] Avg episode reward: [(0, '-7.774')] [2022-07-13 07:43:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 226268160. Throughput: 0: 10314.4. Samples: 452546792. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:43:13,989][27935] Avg episode reward: [(0, '-7.299')] [2022-07-13 07:43:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5199.8). Total num frames: 226294784. Throughput: 0: 10304.1. Samples: 452609040. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 07:43:18,989][27935] Avg episode reward: [(0, '-7.796')] [2022-07-13 07:43:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 226321408. Throughput: 0: 10309.1. Samples: 452640532. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:23,989][27935] Avg episode reward: [(0, '-8.713')] [2022-07-13 07:43:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 226348032. Throughput: 0: 10334.2. Samples: 452703036. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:28,989][27935] Avg episode reward: [(0, '-6.123')] [2022-07-13 07:43:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 226373632. Throughput: 0: 10326.2. Samples: 452765552. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:33,989][27935] Avg episode reward: [(0, '-6.097')] [2022-07-13 07:43:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.9, 300 sec: 5192.9). Total num frames: 226399232. Throughput: 0: 10326.6. Samples: 452796960. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:38,989][27935] Avg episode reward: [(0, '-5.888')] [2022-07-13 07:43:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 226424832. Throughput: 0: 10335.8. Samples: 452860132. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:43,989][27935] Avg episode reward: [(0, '-4.478')] [2022-07-13 07:43:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 226451456. Throughput: 0: 10443.9. Samples: 452923012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:48,989][27935] Avg episode reward: [(0, '-4.996')] [2022-07-13 07:43:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 226478080. Throughput: 0: 10447.0. Samples: 452954516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:53,989][27935] Avg episode reward: [(0, '-4.558')] [2022-07-13 07:43:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 226503680. Throughput: 0: 10451.7. Samples: 453017116. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:43:58,989][27935] Avg episode reward: [(0, '-3.798')] [2022-07-13 07:44:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 226529280. Throughput: 0: 10383.0. Samples: 453076272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:03,991][27935] Avg episode reward: [(0, '-3.877')] [2022-07-13 07:44:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 226553856. Throughput: 0: 10382.9. Samples: 453107760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:08,989][27935] Avg episode reward: [(0, '-4.944')] [2022-07-13 07:44:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 226582528. Throughput: 0: 10402.8. Samples: 453171160. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:13,989][27935] Avg episode reward: [(0, '-5.462')] [2022-07-13 07:44:18,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5205.0, 300 sec: 5196.3). Total num frames: 226607104. Throughput: 0: 10416.0. Samples: 453234312. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:18,993][27935] Avg episode reward: [(0, '-6.964')] [2022-07-13 07:44:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 226633728. Throughput: 0: 10413.7. Samples: 453265576. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:23,989][27935] Avg episode reward: [(0, '-6.471')] [2022-07-13 07:44:28,989][27935] Fps is (10 sec: 5429.2, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 226661376. Throughput: 0: 10409.3. Samples: 453328552. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:28,989][27935] Avg episode reward: [(0, '-7.236')] [2022-07-13 07:44:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 226685952. Throughput: 0: 9705.9. Samples: 453359776. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:33,989][27935] Avg episode reward: [(0, '-7.191')] [2022-07-13 07:44:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 226711552. Throughput: 0: 10390.9. Samples: 453422108. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:38,989][27935] Avg episode reward: [(0, '-5.883')] [2022-07-13 07:44:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 226738176. Throughput: 0: 10409.4. Samples: 453485540. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:43,989][27935] Avg episode reward: [(0, '-4.923')] [2022-07-13 07:44:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 226764800. Throughput: 0: 10494.3. Samples: 453548516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:48,989][27935] Avg episode reward: [(0, '-5.741')] [2022-07-13 07:44:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 226791424. Throughput: 0: 10491.4. Samples: 453579872. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:53,989][27935] Avg episode reward: [(0, '-5.196')] [2022-07-13 07:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.2). Total num frames: 226817024. Throughput: 0: 10485.7. Samples: 453643016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:44:58,989][27935] Avg episode reward: [(0, '-5.149')] [2022-07-13 07:45:03,989][27935] Fps is (10 sec: 4914.9, 60 sec: 5188.2, 300 sec: 5192.9). Total num frames: 226840576. Throughput: 0: 10395.1. Samples: 453702060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:03,990][27935] Avg episode reward: [(0, '-5.923')] [2022-07-13 07:45:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 226868224. Throughput: 0: 10400.1. Samples: 453733580. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:08,989][27935] Avg episode reward: [(0, '-6.542')] [2022-07-13 07:45:13,989][27935] Fps is (10 sec: 5222.7, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 226892800. Throughput: 0: 10400.5. Samples: 453796576. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:13,989][27935] Avg episode reward: [(0, '-7.471')] [2022-07-13 07:45:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.6, 300 sec: 5192.9). Total num frames: 226919424. Throughput: 0: 11107.6. Samples: 453859620. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:18,989][27935] Avg episode reward: [(0, '-7.440')] [2022-07-13 07:45:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 226946048. Throughput: 0: 10421.6. Samples: 453891080. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:23,989][27935] Avg episode reward: [(0, '-6.115')] [2022-07-13 07:45:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 226971648. Throughput: 0: 10406.0. Samples: 453953812. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:28,992][27935] Avg episode reward: [(0, '-5.910')] [2022-07-13 07:45:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 226999296. Throughput: 0: 10398.6. Samples: 454016452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 07:45:33,989][27935] Avg episode reward: [(0, '-5.088')] [2022-07-13 07:45:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 227023872. Throughput: 0: 10406.7. Samples: 454048172. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:45:38,989][27935] Avg episode reward: [(0, '-5.259')] [2022-07-13 07:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 227050496. Throughput: 0: 10402.8. Samples: 454111140. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:45:43,989][27935] Avg episode reward: [(0, '-4.430')] [2022-07-13 07:45:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 227077120. Throughput: 0: 10482.1. Samples: 454173748. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:45:48,989][27935] Avg episode reward: [(0, '-4.180')] [2022-07-13 07:45:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 227103744. Throughput: 0: 10480.9. Samples: 454205220. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:45:53,989][27935] Avg episode reward: [(0, '-4.874')] [2022-07-13 07:45:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 227129344. Throughput: 0: 10487.8. Samples: 454268524. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:45:58,989][27935] Avg episode reward: [(0, '-4.041')] [2022-07-13 07:46:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 227154944. Throughput: 0: 10392.7. Samples: 454327292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:03,989][27935] Avg episode reward: [(0, '-3.865')] [2022-07-13 07:46:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 227180544. Throughput: 0: 10395.6. Samples: 454358884. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:08,989][27935] Avg episode reward: [(0, '-4.726')] [2022-07-13 07:46:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 227207168. Throughput: 0: 10398.9. Samples: 454421764. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:13,989][27935] Avg episode reward: [(0, '-4.714')] [2022-07-13 07:46:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 227232768. Throughput: 0: 10401.2. Samples: 454484504. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:18,989][27935] Avg episode reward: [(0, '-5.339')] [2022-07-13 07:46:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 227257344. Throughput: 0: 10395.5. Samples: 454515968. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:23,989][27935] Avg episode reward: [(0, '-6.050')] [2022-07-13 07:46:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5206.8). Total num frames: 227284992. Throughput: 0: 10387.9. Samples: 454578596. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:28,991][27935] Avg episode reward: [(0, '-6.935')] [2022-07-13 07:46:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 227310592. Throughput: 0: 10378.9. Samples: 454640800. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:33,989][27935] Avg episode reward: [(0, '-7.126')] [2022-07-13 07:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 227337216. Throughput: 0: 10373.3. Samples: 454672020. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:38,990][27935] Avg episode reward: [(0, '-6.836')] [2022-07-13 07:46:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 227362816. Throughput: 0: 10367.2. Samples: 454735048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:43,990][27935] Avg episode reward: [(0, '-6.213')] [2022-07-13 07:46:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 227390464. Throughput: 0: 10449.0. Samples: 454797496. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:48,989][27935] Avg episode reward: [(0, '-5.032')] [2022-07-13 07:46:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 227415040. Throughput: 0: 10446.5. Samples: 454828976. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:53,989][27935] Avg episode reward: [(0, '-5.546')] [2022-07-13 07:46:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 227441664. Throughput: 0: 10441.3. Samples: 454891620. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:46:58,989][27935] Avg episode reward: [(0, '-4.325')] [2022-07-13 07:47:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 227465216. Throughput: 0: 10355.7. Samples: 454950512. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:03,991][27935] Avg episode reward: [(0, '-4.987')] [2022-07-13 07:47:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 227491840. Throughput: 0: 10345.0. Samples: 454981496. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:08,991][27935] Avg episode reward: [(0, '-4.728')] [2022-07-13 07:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 227517440. Throughput: 0: 10343.4. Samples: 455044048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:13,989][27935] Avg episode reward: [(0, '-5.692')] [2022-07-13 07:47:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 227545088. Throughput: 0: 9656.5. Samples: 455075344. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:18,989][27935] Avg episode reward: [(0, '-6.678')] [2022-07-13 07:47:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 227569664. Throughput: 0: 10366.4. Samples: 455138508. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:23,989][27935] Avg episode reward: [(0, '-5.833')] [2022-07-13 07:47:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 227595264. Throughput: 0: 10353.6. Samples: 455200960. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:28,989][27935] Avg episode reward: [(0, '-5.207')] [2022-07-13 07:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.5). Total num frames: 227621888. Throughput: 0: 10342.5. Samples: 455262908. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:33,989][27935] Avg episode reward: [(0, '-6.089')] [2022-07-13 07:47:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 227648512. Throughput: 0: 10334.2. Samples: 455294016. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:38,989][27935] Avg episode reward: [(0, '-5.438')] [2022-07-13 07:47:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 227673088. Throughput: 0: 10299.8. Samples: 455355112. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:43,989][27935] Avg episode reward: [(0, '-5.972')] [2022-07-13 07:47:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 227698688. Throughput: 0: 10379.3. Samples: 455417580. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 07:47:48,989][27935] Avg episode reward: [(0, '-3.709')] [2022-07-13 07:47:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 227725312. Throughput: 0: 10388.0. Samples: 455448956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:47:53,989][27935] Avg episode reward: [(0, '-4.582')] [2022-07-13 07:47:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 227751936. Throughput: 0: 10388.7. Samples: 455511540. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:47:58,989][27935] Avg episode reward: [(0, '-5.102')] [2022-07-13 07:48:03,992][27935] Fps is (10 sec: 5015.8, 60 sec: 5170.9, 300 sec: 5192.8). Total num frames: 227775488. Throughput: 0: 10977.7. Samples: 455569380. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:03,993][27935] Avg episode reward: [(0, '-8.097')] [2022-07-13 07:48:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 227802112. Throughput: 0: 10276.0. Samples: 455600928. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:08,989][27935] Avg episode reward: [(0, '-7.685')] [2022-07-13 07:48:13,991][27935] Fps is (10 sec: 5222.9, 60 sec: 5171.0, 300 sec: 5196.3). Total num frames: 227827712. Throughput: 0: 10279.2. Samples: 455663548. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:13,992][27935] Avg episode reward: [(0, '-7.074')] [2022-07-13 07:48:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5189.4). Total num frames: 227852288. Throughput: 0: 10291.2. Samples: 455726012. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:18,989][27935] Avg episode reward: [(0, '-6.968')] [2022-07-13 07:48:23,989][27935] Fps is (10 sec: 5121.3, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 227878912. Throughput: 0: 10291.6. Samples: 455757140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:23,989][27935] Avg episode reward: [(0, '-5.890')] [2022-07-13 07:48:28,990][27935] Fps is (10 sec: 5119.2, 60 sec: 5136.9, 300 sec: 5185.9). Total num frames: 227903488. Throughput: 0: 10239.0. Samples: 455815884. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:28,991][27935] Avg episode reward: [(0, '-6.345')] [2022-07-13 07:48:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5182.5). Total num frames: 227928064. Throughput: 0: 10205.0. Samples: 455876804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:33,989][27935] Avg episode reward: [(0, '-4.685')] [2022-07-13 07:48:38,989][27935] Fps is (10 sec: 5120.8, 60 sec: 5102.9, 300 sec: 5186.0). Total num frames: 227954688. Throughput: 0: 10188.6. Samples: 455907444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:38,989][27935] Avg episode reward: [(0, '-3.763')] [2022-07-13 07:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5182.5). Total num frames: 227980288. Throughput: 0: 10180.9. Samples: 455969680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:43,989][27935] Avg episode reward: [(0, '-3.940')] [2022-07-13 07:48:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5182.5). Total num frames: 228006912. Throughput: 0: 10286.1. Samples: 456032216. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:48,989][27935] Avg episode reward: [(0, '-4.029')] [2022-07-13 07:48:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5179.0). Total num frames: 228031488. Throughput: 0: 10281.9. Samples: 456063612. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:53,989][27935] Avg episode reward: [(0, '-4.788')] [2022-07-13 07:48:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5182.5). Total num frames: 228058112. Throughput: 0: 10273.1. Samples: 456125812. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:48:58,989][27935] Avg episode reward: [(0, '-4.312')] [2022-07-13 07:49:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.4, 300 sec: 5186.0). Total num frames: 228083712. Throughput: 0: 10179.9. Samples: 456184108. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:03,992][27935] Avg episode reward: [(0, '-4.971')] [2022-07-13 07:49:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5175.5). Total num frames: 228109312. Throughput: 0: 10191.2. Samples: 456215744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:08,989][27935] Avg episode reward: [(0, '-4.787')] [2022-07-13 07:49:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5103.1, 300 sec: 5175.6). Total num frames: 228133888. Throughput: 0: 10280.0. Samples: 456278468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:13,989][27935] Avg episode reward: [(0, '-4.460')] [2022-07-13 07:49:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5175.5). Total num frames: 228160512. Throughput: 0: 10318.6. Samples: 456341140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:18,989][27935] Avg episode reward: [(0, '-4.822')] [2022-07-13 07:49:23,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 228188160. Throughput: 0: 10338.8. Samples: 456372692. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:23,989][27935] Avg episode reward: [(0, '-6.177')] [2022-07-13 07:49:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.3, 300 sec: 5175.5). Total num frames: 228212736. Throughput: 0: 10356.6. Samples: 456435728. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:28,989][27935] Avg episode reward: [(0, '-6.309')] [2022-07-13 07:49:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 228239360. Throughput: 0: 10346.4. Samples: 456497804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:33,989][27935] Avg episode reward: [(0, '-6.123')] [2022-07-13 07:49:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 228264960. Throughput: 0: 10342.1. Samples: 456529008. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:38,989][27935] Avg episode reward: [(0, '-6.391')] [2022-07-13 07:49:43,991][27935] Fps is (10 sec: 5221.0, 60 sec: 5188.0, 300 sec: 5175.5). Total num frames: 228291584. Throughput: 0: 10372.6. Samples: 456592608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:43,992][27935] Avg episode reward: [(0, '-5.866')] [2022-07-13 07:49:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 228317184. Throughput: 0: 10475.2. Samples: 456655492. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:48,989][27935] Avg episode reward: [(0, '-5.367')] [2022-07-13 07:49:53,989][27935] Fps is (10 sec: 5428.6, 60 sec: 5239.5, 300 sec: 5182.5). Total num frames: 228345856. Throughput: 0: 10474.3. Samples: 456687088. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:53,990][27935] Avg episode reward: [(0, '-3.873')] [2022-07-13 07:49:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 228371456. Throughput: 0: 10483.5. Samples: 456750224. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:49:58,991][27935] Avg episode reward: [(0, '-3.846')] [2022-07-13 07:50:03,990][27935] Fps is (10 sec: 4914.7, 60 sec: 5188.2, 300 sec: 5175.5). Total num frames: 228395008. Throughput: 0: 10388.5. Samples: 456808632. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:50:03,990][27935] Avg episode reward: [(0, '-4.754')] [2022-07-13 07:50:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 228420608. Throughput: 0: 10379.8. Samples: 456839784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 07:50:08,991][27935] Avg episode reward: [(0, '-4.855')] [2022-07-13 07:50:13,989][27935] Fps is (10 sec: 5222.9, 60 sec: 5222.4, 300 sec: 5179.0). Total num frames: 228447232. Throughput: 0: 10367.9. Samples: 456902284. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:13,994][27935] Avg episode reward: [(0, '-5.846')] [2022-07-13 07:50:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 228471808. Throughput: 0: 10375.9. Samples: 456964720. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:18,989][27935] Avg episode reward: [(0, '-5.864')] [2022-07-13 07:50:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.0). Total num frames: 228499456. Throughput: 0: 10376.4. Samples: 456995944. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:23,989][27935] Avg episode reward: [(0, '-5.362')] [2022-07-13 07:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 228524032. Throughput: 0: 10349.9. Samples: 457058328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:28,989][27935] Avg episode reward: [(0, '-4.520')] [2022-07-13 07:50:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 228550656. Throughput: 0: 10316.6. Samples: 457119740. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:33,989][27935] Avg episode reward: [(0, '-3.915')] [2022-07-13 07:50:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 228576256. Throughput: 0: 10303.8. Samples: 457150760. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:38,989][27935] Avg episode reward: [(0, '-3.963')] [2022-07-13 07:50:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.5, 300 sec: 5172.1). Total num frames: 228602880. Throughput: 0: 10296.3. Samples: 457213556. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:43,989][27935] Avg episode reward: [(0, '-1.741')] [2022-07-13 07:50:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 228628480. Throughput: 0: 10391.9. Samples: 457276256. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:48,989][27935] Avg episode reward: [(0, '-1.721')] [2022-07-13 07:50:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5168.6). Total num frames: 228654080. Throughput: 0: 10392.6. Samples: 457307452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:53,989][27935] Avg episode reward: [(0, '-2.435')] [2022-07-13 07:50:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 228680704. Throughput: 0: 10398.4. Samples: 457370212. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:50:58,989][27935] Avg episode reward: [(0, '-3.288')] [2022-07-13 07:51:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.3, 300 sec: 5168.6). Total num frames: 228705280. Throughput: 0: 10310.2. Samples: 457428680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:03,991][27935] Avg episode reward: [(0, '-4.125')] [2022-07-13 07:51:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 228730880. Throughput: 0: 10312.1. Samples: 457459988. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:08,989][27935] Avg episode reward: [(0, '-4.222')] [2022-07-13 07:51:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 228757504. Throughput: 0: 10320.0. Samples: 457522728. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:13,989][27935] Avg episode reward: [(0, '-4.586')] [2022-07-13 07:51:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 228782080. Throughput: 0: 10331.0. Samples: 457584636. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:18,990][27935] Avg episode reward: [(0, '-6.073')] [2022-07-13 07:51:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5161.7). Total num frames: 228807680. Throughput: 0: 10322.5. Samples: 457615272. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:23,990][27935] Avg episode reward: [(0, '-6.924')] [2022-07-13 07:51:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5165.1). Total num frames: 228834304. Throughput: 0: 10299.0. Samples: 457677012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:28,989][27935] Avg episode reward: [(0, '-5.673')] [2022-07-13 07:51:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5154.7). Total num frames: 228857856. Throughput: 0: 10252.9. Samples: 457737636. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:33,989][27935] Avg episode reward: [(0, '-4.976')] [2022-07-13 07:51:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5161.7). Total num frames: 228885504. Throughput: 0: 10254.8. Samples: 457768920. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:38,989][27935] Avg episode reward: [(0, '-5.225')] [2022-07-13 07:51:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 228911104. Throughput: 0: 10235.8. Samples: 457830824. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:43,989][27935] Avg episode reward: [(0, '-4.373')] [2022-07-13 07:51:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 228934656. Throughput: 0: 10308.6. Samples: 457892568. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:48,989][27935] Avg episode reward: [(0, '-4.284')] [2022-07-13 07:51:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5154.7). Total num frames: 228962304. Throughput: 0: 10294.7. Samples: 457923248. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:53,989][27935] Avg episode reward: [(0, '-5.193')] [2022-07-13 07:51:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 228987904. Throughput: 0: 10272.3. Samples: 457984980. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:51:58,990][27935] Avg episode reward: [(0, '-5.593')] [2022-07-13 07:52:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 229011456. Throughput: 0: 10166.6. Samples: 458042132. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:52:03,994][27935] Avg episode reward: [(0, '-5.035')] [2022-07-13 07:52:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 229037056. Throughput: 0: 10175.2. Samples: 458073156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:52:08,989][27935] Avg episode reward: [(0, '-5.229')] [2022-07-13 07:52:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5144.3). Total num frames: 229062656. Throughput: 0: 10183.8. Samples: 458135284. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:52:13,989][27935] Avg episode reward: [(0, '-5.936')] [2022-07-13 07:52:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5147.8). Total num frames: 229088256. Throughput: 0: 10204.3. Samples: 458196828. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:52:18,989][27935] Avg episode reward: [(0, '-5.825')] [2022-07-13 07:52:23,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5120.0, 300 sec: 5151.2). Total num frames: 229114880. Throughput: 0: 10193.4. Samples: 458227628. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 07:52:23,990][27935] Avg episode reward: [(0, '-4.400')] [2022-07-13 07:52:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5140.8). Total num frames: 229138432. Throughput: 0: 10197.7. Samples: 458289720. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:28,989][27935] Avg episode reward: [(0, '-4.447')] [2022-07-13 07:52:33,989][27935] Fps is (10 sec: 5120.2, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 229166080. Throughput: 0: 10192.2. Samples: 458351216. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:33,989][27935] Avg episode reward: [(0, '-4.902')] [2022-07-13 07:52:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5102.9, 300 sec: 5147.8). Total num frames: 229191680. Throughput: 0: 10191.7. Samples: 458381872. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:38,989][27935] Avg episode reward: [(0, '-4.263')] [2022-07-13 07:52:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5144.3). Total num frames: 229216256. Throughput: 0: 10180.1. Samples: 458443084. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:43,989][27935] Avg episode reward: [(0, '-3.950')] [2022-07-13 07:52:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 229243904. Throughput: 0: 10296.6. Samples: 458505480. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:48,989][27935] Avg episode reward: [(0, '-4.483')] [2022-07-13 07:52:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 229269504. Throughput: 0: 10306.5. Samples: 458536948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:53,989][27935] Avg episode reward: [(0, '-5.581')] [2022-07-13 07:52:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5151.3). Total num frames: 229295104. Throughput: 0: 10313.0. Samples: 458599368. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:52:58,989][27935] Avg episode reward: [(0, '-5.204')] [2022-07-13 07:53:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 229318656. Throughput: 0: 10255.4. Samples: 458658320. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:03,991][27935] Avg episode reward: [(0, '-7.254')] [2022-07-13 07:53:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5151.3). Total num frames: 229347328. Throughput: 0: 10270.0. Samples: 458689772. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:08,990][27935] Avg episode reward: [(0, '-6.712')] [2022-07-13 07:53:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 229371904. Throughput: 0: 10287.0. Samples: 458752636. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:13,989][27935] Avg episode reward: [(0, '-5.354')] [2022-07-13 07:53:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 229397504. Throughput: 0: 10314.6. Samples: 458815372. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:18,991][27935] Avg episode reward: [(0, '-6.271')] [2022-07-13 07:53:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 229425152. Throughput: 0: 10325.7. Samples: 458846528. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:23,989][27935] Avg episode reward: [(0, '-5.594')] [2022-07-13 07:53:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5158.2). Total num frames: 229449728. Throughput: 0: 10347.1. Samples: 458908704. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:28,989][27935] Avg episode reward: [(0, '-5.628')] [2022-07-13 07:53:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5154.7). Total num frames: 229475328. Throughput: 0: 10339.7. Samples: 458970768. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:33,989][27935] Avg episode reward: [(0, '-5.621')] [2022-07-13 07:53:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 229501952. Throughput: 0: 10313.1. Samples: 459001040. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:38,989][27935] Avg episode reward: [(0, '-6.666')] [2022-07-13 07:53:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 229527552. Throughput: 0: 10321.5. Samples: 459063836. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:43,989][27935] Avg episode reward: [(0, '-8.134')] [2022-07-13 07:53:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5161.7). Total num frames: 229554176. Throughput: 0: 10407.6. Samples: 459126660. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:48,989][27935] Avg episode reward: [(0, '-7.263')] [2022-07-13 07:53:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 229579776. Throughput: 0: 10412.5. Samples: 459158336. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:53,989][27935] Avg episode reward: [(0, '-7.032')] [2022-07-13 07:53:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5161.7). Total num frames: 229606400. Throughput: 0: 10414.8. Samples: 459221300. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:53:58,989][27935] Avg episode reward: [(0, '-6.264')] [2022-07-13 07:54:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 229629952. Throughput: 0: 10323.0. Samples: 459279908. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:03,989][27935] Avg episode reward: [(0, '-4.803')] [2022-07-13 07:54:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5158.2). Total num frames: 229655552. Throughput: 0: 10314.3. Samples: 459310672. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:08,991][27935] Avg episode reward: [(0, '-3.937')] [2022-07-13 07:54:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5158.2). Total num frames: 229682176. Throughput: 0: 10335.6. Samples: 459373808. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:13,989][27935] Avg episode reward: [(0, '-2.261')] [2022-07-13 07:54:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 229708800. Throughput: 0: 10339.3. Samples: 459436036. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:18,989][27935] Avg episode reward: [(0, '-3.250')] [2022-07-13 07:54:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 229734400. Throughput: 0: 10373.4. Samples: 459467844. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:23,991][27935] Avg episode reward: [(0, '-3.019')] [2022-07-13 07:54:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 229760000. Throughput: 0: 10356.3. Samples: 459529868. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:28,991][27935] Avg episode reward: [(0, '-3.964')] [2022-07-13 07:54:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 229785600. Throughput: 0: 10293.2. Samples: 459589852. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:33,990][27935] Avg episode reward: [(0, '-5.859')] [2022-07-13 07:54:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.3). Total num frames: 229811200. Throughput: 0: 10275.2. Samples: 459620720. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:38,991][27935] Avg episode reward: [(0, '-6.283')] [2022-07-13 07:54:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 229836800. Throughput: 0: 10271.5. Samples: 459683516. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:43,989][27935] Avg episode reward: [(0, '-6.539')] [2022-07-13 07:54:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 229863424. Throughput: 0: 10354.8. Samples: 459745876. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:48,989][27935] Avg episode reward: [(0, '-7.040')] [2022-07-13 07:54:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 229889024. Throughput: 0: 10363.6. Samples: 459777036. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:53,989][27935] Avg episode reward: [(0, '-6.930')] [2022-07-13 07:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5154.7). Total num frames: 229915648. Throughput: 0: 10353.3. Samples: 459839704. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:54:58,989][27935] Avg episode reward: [(0, '-5.148')] [2022-07-13 07:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 229939200. Throughput: 0: 10255.5. Samples: 459897532. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:03,989][27935] Avg episode reward: [(0, '-5.272')] [2022-07-13 07:55:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 229965824. Throughput: 0: 10246.0. Samples: 459928916. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:08,989][27935] Avg episode reward: [(0, '-5.437')] [2022-07-13 07:55:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 229990400. Throughput: 0: 10254.1. Samples: 459991304. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:13,989][27935] Avg episode reward: [(0, '-3.873')] [2022-07-13 07:55:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 230017024. Throughput: 0: 10306.7. Samples: 460053656. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:18,990][27935] Avg episode reward: [(0, '-3.523')] [2022-07-13 07:55:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 230043648. Throughput: 0: 10320.0. Samples: 460085120. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:23,989][27935] Avg episode reward: [(0, '-3.982')] [2022-07-13 07:55:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5147.8). Total num frames: 230069248. Throughput: 0: 10330.4. Samples: 460148384. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:28,989][27935] Avg episode reward: [(0, '-4.329')] [2022-07-13 07:55:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5151.2). Total num frames: 230095872. Throughput: 0: 10324.9. Samples: 460210496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:33,989][27935] Avg episode reward: [(0, '-4.288')] [2022-07-13 07:55:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 230120448. Throughput: 0: 10324.9. Samples: 460241656. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:38,989][27935] Avg episode reward: [(0, '-5.224')] [2022-07-13 07:55:43,990][27935] Fps is (10 sec: 5119.5, 60 sec: 5171.1, 300 sec: 5147.8). Total num frames: 230147072. Throughput: 0: 10322.5. Samples: 460304228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:43,990][27935] Avg episode reward: [(0, '-7.314')] [2022-07-13 07:55:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5151.2). Total num frames: 230173696. Throughput: 0: 10421.3. Samples: 460366492. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:48,989][27935] Avg episode reward: [(0, '-7.820')] [2022-07-13 07:55:53,989][27935] Fps is (10 sec: 5325.3, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 230200320. Throughput: 0: 10431.0. Samples: 460398312. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:53,989][27935] Avg episode reward: [(0, '-8.337')] [2022-07-13 07:55:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 230225920. Throughput: 0: 10437.5. Samples: 460460992. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:55:58,989][27935] Avg episode reward: [(0, '-7.828')] [2022-07-13 07:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5151.2). Total num frames: 230250496. Throughput: 0: 10351.1. Samples: 460519456. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:03,989][27935] Avg episode reward: [(0, '-7.463')] [2022-07-13 07:56:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 230276096. Throughput: 0: 10343.6. Samples: 460550580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:08,989][27935] Avg episode reward: [(0, '-6.287')] [2022-07-13 07:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5154.7). Total num frames: 230302720. Throughput: 0: 10334.8. Samples: 460613452. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:13,989][27935] Avg episode reward: [(0, '-5.776')] [2022-07-13 07:56:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5158.2). Total num frames: 230329344. Throughput: 0: 10334.0. Samples: 460675528. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:18,989][27935] Avg episode reward: [(0, '-4.730')] [2022-07-13 07:56:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5151.2). Total num frames: 230353920. Throughput: 0: 10331.8. Samples: 460706588. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:23,989][27935] Avg episode reward: [(0, '-3.456')] [2022-07-13 07:56:28,989][27935] Fps is (10 sec: 5119.7, 60 sec: 5188.2, 300 sec: 5161.6). Total num frames: 230380544. Throughput: 0: 10335.1. Samples: 460769304. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:28,990][27935] Avg episode reward: [(0, '-4.158')] [2022-07-13 07:56:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5154.7). Total num frames: 230406144. Throughput: 0: 10326.8. Samples: 460831200. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:33,990][27935] Avg episode reward: [(0, '-4.342')] [2022-07-13 07:56:38,989][27935] Fps is (10 sec: 5120.3, 60 sec: 5188.3, 300 sec: 5154.7). Total num frames: 230431744. Throughput: 0: 10314.8. Samples: 460862480. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:38,991][27935] Avg episode reward: [(0, '-5.066')] [2022-07-13 07:56:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.4, 300 sec: 5168.6). Total num frames: 230459392. Throughput: 0: 10311.0. Samples: 460924988. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:43,989][27935] Avg episode reward: [(0, '-5.832')] [2022-07-13 07:56:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5154.7). Total num frames: 230482944. Throughput: 0: 10407.9. Samples: 460987812. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:48,991][27935] Avg episode reward: [(0, '-5.729')] [2022-07-13 07:56:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5165.1). Total num frames: 230511616. Throughput: 0: 10415.1. Samples: 461019260. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:53,989][27935] Avg episode reward: [(0, '-4.735')] [2022-07-13 07:56:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 230536192. Throughput: 0: 10421.0. Samples: 461082396. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 07:56:58,990][27935] Avg episode reward: [(0, '-3.448')] [2022-07-13 07:57:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5168.6). Total num frames: 230561792. Throughput: 0: 10347.7. Samples: 461141176. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:03,989][27935] Avg episode reward: [(0, '-3.431')] [2022-07-13 07:57:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 230588416. Throughput: 0: 10359.6. Samples: 461172768. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:08,989][27935] Avg episode reward: [(0, '-3.457')] [2022-07-13 07:57:13,992][27935] Fps is (10 sec: 5118.5, 60 sec: 5171.0, 300 sec: 5168.5). Total num frames: 230612992. Throughput: 0: 10372.7. Samples: 461236100. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:13,996][27935] Avg episode reward: [(0, '-4.012')] [2022-07-13 07:57:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5165.1). Total num frames: 230638592. Throughput: 0: 10394.3. Samples: 461298944. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:18,989][27935] Avg episode reward: [(0, '-3.933')] [2022-07-13 07:57:23,989][27935] Fps is (10 sec: 5428.7, 60 sec: 5222.4, 300 sec: 5182.5). Total num frames: 230667264. Throughput: 0: 10395.5. Samples: 461330280. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:23,989][27935] Avg episode reward: [(0, '-3.842')] [2022-07-13 07:57:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 230691840. Throughput: 0: 10398.5. Samples: 461392920. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:28,989][27935] Avg episode reward: [(0, '-4.804')] [2022-07-13 07:57:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 230718464. Throughput: 0: 9692.6. Samples: 461423980. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:33,989][27935] Avg episode reward: [(0, '-5.475')] [2022-07-13 07:57:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 230744064. Throughput: 0: 10385.3. Samples: 461486600. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:38,989][27935] Avg episode reward: [(0, '-6.126')] [2022-07-13 07:57:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 230769664. Throughput: 0: 10352.4. Samples: 461548252. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:43,989][27935] Avg episode reward: [(0, '-5.803')] [2022-07-13 07:57:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5172.1). Total num frames: 230795264. Throughput: 0: 10451.3. Samples: 461611484. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:48,989][27935] Avg episode reward: [(0, '-5.722')] [2022-07-13 07:57:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 230821888. Throughput: 0: 10442.0. Samples: 461642656. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:53,989][27935] Avg episode reward: [(0, '-6.187')] [2022-07-13 07:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 230847488. Throughput: 0: 10434.3. Samples: 461705612. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:57:58,990][27935] Avg episode reward: [(0, '-5.660')] [2022-07-13 07:58:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5172.1). Total num frames: 230873088. Throughput: 0: 10340.6. Samples: 461764268. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:03,989][27935] Avg episode reward: [(0, '-5.377')] [2022-07-13 07:58:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 230898688. Throughput: 0: 10347.9. Samples: 461795936. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:08,989][27935] Avg episode reward: [(0, '-5.403')] [2022-07-13 07:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.5, 300 sec: 5175.5). Total num frames: 230924288. Throughput: 0: 10353.3. Samples: 461858820. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:13,989][27935] Avg episode reward: [(0, '-5.720')] [2022-07-13 07:58:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5175.5). Total num frames: 230951936. Throughput: 0: 11073.4. Samples: 461922284. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:18,989][27935] Avg episode reward: [(0, '-6.623')] [2022-07-13 07:58:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 230975488. Throughput: 0: 10383.5. Samples: 461953856. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:23,992][27935] Avg episode reward: [(0, '-6.180')] [2022-07-13 07:58:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 231004160. Throughput: 0: 10413.6. Samples: 462016864. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:28,990][27935] Avg episode reward: [(0, '-6.575')] [2022-07-13 07:58:33,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 231030784. Throughput: 0: 10403.3. Samples: 462079632. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:33,991][27935] Avg episode reward: [(0, '-7.656')] [2022-07-13 07:58:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 231056384. Throughput: 0: 10400.2. Samples: 462110664. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:38,989][27935] Avg episode reward: [(0, '-7.430')] [2022-07-13 07:58:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 231081984. Throughput: 0: 10401.6. Samples: 462173684. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:43,989][27935] Avg episode reward: [(0, '-7.916')] [2022-07-13 07:58:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 231107584. Throughput: 0: 10472.3. Samples: 462235520. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:48,989][27935] Avg episode reward: [(0, '-10.316')] [2022-07-13 07:58:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 231134208. Throughput: 0: 10468.2. Samples: 462267004. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:53,989][27935] Avg episode reward: [(0, '-9.151')] [2022-07-13 07:58:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5189.4). Total num frames: 231160832. Throughput: 0: 10469.0. Samples: 462329924. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:58:58,989][27935] Avg episode reward: [(0, '-8.453')] [2022-07-13 07:59:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 231184384. Throughput: 0: 10374.6. Samples: 462389140. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:59:03,989][27935] Avg episode reward: [(0, '-8.512')] [2022-07-13 07:59:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5182.5). Total num frames: 231211008. Throughput: 0: 10373.2. Samples: 462420648. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:59:08,989][27935] Avg episode reward: [(0, '-6.686')] [2022-07-13 07:59:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 231236608. Throughput: 0: 10370.0. Samples: 462483516. Policy #0 lag: (min: 0.0, avg: 10.2, max: 20.0) [2022-07-13 07:59:13,989][27935] Avg episode reward: [(0, '-4.767')] [2022-07-13 07:59:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 231263232. Throughput: 0: 10363.1. Samples: 462545972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:18,989][27935] Avg episode reward: [(0, '-3.145')] [2022-07-13 07:59:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5186.0). Total num frames: 231289856. Throughput: 0: 10383.2. Samples: 462577908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:23,989][27935] Avg episode reward: [(0, '-3.653')] [2022-07-13 07:59:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 231315456. Throughput: 0: 10376.6. Samples: 462640632. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:28,989][27935] Avg episode reward: [(0, '-5.464')] [2022-07-13 07:59:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 231341056. Throughput: 0: 10378.5. Samples: 462702552. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:33,989][27935] Avg episode reward: [(0, '-5.670')] [2022-07-13 07:59:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 231367680. Throughput: 0: 10373.0. Samples: 462733788. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:38,991][27935] Avg episode reward: [(0, '-6.015')] [2022-07-13 07:59:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 231393280. Throughput: 0: 10383.7. Samples: 462797192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:43,989][27935] Avg episode reward: [(0, '-7.049')] [2022-07-13 07:59:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 231421952. Throughput: 0: 10463.2. Samples: 462859984. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:48,989][27935] Avg episode reward: [(0, '-7.127')] [2022-07-13 07:59:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 231446528. Throughput: 0: 10469.5. Samples: 462891776. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:53,989][27935] Avg episode reward: [(0, '-6.608')] [2022-07-13 07:59:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 231473152. Throughput: 0: 10480.4. Samples: 462955132. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 07:59:58,989][27935] Avg episode reward: [(0, '-4.416')] [2022-07-13 08:00:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 231496704. Throughput: 0: 10393.9. Samples: 463013696. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:03,989][27935] Avg episode reward: [(0, '-4.231')] [2022-07-13 08:00:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 231522304. Throughput: 0: 10378.0. Samples: 463044916. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:08,989][27935] Avg episode reward: [(0, '-5.243')] [2022-07-13 08:00:14,000][27935] Fps is (10 sec: 5216.4, 60 sec: 5204.3, 300 sec: 5192.7). Total num frames: 231548928. Throughput: 0: 10389.4. Samples: 463108276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:14,001][27935] Avg episode reward: [(0, '-5.906')] [2022-07-13 08:00:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 231575552. Throughput: 0: 10416.1. Samples: 463171276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:18,990][27935] Avg episode reward: [(0, '-5.086')] [2022-07-13 08:00:23,989][27935] Fps is (10 sec: 5331.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 231602176. Throughput: 0: 10424.4. Samples: 463202884. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:23,989][27935] Avg episode reward: [(0, '-4.687')] [2022-07-13 08:00:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 231627776. Throughput: 0: 10424.4. Samples: 463266288. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:28,989][27935] Avg episode reward: [(0, '-5.761')] [2022-07-13 08:00:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 231654400. Throughput: 0: 10385.6. Samples: 463327336. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:33,989][27935] Avg episode reward: [(0, '-6.202')] [2022-07-13 08:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 231677952. Throughput: 0: 10347.1. Samples: 463357396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:38,989][27935] Avg episode reward: [(0, '-5.411')] [2022-07-13 08:00:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 231705600. Throughput: 0: 10332.3. Samples: 463420084. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:43,989][27935] Avg episode reward: [(0, '-5.297')] [2022-07-13 08:00:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 231731200. Throughput: 0: 10436.1. Samples: 463483320. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:48,989][27935] Avg episode reward: [(0, '-5.254')] [2022-07-13 08:00:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 231758848. Throughput: 0: 10455.6. Samples: 463515420. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:53,989][27935] Avg episode reward: [(0, '-5.750')] [2022-07-13 08:00:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 231784448. Throughput: 0: 10469.9. Samples: 463579300. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:00:58,989][27935] Avg episode reward: [(0, '-5.848')] [2022-07-13 08:01:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 231809024. Throughput: 0: 10357.5. Samples: 463637364. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:03,989][27935] Avg episode reward: [(0, '-3.771')] [2022-07-13 08:01:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 231834624. Throughput: 0: 10355.1. Samples: 463668864. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:08,990][27935] Avg episode reward: [(0, '-4.759')] [2022-07-13 08:01:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5206.3, 300 sec: 5192.9). Total num frames: 231861248. Throughput: 0: 10353.9. Samples: 463732212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:13,989][27935] Avg episode reward: [(0, '-4.603')] [2022-07-13 08:01:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 231886848. Throughput: 0: 10384.2. Samples: 463794624. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:18,989][27935] Avg episode reward: [(0, '-5.355')] [2022-07-13 08:01:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 231914496. Throughput: 0: 10405.9. Samples: 463825660. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:23,989][27935] Avg episode reward: [(0, '-4.959')] [2022-07-13 08:01:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 231940096. Throughput: 0: 10401.5. Samples: 463888152. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:28,989][27935] Avg episode reward: [(0, '-6.953')] [2022-07-13 08:01:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 231965696. Throughput: 0: 10367.5. Samples: 463949860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 08:01:33,989][27935] Avg episode reward: [(0, '-7.740')] [2022-07-13 08:01:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 231991296. Throughput: 0: 10348.9. Samples: 463981120. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:01:38,990][27935] Avg episode reward: [(0, '-6.241')] [2022-07-13 08:01:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 232016896. Throughput: 0: 10333.0. Samples: 464044284. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:01:43,990][27935] Avg episode reward: [(0, '-5.116')] [2022-07-13 08:01:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 232044544. Throughput: 0: 10431.5. Samples: 464106780. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:01:48,989][27935] Avg episode reward: [(0, '-5.166')] [2022-07-13 08:01:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 232069120. Throughput: 0: 10430.8. Samples: 464138248. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:01:53,991][27935] Avg episode reward: [(0, '-5.597')] [2022-07-13 08:01:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 232096768. Throughput: 0: 10421.5. Samples: 464201180. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:01:58,989][27935] Avg episode reward: [(0, '-4.555')] [2022-07-13 08:02:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 232119296. Throughput: 0: 10340.5. Samples: 464259944. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:03,989][27935] Avg episode reward: [(0, '-5.562')] [2022-07-13 08:02:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 232145920. Throughput: 0: 10344.6. Samples: 464291168. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:08,991][27935] Avg episode reward: [(0, '-5.977')] [2022-07-13 08:02:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 232172544. Throughput: 0: 10350.4. Samples: 464353920. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:13,989][27935] Avg episode reward: [(0, '-5.992')] [2022-07-13 08:02:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 232198144. Throughput: 0: 10370.9. Samples: 464416552. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:18,990][27935] Avg episode reward: [(0, '-7.384')] [2022-07-13 08:02:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 232224768. Throughput: 0: 10374.0. Samples: 464447952. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:23,989][27935] Avg episode reward: [(0, '-6.239')] [2022-07-13 08:02:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 232251392. Throughput: 0: 10364.2. Samples: 464510672. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:28,989][27935] Avg episode reward: [(0, '-5.036')] [2022-07-13 08:02:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 232276992. Throughput: 0: 9667.1. Samples: 464541800. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:33,991][27935] Avg episode reward: [(0, '-4.012')] [2022-07-13 08:02:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 232302592. Throughput: 0: 10360.7. Samples: 464604480. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:38,989][27935] Avg episode reward: [(0, '-2.745')] [2022-07-13 08:02:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 232329216. Throughput: 0: 10351.8. Samples: 464667012. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:43,989][27935] Avg episode reward: [(0, '-3.404')] [2022-07-13 08:02:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 232353792. Throughput: 0: 10430.0. Samples: 464729292. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:48,989][27935] Avg episode reward: [(0, '-2.483')] [2022-07-13 08:02:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 232381440. Throughput: 0: 10431.2. Samples: 464760572. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:53,989][27935] Avg episode reward: [(0, '-3.196')] [2022-07-13 08:02:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 232407040. Throughput: 0: 10429.8. Samples: 464823260. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:02:58,989][27935] Avg episode reward: [(0, '-2.895')] [2022-07-13 08:03:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 232431616. Throughput: 0: 10335.4. Samples: 464881644. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:03,989][27935] Avg episode reward: [(0, '-3.458')] [2022-07-13 08:03:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 232456192. Throughput: 0: 10334.0. Samples: 464912984. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:08,989][27935] Avg episode reward: [(0, '-3.711')] [2022-07-13 08:03:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232483840. Throughput: 0: 10347.4. Samples: 464976304. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:13,989][27935] Avg episode reward: [(0, '-3.816')] [2022-07-13 08:03:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 232509440. Throughput: 0: 11049.0. Samples: 465039004. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:18,990][27935] Avg episode reward: [(0, '-4.836')] [2022-07-13 08:03:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232536064. Throughput: 0: 10348.2. Samples: 465070148. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:23,989][27935] Avg episode reward: [(0, '-5.056')] [2022-07-13 08:03:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232562688. Throughput: 0: 10355.1. Samples: 465132992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:28,991][27935] Avg episode reward: [(0, '-5.913')] [2022-07-13 08:03:33,992][27935] Fps is (10 sec: 5118.3, 60 sec: 5170.9, 300 sec: 5189.4). Total num frames: 232587264. Throughput: 0: 10360.5. Samples: 465195548. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:33,994][27935] Avg episode reward: [(0, '-5.812')] [2022-07-13 08:03:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232613888. Throughput: 0: 10364.8. Samples: 465226988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:38,989][27935] Avg episode reward: [(0, '-5.578')] [2022-07-13 08:03:43,989][27935] Fps is (10 sec: 5326.5, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 232640512. Throughput: 0: 10373.7. Samples: 465290076. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:43,989][27935] Avg episode reward: [(0, '-4.902')] [2022-07-13 08:03:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 232667136. Throughput: 0: 10454.5. Samples: 465352096. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:03:48,992][27935] Avg episode reward: [(0, '-4.412')] [2022-07-13 08:03:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 232691712. Throughput: 0: 10444.0. Samples: 465382964. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:03:53,989][27935] Avg episode reward: [(0, '-3.719')] [2022-07-13 08:03:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 232717312. Throughput: 0: 10414.2. Samples: 465444944. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:03:58,989][27935] Avg episode reward: [(0, '-3.521')] [2022-07-13 08:04:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 232740864. Throughput: 0: 10312.0. Samples: 465503044. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:03,989][27935] Avg episode reward: [(0, '-4.530')] [2022-07-13 08:04:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 232768512. Throughput: 0: 10311.3. Samples: 465534156. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:08,989][27935] Avg episode reward: [(0, '-4.675')] [2022-07-13 08:04:13,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232795136. Throughput: 0: 10318.4. Samples: 465597320. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:13,989][27935] Avg episode reward: [(0, '-6.019')] [2022-07-13 08:04:19,017][27935] Fps is (10 sec: 5003.7, 60 sec: 5151.8, 300 sec: 5182.0). Total num frames: 232818688. Throughput: 0: 10326.1. Samples: 465660476. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:19,017][27935] Avg episode reward: [(0, '-5.619')] [2022-07-13 08:04:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232847360. Throughput: 0: 10329.4. Samples: 465691812. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:23,990][27935] Avg episode reward: [(0, '-5.651')] [2022-07-13 08:04:28,989][27935] Fps is (10 sec: 5442.3, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 232872960. Throughput: 0: 10337.9. Samples: 465755280. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:28,989][27935] Avg episode reward: [(0, '-7.670')] [2022-07-13 08:04:33,998][27935] Fps is (10 sec: 5217.6, 60 sec: 5204.8, 300 sec: 5192.7). Total num frames: 232899584. Throughput: 0: 10349.1. Samples: 465817900. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:33,999][27935] Avg episode reward: [(0, '-8.300')] [2022-07-13 08:04:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 232925184. Throughput: 0: 10363.2. Samples: 465849308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:38,989][27935] Avg episode reward: [(0, '-8.972')] [2022-07-13 08:04:43,989][27935] Fps is (10 sec: 5329.7, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 232952832. Throughput: 0: 10384.0. Samples: 465912224. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:43,990][27935] Avg episode reward: [(0, '-8.329')] [2022-07-13 08:04:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 232977408. Throughput: 0: 10501.2. Samples: 465975596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:48,989][27935] Avg episode reward: [(0, '-7.589')] [2022-07-13 08:04:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5189.4). Total num frames: 233004032. Throughput: 0: 10510.3. Samples: 466007120. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:53,990][27935] Avg episode reward: [(0, '-5.691')] [2022-07-13 08:04:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 233030656. Throughput: 0: 10511.8. Samples: 466070352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:04:58,989][27935] Avg episode reward: [(0, '-4.834')] [2022-07-13 08:05:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 233054208. Throughput: 0: 10419.1. Samples: 466129048. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:03,989][27935] Avg episode reward: [(0, '-3.506')] [2022-07-13 08:05:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5193.1). Total num frames: 233080832. Throughput: 0: 10417.5. Samples: 466160600. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:08,989][27935] Avg episode reward: [(0, '-6.466')] [2022-07-13 08:05:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 233107456. Throughput: 0: 10413.7. Samples: 466223896. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:13,989][27935] Avg episode reward: [(0, '-5.689')] [2022-07-13 08:05:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5241.9, 300 sec: 5189.4). Total num frames: 233133056. Throughput: 0: 10412.8. Samples: 466286380. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:18,991][27935] Avg episode reward: [(0, '-6.745')] [2022-07-13 08:05:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 233158656. Throughput: 0: 10406.0. Samples: 466317580. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:23,990][27935] Avg episode reward: [(0, '-8.803')] [2022-07-13 08:05:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 233186304. Throughput: 0: 10404.7. Samples: 466380436. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:28,989][27935] Avg episode reward: [(0, '-8.618')] [2022-07-13 08:05:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5206.1, 300 sec: 5199.8). Total num frames: 233211904. Throughput: 0: 10388.3. Samples: 466443068. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:33,989][27935] Avg episode reward: [(0, '-6.938')] [2022-07-13 08:05:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 233238528. Throughput: 0: 10388.1. Samples: 466474584. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:38,990][27935] Avg episode reward: [(0, '-6.193')] [2022-07-13 08:05:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 233264128. Throughput: 0: 10388.9. Samples: 466537852. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:43,991][27935] Avg episode reward: [(0, '-5.239')] [2022-07-13 08:05:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 233291776. Throughput: 0: 10488.0. Samples: 466601008. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:48,990][27935] Avg episode reward: [(0, '-6.055')] [2022-07-13 08:05:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 233316352. Throughput: 0: 10483.4. Samples: 466632352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:53,989][27935] Avg episode reward: [(0, '-5.796')] [2022-07-13 08:05:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 233344000. Throughput: 0: 10491.7. Samples: 466696024. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:05:58,991][27935] Avg episode reward: [(0, '-4.685')] [2022-07-13 08:06:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 233367552. Throughput: 0: 10417.9. Samples: 466755184. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:06:03,989][27935] Avg episode reward: [(0, '-3.746')] [2022-07-13 08:06:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 233395200. Throughput: 0: 10432.6. Samples: 466787048. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 08:06:08,989][27935] Avg episode reward: [(0, '-5.325')] [2022-07-13 08:06:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 233420800. Throughput: 0: 10439.5. Samples: 466850212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:13,989][27935] Avg episode reward: [(0, '-4.626')] [2022-07-13 08:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5192.9). Total num frames: 233446400. Throughput: 0: 10443.2. Samples: 466913012. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:18,989][27935] Avg episode reward: [(0, '-4.281')] [2022-07-13 08:06:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 233473024. Throughput: 0: 10437.4. Samples: 466944268. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:23,989][27935] Avg episode reward: [(0, '-5.555')] [2022-07-13 08:06:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 233498624. Throughput: 0: 10430.8. Samples: 467007236. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:28,989][27935] Avg episode reward: [(0, '-5.537')] [2022-07-13 08:06:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 233523200. Throughput: 0: 10415.0. Samples: 467069684. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:33,989][27935] Avg episode reward: [(0, '-5.291')] [2022-07-13 08:06:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 233550848. Throughput: 0: 10394.1. Samples: 467100084. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:38,989][27935] Avg episode reward: [(0, '-5.800')] [2022-07-13 08:06:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 233576448. Throughput: 0: 10327.1. Samples: 467160744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:43,989][27935] Avg episode reward: [(0, '-5.525')] [2022-07-13 08:06:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 233602048. Throughput: 0: 10402.1. Samples: 467223280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:48,989][27935] Avg episode reward: [(0, '-7.231')] [2022-07-13 08:06:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 233627648. Throughput: 0: 10388.2. Samples: 467254516. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:53,989][27935] Avg episode reward: [(0, '-6.638')] [2022-07-13 08:06:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 233654272. Throughput: 0: 10383.6. Samples: 467317476. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:06:58,990][27935] Avg episode reward: [(0, '-5.496')] [2022-07-13 08:07:03,992][27935] Fps is (10 sec: 5118.5, 60 sec: 5188.0, 300 sec: 5196.3). Total num frames: 233678848. Throughput: 0: 10294.6. Samples: 467376300. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:03,992][27935] Avg episode reward: [(0, '-5.912')] [2022-07-13 08:07:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 233704448. Throughput: 0: 10303.3. Samples: 467407916. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:08,989][27935] Avg episode reward: [(0, '-4.775')] [2022-07-13 08:07:13,989][27935] Fps is (10 sec: 5223.9, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 233731072. Throughput: 0: 10292.8. Samples: 467470412. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:13,989][27935] Avg episode reward: [(0, '-4.620')] [2022-07-13 08:07:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 233756672. Throughput: 0: 10304.1. Samples: 467533368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:18,989][27935] Avg episode reward: [(0, '-4.050')] [2022-07-13 08:07:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 233783296. Throughput: 0: 10337.0. Samples: 467565248. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:23,989][27935] Avg episode reward: [(0, '-4.436')] [2022-07-13 08:07:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 233808896. Throughput: 0: 10384.1. Samples: 467628028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:28,992][27935] Avg episode reward: [(0, '-3.569')] [2022-07-13 08:07:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 233836544. Throughput: 0: 10373.2. Samples: 467690072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:33,989][27935] Avg episode reward: [(0, '-4.255')] [2022-07-13 08:07:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 233861120. Throughput: 0: 10377.4. Samples: 467721500. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:38,989][27935] Avg episode reward: [(0, '-4.467')] [2022-07-13 08:07:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 233887744. Throughput: 0: 10325.8. Samples: 467782136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:43,989][27935] Avg episode reward: [(0, '-5.450')] [2022-07-13 08:07:48,997][27935] Fps is (10 sec: 5013.7, 60 sec: 5153.5, 300 sec: 5185.8). Total num frames: 233911296. Throughput: 0: 10393.6. Samples: 467844060. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:48,997][27935] Avg episode reward: [(0, '-4.094')] [2022-07-13 08:07:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 233936896. Throughput: 0: 10379.4. Samples: 467874988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:53,989][27935] Avg episode reward: [(0, '-4.788')] [2022-07-13 08:07:58,989][27935] Fps is (10 sec: 5329.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 233964544. Throughput: 0: 10379.2. Samples: 467937476. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:07:58,989][27935] Avg episode reward: [(0, '-4.479')] [2022-07-13 08:08:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.4, 300 sec: 5192.9). Total num frames: 233988096. Throughput: 0: 10276.5. Samples: 467995808. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:08:03,989][27935] Avg episode reward: [(0, '-4.577')] [2022-07-13 08:08:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 234014720. Throughput: 0: 10265.6. Samples: 468027200. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:08:08,989][27935] Avg episode reward: [(0, '-3.550')] [2022-07-13 08:08:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5189.4). Total num frames: 234040320. Throughput: 0: 10272.7. Samples: 468090300. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:08:13,989][27935] Avg episode reward: [(0, '-2.867')] [2022-07-13 08:08:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 234066944. Throughput: 0: 10289.6. Samples: 468153104. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:08:18,989][27935] Avg episode reward: [(0, '-2.675')] [2022-07-13 08:08:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 234092544. Throughput: 0: 10302.4. Samples: 468185108. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 08:08:23,989][27935] Avg episode reward: [(0, '-2.300')] [2022-07-13 08:08:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 234120192. Throughput: 0: 10352.5. Samples: 468248000. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:28,989][27935] Avg episode reward: [(0, '-2.465')] [2022-07-13 08:08:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5189.4). Total num frames: 234144768. Throughput: 0: 10375.0. Samples: 468310852. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:33,989][27935] Avg episode reward: [(0, '-2.650')] [2022-07-13 08:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 234171392. Throughput: 0: 10386.1. Samples: 468342364. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:38,989][27935] Avg episode reward: [(0, '-2.782')] [2022-07-13 08:08:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5186.0). Total num frames: 234196992. Throughput: 0: 10363.1. Samples: 468403816. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:43,991][27935] Avg episode reward: [(0, '-2.758')] [2022-07-13 08:08:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5206.0, 300 sec: 5192.9). Total num frames: 234223616. Throughput: 0: 10440.9. Samples: 468465648. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:48,989][27935] Avg episode reward: [(0, '-2.428')] [2022-07-13 08:08:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5189.4). Total num frames: 234248192. Throughput: 0: 10436.5. Samples: 468496844. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:53,989][27935] Avg episode reward: [(0, '-3.211')] [2022-07-13 08:08:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5192.9). Total num frames: 234272768. Throughput: 0: 10339.0. Samples: 468555556. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:08:58,991][27935] Avg episode reward: [(0, '-2.960')] [2022-07-13 08:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5120.0, 300 sec: 5175.5). Total num frames: 234295296. Throughput: 0: 10195.9. Samples: 468611920. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:03,989][27935] Avg episode reward: [(0, '-3.397')] [2022-07-13 08:09:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5085.9, 300 sec: 5168.6). Total num frames: 234319872. Throughput: 0: 10147.3. Samples: 468641736. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:08,989][27935] Avg episode reward: [(0, '-3.143')] [2022-07-13 08:09:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5176.0). Total num frames: 234345472. Throughput: 0: 10037.6. Samples: 468699692. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:13,989][27935] Avg episode reward: [(0, '-4.355')] [2022-07-13 08:09:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5051.7, 300 sec: 5161.7). Total num frames: 234370048. Throughput: 0: 9930.2. Samples: 468757712. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:18,989][27935] Avg episode reward: [(0, '-6.597')] [2022-07-13 08:09:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5154.7). Total num frames: 234393600. Throughput: 0: 9904.3. Samples: 468788056. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:23,990][27935] Avg episode reward: [(0, '-6.679')] [2022-07-13 08:09:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4966.4, 300 sec: 5147.9). Total num frames: 234418176. Throughput: 0: 9836.5. Samples: 468846460. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:28,989][27935] Avg episode reward: [(0, '-6.178')] [2022-07-13 08:09:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5144.3). Total num frames: 234442752. Throughput: 0: 9757.1. Samples: 468904716. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:33,989][27935] Avg episode reward: [(0, '-5.959')] [2022-07-13 08:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 5133.9). Total num frames: 234467328. Throughput: 0: 9724.7. Samples: 468934456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:38,989][27935] Avg episode reward: [(0, '-6.348')] [2022-07-13 08:09:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5133.9). Total num frames: 234491904. Throughput: 0: 9732.6. Samples: 468993524. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:43,989][27935] Avg episode reward: [(0, '-5.999')] [2022-07-13 08:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 5126.9). Total num frames: 234516480. Throughput: 0: 9806.7. Samples: 469053220. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:48,989][27935] Avg episode reward: [(0, '-5.076')] [2022-07-13 08:09:53,989][27935] Fps is (10 sec: 5017.4, 60 sec: 4898.1, 300 sec: 5123.5). Total num frames: 234542080. Throughput: 0: 9807.6. Samples: 469083084. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:53,990][27935] Avg episode reward: [(0, '-4.225')] [2022-07-13 08:09:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5126.9). Total num frames: 234566656. Throughput: 0: 9844.3. Samples: 469142684. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:09:58,989][27935] Avg episode reward: [(0, '-5.330')] [2022-07-13 08:10:03,989][27935] Fps is (10 sec: 4710.6, 60 sec: 4898.1, 300 sec: 5113.1). Total num frames: 234589184. Throughput: 0: 9750.4. Samples: 469196480. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:03,991][27935] Avg episode reward: [(0, '-5.311')] [2022-07-13 08:10:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 5102.6). Total num frames: 234612736. Throughput: 0: 9701.4. Samples: 469224620. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:08,990][27935] Avg episode reward: [(0, '-5.531')] [2022-07-13 08:10:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 5092.2). Total num frames: 234635264. Throughput: 0: 9654.7. Samples: 469280924. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:13,990][27935] Avg episode reward: [(0, '-6.433')] [2022-07-13 08:10:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 5088.8). Total num frames: 234659840. Throughput: 0: 9623.2. Samples: 469337760. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:18,989][27935] Avg episode reward: [(0, '-6.121')] [2022-07-13 08:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5074.9). Total num frames: 234683392. Throughput: 0: 9611.2. Samples: 469366960. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:23,993][27935] Avg episode reward: [(0, '-5.633')] [2022-07-13 08:10:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 5067.9). Total num frames: 234706944. Throughput: 0: 9596.1. Samples: 469425348. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:28,989][27935] Avg episode reward: [(0, '-6.727')] [2022-07-13 08:10:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 5064.5). Total num frames: 234732544. Throughput: 0: 9564.6. Samples: 469483628. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:33,989][27935] Avg episode reward: [(0, '-6.762')] [2022-07-13 08:10:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 5061.0). Total num frames: 234757120. Throughput: 0: 9548.5. Samples: 469512760. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:10:38,989][27935] Avg episode reward: [(0, '-4.503')] [2022-07-13 08:10:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 5047.1). Total num frames: 234780672. Throughput: 0: 9533.4. Samples: 469571688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:10:43,989][27935] Avg episode reward: [(0, '-4.123')] [2022-07-13 08:10:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 5047.1). Total num frames: 234805248. Throughput: 0: 9636.1. Samples: 469630104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:10:48,989][27935] Avg episode reward: [(0, '-3.933')] [2022-07-13 08:10:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 5033.2). Total num frames: 234828800. Throughput: 0: 9659.2. Samples: 469659284. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:10:53,989][27935] Avg episode reward: [(0, '-3.389')] [2022-07-13 08:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 5040.2). Total num frames: 234854400. Throughput: 0: 9713.2. Samples: 469718016. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:10:58,989][27935] Avg episode reward: [(0, '-3.017')] [2022-07-13 08:11:03,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4795.6, 300 sec: 5022.8). Total num frames: 234876928. Throughput: 0: 9654.1. Samples: 469772216. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:03,991][27935] Avg episode reward: [(0, '-4.725')] [2022-07-13 08:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 5019.3). Total num frames: 234901504. Throughput: 0: 9663.0. Samples: 469801796. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:08,989][27935] Avg episode reward: [(0, '-6.077')] [2022-07-13 08:11:13,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4829.9, 300 sec: 5012.4). Total num frames: 234925056. Throughput: 0: 9662.1. Samples: 469860144. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:13,989][27935] Avg episode reward: [(0, '-6.378')] [2022-07-13 08:11:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 5002.0). Total num frames: 234948608. Throughput: 0: 9638.7. Samples: 469917372. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:18,989][27935] Avg episode reward: [(0, '-6.518')] [2022-07-13 08:11:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4998.5). Total num frames: 234973184. Throughput: 0: 9635.1. Samples: 469946340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:23,989][27935] Avg episode reward: [(0, '-6.011')] [2022-07-13 08:11:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 5002.0). Total num frames: 234998784. Throughput: 0: 9621.2. Samples: 470004644. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:28,989][27935] Avg episode reward: [(0, '-6.264')] [2022-07-13 08:11:33,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4829.6, 300 sec: 4988.0). Total num frames: 235022336. Throughput: 0: 9613.6. Samples: 470062752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:33,993][27935] Avg episode reward: [(0, '-5.241')] [2022-07-13 08:11:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4981.2). Total num frames: 235045888. Throughput: 0: 9617.1. Samples: 470092052. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:38,989][27935] Avg episode reward: [(0, '-3.389')] [2022-07-13 08:11:43,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4829.9, 300 sec: 4977.7). Total num frames: 235070464. Throughput: 0: 9619.8. Samples: 470150908. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:43,989][27935] Avg episode reward: [(0, '-5.197')] [2022-07-13 08:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4974.2). Total num frames: 235095040. Throughput: 0: 9720.2. Samples: 470209604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:48,989][27935] Avg episode reward: [(0, '-5.210')] [2022-07-13 08:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4967.3). Total num frames: 235119616. Throughput: 0: 9719.3. Samples: 470239164. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:53,989][27935] Avg episode reward: [(0, '-4.860')] [2022-07-13 08:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4967.3). Total num frames: 235144192. Throughput: 0: 9729.1. Samples: 470297952. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:11:58,989][27935] Avg episode reward: [(0, '-4.867')] [2022-07-13 08:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.0, 300 sec: 4956.9). Total num frames: 235166720. Throughput: 0: 9655.0. Samples: 470351848. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:03,989][27935] Avg episode reward: [(0, '-4.168')] [2022-07-13 08:12:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4953.4). Total num frames: 235192320. Throughput: 0: 9694.2. Samples: 470382580. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:08,989][27935] Avg episode reward: [(0, '-5.093')] [2022-07-13 08:12:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4946.4). Total num frames: 235215872. Throughput: 0: 9714.4. Samples: 470441792. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:13,992][27935] Avg episode reward: [(0, '-5.175')] [2022-07-13 08:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4943.0). Total num frames: 235241472. Throughput: 0: 9763.2. Samples: 470502060. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:18,989][27935] Avg episode reward: [(0, '-3.217')] [2022-07-13 08:12:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4943.0). Total num frames: 235267072. Throughput: 0: 9773.9. Samples: 470531876. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:23,989][27935] Avg episode reward: [(0, '-3.814')] [2022-07-13 08:12:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4929.1). Total num frames: 235290624. Throughput: 0: 9774.7. Samples: 470590768. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:28,989][27935] Avg episode reward: [(0, '-3.872')] [2022-07-13 08:12:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.2, 300 sec: 4922.1). Total num frames: 235313152. Throughput: 0: 9717.7. Samples: 470646900. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:33,989][27935] Avg episode reward: [(0, '-3.417')] [2022-07-13 08:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4918.7). Total num frames: 235338752. Throughput: 0: 9702.9. Samples: 470675796. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:38,993][27935] Avg episode reward: [(0, '-3.228')] [2022-07-13 08:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4915.3). Total num frames: 235361280. Throughput: 0: 9644.2. Samples: 470731940. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:43,989][27935] Avg episode reward: [(0, '-3.093')] [2022-07-13 08:12:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4911.7). Total num frames: 235385856. Throughput: 0: 9730.2. Samples: 470789708. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:48,989][27935] Avg episode reward: [(0, '-3.098')] [2022-07-13 08:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4901.3). Total num frames: 235410432. Throughput: 0: 9700.6. Samples: 470819108. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:53,989][27935] Avg episode reward: [(0, '-5.076')] [2022-07-13 08:12:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4897.8). Total num frames: 235432960. Throughput: 0: 9686.0. Samples: 470877660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 08:12:58,991][27935] Avg episode reward: [(0, '-5.132')] [2022-07-13 08:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4887.4). Total num frames: 235456512. Throughput: 0: 9548.4. Samples: 470931740. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:03,989][27935] Avg episode reward: [(0, '-5.374')] [2022-07-13 08:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4884.0). Total num frames: 235481088. Throughput: 0: 9541.2. Samples: 470961228. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:08,989][27935] Avg episode reward: [(0, '-5.351')] [2022-07-13 08:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4873.5). Total num frames: 235504640. Throughput: 0: 9527.1. Samples: 471019488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:13,989][27935] Avg episode reward: [(0, '-6.326')] [2022-07-13 08:13:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4866.6). Total num frames: 235528192. Throughput: 0: 9562.7. Samples: 471077224. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:18,989][27935] Avg episode reward: [(0, '-6.152')] [2022-07-13 08:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4856.2). Total num frames: 235552768. Throughput: 0: 9564.5. Samples: 471106200. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:23,989][27935] Avg episode reward: [(0, '-6.003')] [2022-07-13 08:13:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4856.2). Total num frames: 235577344. Throughput: 0: 9610.0. Samples: 471164388. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:28,989][27935] Avg episode reward: [(0, '-5.153')] [2022-07-13 08:13:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 235600896. Throughput: 0: 9596.4. Samples: 471221548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:33,989][27935] Avg episode reward: [(0, '-4.763')] [2022-07-13 08:13:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 235626496. Throughput: 0: 9593.8. Samples: 471250832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:38,989][27935] Avg episode reward: [(0, '-5.552')] [2022-07-13 08:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 235650048. Throughput: 0: 9598.4. Samples: 471309588. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:43,989][27935] Avg episode reward: [(0, '-5.499')] [2022-07-13 08:13:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 235673600. Throughput: 0: 9688.3. Samples: 471367712. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:48,989][27935] Avg episode reward: [(0, '-5.002')] [2022-07-13 08:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 235699200. Throughput: 0: 9680.4. Samples: 471396848. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:53,989][27935] Avg episode reward: [(0, '-3.265')] [2022-07-13 08:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 235722752. Throughput: 0: 9686.3. Samples: 471455372. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:13:58,989][27935] Avg episode reward: [(0, '-3.702')] [2022-07-13 08:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 235745280. Throughput: 0: 9620.7. Samples: 471510156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:03,990][27935] Avg episode reward: [(0, '-3.775')] [2022-07-13 08:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4825.0). Total num frames: 235768832. Throughput: 0: 9619.9. Samples: 471539096. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:08,989][27935] Avg episode reward: [(0, '-3.562')] [2022-07-13 08:14:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 235793408. Throughput: 0: 9616.4. Samples: 471597128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:13,989][27935] Avg episode reward: [(0, '-4.106')] [2022-07-13 08:14:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 235817984. Throughput: 0: 9647.3. Samples: 471655676. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:18,989][27935] Avg episode reward: [(0, '-4.859')] [2022-07-13 08:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 235841536. Throughput: 0: 9652.2. Samples: 471685180. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:23,989][27935] Avg episode reward: [(0, '-4.217')] [2022-07-13 08:14:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 235868160. Throughput: 0: 9649.6. Samples: 471743820. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:28,989][27935] Avg episode reward: [(0, '-4.200')] [2022-07-13 08:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 235890688. Throughput: 0: 9617.0. Samples: 471800476. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:33,989][27935] Avg episode reward: [(0, '-3.621')] [2022-07-13 08:14:38,990][27935] Fps is (10 sec: 4710.0, 60 sec: 4812.7, 300 sec: 4824.9). Total num frames: 235915264. Throughput: 0: 9613.8. Samples: 471829476. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:38,991][27935] Avg episode reward: [(0, '-2.865')] [2022-07-13 08:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 235939840. Throughput: 0: 9605.4. Samples: 471887616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:43,990][27935] Avg episode reward: [(0, '-1.952')] [2022-07-13 08:14:48,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 235963392. Throughput: 0: 9696.7. Samples: 471946508. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:48,989][27935] Avg episode reward: [(0, '-2.534')] [2022-07-13 08:14:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 235987968. Throughput: 0: 9702.2. Samples: 471975696. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:53,989][27935] Avg episode reward: [(0, '-3.019')] [2022-07-13 08:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 236011520. Throughput: 0: 9719.9. Samples: 472034524. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:14:58,990][27935] Avg episode reward: [(0, '-2.929')] [2022-07-13 08:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 236035072. Throughput: 0: 9071.3. Samples: 472063884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:15:03,989][27935] Avg episode reward: [(0, '-3.883')] [2022-07-13 08:15:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 236058624. Throughput: 0: 9614.4. Samples: 472117828. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:15:08,991][27935] Avg episode reward: [(0, '-4.136')] [2022-07-13 08:15:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 236083200. Throughput: 0: 9594.8. Samples: 472175584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:15:13,989][27935] Avg episode reward: [(0, '-6.318')] [2022-07-13 08:15:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 236107776. Throughput: 0: 9622.6. Samples: 472233492. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 08:15:18,989][27935] Avg episode reward: [(0, '-6.391')] [2022-07-13 08:15:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 236131328. Throughput: 0: 9633.2. Samples: 472262960. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:23,989][27935] Avg episode reward: [(0, '-5.339')] [2022-07-13 08:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 236155904. Throughput: 0: 9638.8. Samples: 472321364. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:28,989][27935] Avg episode reward: [(0, '-6.449')] [2022-07-13 08:15:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 236180480. Throughput: 0: 9632.8. Samples: 472379984. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:33,989][27935] Avg episode reward: [(0, '-6.989')] [2022-07-13 08:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 236205056. Throughput: 0: 9636.9. Samples: 472409356. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:38,989][27935] Avg episode reward: [(0, '-6.958')] [2022-07-13 08:15:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 236228608. Throughput: 0: 9637.9. Samples: 472468228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:43,989][27935] Avg episode reward: [(0, '-4.644')] [2022-07-13 08:15:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 236255232. Throughput: 0: 10278.4. Samples: 472526412. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:48,989][27935] Avg episode reward: [(0, '-4.970')] [2022-07-13 08:15:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 236277760. Throughput: 0: 9716.6. Samples: 472555076. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:53,989][27935] Avg episode reward: [(0, '-4.853')] [2022-07-13 08:15:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 236302336. Throughput: 0: 9754.4. Samples: 472614532. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:15:58,990][27935] Avg episode reward: [(0, '-3.537')] [2022-07-13 08:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 236324864. Throughput: 0: 9681.0. Samples: 472669136. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:03,991][27935] Avg episode reward: [(0, '-3.662')] [2022-07-13 08:16:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 236348416. Throughput: 0: 9676.9. Samples: 472698420. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:08,989][27935] Avg episode reward: [(0, '-1.957')] [2022-07-13 08:16:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 236375040. Throughput: 0: 9689.1. Samples: 472757372. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:13,989][27935] Avg episode reward: [(0, '-2.871')] [2022-07-13 08:16:19,001][27935] Fps is (10 sec: 4909.4, 60 sec: 4828.9, 300 sec: 4828.2). Total num frames: 236397568. Throughput: 0: 9690.5. Samples: 472816172. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:19,002][27935] Avg episode reward: [(0, '-4.857')] [2022-07-13 08:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 236423168. Throughput: 0: 9692.2. Samples: 472845504. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:23,989][27935] Avg episode reward: [(0, '-5.064')] [2022-07-13 08:16:28,989][27935] Fps is (10 sec: 5023.5, 60 sec: 4864.0, 300 sec: 4832.0). Total num frames: 236447744. Throughput: 0: 9690.3. Samples: 472904292. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:28,989][27935] Avg episode reward: [(0, '-6.738')] [2022-07-13 08:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 236471296. Throughput: 0: 9696.4. Samples: 472962748. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:33,989][27935] Avg episode reward: [(0, '-6.606')] [2022-07-13 08:16:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 236495872. Throughput: 0: 9715.6. Samples: 472992276. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:38,989][27935] Avg episode reward: [(0, '-7.937')] [2022-07-13 08:16:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 236521472. Throughput: 0: 9700.4. Samples: 473051048. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:43,992][27935] Avg episode reward: [(0, '-8.273')] [2022-07-13 08:16:48,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4829.6, 300 sec: 4831.8). Total num frames: 236545024. Throughput: 0: 9800.1. Samples: 473110176. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:48,993][27935] Avg episode reward: [(0, '-7.451')] [2022-07-13 08:16:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 236568576. Throughput: 0: 9806.3. Samples: 473139704. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:53,989][27935] Avg episode reward: [(0, '-7.542')] [2022-07-13 08:16:58,989][27935] Fps is (10 sec: 5019.5, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 236595200. Throughput: 0: 9806.8. Samples: 473198680. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:16:58,990][27935] Avg episode reward: [(0, '-6.538')] [2022-07-13 08:17:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 236616704. Throughput: 0: 9720.1. Samples: 473253460. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:03,991][27935] Avg episode reward: [(0, '-6.767')] [2022-07-13 08:17:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4835.4). Total num frames: 236642304. Throughput: 0: 9721.2. Samples: 473282960. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:08,989][27935] Avg episode reward: [(0, '-6.781')] [2022-07-13 08:17:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 236665856. Throughput: 0: 9721.6. Samples: 473341764. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:13,989][27935] Avg episode reward: [(0, '-6.764')] [2022-07-13 08:17:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4882.0, 300 sec: 4825.0). Total num frames: 236690432. Throughput: 0: 9732.5. Samples: 473400708. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:18,989][27935] Avg episode reward: [(0, '-6.795')] [2022-07-13 08:17:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 236716032. Throughput: 0: 9736.7. Samples: 473430428. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:23,989][27935] Avg episode reward: [(0, '-8.125')] [2022-07-13 08:17:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 236738560. Throughput: 0: 9741.5. Samples: 473489416. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:28,989][27935] Avg episode reward: [(0, '-7.887')] [2022-07-13 08:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4835.4). Total num frames: 236765184. Throughput: 0: 9732.7. Samples: 473548112. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:17:33,989][27935] Avg episode reward: [(0, '-7.684')] [2022-07-13 08:17:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 236789760. Throughput: 0: 9727.6. Samples: 473577448. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:17:38,990][27935] Avg episode reward: [(0, '-7.171')] [2022-07-13 08:17:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 236813312. Throughput: 0: 9731.0. Samples: 473636576. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:17:43,989][27935] Avg episode reward: [(0, '-7.698')] [2022-07-13 08:17:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.4, 300 sec: 4838.8). Total num frames: 236837888. Throughput: 0: 9827.0. Samples: 473695676. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:17:48,989][27935] Avg episode reward: [(0, '-7.197')] [2022-07-13 08:17:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4849.2). Total num frames: 236863488. Throughput: 0: 9829.4. Samples: 473725284. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:17:53,989][27935] Avg episode reward: [(0, '-7.104')] [2022-07-13 08:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 236887040. Throughput: 0: 9840.4. Samples: 473784580. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:17:58,989][27935] Avg episode reward: [(0, '-6.815')] [2022-07-13 08:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 236910592. Throughput: 0: 9748.1. Samples: 473839372. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:03,989][27935] Avg episode reward: [(0, '-5.438')] [2022-07-13 08:18:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 236934144. Throughput: 0: 9744.6. Samples: 473868936. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:08,989][27935] Avg episode reward: [(0, '-5.877')] [2022-07-13 08:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 236958720. Throughput: 0: 9745.9. Samples: 473927980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:13,991][27935] Avg episode reward: [(0, '-5.263')] [2022-07-13 08:18:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 236984320. Throughput: 0: 9751.7. Samples: 473986936. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:18,991][27935] Avg episode reward: [(0, '-5.623')] [2022-07-13 08:18:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 237008896. Throughput: 0: 9752.1. Samples: 474016292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:23,989][27935] Avg episode reward: [(0, '-6.327')] [2022-07-13 08:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4856.2). Total num frames: 237033472. Throughput: 0: 9753.4. Samples: 474075480. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:28,991][27935] Avg episode reward: [(0, '-4.875')] [2022-07-13 08:18:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 237057024. Throughput: 0: 9745.8. Samples: 474134236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:33,989][27935] Avg episode reward: [(0, '-4.186')] [2022-07-13 08:18:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 237081600. Throughput: 0: 9741.2. Samples: 474163640. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:38,990][27935] Avg episode reward: [(0, '-4.746')] [2022-07-13 08:18:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 237106176. Throughput: 0: 9735.4. Samples: 474222672. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:43,991][27935] Avg episode reward: [(0, '-5.168')] [2022-07-13 08:18:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 237129728. Throughput: 0: 9790.0. Samples: 474279924. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:48,991][27935] Avg episode reward: [(0, '-5.389')] [2022-07-13 08:18:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 237154304. Throughput: 0: 9772.3. Samples: 474308688. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:53,989][27935] Avg episode reward: [(0, '-5.259')] [2022-07-13 08:18:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 237178880. Throughput: 0: 9764.0. Samples: 474367360. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:18:58,990][27935] Avg episode reward: [(0, '-4.071')] [2022-07-13 08:19:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 237201408. Throughput: 0: 9655.9. Samples: 474421452. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:03,989][27935] Avg episode reward: [(0, '-4.286')] [2022-07-13 08:19:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 237224960. Throughput: 0: 9653.5. Samples: 474450700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:08,989][27935] Avg episode reward: [(0, '-3.814')] [2022-07-13 08:19:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 237249536. Throughput: 0: 9641.0. Samples: 474509324. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:13,989][27935] Avg episode reward: [(0, '-3.200')] [2022-07-13 08:19:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 237275136. Throughput: 0: 9641.2. Samples: 474568088. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:18,996][27935] Avg episode reward: [(0, '-3.568')] [2022-07-13 08:19:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 237299712. Throughput: 0: 9643.5. Samples: 474597600. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:23,989][27935] Avg episode reward: [(0, '-4.413')] [2022-07-13 08:19:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 237323264. Throughput: 0: 9632.7. Samples: 474656144. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:28,989][27935] Avg episode reward: [(0, '-4.264')] [2022-07-13 08:19:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 237346816. Throughput: 0: 9663.7. Samples: 474714792. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:33,989][27935] Avg episode reward: [(0, '-3.903')] [2022-07-13 08:19:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 237372416. Throughput: 0: 9672.2. Samples: 474743936. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:38,989][27935] Avg episode reward: [(0, '-5.110')] [2022-07-13 08:19:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 237396992. Throughput: 0: 9677.3. Samples: 474802840. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:43,989][27935] Avg episode reward: [(0, '-5.993')] [2022-07-13 08:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 237420544. Throughput: 0: 9781.9. Samples: 474861636. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:48,989][27935] Avg episode reward: [(0, '-6.006')] [2022-07-13 08:19:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 237445120. Throughput: 0: 9780.2. Samples: 474890808. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 08:19:53,989][27935] Avg episode reward: [(0, '-5.377')] [2022-07-13 08:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 237469696. Throughput: 0: 9778.7. Samples: 474949364. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:19:58,989][27935] Avg episode reward: [(0, '-4.731')] [2022-07-13 08:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 237493248. Throughput: 0: 9693.3. Samples: 475004288. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:03,989][27935] Avg episode reward: [(0, '-3.945')] [2022-07-13 08:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 237516800. Throughput: 0: 9691.4. Samples: 475033712. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:08,989][27935] Avg episode reward: [(0, '-4.165')] [2022-07-13 08:20:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 237541376. Throughput: 0: 9693.0. Samples: 475092328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:13,991][27935] Avg episode reward: [(0, '-4.401')] [2022-07-13 08:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 237565952. Throughput: 0: 9697.3. Samples: 475151168. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:18,991][27935] Avg episode reward: [(0, '-5.555')] [2022-07-13 08:20:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 237589504. Throughput: 0: 9702.0. Samples: 475180528. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:23,991][27935] Avg episode reward: [(0, '-5.391')] [2022-07-13 08:20:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 237614080. Throughput: 0: 9709.0. Samples: 475239744. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:28,989][27935] Avg episode reward: [(0, '-5.245')] [2022-07-13 08:20:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 237639680. Throughput: 0: 9712.0. Samples: 475298676. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:33,989][27935] Avg episode reward: [(0, '-5.563')] [2022-07-13 08:20:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 237664256. Throughput: 0: 9712.5. Samples: 475327872. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:38,989][27935] Avg episode reward: [(0, '-4.679')] [2022-07-13 08:20:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 237687808. Throughput: 0: 9722.1. Samples: 475386860. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:43,989][27935] Avg episode reward: [(0, '-5.161')] [2022-07-13 08:20:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 237713408. Throughput: 0: 9816.2. Samples: 475446016. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:48,990][27935] Avg episode reward: [(0, '-3.692')] [2022-07-13 08:20:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 237737984. Throughput: 0: 9810.4. Samples: 475475180. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:53,990][27935] Avg episode reward: [(0, '-2.419')] [2022-07-13 08:20:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 237761536. Throughput: 0: 9816.8. Samples: 475534084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:20:58,989][27935] Avg episode reward: [(0, '-2.254')] [2022-07-13 08:21:03,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 237785088. Throughput: 0: 9727.2. Samples: 475588896. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:03,989][27935] Avg episode reward: [(0, '-3.389')] [2022-07-13 08:21:08,992][27935] Fps is (10 sec: 4709.1, 60 sec: 4863.8, 300 sec: 4859.6). Total num frames: 237808640. Throughput: 0: 9729.7. Samples: 475618392. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:08,992][27935] Avg episode reward: [(0, '-3.421')] [2022-07-13 08:21:13,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4864.0, 300 sec: 4866.8). Total num frames: 237833216. Throughput: 0: 9717.9. Samples: 475677052. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:13,989][27935] Avg episode reward: [(0, '-3.527')] [2022-07-13 08:21:19,000][27935] Fps is (10 sec: 4910.8, 60 sec: 4863.1, 300 sec: 4862.9). Total num frames: 237857792. Throughput: 0: 9710.0. Samples: 475735740. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:19,001][27935] Avg episode reward: [(0, '-2.971')] [2022-07-13 08:21:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 237881344. Throughput: 0: 9712.0. Samples: 475764912. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:23,989][27935] Avg episode reward: [(0, '-3.608')] [2022-07-13 08:21:28,989][27935] Fps is (10 sec: 4920.9, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 237906944. Throughput: 0: 9709.5. Samples: 475823788. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:28,989][27935] Avg episode reward: [(0, '-4.053')] [2022-07-13 08:21:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 237932544. Throughput: 0: 9690.4. Samples: 475882084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:33,989][27935] Avg episode reward: [(0, '-4.075')] [2022-07-13 08:21:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 237956096. Throughput: 0: 9694.2. Samples: 475911420. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:38,989][27935] Avg episode reward: [(0, '-3.227')] [2022-07-13 08:21:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.7). Total num frames: 237980672. Throughput: 0: 9689.3. Samples: 475970104. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:43,989][27935] Avg episode reward: [(0, '-3.814')] [2022-07-13 08:21:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 238005248. Throughput: 0: 9774.7. Samples: 476028756. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:48,989][27935] Avg episode reward: [(0, '-4.320')] [2022-07-13 08:21:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 238027776. Throughput: 0: 9769.3. Samples: 476057984. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:53,991][27935] Avg episode reward: [(0, '-4.207')] [2022-07-13 08:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 238053376. Throughput: 0: 9775.5. Samples: 476116948. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:21:58,989][27935] Avg episode reward: [(0, '-5.414')] [2022-07-13 08:22:04,000][27935] Fps is (10 sec: 4807.2, 60 sec: 4846.0, 300 sec: 4859.5). Total num frames: 238075904. Throughput: 0: 9692.8. Samples: 476171916. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:22:04,001][27935] Avg episode reward: [(0, '-5.154')] [2022-07-13 08:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.2, 300 sec: 4863.1). Total num frames: 238100480. Throughput: 0: 9704.4. Samples: 476201608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 08:22:08,989][27935] Avg episode reward: [(0, '-5.890')] [2022-07-13 08:22:13,989][27935] Fps is (10 sec: 5023.4, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 238126080. Throughput: 0: 9696.3. Samples: 476260120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:13,989][27935] Avg episode reward: [(0, '-5.721')] [2022-07-13 08:22:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.9, 300 sec: 4859.7). Total num frames: 238149632. Throughput: 0: 9709.1. Samples: 476318992. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:18,989][27935] Avg episode reward: [(0, '-5.925')] [2022-07-13 08:22:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 238174208. Throughput: 0: 9710.1. Samples: 476348376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:23,989][27935] Avg episode reward: [(0, '-5.822')] [2022-07-13 08:22:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 238199808. Throughput: 0: 9720.5. Samples: 476407528. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:28,989][27935] Avg episode reward: [(0, '-6.009')] [2022-07-13 08:22:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 238223360. Throughput: 0: 9729.1. Samples: 476466564. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:33,989][27935] Avg episode reward: [(0, '-4.749')] [2022-07-13 08:22:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 238248960. Throughput: 0: 9735.3. Samples: 476496072. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:38,989][27935] Avg episode reward: [(0, '-3.097')] [2022-07-13 08:22:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 238272512. Throughput: 0: 9710.7. Samples: 476553928. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:43,989][27935] Avg episode reward: [(0, '-3.864')] [2022-07-13 08:22:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 238295040. Throughput: 0: 9788.7. Samples: 476612292. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:48,989][27935] Avg episode reward: [(0, '-4.668')] [2022-07-13 08:22:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 238320640. Throughput: 0: 9771.9. Samples: 476641344. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:54,004][27935] Avg episode reward: [(0, '-3.738')] [2022-07-13 08:22:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 238345216. Throughput: 0: 9767.7. Samples: 476699668. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:22:58,989][27935] Avg episode reward: [(0, '-3.679')] [2022-07-13 08:23:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.9, 300 sec: 4856.2). Total num frames: 238366720. Throughput: 0: 9671.1. Samples: 476754192. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:03,991][27935] Avg episode reward: [(0, '-3.431')] [2022-07-13 08:23:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 238393344. Throughput: 0: 9666.3. Samples: 476783360. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:08,990][27935] Avg episode reward: [(0, '-3.884')] [2022-07-13 08:23:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 238415872. Throughput: 0: 9639.9. Samples: 476841324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:13,992][27935] Avg episode reward: [(0, '-4.032')] [2022-07-13 08:23:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 238438400. Throughput: 0: 9614.9. Samples: 476899236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:18,989][27935] Avg episode reward: [(0, '-2.900')] [2022-07-13 08:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 238464000. Throughput: 0: 9609.9. Samples: 476928516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:23,989][27935] Avg episode reward: [(0, '-4.126')] [2022-07-13 08:23:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 238489600. Throughput: 0: 9635.9. Samples: 476987544. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:28,989][27935] Avg episode reward: [(0, '-4.408')] [2022-07-13 08:23:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 238514176. Throughput: 0: 9619.7. Samples: 477045176. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:33,989][27935] Avg episode reward: [(0, '-4.320')] [2022-07-13 08:23:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 238536704. Throughput: 0: 9618.7. Samples: 477074184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:38,989][27935] Avg episode reward: [(0, '-4.901')] [2022-07-13 08:23:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 238560256. Throughput: 0: 9616.9. Samples: 477132428. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:43,989][27935] Avg episode reward: [(0, '-4.987')] [2022-07-13 08:23:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 238585856. Throughput: 0: 9685.2. Samples: 477190024. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:48,989][27935] Avg episode reward: [(0, '-5.497')] [2022-07-13 08:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 238609408. Throughput: 0: 9689.2. Samples: 477219376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:53,989][27935] Avg episode reward: [(0, '-4.572')] [2022-07-13 08:23:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 238635008. Throughput: 0: 9701.1. Samples: 477277872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:23:58,989][27935] Avg episode reward: [(0, '-5.142')] [2022-07-13 08:24:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 238655488. Throughput: 0: 9064.3. Samples: 477307128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:03,989][27935] Avg episode reward: [(0, '-5.115')] [2022-07-13 08:24:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4849.2). Total num frames: 238680064. Throughput: 0: 9614.0. Samples: 477361144. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:08,989][27935] Avg episode reward: [(0, '-5.067')] [2022-07-13 08:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 238704640. Throughput: 0: 9597.9. Samples: 477419452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:13,989][27935] Avg episode reward: [(0, '-4.859')] [2022-07-13 08:24:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 238728192. Throughput: 0: 9598.8. Samples: 477477120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:18,991][27935] Avg episode reward: [(0, '-5.439')] [2022-07-13 08:24:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 238753792. Throughput: 0: 9603.4. Samples: 477506336. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:23,991][27935] Avg episode reward: [(0, '-6.934')] [2022-07-13 08:24:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 238777344. Throughput: 0: 9596.1. Samples: 477564252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 08:24:28,990][27935] Avg episode reward: [(0, '-8.072')] [2022-07-13 08:24:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4842.3). Total num frames: 238800896. Throughput: 0: 9590.9. Samples: 477621616. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:33,990][27935] Avg episode reward: [(0, '-6.930')] [2022-07-13 08:24:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 238824448. Throughput: 0: 9582.6. Samples: 477650592. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:38,990][27935] Avg episode reward: [(0, '-7.365')] [2022-07-13 08:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 238849024. Throughput: 0: 9552.4. Samples: 477707732. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:43,989][27935] Avg episode reward: [(0, '-8.344')] [2022-07-13 08:24:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 238873600. Throughput: 0: 10177.5. Samples: 477765116. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:48,989][27935] Avg episode reward: [(0, '-7.034')] [2022-07-13 08:24:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4835.4). Total num frames: 238896128. Throughput: 0: 9611.8. Samples: 477793676. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:53,989][27935] Avg episode reward: [(0, '-7.124')] [2022-07-13 08:24:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4838.8). Total num frames: 238920704. Throughput: 0: 9591.7. Samples: 477851076. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:24:58,989][27935] Avg episode reward: [(0, '-5.857')] [2022-07-13 08:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 238943232. Throughput: 0: 9516.3. Samples: 477905352. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:03,991][27935] Avg episode reward: [(0, '-6.502')] [2022-07-13 08:25:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 238966784. Throughput: 0: 9515.9. Samples: 477934552. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:08,989][27935] Avg episode reward: [(0, '-6.025')] [2022-07-13 08:25:13,994][27935] Fps is (10 sec: 4912.7, 60 sec: 4795.3, 300 sec: 4835.3). Total num frames: 238992384. Throughput: 0: 9526.1. Samples: 477992976. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:13,994][27935] Avg episode reward: [(0, '-5.711')] [2022-07-13 08:25:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 239014912. Throughput: 0: 9520.0. Samples: 478050016. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:18,989][27935] Avg episode reward: [(0, '-4.498')] [2022-07-13 08:25:23,989][27935] Fps is (10 sec: 4712.8, 60 sec: 4761.6, 300 sec: 4831.9). Total num frames: 239039488. Throughput: 0: 9517.7. Samples: 478078888. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:23,989][27935] Avg episode reward: [(0, '-5.451')] [2022-07-13 08:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 239064064. Throughput: 0: 9534.7. Samples: 478136792. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:28,989][27935] Avg episode reward: [(0, '-4.588')] [2022-07-13 08:25:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 239087616. Throughput: 0: 9534.6. Samples: 478194172. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:33,989][27935] Avg episode reward: [(0, '-4.756')] [2022-07-13 08:25:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 239112192. Throughput: 0: 9548.7. Samples: 478223368. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:38,989][27935] Avg episode reward: [(0, '-5.453')] [2022-07-13 08:25:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 239135744. Throughput: 0: 9559.8. Samples: 478281268. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:43,989][27935] Avg episode reward: [(0, '-5.258')] [2022-07-13 08:25:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 239159296. Throughput: 0: 9645.9. Samples: 478339420. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:48,989][27935] Avg episode reward: [(0, '-4.978')] [2022-07-13 08:25:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 239183872. Throughput: 0: 9643.9. Samples: 478368528. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:53,991][27935] Avg episode reward: [(0, '-6.535')] [2022-07-13 08:25:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 239207424. Throughput: 0: 9627.6. Samples: 478426168. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:25:58,989][27935] Avg episode reward: [(0, '-4.442')] [2022-07-13 08:26:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4818.1). Total num frames: 239229952. Throughput: 0: 9555.6. Samples: 478480016. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:03,989][27935] Avg episode reward: [(0, '-4.721')] [2022-07-13 08:26:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 239255552. Throughput: 0: 9563.7. Samples: 478509256. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:08,989][27935] Avg episode reward: [(0, '-3.603')] [2022-07-13 08:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4779.1, 300 sec: 4818.2). Total num frames: 239279104. Throughput: 0: 9560.5. Samples: 478567016. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:13,989][27935] Avg episode reward: [(0, '-3.717')] [2022-07-13 08:26:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 239302656. Throughput: 0: 9559.5. Samples: 478624348. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:18,989][27935] Avg episode reward: [(0, '-3.383')] [2022-07-13 08:26:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 239326208. Throughput: 0: 9551.5. Samples: 478653184. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:23,989][27935] Avg episode reward: [(0, '-2.701')] [2022-07-13 08:26:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 239350784. Throughput: 0: 9565.4. Samples: 478711712. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:28,990][27935] Avg episode reward: [(0, '-2.732')] [2022-07-13 08:26:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 239376384. Throughput: 0: 9564.0. Samples: 478769800. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:33,989][27935] Avg episode reward: [(0, '-4.053')] [2022-07-13 08:26:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 239398912. Throughput: 0: 9565.2. Samples: 478798964. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:38,989][27935] Avg episode reward: [(0, '-5.211')] [2022-07-13 08:26:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 239423488. Throughput: 0: 9589.4. Samples: 478857692. Policy #0 lag: (min: 0.0, avg: 7.3, max: 18.0) [2022-07-13 08:26:43,989][27935] Avg episode reward: [(0, '-5.751')] [2022-07-13 08:26:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 239448064. Throughput: 0: 9684.1. Samples: 478915800. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:26:48,989][27935] Avg episode reward: [(0, '-6.533')] [2022-07-13 08:26:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 239471616. Throughput: 0: 9678.2. Samples: 478944776. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:26:53,989][27935] Avg episode reward: [(0, '-6.080')] [2022-07-13 08:26:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.7). Total num frames: 239496192. Throughput: 0: 9681.2. Samples: 479002668. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:26:58,990][27935] Avg episode reward: [(0, '-6.466')] [2022-07-13 08:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 239519744. Throughput: 0: 9060.1. Samples: 479032052. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:03,989][27935] Avg episode reward: [(0, '-6.601')] [2022-07-13 08:27:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 239543296. Throughput: 0: 9622.9. Samples: 479086216. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:08,989][27935] Avg episode reward: [(0, '-5.493')] [2022-07-13 08:27:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 239567872. Throughput: 0: 9606.2. Samples: 479143992. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:13,989][27935] Avg episode reward: [(0, '-4.589')] [2022-07-13 08:27:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 239590400. Throughput: 0: 9604.0. Samples: 479201980. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:18,989][27935] Avg episode reward: [(0, '-3.994')] [2022-07-13 08:27:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 239614976. Throughput: 0: 9600.7. Samples: 479230996. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:23,989][27935] Avg episode reward: [(0, '-3.719')] [2022-07-13 08:27:28,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 239639552. Throughput: 0: 9598.3. Samples: 479289616. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:28,990][27935] Avg episode reward: [(0, '-5.137')] [2022-07-13 08:27:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 239664128. Throughput: 0: 8952.6. Samples: 479318668. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:33,989][27935] Avg episode reward: [(0, '-4.397')] [2022-07-13 08:27:38,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 239688704. Throughput: 0: 9597.2. Samples: 479376648. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:38,989][27935] Avg episode reward: [(0, '-3.743')] [2022-07-13 08:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 239712256. Throughput: 0: 9588.1. Samples: 479434132. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:43,989][27935] Avg episode reward: [(0, '-3.890')] [2022-07-13 08:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 239736832. Throughput: 0: 10227.4. Samples: 479492284. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:48,989][27935] Avg episode reward: [(0, '-4.064')] [2022-07-13 08:27:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 239760384. Throughput: 0: 9664.1. Samples: 479521100. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:53,991][27935] Avg episode reward: [(0, '-5.024')] [2022-07-13 08:27:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 239783936. Throughput: 0: 9663.5. Samples: 479578848. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:27:58,994][27935] Avg episode reward: [(0, '-4.647')] [2022-07-13 08:28:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 239806464. Throughput: 0: 9564.2. Samples: 479632368. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:03,989][27935] Avg episode reward: [(0, '-4.848')] [2022-07-13 08:28:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 239831040. Throughput: 0: 9580.6. Samples: 479662124. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:08,989][27935] Avg episode reward: [(0, '-4.317')] [2022-07-13 08:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 239855616. Throughput: 0: 9571.5. Samples: 479720332. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:13,989][27935] Avg episode reward: [(0, '-3.646')] [2022-07-13 08:28:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 239880192. Throughput: 0: 10228.4. Samples: 479778948. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:18,990][27935] Avg episode reward: [(0, '-3.886')] [2022-07-13 08:28:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 239903744. Throughput: 0: 9591.2. Samples: 479808252. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:23,989][27935] Avg episode reward: [(0, '-4.488')] [2022-07-13 08:28:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4804.1). Total num frames: 239931392. Throughput: 0: 9707.5. Samples: 479870968. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:28,989][27935] Avg episode reward: [(0, '-3.058')] [2022-07-13 08:28:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 4898.1, 300 sec: 4818.0). Total num frames: 239958016. Throughput: 0: 9818.7. Samples: 479934124. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:33,989][27935] Avg episode reward: [(0, '-3.986')] [2022-07-13 08:28:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4821.5). Total num frames: 239982592. Throughput: 0: 9876.7. Samples: 479965552. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:38,990][27935] Avg episode reward: [(0, '-4.344')] [2022-07-13 08:28:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4966.4, 300 sec: 4828.4). Total num frames: 240010240. Throughput: 0: 10003.3. Samples: 480028996. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:43,989][27935] Avg episode reward: [(0, '-4.941')] [2022-07-13 08:28:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5000.5, 300 sec: 4838.8). Total num frames: 240036864. Throughput: 0: 10214.9. Samples: 480092040. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:48,989][27935] Avg episode reward: [(0, '-4.767')] [2022-07-13 08:28:53,990][27935] Fps is (10 sec: 5222.0, 60 sec: 5034.6, 300 sec: 4838.8). Total num frames: 240062464. Throughput: 0: 10254.6. Samples: 480123588. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:53,990][27935] Avg episode reward: [(0, '-5.694')] [2022-07-13 08:28:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 4856.2). Total num frames: 240088064. Throughput: 0: 10358.9. Samples: 480186484. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:28:58,990][27935] Avg episode reward: [(0, '-5.561')] [2022-07-13 08:29:03,989][27935] Fps is (10 sec: 5120.4, 60 sec: 5120.0, 300 sec: 4859.7). Total num frames: 240113664. Throughput: 0: 10359.6. Samples: 480245132. Policy #0 lag: (min: 0.0, avg: 11.1, max: 24.0) [2022-07-13 08:29:03,991][27935] Avg episode reward: [(0, '-3.723')] [2022-07-13 08:29:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 4866.6). Total num frames: 240140288. Throughput: 0: 10416.4. Samples: 480276988. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:08,989][27935] Avg episode reward: [(0, '-5.286')] [2022-07-13 08:29:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 4873.5). Total num frames: 240165888. Throughput: 0: 10429.0. Samples: 480340276. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:13,990][27935] Avg episode reward: [(0, '-4.814')] [2022-07-13 08:29:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4877.0). Total num frames: 240192512. Throughput: 0: 10420.7. Samples: 480403056. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:18,990][27935] Avg episode reward: [(0, '-4.446')] [2022-07-13 08:29:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 5239.5, 300 sec: 4884.0). Total num frames: 240218112. Throughput: 0: 10426.1. Samples: 480434728. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:23,989][27935] Avg episode reward: [(0, '-3.571')] [2022-07-13 08:29:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4894.4). Total num frames: 240244736. Throughput: 0: 10422.0. Samples: 480497984. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:28,989][27935] Avg episode reward: [(0, '-3.538')] [2022-07-13 08:29:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4901.3). Total num frames: 240270336. Throughput: 0: 10420.4. Samples: 480560960. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:33,990][27935] Avg episode reward: [(0, '-3.797')] [2022-07-13 08:29:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 4904.8). Total num frames: 240295936. Throughput: 0: 10417.7. Samples: 480592376. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:38,989][27935] Avg episode reward: [(0, '-2.568')] [2022-07-13 08:29:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 4918.7). Total num frames: 240324608. Throughput: 0: 10425.8. Samples: 480655644. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:43,989][27935] Avg episode reward: [(0, '-2.099')] [2022-07-13 08:29:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 4922.1). Total num frames: 240348160. Throughput: 0: 10523.6. Samples: 480718696. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:48,989][27935] Avg episode reward: [(0, '-2.908')] [2022-07-13 08:29:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4936.0). Total num frames: 240376832. Throughput: 0: 10522.3. Samples: 480750492. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:53,991][27935] Avg episode reward: [(0, '-2.393')] [2022-07-13 08:29:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 4943.0). Total num frames: 240401408. Throughput: 0: 10531.5. Samples: 480814192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:29:58,989][27935] Avg episode reward: [(0, '-2.909')] [2022-07-13 08:30:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 4949.9). Total num frames: 240427008. Throughput: 0: 10441.2. Samples: 480872912. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:03,989][27935] Avg episode reward: [(0, '-3.200')] [2022-07-13 08:30:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 4946.5). Total num frames: 240451584. Throughput: 0: 10440.9. Samples: 480904568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:08,990][27935] Avg episode reward: [(0, '-3.460')] [2022-07-13 08:30:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 4967.3). Total num frames: 240480256. Throughput: 0: 10451.0. Samples: 480968280. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:13,989][27935] Avg episode reward: [(0, '-3.401')] [2022-07-13 08:30:18,989][27935] Fps is (10 sec: 5427.1, 60 sec: 5222.4, 300 sec: 4970.7). Total num frames: 240505856. Throughput: 0: 10451.3. Samples: 481031268. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:18,989][27935] Avg episode reward: [(0, '-4.041')] [2022-07-13 08:30:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 4977.7). Total num frames: 240532480. Throughput: 0: 10458.3. Samples: 481063000. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:23,989][27935] Avg episode reward: [(0, '-3.229')] [2022-07-13 08:30:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 4988.1). Total num frames: 240559104. Throughput: 0: 10464.2. Samples: 481126532. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:28,989][27935] Avg episode reward: [(0, '-3.195')] [2022-07-13 08:30:33,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5256.5, 300 sec: 4995.0). Total num frames: 240585728. Throughput: 0: 10467.4. Samples: 481189728. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:33,989][27935] Avg episode reward: [(0, '-2.846')] [2022-07-13 08:30:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5002.0). Total num frames: 240611328. Throughput: 0: 10458.3. Samples: 481221116. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:38,989][27935] Avg episode reward: [(0, '-3.116')] [2022-07-13 08:30:43,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5222.4, 300 sec: 5012.4). Total num frames: 240637952. Throughput: 0: 10449.2. Samples: 481284404. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:43,989][27935] Avg episode reward: [(0, '-3.727')] [2022-07-13 08:30:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5019.3). Total num frames: 240664576. Throughput: 0: 10539.4. Samples: 481347184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:48,989][27935] Avg episode reward: [(0, '-3.659')] [2022-07-13 08:30:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5022.8). Total num frames: 240689152. Throughput: 0: 10531.6. Samples: 481378488. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:53,989][27935] Avg episode reward: [(0, '-4.969')] [2022-07-13 08:30:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5036.7). Total num frames: 240715776. Throughput: 0: 10471.0. Samples: 481439476. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:30:58,989][27935] Avg episode reward: [(0, '-5.511')] [2022-07-13 08:31:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5033.2). Total num frames: 240740352. Throughput: 0: 10376.1. Samples: 481498192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:31:03,989][27935] Avg episode reward: [(0, '-5.244')] [2022-07-13 08:31:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5040.2). Total num frames: 240765952. Throughput: 0: 10385.4. Samples: 481530344. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:31:08,989][27935] Avg episode reward: [(0, '-5.901')] [2022-07-13 08:31:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5054.0). Total num frames: 240793600. Throughput: 0: 10388.3. Samples: 481594008. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:31:13,989][27935] Avg episode reward: [(0, '-5.804')] [2022-07-13 08:31:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5057.5). Total num frames: 240818176. Throughput: 0: 10395.1. Samples: 481657508. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:31:18,995][27935] Avg episode reward: [(0, '-5.436')] [2022-07-13 08:31:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5067.9). Total num frames: 240845824. Throughput: 0: 10395.6. Samples: 481688920. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 08:31:23,989][27935] Avg episode reward: [(0, '-4.577')] [2022-07-13 08:31:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5067.9). Total num frames: 240871424. Throughput: 0: 10411.5. Samples: 481752920. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:28,989][27935] Avg episode reward: [(0, '-6.438')] [2022-07-13 08:31:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5081.8). Total num frames: 240898048. Throughput: 0: 10423.5. Samples: 481816240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:33,989][27935] Avg episode reward: [(0, '-6.591')] [2022-07-13 08:31:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5088.8). Total num frames: 240924672. Throughput: 0: 10432.7. Samples: 481847960. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:38,989][27935] Avg episode reward: [(0, '-7.883')] [2022-07-13 08:31:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5099.2). Total num frames: 240952320. Throughput: 0: 10497.8. Samples: 481911876. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:43,989][27935] Avg episode reward: [(0, '-6.998')] [2022-07-13 08:31:48,990][27935] Fps is (10 sec: 5426.5, 60 sec: 5239.4, 300 sec: 5109.6). Total num frames: 240978944. Throughput: 0: 10610.9. Samples: 481975696. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:48,990][27935] Avg episode reward: [(0, '-6.706')] [2022-07-13 08:31:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5113.1). Total num frames: 241004544. Throughput: 0: 10605.6. Samples: 482007596. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:53,989][27935] Avg episode reward: [(0, '-9.038')] [2022-07-13 08:31:58,989][27935] Fps is (10 sec: 5223.0, 60 sec: 5256.5, 300 sec: 5123.5). Total num frames: 241031168. Throughput: 0: 10611.6. Samples: 482071528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:31:58,990][27935] Avg episode reward: [(0, '-6.242')] [2022-07-13 08:32:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5130.4). Total num frames: 241056768. Throughput: 0: 10534.9. Samples: 482131580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:03,991][27935] Avg episode reward: [(0, '-5.459')] [2022-07-13 08:32:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5256.5, 300 sec: 5130.4). Total num frames: 241081344. Throughput: 0: 10552.4. Samples: 482163776. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:08,990][27935] Avg episode reward: [(0, '-5.069')] [2022-07-13 08:32:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5151.2). Total num frames: 241110016. Throughput: 0: 10550.1. Samples: 482227672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:13,989][27935] Avg episode reward: [(0, '-6.564')] [2022-07-13 08:32:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5290.7, 300 sec: 5154.7). Total num frames: 241135616. Throughput: 0: 10548.5. Samples: 482290924. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:18,989][27935] Avg episode reward: [(0, '-6.205')] [2022-07-13 08:32:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5256.5, 300 sec: 5158.2). Total num frames: 241161216. Throughput: 0: 10543.4. Samples: 482322412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:23,989][27935] Avg episode reward: [(0, '-6.421')] [2022-07-13 08:32:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5165.1). Total num frames: 241187840. Throughput: 0: 10528.1. Samples: 482385640. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:28,989][27935] Avg episode reward: [(0, '-5.071')] [2022-07-13 08:32:33,995][27935] Fps is (10 sec: 5321.5, 60 sec: 5273.1, 300 sec: 5172.0). Total num frames: 241214464. Throughput: 0: 10518.7. Samples: 482449088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:33,995][27935] Avg episode reward: [(0, '-5.384')] [2022-07-13 08:32:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5182.5). Total num frames: 241241088. Throughput: 0: 10522.0. Samples: 482481088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:38,989][27935] Avg episode reward: [(0, '-5.045')] [2022-07-13 08:32:44,001][27935] Fps is (10 sec: 5424.2, 60 sec: 5272.6, 300 sec: 5192.7). Total num frames: 241268736. Throughput: 0: 10480.7. Samples: 482543284. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:44,001][27935] Avg episode reward: [(0, '-5.979')] [2022-07-13 08:32:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.6, 300 sec: 5196.4). Total num frames: 241293312. Throughput: 0: 10559.2. Samples: 482606744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:48,989][27935] Avg episode reward: [(0, '-5.747')] [2022-07-13 08:32:53,989][27935] Fps is (10 sec: 5331.1, 60 sec: 5290.7, 300 sec: 5213.7). Total num frames: 241321984. Throughput: 0: 10550.8. Samples: 482638564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:53,990][27935] Avg episode reward: [(0, '-5.580')] [2022-07-13 08:32:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 241345536. Throughput: 0: 10546.8. Samples: 482702280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:32:58,990][27935] Avg episode reward: [(0, '-5.092')] [2022-07-13 08:33:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5239.5, 300 sec: 5220.7). Total num frames: 241371136. Throughput: 0: 10461.0. Samples: 482761668. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:03,989][27935] Avg episode reward: [(0, '-6.472')] [2022-07-13 08:33:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 241397760. Throughput: 0: 10464.4. Samples: 482793312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:08,989][27935] Avg episode reward: [(0, '-6.287')] [2022-07-13 08:33:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 241424384. Throughput: 0: 10479.1. Samples: 482857200. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:13,989][27935] Avg episode reward: [(0, '-6.383')] [2022-07-13 08:33:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 241449984. Throughput: 0: 10483.7. Samples: 482920792. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:18,989][27935] Avg episode reward: [(0, '-4.114')] [2022-07-13 08:33:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5238.0). Total num frames: 241476608. Throughput: 0: 10475.0. Samples: 482952464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:23,989][27935] Avg episode reward: [(0, '-4.844')] [2022-07-13 08:33:28,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5241.5). Total num frames: 241504256. Throughput: 0: 10508.9. Samples: 483016060. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:28,989][27935] Avg episode reward: [(0, '-4.977')] [2022-07-13 08:33:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5274.1, 300 sec: 5248.4). Total num frames: 241530880. Throughput: 0: 10494.1. Samples: 483078980. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:33,989][27935] Avg episode reward: [(0, '-3.620')] [2022-07-13 08:33:38,996][27935] Fps is (10 sec: 5116.1, 60 sec: 5238.8, 300 sec: 5237.9). Total num frames: 241555456. Throughput: 0: 10486.8. Samples: 483110548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 08:33:38,997][27935] Avg episode reward: [(0, '-3.777')] [2022-07-13 08:33:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5240.5, 300 sec: 5241.5). Total num frames: 241583104. Throughput: 0: 10480.8. Samples: 483173916. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:33:43,989][27935] Avg episode reward: [(0, '-3.373')] [2022-07-13 08:33:48,990][27935] Fps is (10 sec: 5328.1, 60 sec: 5256.4, 300 sec: 5241.5). Total num frames: 241608704. Throughput: 0: 10566.5. Samples: 483237176. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:33:48,991][27935] Avg episode reward: [(0, '-3.499')] [2022-07-13 08:33:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 241634304. Throughput: 0: 10572.4. Samples: 483269072. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:33:53,989][27935] Avg episode reward: [(0, '-2.803')] [2022-07-13 08:33:58,989][27935] Fps is (10 sec: 5223.1, 60 sec: 5256.5, 300 sec: 5245.0). Total num frames: 241660928. Throughput: 0: 10545.8. Samples: 483331760. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:33:58,989][27935] Avg episode reward: [(0, '-2.756')] [2022-07-13 08:34:03,996][27935] Fps is (10 sec: 5116.2, 60 sec: 5238.8, 300 sec: 5237.9). Total num frames: 241685504. Throughput: 0: 10450.4. Samples: 483391136. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:03,998][27935] Avg episode reward: [(0, '-2.894')] [2022-07-13 08:34:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 241711104. Throughput: 0: 10451.0. Samples: 483422760. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:08,989][27935] Avg episode reward: [(0, '-2.621')] [2022-07-13 08:34:13,992][27935] Fps is (10 sec: 5327.3, 60 sec: 5239.2, 300 sec: 5241.4). Total num frames: 241738752. Throughput: 0: 10454.5. Samples: 483486544. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:13,992][27935] Avg episode reward: [(0, '-3.745')] [2022-07-13 08:34:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 241764352. Throughput: 0: 10459.1. Samples: 483549640. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:18,990][27935] Avg episode reward: [(0, '-4.436')] [2022-07-13 08:34:23,989][27935] Fps is (10 sec: 5223.9, 60 sec: 5239.5, 300 sec: 5241.5). Total num frames: 241790976. Throughput: 0: 10466.2. Samples: 483581448. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:23,989][27935] Avg episode reward: [(0, '-4.304')] [2022-07-13 08:34:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 241817600. Throughput: 0: 10458.6. Samples: 483644552. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:28,989][27935] Avg episode reward: [(0, '-4.988')] [2022-07-13 08:34:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5248.4). Total num frames: 241844224. Throughput: 0: 10453.9. Samples: 483707588. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:33,989][27935] Avg episode reward: [(0, '-5.100')] [2022-07-13 08:34:38,989][27935] Fps is (10 sec: 5324.7, 60 sec: 5257.2, 300 sec: 5241.5). Total num frames: 241870848. Throughput: 0: 10448.6. Samples: 483739260. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:38,989][27935] Avg episode reward: [(0, '-4.304')] [2022-07-13 08:34:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5251.9). Total num frames: 241897472. Throughput: 0: 10467.6. Samples: 483802804. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:43,989][27935] Avg episode reward: [(0, '-4.902')] [2022-07-13 08:34:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.6, 300 sec: 5241.5). Total num frames: 241923072. Throughput: 0: 10555.1. Samples: 483866036. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:48,991][27935] Avg episode reward: [(0, '-7.509')] [2022-07-13 08:34:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5248.4). Total num frames: 241949696. Throughput: 0: 10541.1. Samples: 483897108. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:53,993][27935] Avg episode reward: [(0, '-8.195')] [2022-07-13 08:34:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 241974272. Throughput: 0: 10512.8. Samples: 483959592. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:34:58,989][27935] Avg episode reward: [(0, '-7.283')] [2022-07-13 08:35:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5240.1, 300 sec: 5248.4). Total num frames: 241999872. Throughput: 0: 10400.8. Samples: 484017676. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:03,990][27935] Avg episode reward: [(0, '-7.571')] [2022-07-13 08:35:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 242024448. Throughput: 0: 10386.8. Samples: 484048852. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:08,989][27935] Avg episode reward: [(0, '-7.494')] [2022-07-13 08:35:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.6, 300 sec: 5241.5). Total num frames: 242052096. Throughput: 0: 10380.4. Samples: 484111672. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:13,991][27935] Avg episode reward: [(0, '-5.075')] [2022-07-13 08:35:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 242077696. Throughput: 0: 10367.2. Samples: 484174112. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:18,991][27935] Avg episode reward: [(0, '-4.459')] [2022-07-13 08:35:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 242104320. Throughput: 0: 10362.1. Samples: 484205552. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:23,989][27935] Avg episode reward: [(0, '-3.590')] [2022-07-13 08:35:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5231.1). Total num frames: 242128896. Throughput: 0: 10354.5. Samples: 484268756. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:28,989][27935] Avg episode reward: [(0, '-3.971')] [2022-07-13 08:35:33,990][27935] Fps is (10 sec: 5119.3, 60 sec: 5188.2, 300 sec: 5234.5). Total num frames: 242155520. Throughput: 0: 10334.6. Samples: 484331104. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:33,991][27935] Avg episode reward: [(0, '-3.241')] [2022-07-13 08:35:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5234.5). Total num frames: 242182144. Throughput: 0: 10344.8. Samples: 484362624. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:38,989][27935] Avg episode reward: [(0, '-3.429')] [2022-07-13 08:35:43,989][27935] Fps is (10 sec: 5325.5, 60 sec: 5188.3, 300 sec: 5234.5). Total num frames: 242208768. Throughput: 0: 10360.4. Samples: 484425808. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:43,989][27935] Avg episode reward: [(0, '-3.166')] [2022-07-13 08:35:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 242235392. Throughput: 0: 10474.5. Samples: 484489028. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:48,989][27935] Avg episode reward: [(0, '-2.631')] [2022-07-13 08:35:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5241.5). Total num frames: 242262016. Throughput: 0: 10483.4. Samples: 484520604. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:53,989][27935] Avg episode reward: [(0, '-3.979')] [2022-07-13 08:35:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5245.0). Total num frames: 242287616. Throughput: 0: 10491.3. Samples: 484583780. Policy #0 lag: (min: 0.0, avg: 7.9, max: 21.0) [2022-07-13 08:35:58,991][27935] Avg episode reward: [(0, '-4.227')] [2022-07-13 08:36:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5238.0). Total num frames: 242311168. Throughput: 0: 10420.1. Samples: 484643016. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:03,995][27935] Avg episode reward: [(0, '-5.136')] [2022-07-13 08:36:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5222.4, 300 sec: 5234.6). Total num frames: 242337792. Throughput: 0: 10419.1. Samples: 484674412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:08,989][27935] Avg episode reward: [(0, '-4.932')] [2022-07-13 08:36:13,991][27935] Fps is (10 sec: 5221.0, 60 sec: 5188.0, 300 sec: 5238.0). Total num frames: 242363392. Throughput: 0: 10420.2. Samples: 484737692. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:13,992][27935] Avg episode reward: [(0, '-5.512')] [2022-07-13 08:36:18,992][27935] Fps is (10 sec: 5322.9, 60 sec: 5222.1, 300 sec: 5238.0). Total num frames: 242391040. Throughput: 0: 10415.9. Samples: 484799844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:18,993][27935] Avg episode reward: [(0, '-7.128')] [2022-07-13 08:36:23,989][27935] Fps is (10 sec: 5326.2, 60 sec: 5205.3, 300 sec: 5238.0). Total num frames: 242416640. Throughput: 0: 10410.4. Samples: 484831092. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:23,989][27935] Avg episode reward: [(0, '-5.287')] [2022-07-13 08:36:28,989][27935] Fps is (10 sec: 5121.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 242442240. Throughput: 0: 10403.8. Samples: 484893980. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:28,989][27935] Avg episode reward: [(0, '-5.425')] [2022-07-13 08:36:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.4, 300 sec: 5231.1). Total num frames: 242467840. Throughput: 0: 10386.2. Samples: 484956408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:33,989][27935] Avg episode reward: [(0, '-4.627')] [2022-07-13 08:36:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5227.6). Total num frames: 242494464. Throughput: 0: 10380.3. Samples: 484987716. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:38,989][27935] Avg episode reward: [(0, '-3.931')] [2022-07-13 08:36:43,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 242522112. Throughput: 0: 10391.1. Samples: 485051380. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:43,989][27935] Avg episode reward: [(0, '-5.181')] [2022-07-13 08:36:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 242547712. Throughput: 0: 10469.1. Samples: 485114124. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:48,989][27935] Avg episode reward: [(0, '-3.808')] [2022-07-13 08:36:53,989][27935] Fps is (10 sec: 5120.1, 60 sec: 5188.3, 300 sec: 5227.6). Total num frames: 242573312. Throughput: 0: 10478.1. Samples: 485145928. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:53,989][27935] Avg episode reward: [(0, '-4.502')] [2022-07-13 08:36:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5224.1). Total num frames: 242597888. Throughput: 0: 10415.4. Samples: 485206360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:36:58,989][27935] Avg episode reward: [(0, '-4.755')] [2022-07-13 08:37:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 242622464. Throughput: 0: 10302.5. Samples: 485263420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:03,989][27935] Avg episode reward: [(0, '-4.374')] [2022-07-13 08:37:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 242648064. Throughput: 0: 10300.4. Samples: 485294608. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:08,989][27935] Avg episode reward: [(0, '-3.970')] [2022-07-13 08:37:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5171.4, 300 sec: 5213.7). Total num frames: 242673664. Throughput: 0: 10307.4. Samples: 485357812. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:13,991][27935] Avg episode reward: [(0, '-3.099')] [2022-07-13 08:37:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.4, 300 sec: 5217.2). Total num frames: 242700288. Throughput: 0: 10307.4. Samples: 485420240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:18,989][27935] Avg episode reward: [(0, '-2.260')] [2022-07-13 08:37:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 242726912. Throughput: 0: 10314.6. Samples: 485451872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:23,990][27935] Avg episode reward: [(0, '-1.411')] [2022-07-13 08:37:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.8). Total num frames: 242752512. Throughput: 0: 10309.2. Samples: 485515292. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:28,989][27935] Avg episode reward: [(0, '-1.089')] [2022-07-13 08:37:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 242779136. Throughput: 0: 10310.9. Samples: 485578116. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:33,989][27935] Avg episode reward: [(0, '-2.220')] [2022-07-13 08:37:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5213.9). Total num frames: 242806784. Throughput: 0: 10311.2. Samples: 485609932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:38,989][27935] Avg episode reward: [(0, '-2.907')] [2022-07-13 08:37:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5217.2). Total num frames: 242832384. Throughput: 0: 10355.7. Samples: 485672364. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:43,989][27935] Avg episode reward: [(0, '-2.656')] [2022-07-13 08:37:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 242857984. Throughput: 0: 10503.5. Samples: 485736076. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:48,989][27935] Avg episode reward: [(0, '-3.962')] [2022-07-13 08:37:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 242885632. Throughput: 0: 10520.2. Samples: 485768016. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:53,989][27935] Avg episode reward: [(0, '-4.254')] [2022-07-13 08:37:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 242912256. Throughput: 0: 10543.6. Samples: 485832272. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:37:58,989][27935] Avg episode reward: [(0, '-4.053')] [2022-07-13 08:38:03,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 242937856. Throughput: 0: 10478.1. Samples: 485891752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:38:03,989][27935] Avg episode reward: [(0, '-5.111')] [2022-07-13 08:38:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 242962432. Throughput: 0: 10479.6. Samples: 485923452. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:38:08,990][27935] Avg episode reward: [(0, '-4.705')] [2022-07-13 08:38:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 242989056. Throughput: 0: 10496.4. Samples: 485987628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:38:13,989][27935] Avg episode reward: [(0, '-4.079')] [2022-07-13 08:38:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 243015680. Throughput: 0: 10499.7. Samples: 486050604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 08:38:18,989][27935] Avg episode reward: [(0, '-3.988')] [2022-07-13 08:38:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 243041280. Throughput: 0: 10494.0. Samples: 486082160. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:23,989][27935] Avg episode reward: [(0, '-4.123')] [2022-07-13 08:38:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5213.7). Total num frames: 243068928. Throughput: 0: 10515.5. Samples: 486145560. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:28,989][27935] Avg episode reward: [(0, '-4.176')] [2022-07-13 08:38:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5213.9). Total num frames: 243093504. Throughput: 0: 10494.0. Samples: 486208308. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:33,989][27935] Avg episode reward: [(0, '-4.176')] [2022-07-13 08:38:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 243121152. Throughput: 0: 10487.0. Samples: 486239932. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:38,989][27935] Avg episode reward: [(0, '-4.153')] [2022-07-13 08:38:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 243146752. Throughput: 0: 10469.7. Samples: 486303408. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:43,989][27935] Avg episode reward: [(0, '-3.681')] [2022-07-13 08:38:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 243173376. Throughput: 0: 10554.2. Samples: 486366692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:48,989][27935] Avg episode reward: [(0, '-4.356')] [2022-07-13 08:38:53,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 243201024. Throughput: 0: 10557.2. Samples: 486398528. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:53,989][27935] Avg episode reward: [(0, '-3.301')] [2022-07-13 08:38:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5224.3). Total num frames: 243226624. Throughput: 0: 10546.0. Samples: 486462196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:38:58,990][27935] Avg episode reward: [(0, '-2.602')] [2022-07-13 08:39:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5205.3, 300 sec: 5217.2). Total num frames: 243250176. Throughput: 0: 10459.2. Samples: 486521268. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:03,989][27935] Avg episode reward: [(0, '-2.148')] [2022-07-13 08:39:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5239.5, 300 sec: 5213.8). Total num frames: 243276800. Throughput: 0: 10454.8. Samples: 486552624. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:08,991][27935] Avg episode reward: [(0, '-2.637')] [2022-07-13 08:39:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5217.2). Total num frames: 243303424. Throughput: 0: 10453.4. Samples: 486615964. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:13,989][27935] Avg episode reward: [(0, '-3.243')] [2022-07-13 08:39:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5220.7). Total num frames: 243331072. Throughput: 0: 10469.5. Samples: 486679436. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:18,989][27935] Avg episode reward: [(0, '-4.229')] [2022-07-13 08:39:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 243355648. Throughput: 0: 10473.9. Samples: 486711256. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:23,989][27935] Avg episode reward: [(0, '-5.126')] [2022-07-13 08:39:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.4, 300 sec: 5213.7). Total num frames: 243382272. Throughput: 0: 10480.1. Samples: 486775012. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:28,990][27935] Avg episode reward: [(0, '-5.744')] [2022-07-13 08:39:33,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5273.6, 300 sec: 5217.2). Total num frames: 243409920. Throughput: 0: 10486.8. Samples: 486838600. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:33,989][27935] Avg episode reward: [(0, '-5.421')] [2022-07-13 08:39:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5217.2). Total num frames: 243436544. Throughput: 0: 10472.9. Samples: 486869808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:38,989][27935] Avg episode reward: [(0, '-5.005')] [2022-07-13 08:39:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5273.6, 300 sec: 5220.7). Total num frames: 243463168. Throughput: 0: 10481.3. Samples: 486933856. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:43,989][27935] Avg episode reward: [(0, '-5.761')] [2022-07-13 08:39:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 243487744. Throughput: 0: 10581.4. Samples: 486997428. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:48,989][27935] Avg episode reward: [(0, '-4.599')] [2022-07-13 08:39:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 243516416. Throughput: 0: 10585.3. Samples: 487028964. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:53,990][27935] Avg episode reward: [(0, '-2.250')] [2022-07-13 08:39:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 243542016. Throughput: 0: 10590.2. Samples: 487092524. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:39:58,991][27935] Avg episode reward: [(0, '-1.953')] [2022-07-13 08:40:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5273.6, 300 sec: 5227.6). Total num frames: 243566592. Throughput: 0: 10477.8. Samples: 487150936. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:03,989][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 08:40:08,990][27935] Fps is (10 sec: 5016.7, 60 sec: 5256.4, 300 sec: 5220.6). Total num frames: 243592192. Throughput: 0: 10460.9. Samples: 487182016. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:08,991][27935] Avg episode reward: [(0, '-2.463')] [2022-07-13 08:40:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5256.5, 300 sec: 5224.1). Total num frames: 243618816. Throughput: 0: 10441.0. Samples: 487244856. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:13,989][27935] Avg episode reward: [(0, '-2.409')] [2022-07-13 08:40:18,991][27935] Fps is (10 sec: 5119.8, 60 sec: 5205.1, 300 sec: 5217.2). Total num frames: 243643392. Throughput: 0: 10432.1. Samples: 487308068. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:18,993][27935] Avg episode reward: [(0, '-1.280')] [2022-07-13 08:40:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5224.1). Total num frames: 243670016. Throughput: 0: 10438.6. Samples: 487339544. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:23,989][27935] Avg episode reward: [(0, '-1.588')] [2022-07-13 08:40:28,989][27935] Fps is (10 sec: 5428.4, 60 sec: 5256.5, 300 sec: 5227.6). Total num frames: 243697664. Throughput: 0: 10412.4. Samples: 487402412. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:28,989][27935] Avg episode reward: [(0, '-2.566')] [2022-07-13 08:40:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 243723264. Throughput: 0: 9699.4. Samples: 487433900. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 08:40:33,989][27935] Avg episode reward: [(0, '-3.455')] [2022-07-13 08:40:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 243748864. Throughput: 0: 10386.7. Samples: 487496364. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:40:38,989][27935] Avg episode reward: [(0, '-3.375')] [2022-07-13 08:40:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5220.7). Total num frames: 243775488. Throughput: 0: 10377.9. Samples: 487559528. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:40:43,989][27935] Avg episode reward: [(0, '-2.730')] [2022-07-13 08:40:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5217.2). Total num frames: 243801088. Throughput: 0: 10485.3. Samples: 487622772. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:40:48,989][27935] Avg episode reward: [(0, '-3.643')] [2022-07-13 08:40:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 243828736. Throughput: 0: 10490.0. Samples: 487654048. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:40:53,989][27935] Avg episode reward: [(0, '-4.312')] [2022-07-13 08:40:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 243854336. Throughput: 0: 10504.5. Samples: 487717560. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:40:58,989][27935] Avg episode reward: [(0, '-3.243')] [2022-07-13 08:41:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 243878912. Throughput: 0: 10426.3. Samples: 487777228. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:03,989][27935] Avg episode reward: [(0, '-3.664')] [2022-07-13 08:41:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5222.6, 300 sec: 5227.7). Total num frames: 243905536. Throughput: 0: 10421.0. Samples: 487808488. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:08,989][27935] Avg episode reward: [(0, '-4.067')] [2022-07-13 08:41:13,991][27935] Fps is (10 sec: 5221.3, 60 sec: 5205.1, 300 sec: 5220.7). Total num frames: 243931136. Throughput: 0: 10432.3. Samples: 487871888. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:13,991][27935] Avg episode reward: [(0, '-5.762')] [2022-07-13 08:41:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.7, 300 sec: 5224.1). Total num frames: 243957760. Throughput: 0: 11136.7. Samples: 487935052. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:18,989][27935] Avg episode reward: [(0, '-6.632')] [2022-07-13 08:41:23,989][27935] Fps is (10 sec: 5326.0, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 243984384. Throughput: 0: 10450.9. Samples: 487966656. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:23,990][27935] Avg episode reward: [(0, '-5.983')] [2022-07-13 08:41:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 244008960. Throughput: 0: 10449.1. Samples: 488029736. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:28,991][27935] Avg episode reward: [(0, '-6.345')] [2022-07-13 08:41:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5227.6). Total num frames: 244036608. Throughput: 0: 10429.2. Samples: 488092084. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:33,989][27935] Avg episode reward: [(0, '-4.939')] [2022-07-13 08:41:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5220.7). Total num frames: 244062208. Throughput: 0: 10433.3. Samples: 488123544. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:38,989][27935] Avg episode reward: [(0, '-5.131')] [2022-07-13 08:41:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5224.1). Total num frames: 244088832. Throughput: 0: 10418.3. Samples: 488186384. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:43,990][27935] Avg episode reward: [(0, '-5.165')] [2022-07-13 08:41:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5227.6). Total num frames: 244115456. Throughput: 0: 10489.7. Samples: 488249264. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:48,989][27935] Avg episode reward: [(0, '-5.638')] [2022-07-13 08:41:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5234.5). Total num frames: 244142080. Throughput: 0: 10503.1. Samples: 488281128. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:53,989][27935] Avg episode reward: [(0, '-7.049')] [2022-07-13 08:41:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5238.0). Total num frames: 244167680. Throughput: 0: 10510.6. Samples: 488344844. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:41:58,995][27935] Avg episode reward: [(0, '-6.707')] [2022-07-13 08:42:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5238.0). Total num frames: 244193280. Throughput: 0: 10413.8. Samples: 488403672. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:03,989][27935] Avg episode reward: [(0, '-6.689')] [2022-07-13 08:42:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5171.2, 300 sec: 5227.6). Total num frames: 244215808. Throughput: 0: 10410.7. Samples: 488435136. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:08,989][27935] Avg episode reward: [(0, '-7.280')] [2022-07-13 08:42:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.7, 300 sec: 5238.0). Total num frames: 244245504. Throughput: 0: 10417.2. Samples: 488498512. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:13,990][27935] Avg episode reward: [(0, '-7.269')] [2022-07-13 08:42:18,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5222.4, 300 sec: 5234.6). Total num frames: 244271104. Throughput: 0: 10424.4. Samples: 488561184. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:18,989][27935] Avg episode reward: [(0, '-4.762')] [2022-07-13 08:42:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5234.5). Total num frames: 244296704. Throughput: 0: 10425.9. Samples: 488592708. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:23,989][27935] Avg episode reward: [(0, '-3.556')] [2022-07-13 08:42:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5234.5). Total num frames: 244323328. Throughput: 0: 10438.7. Samples: 488656124. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:28,989][27935] Avg episode reward: [(0, '-3.016')] [2022-07-13 08:42:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 244349952. Throughput: 0: 10431.7. Samples: 488718692. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:33,989][27935] Avg episode reward: [(0, '-3.143')] [2022-07-13 08:42:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5231.1). Total num frames: 244375552. Throughput: 0: 10426.6. Samples: 488750324. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:38,991][27935] Avg episode reward: [(0, '-2.656')] [2022-07-13 08:42:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5231.1). Total num frames: 244401152. Throughput: 0: 10363.5. Samples: 488811200. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:43,989][27935] Avg episode reward: [(0, '-2.790')] [2022-07-13 08:42:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 244426752. Throughput: 0: 10449.1. Samples: 488873880. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:49,004][27935] Avg episode reward: [(0, '-2.104')] [2022-07-13 08:42:53,990][27935] Fps is (10 sec: 5221.5, 60 sec: 5188.1, 300 sec: 5224.1). Total num frames: 244453376. Throughput: 0: 10443.8. Samples: 488905124. Policy #0 lag: (min: 0.0, avg: 10.7, max: 21.0) [2022-07-13 08:42:53,991][27935] Avg episode reward: [(0, '-3.142')] [2022-07-13 08:42:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5224.1). Total num frames: 244478976. Throughput: 0: 10439.9. Samples: 488968308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:42:58,989][27935] Avg episode reward: [(0, '-3.509')] [2022-07-13 08:43:03,996][27935] Fps is (10 sec: 4912.3, 60 sec: 5153.5, 300 sec: 5220.5). Total num frames: 244502528. Throughput: 0: 10298.8. Samples: 489024708. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:03,997][27935] Avg episode reward: [(0, '-3.741')] [2022-07-13 08:43:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5188.3, 300 sec: 5213.7). Total num frames: 244527104. Throughput: 0: 10270.8. Samples: 489054896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:08,989][27935] Avg episode reward: [(0, '-4.390')] [2022-07-13 08:43:13,989][27935] Fps is (10 sec: 5226.3, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 244554752. Throughput: 0: 10256.3. Samples: 489117656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:13,989][27935] Avg episode reward: [(0, '-3.854')] [2022-07-13 08:43:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5171.2, 300 sec: 5220.7). Total num frames: 244581376. Throughput: 0: 10257.3. Samples: 489180272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:18,989][27935] Avg episode reward: [(0, '-3.771')] [2022-07-13 08:43:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 244606976. Throughput: 0: 10255.4. Samples: 489211816. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:23,989][27935] Avg episode reward: [(0, '-4.118')] [2022-07-13 08:43:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5217.2). Total num frames: 244632576. Throughput: 0: 10285.7. Samples: 489274056. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:28,989][27935] Avg episode reward: [(0, '-5.455')] [2022-07-13 08:43:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5213.7). Total num frames: 244659200. Throughput: 0: 10283.4. Samples: 489336632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:33,989][27935] Avg episode reward: [(0, '-4.717')] [2022-07-13 08:43:38,996][27935] Fps is (10 sec: 5218.4, 60 sec: 5153.5, 300 sec: 5213.6). Total num frames: 244684800. Throughput: 0: 10289.6. Samples: 489368216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:38,997][27935] Avg episode reward: [(0, '-5.957')] [2022-07-13 08:43:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5213.7). Total num frames: 244711424. Throughput: 0: 10276.0. Samples: 489430728. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:43,990][27935] Avg episode reward: [(0, '-5.727')] [2022-07-13 08:43:48,989][27935] Fps is (10 sec: 5226.4, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 244737024. Throughput: 0: 10434.8. Samples: 489494196. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:48,990][27935] Avg episode reward: [(0, '-4.911')] [2022-07-13 08:43:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.3, 300 sec: 5206.8). Total num frames: 244762624. Throughput: 0: 10463.1. Samples: 489525736. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:53,990][27935] Avg episode reward: [(0, '-4.962')] [2022-07-13 08:43:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 5224.1). Total num frames: 244791296. Throughput: 0: 10466.8. Samples: 489588664. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:43:58,989][27935] Avg episode reward: [(0, '-4.316')] [2022-07-13 08:44:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.9, 300 sec: 5210.2). Total num frames: 244813824. Throughput: 0: 10382.1. Samples: 489647468. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:03,989][27935] Avg episode reward: [(0, '-4.661')] [2022-07-13 08:44:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 244840448. Throughput: 0: 10380.1. Samples: 489678920. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:08,989][27935] Avg episode reward: [(0, '-4.048')] [2022-07-13 08:44:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 244866048. Throughput: 0: 10391.2. Samples: 489741660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:13,989][27935] Avg episode reward: [(0, '-4.768')] [2022-07-13 08:44:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5210.3). Total num frames: 244892672. Throughput: 0: 10393.0. Samples: 489804316. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:18,989][27935] Avg episode reward: [(0, '-5.468')] [2022-07-13 08:44:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 244918272. Throughput: 0: 10389.5. Samples: 489835664. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:23,990][27935] Avg episode reward: [(0, '-5.942')] [2022-07-13 08:44:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 244942848. Throughput: 0: 10395.1. Samples: 489898508. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:28,989][27935] Avg episode reward: [(0, '-5.323')] [2022-07-13 08:44:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 244970496. Throughput: 0: 10371.1. Samples: 489960896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:33,989][27935] Avg episode reward: [(0, '-5.249')] [2022-07-13 08:44:38,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5206.0, 300 sec: 5199.8). Total num frames: 244997120. Throughput: 0: 10376.5. Samples: 489992680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:38,989][27935] Avg episode reward: [(0, '-4.693')] [2022-07-13 08:44:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 245023744. Throughput: 0: 10379.2. Samples: 490055728. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:43,989][27935] Avg episode reward: [(0, '-5.212')] [2022-07-13 08:44:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245049344. Throughput: 0: 10471.1. Samples: 490118668. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:48,989][27935] Avg episode reward: [(0, '-3.446')] [2022-07-13 08:44:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245074944. Throughput: 0: 10465.2. Samples: 490149852. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:53,989][27935] Avg episode reward: [(0, '-3.955')] [2022-07-13 08:44:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 245101568. Throughput: 0: 10471.5. Samples: 490212880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:44:58,990][27935] Avg episode reward: [(0, '-4.076')] [2022-07-13 08:45:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.9). Total num frames: 245126144. Throughput: 0: 10394.1. Samples: 490272052. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:45:03,991][27935] Avg episode reward: [(0, '-4.422')] [2022-07-13 08:45:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 245152768. Throughput: 0: 10395.1. Samples: 490303444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:45:08,996][27935] Avg episode reward: [(0, '-4.669')] [2022-07-13 08:45:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 245178368. Throughput: 0: 10394.2. Samples: 490366248. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 08:45:13,989][27935] Avg episode reward: [(0, '-4.757')] [2022-07-13 08:45:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 245203968. Throughput: 0: 10408.8. Samples: 490429292. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:18,989][27935] Avg episode reward: [(0, '-5.373')] [2022-07-13 08:45:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 245231616. Throughput: 0: 10398.7. Samples: 490460620. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:23,989][27935] Avg episode reward: [(0, '-5.114')] [2022-07-13 08:45:28,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5239.5, 300 sec: 5199.8). Total num frames: 245257216. Throughput: 0: 10395.4. Samples: 490523520. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:28,989][27935] Avg episode reward: [(0, '-4.291')] [2022-07-13 08:45:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 245283840. Throughput: 0: 9694.4. Samples: 490554916. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:33,989][27935] Avg episode reward: [(0, '-3.349')] [2022-07-13 08:45:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 245308416. Throughput: 0: 10388.6. Samples: 490617340. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:38,989][27935] Avg episode reward: [(0, '-4.365')] [2022-07-13 08:45:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 245335040. Throughput: 0: 10381.2. Samples: 490680032. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:43,989][27935] Avg episode reward: [(0, '-4.254')] [2022-07-13 08:45:48,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 245362688. Throughput: 0: 10458.8. Samples: 490742700. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:49,003][27935] Avg episode reward: [(0, '-4.080')] [2022-07-13 08:45:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245387264. Throughput: 0: 10459.7. Samples: 490774132. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:53,989][27935] Avg episode reward: [(0, '-4.054')] [2022-07-13 08:45:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 245413888. Throughput: 0: 10473.4. Samples: 490837552. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:45:58,989][27935] Avg episode reward: [(0, '-4.334')] [2022-07-13 08:46:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245438464. Throughput: 0: 10377.7. Samples: 490896288. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:03,989][27935] Avg episode reward: [(0, '-4.243')] [2022-07-13 08:46:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 245466112. Throughput: 0: 10378.0. Samples: 490927632. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:08,989][27935] Avg episode reward: [(0, '-5.828')] [2022-07-13 08:46:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 245491712. Throughput: 0: 10379.0. Samples: 490990576. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:13,989][27935] Avg episode reward: [(0, '-3.790')] [2022-07-13 08:46:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 245516288. Throughput: 0: 11074.5. Samples: 491053268. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:18,989][27935] Avg episode reward: [(0, '-3.096')] [2022-07-13 08:46:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 245543936. Throughput: 0: 10377.6. Samples: 491084332. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:23,991][27935] Avg episode reward: [(0, '-3.416')] [2022-07-13 08:46:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245569536. Throughput: 0: 10378.6. Samples: 491147068. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:28,991][27935] Avg episode reward: [(0, '-3.425')] [2022-07-13 08:46:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 245594112. Throughput: 0: 10370.5. Samples: 491209372. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:33,991][27935] Avg episode reward: [(0, '-2.788')] [2022-07-13 08:46:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 245621760. Throughput: 0: 10376.3. Samples: 491241064. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:38,989][27935] Avg episode reward: [(0, '-2.318')] [2022-07-13 08:46:43,995][27935] Fps is (10 sec: 5423.7, 60 sec: 5221.8, 300 sec: 5196.3). Total num frames: 245648384. Throughput: 0: 10365.1. Samples: 491304048. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:43,996][27935] Avg episode reward: [(0, '-4.796')] [2022-07-13 08:46:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 245672960. Throughput: 0: 10469.0. Samples: 491367392. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:48,990][27935] Avg episode reward: [(0, '-5.057')] [2022-07-13 08:46:53,989][27935] Fps is (10 sec: 5123.3, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 245699584. Throughput: 0: 10465.2. Samples: 491398568. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:53,989][27935] Avg episode reward: [(0, '-5.355')] [2022-07-13 08:46:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245726208. Throughput: 0: 10479.7. Samples: 491462164. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:46:58,989][27935] Avg episode reward: [(0, '-5.081')] [2022-07-13 08:47:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 245750784. Throughput: 0: 10399.4. Samples: 491521240. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:03,989][27935] Avg episode reward: [(0, '-5.281')] [2022-07-13 08:47:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 245776384. Throughput: 0: 10411.1. Samples: 491552832. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:08,989][27935] Avg episode reward: [(0, '-4.841')] [2022-07-13 08:47:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5192.9). Total num frames: 245803008. Throughput: 0: 10425.5. Samples: 491616216. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:13,989][27935] Avg episode reward: [(0, '-2.518')] [2022-07-13 08:47:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 245829632. Throughput: 0: 10440.2. Samples: 491679184. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:18,989][27935] Avg episode reward: [(0, '-2.427')] [2022-07-13 08:47:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 245856256. Throughput: 0: 10442.9. Samples: 491710996. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:23,989][27935] Avg episode reward: [(0, '-1.414')] [2022-07-13 08:47:28,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 5196.4). Total num frames: 245882880. Throughput: 0: 10449.7. Samples: 491774216. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:28,989][27935] Avg episode reward: [(0, '-2.206')] [2022-07-13 08:47:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5196.4). Total num frames: 245908480. Throughput: 0: 10443.7. Samples: 491837360. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 08:47:33,989][27935] Avg episode reward: [(0, '-3.321')] [2022-07-13 08:47:38,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 245936128. Throughput: 0: 10460.0. Samples: 491869268. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:47:38,989][27935] Avg episode reward: [(0, '-4.502')] [2022-07-13 08:47:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.9, 300 sec: 5199.8). Total num frames: 245960704. Throughput: 0: 10409.9. Samples: 491930608. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:47:43,989][27935] Avg episode reward: [(0, '-4.445')] [2022-07-13 08:47:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5199.9). Total num frames: 245987328. Throughput: 0: 10497.0. Samples: 491993604. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:47:48,989][27935] Avg episode reward: [(0, '-5.393')] [2022-07-13 08:47:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5203.3). Total num frames: 246013952. Throughput: 0: 10500.8. Samples: 492025368. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:47:53,989][27935] Avg episode reward: [(0, '-6.173')] [2022-07-13 08:47:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.4). Total num frames: 246039552. Throughput: 0: 10501.7. Samples: 492088792. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:47:58,989][27935] Avg episode reward: [(0, '-5.221')] [2022-07-13 08:48:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5213.7). Total num frames: 246065152. Throughput: 0: 10412.1. Samples: 492147728. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:03,989][27935] Avg episode reward: [(0, '-4.465')] [2022-07-13 08:48:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5239.5, 300 sec: 5206.8). Total num frames: 246090752. Throughput: 0: 10407.4. Samples: 492179328. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:08,989][27935] Avg episode reward: [(0, '-4.655')] [2022-07-13 08:48:13,989][27935] Fps is (10 sec: 5119.9, 60 sec: 5222.4, 300 sec: 5203.3). Total num frames: 246116352. Throughput: 0: 10399.8. Samples: 492242208. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:13,989][27935] Avg episode reward: [(0, '-3.871')] [2022-07-13 08:48:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 5210.3). Total num frames: 246144000. Throughput: 0: 10391.8. Samples: 492304988. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:18,989][27935] Avg episode reward: [(0, '-2.572')] [2022-07-13 08:48:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5203.3). Total num frames: 246167552. Throughput: 0: 10387.9. Samples: 492336724. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:23,989][27935] Avg episode reward: [(0, '-2.614')] [2022-07-13 08:48:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 246196224. Throughput: 0: 10415.1. Samples: 492399288. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:28,989][27935] Avg episode reward: [(0, '-2.696')] [2022-07-13 08:48:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5206.9). Total num frames: 246220800. Throughput: 0: 10391.7. Samples: 492461228. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:33,989][27935] Avg episode reward: [(0, '-2.091')] [2022-07-13 08:48:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 246247424. Throughput: 0: 10378.4. Samples: 492492396. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:38,991][27935] Avg episode reward: [(0, '-1.819')] [2022-07-13 08:48:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5206.8). Total num frames: 246273024. Throughput: 0: 10368.5. Samples: 492555376. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:43,990][27935] Avg episode reward: [(0, '-1.596')] [2022-07-13 08:48:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 246298624. Throughput: 0: 10448.0. Samples: 492617888. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:48,989][27935] Avg episode reward: [(0, '-2.947')] [2022-07-13 08:48:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 246325248. Throughput: 0: 10447.7. Samples: 492649476. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:53,989][27935] Avg episode reward: [(0, '-3.351')] [2022-07-13 08:48:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5213.7). Total num frames: 246351872. Throughput: 0: 10452.2. Samples: 492712556. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:48:58,989][27935] Avg episode reward: [(0, '-3.626')] [2022-07-13 08:49:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5206.8). Total num frames: 246376448. Throughput: 0: 10368.6. Samples: 492771576. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:03,989][27935] Avg episode reward: [(0, '-3.594')] [2022-07-13 08:49:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5171.2, 300 sec: 5203.3). Total num frames: 246401024. Throughput: 0: 10338.0. Samples: 492801936. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:08,989][27935] Avg episode reward: [(0, '-3.867')] [2022-07-13 08:49:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 246426624. Throughput: 0: 10299.3. Samples: 492862756. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:13,989][27935] Avg episode reward: [(0, '-3.297')] [2022-07-13 08:49:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5203.3). Total num frames: 246453248. Throughput: 0: 10325.3. Samples: 492925868. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:18,989][27935] Avg episode reward: [(0, '-3.544')] [2022-07-13 08:49:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5210.3). Total num frames: 246479872. Throughput: 0: 10329.6. Samples: 492957228. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:23,989][27935] Avg episode reward: [(0, '-3.523')] [2022-07-13 08:49:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5199.8). Total num frames: 246504448. Throughput: 0: 10328.6. Samples: 493020164. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:28,989][27935] Avg episode reward: [(0, '-3.661')] [2022-07-13 08:49:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 246531072. Throughput: 0: 10330.7. Samples: 493082768. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:33,989][27935] Avg episode reward: [(0, '-2.190')] [2022-07-13 08:49:39,001][27935] Fps is (10 sec: 5318.5, 60 sec: 5170.2, 300 sec: 5199.6). Total num frames: 246557696. Throughput: 0: 10321.5. Samples: 493114064. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:39,001][27935] Avg episode reward: [(0, '-3.266')] [2022-07-13 08:49:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 246583296. Throughput: 0: 10316.0. Samples: 493176776. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:43,989][27935] Avg episode reward: [(0, '-2.152')] [2022-07-13 08:49:48,989][27935] Fps is (10 sec: 5126.0, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 246608896. Throughput: 0: 10371.9. Samples: 493238312. Policy #0 lag: (min: 0.0, avg: 10.6, max: 23.0) [2022-07-13 08:49:48,989][27935] Avg episode reward: [(0, '-2.283')] [2022-07-13 08:49:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5199.8). Total num frames: 246635520. Throughput: 0: 10399.6. Samples: 493269916. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:49:53,991][27935] Avg episode reward: [(0, '-2.983')] [2022-07-13 08:49:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5206.8). Total num frames: 246662144. Throughput: 0: 10441.3. Samples: 493332612. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:49:58,991][27935] Avg episode reward: [(0, '-2.282')] [2022-07-13 08:50:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 246685696. Throughput: 0: 10359.0. Samples: 493392020. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:03,992][27935] Avg episode reward: [(0, '-2.138')] [2022-07-13 08:50:08,989][27935] Fps is (10 sec: 5119.7, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 246713344. Throughput: 0: 10359.3. Samples: 493423400. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:08,991][27935] Avg episode reward: [(0, '-1.626')] [2022-07-13 08:50:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 246738944. Throughput: 0: 10366.1. Samples: 493486636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:13,991][27935] Avg episode reward: [(0, '-2.081')] [2022-07-13 08:50:18,989][27935] Fps is (10 sec: 5222.7, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 246765568. Throughput: 0: 10363.5. Samples: 493549124. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:18,989][27935] Avg episode reward: [(0, '-3.365')] [2022-07-13 08:50:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 246791168. Throughput: 0: 10373.2. Samples: 493580736. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:23,989][27935] Avg episode reward: [(0, '-4.584')] [2022-07-13 08:50:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 5199.8). Total num frames: 246817792. Throughput: 0: 10379.0. Samples: 493643832. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:28,989][27935] Avg episode reward: [(0, '-4.790')] [2022-07-13 08:50:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5203.3). Total num frames: 246843392. Throughput: 0: 10382.5. Samples: 493705524. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:33,989][27935] Avg episode reward: [(0, '-5.339')] [2022-07-13 08:50:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5189.3, 300 sec: 5199.8). Total num frames: 246868992. Throughput: 0: 10371.5. Samples: 493736632. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:38,989][27935] Avg episode reward: [(0, '-6.278')] [2022-07-13 08:50:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5196.4). Total num frames: 246895616. Throughput: 0: 10391.1. Samples: 493800212. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:43,989][27935] Avg episode reward: [(0, '-6.598')] [2022-07-13 08:50:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5199.8). Total num frames: 246921216. Throughput: 0: 10479.1. Samples: 493863580. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:48,990][27935] Avg episode reward: [(0, '-6.150')] [2022-07-13 08:50:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 246946816. Throughput: 0: 10480.0. Samples: 493894992. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:53,990][27935] Avg episode reward: [(0, '-4.959')] [2022-07-13 08:50:58,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5222.4, 300 sec: 5210.3). Total num frames: 246975488. Throughput: 0: 10469.6. Samples: 493957768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:50:58,989][27935] Avg episode reward: [(0, '-4.772')] [2022-07-13 08:51:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5192.9). Total num frames: 246998016. Throughput: 0: 10386.7. Samples: 494016524. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:03,991][27935] Avg episode reward: [(0, '-5.403')] [2022-07-13 08:51:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5205.4, 300 sec: 5199.8). Total num frames: 247025664. Throughput: 0: 10372.3. Samples: 494047492. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:08,991][27935] Avg episode reward: [(0, '-4.721')] [2022-07-13 08:51:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5196.4). Total num frames: 247049216. Throughput: 0: 10359.1. Samples: 494109992. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:13,993][27935] Avg episode reward: [(0, '-2.390')] [2022-07-13 08:51:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 247075840. Throughput: 0: 10358.7. Samples: 494171664. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:18,989][27935] Avg episode reward: [(0, '-2.334')] [2022-07-13 08:51:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5196.4). Total num frames: 247102464. Throughput: 0: 10353.4. Samples: 494202536. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:23,989][27935] Avg episode reward: [(0, '-2.221')] [2022-07-13 08:51:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5196.4). Total num frames: 247127040. Throughput: 0: 10319.4. Samples: 494264584. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:28,989][27935] Avg episode reward: [(0, '-1.468')] [2022-07-13 08:51:33,997][27935] Fps is (10 sec: 5116.0, 60 sec: 5170.5, 300 sec: 5192.8). Total num frames: 247153664. Throughput: 0: 10278.6. Samples: 494326196. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:33,997][27935] Avg episode reward: [(0, '-1.184')] [2022-07-13 08:51:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5189.5). Total num frames: 247179264. Throughput: 0: 10279.8. Samples: 494357584. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:38,989][27935] Avg episode reward: [(0, '-2.015')] [2022-07-13 08:51:43,989][27935] Fps is (10 sec: 5329.0, 60 sec: 5188.3, 300 sec: 5199.8). Total num frames: 247206912. Throughput: 0: 10284.7. Samples: 494420580. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:43,989][27935] Avg episode reward: [(0, '-2.722')] [2022-07-13 08:51:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 247231488. Throughput: 0: 10364.7. Samples: 494482936. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:48,990][27935] Avg episode reward: [(0, '-3.865')] [2022-07-13 08:51:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5189.4). Total num frames: 247257088. Throughput: 0: 10369.4. Samples: 494514116. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:53,989][27935] Avg episode reward: [(0, '-4.561')] [2022-07-13 08:51:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5196.4). Total num frames: 247283712. Throughput: 0: 10365.0. Samples: 494576416. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:51:58,989][27935] Avg episode reward: [(0, '-5.087')] [2022-07-13 08:52:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5192.9). Total num frames: 247308288. Throughput: 0: 10292.4. Samples: 494634820. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:52:03,989][27935] Avg episode reward: [(0, '-5.137')] [2022-07-13 08:52:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5192.9). Total num frames: 247334912. Throughput: 0: 10298.1. Samples: 494665952. Policy #0 lag: (min: 0.0, avg: 8.3, max: 18.0) [2022-07-13 08:52:08,989][27935] Avg episode reward: [(0, '-4.253')] [2022-07-13 08:52:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 247358464. Throughput: 0: 10296.8. Samples: 494727940. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:13,990][27935] Avg episode reward: [(0, '-3.634')] [2022-07-13 08:52:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5186.0). Total num frames: 247386112. Throughput: 0: 10323.2. Samples: 494790660. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:18,989][27935] Avg episode reward: [(0, '-3.099')] [2022-07-13 08:52:23,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5182.5). Total num frames: 247411712. Throughput: 0: 10319.9. Samples: 494821980. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:23,989][27935] Avg episode reward: [(0, '-3.214')] [2022-07-13 08:52:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 247438336. Throughput: 0: 10299.5. Samples: 494884060. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:28,989][27935] Avg episode reward: [(0, '-3.761')] [2022-07-13 08:52:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.7, 300 sec: 5172.1). Total num frames: 247461888. Throughput: 0: 10292.0. Samples: 494946076. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:33,989][27935] Avg episode reward: [(0, '-3.361')] [2022-07-13 08:52:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5186.0). Total num frames: 247490560. Throughput: 0: 10286.0. Samples: 494976984. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:38,989][27935] Avg episode reward: [(0, '-4.402')] [2022-07-13 08:52:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5175.5). Total num frames: 247514112. Throughput: 0: 10264.8. Samples: 495038332. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:43,989][27935] Avg episode reward: [(0, '-6.055')] [2022-07-13 08:52:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 247540736. Throughput: 0: 10354.7. Samples: 495100784. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:48,990][27935] Avg episode reward: [(0, '-5.422')] [2022-07-13 08:52:53,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 247567360. Throughput: 0: 10344.4. Samples: 495131448. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:53,989][27935] Avg episode reward: [(0, '-5.089')] [2022-07-13 08:52:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 247592960. Throughput: 0: 10359.0. Samples: 495194096. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:52:58,989][27935] Avg episode reward: [(0, '-4.559')] [2022-07-13 08:53:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 247616512. Throughput: 0: 10267.1. Samples: 495252680. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:03,989][27935] Avg episode reward: [(0, '-4.992')] [2022-07-13 08:53:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5172.1). Total num frames: 247642112. Throughput: 0: 10271.1. Samples: 495284180. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:08,989][27935] Avg episode reward: [(0, '-5.079')] [2022-07-13 08:53:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5171.2, 300 sec: 5168.6). Total num frames: 247668736. Throughput: 0: 10296.1. Samples: 495347384. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:13,989][27935] Avg episode reward: [(0, '-3.530')] [2022-07-13 08:53:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 247695360. Throughput: 0: 10299.1. Samples: 495409536. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:18,989][27935] Avg episode reward: [(0, '-4.177')] [2022-07-13 08:53:23,989][27935] Fps is (10 sec: 5324.9, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 247721984. Throughput: 0: 10306.2. Samples: 495440764. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:23,989][27935] Avg episode reward: [(0, '-4.512')] [2022-07-13 08:53:28,996][27935] Fps is (10 sec: 5116.2, 60 sec: 5136.4, 300 sec: 5171.9). Total num frames: 247746560. Throughput: 0: 10338.2. Samples: 495503628. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:28,997][27935] Avg episode reward: [(0, '-4.578')] [2022-07-13 08:53:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5175.5). Total num frames: 247774208. Throughput: 0: 10336.4. Samples: 495565924. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:33,990][27935] Avg episode reward: [(0, '-3.529')] [2022-07-13 08:53:38,989][27935] Fps is (10 sec: 5226.4, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 247798784. Throughput: 0: 10353.9. Samples: 495597372. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:38,989][27935] Avg episode reward: [(0, '-3.278')] [2022-07-13 08:53:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 247826432. Throughput: 0: 10365.2. Samples: 495660532. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:43,989][27935] Avg episode reward: [(0, '-2.976')] [2022-07-13 08:53:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 247852032. Throughput: 0: 10440.3. Samples: 495722492. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:48,989][27935] Avg episode reward: [(0, '-2.328')] [2022-07-13 08:53:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 247877632. Throughput: 0: 10433.4. Samples: 495753684. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:53,990][27935] Avg episode reward: [(0, '-2.707')] [2022-07-13 08:53:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 247903232. Throughput: 0: 10418.7. Samples: 495816224. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:53:58,991][27935] Avg episode reward: [(0, '-3.122')] [2022-07-13 08:54:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 247928832. Throughput: 0: 10344.2. Samples: 495875024. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:03,991][27935] Avg episode reward: [(0, '-3.637')] [2022-07-13 08:54:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 247953408. Throughput: 0: 10343.0. Samples: 495906200. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:08,989][27935] Avg episode reward: [(0, '-4.094')] [2022-07-13 08:54:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 5179.0). Total num frames: 247981056. Throughput: 0: 10354.4. Samples: 495969496. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:13,989][27935] Avg episode reward: [(0, '-4.937')] [2022-07-13 08:54:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 248006656. Throughput: 0: 10370.6. Samples: 496032600. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:18,989][27935] Avg episode reward: [(0, '-5.380')] [2022-07-13 08:54:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 248033280. Throughput: 0: 10376.8. Samples: 496064328. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:23,989][27935] Avg episode reward: [(0, '-6.219')] [2022-07-13 08:54:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5206.0, 300 sec: 5179.0). Total num frames: 248058880. Throughput: 0: 10365.2. Samples: 496126964. Policy #0 lag: (min: 1.0, avg: 9.7, max: 22.0) [2022-07-13 08:54:28,989][27935] Avg episode reward: [(0, '-5.415')] [2022-07-13 08:54:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5179.2). Total num frames: 248085504. Throughput: 0: 9681.3. Samples: 496158152. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:33,989][27935] Avg episode reward: [(0, '-5.086')] [2022-07-13 08:54:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 5175.5). Total num frames: 248110080. Throughput: 0: 10362.6. Samples: 496220000. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:38,989][27935] Avg episode reward: [(0, '-4.510')] [2022-07-13 08:54:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 248137728. Throughput: 0: 10357.8. Samples: 496282324. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:43,989][27935] Avg episode reward: [(0, '-3.699')] [2022-07-13 08:54:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5175.5). Total num frames: 248162304. Throughput: 0: 9748.8. Samples: 496313720. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:48,989][27935] Avg episode reward: [(0, '-3.147')] [2022-07-13 08:54:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5172.1). Total num frames: 248187904. Throughput: 0: 10441.1. Samples: 496376048. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:53,989][27935] Avg episode reward: [(0, '-3.256')] [2022-07-13 08:54:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5182.5). Total num frames: 248214528. Throughput: 0: 10417.2. Samples: 496438272. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:54:58,990][27935] Avg episode reward: [(0, '-4.559')] [2022-07-13 08:55:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 5168.6). Total num frames: 248238080. Throughput: 0: 10317.9. Samples: 496496908. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:03,991][27935] Avg episode reward: [(0, '-4.987')] [2022-07-13 08:55:08,999][27935] Fps is (10 sec: 5012.3, 60 sec: 5187.3, 300 sec: 5171.9). Total num frames: 248264704. Throughput: 0: 10294.0. Samples: 496527668. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:09,000][27935] Avg episode reward: [(0, '-5.955')] [2022-07-13 08:55:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5165.1). Total num frames: 248289280. Throughput: 0: 10230.5. Samples: 496587336. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:13,989][27935] Avg episode reward: [(0, '-4.811')] [2022-07-13 08:55:18,989][27935] Fps is (10 sec: 4920.4, 60 sec: 5120.0, 300 sec: 5161.7). Total num frames: 248313856. Throughput: 0: 10868.1. Samples: 496647216. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:18,989][27935] Avg episode reward: [(0, '-6.402')] [2022-07-13 08:55:23,992][27935] Fps is (10 sec: 5016.3, 60 sec: 5102.7, 300 sec: 5158.1). Total num frames: 248339456. Throughput: 0: 10182.8. Samples: 496678252. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:23,992][27935] Avg episode reward: [(0, '-5.073')] [2022-07-13 08:55:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5158.2). Total num frames: 248365056. Throughput: 0: 10181.3. Samples: 496740484. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:28,989][27935] Avg episode reward: [(0, '-4.404')] [2022-07-13 08:55:33,989][27935] Fps is (10 sec: 5223.8, 60 sec: 5102.9, 300 sec: 5161.7). Total num frames: 248391680. Throughput: 0: 10838.6. Samples: 496801456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:33,989][27935] Avg episode reward: [(0, '-5.064')] [2022-07-13 08:55:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5151.2). Total num frames: 248415232. Throughput: 0: 10136.8. Samples: 496832204. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:38,989][27935] Avg episode reward: [(0, '-4.718')] [2022-07-13 08:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5068.8, 300 sec: 5154.7). Total num frames: 248441856. Throughput: 0: 10119.2. Samples: 496893636. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:43,989][27935] Avg episode reward: [(0, '-5.754')] [2022-07-13 08:55:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5085.9, 300 sec: 5154.7). Total num frames: 248467456. Throughput: 0: 10177.9. Samples: 496954916. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:48,989][27935] Avg episode reward: [(0, '-4.293')] [2022-07-13 08:55:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5144.3). Total num frames: 248493056. Throughput: 0: 10185.1. Samples: 496985888. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:53,989][27935] Avg episode reward: [(0, '-5.162')] [2022-07-13 08:55:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5068.8, 300 sec: 5154.7). Total num frames: 248518656. Throughput: 0: 10233.3. Samples: 497047832. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:55:58,989][27935] Avg episode reward: [(0, '-5.846')] [2022-07-13 08:56:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5144.3). Total num frames: 248543232. Throughput: 0: 10187.6. Samples: 497105656. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:03,989][27935] Avg episode reward: [(0, '-5.183')] [2022-07-13 08:56:08,992][27935] Fps is (10 sec: 4913.4, 60 sec: 5052.3, 300 sec: 5147.7). Total num frames: 248567808. Throughput: 0: 10176.3. Samples: 497136192. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:08,993][27935] Avg episode reward: [(0, '-4.805')] [2022-07-13 08:56:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 5151.2). Total num frames: 248595456. Throughput: 0: 10178.9. Samples: 497198536. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:13,989][27935] Avg episode reward: [(0, '-4.468')] [2022-07-13 08:56:18,989][27935] Fps is (10 sec: 5224.3, 60 sec: 5102.9, 300 sec: 5144.3). Total num frames: 248620032. Throughput: 0: 10195.6. Samples: 497260256. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:18,989][27935] Avg episode reward: [(0, '-5.373')] [2022-07-13 08:56:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5103.2, 300 sec: 5147.8). Total num frames: 248645632. Throughput: 0: 10195.4. Samples: 497290996. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:23,989][27935] Avg episode reward: [(0, '-4.477')] [2022-07-13 08:56:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5147.9). Total num frames: 248672256. Throughput: 0: 10189.2. Samples: 497352152. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:28,989][27935] Avg episode reward: [(0, '-4.726')] [2022-07-13 08:56:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5085.9, 300 sec: 5144.3). Total num frames: 248696832. Throughput: 0: 10184.0. Samples: 497413196. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:33,989][27935] Avg episode reward: [(0, '-5.221')] [2022-07-13 08:56:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 248722432. Throughput: 0: 10185.5. Samples: 497444236. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:38,989][27935] Avg episode reward: [(0, '-5.657')] [2022-07-13 08:56:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 248750080. Throughput: 0: 10198.7. Samples: 497506772. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:43,989][27935] Avg episode reward: [(0, '-5.446')] [2022-07-13 08:56:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5144.3). Total num frames: 248774656. Throughput: 0: 10297.5. Samples: 497569044. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 08:56:48,989][27935] Avg episode reward: [(0, '-4.258')] [2022-07-13 08:56:53,989][27935] Fps is (10 sec: 5017.5, 60 sec: 5120.0, 300 sec: 5140.8). Total num frames: 248800256. Throughput: 0: 10312.6. Samples: 497600224. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:56:53,989][27935] Avg episode reward: [(0, '-3.415')] [2022-07-13 08:56:58,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5151.2). Total num frames: 248827904. Throughput: 0: 10318.8. Samples: 497662880. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:56:58,990][27935] Avg episode reward: [(0, '-2.770')] [2022-07-13 08:57:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 248850432. Throughput: 0: 10251.1. Samples: 497721556. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:03,991][27935] Avg episode reward: [(0, '-3.555')] [2022-07-13 08:57:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5137.4, 300 sec: 5144.3). Total num frames: 248876032. Throughput: 0: 10253.5. Samples: 497752404. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:08,991][27935] Avg episode reward: [(0, '-3.144')] [2022-07-13 08:57:13,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 248903680. Throughput: 0: 10293.1. Samples: 497815344. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:13,991][27935] Avg episode reward: [(0, '-2.962')] [2022-07-13 08:57:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 248929280. Throughput: 0: 10323.7. Samples: 497877764. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:18,989][27935] Avg episode reward: [(0, '-3.335')] [2022-07-13 08:57:23,989][27935] Fps is (10 sec: 5222.2, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 248955904. Throughput: 0: 10331.0. Samples: 497909136. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:23,990][27935] Avg episode reward: [(0, '-2.840')] [2022-07-13 08:57:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5147.8). Total num frames: 248980480. Throughput: 0: 10335.3. Samples: 497971860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:28,989][27935] Avg episode reward: [(0, '-2.697')] [2022-07-13 08:57:33,989][27935] Fps is (10 sec: 5222.7, 60 sec: 5188.3, 300 sec: 5144.3). Total num frames: 249008128. Throughput: 0: 10333.4. Samples: 498034048. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:33,989][27935] Avg episode reward: [(0, '-3.393')] [2022-07-13 08:57:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5147.8). Total num frames: 249032704. Throughput: 0: 10336.6. Samples: 498065372. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:38,990][27935] Avg episode reward: [(0, '-2.315')] [2022-07-13 08:57:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5144.3). Total num frames: 249058304. Throughput: 0: 10294.0. Samples: 498126108. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:43,989][27935] Avg episode reward: [(0, '-2.464')] [2022-07-13 08:57:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 249083904. Throughput: 0: 10367.6. Samples: 498188096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:48,990][27935] Avg episode reward: [(0, '-2.411')] [2022-07-13 08:57:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 249110528. Throughput: 0: 10367.3. Samples: 498218932. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:53,989][27935] Avg episode reward: [(0, '-3.249')] [2022-07-13 08:57:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5151.2). Total num frames: 249136128. Throughput: 0: 10350.8. Samples: 498281128. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:57:58,989][27935] Avg episode reward: [(0, '-3.176')] [2022-07-13 08:58:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 249159680. Throughput: 0: 10258.3. Samples: 498339388. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:03,989][27935] Avg episode reward: [(0, '-2.787')] [2022-07-13 08:58:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 249186304. Throughput: 0: 10253.9. Samples: 498370556. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:08,989][27935] Avg episode reward: [(0, '-3.598')] [2022-07-13 08:58:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5137.4). Total num frames: 249210880. Throughput: 0: 10232.9. Samples: 498432340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:13,989][27935] Avg episode reward: [(0, '-4.239')] [2022-07-13 08:58:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5140.8). Total num frames: 249238528. Throughput: 0: 10217.1. Samples: 498493816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:18,990][27935] Avg episode reward: [(0, '-3.726')] [2022-07-13 08:58:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5120.0, 300 sec: 5141.0). Total num frames: 249263104. Throughput: 0: 10211.9. Samples: 498524908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:23,990][27935] Avg episode reward: [(0, '-3.209')] [2022-07-13 08:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 249288704. Throughput: 0: 10238.9. Samples: 498586860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:28,990][27935] Avg episode reward: [(0, '-3.589')] [2022-07-13 08:58:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5102.9, 300 sec: 5137.4). Total num frames: 249314304. Throughput: 0: 10222.9. Samples: 498648128. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:33,993][27935] Avg episode reward: [(0, '-3.848')] [2022-07-13 08:58:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 249339904. Throughput: 0: 10230.5. Samples: 498679304. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:38,989][27935] Avg episode reward: [(0, '-3.869')] [2022-07-13 08:58:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 249366528. Throughput: 0: 10231.0. Samples: 498741524. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:43,989][27935] Avg episode reward: [(0, '-3.695')] [2022-07-13 08:58:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5137.1, 300 sec: 5133.9). Total num frames: 249392128. Throughput: 0: 10310.5. Samples: 498803360. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:48,989][27935] Avg episode reward: [(0, '-3.809')] [2022-07-13 08:58:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 249417728. Throughput: 0: 10306.3. Samples: 498834340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:53,989][27935] Avg episode reward: [(0, '-4.005')] [2022-07-13 08:58:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5133.9). Total num frames: 249443328. Throughput: 0: 10308.8. Samples: 498896236. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:58:58,990][27935] Avg episode reward: [(0, '-3.783')] [2022-07-13 08:59:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5120.0, 300 sec: 5130.4). Total num frames: 249466880. Throughput: 0: 10228.6. Samples: 498954104. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:59:03,990][27935] Avg episode reward: [(0, '-2.956')] [2022-07-13 08:59:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5120.0, 300 sec: 5126.9). Total num frames: 249493504. Throughput: 0: 10204.5. Samples: 498984112. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 08:59:08,989][27935] Avg episode reward: [(0, '-2.466')] [2022-07-13 08:59:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5123.5). Total num frames: 249518080. Throughput: 0: 10175.8. Samples: 499044772. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:13,989][27935] Avg episode reward: [(0, '-2.771')] [2022-07-13 08:59:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5120.0). Total num frames: 249543680. Throughput: 0: 10157.8. Samples: 499105228. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:18,991][27935] Avg episode reward: [(0, '-3.162')] [2022-07-13 08:59:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5085.9, 300 sec: 5116.5). Total num frames: 249568256. Throughput: 0: 10139.6. Samples: 499135584. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:23,989][27935] Avg episode reward: [(0, '-2.872')] [2022-07-13 08:59:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5106.1). Total num frames: 249591808. Throughput: 0: 10082.0. Samples: 499195216. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:28,989][27935] Avg episode reward: [(0, '-3.043')] [2022-07-13 08:59:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5051.7, 300 sec: 5109.6). Total num frames: 249617408. Throughput: 0: 10034.4. Samples: 499254908. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:33,992][27935] Avg episode reward: [(0, '-3.566')] [2022-07-13 08:59:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5034.7, 300 sec: 5099.2). Total num frames: 249641984. Throughput: 0: 10007.0. Samples: 499284656. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:38,989][27935] Avg episode reward: [(0, '-3.406')] [2022-07-13 08:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 5000.5, 300 sec: 5099.2). Total num frames: 249666560. Throughput: 0: 9918.7. Samples: 499342576. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:43,989][27935] Avg episode reward: [(0, '-3.538')] [2022-07-13 08:59:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4983.5, 300 sec: 5095.7). Total num frames: 249691136. Throughput: 0: 9934.8. Samples: 499401172. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:48,989][27935] Avg episode reward: [(0, '-2.841')] [2022-07-13 08:59:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4966.4, 300 sec: 5088.8). Total num frames: 249715712. Throughput: 0: 9933.3. Samples: 499431112. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:53,989][27935] Avg episode reward: [(0, '-3.774')] [2022-07-13 08:59:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4932.3, 300 sec: 5088.8). Total num frames: 249739264. Throughput: 0: 9889.7. Samples: 499489808. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 08:59:58,989][27935] Avg episode reward: [(0, '-3.731')] [2022-07-13 09:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 5078.5). Total num frames: 249762816. Throughput: 0: 9765.6. Samples: 499544680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:03,989][27935] Avg episode reward: [(0, '-4.082')] [2022-07-13 09:00:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 5078.3). Total num frames: 249787392. Throughput: 0: 9750.7. Samples: 499574364. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:08,989][27935] Avg episode reward: [(0, '-3.750')] [2022-07-13 09:00:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 5078.3). Total num frames: 249811968. Throughput: 0: 9747.7. Samples: 499633864. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:13,989][27935] Avg episode reward: [(0, '-3.996')] [2022-07-13 09:00:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5078.4). Total num frames: 249837568. Throughput: 0: 9736.1. Samples: 499693032. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:18,991][27935] Avg episode reward: [(0, '-4.135')] [2022-07-13 09:00:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 5074.9). Total num frames: 249862144. Throughput: 0: 9736.4. Samples: 499722792. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:23,990][27935] Avg episode reward: [(0, '-5.325')] [2022-07-13 09:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5067.9). Total num frames: 249886720. Throughput: 0: 9776.3. Samples: 499782508. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:28,989][27935] Avg episode reward: [(0, '-5.100')] [2022-07-13 09:00:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 5064.5). Total num frames: 249909248. Throughput: 0: 9784.2. Samples: 499841460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:33,989][27935] Avg episode reward: [(0, '-6.719')] [2022-07-13 09:00:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 5061.0). Total num frames: 249934848. Throughput: 0: 9745.5. Samples: 499869660. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:38,991][27935] Avg episode reward: [(0, '-6.289')] [2022-07-13 09:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 5050.6). Total num frames: 249957376. Throughput: 0: 9678.0. Samples: 499925316. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:43,990][27935] Avg episode reward: [(0, '-6.209')] [2022-07-13 09:00:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 5047.1). Total num frames: 249981952. Throughput: 0: 9714.0. Samples: 499981808. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:48,991][27935] Avg episode reward: [(0, '-5.653')] [2022-07-13 09:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5040.2). Total num frames: 250005504. Throughput: 0: 9696.5. Samples: 500010708. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:53,990][27935] Avg episode reward: [(0, '-5.040')] [2022-07-13 09:00:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 5036.7). Total num frames: 250029056. Throughput: 0: 9648.6. Samples: 500068052. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:00:58,990][27935] Avg episode reward: [(0, '-4.535')] [2022-07-13 09:01:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 5029.8). Total num frames: 250051584. Throughput: 0: 8981.7. Samples: 500097208. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:03,989][27935] Avg episode reward: [(0, '-5.384')] [2022-07-13 09:01:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 5015.9). Total num frames: 250075136. Throughput: 0: 9535.8. Samples: 500151904. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:08,989][27935] Avg episode reward: [(0, '-3.560')] [2022-07-13 09:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 5019.3). Total num frames: 250100736. Throughput: 0: 9512.1. Samples: 500210552. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:13,990][27935] Avg episode reward: [(0, '-3.700')] [2022-07-13 09:01:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 5012.4). Total num frames: 250124288. Throughput: 0: 9443.4. Samples: 500266412. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:18,989][27935] Avg episode reward: [(0, '-3.934')] [2022-07-13 09:01:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4998.5). Total num frames: 250146816. Throughput: 0: 9453.3. Samples: 500295060. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:23,990][27935] Avg episode reward: [(0, '-4.041')] [2022-07-13 09:01:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 5002.0). Total num frames: 250172416. Throughput: 0: 9518.9. Samples: 500353668. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 09:01:28,989][27935] Avg episode reward: [(0, '-4.436')] [2022-07-13 09:01:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4995.0). Total num frames: 250195968. Throughput: 0: 9549.0. Samples: 500411512. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:33,998][27935] Avg episode reward: [(0, '-3.186')] [2022-07-13 09:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4984.6). Total num frames: 250220544. Throughput: 0: 9553.2. Samples: 500440600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:38,989][27935] Avg episode reward: [(0, '-3.308')] [2022-07-13 09:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4984.6). Total num frames: 250245120. Throughput: 0: 9580.9. Samples: 500499192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:43,989][27935] Avg episode reward: [(0, '-2.509')] [2022-07-13 09:01:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4977.7). Total num frames: 250268672. Throughput: 0: 9586.5. Samples: 500528600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:49,004][27935] Avg episode reward: [(0, '-3.514')] [2022-07-13 09:01:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4963.8). Total num frames: 250292224. Throughput: 0: 9651.4. Samples: 500586216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:53,989][27935] Avg episode reward: [(0, '-3.707')] [2022-07-13 09:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4970.7). Total num frames: 250316800. Throughput: 0: 9645.4. Samples: 500644592. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:01:58,989][27935] Avg episode reward: [(0, '-4.330')] [2022-07-13 09:02:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4963.8). Total num frames: 250340352. Throughput: 0: 9624.1. Samples: 500699496. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:03,989][27935] Avg episode reward: [(0, '-4.806')] [2022-07-13 09:02:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4953.4). Total num frames: 250364928. Throughput: 0: 9647.1. Samples: 500729180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:08,989][27935] Avg episode reward: [(0, '-4.792')] [2022-07-13 09:02:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4953.4). Total num frames: 250390528. Throughput: 0: 9644.5. Samples: 500787672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:13,989][27935] Avg episode reward: [(0, '-4.923')] [2022-07-13 09:02:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4939.5). Total num frames: 250413056. Throughput: 0: 9664.8. Samples: 500846428. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:18,989][27935] Avg episode reward: [(0, '-4.101')] [2022-07-13 09:02:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4943.0). Total num frames: 250438656. Throughput: 0: 9672.3. Samples: 500875852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:23,989][27935] Avg episode reward: [(0, '-4.569')] [2022-07-13 09:02:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4929.1). Total num frames: 250462208. Throughput: 0: 9673.5. Samples: 500934500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:28,991][27935] Avg episode reward: [(0, '-3.753')] [2022-07-13 09:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4932.6). Total num frames: 250487808. Throughput: 0: 10318.5. Samples: 500992932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:33,989][27935] Avg episode reward: [(0, '-4.708')] [2022-07-13 09:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4922.1). Total num frames: 250510336. Throughput: 0: 9683.6. Samples: 501021976. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:38,989][27935] Avg episode reward: [(0, '-3.866')] [2022-07-13 09:02:43,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4812.8, 300 sec: 4915.2). Total num frames: 250533888. Throughput: 0: 9705.5. Samples: 501081340. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:43,991][27935] Avg episode reward: [(0, '-5.271')] [2022-07-13 09:02:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4918.7). Total num frames: 250561536. Throughput: 0: 9801.1. Samples: 501140544. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:48,989][27935] Avg episode reward: [(0, '-4.806')] [2022-07-13 09:02:53,989][27935] Fps is (10 sec: 5222.5, 60 sec: 4898.1, 300 sec: 4915.2). Total num frames: 250586112. Throughput: 0: 9833.3. Samples: 501171680. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:53,989][27935] Avg episode reward: [(0, '-5.880')] [2022-07-13 09:02:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4915.2). Total num frames: 250609664. Throughput: 0: 9847.8. Samples: 501230824. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:02:58,990][27935] Avg episode reward: [(0, '-5.099')] [2022-07-13 09:03:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4904.8). Total num frames: 250633216. Throughput: 0: 9765.2. Samples: 501285864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:03,989][27935] Avg episode reward: [(0, '-4.979')] [2022-07-13 09:03:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4897.8). Total num frames: 250655744. Throughput: 0: 9735.0. Samples: 501313928. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:08,992][27935] Avg episode reward: [(0, '-4.379')] [2022-07-13 09:03:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4890.9). Total num frames: 250681344. Throughput: 0: 9682.1. Samples: 501370196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:13,989][27935] Avg episode reward: [(0, '-2.661')] [2022-07-13 09:03:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 250704896. Throughput: 0: 9665.2. Samples: 501427868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:18,989][27935] Avg episode reward: [(0, '-2.573')] [2022-07-13 09:03:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4880.5). Total num frames: 250728448. Throughput: 0: 9669.3. Samples: 501457096. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:23,991][27935] Avg episode reward: [(0, '-1.109')] [2022-07-13 09:03:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 250752000. Throughput: 0: 9649.4. Samples: 501515560. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:28,991][27935] Avg episode reward: [(0, '-1.573')] [2022-07-13 09:03:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 250777600. Throughput: 0: 9634.7. Samples: 501574104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:33,989][27935] Avg episode reward: [(0, '-3.093')] [2022-07-13 09:03:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 250802176. Throughput: 0: 9594.8. Samples: 501603444. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:38,990][27935] Avg episode reward: [(0, '-3.263')] [2022-07-13 09:03:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 250825728. Throughput: 0: 9586.4. Samples: 501662212. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 09:03:43,989][27935] Avg episode reward: [(0, '-3.352')] [2022-07-13 09:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 250852352. Throughput: 0: 9669.2. Samples: 501720980. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:03:49,000][27935] Avg episode reward: [(0, '-3.425')] [2022-07-13 09:03:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 250875904. Throughput: 0: 9699.7. Samples: 501750412. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:03:53,989][27935] Avg episode reward: [(0, '-3.243')] [2022-07-13 09:03:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 250898432. Throughput: 0: 9731.8. Samples: 501808128. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:03:58,989][27935] Avg episode reward: [(0, '-3.140')] [2022-07-13 09:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 250921984. Throughput: 0: 9653.2. Samples: 501862264. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:03,989][27935] Avg episode reward: [(0, '-2.283')] [2022-07-13 09:04:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 250945536. Throughput: 0: 9637.9. Samples: 501890800. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:08,990][27935] Avg episode reward: [(0, '-2.097')] [2022-07-13 09:04:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 250970112. Throughput: 0: 9622.2. Samples: 501948560. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:13,989][27935] Avg episode reward: [(0, '-2.895')] [2022-07-13 09:04:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 250993664. Throughput: 0: 8967.0. Samples: 501977620. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:18,989][27935] Avg episode reward: [(0, '-4.214')] [2022-07-13 09:04:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 251018240. Throughput: 0: 9612.2. Samples: 502035992. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:23,989][27935] Avg episode reward: [(0, '-3.980')] [2022-07-13 09:04:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 251041792. Throughput: 0: 9601.4. Samples: 502094276. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:28,989][27935] Avg episode reward: [(0, '-4.330')] [2022-07-13 09:04:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 251065344. Throughput: 0: 9576.8. Samples: 502151936. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:33,989][27935] Avg episode reward: [(0, '-3.725')] [2022-07-13 09:04:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 251090944. Throughput: 0: 9574.8. Samples: 502181280. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:38,989][27935] Avg episode reward: [(0, '-3.791')] [2022-07-13 09:04:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 251115520. Throughput: 0: 9596.9. Samples: 502239988. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:43,990][27935] Avg episode reward: [(0, '-4.021')] [2022-07-13 09:04:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 251139072. Throughput: 0: 9702.1. Samples: 502298860. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:48,989][27935] Avg episode reward: [(0, '-2.473')] [2022-07-13 09:04:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 251164672. Throughput: 0: 9719.1. Samples: 502328160. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:53,990][27935] Avg episode reward: [(0, '-2.052')] [2022-07-13 09:04:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 251188224. Throughput: 0: 9742.9. Samples: 502386992. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:04:58,989][27935] Avg episode reward: [(0, '-1.911')] [2022-07-13 09:05:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 251210752. Throughput: 0: 10305.5. Samples: 502441368. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:03,989][27935] Avg episode reward: [(0, '-2.649')] [2022-07-13 09:05:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 251235328. Throughput: 0: 9645.0. Samples: 502470016. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:08,989][27935] Avg episode reward: [(0, '-2.603')] [2022-07-13 09:05:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 251258880. Throughput: 0: 9617.7. Samples: 502527072. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:13,989][27935] Avg episode reward: [(0, '-2.136')] [2022-07-13 09:05:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 251282432. Throughput: 0: 9623.2. Samples: 502584980. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:18,989][27935] Avg episode reward: [(0, '-2.257')] [2022-07-13 09:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 251307008. Throughput: 0: 9614.7. Samples: 502613940. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:23,989][27935] Avg episode reward: [(0, '-3.013')] [2022-07-13 09:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 251331584. Throughput: 0: 9614.1. Samples: 502672624. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:28,989][27935] Avg episode reward: [(0, '-2.545')] [2022-07-13 09:05:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 251356160. Throughput: 0: 9602.2. Samples: 502730960. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:33,990][27935] Avg episode reward: [(0, '-3.067')] [2022-07-13 09:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 251379712. Throughput: 0: 9605.2. Samples: 502760392. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:38,989][27935] Avg episode reward: [(0, '-2.704')] [2022-07-13 09:05:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 251404288. Throughput: 0: 9579.4. Samples: 502818064. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:43,991][27935] Avg episode reward: [(0, '-2.093')] [2022-07-13 09:05:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 251427840. Throughput: 0: 9655.6. Samples: 502875868. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:48,989][27935] Avg episode reward: [(0, '-1.975')] [2022-07-13 09:05:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4825.0). Total num frames: 251452416. Throughput: 0: 9656.1. Samples: 502904540. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:53,989][27935] Avg episode reward: [(0, '-1.705')] [2022-07-13 09:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 251476992. Throughput: 0: 9678.9. Samples: 502962624. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:05:58,989][27935] Avg episode reward: [(0, '-3.575')] [2022-07-13 09:06:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 251498496. Throughput: 0: 9598.5. Samples: 503016912. Policy #0 lag: (min: 0.0, avg: 10.3, max: 20.0) [2022-07-13 09:06:03,991][27935] Avg episode reward: [(0, '-3.950')] [2022-07-13 09:06:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 251522048. Throughput: 0: 9601.2. Samples: 503045992. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:08,989][27935] Avg episode reward: [(0, '-3.756')] [2022-07-13 09:06:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 251546624. Throughput: 0: 9561.8. Samples: 503102904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:13,989][27935] Avg episode reward: [(0, '-3.989')] [2022-07-13 09:06:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 251571200. Throughput: 0: 9564.6. Samples: 503161368. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:18,989][27935] Avg episode reward: [(0, '-3.713')] [2022-07-13 09:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 251594752. Throughput: 0: 9558.4. Samples: 503190520. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:23,989][27935] Avg episode reward: [(0, '-3.826')] [2022-07-13 09:06:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 251620352. Throughput: 0: 9582.6. Samples: 503249280. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:28,989][27935] Avg episode reward: [(0, '-3.296')] [2022-07-13 09:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 251642880. Throughput: 0: 9581.0. Samples: 503307012. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:33,990][27935] Avg episode reward: [(0, '-1.839')] [2022-07-13 09:06:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 251667456. Throughput: 0: 9595.7. Samples: 503336348. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:38,989][27935] Avg episode reward: [(0, '-2.420')] [2022-07-13 09:06:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 251693056. Throughput: 0: 9604.2. Samples: 503394812. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:43,990][27935] Avg episode reward: [(0, '-1.752')] [2022-07-13 09:06:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 251717632. Throughput: 0: 9701.5. Samples: 503453480. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:48,992][27935] Avg episode reward: [(0, '-1.467')] [2022-07-13 09:06:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 251741184. Throughput: 0: 9713.2. Samples: 503483084. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:53,989][27935] Avg episode reward: [(0, '-1.740')] [2022-07-13 09:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 251765760. Throughput: 0: 9754.9. Samples: 503541876. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:06:58,989][27935] Avg episode reward: [(0, '-1.757')] [2022-07-13 09:07:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 251789312. Throughput: 0: 9672.1. Samples: 503596612. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:03,989][27935] Avg episode reward: [(0, '-1.750')] [2022-07-13 09:07:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 251813888. Throughput: 0: 9677.5. Samples: 503626008. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:08,989][27935] Avg episode reward: [(0, '-1.035')] [2022-07-13 09:07:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 251836416. Throughput: 0: 9676.1. Samples: 503684704. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:13,989][27935] Avg episode reward: [(0, '-0.299')] [2022-07-13 09:07:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 251860992. Throughput: 0: 9039.6. Samples: 503713792. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:18,989][27935] Avg episode reward: [(0, '-0.278')] [2022-07-13 09:07:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 251885568. Throughput: 0: 9654.7. Samples: 503770808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:23,989][27935] Avg episode reward: [(0, '-0.760')] [2022-07-13 09:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 251910144. Throughput: 0: 9655.9. Samples: 503829328. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:28,991][27935] Avg episode reward: [(0, '-1.258')] [2022-07-13 09:07:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 251933696. Throughput: 0: 9649.3. Samples: 503887700. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:33,992][27935] Avg episode reward: [(0, '-1.398')] [2022-07-13 09:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 251959296. Throughput: 0: 9644.4. Samples: 503917080. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:38,989][27935] Avg episode reward: [(0, '-1.576')] [2022-07-13 09:07:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 251982848. Throughput: 0: 9615.1. Samples: 503974556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:43,989][27935] Avg episode reward: [(0, '-1.929')] [2022-07-13 09:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 252007424. Throughput: 0: 9707.4. Samples: 504033444. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:48,990][27935] Avg episode reward: [(0, '-1.755')] [2022-07-13 09:07:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 252029952. Throughput: 0: 9706.1. Samples: 504062784. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:53,989][27935] Avg episode reward: [(0, '-1.759')] [2022-07-13 09:07:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 252055552. Throughput: 0: 9708.5. Samples: 504121588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:07:58,989][27935] Avg episode reward: [(0, '-1.590')] [2022-07-13 09:08:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 252079104. Throughput: 0: 10275.6. Samples: 504176196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:08:03,989][27935] Avg episode reward: [(0, '-1.939')] [2022-07-13 09:08:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 252103680. Throughput: 0: 9650.9. Samples: 504205100. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:08:08,989][27935] Avg episode reward: [(0, '-1.168')] [2022-07-13 09:08:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 252127232. Throughput: 0: 9647.3. Samples: 504263456. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:08:13,989][27935] Avg episode reward: [(0, '-2.198')] [2022-07-13 09:08:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 252150784. Throughput: 0: 9656.2. Samples: 504322228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:08:18,989][27935] Avg episode reward: [(0, '-1.992')] [2022-07-13 09:08:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 252174336. Throughput: 0: 9655.7. Samples: 504351588. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 09:08:23,990][27935] Avg episode reward: [(0, '-2.697')] [2022-07-13 09:08:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 252199936. Throughput: 0: 9680.2. Samples: 504410168. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:28,991][27935] Avg episode reward: [(0, '-3.163')] [2022-07-13 09:08:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 252225536. Throughput: 0: 9016.5. Samples: 504439188. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:33,990][27935] Avg episode reward: [(0, '-2.900')] [2022-07-13 09:08:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 252249088. Throughput: 0: 9662.9. Samples: 504497616. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:38,989][27935] Avg episode reward: [(0, '-3.185')] [2022-07-13 09:08:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 252272640. Throughput: 0: 9667.2. Samples: 504556612. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:43,989][27935] Avg episode reward: [(0, '-2.985')] [2022-07-13 09:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 252298240. Throughput: 0: 9750.8. Samples: 504614980. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:48,989][27935] Avg episode reward: [(0, '-2.889')] [2022-07-13 09:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 252321792. Throughput: 0: 9763.2. Samples: 504644444. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:53,991][27935] Avg episode reward: [(0, '-3.262')] [2022-07-13 09:08:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 252347392. Throughput: 0: 9764.9. Samples: 504702876. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:08:58,990][27935] Avg episode reward: [(0, '-2.717')] [2022-07-13 09:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 252368896. Throughput: 0: 9676.1. Samples: 504757652. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:03,989][27935] Avg episode reward: [(0, '-2.196')] [2022-07-13 09:09:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 252393472. Throughput: 0: 9675.1. Samples: 504786968. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:08,989][27935] Avg episode reward: [(0, '-3.770')] [2022-07-13 09:09:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 252417024. Throughput: 0: 9679.8. Samples: 504845760. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:13,989][27935] Avg episode reward: [(0, '-3.777')] [2022-07-13 09:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 252442624. Throughput: 0: 10332.0. Samples: 504904128. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:18,991][27935] Avg episode reward: [(0, '-4.792')] [2022-07-13 09:09:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 252467200. Throughput: 0: 9688.2. Samples: 504933584. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:23,989][27935] Avg episode reward: [(0, '-4.383')] [2022-07-13 09:09:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 252490752. Throughput: 0: 9685.0. Samples: 504992436. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:28,989][27935] Avg episode reward: [(0, '-4.828')] [2022-07-13 09:09:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 252515328. Throughput: 0: 9679.4. Samples: 505050552. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:33,989][27935] Avg episode reward: [(0, '-6.420')] [2022-07-13 09:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 252539904. Throughput: 0: 9673.7. Samples: 505079760. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:38,989][27935] Avg episode reward: [(0, '-7.437')] [2022-07-13 09:09:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 252564480. Throughput: 0: 9689.5. Samples: 505138904. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:43,989][27935] Avg episode reward: [(0, '-6.913')] [2022-07-13 09:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 252589056. Throughput: 0: 9773.2. Samples: 505197448. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:48,990][27935] Avg episode reward: [(0, '-5.867')] [2022-07-13 09:09:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 252612608. Throughput: 0: 9775.2. Samples: 505226852. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:53,990][27935] Avg episode reward: [(0, '-5.822')] [2022-07-13 09:09:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 252638208. Throughput: 0: 9773.0. Samples: 505285544. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:09:58,990][27935] Avg episode reward: [(0, '-5.902')] [2022-07-13 09:10:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 252659712. Throughput: 0: 9689.7. Samples: 505340164. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:03,989][27935] Avg episode reward: [(0, '-3.217')] [2022-07-13 09:10:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 252685312. Throughput: 0: 9683.4. Samples: 505369336. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:08,990][27935] Avg episode reward: [(0, '-4.034')] [2022-07-13 09:10:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 252709888. Throughput: 0: 9674.5. Samples: 505427788. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:13,990][27935] Avg episode reward: [(0, '-1.279')] [2022-07-13 09:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 252733440. Throughput: 0: 9677.0. Samples: 505486016. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:18,989][27935] Avg episode reward: [(0, '-0.987')] [2022-07-13 09:10:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 252756992. Throughput: 0: 9675.1. Samples: 505515140. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:23,989][27935] Avg episode reward: [(0, '-2.031')] [2022-07-13 09:10:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 252781568. Throughput: 0: 9664.8. Samples: 505573820. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:28,989][27935] Avg episode reward: [(0, '-3.048')] [2022-07-13 09:10:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 252807168. Throughput: 0: 9655.8. Samples: 505631960. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:33,989][27935] Avg episode reward: [(0, '-3.064')] [2022-07-13 09:10:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 252830720. Throughput: 0: 9656.6. Samples: 505661400. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:38,991][27935] Avg episode reward: [(0, '-2.670')] [2022-07-13 09:10:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 252856320. Throughput: 0: 9664.0. Samples: 505720424. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 09:10:43,990][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 09:10:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 252879872. Throughput: 0: 9749.8. Samples: 505778904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:10:48,989][27935] Avg episode reward: [(0, '-2.144')] [2022-07-13 09:10:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 252903424. Throughput: 0: 9747.3. Samples: 505807964. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:10:53,989][27935] Avg episode reward: [(0, '-2.550')] [2022-07-13 09:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 252929024. Throughput: 0: 9757.1. Samples: 505866856. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:10:58,989][27935] Avg episode reward: [(0, '-0.637')] [2022-07-13 09:11:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 252950528. Throughput: 0: 9666.8. Samples: 505921020. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:03,989][27935] Avg episode reward: [(0, '-1.577')] [2022-07-13 09:11:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 252975104. Throughput: 0: 9665.6. Samples: 505950092. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:08,989][27935] Avg episode reward: [(0, '-2.693')] [2022-07-13 09:11:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 252999680. Throughput: 0: 9663.7. Samples: 506008688. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:13,991][27935] Avg episode reward: [(0, '-4.090')] [2022-07-13 09:11:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 253024256. Throughput: 0: 9661.2. Samples: 506066716. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:18,991][27935] Avg episode reward: [(0, '-4.303')] [2022-07-13 09:11:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 253048832. Throughput: 0: 9648.4. Samples: 506095580. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:23,989][27935] Avg episode reward: [(0, '-4.664')] [2022-07-13 09:11:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 253072384. Throughput: 0: 9634.9. Samples: 506153996. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:28,989][27935] Avg episode reward: [(0, '-4.000')] [2022-07-13 09:11:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 253095936. Throughput: 0: 9624.6. Samples: 506212012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:33,991][27935] Avg episode reward: [(0, '-4.051')] [2022-07-13 09:11:38,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4829.8, 300 sec: 4838.8). Total num frames: 253120512. Throughput: 0: 9625.8. Samples: 506241140. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:38,992][27935] Avg episode reward: [(0, '-4.114')] [2022-07-13 09:11:43,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4812.6, 300 sec: 4838.8). Total num frames: 253145088. Throughput: 0: 9611.7. Samples: 506299404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:43,991][27935] Avg episode reward: [(0, '-3.582')] [2022-07-13 09:11:48,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 253168640. Throughput: 0: 9697.9. Samples: 506357428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:48,989][27935] Avg episode reward: [(0, '-2.777')] [2022-07-13 09:11:53,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 253194240. Throughput: 0: 9701.5. Samples: 506386660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:53,989][27935] Avg episode reward: [(0, '-3.569')] [2022-07-13 09:11:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 253216768. Throughput: 0: 9703.2. Samples: 506445332. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:11:58,989][27935] Avg episode reward: [(0, '-3.970')] [2022-07-13 09:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 253241344. Throughput: 0: 9624.7. Samples: 506499828. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:03,989][27935] Avg episode reward: [(0, '-4.404')] [2022-07-13 09:12:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 253264896. Throughput: 0: 9636.9. Samples: 506529240. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:08,989][27935] Avg episode reward: [(0, '-3.395')] [2022-07-13 09:12:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 253289472. Throughput: 0: 9641.4. Samples: 506587860. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:13,989][27935] Avg episode reward: [(0, '-3.016')] [2022-07-13 09:12:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 253313024. Throughput: 0: 9650.6. Samples: 506646288. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:18,991][27935] Avg episode reward: [(0, '-2.961')] [2022-07-13 09:12:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 253337600. Throughput: 0: 9653.9. Samples: 506675552. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:23,989][27935] Avg episode reward: [(0, '-3.009')] [2022-07-13 09:12:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 253363200. Throughput: 0: 9668.3. Samples: 506734456. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:28,990][27935] Avg episode reward: [(0, '-3.176')] [2022-07-13 09:12:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 253387776. Throughput: 0: 9678.7. Samples: 506792968. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:33,989][27935] Avg episode reward: [(0, '-3.111')] [2022-07-13 09:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.0, 300 sec: 4842.3). Total num frames: 253411328. Throughput: 0: 9681.9. Samples: 506822348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:38,989][27935] Avg episode reward: [(0, '-2.084')] [2022-07-13 09:12:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.0, 300 sec: 4838.8). Total num frames: 253434880. Throughput: 0: 9674.9. Samples: 506880704. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:43,989][27935] Avg episode reward: [(0, '-2.459')] [2022-07-13 09:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 253459456. Throughput: 0: 9118.4. Samples: 506910156. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:48,991][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 09:12:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 253485056. Throughput: 0: 9770.3. Samples: 506968904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:53,990][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 09:12:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 253508608. Throughput: 0: 9780.8. Samples: 507027996. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:12:58,990][27935] Avg episode reward: [(0, '-1.500')] [2022-07-13 09:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 253531136. Throughput: 0: 9703.3. Samples: 507082936. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 09:13:03,989][27935] Avg episode reward: [(0, '-1.270')] [2022-07-13 09:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 253556736. Throughput: 0: 9713.0. Samples: 507112636. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:08,990][27935] Avg episode reward: [(0, '-1.592')] [2022-07-13 09:13:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 253581312. Throughput: 0: 9707.2. Samples: 507171280. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:13,989][27935] Avg episode reward: [(0, '-2.864')] [2022-07-13 09:13:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 253605888. Throughput: 0: 9710.2. Samples: 507229928. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:18,996][27935] Avg episode reward: [(0, '-2.921')] [2022-07-13 09:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 253629440. Throughput: 0: 9707.1. Samples: 507259168. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:23,990][27935] Avg episode reward: [(0, '-3.035')] [2022-07-13 09:13:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 253654016. Throughput: 0: 9682.5. Samples: 507316416. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:28,989][27935] Avg episode reward: [(0, '-3.137')] [2022-07-13 09:13:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 253677568. Throughput: 0: 10311.3. Samples: 507374164. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:33,989][27935] Avg episode reward: [(0, '-2.259')] [2022-07-13 09:13:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 253701120. Throughput: 0: 9650.3. Samples: 507403168. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:38,989][27935] Avg episode reward: [(0, '-2.255')] [2022-07-13 09:13:43,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4829.6, 300 sec: 4835.3). Total num frames: 253724672. Throughput: 0: 9621.7. Samples: 507461004. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:43,993][27935] Avg episode reward: [(0, '-1.573')] [2022-07-13 09:13:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 253750272. Throughput: 0: 9680.3. Samples: 507518552. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:48,989][27935] Avg episode reward: [(0, '-1.257')] [2022-07-13 09:13:53,989][27935] Fps is (10 sec: 4916.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 253773824. Throughput: 0: 9666.8. Samples: 507547640. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:53,989][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 09:13:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 253797376. Throughput: 0: 9648.2. Samples: 507605448. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:13:58,989][27935] Avg episode reward: [(0, '-2.398')] [2022-07-13 09:14:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 253820928. Throughput: 0: 9546.3. Samples: 507659512. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:03,989][27935] Avg episode reward: [(0, '-2.375')] [2022-07-13 09:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 253844480. Throughput: 0: 9537.4. Samples: 507688352. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:08,989][27935] Avg episode reward: [(0, '-2.415')] [2022-07-13 09:14:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 253868032. Throughput: 0: 9549.4. Samples: 507746140. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:13,989][27935] Avg episode reward: [(0, '-2.416')] [2022-07-13 09:14:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 253892608. Throughput: 0: 9557.4. Samples: 507804248. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:18,989][27935] Avg episode reward: [(0, '-2.074')] [2022-07-13 09:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 253916160. Throughput: 0: 9559.4. Samples: 507833340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:23,992][27935] Avg episode reward: [(0, '-1.569')] [2022-07-13 09:14:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 253940736. Throughput: 0: 9564.0. Samples: 507891352. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:28,989][27935] Avg episode reward: [(0, '-0.580')] [2022-07-13 09:14:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 253964288. Throughput: 0: 9570.7. Samples: 507949232. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:33,990][27935] Avg episode reward: [(0, '-0.498')] [2022-07-13 09:14:38,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4795.6, 300 sec: 4828.4). Total num frames: 253988864. Throughput: 0: 9566.4. Samples: 507978148. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:38,991][27935] Avg episode reward: [(0, '-1.270')] [2022-07-13 09:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.1, 300 sec: 4828.4). Total num frames: 254013440. Throughput: 0: 9591.6. Samples: 508037068. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:43,989][27935] Avg episode reward: [(0, '-0.869')] [2022-07-13 09:14:48,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 254038016. Throughput: 0: 9686.9. Samples: 508095420. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:48,990][27935] Avg episode reward: [(0, '-3.433')] [2022-07-13 09:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 254062592. Throughput: 0: 9692.4. Samples: 508124508. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:53,989][27935] Avg episode reward: [(0, '-5.662')] [2022-07-13 09:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 254086144. Throughput: 0: 9704.7. Samples: 508182852. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:14:58,989][27935] Avg episode reward: [(0, '-5.797')] [2022-07-13 09:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 254109696. Throughput: 0: 9612.4. Samples: 508236808. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:15:03,989][27935] Avg episode reward: [(0, '-6.720')] [2022-07-13 09:15:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 254132224. Throughput: 0: 9608.2. Samples: 508265708. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:15:08,989][27935] Avg episode reward: [(0, '-5.884')] [2022-07-13 09:15:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 254155776. Throughput: 0: 9603.9. Samples: 508323528. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:15:13,990][27935] Avg episode reward: [(0, '-5.323')] [2022-07-13 09:15:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 254181376. Throughput: 0: 9598.7. Samples: 508381176. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:15:18,989][27935] Avg episode reward: [(0, '-5.644')] [2022-07-13 09:15:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 254204928. Throughput: 0: 9603.2. Samples: 508410272. Policy #0 lag: (min: 0.0, avg: 9.8, max: 20.0) [2022-07-13 09:15:23,989][27935] Avg episode reward: [(0, '-4.380')] [2022-07-13 09:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 254229504. Throughput: 0: 9583.4. Samples: 508468320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:28,989][27935] Avg episode reward: [(0, '-1.907')] [2022-07-13 09:15:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 254252032. Throughput: 0: 9550.0. Samples: 508525168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:33,992][27935] Avg episode reward: [(0, '-1.806')] [2022-07-13 09:15:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.8, 300 sec: 4811.1). Total num frames: 254275584. Throughput: 0: 9542.4. Samples: 508553916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:38,989][27935] Avg episode reward: [(0, '-2.018')] [2022-07-13 09:15:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 254300160. Throughput: 0: 9521.8. Samples: 508611332. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:43,989][27935] Avg episode reward: [(0, '-2.372')] [2022-07-13 09:15:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 254324736. Throughput: 0: 9596.1. Samples: 508668632. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:48,989][27935] Avg episode reward: [(0, '-3.079')] [2022-07-13 09:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4811.1). Total num frames: 254348288. Throughput: 0: 9595.8. Samples: 508697520. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:53,989][27935] Avg episode reward: [(0, '-2.946')] [2022-07-13 09:15:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 254373888. Throughput: 0: 9591.5. Samples: 508755144. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:15:58,989][27935] Avg episode reward: [(0, '-1.839')] [2022-07-13 09:16:03,990][27935] Fps is (10 sec: 4607.7, 60 sec: 4744.5, 300 sec: 4811.1). Total num frames: 254394368. Throughput: 0: 9515.2. Samples: 508809364. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:03,990][27935] Avg episode reward: [(0, '-1.808')] [2022-07-13 09:16:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 254418944. Throughput: 0: 9507.6. Samples: 508838112. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:08,989][27935] Avg episode reward: [(0, '-2.208')] [2022-07-13 09:16:13,989][27935] Fps is (10 sec: 4813.1, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 254442496. Throughput: 0: 9490.1. Samples: 508895376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:13,989][27935] Avg episode reward: [(0, '-1.920')] [2022-07-13 09:16:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4804.1). Total num frames: 254466048. Throughput: 0: 9502.0. Samples: 508952756. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:18,989][27935] Avg episode reward: [(0, '-1.544')] [2022-07-13 09:16:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 254491648. Throughput: 0: 9493.9. Samples: 508981140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:23,989][27935] Avg episode reward: [(0, '-1.901')] [2022-07-13 09:16:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4804.1). Total num frames: 254513152. Throughput: 0: 9480.5. Samples: 509037956. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:28,990][27935] Avg episode reward: [(0, '-2.395')] [2022-07-13 09:16:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4800.7). Total num frames: 254536704. Throughput: 0: 9486.3. Samples: 509095516. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:33,989][27935] Avg episode reward: [(0, '-2.452')] [2022-07-13 09:16:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4804.2). Total num frames: 254562304. Throughput: 0: 9480.1. Samples: 509124124. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:38,989][27935] Avg episode reward: [(0, '-3.240')] [2022-07-13 09:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 254585856. Throughput: 0: 9477.1. Samples: 509181616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:43,990][27935] Avg episode reward: [(0, '-3.311')] [2022-07-13 09:16:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4797.2). Total num frames: 254609408. Throughput: 0: 9542.7. Samples: 509238780. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:48,991][27935] Avg episode reward: [(0, '-2.954')] [2022-07-13 09:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 254633984. Throughput: 0: 9535.6. Samples: 509267212. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:53,990][27935] Avg episode reward: [(0, '-3.280')] [2022-07-13 09:16:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4800.7). Total num frames: 254657536. Throughput: 0: 9537.6. Samples: 509324568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:16:58,989][27935] Avg episode reward: [(0, '-2.565')] [2022-07-13 09:17:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.7, 300 sec: 4797.2). Total num frames: 254680064. Throughput: 0: 9451.3. Samples: 509378064. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:03,991][27935] Avg episode reward: [(0, '-2.152')] [2022-07-13 09:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 254703616. Throughput: 0: 9452.4. Samples: 509406496. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:08,989][27935] Avg episode reward: [(0, '-1.919')] [2022-07-13 09:17:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 254727168. Throughput: 0: 9466.8. Samples: 509463964. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:13,989][27935] Avg episode reward: [(0, '-1.000')] [2022-07-13 09:17:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 254750720. Throughput: 0: 9465.4. Samples: 509521460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:18,989][27935] Avg episode reward: [(0, '-0.822')] [2022-07-13 09:17:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4783.3). Total num frames: 254774272. Throughput: 0: 9470.0. Samples: 509550276. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:23,989][27935] Avg episode reward: [(0, '-1.184')] [2022-07-13 09:17:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 254798848. Throughput: 0: 9463.5. Samples: 509607472. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:28,989][27935] Avg episode reward: [(0, '-1.358')] [2022-07-13 09:17:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 254822400. Throughput: 0: 9471.9. Samples: 509665016. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:33,989][27935] Avg episode reward: [(0, '-1.234')] [2022-07-13 09:17:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 254846976. Throughput: 0: 9474.2. Samples: 509693552. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:38,989][27935] Avg episode reward: [(0, '-1.845')] [2022-07-13 09:17:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4779.8). Total num frames: 254869504. Throughput: 0: 9454.7. Samples: 509750028. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 09:17:43,989][27935] Avg episode reward: [(0, '-2.337')] [2022-07-13 09:17:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 254895104. Throughput: 0: 9548.3. Samples: 509807740. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:17:48,989][27935] Avg episode reward: [(0, '-2.693')] [2022-07-13 09:17:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 254917632. Throughput: 0: 9552.7. Samples: 509836368. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:17:53,990][27935] Avg episode reward: [(0, '-2.512')] [2022-07-13 09:17:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 254942208. Throughput: 0: 9558.9. Samples: 509894116. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:17:58,989][27935] Avg episode reward: [(0, '-2.033')] [2022-07-13 09:18:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4769.4). Total num frames: 254963712. Throughput: 0: 9473.2. Samples: 509947752. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:03,989][27935] Avg episode reward: [(0, '-2.115')] [2022-07-13 09:18:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4769.4). Total num frames: 254988288. Throughput: 0: 9483.1. Samples: 509977016. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:08,989][27935] Avg episode reward: [(0, '-2.654')] [2022-07-13 09:18:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 255013888. Throughput: 0: 9548.4. Samples: 510037152. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:13,989][27935] Avg episode reward: [(0, '-2.456')] [2022-07-13 09:18:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 255039488. Throughput: 0: 9649.8. Samples: 510099256. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:18,989][27935] Avg episode reward: [(0, '-1.704')] [2022-07-13 09:18:23,989][27935] Fps is (10 sec: 5222.5, 60 sec: 4864.0, 300 sec: 4786.8). Total num frames: 255066112. Throughput: 0: 9706.0. Samples: 510130320. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:23,989][27935] Avg episode reward: [(0, '-1.476')] [2022-07-13 09:18:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4881.1, 300 sec: 4793.7). Total num frames: 255091712. Throughput: 0: 9832.3. Samples: 510192480. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:28,989][27935] Avg episode reward: [(0, '-1.140')] [2022-07-13 09:18:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4797.2). Total num frames: 255116288. Throughput: 0: 9922.1. Samples: 510254232. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:33,989][27935] Avg episode reward: [(0, '-1.041')] [2022-07-13 09:18:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4807.6). Total num frames: 255142912. Throughput: 0: 9977.7. Samples: 510285364. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:38,989][27935] Avg episode reward: [(0, '-0.062')] [2022-07-13 09:18:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5000.5, 300 sec: 4811.1). Total num frames: 255169536. Throughput: 0: 10084.4. Samples: 510347916. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:43,989][27935] Avg episode reward: [(0, '-0.272')] [2022-07-13 09:18:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5017.6, 300 sec: 4821.5). Total num frames: 255196160. Throughput: 0: 10298.0. Samples: 510411160. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:48,989][27935] Avg episode reward: [(0, '-0.156')] [2022-07-13 09:18:53,996][27935] Fps is (10 sec: 5218.7, 60 sec: 5068.2, 300 sec: 4828.3). Total num frames: 255221760. Throughput: 0: 10349.0. Samples: 510442796. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:53,996][27935] Avg episode reward: [(0, '-1.398')] [2022-07-13 09:18:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5102.9, 300 sec: 4838.8). Total num frames: 255248384. Throughput: 0: 10413.3. Samples: 510505752. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:18:58,989][27935] Avg episode reward: [(0, '-2.255')] [2022-07-13 09:19:03,989][27935] Fps is (10 sec: 5123.6, 60 sec: 5154.1, 300 sec: 4842.3). Total num frames: 255272960. Throughput: 0: 10345.9. Samples: 510564824. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:03,989][27935] Avg episode reward: [(0, '-2.394')] [2022-07-13 09:19:08,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 4852.7). Total num frames: 255299584. Throughput: 0: 10366.6. Samples: 510596820. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:08,989][27935] Avg episode reward: [(0, '-2.286')] [2022-07-13 09:19:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 4852.7). Total num frames: 255324160. Throughput: 0: 10368.7. Samples: 510659072. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:13,992][27935] Avg episode reward: [(0, '-1.759')] [2022-07-13 09:19:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 4863.1). Total num frames: 255350784. Throughput: 0: 10405.5. Samples: 510722480. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:18,989][27935] Avg episode reward: [(0, '-1.785')] [2022-07-13 09:19:23,989][27935] Fps is (10 sec: 5529.6, 60 sec: 5222.4, 300 sec: 4877.0). Total num frames: 255379456. Throughput: 0: 10412.2. Samples: 510753912. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:23,989][27935] Avg episode reward: [(0, '-0.956')] [2022-07-13 09:19:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 4873.5). Total num frames: 255401984. Throughput: 0: 10371.7. Samples: 510814644. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:28,989][27935] Avg episode reward: [(0, '-1.302')] [2022-07-13 09:19:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5188.3, 300 sec: 4877.0). Total num frames: 255427584. Throughput: 0: 10323.0. Samples: 510875696. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:33,989][27935] Avg episode reward: [(0, '-2.803')] [2022-07-13 09:19:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 4880.5). Total num frames: 255453184. Throughput: 0: 10316.1. Samples: 510906948. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:38,989][27935] Avg episode reward: [(0, '-3.055')] [2022-07-13 09:19:43,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5188.3, 300 sec: 4890.9). Total num frames: 255480832. Throughput: 0: 10311.3. Samples: 510969760. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:43,989][27935] Avg episode reward: [(0, '-2.988')] [2022-07-13 09:19:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 4894.4). Total num frames: 255506432. Throughput: 0: 10401.4. Samples: 511032888. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:48,989][27935] Avg episode reward: [(0, '-3.405')] [2022-07-13 09:19:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.9, 300 sec: 4904.8). Total num frames: 255533056. Throughput: 0: 10396.1. Samples: 511064644. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:53,989][27935] Avg episode reward: [(0, '-3.290')] [2022-07-13 09:19:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 4911.7). Total num frames: 255558656. Throughput: 0: 10411.2. Samples: 511127576. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:19:58,990][27935] Avg episode reward: [(0, '-3.291')] [2022-07-13 09:20:03,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5188.3, 300 sec: 4922.1). Total num frames: 255584256. Throughput: 0: 10311.4. Samples: 511186492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 09:20:03,991][27935] Avg episode reward: [(0, '-4.438')] [2022-07-13 09:20:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5154.1, 300 sec: 4925.6). Total num frames: 255608832. Throughput: 0: 10319.5. Samples: 511218292. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:08,991][27935] Avg episode reward: [(0, '-4.437')] [2022-07-13 09:20:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4932.6). Total num frames: 255636480. Throughput: 0: 10360.6. Samples: 511280872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:13,989][27935] Avg episode reward: [(0, '-5.054')] [2022-07-13 09:20:18,989][27935] Fps is (10 sec: 5427.2, 60 sec: 5205.3, 300 sec: 4943.0). Total num frames: 255663104. Throughput: 0: 10407.0. Samples: 511344012. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:18,989][27935] Avg episode reward: [(0, '-5.905')] [2022-07-13 09:20:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 4946.4). Total num frames: 255688704. Throughput: 0: 10415.8. Samples: 511375660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:23,989][27935] Avg episode reward: [(0, '-6.687')] [2022-07-13 09:20:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4956.9). Total num frames: 255714304. Throughput: 0: 10421.0. Samples: 511438704. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:28,990][27935] Avg episode reward: [(0, '-5.934')] [2022-07-13 09:20:33,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5239.5, 300 sec: 4970.7). Total num frames: 255741952. Throughput: 0: 10399.3. Samples: 511500856. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:33,990][27935] Avg episode reward: [(0, '-5.283')] [2022-07-13 09:20:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5222.4, 300 sec: 4970.7). Total num frames: 255766528. Throughput: 0: 10395.0. Samples: 511532420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:38,989][27935] Avg episode reward: [(0, '-3.951')] [2022-07-13 09:20:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 4977.7). Total num frames: 255793152. Throughput: 0: 10394.3. Samples: 511595320. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:43,989][27935] Avg episode reward: [(0, '-2.988')] [2022-07-13 09:20:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5222.4, 300 sec: 4988.1). Total num frames: 255819776. Throughput: 0: 10477.2. Samples: 511657968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:48,989][27935] Avg episode reward: [(0, '-3.453')] [2022-07-13 09:20:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5205.3, 300 sec: 4988.1). Total num frames: 255845376. Throughput: 0: 10466.4. Samples: 511689280. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:53,989][27935] Avg episode reward: [(0, '-3.424')] [2022-07-13 09:20:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5205.3, 300 sec: 5005.5). Total num frames: 255870976. Throughput: 0: 10478.2. Samples: 511752392. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:20:58,989][27935] Avg episode reward: [(0, '-3.417')] [2022-07-13 09:21:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5188.3, 300 sec: 5005.5). Total num frames: 255895552. Throughput: 0: 10386.7. Samples: 511811412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:03,989][27935] Avg episode reward: [(0, '-3.829')] [2022-07-13 09:21:08,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5239.5, 300 sec: 5019.3). Total num frames: 255923200. Throughput: 0: 10384.8. Samples: 511842976. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:08,989][27935] Avg episode reward: [(0, '-5.613')] [2022-07-13 09:21:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5022.8). Total num frames: 255947776. Throughput: 0: 10374.8. Samples: 511905572. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:13,989][27935] Avg episode reward: [(0, '-5.277')] [2022-07-13 09:21:18,992][27935] Fps is (10 sec: 5118.5, 60 sec: 5188.0, 300 sec: 5026.2). Total num frames: 255974400. Throughput: 0: 10378.5. Samples: 511967920. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:18,994][27935] Avg episode reward: [(0, '-5.519')] [2022-07-13 09:21:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5188.3, 300 sec: 5040.2). Total num frames: 256000000. Throughput: 0: 10365.5. Samples: 511998868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:23,989][27935] Avg episode reward: [(0, '-3.827')] [2022-07-13 09:21:28,989][27935] Fps is (10 sec: 5224.0, 60 sec: 5205.3, 300 sec: 5050.6). Total num frames: 256026624. Throughput: 0: 10355.4. Samples: 512061312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:28,989][27935] Avg episode reward: [(0, '-3.476')] [2022-07-13 09:21:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5047.1). Total num frames: 256051200. Throughput: 0: 10318.5. Samples: 512122300. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:33,989][27935] Avg episode reward: [(0, '-2.664')] [2022-07-13 09:21:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.2, 300 sec: 5054.0). Total num frames: 256076800. Throughput: 0: 10310.8. Samples: 512153264. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:38,989][27935] Avg episode reward: [(0, '-1.443')] [2022-07-13 09:21:43,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5064.5). Total num frames: 256103424. Throughput: 0: 10289.0. Samples: 512215396. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:43,989][27935] Avg episode reward: [(0, '-0.793')] [2022-07-13 09:21:48,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5071.4). Total num frames: 256130048. Throughput: 0: 10358.8. Samples: 512277556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:48,989][27935] Avg episode reward: [(0, '-1.738')] [2022-07-13 09:21:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5074.9). Total num frames: 256154624. Throughput: 0: 10346.2. Samples: 512308556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:53,989][27935] Avg episode reward: [(0, '-1.931')] [2022-07-13 09:21:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5088.8). Total num frames: 256181248. Throughput: 0: 10358.1. Samples: 512371684. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:21:58,989][27935] Avg episode reward: [(0, '-2.410')] [2022-07-13 09:22:03,992][27935] Fps is (10 sec: 5016.0, 60 sec: 5153.9, 300 sec: 5088.7). Total num frames: 256204800. Throughput: 0: 10262.5. Samples: 512429736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:22:03,993][27935] Avg episode reward: [(0, '-2.512')] [2022-07-13 09:22:08,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5099.2). Total num frames: 256231424. Throughput: 0: 10262.8. Samples: 512460692. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:22:08,989][27935] Avg episode reward: [(0, '-3.090')] [2022-07-13 09:22:13,989][27935] Fps is (10 sec: 5224.1, 60 sec: 5154.1, 300 sec: 5106.1). Total num frames: 256257024. Throughput: 0: 10268.8. Samples: 512523408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:22:13,989][27935] Avg episode reward: [(0, '-3.157')] [2022-07-13 09:22:18,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.4, 300 sec: 5116.5). Total num frames: 256283648. Throughput: 0: 10306.3. Samples: 512586084. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:22:18,989][27935] Avg episode reward: [(0, '-3.025')] [2022-07-13 09:22:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5120.0). Total num frames: 256309248. Throughput: 0: 10321.9. Samples: 512617748. Policy #0 lag: (min: 0.0, avg: 9.3, max: 18.0) [2022-07-13 09:22:23,989][27935] Avg episode reward: [(0, '-2.906')] [2022-07-13 09:22:28,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5130.4). Total num frames: 256335872. Throughput: 0: 10328.8. Samples: 512680192. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:28,989][27935] Avg episode reward: [(0, '-1.878')] [2022-07-13 09:22:33,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5133.9). Total num frames: 256361472. Throughput: 0: 10324.2. Samples: 512742144. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:33,989][27935] Avg episode reward: [(0, '-2.007')] [2022-07-13 09:22:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5171.2, 300 sec: 5144.3). Total num frames: 256387072. Throughput: 0: 10331.1. Samples: 512773456. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:38,989][27935] Avg episode reward: [(0, '-2.212')] [2022-07-13 09:22:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5144.3). Total num frames: 256412672. Throughput: 0: 10284.3. Samples: 512834476. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:43,989][27935] Avg episode reward: [(0, '-1.607')] [2022-07-13 09:22:48,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5154.1, 300 sec: 5158.2). Total num frames: 256439296. Throughput: 0: 10395.1. Samples: 512897484. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:48,989][27935] Avg episode reward: [(0, '-0.797')] [2022-07-13 09:22:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5161.7). Total num frames: 256464896. Throughput: 0: 10398.4. Samples: 512928620. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:53,990][27935] Avg episode reward: [(0, '-2.479')] [2022-07-13 09:22:58,990][27935] Fps is (10 sec: 5119.3, 60 sec: 5154.0, 300 sec: 5175.5). Total num frames: 256490496. Throughput: 0: 10396.6. Samples: 512991268. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:22:58,991][27935] Avg episode reward: [(0, '-2.501')] [2022-07-13 09:23:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5171.5, 300 sec: 5175.5). Total num frames: 256515072. Throughput: 0: 10300.7. Samples: 513049616. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:03,990][27935] Avg episode reward: [(0, '-2.420')] [2022-07-13 09:23:08,989][27935] Fps is (10 sec: 5018.2, 60 sec: 5154.1, 300 sec: 5175.5). Total num frames: 256540672. Throughput: 0: 10299.3. Samples: 513081216. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:08,990][27935] Avg episode reward: [(0, '-2.322')] [2022-07-13 09:23:13,989][27935] Fps is (10 sec: 5222.3, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 256567296. Throughput: 0: 10303.0. Samples: 513143828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:13,989][27935] Avg episode reward: [(0, '-3.159')] [2022-07-13 09:23:18,989][27935] Fps is (10 sec: 5324.8, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 256593920. Throughput: 0: 10301.6. Samples: 513205716. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:18,989][27935] Avg episode reward: [(0, '-3.716')] [2022-07-13 09:23:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 5171.2, 300 sec: 5179.0). Total num frames: 256619520. Throughput: 0: 10300.1. Samples: 513236960. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:23,989][27935] Avg episode reward: [(0, '-3.520')] [2022-07-13 09:23:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5137.1, 300 sec: 5179.0). Total num frames: 256644096. Throughput: 0: 10315.6. Samples: 513298676. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:28,991][27935] Avg episode reward: [(0, '-3.260')] [2022-07-13 09:23:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5179.0). Total num frames: 256670720. Throughput: 0: 10278.9. Samples: 513360036. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:33,989][27935] Avg episode reward: [(0, '-3.577')] [2022-07-13 09:23:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5137.1, 300 sec: 5172.1). Total num frames: 256695296. Throughput: 0: 10256.0. Samples: 513390140. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:38,989][27935] Avg episode reward: [(0, '-3.165')] [2022-07-13 09:23:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5154.1, 300 sec: 5172.1). Total num frames: 256721920. Throughput: 0: 10224.3. Samples: 513451348. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:43,989][27935] Avg episode reward: [(0, '-3.300')] [2022-07-13 09:23:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 5120.0, 300 sec: 5168.7). Total num frames: 256746496. Throughput: 0: 10242.9. Samples: 513510548. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:48,989][27935] Avg episode reward: [(0, '-4.344')] [2022-07-13 09:23:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5085.9, 300 sec: 5158.2). Total num frames: 256770048. Throughput: 0: 10193.3. Samples: 513539916. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:53,989][27935] Avg episode reward: [(0, '-4.823')] [2022-07-13 09:23:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 5051.8, 300 sec: 5154.7). Total num frames: 256793600. Throughput: 0: 10114.7. Samples: 513598988. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:23:58,989][27935] Avg episode reward: [(0, '-3.808')] [2022-07-13 09:24:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5051.7, 300 sec: 5147.8). Total num frames: 256818176. Throughput: 0: 9980.3. Samples: 513654828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:03,989][27935] Avg episode reward: [(0, '-5.521')] [2022-07-13 09:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 5017.6, 300 sec: 5144.3). Total num frames: 256841728. Throughput: 0: 9939.5. Samples: 513684236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:08,989][27935] Avg episode reward: [(0, '-5.963')] [2022-07-13 09:24:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 5017.6, 300 sec: 5144.3). Total num frames: 256868352. Throughput: 0: 9889.0. Samples: 513743680. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:13,989][27935] Avg episode reward: [(0, '-5.662')] [2022-07-13 09:24:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4966.4, 300 sec: 5126.9). Total num frames: 256891904. Throughput: 0: 9842.0. Samples: 513802924. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:18,989][27935] Avg episode reward: [(0, '-4.998')] [2022-07-13 09:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4949.3, 300 sec: 5133.9). Total num frames: 256916480. Throughput: 0: 9842.8. Samples: 513833068. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:23,989][27935] Avg episode reward: [(0, '-3.891')] [2022-07-13 09:24:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4949.3, 300 sec: 5130.4). Total num frames: 256941056. Throughput: 0: 9821.0. Samples: 513893292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:28,989][27935] Avg episode reward: [(0, '-3.982')] [2022-07-13 09:24:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 5130.4). Total num frames: 256966656. Throughput: 0: 9828.7. Samples: 513952840. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:33,990][27935] Avg episode reward: [(0, '-4.275')] [2022-07-13 09:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 5116.5). Total num frames: 256990208. Throughput: 0: 9791.5. Samples: 513980532. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:38,989][27935] Avg episode reward: [(0, '-2.351')] [2022-07-13 09:24:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 5109.6). Total num frames: 257013760. Throughput: 0: 9740.1. Samples: 514037292. Policy #0 lag: (min: 0.0, avg: 8.5, max: 22.0) [2022-07-13 09:24:43,989][27935] Avg episode reward: [(0, '-3.754')] [2022-07-13 09:24:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 5095.7). Total num frames: 257036288. Throughput: 0: 9770.4. Samples: 514094496. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:24:48,989][27935] Avg episode reward: [(0, '-3.461')] [2022-07-13 09:24:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 5092.2). Total num frames: 257060864. Throughput: 0: 9745.6. Samples: 514122788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:24:53,990][27935] Avg episode reward: [(0, '-4.767')] [2022-07-13 09:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 5088.8). Total num frames: 257085440. Throughput: 0: 9721.0. Samples: 514181124. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:24:58,990][27935] Avg episode reward: [(0, '-5.084')] [2022-07-13 09:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 5081.8). Total num frames: 257107968. Throughput: 0: 9619.3. Samples: 514235792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:03,991][27935] Avg episode reward: [(0, '-4.450')] [2022-07-13 09:25:08,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4863.8, 300 sec: 5074.8). Total num frames: 257133568. Throughput: 0: 9597.9. Samples: 514265000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:08,992][27935] Avg episode reward: [(0, '-4.494')] [2022-07-13 09:25:13,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4812.7, 300 sec: 5064.4). Total num frames: 257157120. Throughput: 0: 9561.1. Samples: 514323560. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:13,992][27935] Avg episode reward: [(0, '-5.402')] [2022-07-13 09:25:18,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4829.9, 300 sec: 5061.0). Total num frames: 257181696. Throughput: 0: 9546.2. Samples: 514382420. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:18,989][27935] Avg episode reward: [(0, '-3.595')] [2022-07-13 09:25:23,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4812.8, 300 sec: 5054.0). Total num frames: 257205248. Throughput: 0: 9587.9. Samples: 514411988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:23,989][27935] Avg episode reward: [(0, '-3.693')] [2022-07-13 09:25:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 5050.6). Total num frames: 257231872. Throughput: 0: 9639.2. Samples: 514471056. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:28,989][27935] Avg episode reward: [(0, '-2.030')] [2022-07-13 09:25:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 5043.6). Total num frames: 257254400. Throughput: 0: 9618.6. Samples: 514527332. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:33,989][27935] Avg episode reward: [(0, '-3.071')] [2022-07-13 09:25:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 5033.2). Total num frames: 257277952. Throughput: 0: 9630.0. Samples: 514556140. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:38,989][27935] Avg episode reward: [(0, '-2.788')] [2022-07-13 09:25:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 5022.8). Total num frames: 257301504. Throughput: 0: 9646.6. Samples: 514615220. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:43,989][27935] Avg episode reward: [(0, '-3.957')] [2022-07-13 09:25:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 5019.3). Total num frames: 257326080. Throughput: 0: 9720.0. Samples: 514673192. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:48,989][27935] Avg episode reward: [(0, '-3.201')] [2022-07-13 09:25:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 5015.9). Total num frames: 257350656. Throughput: 0: 9719.1. Samples: 514702332. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:53,989][27935] Avg episode reward: [(0, '-2.916')] [2022-07-13 09:25:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 5019.3). Total num frames: 257376256. Throughput: 0: 9721.0. Samples: 514760988. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:25:58,989][27935] Avg episode reward: [(0, '-3.042')] [2022-07-13 09:26:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 5002.0). Total num frames: 257398784. Throughput: 0: 9636.9. Samples: 514816080. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:03,989][27935] Avg episode reward: [(0, '-3.860')] [2022-07-13 09:26:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4813.0, 300 sec: 4998.5). Total num frames: 257422336. Throughput: 0: 9634.7. Samples: 514845548. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:08,989][27935] Avg episode reward: [(0, '-4.053')] [2022-07-13 09:26:13,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4829.7, 300 sec: 4991.6). Total num frames: 257446912. Throughput: 0: 9628.5. Samples: 514904372. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:13,993][27935] Avg episode reward: [(0, '-3.701')] [2022-07-13 09:26:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4988.1). Total num frames: 257471488. Throughput: 0: 9683.8. Samples: 514963104. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:18,989][27935] Avg episode reward: [(0, '-3.224')] [2022-07-13 09:26:23,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4864.0, 300 sec: 4984.6). Total num frames: 257497088. Throughput: 0: 9695.2. Samples: 514992424. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:23,990][27935] Avg episode reward: [(0, '-2.522')] [2022-07-13 09:26:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4981.2). Total num frames: 257520640. Throughput: 0: 9696.5. Samples: 515051564. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:28,989][27935] Avg episode reward: [(0, '-3.204')] [2022-07-13 09:26:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4977.7). Total num frames: 257545216. Throughput: 0: 9711.5. Samples: 515110212. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:33,991][27935] Avg episode reward: [(0, '-3.040')] [2022-07-13 09:26:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4970.7). Total num frames: 257569792. Throughput: 0: 9693.2. Samples: 515138528. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:38,989][27935] Avg episode reward: [(0, '-2.775')] [2022-07-13 09:26:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4960.3). Total num frames: 257593344. Throughput: 0: 9662.6. Samples: 515195804. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:43,990][27935] Avg episode reward: [(0, '-2.910')] [2022-07-13 09:26:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4963.8). Total num frames: 257618944. Throughput: 0: 9818.5. Samples: 515257912. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:48,990][27935] Avg episode reward: [(0, '-3.186')] [2022-07-13 09:26:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4960.3). Total num frames: 257644544. Throughput: 0: 9821.5. Samples: 515287516. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:53,991][27935] Avg episode reward: [(0, '-4.293')] [2022-07-13 09:26:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4963.9). Total num frames: 257669120. Throughput: 0: 9855.5. Samples: 515347832. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:26:58,990][27935] Avg episode reward: [(0, '-4.195')] [2022-07-13 09:27:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4946.4). Total num frames: 257690624. Throughput: 0: 9737.0. Samples: 515401268. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 09:27:03,989][27935] Avg episode reward: [(0, '-3.572')] [2022-07-13 09:27:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4846.9, 300 sec: 4936.0). Total num frames: 257713152. Throughput: 0: 9706.0. Samples: 515429192. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:08,990][27935] Avg episode reward: [(0, '-4.126')] [2022-07-13 09:27:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.2, 300 sec: 4929.1). Total num frames: 257737728. Throughput: 0: 9680.5. Samples: 515487188. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:13,989][27935] Avg episode reward: [(0, '-2.549')] [2022-07-13 09:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4929.1). Total num frames: 257763328. Throughput: 0: 9668.9. Samples: 515545312. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:18,990][27935] Avg episode reward: [(0, '-3.632')] [2022-07-13 09:27:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4922.1). Total num frames: 257787904. Throughput: 0: 9689.3. Samples: 515574548. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:23,989][27935] Avg episode reward: [(0, '-3.803')] [2022-07-13 09:27:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4915.2). Total num frames: 257811456. Throughput: 0: 9730.1. Samples: 515633660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:28,989][27935] Avg episode reward: [(0, '-2.974')] [2022-07-13 09:27:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4915.2). Total num frames: 257837056. Throughput: 0: 9658.4. Samples: 515692540. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:33,990][27935] Avg episode reward: [(0, '-3.474')] [2022-07-13 09:27:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4911.7). Total num frames: 257861632. Throughput: 0: 9653.7. Samples: 515721932. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:38,989][27935] Avg episode reward: [(0, '-2.664')] [2022-07-13 09:27:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4904.8). Total num frames: 257886208. Throughput: 0: 9610.9. Samples: 515780324. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:43,991][27935] Avg episode reward: [(0, '-2.003')] [2022-07-13 09:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4897.8). Total num frames: 257909760. Throughput: 0: 9741.9. Samples: 515839656. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:48,989][27935] Avg episode reward: [(0, '-1.966')] [2022-07-13 09:27:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4894.4). Total num frames: 257934336. Throughput: 0: 9761.6. Samples: 515868464. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:53,991][27935] Avg episode reward: [(0, '-2.482')] [2022-07-13 09:27:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4890.9). Total num frames: 257957888. Throughput: 0: 9778.3. Samples: 515927212. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:27:58,989][27935] Avg episode reward: [(0, '-2.368')] [2022-07-13 09:28:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4880.5). Total num frames: 257980416. Throughput: 0: 9687.5. Samples: 515981248. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:03,989][27935] Avg episode reward: [(0, '-2.343')] [2022-07-13 09:28:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 258006016. Throughput: 0: 9688.6. Samples: 516010536. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:08,989][27935] Avg episode reward: [(0, '-4.635')] [2022-07-13 09:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 258029568. Throughput: 0: 9685.4. Samples: 516069504. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:13,989][27935] Avg episode reward: [(0, '-4.697')] [2022-07-13 09:28:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 258054144. Throughput: 0: 9682.6. Samples: 516128256. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:18,989][27935] Avg episode reward: [(0, '-4.622')] [2022-07-13 09:28:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 258078720. Throughput: 0: 9679.5. Samples: 516157508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:23,989][27935] Avg episode reward: [(0, '-4.523')] [2022-07-13 09:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 258103296. Throughput: 0: 9680.7. Samples: 516215956. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:28,989][27935] Avg episode reward: [(0, '-3.887')] [2022-07-13 09:28:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 258126848. Throughput: 0: 9660.9. Samples: 516274396. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:33,989][27935] Avg episode reward: [(0, '-5.477')] [2022-07-13 09:28:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 258152448. Throughput: 0: 9676.6. Samples: 516303912. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:38,989][27935] Avg episode reward: [(0, '-5.320')] [2022-07-13 09:28:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 258178048. Throughput: 0: 9680.6. Samples: 516362840. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:43,989][27935] Avg episode reward: [(0, '-5.106')] [2022-07-13 09:28:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 258200576. Throughput: 0: 9788.5. Samples: 516421732. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:48,991][27935] Avg episode reward: [(0, '-5.296')] [2022-07-13 09:28:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 258225152. Throughput: 0: 9788.0. Samples: 516450996. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:53,992][27935] Avg episode reward: [(0, '-4.637')] [2022-07-13 09:28:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 258250752. Throughput: 0: 9784.6. Samples: 516509812. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:28:58,989][27935] Avg episode reward: [(0, '-3.778')] [2022-07-13 09:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 258272256. Throughput: 0: 9671.0. Samples: 516563452. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:29:03,990][27935] Avg episode reward: [(0, '-3.468')] [2022-07-13 09:29:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 258296832. Throughput: 0: 9664.0. Samples: 516592388. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:29:08,989][27935] Avg episode reward: [(0, '-1.966')] [2022-07-13 09:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 258321408. Throughput: 0: 9654.4. Samples: 516650404. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:29:13,990][27935] Avg episode reward: [(0, '-1.652')] [2022-07-13 09:29:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 258344960. Throughput: 0: 9658.3. Samples: 516709020. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:29:18,989][27935] Avg episode reward: [(0, '-1.281')] [2022-07-13 09:29:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 258369536. Throughput: 0: 9660.2. Samples: 516738620. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 09:29:23,989][27935] Avg episode reward: [(0, '-1.483')] [2022-07-13 09:29:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 258393088. Throughput: 0: 9668.2. Samples: 516797908. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:28,989][27935] Avg episode reward: [(0, '-2.451')] [2022-07-13 09:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 258419712. Throughput: 0: 9664.5. Samples: 516856636. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:33,989][27935] Avg episode reward: [(0, '-2.243')] [2022-07-13 09:29:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 258443264. Throughput: 0: 9663.6. Samples: 516885856. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:38,989][27935] Avg episode reward: [(0, '-4.284')] [2022-07-13 09:29:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 258466816. Throughput: 0: 9653.1. Samples: 516944200. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:43,989][27935] Avg episode reward: [(0, '-4.663')] [2022-07-13 09:29:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 258491392. Throughput: 0: 9747.6. Samples: 517002092. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:48,989][27935] Avg episode reward: [(0, '-5.981')] [2022-07-13 09:29:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 258515968. Throughput: 0: 9755.1. Samples: 517031368. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:53,989][27935] Avg episode reward: [(0, '-5.031')] [2022-07-13 09:29:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 258541568. Throughput: 0: 9773.4. Samples: 517090208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:29:58,989][27935] Avg episode reward: [(0, '-6.666')] [2022-07-13 09:30:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.4). Total num frames: 258562048. Throughput: 0: 9670.3. Samples: 517144184. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:03,991][27935] Avg episode reward: [(0, '-6.136')] [2022-07-13 09:30:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 258587648. Throughput: 0: 9667.5. Samples: 517173660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:08,991][27935] Avg episode reward: [(0, '-4.994')] [2022-07-13 09:30:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 258611200. Throughput: 0: 9654.9. Samples: 517232380. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:13,991][27935] Avg episode reward: [(0, '-5.002')] [2022-07-13 09:30:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 258634752. Throughput: 0: 9653.0. Samples: 517291020. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:18,989][27935] Avg episode reward: [(0, '-3.138')] [2022-07-13 09:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 258660352. Throughput: 0: 9642.4. Samples: 517319764. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:23,991][27935] Avg episode reward: [(0, '-3.292')] [2022-07-13 09:30:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 258683904. Throughput: 0: 9640.6. Samples: 517378028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:28,989][27935] Avg episode reward: [(0, '-2.664')] [2022-07-13 09:30:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 258708480. Throughput: 0: 9665.3. Samples: 517437032. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:33,989][27935] Avg episode reward: [(0, '-1.435')] [2022-07-13 09:30:38,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4829.7, 300 sec: 4852.7). Total num frames: 258733056. Throughput: 0: 9672.7. Samples: 517466664. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:38,992][27935] Avg episode reward: [(0, '-1.400')] [2022-07-13 09:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 258757632. Throughput: 0: 9667.7. Samples: 517525256. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:43,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 09:30:48,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 258782208. Throughput: 0: 9122.4. Samples: 517554692. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:48,989][27935] Avg episode reward: [(0, '-0.910')] [2022-07-13 09:30:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 258806784. Throughput: 0: 9789.5. Samples: 517614188. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:53,989][27935] Avg episode reward: [(0, '-1.431')] [2022-07-13 09:30:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 258832384. Throughput: 0: 9795.9. Samples: 517673196. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:30:58,989][27935] Avg episode reward: [(0, '-1.439')] [2022-07-13 09:31:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 258854912. Throughput: 0: 9713.7. Samples: 517728136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:03,989][27935] Avg episode reward: [(0, '-2.621')] [2022-07-13 09:31:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.8). Total num frames: 258878464. Throughput: 0: 9731.0. Samples: 517757660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:08,989][27935] Avg episode reward: [(0, '-4.125')] [2022-07-13 09:31:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 258905088. Throughput: 0: 9752.0. Samples: 517816868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:13,989][27935] Avg episode reward: [(0, '-4.139')] [2022-07-13 09:31:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 258927616. Throughput: 0: 9745.9. Samples: 517875596. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:18,989][27935] Avg episode reward: [(0, '-4.178')] [2022-07-13 09:31:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 258952192. Throughput: 0: 9733.4. Samples: 517904640. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:23,990][27935] Avg episode reward: [(0, '-4.060')] [2022-07-13 09:31:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 258976768. Throughput: 0: 9738.8. Samples: 517963500. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:28,989][27935] Avg episode reward: [(0, '-3.319')] [2022-07-13 09:31:33,994][27935] Fps is (10 sec: 4912.6, 60 sec: 4880.6, 300 sec: 4852.6). Total num frames: 259001344. Throughput: 0: 10366.0. Samples: 518021216. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:33,995][27935] Avg episode reward: [(0, '-4.456')] [2022-07-13 09:31:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.1, 300 sec: 4849.2). Total num frames: 259023872. Throughput: 0: 9674.6. Samples: 518049544. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:38,989][27935] Avg episode reward: [(0, '-3.963')] [2022-07-13 09:31:43,989][27935] Fps is (10 sec: 4712.9, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 259048448. Throughput: 0: 9657.3. Samples: 518107776. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 09:31:43,989][27935] Avg episode reward: [(0, '-3.266')] [2022-07-13 09:31:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 259074048. Throughput: 0: 9733.6. Samples: 518166148. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:31:48,989][27935] Avg episode reward: [(0, '-4.389')] [2022-07-13 09:31:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 259097600. Throughput: 0: 9734.3. Samples: 518195704. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:31:53,989][27935] Avg episode reward: [(0, '-5.975')] [2022-07-13 09:31:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 259123200. Throughput: 0: 9712.9. Samples: 518253948. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:31:58,989][27935] Avg episode reward: [(0, '-6.975')] [2022-07-13 09:32:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 259143680. Throughput: 0: 9619.2. Samples: 518308460. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:03,989][27935] Avg episode reward: [(0, '-6.929')] [2022-07-13 09:32:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 259168256. Throughput: 0: 9628.4. Samples: 518337920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:08,989][27935] Avg episode reward: [(0, '-7.088')] [2022-07-13 09:32:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 259193856. Throughput: 0: 9634.6. Samples: 518397056. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:13,989][27935] Avg episode reward: [(0, '-6.877')] [2022-07-13 09:32:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 259218432. Throughput: 0: 9662.2. Samples: 518455964. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:18,989][27935] Avg episode reward: [(0, '-6.543')] [2022-07-13 09:32:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 259243008. Throughput: 0: 9686.9. Samples: 518485452. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:23,989][27935] Avg episode reward: [(0, '-6.409')] [2022-07-13 09:32:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 259266560. Throughput: 0: 9698.8. Samples: 518544224. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:28,989][27935] Avg episode reward: [(0, '-4.082')] [2022-07-13 09:32:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.4, 300 sec: 4852.7). Total num frames: 259293184. Throughput: 0: 9056.2. Samples: 518573676. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:33,989][27935] Avg episode reward: [(0, '-4.148')] [2022-07-13 09:32:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 259315712. Throughput: 0: 9703.5. Samples: 518632360. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:38,991][27935] Avg episode reward: [(0, '-4.071')] [2022-07-13 09:32:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 259340288. Throughput: 0: 9703.2. Samples: 518690592. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:43,989][27935] Avg episode reward: [(0, '-2.871')] [2022-07-13 09:32:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259365888. Throughput: 0: 9796.6. Samples: 518749308. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:48,990][27935] Avg episode reward: [(0, '-3.403')] [2022-07-13 09:32:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259389440. Throughput: 0: 9795.2. Samples: 518778704. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:53,991][27935] Avg episode reward: [(0, '-2.435')] [2022-07-13 09:32:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 259414016. Throughput: 0: 9790.5. Samples: 518837628. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:32:58,989][27935] Avg episode reward: [(0, '-4.058')] [2022-07-13 09:33:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 259436544. Throughput: 0: 9700.6. Samples: 518892492. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:03,989][27935] Avg episode reward: [(0, '-3.780')] [2022-07-13 09:33:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 259461120. Throughput: 0: 9699.8. Samples: 518921944. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:08,989][27935] Avg episode reward: [(0, '-3.772')] [2022-07-13 09:33:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 259484672. Throughput: 0: 9707.3. Samples: 518981052. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:13,989][27935] Avg episode reward: [(0, '-3.294')] [2022-07-13 09:33:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259510272. Throughput: 0: 10352.0. Samples: 519039516. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:18,989][27935] Avg episode reward: [(0, '-3.084')] [2022-07-13 09:33:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259534848. Throughput: 0: 9704.6. Samples: 519069068. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:23,989][27935] Avg episode reward: [(0, '-3.764')] [2022-07-13 09:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 259559424. Throughput: 0: 9711.7. Samples: 519127620. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:28,989][27935] Avg episode reward: [(0, '-3.470')] [2022-07-13 09:33:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 259582976. Throughput: 0: 9711.6. Samples: 519186332. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:33,989][27935] Avg episode reward: [(0, '-3.300')] [2022-07-13 09:33:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 259607552. Throughput: 0: 9707.6. Samples: 519215544. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:38,990][27935] Avg episode reward: [(0, '-4.151')] [2022-07-13 09:33:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 259633152. Throughput: 0: 9702.2. Samples: 519274228. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:43,989][27935] Avg episode reward: [(0, '-3.601')] [2022-07-13 09:33:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 259657728. Throughput: 0: 9781.3. Samples: 519332648. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:48,991][27935] Avg episode reward: [(0, '-3.665')] [2022-07-13 09:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 259682304. Throughput: 0: 9786.6. Samples: 519362340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:53,990][27935] Avg episode reward: [(0, '-3.521')] [2022-07-13 09:33:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 259704832. Throughput: 0: 9783.2. Samples: 519421296. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:33:58,996][27935] Avg episode reward: [(0, '-4.260')] [2022-07-13 09:34:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259728384. Throughput: 0: 9709.1. Samples: 519476424. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:34:03,989][27935] Avg episode reward: [(0, '-3.955')] [2022-07-13 09:34:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 259752960. Throughput: 0: 9706.7. Samples: 519505868. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 09:34:08,989][27935] Avg episode reward: [(0, '-2.680')] [2022-07-13 09:34:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 259777536. Throughput: 0: 9720.0. Samples: 519565020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:13,989][27935] Avg episode reward: [(0, '-2.774')] [2022-07-13 09:34:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 259802112. Throughput: 0: 9715.0. Samples: 519623508. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:18,989][27935] Avg episode reward: [(0, '-2.665')] [2022-07-13 09:34:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 259828736. Throughput: 0: 9730.9. Samples: 519653432. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:23,989][27935] Avg episode reward: [(0, '-1.984')] [2022-07-13 09:34:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 259850240. Throughput: 0: 9735.2. Samples: 519712312. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:28,989][27935] Avg episode reward: [(0, '-1.924')] [2022-07-13 09:34:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 259875840. Throughput: 0: 9743.3. Samples: 519771096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:33,989][27935] Avg episode reward: [(0, '-2.130')] [2022-07-13 09:34:38,996][27935] Fps is (10 sec: 5014.0, 60 sec: 4880.5, 300 sec: 4859.5). Total num frames: 259900416. Throughput: 0: 9732.0. Samples: 519800348. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:38,998][27935] Avg episode reward: [(0, '-2.509')] [2022-07-13 09:34:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 259924992. Throughput: 0: 9736.4. Samples: 519859436. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:43,990][27935] Avg episode reward: [(0, '-2.492')] [2022-07-13 09:34:48,989][27935] Fps is (10 sec: 5021.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 259950592. Throughput: 0: 9824.9. Samples: 519918544. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:48,989][27935] Avg episode reward: [(0, '-2.344')] [2022-07-13 09:34:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 259974144. Throughput: 0: 9830.5. Samples: 519948240. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:53,989][27935] Avg episode reward: [(0, '-2.679')] [2022-07-13 09:34:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 259998720. Throughput: 0: 9828.6. Samples: 520007308. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:34:58,989][27935] Avg episode reward: [(0, '-2.584')] [2022-07-13 09:35:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 260021248. Throughput: 0: 9758.6. Samples: 520062644. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:03,989][27935] Avg episode reward: [(0, '-2.049')] [2022-07-13 09:35:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 260046848. Throughput: 0: 9753.0. Samples: 520092316. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:08,990][27935] Avg episode reward: [(0, '-2.040')] [2022-07-13 09:35:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 260070400. Throughput: 0: 9756.8. Samples: 520151368. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:13,989][27935] Avg episode reward: [(0, '-1.979')] [2022-07-13 09:35:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 260096000. Throughput: 0: 9757.3. Samples: 520210176. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:18,989][27935] Avg episode reward: [(0, '-2.061')] [2022-07-13 09:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 260119552. Throughput: 0: 9758.8. Samples: 520239424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:23,989][27935] Avg episode reward: [(0, '-2.725')] [2022-07-13 09:35:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 260144128. Throughput: 0: 9753.4. Samples: 520298340. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:28,989][27935] Avg episode reward: [(0, '-2.021')] [2022-07-13 09:35:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 260168704. Throughput: 0: 9741.9. Samples: 520356928. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:33,989][27935] Avg episode reward: [(0, '-3.076')] [2022-07-13 09:35:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.6, 300 sec: 4866.6). Total num frames: 260193280. Throughput: 0: 9734.7. Samples: 520386300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:38,990][27935] Avg episode reward: [(0, '-2.042')] [2022-07-13 09:35:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 260217856. Throughput: 0: 9734.5. Samples: 520445360. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:43,989][27935] Avg episode reward: [(0, '-2.348')] [2022-07-13 09:35:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 260243456. Throughput: 0: 9812.3. Samples: 520504196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:48,989][27935] Avg episode reward: [(0, '-2.162')] [2022-07-13 09:35:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 260267008. Throughput: 0: 9813.1. Samples: 520533904. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:53,989][27935] Avg episode reward: [(0, '-2.881')] [2022-07-13 09:35:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 260290560. Throughput: 0: 9810.6. Samples: 520592844. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:35:58,989][27935] Avg episode reward: [(0, '-2.415')] [2022-07-13 09:36:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 260315136. Throughput: 0: 9722.2. Samples: 520647672. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:03,989][27935] Avg episode reward: [(0, '-2.847')] [2022-07-13 09:36:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 260338688. Throughput: 0: 9731.1. Samples: 520677324. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:08,989][27935] Avg episode reward: [(0, '-2.430')] [2022-07-13 09:36:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 260363264. Throughput: 0: 9728.4. Samples: 520736116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:13,991][27935] Avg episode reward: [(0, '-2.718')] [2022-07-13 09:36:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 260387840. Throughput: 0: 9728.2. Samples: 520794696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:18,991][27935] Avg episode reward: [(0, '-2.742')] [2022-07-13 09:36:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 260411392. Throughput: 0: 9725.4. Samples: 520823944. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:23,990][27935] Avg episode reward: [(0, '-2.437')] [2022-07-13 09:36:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.7). Total num frames: 260436992. Throughput: 0: 9723.3. Samples: 520882908. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 09:36:28,989][27935] Avg episode reward: [(0, '-2.236')] [2022-07-13 09:36:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 260461568. Throughput: 0: 9717.9. Samples: 520941500. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:33,989][27935] Avg episode reward: [(0, '-2.933')] [2022-07-13 09:36:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 260486144. Throughput: 0: 9714.0. Samples: 520971032. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:38,989][27935] Avg episode reward: [(0, '-3.028')] [2022-07-13 09:36:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 260510720. Throughput: 0: 9711.0. Samples: 521029840. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:43,989][27935] Avg episode reward: [(0, '-3.281')] [2022-07-13 09:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 260534272. Throughput: 0: 9799.3. Samples: 521088640. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:48,990][27935] Avg episode reward: [(0, '-4.858')] [2022-07-13 09:36:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 260558848. Throughput: 0: 9797.0. Samples: 521118188. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:53,989][27935] Avg episode reward: [(0, '-5.051')] [2022-07-13 09:36:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 260583424. Throughput: 0: 9800.7. Samples: 521177148. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:36:58,992][27935] Avg episode reward: [(0, '-4.685')] [2022-07-13 09:37:03,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 260606976. Throughput: 0: 9715.7. Samples: 521231900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:03,989][27935] Avg episode reward: [(0, '-4.708')] [2022-07-13 09:37:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 260631552. Throughput: 0: 9717.3. Samples: 521261224. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:08,989][27935] Avg episode reward: [(0, '-4.179')] [2022-07-13 09:37:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 260654080. Throughput: 0: 9708.3. Samples: 521319784. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:13,989][27935] Avg episode reward: [(0, '-3.274')] [2022-07-13 09:37:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 260679680. Throughput: 0: 9709.2. Samples: 521378416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:18,989][27935] Avg episode reward: [(0, '-4.040')] [2022-07-13 09:37:23,989][27935] Fps is (10 sec: 5017.4, 60 sec: 4881.0, 300 sec: 4873.5). Total num frames: 260704256. Throughput: 0: 9711.8. Samples: 521408068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:23,990][27935] Avg episode reward: [(0, '-2.527')] [2022-07-13 09:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 260728832. Throughput: 0: 9704.5. Samples: 521466544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:28,990][27935] Avg episode reward: [(0, '-2.039')] [2022-07-13 09:37:33,989][27935] Fps is (10 sec: 4710.6, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 260751360. Throughput: 0: 9678.8. Samples: 521524188. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:33,990][27935] Avg episode reward: [(0, '-1.650')] [2022-07-13 09:37:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 260775936. Throughput: 0: 9659.5. Samples: 521552864. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:38,990][27935] Avg episode reward: [(0, '-1.687')] [2022-07-13 09:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4859.7). Total num frames: 260799488. Throughput: 0: 9593.4. Samples: 521608852. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:43,990][27935] Avg episode reward: [(0, '-1.527')] [2022-07-13 09:37:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4859.7). Total num frames: 260823040. Throughput: 0: 9659.8. Samples: 521666592. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:48,989][27935] Avg episode reward: [(0, '-1.639')] [2022-07-13 09:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 260848640. Throughput: 0: 9644.5. Samples: 521695228. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:53,989][27935] Avg episode reward: [(0, '-1.784')] [2022-07-13 09:37:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4866.6). Total num frames: 260872192. Throughput: 0: 9631.9. Samples: 521753220. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:37:58,989][27935] Avg episode reward: [(0, '-2.653')] [2022-07-13 09:38:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4856.2). Total num frames: 260893696. Throughput: 0: 8977.7. Samples: 521782412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:03,989][27935] Avg episode reward: [(0, '-3.129')] [2022-07-13 09:38:08,992][27935] Fps is (10 sec: 4606.5, 60 sec: 4778.4, 300 sec: 4859.6). Total num frames: 260918272. Throughput: 0: 9509.8. Samples: 521836036. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:08,992][27935] Avg episode reward: [(0, '-3.213')] [2022-07-13 09:38:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4852.7). Total num frames: 260941824. Throughput: 0: 9503.3. Samples: 521894192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:13,989][27935] Avg episode reward: [(0, '-3.560')] [2022-07-13 09:38:18,996][27935] Fps is (10 sec: 4913.4, 60 sec: 4795.2, 300 sec: 4856.1). Total num frames: 260967424. Throughput: 0: 9509.2. Samples: 521952168. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:18,996][27935] Avg episode reward: [(0, '-3.040')] [2022-07-13 09:38:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4849.2). Total num frames: 260989952. Throughput: 0: 9510.1. Samples: 521980816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:23,989][27935] Avg episode reward: [(0, '-3.285')] [2022-07-13 09:38:28,989][27935] Fps is (10 sec: 4713.6, 60 sec: 4761.6, 300 sec: 4852.7). Total num frames: 261014528. Throughput: 0: 9552.5. Samples: 522038716. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:28,989][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 09:38:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4852.7). Total num frames: 261039104. Throughput: 0: 9556.4. Samples: 522096628. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:33,989][27935] Avg episode reward: [(0, '-1.281')] [2022-07-13 09:38:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4845.8). Total num frames: 261062656. Throughput: 0: 9563.3. Samples: 522125576. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:38,989][27935] Avg episode reward: [(0, '-1.881')] [2022-07-13 09:38:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 261087232. Throughput: 0: 9578.2. Samples: 522184240. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:43,989][27935] Avg episode reward: [(0, '-2.362')] [2022-07-13 09:38:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 261111808. Throughput: 0: 10232.6. Samples: 522242880. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 09:38:48,989][27935] Avg episode reward: [(0, '-2.237')] [2022-07-13 09:38:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4852.7). Total num frames: 261136384. Throughput: 0: 9681.0. Samples: 522271648. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:38:53,989][27935] Avg episode reward: [(0, '-2.371')] [2022-07-13 09:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4852.7). Total num frames: 261159936. Throughput: 0: 9676.9. Samples: 522329652. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:38:58,989][27935] Avg episode reward: [(0, '-3.342')] [2022-07-13 09:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 261183488. Throughput: 0: 9591.6. Samples: 522383724. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:03,989][27935] Avg episode reward: [(0, '-3.003')] [2022-07-13 09:39:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4796.0, 300 sec: 4842.3). Total num frames: 261206016. Throughput: 0: 9600.9. Samples: 522412856. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:08,989][27935] Avg episode reward: [(0, '-3.240')] [2022-07-13 09:39:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 261229568. Throughput: 0: 9598.8. Samples: 522470660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:13,989][27935] Avg episode reward: [(0, '-4.109')] [2022-07-13 09:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4779.2, 300 sec: 4831.9). Total num frames: 261254144. Throughput: 0: 9593.9. Samples: 522528352. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:18,989][27935] Avg episode reward: [(0, '-3.988')] [2022-07-13 09:39:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 261278720. Throughput: 0: 9596.8. Samples: 522557432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:23,990][27935] Avg episode reward: [(0, '-4.226')] [2022-07-13 09:39:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 261303296. Throughput: 0: 9569.1. Samples: 522614848. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:28,989][27935] Avg episode reward: [(0, '-4.113')] [2022-07-13 09:39:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.5). Total num frames: 261326848. Throughput: 0: 9539.9. Samples: 522672176. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:33,990][27935] Avg episode reward: [(0, '-3.838')] [2022-07-13 09:39:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 261350400. Throughput: 0: 9535.0. Samples: 522700724. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:38,989][27935] Avg episode reward: [(0, '-3.837')] [2022-07-13 09:39:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 261373952. Throughput: 0: 9516.5. Samples: 522757896. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:43,989][27935] Avg episode reward: [(0, '-3.088')] [2022-07-13 09:39:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4824.9). Total num frames: 261397504. Throughput: 0: 9599.6. Samples: 522815708. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:48,990][27935] Avg episode reward: [(0, '-2.838')] [2022-07-13 09:39:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4824.9). Total num frames: 261422080. Throughput: 0: 9593.8. Samples: 522844576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:53,989][27935] Avg episode reward: [(0, '-2.112')] [2022-07-13 09:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 261446656. Throughput: 0: 9594.4. Samples: 522902408. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:39:58,991][27935] Avg episode reward: [(0, '-2.049')] [2022-07-13 09:40:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4821.5). Total num frames: 261469184. Throughput: 0: 9507.6. Samples: 522956192. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:03,989][27935] Avg episode reward: [(0, '-2.118')] [2022-07-13 09:40:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 261491712. Throughput: 0: 9496.1. Samples: 522984756. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:08,989][27935] Avg episode reward: [(0, '-2.041')] [2022-07-13 09:40:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 261516288. Throughput: 0: 9506.2. Samples: 523042628. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:13,989][27935] Avg episode reward: [(0, '-2.130')] [2022-07-13 09:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 261540864. Throughput: 0: 9507.4. Samples: 523100008. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:18,989][27935] Avg episode reward: [(0, '-1.727')] [2022-07-13 09:40:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4814.5). Total num frames: 261564416. Throughput: 0: 9513.7. Samples: 523128840. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:23,989][27935] Avg episode reward: [(0, '-3.017')] [2022-07-13 09:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4814.5). Total num frames: 261588992. Throughput: 0: 9519.2. Samples: 523186260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:28,989][27935] Avg episode reward: [(0, '-2.753')] [2022-07-13 09:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4811.1). Total num frames: 261612544. Throughput: 0: 9508.5. Samples: 523243592. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:33,989][27935] Avg episode reward: [(0, '-3.348')] [2022-07-13 09:40:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4804.1). Total num frames: 261635072. Throughput: 0: 9507.6. Samples: 523272416. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:38,990][27935] Avg episode reward: [(0, '-3.099')] [2022-07-13 09:40:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 261659648. Throughput: 0: 9495.7. Samples: 523329716. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:43,989][27935] Avg episode reward: [(0, '-2.605')] [2022-07-13 09:40:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 261684224. Throughput: 0: 9575.6. Samples: 523387092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:48,989][27935] Avg episode reward: [(0, '-2.608')] [2022-07-13 09:40:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 261708800. Throughput: 0: 9587.2. Samples: 523416180. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:53,989][27935] Avg episode reward: [(0, '-2.408')] [2022-07-13 09:40:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4800.7). Total num frames: 261731328. Throughput: 0: 9575.1. Samples: 523473508. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:40:58,989][27935] Avg episode reward: [(0, '-2.531')] [2022-07-13 09:41:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4797.2). Total num frames: 261753856. Throughput: 0: 9486.1. Samples: 523526884. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:41:03,989][27935] Avg episode reward: [(0, '-2.733')] [2022-07-13 09:41:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 261777408. Throughput: 0: 9473.1. Samples: 523555128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 09:41:08,989][27935] Avg episode reward: [(0, '-3.575')] [2022-07-13 09:41:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 261800960. Throughput: 0: 9474.0. Samples: 523612592. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:13,989][27935] Avg episode reward: [(0, '-3.665')] [2022-07-13 09:41:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 261825536. Throughput: 0: 9469.6. Samples: 523669724. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:18,989][27935] Avg episode reward: [(0, '-4.251')] [2022-07-13 09:41:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 261849088. Throughput: 0: 9460.9. Samples: 523698156. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:23,989][27935] Avg episode reward: [(0, '-4.657')] [2022-07-13 09:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 261873664. Throughput: 0: 9464.3. Samples: 523755608. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:28,989][27935] Avg episode reward: [(0, '-5.988')] [2022-07-13 09:41:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4779.8). Total num frames: 261896192. Throughput: 0: 9454.5. Samples: 523812544. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:33,989][27935] Avg episode reward: [(0, '-5.171')] [2022-07-13 09:41:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 261919744. Throughput: 0: 9446.3. Samples: 523841264. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:38,989][27935] Avg episode reward: [(0, '-4.282')] [2022-07-13 09:41:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 261943296. Throughput: 0: 9453.1. Samples: 523898896. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:43,989][27935] Avg episode reward: [(0, '-3.755')] [2022-07-13 09:41:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 261967872. Throughput: 0: 9546.0. Samples: 523956452. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:48,991][27935] Avg episode reward: [(0, '-3.415')] [2022-07-13 09:41:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 261992448. Throughput: 0: 9554.7. Samples: 523985088. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:53,990][27935] Avg episode reward: [(0, '-2.408')] [2022-07-13 09:41:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 262017024. Throughput: 0: 9554.8. Samples: 524042556. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:41:58,989][27935] Avg episode reward: [(0, '-0.906')] [2022-07-13 09:42:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4765.9). Total num frames: 262037504. Throughput: 0: 9469.7. Samples: 524095860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:03,989][27935] Avg episode reward: [(0, '-0.886')] [2022-07-13 09:42:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4776.4). Total num frames: 262063104. Throughput: 0: 9477.0. Samples: 524124620. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:08,989][27935] Avg episode reward: [(0, '-2.017')] [2022-07-13 09:42:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4769.4). Total num frames: 262086656. Throughput: 0: 9474.1. Samples: 524181944. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:13,989][27935] Avg episode reward: [(0, '-2.558')] [2022-07-13 09:42:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 262110208. Throughput: 0: 9491.2. Samples: 524239648. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:18,989][27935] Avg episode reward: [(0, '-2.655')] [2022-07-13 09:42:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4762.5). Total num frames: 262133760. Throughput: 0: 9493.4. Samples: 524268468. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:23,989][27935] Avg episode reward: [(0, '-3.427')] [2022-07-13 09:42:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4765.9). Total num frames: 262157312. Throughput: 0: 9489.6. Samples: 524325928. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:28,990][27935] Avg episode reward: [(0, '-4.281')] [2022-07-13 09:42:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4765.9). Total num frames: 262181888. Throughput: 0: 9480.8. Samples: 524383088. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:33,989][27935] Avg episode reward: [(0, '-5.386')] [2022-07-13 09:42:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 262206464. Throughput: 0: 9485.2. Samples: 524411920. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:38,990][27935] Avg episode reward: [(0, '-4.628')] [2022-07-13 09:42:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 262230016. Throughput: 0: 9475.2. Samples: 524468940. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:43,989][27935] Avg episode reward: [(0, '-4.673')] [2022-07-13 09:42:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4759.0). Total num frames: 262252544. Throughput: 0: 9564.0. Samples: 524526240. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:48,989][27935] Avg episode reward: [(0, '-5.521')] [2022-07-13 09:42:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4759.0). Total num frames: 262276096. Throughput: 0: 9559.6. Samples: 524554804. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:53,990][27935] Avg episode reward: [(0, '-4.847')] [2022-07-13 09:42:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4776.4). Total num frames: 262302720. Throughput: 0: 9569.2. Samples: 524612556. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:42:58,990][27935] Avg episode reward: [(0, '-3.340')] [2022-07-13 09:43:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4766.0). Total num frames: 262324224. Throughput: 0: 9485.2. Samples: 524666484. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:03,989][27935] Avg episode reward: [(0, '-4.685')] [2022-07-13 09:43:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 4762.5). Total num frames: 262346752. Throughput: 0: 9486.5. Samples: 524695360. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:08,989][27935] Avg episode reward: [(0, '-4.701')] [2022-07-13 09:43:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4755.6). Total num frames: 262370304. Throughput: 0: 9490.3. Samples: 524752992. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:13,989][27935] Avg episode reward: [(0, '-4.032')] [2022-07-13 09:43:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4762.5). Total num frames: 262394880. Throughput: 0: 8857.0. Samples: 524781652. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:18,989][27935] Avg episode reward: [(0, '-3.139')] [2022-07-13 09:43:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 262420480. Throughput: 0: 9506.5. Samples: 524839712. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:23,989][27935] Avg episode reward: [(0, '-2.847')] [2022-07-13 09:43:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 262444032. Throughput: 0: 9509.2. Samples: 524896856. Policy #0 lag: (min: 0.0, avg: 9.9, max: 20.0) [2022-07-13 09:43:28,989][27935] Avg episode reward: [(0, '-3.732')] [2022-07-13 09:43:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 262467584. Throughput: 0: 9503.1. Samples: 524953880. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:33,989][27935] Avg episode reward: [(0, '-2.870')] [2022-07-13 09:43:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4759.0). Total num frames: 262491136. Throughput: 0: 9502.2. Samples: 524982404. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:38,989][27935] Avg episode reward: [(0, '-2.077')] [2022-07-13 09:43:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4755.5). Total num frames: 262514688. Throughput: 0: 9494.0. Samples: 525039784. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:43,989][27935] Avg episode reward: [(0, '-2.842')] [2022-07-13 09:43:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4752.1). Total num frames: 262538240. Throughput: 0: 9558.3. Samples: 525096608. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:48,989][27935] Avg episode reward: [(0, '-2.847')] [2022-07-13 09:43:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 262562816. Throughput: 0: 9560.7. Samples: 525125592. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:53,989][27935] Avg episode reward: [(0, '-2.912')] [2022-07-13 09:43:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 262588416. Throughput: 0: 9573.5. Samples: 525183800. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:43:58,990][27935] Avg episode reward: [(0, '-2.818')] [2022-07-13 09:44:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4759.0). Total num frames: 262609920. Throughput: 0: 10147.6. Samples: 525238292. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:03,990][27935] Avg episode reward: [(0, '-3.458')] [2022-07-13 09:44:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 262632448. Throughput: 0: 9499.7. Samples: 525267200. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:08,989][27935] Avg episode reward: [(0, '-3.273')] [2022-07-13 09:44:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 262658048. Throughput: 0: 9516.7. Samples: 525325108. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:13,991][27935] Avg episode reward: [(0, '-3.660')] [2022-07-13 09:44:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4755.5). Total num frames: 262681600. Throughput: 0: 9536.5. Samples: 525383024. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:18,989][27935] Avg episode reward: [(0, '-2.754')] [2022-07-13 09:44:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 262706176. Throughput: 0: 9543.6. Samples: 525411864. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:23,989][27935] Avg episode reward: [(0, '-2.730')] [2022-07-13 09:44:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 262729728. Throughput: 0: 9546.3. Samples: 525469368. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:28,989][27935] Avg episode reward: [(0, '-2.840')] [2022-07-13 09:44:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4755.5). Total num frames: 262753280. Throughput: 0: 9574.1. Samples: 525527444. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:33,989][27935] Avg episode reward: [(0, '-2.581')] [2022-07-13 09:44:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 262778880. Throughput: 0: 9575.5. Samples: 525556492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:38,989][27935] Avg episode reward: [(0, '-2.379')] [2022-07-13 09:44:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 262802432. Throughput: 0: 9573.2. Samples: 525614596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:43,989][27935] Avg episode reward: [(0, '-2.698')] [2022-07-13 09:44:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4762.5). Total num frames: 262827008. Throughput: 0: 9646.3. Samples: 525672376. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:48,989][27935] Avg episode reward: [(0, '-1.710')] [2022-07-13 09:44:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 262850560. Throughput: 0: 9654.4. Samples: 525701648. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:53,989][27935] Avg episode reward: [(0, '-2.957')] [2022-07-13 09:44:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4765.9). Total num frames: 262875136. Throughput: 0: 9650.5. Samples: 525759380. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:44:58,989][27935] Avg episode reward: [(0, '-3.783')] [2022-07-13 09:45:03,992][27935] Fps is (10 sec: 4606.3, 60 sec: 4778.4, 300 sec: 4762.4). Total num frames: 262896640. Throughput: 0: 9571.2. Samples: 525813764. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:03,993][27935] Avg episode reward: [(0, '-3.869')] [2022-07-13 09:45:08,989][27935] Fps is (10 sec: 4505.4, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 262920192. Throughput: 0: 9582.9. Samples: 525843100. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:08,990][27935] Avg episode reward: [(0, '-4.115')] [2022-07-13 09:45:13,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 262945792. Throughput: 0: 9588.9. Samples: 525900868. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:13,989][27935] Avg episode reward: [(0, '-4.172')] [2022-07-13 09:45:18,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4812.8, 300 sec: 4765.9). Total num frames: 262970368. Throughput: 0: 9595.3. Samples: 525959232. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:18,990][27935] Avg episode reward: [(0, '-4.276')] [2022-07-13 09:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 262993920. Throughput: 0: 9600.2. Samples: 525988500. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:23,989][27935] Avg episode reward: [(0, '-5.389')] [2022-07-13 09:45:28,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4795.7, 300 sec: 4762.5). Total num frames: 263017472. Throughput: 0: 9593.5. Samples: 526046304. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:28,989][27935] Avg episode reward: [(0, '-3.988')] [2022-07-13 09:45:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 263042048. Throughput: 0: 9594.1. Samples: 526104112. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:33,989][27935] Avg episode reward: [(0, '-4.884')] [2022-07-13 09:45:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4769.4). Total num frames: 263066624. Throughput: 0: 9593.0. Samples: 526133332. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:38,989][27935] Avg episode reward: [(0, '-5.270')] [2022-07-13 09:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4765.9). Total num frames: 263090176. Throughput: 0: 9605.8. Samples: 526191640. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:43,989][27935] Avg episode reward: [(0, '-5.213')] [2022-07-13 09:45:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 263115776. Throughput: 0: 9688.0. Samples: 526249688. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:48,991][27935] Avg episode reward: [(0, '-4.632')] [2022-07-13 09:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4772.9). Total num frames: 263139328. Throughput: 0: 9687.0. Samples: 526279012. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 09:45:53,989][27935] Avg episode reward: [(0, '-4.446')] [2022-07-13 09:45:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 263162880. Throughput: 0: 9708.5. Samples: 526337752. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:45:58,989][27935] Avg episode reward: [(0, '-3.750')] [2022-07-13 09:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.2, 300 sec: 4776.4). Total num frames: 263186432. Throughput: 0: 9635.8. Samples: 526392844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:03,989][27935] Avg episode reward: [(0, '-3.198')] [2022-07-13 09:46:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.0, 300 sec: 4779.8). Total num frames: 263211008. Throughput: 0: 9632.9. Samples: 526421980. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:08,991][27935] Avg episode reward: [(0, '-2.419')] [2022-07-13 09:46:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4776.4). Total num frames: 263234560. Throughput: 0: 9637.0. Samples: 526479968. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:13,989][27935] Avg episode reward: [(0, '-2.413')] [2022-07-13 09:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 263260160. Throughput: 0: 9641.0. Samples: 526537956. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:18,989][27935] Avg episode reward: [(0, '-3.341')] [2022-07-13 09:46:24,000][27935] Fps is (10 sec: 4909.8, 60 sec: 4829.0, 300 sec: 4779.6). Total num frames: 263283712. Throughput: 0: 9637.3. Samples: 526567116. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:24,000][27935] Avg episode reward: [(0, '-3.182')] [2022-07-13 09:46:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 263307264. Throughput: 0: 9631.9. Samples: 526625076. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:28,989][27935] Avg episode reward: [(0, '-3.261')] [2022-07-13 09:46:33,989][27935] Fps is (10 sec: 4715.6, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 263330816. Throughput: 0: 9630.4. Samples: 526683056. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:33,989][27935] Avg episode reward: [(0, '-2.848')] [2022-07-13 09:46:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 263356416. Throughput: 0: 9628.9. Samples: 526712312. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:38,989][27935] Avg episode reward: [(0, '-2.788')] [2022-07-13 09:46:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4790.2). Total num frames: 263380992. Throughput: 0: 9617.7. Samples: 526770548. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:43,989][27935] Avg episode reward: [(0, '-2.515')] [2022-07-13 09:46:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 263403520. Throughput: 0: 9678.2. Samples: 526828364. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:48,989][27935] Avg episode reward: [(0, '-1.044')] [2022-07-13 09:46:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 263428096. Throughput: 0: 9686.0. Samples: 526857848. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:53,989][27935] Avg episode reward: [(0, '-1.683')] [2022-07-13 09:46:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 263453696. Throughput: 0: 9704.4. Samples: 526916664. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:46:58,990][27935] Avg episode reward: [(0, '-0.683')] [2022-07-13 09:47:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 263476224. Throughput: 0: 9632.4. Samples: 526971412. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:03,989][27935] Avg episode reward: [(0, '-1.199')] [2022-07-13 09:47:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 263500800. Throughput: 0: 9638.9. Samples: 527000760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:08,989][27935] Avg episode reward: [(0, '-1.307')] [2022-07-13 09:47:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 263524352. Throughput: 0: 9657.2. Samples: 527059652. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:13,989][27935] Avg episode reward: [(0, '-1.927')] [2022-07-13 09:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 263548928. Throughput: 0: 9667.2. Samples: 527118080. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:18,991][27935] Avg episode reward: [(0, '-2.092')] [2022-07-13 09:47:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.8, 300 sec: 4804.1). Total num frames: 263574528. Throughput: 0: 9672.3. Samples: 527147564. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:23,989][27935] Avg episode reward: [(0, '-2.963')] [2022-07-13 09:47:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 263598080. Throughput: 0: 9689.2. Samples: 527206564. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:28,989][27935] Avg episode reward: [(0, '-2.336')] [2022-07-13 09:47:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4800.7). Total num frames: 263622656. Throughput: 0: 9695.5. Samples: 527264660. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:33,990][27935] Avg episode reward: [(0, '-2.663')] [2022-07-13 09:47:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 263646208. Throughput: 0: 9693.9. Samples: 527294072. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:38,990][27935] Avg episode reward: [(0, '-2.873')] [2022-07-13 09:47:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 263671808. Throughput: 0: 9682.4. Samples: 527352372. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:43,990][27935] Avg episode reward: [(0, '-2.771')] [2022-07-13 09:47:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4814.5). Total num frames: 263696384. Throughput: 0: 9772.9. Samples: 527411192. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:48,991][27935] Avg episode reward: [(0, '-3.200')] [2022-07-13 09:47:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4807.6). Total num frames: 263720960. Throughput: 0: 9775.9. Samples: 527440676. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:53,990][27935] Avg episode reward: [(0, '-1.769')] [2022-07-13 09:47:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 263744512. Throughput: 0: 9780.2. Samples: 527499760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:47:58,989][27935] Avg episode reward: [(0, '-1.724')] [2022-07-13 09:48:03,992][27935] Fps is (10 sec: 4606.6, 60 sec: 4846.7, 300 sec: 4814.5). Total num frames: 263767040. Throughput: 0: 9693.2. Samples: 527554304. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:48:03,992][27935] Avg episode reward: [(0, '-1.677')] [2022-07-13 09:48:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 263791616. Throughput: 0: 9695.6. Samples: 527583868. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:48:08,989][27935] Avg episode reward: [(0, '-1.246')] [2022-07-13 09:48:13,989][27935] Fps is (10 sec: 5019.1, 60 sec: 4881.1, 300 sec: 4821.5). Total num frames: 263817216. Throughput: 0: 9698.2. Samples: 527642984. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 09:48:13,989][27935] Avg episode reward: [(0, '-1.429')] [2022-07-13 09:48:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 263840768. Throughput: 0: 9719.0. Samples: 527702016. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:18,989][27935] Avg episode reward: [(0, '-1.618')] [2022-07-13 09:48:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 263865344. Throughput: 0: 9722.6. Samples: 527731588. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:23,989][27935] Avg episode reward: [(0, '-1.637')] [2022-07-13 09:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4824.9). Total num frames: 263890944. Throughput: 0: 9738.8. Samples: 527790620. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:28,989][27935] Avg episode reward: [(0, '-2.970')] [2022-07-13 09:48:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 263915520. Throughput: 0: 9733.9. Samples: 527849220. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:33,989][27935] Avg episode reward: [(0, '-3.537')] [2022-07-13 09:48:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 263939072. Throughput: 0: 9732.8. Samples: 527878652. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:38,989][27935] Avg episode reward: [(0, '-3.361')] [2022-07-13 09:48:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 263963648. Throughput: 0: 9735.9. Samples: 527937876. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:43,989][27935] Avg episode reward: [(0, '-3.545')] [2022-07-13 09:48:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 263989248. Throughput: 0: 9834.4. Samples: 527996824. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:48,989][27935] Avg episode reward: [(0, '-4.016')] [2022-07-13 09:48:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 264012800. Throughput: 0: 9836.9. Samples: 528026528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:53,989][27935] Avg episode reward: [(0, '-4.130')] [2022-07-13 09:48:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 264038400. Throughput: 0: 9835.4. Samples: 528085576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:48:58,989][27935] Avg episode reward: [(0, '-5.195')] [2022-07-13 09:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.3, 300 sec: 4838.8). Total num frames: 264059904. Throughput: 0: 9741.2. Samples: 528140368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:03,989][27935] Avg episode reward: [(0, '-4.687')] [2022-07-13 09:49:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 264084480. Throughput: 0: 9729.4. Samples: 528169412. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:08,989][27935] Avg episode reward: [(0, '-3.844')] [2022-07-13 09:49:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 264109056. Throughput: 0: 9723.3. Samples: 528228168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:13,989][27935] Avg episode reward: [(0, '-4.651')] [2022-07-13 09:49:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 264134656. Throughput: 0: 9722.8. Samples: 528286748. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:18,989][27935] Avg episode reward: [(0, '-3.948')] [2022-07-13 09:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 264158208. Throughput: 0: 9727.7. Samples: 528316400. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:23,989][27935] Avg episode reward: [(0, '-3.060')] [2022-07-13 09:49:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 264182784. Throughput: 0: 9710.8. Samples: 528374864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:28,989][27935] Avg episode reward: [(0, '-2.958')] [2022-07-13 09:49:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 264207360. Throughput: 0: 9698.5. Samples: 528433256. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:33,989][27935] Avg episode reward: [(0, '-2.289')] [2022-07-13 09:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 264231936. Throughput: 0: 9689.1. Samples: 528462536. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:38,989][27935] Avg episode reward: [(0, '-3.093')] [2022-07-13 09:49:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 264256512. Throughput: 0: 9692.6. Samples: 528521744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:43,989][27935] Avg episode reward: [(0, '-3.149')] [2022-07-13 09:49:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 264279040. Throughput: 0: 9743.8. Samples: 528578840. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:48,991][27935] Avg episode reward: [(0, '-3.304')] [2022-07-13 09:49:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 264302592. Throughput: 0: 9736.6. Samples: 528607560. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:53,989][27935] Avg episode reward: [(0, '-3.192')] [2022-07-13 09:49:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 264330240. Throughput: 0: 9739.8. Samples: 528666460. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:49:58,989][27935] Avg episode reward: [(0, '-3.659')] [2022-07-13 09:50:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 264350720. Throughput: 0: 9099.0. Samples: 528696204. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:03,989][27935] Avg episode reward: [(0, '-2.790')] [2022-07-13 09:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 264376320. Throughput: 0: 9649.8. Samples: 528750640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:08,989][27935] Avg episode reward: [(0, '-3.654')] [2022-07-13 09:50:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 264399872. Throughput: 0: 9665.0. Samples: 528809788. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:13,989][27935] Avg episode reward: [(0, '-2.789')] [2022-07-13 09:50:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 264423424. Throughput: 0: 9670.3. Samples: 528868420. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:18,990][27935] Avg episode reward: [(0, '-1.945')] [2022-07-13 09:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 264449024. Throughput: 0: 9666.4. Samples: 528897524. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:23,989][27935] Avg episode reward: [(0, '-2.783')] [2022-07-13 09:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 264472576. Throughput: 0: 9653.4. Samples: 528956148. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:28,990][27935] Avg episode reward: [(0, '-2.308')] [2022-07-13 09:50:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 264498176. Throughput: 0: 9679.3. Samples: 529014408. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 09:50:33,990][27935] Avg episode reward: [(0, '-2.928')] [2022-07-13 09:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 264520704. Throughput: 0: 9690.5. Samples: 529043632. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:50:38,989][27935] Avg episode reward: [(0, '-2.396')] [2022-07-13 09:50:44,001][27935] Fps is (10 sec: 4807.1, 60 sec: 4828.9, 300 sec: 4849.1). Total num frames: 264546304. Throughput: 0: 9692.8. Samples: 529102752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:50:44,001][27935] Avg episode reward: [(0, '-2.049')] [2022-07-13 09:50:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 264570880. Throughput: 0: 10332.3. Samples: 529161156. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:50:48,989][27935] Avg episode reward: [(0, '-3.118')] [2022-07-13 09:50:53,989][27935] Fps is (10 sec: 4921.0, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 264595456. Throughput: 0: 9772.4. Samples: 529190400. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:50:53,989][27935] Avg episode reward: [(0, '-3.228')] [2022-07-13 09:50:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 264620032. Throughput: 0: 9755.7. Samples: 529248796. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:50:59,000][27935] Avg episode reward: [(0, '-2.277')] [2022-07-13 09:51:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 264642560. Throughput: 0: 9665.5. Samples: 529303368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:03,989][27935] Avg episode reward: [(0, '-2.190')] [2022-07-13 09:51:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 264666112. Throughput: 0: 9666.0. Samples: 529332496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:08,990][27935] Avg episode reward: [(0, '-1.762')] [2022-07-13 09:51:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 264690688. Throughput: 0: 9668.3. Samples: 529391220. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:13,989][27935] Avg episode reward: [(0, '-1.303')] [2022-07-13 09:51:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.4). Total num frames: 264714240. Throughput: 0: 9666.0. Samples: 529449380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:18,989][27935] Avg episode reward: [(0, '-1.564')] [2022-07-13 09:51:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 264738816. Throughput: 0: 9660.9. Samples: 529478372. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:23,991][27935] Avg episode reward: [(0, '-1.460')] [2022-07-13 09:51:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 264764416. Throughput: 0: 9652.0. Samples: 529536980. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:28,989][27935] Avg episode reward: [(0, '-1.196')] [2022-07-13 09:51:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 264785920. Throughput: 0: 9651.9. Samples: 529595492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:33,989][27935] Avg episode reward: [(0, '-1.680')] [2022-07-13 09:51:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 264812544. Throughput: 0: 9651.1. Samples: 529624700. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:38,989][27935] Avg episode reward: [(0, '-2.722')] [2022-07-13 09:51:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4830.8, 300 sec: 4856.2). Total num frames: 264836096. Throughput: 0: 9655.1. Samples: 529683276. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:43,989][27935] Avg episode reward: [(0, '-3.393')] [2022-07-13 09:51:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 264860672. Throughput: 0: 9729.8. Samples: 529741208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:48,989][27935] Avg episode reward: [(0, '-3.421')] [2022-07-13 09:51:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 264885248. Throughput: 0: 9726.4. Samples: 529770184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:53,989][27935] Avg episode reward: [(0, '-3.137')] [2022-07-13 09:51:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 264908800. Throughput: 0: 9722.9. Samples: 529828752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:51:58,989][27935] Avg episode reward: [(0, '-3.162')] [2022-07-13 09:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 264931328. Throughput: 0: 9635.0. Samples: 529882956. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:03,989][27935] Avg episode reward: [(0, '-5.220')] [2022-07-13 09:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 264954880. Throughput: 0: 9638.1. Samples: 529912088. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:08,989][27935] Avg episode reward: [(0, '-4.656')] [2022-07-13 09:52:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 264981504. Throughput: 0: 9634.2. Samples: 529970520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:13,995][27935] Avg episode reward: [(0, '-3.252')] [2022-07-13 09:52:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 265005056. Throughput: 0: 9631.2. Samples: 530028896. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:18,989][27935] Avg episode reward: [(0, '-3.056')] [2022-07-13 09:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 265029632. Throughput: 0: 9635.5. Samples: 530058296. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:23,989][27935] Avg episode reward: [(0, '-4.335')] [2022-07-13 09:52:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 265052160. Throughput: 0: 9630.6. Samples: 530116652. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:28,989][27935] Avg episode reward: [(0, '-4.328')] [2022-07-13 09:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 265077760. Throughput: 0: 9622.5. Samples: 530174220. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:33,989][27935] Avg episode reward: [(0, '-4.371')] [2022-07-13 09:52:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 265100288. Throughput: 0: 9622.8. Samples: 530203212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:38,991][27935] Avg episode reward: [(0, '-2.853')] [2022-07-13 09:52:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 265124864. Throughput: 0: 9608.4. Samples: 530261128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:43,989][27935] Avg episode reward: [(0, '-3.357')] [2022-07-13 09:52:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 265149440. Throughput: 0: 9704.3. Samples: 530319652. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:48,989][27935] Avg episode reward: [(0, '-3.138')] [2022-07-13 09:52:53,990][27935] Fps is (10 sec: 5017.0, 60 sec: 4829.8, 300 sec: 4849.2). Total num frames: 265175040. Throughput: 0: 9709.5. Samples: 530349028. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 09:52:53,991][27935] Avg episode reward: [(0, '-4.666')] [2022-07-13 09:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.8). Total num frames: 265198592. Throughput: 0: 9704.5. Samples: 530407224. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:52:58,990][27935] Avg episode reward: [(0, '-4.977')] [2022-07-13 09:53:03,989][27935] Fps is (10 sec: 4506.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 265220096. Throughput: 0: 9633.1. Samples: 530462384. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:03,990][27935] Avg episode reward: [(0, '-4.966')] [2022-07-13 09:53:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 265246720. Throughput: 0: 9631.6. Samples: 530491720. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:08,989][27935] Avg episode reward: [(0, '-4.148')] [2022-07-13 09:53:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 265270272. Throughput: 0: 9637.1. Samples: 530550324. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:13,989][27935] Avg episode reward: [(0, '-4.227')] [2022-07-13 09:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 265294848. Throughput: 0: 9657.7. Samples: 530608816. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:18,991][27935] Avg episode reward: [(0, '-5.406')] [2022-07-13 09:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 265318400. Throughput: 0: 9666.9. Samples: 530638224. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:23,989][27935] Avg episode reward: [(0, '-4.613')] [2022-07-13 09:53:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 265342976. Throughput: 0: 9690.3. Samples: 530697192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:28,990][27935] Avg episode reward: [(0, '-4.256')] [2022-07-13 09:53:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 265368576. Throughput: 0: 9685.7. Samples: 530755508. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:33,989][27935] Avg episode reward: [(0, '-5.011')] [2022-07-13 09:53:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 265393152. Throughput: 0: 9681.0. Samples: 530784660. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:38,993][27935] Avg episode reward: [(0, '-3.822')] [2022-07-13 09:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 265416704. Throughput: 0: 9688.9. Samples: 530843224. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:43,989][27935] Avg episode reward: [(0, '-4.823')] [2022-07-13 09:53:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 265441280. Throughput: 0: 9752.1. Samples: 530901228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:48,989][27935] Avg episode reward: [(0, '-5.227')] [2022-07-13 09:53:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4835.4). Total num frames: 265464832. Throughput: 0: 9758.4. Samples: 530930848. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:53,989][27935] Avg episode reward: [(0, '-4.138')] [2022-07-13 09:53:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 265490432. Throughput: 0: 9754.4. Samples: 530989272. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:53:58,989][27935] Avg episode reward: [(0, '-3.727')] [2022-07-13 09:54:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 265512960. Throughput: 0: 9665.1. Samples: 531043744. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:03,991][27935] Avg episode reward: [(0, '-3.649')] [2022-07-13 09:54:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 265536512. Throughput: 0: 9662.4. Samples: 531073032. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:08,989][27935] Avg episode reward: [(0, '-3.394')] [2022-07-13 09:54:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 265560064. Throughput: 0: 9655.8. Samples: 531131704. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:13,989][27935] Avg episode reward: [(0, '-2.832')] [2022-07-13 09:54:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 265585664. Throughput: 0: 9654.6. Samples: 531189964. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:18,989][27935] Avg episode reward: [(0, '-2.473')] [2022-07-13 09:54:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 265609216. Throughput: 0: 9654.8. Samples: 531219124. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:23,990][27935] Avg episode reward: [(0, '-1.629')] [2022-07-13 09:54:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 265633792. Throughput: 0: 9664.0. Samples: 531278104. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:28,990][27935] Avg episode reward: [(0, '-2.820')] [2022-07-13 09:54:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 265658368. Throughput: 0: 9668.9. Samples: 531336328. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:33,990][27935] Avg episode reward: [(0, '-2.235')] [2022-07-13 09:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 265682944. Throughput: 0: 9658.8. Samples: 531365496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:38,991][27935] Avg episode reward: [(0, '-1.533')] [2022-07-13 09:54:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 265706496. Throughput: 0: 9655.7. Samples: 531423780. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:43,990][27935] Avg episode reward: [(0, '-2.541')] [2022-07-13 09:54:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 265732096. Throughput: 0: 9741.3. Samples: 531482104. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:48,991][27935] Avg episode reward: [(0, '-2.645')] [2022-07-13 09:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 265755648. Throughput: 0: 9736.8. Samples: 531511188. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:53,989][27935] Avg episode reward: [(0, '-2.556')] [2022-07-13 09:54:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 265780224. Throughput: 0: 9732.1. Samples: 531569648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:54:58,990][27935] Avg episode reward: [(0, '-2.319')] [2022-07-13 09:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 265802752. Throughput: 0: 9638.6. Samples: 531623700. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:55:03,990][27935] Avg episode reward: [(0, '-2.576')] [2022-07-13 09:55:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 265825280. Throughput: 0: 9628.9. Samples: 531652424. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:55:08,990][27935] Avg episode reward: [(0, '-2.855')] [2022-07-13 09:55:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 265849856. Throughput: 0: 9618.5. Samples: 531710936. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:55:13,990][27935] Avg episode reward: [(0, '-2.519')] [2022-07-13 09:55:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 265875456. Throughput: 0: 9619.4. Samples: 531769200. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 09:55:18,989][27935] Avg episode reward: [(0, '-2.053')] [2022-07-13 09:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 265897984. Throughput: 0: 9620.3. Samples: 531798408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:23,989][27935] Avg episode reward: [(0, '-1.909')] [2022-07-13 09:55:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 265923584. Throughput: 0: 9626.8. Samples: 531856984. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:28,990][27935] Avg episode reward: [(0, '-1.449')] [2022-07-13 09:55:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 265947136. Throughput: 0: 9618.8. Samples: 531914952. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:33,989][27935] Avg episode reward: [(0, '-0.458')] [2022-07-13 09:55:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.6). Total num frames: 265972736. Throughput: 0: 9623.5. Samples: 531944244. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:38,989][27935] Avg episode reward: [(0, '-0.800')] [2022-07-13 09:55:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 265996288. Throughput: 0: 9616.2. Samples: 532002376. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:43,989][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 09:55:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 266020864. Throughput: 0: 9720.9. Samples: 532061140. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:48,990][27935] Avg episode reward: [(0, '-0.251')] [2022-07-13 09:55:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 266044416. Throughput: 0: 9711.8. Samples: 532089456. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:53,989][27935] Avg episode reward: [(0, '-0.684')] [2022-07-13 09:55:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 266067968. Throughput: 0: 9685.6. Samples: 532146788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:55:58,989][27935] Avg episode reward: [(0, '-0.903')] [2022-07-13 09:56:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 266091520. Throughput: 0: 9604.7. Samples: 532201412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:03,989][27935] Avg episode reward: [(0, '-1.801')] [2022-07-13 09:56:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 266115072. Throughput: 0: 9608.0. Samples: 532230768. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:08,990][27935] Avg episode reward: [(0, '-2.884')] [2022-07-13 09:56:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 266139648. Throughput: 0: 9620.1. Samples: 532289888. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:13,990][27935] Avg episode reward: [(0, '-3.595')] [2022-07-13 09:56:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 266164224. Throughput: 0: 9634.5. Samples: 532348504. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:18,996][27935] Avg episode reward: [(0, '-3.573')] [2022-07-13 09:56:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 266189824. Throughput: 0: 9633.3. Samples: 532377744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:23,989][27935] Avg episode reward: [(0, '-4.214')] [2022-07-13 09:56:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 266213376. Throughput: 0: 9652.4. Samples: 532436732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:28,989][27935] Avg episode reward: [(0, '-4.238')] [2022-07-13 09:56:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 266237952. Throughput: 0: 9650.7. Samples: 532495420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:33,989][27935] Avg episode reward: [(0, '-3.189')] [2022-07-13 09:56:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 266262528. Throughput: 0: 9672.2. Samples: 532524704. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:38,989][27935] Avg episode reward: [(0, '-3.543')] [2022-07-13 09:56:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 266286080. Throughput: 0: 9714.7. Samples: 532583948. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:43,989][27935] Avg episode reward: [(0, '-3.291')] [2022-07-13 09:56:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 266312704. Throughput: 0: 9809.4. Samples: 532642836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:48,989][27935] Avg episode reward: [(0, '-2.710')] [2022-07-13 09:56:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 266337280. Throughput: 0: 9811.3. Samples: 532672276. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:53,989][27935] Avg episode reward: [(0, '-2.274')] [2022-07-13 09:56:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 266360832. Throughput: 0: 9805.0. Samples: 532731112. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:56:58,990][27935] Avg episode reward: [(0, '-2.773')] [2022-07-13 09:57:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 266383360. Throughput: 0: 9719.7. Samples: 532785892. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:03,989][27935] Avg episode reward: [(0, '-2.649')] [2022-07-13 09:57:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 266406912. Throughput: 0: 9719.8. Samples: 532815136. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:08,990][27935] Avg episode reward: [(0, '-2.549')] [2022-07-13 09:57:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 266432512. Throughput: 0: 9723.7. Samples: 532874300. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:13,989][27935] Avg episode reward: [(0, '-2.032')] [2022-07-13 09:57:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 266457088. Throughput: 0: 9719.1. Samples: 532932780. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:18,989][27935] Avg episode reward: [(0, '-2.582')] [2022-07-13 09:57:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 266481664. Throughput: 0: 9723.8. Samples: 532962276. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:23,989][27935] Avg episode reward: [(0, '-3.796')] [2022-07-13 09:57:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 266505216. Throughput: 0: 9721.5. Samples: 533021416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:28,990][27935] Avg episode reward: [(0, '-3.192')] [2022-07-13 09:57:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 266530816. Throughput: 0: 9723.4. Samples: 533080388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:33,990][27935] Avg episode reward: [(0, '-3.311')] [2022-07-13 09:57:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 266555392. Throughput: 0: 9716.5. Samples: 533109520. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 09:57:38,991][27935] Avg episode reward: [(0, '-3.039')] [2022-07-13 09:57:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 266578944. Throughput: 0: 9689.1. Samples: 533167120. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:57:43,990][27935] Avg episode reward: [(0, '-5.592')] [2022-07-13 09:57:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 266603520. Throughput: 0: 9765.8. Samples: 533225352. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:57:48,990][27935] Avg episode reward: [(0, '-7.801')] [2022-07-13 09:57:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 266627072. Throughput: 0: 9768.1. Samples: 533254700. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:57:53,989][27935] Avg episode reward: [(0, '-7.826')] [2022-07-13 09:57:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 266652672. Throughput: 0: 9767.4. Samples: 533313832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:57:58,989][27935] Avg episode reward: [(0, '-7.103')] [2022-07-13 09:58:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 266675200. Throughput: 0: 9687.0. Samples: 533368696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:03,989][27935] Avg episode reward: [(0, '-7.522')] [2022-07-13 09:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 266699776. Throughput: 0: 9687.5. Samples: 533398216. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:08,989][27935] Avg episode reward: [(0, '-8.544')] [2022-07-13 09:58:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 266723328. Throughput: 0: 9670.3. Samples: 533456580. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:13,990][27935] Avg episode reward: [(0, '-6.254')] [2022-07-13 09:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 266747904. Throughput: 0: 9672.9. Samples: 533515668. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:18,991][27935] Avg episode reward: [(0, '-6.058')] [2022-07-13 09:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 266771456. Throughput: 0: 9679.6. Samples: 533545104. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:23,990][27935] Avg episode reward: [(0, '-5.831')] [2022-07-13 09:58:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 266798080. Throughput: 0: 9707.4. Samples: 533603952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:28,989][27935] Avg episode reward: [(0, '-4.636')] [2022-07-13 09:58:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 266820608. Throughput: 0: 9701.1. Samples: 533661900. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:33,990][27935] Avg episode reward: [(0, '-5.331')] [2022-07-13 09:58:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 266845184. Throughput: 0: 9702.7. Samples: 533691320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:38,989][27935] Avg episode reward: [(0, '-3.972')] [2022-07-13 09:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 266869760. Throughput: 0: 9693.2. Samples: 533750028. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:43,989][27935] Avg episode reward: [(0, '-3.281')] [2022-07-13 09:58:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 266895360. Throughput: 0: 9770.2. Samples: 533808356. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:48,989][27935] Avg episode reward: [(0, '-5.430')] [2022-07-13 09:58:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 266918912. Throughput: 0: 9771.9. Samples: 533837952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:53,989][27935] Avg episode reward: [(0, '-5.854')] [2022-07-13 09:58:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 266943488. Throughput: 0: 9771.7. Samples: 533896304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:58:58,990][27935] Avg episode reward: [(0, '-6.731')] [2022-07-13 09:59:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 266964992. Throughput: 0: 9676.7. Samples: 533951120. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:03,989][27935] Avg episode reward: [(0, '-6.090')] [2022-07-13 09:59:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 266990592. Throughput: 0: 9675.6. Samples: 533980508. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:08,991][27935] Avg episode reward: [(0, '-5.432')] [2022-07-13 09:59:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 267015168. Throughput: 0: 9672.1. Samples: 534039196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:13,989][27935] Avg episode reward: [(0, '-5.651')] [2022-07-13 09:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 267037696. Throughput: 0: 9683.5. Samples: 534097660. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:18,990][27935] Avg episode reward: [(0, '-5.335')] [2022-07-13 09:59:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 267064320. Throughput: 0: 9676.8. Samples: 534126776. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:23,989][27935] Avg episode reward: [(0, '-3.007')] [2022-07-13 09:59:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 267087872. Throughput: 0: 9680.6. Samples: 534185656. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:28,989][27935] Avg episode reward: [(0, '-3.921')] [2022-07-13 09:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 267112448. Throughput: 0: 9681.6. Samples: 534244028. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:33,989][27935] Avg episode reward: [(0, '-3.458')] [2022-07-13 09:59:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 267137024. Throughput: 0: 9675.2. Samples: 534273336. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:38,989][27935] Avg episode reward: [(0, '-3.071')] [2022-07-13 09:59:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 267160576. Throughput: 0: 9680.6. Samples: 534331932. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:43,989][27935] Avg episode reward: [(0, '-2.818')] [2022-07-13 09:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 267185152. Throughput: 0: 9765.3. Samples: 534390556. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:48,990][27935] Avg episode reward: [(0, '-3.219')] [2022-07-13 09:59:53,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 267208704. Throughput: 0: 9758.0. Samples: 534419616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:53,989][27935] Avg episode reward: [(0, '-3.100')] [2022-07-13 09:59:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 267235328. Throughput: 0: 9756.0. Samples: 534478216. Policy #0 lag: (min: 0.0, avg: 8.4, max: 21.0) [2022-07-13 09:59:58,989][27935] Avg episode reward: [(0, '-2.362')] [2022-07-13 10:00:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 267256832. Throughput: 0: 9672.4. Samples: 534532916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:03,990][27935] Avg episode reward: [(0, '-1.552')] [2022-07-13 10:00:08,992][27935] Fps is (10 sec: 4606.3, 60 sec: 4846.6, 300 sec: 4852.7). Total num frames: 267281408. Throughput: 0: 9674.7. Samples: 534562172. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:08,993][27935] Avg episode reward: [(0, '-1.813')] [2022-07-13 10:00:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 267305984. Throughput: 0: 9675.6. Samples: 534621060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:13,989][27935] Avg episode reward: [(0, '-2.021')] [2022-07-13 10:00:18,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 267330560. Throughput: 0: 9672.9. Samples: 534679308. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:18,989][27935] Avg episode reward: [(0, '-1.963')] [2022-07-13 10:00:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 267354112. Throughput: 0: 9668.6. Samples: 534708424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:23,989][27935] Avg episode reward: [(0, '-1.938')] [2022-07-13 10:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 267378688. Throughput: 0: 9671.8. Samples: 534767160. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:28,989][27935] Avg episode reward: [(0, '-1.698')] [2022-07-13 10:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 267403264. Throughput: 0: 9661.8. Samples: 534825336. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:33,989][27935] Avg episode reward: [(0, '-1.772')] [2022-07-13 10:00:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 267426816. Throughput: 0: 9671.9. Samples: 534854852. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:38,989][27935] Avg episode reward: [(0, '-3.364')] [2022-07-13 10:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 267451392. Throughput: 0: 9669.3. Samples: 534913336. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:43,989][27935] Avg episode reward: [(0, '-4.341')] [2022-07-13 10:00:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 267478016. Throughput: 0: 9761.5. Samples: 534972184. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:48,989][27935] Avg episode reward: [(0, '-4.450')] [2022-07-13 10:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 267499520. Throughput: 0: 9769.6. Samples: 535001768. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:53,989][27935] Avg episode reward: [(0, '-4.135')] [2022-07-13 10:00:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 267525120. Throughput: 0: 9766.5. Samples: 535060552. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:00:58,989][27935] Avg episode reward: [(0, '-4.244')] [2022-07-13 10:01:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 267548672. Throughput: 0: 9684.9. Samples: 535115128. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:03,989][27935] Avg episode reward: [(0, '-4.192')] [2022-07-13 10:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.2, 300 sec: 4856.2). Total num frames: 267572224. Throughput: 0: 9689.0. Samples: 535144428. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:08,989][27935] Avg episode reward: [(0, '-3.338')] [2022-07-13 10:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 267597824. Throughput: 0: 9693.7. Samples: 535203376. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:13,989][27935] Avg episode reward: [(0, '-3.021')] [2022-07-13 10:01:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 267620352. Throughput: 0: 9698.4. Samples: 535261764. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:18,989][27935] Avg episode reward: [(0, '-2.211')] [2022-07-13 10:01:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 267644928. Throughput: 0: 9685.2. Samples: 535290688. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:23,989][27935] Avg episode reward: [(0, '-2.637')] [2022-07-13 10:01:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 267671552. Throughput: 0: 9694.8. Samples: 535349600. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:28,989][27935] Avg episode reward: [(0, '-2.487')] [2022-07-13 10:01:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 267693056. Throughput: 0: 9676.0. Samples: 535407604. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:33,989][27935] Avg episode reward: [(0, '-2.187')] [2022-07-13 10:01:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 267718656. Throughput: 0: 9670.7. Samples: 535436948. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:38,989][27935] Avg episode reward: [(0, '-2.089')] [2022-07-13 10:01:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 267743232. Throughput: 0: 9674.2. Samples: 535495892. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:43,990][27935] Avg episode reward: [(0, '-2.709')] [2022-07-13 10:01:48,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4812.6, 300 sec: 4845.7). Total num frames: 267766784. Throughput: 0: 9764.7. Samples: 535554568. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:48,994][27935] Avg episode reward: [(0, '-2.068')] [2022-07-13 10:01:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 267793408. Throughput: 0: 9763.7. Samples: 535583796. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:53,989][27935] Avg episode reward: [(0, '-1.078')] [2022-07-13 10:01:58,989][27935] Fps is (10 sec: 4916.7, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 267815936. Throughput: 0: 9729.9. Samples: 535641220. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:01:58,989][27935] Avg episode reward: [(0, '-1.045')] [2022-07-13 10:02:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 267837440. Throughput: 0: 9643.9. Samples: 535695740. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:02:03,990][27935] Avg episode reward: [(0, '-2.298')] [2022-07-13 10:02:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 267863040. Throughput: 0: 9655.8. Samples: 535725200. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:02:08,989][27935] Avg episode reward: [(0, '-2.300')] [2022-07-13 10:02:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 267885568. Throughput: 0: 9656.4. Samples: 535784140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:02:13,989][27935] Avg episode reward: [(0, '-2.102')] [2022-07-13 10:02:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 267912192. Throughput: 0: 9670.8. Samples: 535842788. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:02:18,989][27935] Avg episode reward: [(0, '-1.751')] [2022-07-13 10:02:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 267935744. Throughput: 0: 9668.8. Samples: 535872044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 10:02:23,989][27935] Avg episode reward: [(0, '-2.469')] [2022-07-13 10:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 267960320. Throughput: 0: 9652.3. Samples: 535930244. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:28,989][27935] Avg episode reward: [(0, '-2.628')] [2022-07-13 10:02:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 267983872. Throughput: 0: 9643.7. Samples: 535988504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:33,989][27935] Avg episode reward: [(0, '-3.040')] [2022-07-13 10:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 268008448. Throughput: 0: 9641.2. Samples: 536017652. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:38,989][27935] Avg episode reward: [(0, '-3.662')] [2022-07-13 10:02:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 268034048. Throughput: 0: 9662.4. Samples: 536076028. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:43,989][27935] Avg episode reward: [(0, '-3.685')] [2022-07-13 10:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.2, 300 sec: 4852.7). Total num frames: 268058624. Throughput: 0: 9753.6. Samples: 536134652. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:48,989][27935] Avg episode reward: [(0, '-4.132')] [2022-07-13 10:02:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 268082176. Throughput: 0: 9751.0. Samples: 536163996. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:53,989][27935] Avg episode reward: [(0, '-3.625')] [2022-07-13 10:02:58,996][27935] Fps is (10 sec: 4706.9, 60 sec: 4829.3, 300 sec: 4849.1). Total num frames: 268105728. Throughput: 0: 9732.9. Samples: 536222192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:02:58,997][27935] Avg episode reward: [(0, '-3.541')] [2022-07-13 10:03:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 268128256. Throughput: 0: 9646.8. Samples: 536276896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:03,989][27935] Avg episode reward: [(0, '-4.074')] [2022-07-13 10:03:08,989][27935] Fps is (10 sec: 4816.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 268153856. Throughput: 0: 9646.8. Samples: 536306148. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:08,989][27935] Avg episode reward: [(0, '-2.329')] [2022-07-13 10:03:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 268177408. Throughput: 0: 9663.2. Samples: 536365088. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:13,990][27935] Avg episode reward: [(0, '-1.852')] [2022-07-13 10:03:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 268201984. Throughput: 0: 9673.5. Samples: 536423812. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:18,989][27935] Avg episode reward: [(0, '-2.104')] [2022-07-13 10:03:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 268226560. Throughput: 0: 9681.1. Samples: 536453300. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:23,989][27935] Avg episode reward: [(0, '-2.349')] [2022-07-13 10:03:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 268251136. Throughput: 0: 9687.2. Samples: 536511952. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:28,991][27935] Avg episode reward: [(0, '-2.196')] [2022-07-13 10:03:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 268274688. Throughput: 0: 9684.7. Samples: 536570464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:33,990][27935] Avg episode reward: [(0, '-3.104')] [2022-07-13 10:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 268300288. Throughput: 0: 9685.1. Samples: 536599824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:38,992][27935] Avg episode reward: [(0, '-3.312')] [2022-07-13 10:03:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 268324864. Throughput: 0: 9698.3. Samples: 536658544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:43,990][27935] Avg episode reward: [(0, '-3.256')] [2022-07-13 10:03:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 268348416. Throughput: 0: 9788.3. Samples: 536717368. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:48,989][27935] Avg episode reward: [(0, '-2.885')] [2022-07-13 10:03:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 268372992. Throughput: 0: 9791.6. Samples: 536746772. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:53,989][27935] Avg episode reward: [(0, '-2.754')] [2022-07-13 10:03:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.7, 300 sec: 4859.7). Total num frames: 268398592. Throughput: 0: 9788.8. Samples: 536805584. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:03:58,989][27935] Avg episode reward: [(0, '-2.477')] [2022-07-13 10:04:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 268420096. Throughput: 0: 9705.3. Samples: 536860552. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:03,989][27935] Avg episode reward: [(0, '-2.569')] [2022-07-13 10:04:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 268445696. Throughput: 0: 9707.3. Samples: 536890128. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:08,989][27935] Avg episode reward: [(0, '-2.815')] [2022-07-13 10:04:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 268469248. Throughput: 0: 9710.7. Samples: 536948932. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:13,989][27935] Avg episode reward: [(0, '-2.424')] [2022-07-13 10:04:18,993][27935] Fps is (10 sec: 4810.7, 60 sec: 4863.7, 300 sec: 4845.7). Total num frames: 268493824. Throughput: 0: 9712.4. Samples: 537007564. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:18,994][27935] Avg episode reward: [(0, '-2.770')] [2022-07-13 10:04:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 268518400. Throughput: 0: 9712.1. Samples: 537036868. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:23,989][27935] Avg episode reward: [(0, '-2.601')] [2022-07-13 10:04:28,989][27935] Fps is (10 sec: 4814.9, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 268541952. Throughput: 0: 9706.4. Samples: 537095332. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:28,989][27935] Avg episode reward: [(0, '-2.774')] [2022-07-13 10:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 268567552. Throughput: 0: 9686.8. Samples: 537153272. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:33,989][27935] Avg episode reward: [(0, '-3.338')] [2022-07-13 10:04:38,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4846.6, 300 sec: 4849.2). Total num frames: 268591104. Throughput: 0: 9689.1. Samples: 537182816. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:38,993][27935] Avg episode reward: [(0, '-3.068')] [2022-07-13 10:04:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 268615680. Throughput: 0: 9684.0. Samples: 537241364. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 10:04:43,989][27935] Avg episode reward: [(0, '-4.830')] [2022-07-13 10:04:48,989][27935] Fps is (10 sec: 4916.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 268640256. Throughput: 0: 9765.8. Samples: 537300016. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:04:48,990][27935] Avg episode reward: [(0, '-5.496')] [2022-07-13 10:04:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 268664832. Throughput: 0: 9765.6. Samples: 537329580. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:04:53,989][27935] Avg episode reward: [(0, '-4.980')] [2022-07-13 10:04:58,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 268688384. Throughput: 0: 9745.3. Samples: 537387468. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:04:58,989][27935] Avg episode reward: [(0, '-6.770')] [2022-07-13 10:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.3). Total num frames: 268711936. Throughput: 0: 9659.8. Samples: 537442212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:03,989][27935] Avg episode reward: [(0, '-6.633')] [2022-07-13 10:05:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 268735488. Throughput: 0: 9662.9. Samples: 537471700. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:08,989][27935] Avg episode reward: [(0, '-5.730')] [2022-07-13 10:05:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 268760064. Throughput: 0: 9670.8. Samples: 537530520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:13,989][27935] Avg episode reward: [(0, '-4.429')] [2022-07-13 10:05:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.3, 300 sec: 4849.2). Total num frames: 268784640. Throughput: 0: 9694.9. Samples: 537589544. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:18,989][27935] Avg episode reward: [(0, '-2.980')] [2022-07-13 10:05:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 268810240. Throughput: 0: 9686.8. Samples: 537618688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:23,995][27935] Avg episode reward: [(0, '-2.952')] [2022-07-13 10:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 268833792. Throughput: 0: 9692.2. Samples: 537677512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:28,989][27935] Avg episode reward: [(0, '-3.585')] [2022-07-13 10:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 268858368. Throughput: 0: 9694.3. Samples: 537736256. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:33,989][27935] Avg episode reward: [(0, '-3.170')] [2022-07-13 10:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.2, 300 sec: 4849.2). Total num frames: 268881920. Throughput: 0: 9689.3. Samples: 537765600. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:38,989][27935] Avg episode reward: [(0, '-3.396')] [2022-07-13 10:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 268907520. Throughput: 0: 9711.2. Samples: 537824472. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:43,989][27935] Avg episode reward: [(0, '-3.851')] [2022-07-13 10:05:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.0, 300 sec: 4852.7). Total num frames: 268931072. Throughput: 0: 9802.6. Samples: 537883332. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:48,989][27935] Avg episode reward: [(0, '-4.301')] [2022-07-13 10:05:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 268955648. Throughput: 0: 9802.3. Samples: 537912804. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:53,989][27935] Avg episode reward: [(0, '-4.804')] [2022-07-13 10:05:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 268981248. Throughput: 0: 9799.2. Samples: 537971484. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:05:58,989][27935] Avg episode reward: [(0, '-4.774')] [2022-07-13 10:06:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269003776. Throughput: 0: 9701.3. Samples: 538026100. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:03,989][27935] Avg episode reward: [(0, '-3.029')] [2022-07-13 10:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 269027328. Throughput: 0: 9705.9. Samples: 538055452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:08,989][27935] Avg episode reward: [(0, '-3.408')] [2022-07-13 10:06:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269051904. Throughput: 0: 9705.4. Samples: 538114256. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:13,989][27935] Avg episode reward: [(0, '-3.877')] [2022-07-13 10:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 269078528. Throughput: 0: 9700.2. Samples: 538172764. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:18,990][27935] Avg episode reward: [(0, '-3.122')] [2022-07-13 10:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 269100032. Throughput: 0: 9691.4. Samples: 538201712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:23,989][27935] Avg episode reward: [(0, '-4.078')] [2022-07-13 10:06:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 269125632. Throughput: 0: 9695.6. Samples: 538260772. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:28,990][27935] Avg episode reward: [(0, '-3.663')] [2022-07-13 10:06:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 269149184. Throughput: 0: 9683.7. Samples: 538319100. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:33,990][27935] Avg episode reward: [(0, '-4.113')] [2022-07-13 10:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 269174784. Throughput: 0: 9690.6. Samples: 538348880. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:38,989][27935] Avg episode reward: [(0, '-4.955')] [2022-07-13 10:06:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 269199360. Throughput: 0: 9690.3. Samples: 538407548. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:43,989][27935] Avg episode reward: [(0, '-4.879')] [2022-07-13 10:06:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 269222912. Throughput: 0: 9779.6. Samples: 538466184. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:48,990][27935] Avg episode reward: [(0, '-3.436')] [2022-07-13 10:06:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269247488. Throughput: 0: 9782.6. Samples: 538495668. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:53,991][27935] Avg episode reward: [(0, '-4.360')] [2022-07-13 10:06:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 269272064. Throughput: 0: 9775.7. Samples: 538554164. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:06:58,989][27935] Avg episode reward: [(0, '-2.824')] [2022-07-13 10:07:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 269294592. Throughput: 0: 9689.1. Samples: 538608772. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:07:03,989][27935] Avg episode reward: [(0, '-3.221')] [2022-07-13 10:07:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 269319168. Throughput: 0: 9692.3. Samples: 538637868. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:08,989][27935] Avg episode reward: [(0, '-3.479')] [2022-07-13 10:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269343744. Throughput: 0: 9671.5. Samples: 538695988. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:13,989][27935] Avg episode reward: [(0, '-3.601')] [2022-07-13 10:07:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 269367296. Throughput: 0: 9675.9. Samples: 538754516. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:18,989][27935] Avg episode reward: [(0, '-3.450')] [2022-07-13 10:07:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 269390848. Throughput: 0: 9667.7. Samples: 538783928. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:23,989][27935] Avg episode reward: [(0, '-4.021')] [2022-07-13 10:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 269416448. Throughput: 0: 9664.0. Samples: 538842428. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:28,989][27935] Avg episode reward: [(0, '-2.724')] [2022-07-13 10:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 269441024. Throughput: 0: 9646.0. Samples: 538900256. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:33,989][27935] Avg episode reward: [(0, '-4.947')] [2022-07-13 10:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 269465600. Throughput: 0: 9645.9. Samples: 538929732. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:38,990][27935] Avg episode reward: [(0, '-4.746')] [2022-07-13 10:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 269488128. Throughput: 0: 9636.5. Samples: 538987808. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:43,989][27935] Avg episode reward: [(0, '-3.420')] [2022-07-13 10:07:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 269512704. Throughput: 0: 9724.7. Samples: 539046384. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:48,991][27935] Avg episode reward: [(0, '-5.095')] [2022-07-13 10:07:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4859.8). Total num frames: 269539328. Throughput: 0: 9734.1. Samples: 539075900. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:53,989][27935] Avg episode reward: [(0, '-4.684')] [2022-07-13 10:07:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 269562880. Throughput: 0: 9740.3. Samples: 539134300. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:07:58,989][27935] Avg episode reward: [(0, '-4.663')] [2022-07-13 10:08:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 269584384. Throughput: 0: 9621.7. Samples: 539187492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:03,989][27935] Avg episode reward: [(0, '-4.970')] [2022-07-13 10:08:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 269607936. Throughput: 0: 9614.6. Samples: 539216584. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:08,989][27935] Avg episode reward: [(0, '-2.715')] [2022-07-13 10:08:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 269631488. Throughput: 0: 9628.1. Samples: 539275692. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:13,989][27935] Avg episode reward: [(0, '-3.150')] [2022-07-13 10:08:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 269659136. Throughput: 0: 9645.0. Samples: 539334280. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:18,989][27935] Avg episode reward: [(0, '-4.562')] [2022-07-13 10:08:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 269681664. Throughput: 0: 9642.6. Samples: 539363648. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:23,989][27935] Avg episode reward: [(0, '-3.098')] [2022-07-13 10:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 269707264. Throughput: 0: 9646.0. Samples: 539421880. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:28,989][27935] Avg episode reward: [(0, '-2.905')] [2022-07-13 10:08:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 269729792. Throughput: 0: 9639.9. Samples: 539480180. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:33,989][27935] Avg episode reward: [(0, '-4.507')] [2022-07-13 10:08:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 269754368. Throughput: 0: 9632.1. Samples: 539509344. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:38,989][27935] Avg episode reward: [(0, '-4.234')] [2022-07-13 10:08:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269779968. Throughput: 0: 9641.6. Samples: 539568172. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:43,989][27935] Avg episode reward: [(0, '-4.128')] [2022-07-13 10:08:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 269804544. Throughput: 0: 9764.4. Samples: 539626888. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:48,989][27935] Avg episode reward: [(0, '-2.388')] [2022-07-13 10:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 269829120. Throughput: 0: 9772.4. Samples: 539656340. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:53,990][27935] Avg episode reward: [(0, '-2.223')] [2022-07-13 10:08:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 269851648. Throughput: 0: 9766.8. Samples: 539715200. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:08:58,989][27935] Avg episode reward: [(0, '-2.576')] [2022-07-13 10:09:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 269874176. Throughput: 0: 9671.6. Samples: 539769500. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:03,989][27935] Avg episode reward: [(0, '-4.427')] [2022-07-13 10:09:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 269900800. Throughput: 0: 9673.6. Samples: 539798960. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:08,989][27935] Avg episode reward: [(0, '-2.525')] [2022-07-13 10:09:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4852.8). Total num frames: 269925376. Throughput: 0: 9677.7. Samples: 539857376. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:13,989][27935] Avg episode reward: [(0, '-2.364')] [2022-07-13 10:09:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 269947904. Throughput: 0: 9670.6. Samples: 539915356. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:18,990][27935] Avg episode reward: [(0, '-2.904')] [2022-07-13 10:09:23,990][27935] Fps is (10 sec: 4709.7, 60 sec: 4846.8, 300 sec: 4849.2). Total num frames: 269972480. Throughput: 0: 9676.5. Samples: 539944804. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:23,991][27935] Avg episode reward: [(0, '-3.196')] [2022-07-13 10:09:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 269996032. Throughput: 0: 9677.0. Samples: 540003636. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:09:28,989][27935] Avg episode reward: [(0, '-3.356')] [2022-07-13 10:09:33,989][27935] Fps is (10 sec: 4813.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 270020608. Throughput: 0: 9667.0. Samples: 540061904. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:33,989][27935] Avg episode reward: [(0, '-2.063')] [2022-07-13 10:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 270045184. Throughput: 0: 9664.1. Samples: 540091224. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:38,999][27935] Avg episode reward: [(0, '-2.087')] [2022-07-13 10:09:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 270070784. Throughput: 0: 9659.8. Samples: 540149892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:43,989][27935] Avg episode reward: [(0, '-4.253')] [2022-07-13 10:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 270094336. Throughput: 0: 9750.8. Samples: 540208288. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:48,989][27935] Avg episode reward: [(0, '-4.881')] [2022-07-13 10:09:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 270118912. Throughput: 0: 9745.9. Samples: 540237528. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:53,989][27935] Avg episode reward: [(0, '-5.539')] [2022-07-13 10:09:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 270143488. Throughput: 0: 9741.3. Samples: 540295732. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:09:58,989][27935] Avg episode reward: [(0, '-4.244')] [2022-07-13 10:10:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 270166016. Throughput: 0: 9667.2. Samples: 540350380. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:03,990][27935] Avg episode reward: [(0, '-3.261')] [2022-07-13 10:10:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 270189568. Throughput: 0: 9667.6. Samples: 540379832. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:08,989][27935] Avg episode reward: [(0, '-2.310')] [2022-07-13 10:10:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 270214144. Throughput: 0: 9666.7. Samples: 540438640. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:13,989][27935] Avg episode reward: [(0, '-0.831')] [2022-07-13 10:10:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 270238720. Throughput: 0: 9666.1. Samples: 540496880. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:18,989][27935] Avg episode reward: [(0, '-0.099')] [2022-07-13 10:10:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4845.8). Total num frames: 270263296. Throughput: 0: 9672.2. Samples: 540526472. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:23,990][27935] Avg episode reward: [(0, '0.367')] [2022-07-13 10:10:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 270288896. Throughput: 0: 9675.4. Samples: 540585284. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:28,989][27935] Avg episode reward: [(0, '0.417')] [2022-07-13 10:10:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 270311424. Throughput: 0: 9673.2. Samples: 540643580. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:33,991][27935] Avg episode reward: [(0, '0.599')] [2022-07-13 10:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 270337024. Throughput: 0: 9667.7. Samples: 540672576. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:38,989][27935] Avg episode reward: [(0, '0.148')] [2022-07-13 10:10:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 270361600. Throughput: 0: 9680.9. Samples: 540731372. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:43,989][27935] Avg episode reward: [(0, '-2.095')] [2022-07-13 10:10:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 270385152. Throughput: 0: 9764.7. Samples: 540789792. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:48,989][27935] Avg episode reward: [(0, '-2.617')] [2022-07-13 10:10:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 270409728. Throughput: 0: 9762.5. Samples: 540819144. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:53,989][27935] Avg episode reward: [(0, '-3.378')] [2022-07-13 10:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 270434304. Throughput: 0: 9761.1. Samples: 540877888. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:10:58,990][27935] Avg episode reward: [(0, '-4.260')] [2022-07-13 10:11:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 270456832. Throughput: 0: 9677.3. Samples: 540932360. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:03,991][27935] Avg episode reward: [(0, '-4.855')] [2022-07-13 10:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 270481408. Throughput: 0: 9670.6. Samples: 540961648. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:08,991][27935] Avg episode reward: [(0, '-5.677')] [2022-07-13 10:11:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 270505984. Throughput: 0: 9671.6. Samples: 541020504. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:13,989][27935] Avg episode reward: [(0, '-6.721')] [2022-07-13 10:11:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 270530560. Throughput: 0: 9026.6. Samples: 541049776. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:18,989][27935] Avg episode reward: [(0, '-4.469')] [2022-07-13 10:11:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 270553088. Throughput: 0: 9678.8. Samples: 541108124. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:23,989][27935] Avg episode reward: [(0, '-4.326')] [2022-07-13 10:11:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 270577664. Throughput: 0: 9664.3. Samples: 541166264. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:28,989][27935] Avg episode reward: [(0, '-4.090')] [2022-07-13 10:11:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 270602240. Throughput: 0: 9656.7. Samples: 541224344. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:33,989][27935] Avg episode reward: [(0, '-2.407')] [2022-07-13 10:11:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 270627840. Throughput: 0: 9651.9. Samples: 541253480. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:38,989][27935] Avg episode reward: [(0, '-2.117')] [2022-07-13 10:11:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 270651392. Throughput: 0: 9646.9. Samples: 541312000. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:43,989][27935] Avg episode reward: [(0, '-1.418')] [2022-07-13 10:11:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 270674944. Throughput: 0: 9731.9. Samples: 541370296. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 10:11:48,989][27935] Avg episode reward: [(0, '-2.423')] [2022-07-13 10:11:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 270699520. Throughput: 0: 9736.5. Samples: 541399792. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:11:53,989][27935] Avg episode reward: [(0, '-2.524')] [2022-07-13 10:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 270724096. Throughput: 0: 9734.6. Samples: 541458560. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:11:58,989][27935] Avg episode reward: [(0, '-3.694')] [2022-07-13 10:12:03,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4829.7, 300 sec: 4838.8). Total num frames: 270746624. Throughput: 0: 10298.3. Samples: 541513220. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:03,993][27935] Avg episode reward: [(0, '-3.516')] [2022-07-13 10:12:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 270771200. Throughput: 0: 9648.2. Samples: 541542292. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:08,990][27935] Avg episode reward: [(0, '-4.109')] [2022-07-13 10:12:13,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 270795776. Throughput: 0: 9661.1. Samples: 541601012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:13,991][27935] Avg episode reward: [(0, '-5.155')] [2022-07-13 10:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 270820352. Throughput: 0: 9655.6. Samples: 541658848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:18,989][27935] Avg episode reward: [(0, '-4.450')] [2022-07-13 10:12:24,014][27935] Fps is (10 sec: 4698.5, 60 sec: 4827.8, 300 sec: 4834.9). Total num frames: 270842880. Throughput: 0: 9653.6. Samples: 541688136. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:24,015][27935] Avg episode reward: [(0, '-5.169')] [2022-07-13 10:12:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 270868480. Throughput: 0: 9653.7. Samples: 541746416. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:28,989][27935] Avg episode reward: [(0, '-4.625')] [2022-07-13 10:12:33,989][27935] Fps is (10 sec: 4927.7, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 270892032. Throughput: 0: 9644.7. Samples: 541804308. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:33,989][27935] Avg episode reward: [(0, '-4.823')] [2022-07-13 10:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 270916608. Throughput: 0: 9637.4. Samples: 541833476. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:38,989][27935] Avg episode reward: [(0, '-5.058')] [2022-07-13 10:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 270940160. Throughput: 0: 9619.8. Samples: 541891452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:43,989][27935] Avg episode reward: [(0, '-4.040')] [2022-07-13 10:12:49,000][27935] Fps is (10 sec: 4807.2, 60 sec: 4828.9, 300 sec: 4831.7). Total num frames: 270964736. Throughput: 0: 9698.7. Samples: 541949752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:49,001][27935] Avg episode reward: [(0, '-3.541')] [2022-07-13 10:12:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 270990336. Throughput: 0: 9705.4. Samples: 541979036. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:53,989][27935] Avg episode reward: [(0, '-4.591')] [2022-07-13 10:12:58,989][27935] Fps is (10 sec: 5023.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 271014912. Throughput: 0: 9704.4. Samples: 542037712. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:12:58,989][27935] Avg episode reward: [(0, '-4.076')] [2022-07-13 10:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4830.0, 300 sec: 4842.3). Total num frames: 271036416. Throughput: 0: 9626.3. Samples: 542092032. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:03,989][27935] Avg episode reward: [(0, '-3.402')] [2022-07-13 10:13:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 271060992. Throughput: 0: 9627.0. Samples: 542121108. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:08,989][27935] Avg episode reward: [(0, '-3.757')] [2022-07-13 10:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 271084544. Throughput: 0: 9625.0. Samples: 542179540. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:13,989][27935] Avg episode reward: [(0, '-2.880')] [2022-07-13 10:13:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 271108096. Throughput: 0: 9626.1. Samples: 542237484. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:18,989][27935] Avg episode reward: [(0, '-2.309')] [2022-07-13 10:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4831.9, 300 sec: 4831.9). Total num frames: 271132672. Throughput: 0: 9628.4. Samples: 542266756. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:23,989][27935] Avg episode reward: [(0, '-2.854')] [2022-07-13 10:13:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 271158272. Throughput: 0: 9639.5. Samples: 542325228. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:28,989][27935] Avg episode reward: [(0, '-1.932')] [2022-07-13 10:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 271181824. Throughput: 0: 9633.9. Samples: 542383168. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:33,989][27935] Avg episode reward: [(0, '-2.469')] [2022-07-13 10:13:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 271206400. Throughput: 0: 9625.0. Samples: 542412160. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:38,989][27935] Avg episode reward: [(0, '-1.898')] [2022-07-13 10:13:43,994][27935] Fps is (10 sec: 5014.8, 60 sec: 4863.6, 300 sec: 4838.7). Total num frames: 271232000. Throughput: 0: 9619.5. Samples: 542470644. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:43,995][27935] Avg episode reward: [(0, '-1.952')] [2022-07-13 10:13:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.8, 300 sec: 4831.9). Total num frames: 271254528. Throughput: 0: 9711.7. Samples: 542529060. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:48,989][27935] Avg episode reward: [(0, '-1.592')] [2022-07-13 10:13:53,989][27935] Fps is (10 sec: 4713.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 271279104. Throughput: 0: 9717.0. Samples: 542558372. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:53,989][27935] Avg episode reward: [(0, '-2.037')] [2022-07-13 10:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 271303680. Throughput: 0: 9719.2. Samples: 542616904. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:13:58,989][27935] Avg episode reward: [(0, '-2.466')] [2022-07-13 10:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271325184. Throughput: 0: 9627.1. Samples: 542670704. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:14:03,992][27935] Avg episode reward: [(0, '-2.467')] [2022-07-13 10:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271349760. Throughput: 0: 9595.2. Samples: 542698540. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:14:08,989][27935] Avg episode reward: [(0, '-2.250')] [2022-07-13 10:14:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 271373312. Throughput: 0: 9591.5. Samples: 542756844. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 10:14:13,989][27935] Avg episode reward: [(0, '-2.753')] [2022-07-13 10:14:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271396864. Throughput: 0: 9597.2. Samples: 542815040. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:18,989][27935] Avg episode reward: [(0, '-3.488')] [2022-07-13 10:14:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 271422464. Throughput: 0: 9602.3. Samples: 542844264. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:23,989][27935] Avg episode reward: [(0, '-3.682')] [2022-07-13 10:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 271446016. Throughput: 0: 9600.7. Samples: 542902624. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:28,989][27935] Avg episode reward: [(0, '-3.257')] [2022-07-13 10:14:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 271470592. Throughput: 0: 9595.4. Samples: 542960852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:33,989][27935] Avg episode reward: [(0, '-2.391')] [2022-07-13 10:14:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271495168. Throughput: 0: 9593.2. Samples: 542990068. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:38,989][27935] Avg episode reward: [(0, '-3.501')] [2022-07-13 10:14:43,990][27935] Fps is (10 sec: 4914.7, 60 sec: 4796.1, 300 sec: 4831.9). Total num frames: 271519744. Throughput: 0: 9587.0. Samples: 543048328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:43,990][27935] Avg episode reward: [(0, '-3.147')] [2022-07-13 10:14:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271543296. Throughput: 0: 9692.3. Samples: 543106856. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:48,989][27935] Avg episode reward: [(0, '-3.463')] [2022-07-13 10:14:53,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271567872. Throughput: 0: 9725.7. Samples: 543136196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:53,989][27935] Avg episode reward: [(0, '-2.731')] [2022-07-13 10:14:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 271592448. Throughput: 0: 9733.8. Samples: 543194864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:14:58,989][27935] Avg episode reward: [(0, '-2.588')] [2022-07-13 10:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 271614976. Throughput: 0: 9655.7. Samples: 543249548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:03,989][27935] Avg episode reward: [(0, '-2.923')] [2022-07-13 10:15:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 271639552. Throughput: 0: 9650.8. Samples: 543278548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:08,989][27935] Avg episode reward: [(0, '-2.518')] [2022-07-13 10:15:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 271664128. Throughput: 0: 9662.8. Samples: 543337448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:13,995][27935] Avg episode reward: [(0, '-3.200')] [2022-07-13 10:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 271687680. Throughput: 0: 9663.9. Samples: 543395728. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:18,989][27935] Avg episode reward: [(0, '-3.049')] [2022-07-13 10:15:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 271712256. Throughput: 0: 9664.7. Samples: 543424980. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:23,989][27935] Avg episode reward: [(0, '-3.147')] [2022-07-13 10:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 271736832. Throughput: 0: 9672.9. Samples: 543483596. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:28,989][27935] Avg episode reward: [(0, '-3.656')] [2022-07-13 10:15:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 271761408. Throughput: 0: 9664.8. Samples: 543541772. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:33,989][27935] Avg episode reward: [(0, '-4.469')] [2022-07-13 10:15:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 271784960. Throughput: 0: 9658.7. Samples: 543570836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:38,989][27935] Avg episode reward: [(0, '-3.881')] [2022-07-13 10:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.0, 300 sec: 4831.9). Total num frames: 271810560. Throughput: 0: 9651.5. Samples: 543629180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:43,989][27935] Avg episode reward: [(0, '-4.932')] [2022-07-13 10:15:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 271834112. Throughput: 0: 9082.0. Samples: 543658240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:48,989][27935] Avg episode reward: [(0, '-3.396')] [2022-07-13 10:15:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 271857664. Throughput: 0: 9728.8. Samples: 543716344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:53,989][27935] Avg episode reward: [(0, '-3.724')] [2022-07-13 10:15:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 271881216. Throughput: 0: 9715.4. Samples: 543774640. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:15:58,989][27935] Avg episode reward: [(0, '-2.925')] [2022-07-13 10:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 271903744. Throughput: 0: 9625.1. Samples: 543828856. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:03,989][27935] Avg episode reward: [(0, '-1.905')] [2022-07-13 10:16:08,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4829.3, 300 sec: 4824.8). Total num frames: 271929344. Throughput: 0: 9607.8. Samples: 543857404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:08,997][27935] Avg episode reward: [(0, '-1.904')] [2022-07-13 10:16:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 271953920. Throughput: 0: 9608.3. Samples: 543915968. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:13,989][27935] Avg episode reward: [(0, '-2.994')] [2022-07-13 10:16:18,989][27935] Fps is (10 sec: 4713.9, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 271976448. Throughput: 0: 9605.1. Samples: 543974000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:18,989][27935] Avg episode reward: [(0, '-3.172')] [2022-07-13 10:16:24,001][27935] Fps is (10 sec: 4704.8, 60 sec: 4811.8, 300 sec: 4824.8). Total num frames: 272001024. Throughput: 0: 9594.9. Samples: 544002720. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:24,001][27935] Avg episode reward: [(0, '-4.599')] [2022-07-13 10:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 272024576. Throughput: 0: 9590.6. Samples: 544060756. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:28,989][27935] Avg episode reward: [(0, '-4.413')] [2022-07-13 10:16:33,989][27935] Fps is (10 sec: 4818.5, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 272049152. Throughput: 0: 10223.8. Samples: 544118312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 10:16:33,989][27935] Avg episode reward: [(0, '-5.140')] [2022-07-13 10:16:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 272073728. Throughput: 0: 9579.8. Samples: 544147436. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:16:38,989][27935] Avg episode reward: [(0, '-5.901')] [2022-07-13 10:16:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 272097280. Throughput: 0: 9578.3. Samples: 544205664. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:16:43,989][27935] Avg episode reward: [(0, '-6.394')] [2022-07-13 10:16:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 272121856. Throughput: 0: 9655.6. Samples: 544263356. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:16:48,989][27935] Avg episode reward: [(0, '-4.657')] [2022-07-13 10:16:53,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4795.6, 300 sec: 4818.0). Total num frames: 272145408. Throughput: 0: 9671.7. Samples: 544292580. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:16:53,992][27935] Avg episode reward: [(0, '-3.909')] [2022-07-13 10:16:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 272172032. Throughput: 0: 9655.5. Samples: 544350464. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:16:58,989][27935] Avg episode reward: [(0, '-4.022')] [2022-07-13 10:17:03,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 272193536. Throughput: 0: 9566.0. Samples: 544404468. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:03,991][27935] Avg episode reward: [(0, '-3.954')] [2022-07-13 10:17:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4779.3, 300 sec: 4814.5). Total num frames: 272216064. Throughput: 0: 9566.2. Samples: 544433084. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:08,991][27935] Avg episode reward: [(0, '-3.818')] [2022-07-13 10:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 272241664. Throughput: 0: 9565.0. Samples: 544491180. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:13,989][27935] Avg episode reward: [(0, '-3.119')] [2022-07-13 10:17:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.4). Total num frames: 272264192. Throughput: 0: 9567.4. Samples: 544548844. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:18,989][27935] Avg episode reward: [(0, '-2.158')] [2022-07-13 10:17:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4779.6, 300 sec: 4811.1). Total num frames: 272287744. Throughput: 0: 9563.6. Samples: 544577800. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:23,989][27935] Avg episode reward: [(0, '-2.814')] [2022-07-13 10:17:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 272314368. Throughput: 0: 9560.6. Samples: 544635892. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:28,989][27935] Avg episode reward: [(0, '-3.014')] [2022-07-13 10:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 272336896. Throughput: 0: 9565.3. Samples: 544693796. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:33,989][27935] Avg episode reward: [(0, '-2.758')] [2022-07-13 10:17:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 272361472. Throughput: 0: 9566.7. Samples: 544723060. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:38,989][27935] Avg episode reward: [(0, '-2.313')] [2022-07-13 10:17:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.2). Total num frames: 272386048. Throughput: 0: 9561.0. Samples: 544780708. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:43,989][27935] Avg episode reward: [(0, '-1.265')] [2022-07-13 10:17:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 272409600. Throughput: 0: 9649.0. Samples: 544838672. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:48,989][27935] Avg episode reward: [(0, '-1.423')] [2022-07-13 10:17:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4807.6). Total num frames: 272433152. Throughput: 0: 9662.8. Samples: 544867908. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:53,989][27935] Avg episode reward: [(0, '-1.555')] [2022-07-13 10:17:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 272457728. Throughput: 0: 9667.0. Samples: 544926192. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:17:58,989][27935] Avg episode reward: [(0, '-1.515')] [2022-07-13 10:18:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 272481280. Throughput: 0: 9584.2. Samples: 544980132. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:03,989][27935] Avg episode reward: [(0, '-1.312')] [2022-07-13 10:18:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 272504832. Throughput: 0: 9584.7. Samples: 545009112. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:08,989][27935] Avg episode reward: [(0, '-1.426')] [2022-07-13 10:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 272529408. Throughput: 0: 9582.8. Samples: 545067116. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:13,989][27935] Avg episode reward: [(0, '-2.074')] [2022-07-13 10:18:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 272552960. Throughput: 0: 9581.9. Samples: 545124980. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:18,989][27935] Avg episode reward: [(0, '-2.455')] [2022-07-13 10:18:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 272577536. Throughput: 0: 9579.1. Samples: 545154120. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:23,989][27935] Avg episode reward: [(0, '-2.543')] [2022-07-13 10:18:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 272601088. Throughput: 0: 9587.4. Samples: 545212140. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:28,989][27935] Avg episode reward: [(0, '-3.523')] [2022-07-13 10:18:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 272624640. Throughput: 0: 9585.7. Samples: 545270028. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:33,989][27935] Avg episode reward: [(0, '-3.331')] [2022-07-13 10:18:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.2). Total num frames: 272649216. Throughput: 0: 9587.0. Samples: 545299324. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:38,989][27935] Avg episode reward: [(0, '-3.145')] [2022-07-13 10:18:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 272674816. Throughput: 0: 9584.2. Samples: 545357480. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:43,989][27935] Avg episode reward: [(0, '-2.380')] [2022-07-13 10:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 272698368. Throughput: 0: 9674.3. Samples: 545415476. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:48,989][27935] Avg episode reward: [(0, '-1.731')] [2022-07-13 10:18:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 272721920. Throughput: 0: 9683.8. Samples: 545444884. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:53,989][27935] Avg episode reward: [(0, '-1.458')] [2022-07-13 10:18:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 272747520. Throughput: 0: 9680.4. Samples: 545502732. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 10:18:58,989][27935] Avg episode reward: [(0, '-3.104')] [2022-07-13 10:19:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 272768000. Throughput: 0: 9612.6. Samples: 545557548. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:03,991][27935] Avg episode reward: [(0, '-2.970')] [2022-07-13 10:19:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 272792576. Throughput: 0: 9606.6. Samples: 545586420. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:08,990][27935] Avg episode reward: [(0, '-2.894')] [2022-07-13 10:19:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 272817152. Throughput: 0: 9612.0. Samples: 545644680. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:13,989][27935] Avg episode reward: [(0, '-3.678')] [2022-07-13 10:19:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 272841728. Throughput: 0: 9619.0. Samples: 545702884. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:18,991][27935] Avg episode reward: [(0, '-3.740')] [2022-07-13 10:19:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 272866304. Throughput: 0: 9614.1. Samples: 545731956. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:23,990][27935] Avg episode reward: [(0, '-3.786')] [2022-07-13 10:19:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 272890880. Throughput: 0: 9626.3. Samples: 545790664. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:28,989][27935] Avg episode reward: [(0, '-2.125')] [2022-07-13 10:19:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 272914432. Throughput: 0: 9624.7. Samples: 545848588. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:33,989][27935] Avg episode reward: [(0, '-1.479')] [2022-07-13 10:19:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 272939008. Throughput: 0: 9622.7. Samples: 545877908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:38,989][27935] Avg episode reward: [(0, '-1.396')] [2022-07-13 10:19:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 272962560. Throughput: 0: 9634.0. Samples: 545936264. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:43,989][27935] Avg episode reward: [(0, '-1.970')] [2022-07-13 10:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 272987136. Throughput: 0: 9707.9. Samples: 545994404. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:48,989][27935] Avg episode reward: [(0, '-1.015')] [2022-07-13 10:19:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 273011712. Throughput: 0: 9713.4. Samples: 546023524. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:53,989][27935] Avg episode reward: [(0, '-1.829')] [2022-07-13 10:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 273036288. Throughput: 0: 9703.5. Samples: 546081336. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:19:58,989][27935] Avg episode reward: [(0, '-1.809')] [2022-07-13 10:20:03,991][27935] Fps is (10 sec: 4606.9, 60 sec: 4829.7, 300 sec: 4807.6). Total num frames: 273057792. Throughput: 0: 9619.8. Samples: 546135796. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:03,992][27935] Avg episode reward: [(0, '-1.555')] [2022-07-13 10:20:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 273082368. Throughput: 0: 9612.8. Samples: 546164532. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:08,989][27935] Avg episode reward: [(0, '-1.497')] [2022-07-13 10:20:13,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 273105920. Throughput: 0: 9557.4. Samples: 546220748. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:13,989][27935] Avg episode reward: [(0, '-1.293')] [2022-07-13 10:20:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 273127424. Throughput: 0: 9569.2. Samples: 546279204. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:18,989][27935] Avg episode reward: [(0, '-2.625')] [2022-07-13 10:20:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 273155072. Throughput: 0: 9563.5. Samples: 546308264. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:23,989][27935] Avg episode reward: [(0, '-2.930')] [2022-07-13 10:20:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 273178624. Throughput: 0: 9561.6. Samples: 546366536. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:28,990][27935] Avg episode reward: [(0, '-2.888')] [2022-07-13 10:20:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 273203200. Throughput: 0: 9556.2. Samples: 546424432. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:33,990][27935] Avg episode reward: [(0, '-2.959')] [2022-07-13 10:20:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 273226752. Throughput: 0: 9558.7. Samples: 546453664. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:38,989][27935] Avg episode reward: [(0, '-3.454')] [2022-07-13 10:20:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 273249280. Throughput: 0: 9568.3. Samples: 546511908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:43,989][27935] Avg episode reward: [(0, '-4.290')] [2022-07-13 10:20:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 273274880. Throughput: 0: 9646.3. Samples: 546569856. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:48,989][27935] Avg episode reward: [(0, '-4.475')] [2022-07-13 10:20:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 273300480. Throughput: 0: 9646.9. Samples: 546598640. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:53,989][27935] Avg episode reward: [(0, '-4.169')] [2022-07-13 10:20:58,990][27935] Fps is (10 sec: 5017.2, 60 sec: 4812.7, 300 sec: 4818.0). Total num frames: 273325056. Throughput: 0: 9695.0. Samples: 546657032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:20:58,990][27935] Avg episode reward: [(0, '-4.910')] [2022-07-13 10:21:03,989][27935] Fps is (10 sec: 4505.4, 60 sec: 4795.9, 300 sec: 4800.8). Total num frames: 273345536. Throughput: 0: 9611.5. Samples: 546711724. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:21:03,990][27935] Avg episode reward: [(0, '-4.939')] [2022-07-13 10:21:08,989][27935] Fps is (10 sec: 4506.0, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 273370112. Throughput: 0: 9616.0. Samples: 546740984. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:21:08,989][27935] Avg episode reward: [(0, '-5.550')] [2022-07-13 10:21:13,989][27935] Fps is (10 sec: 4915.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 273394688. Throughput: 0: 9630.7. Samples: 546799916. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:21:13,990][27935] Avg episode reward: [(0, '-5.217')] [2022-07-13 10:21:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4811.3). Total num frames: 273420288. Throughput: 0: 9633.3. Samples: 546857928. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 10:21:18,991][27935] Avg episode reward: [(0, '-4.678')] [2022-07-13 10:21:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 273443840. Throughput: 0: 9623.6. Samples: 546886724. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:23,989][27935] Avg episode reward: [(0, '-3.017')] [2022-07-13 10:21:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 273467392. Throughput: 0: 9630.1. Samples: 546945264. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:28,989][27935] Avg episode reward: [(0, '-2.259')] [2022-07-13 10:21:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 273490944. Throughput: 0: 9620.3. Samples: 547002768. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:33,991][27935] Avg episode reward: [(0, '-2.345')] [2022-07-13 10:21:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 273516544. Throughput: 0: 9626.1. Samples: 547031816. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:38,989][27935] Avg episode reward: [(0, '-2.231')] [2022-07-13 10:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 273540096. Throughput: 0: 9622.2. Samples: 547090024. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:43,989][27935] Avg episode reward: [(0, '-2.461')] [2022-07-13 10:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 273564672. Throughput: 0: 9695.6. Samples: 547148024. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:48,989][27935] Avg episode reward: [(0, '-2.899')] [2022-07-13 10:21:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 273589248. Throughput: 0: 9694.0. Samples: 547177212. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:53,989][27935] Avg episode reward: [(0, '-3.937')] [2022-07-13 10:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.8, 300 sec: 4811.1). Total num frames: 273612800. Throughput: 0: 9684.3. Samples: 547235708. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:21:58,989][27935] Avg episode reward: [(0, '-3.781')] [2022-07-13 10:22:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 273635328. Throughput: 0: 9606.7. Samples: 547290228. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:03,989][27935] Avg episode reward: [(0, '-3.818')] [2022-07-13 10:22:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 273658880. Throughput: 0: 9613.2. Samples: 547319320. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:08,989][27935] Avg episode reward: [(0, '-4.041')] [2022-07-13 10:22:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 273684480. Throughput: 0: 9607.7. Samples: 547377612. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:13,989][27935] Avg episode reward: [(0, '-3.131')] [2022-07-13 10:22:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 273708032. Throughput: 0: 9616.0. Samples: 547435488. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:18,989][27935] Avg episode reward: [(0, '-2.696')] [2022-07-13 10:22:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 273731584. Throughput: 0: 9623.6. Samples: 547464876. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:23,990][27935] Avg episode reward: [(0, '-2.433')] [2022-07-13 10:22:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 273756160. Throughput: 0: 9626.2. Samples: 547523204. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:28,990][27935] Avg episode reward: [(0, '-2.138')] [2022-07-13 10:22:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 273780736. Throughput: 0: 9630.6. Samples: 547581400. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:33,989][27935] Avg episode reward: [(0, '-1.603')] [2022-07-13 10:22:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 273806336. Throughput: 0: 9635.6. Samples: 547610816. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:38,990][27935] Avg episode reward: [(0, '-0.943')] [2022-07-13 10:22:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 273828864. Throughput: 0: 9611.8. Samples: 547668240. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:43,990][27935] Avg episode reward: [(0, '-1.415')] [2022-07-13 10:22:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 273853440. Throughput: 0: 9700.1. Samples: 547726732. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:48,991][27935] Avg episode reward: [(0, '-3.573')] [2022-07-13 10:22:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 273876992. Throughput: 0: 9700.3. Samples: 547755832. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:53,990][27935] Avg episode reward: [(0, '-3.640')] [2022-07-13 10:22:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 273902592. Throughput: 0: 9705.1. Samples: 547814340. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:22:58,989][27935] Avg episode reward: [(0, '-2.863')] [2022-07-13 10:23:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 273926144. Throughput: 0: 9630.9. Samples: 547868880. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:03,991][27935] Avg episode reward: [(0, '-2.456')] [2022-07-13 10:23:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 273949696. Throughput: 0: 9628.0. Samples: 547898136. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:08,989][27935] Avg episode reward: [(0, '-2.397')] [2022-07-13 10:23:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 273973248. Throughput: 0: 9618.9. Samples: 547956056. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:13,989][27935] Avg episode reward: [(0, '-2.208')] [2022-07-13 10:23:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 273996800. Throughput: 0: 9612.3. Samples: 548013952. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:18,989][27935] Avg episode reward: [(0, '-0.415')] [2022-07-13 10:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 274021376. Throughput: 0: 9610.3. Samples: 548043280. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:23,989][27935] Avg episode reward: [(0, '-0.210')] [2022-07-13 10:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 274045952. Throughput: 0: 9620.0. Samples: 548101140. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:28,990][27935] Avg episode reward: [(0, '-0.189')] [2022-07-13 10:23:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274069504. Throughput: 0: 9608.4. Samples: 548159108. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:33,989][27935] Avg episode reward: [(0, '-0.600')] [2022-07-13 10:23:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274095104. Throughput: 0: 9607.7. Samples: 548188180. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:38,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 10:23:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 274116608. Throughput: 0: 9602.9. Samples: 548246472. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 10:23:43,989][27935] Avg episode reward: [(0, '-1.195')] [2022-07-13 10:23:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274142208. Throughput: 0: 9689.5. Samples: 548304908. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:23:48,989][27935] Avg episode reward: [(0, '-0.995')] [2022-07-13 10:23:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 274166784. Throughput: 0: 9684.2. Samples: 548333924. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:23:53,990][27935] Avg episode reward: [(0, '-1.221')] [2022-07-13 10:23:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 274191360. Throughput: 0: 9692.0. Samples: 548392196. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:23:58,989][27935] Avg episode reward: [(0, '-1.790')] [2022-07-13 10:24:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 274213888. Throughput: 0: 9616.2. Samples: 548446680. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:03,989][27935] Avg episode reward: [(0, '-2.211')] [2022-07-13 10:24:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 274238464. Throughput: 0: 9610.0. Samples: 548475732. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:08,990][27935] Avg episode reward: [(0, '-2.429')] [2022-07-13 10:24:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274262016. Throughput: 0: 9623.9. Samples: 548534216. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:13,990][27935] Avg episode reward: [(0, '-1.698')] [2022-07-13 10:24:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 274285568. Throughput: 0: 9632.4. Samples: 548592568. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:18,989][27935] Avg episode reward: [(0, '-1.801')] [2022-07-13 10:24:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 274312192. Throughput: 0: 9630.6. Samples: 548621556. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:23,989][27935] Avg episode reward: [(0, '-2.186')] [2022-07-13 10:24:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274334720. Throughput: 0: 9635.0. Samples: 548680048. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:28,989][27935] Avg episode reward: [(0, '-2.012')] [2022-07-13 10:24:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 274358272. Throughput: 0: 9633.6. Samples: 548738420. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:33,990][27935] Avg episode reward: [(0, '-2.076')] [2022-07-13 10:24:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 274381824. Throughput: 0: 9639.4. Samples: 548767696. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:38,989][27935] Avg episode reward: [(0, '-2.465')] [2022-07-13 10:24:43,992][27935] Fps is (10 sec: 5118.6, 60 sec: 4880.8, 300 sec: 4821.4). Total num frames: 274409472. Throughput: 0: 9644.0. Samples: 548826204. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:43,992][27935] Avg episode reward: [(0, '-2.668')] [2022-07-13 10:24:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 274433024. Throughput: 0: 9740.5. Samples: 548885004. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:48,989][27935] Avg episode reward: [(0, '-3.163')] [2022-07-13 10:24:53,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 274457600. Throughput: 0: 9750.0. Samples: 548914480. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:53,989][27935] Avg episode reward: [(0, '-2.771')] [2022-07-13 10:24:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 274481152. Throughput: 0: 9758.1. Samples: 548973332. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:24:58,989][27935] Avg episode reward: [(0, '-2.805')] [2022-07-13 10:25:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 274502656. Throughput: 0: 9682.7. Samples: 549028288. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:03,989][27935] Avg episode reward: [(0, '-2.501')] [2022-07-13 10:25:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 274529280. Throughput: 0: 9684.3. Samples: 549057348. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:08,991][27935] Avg episode reward: [(0, '-2.791')] [2022-07-13 10:25:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 274552832. Throughput: 0: 9694.5. Samples: 549116300. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:13,990][27935] Avg episode reward: [(0, '-2.405')] [2022-07-13 10:25:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4824.9). Total num frames: 274578432. Throughput: 0: 9692.0. Samples: 549174560. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:18,989][27935] Avg episode reward: [(0, '-1.528')] [2022-07-13 10:25:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 274600960. Throughput: 0: 9693.2. Samples: 549203892. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:23,989][27935] Avg episode reward: [(0, '-2.768')] [2022-07-13 10:25:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 274626560. Throughput: 0: 9700.2. Samples: 549262688. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:28,989][27935] Avg episode reward: [(0, '-3.644')] [2022-07-13 10:25:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 274650112. Throughput: 0: 9683.2. Samples: 549320748. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:33,989][27935] Avg episode reward: [(0, '-3.211')] [2022-07-13 10:25:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4835.4). Total num frames: 274675712. Throughput: 0: 9683.9. Samples: 549350256. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:38,989][27935] Avg episode reward: [(0, '-2.307')] [2022-07-13 10:25:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.1, 300 sec: 4828.4). Total num frames: 274699264. Throughput: 0: 9681.4. Samples: 549408996. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:43,991][27935] Avg episode reward: [(0, '-2.350')] [2022-07-13 10:25:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 274723840. Throughput: 0: 9765.4. Samples: 549467732. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:48,989][27935] Avg episode reward: [(0, '-2.008')] [2022-07-13 10:25:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4825.0). Total num frames: 274748416. Throughput: 0: 9769.4. Samples: 549496972. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:53,989][27935] Avg episode reward: [(0, '-1.946')] [2022-07-13 10:25:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 274772992. Throughput: 0: 9760.5. Samples: 549555524. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:25:58,989][27935] Avg episode reward: [(0, '-1.038')] [2022-07-13 10:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 274795520. Throughput: 0: 9679.1. Samples: 549610120. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:26:03,989][27935] Avg episode reward: [(0, '-0.154')] [2022-07-13 10:26:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 274820096. Throughput: 0: 9680.1. Samples: 549639496. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:08,989][27935] Avg episode reward: [(0, '-0.458')] [2022-07-13 10:26:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 274843648. Throughput: 0: 9644.9. Samples: 549696708. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:13,989][27935] Avg episode reward: [(0, '-0.992')] [2022-07-13 10:26:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 274867200. Throughput: 0: 9626.0. Samples: 549753920. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:18,990][27935] Avg episode reward: [(0, '-2.310')] [2022-07-13 10:26:23,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4829.6, 300 sec: 4824.9). Total num frames: 274890752. Throughput: 0: 9616.8. Samples: 549783044. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:23,993][27935] Avg episode reward: [(0, '-2.507')] [2022-07-13 10:26:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 274916352. Throughput: 0: 9607.3. Samples: 549841324. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:28,990][27935] Avg episode reward: [(0, '-3.100')] [2022-07-13 10:26:33,989][27935] Fps is (10 sec: 4916.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 274939904. Throughput: 0: 9592.6. Samples: 549899400. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:33,989][27935] Avg episode reward: [(0, '-3.261')] [2022-07-13 10:26:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 274964480. Throughput: 0: 9595.1. Samples: 549928752. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:38,989][27935] Avg episode reward: [(0, '-3.284')] [2022-07-13 10:26:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 274989056. Throughput: 0: 9595.2. Samples: 549987308. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:43,989][27935] Avg episode reward: [(0, '-2.809')] [2022-07-13 10:26:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 275013632. Throughput: 0: 9684.6. Samples: 550045928. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:48,989][27935] Avg episode reward: [(0, '-3.305')] [2022-07-13 10:26:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 275037184. Throughput: 0: 9683.8. Samples: 550075268. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:53,995][27935] Avg episode reward: [(0, '-2.987')] [2022-07-13 10:26:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 275061760. Throughput: 0: 9707.7. Samples: 550133556. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:26:58,989][27935] Avg episode reward: [(0, '-3.442')] [2022-07-13 10:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 275085312. Throughput: 0: 9649.4. Samples: 550188144. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:03,990][27935] Avg episode reward: [(0, '-4.088')] [2022-07-13 10:27:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 275108864. Throughput: 0: 9652.9. Samples: 550217392. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:08,989][27935] Avg episode reward: [(0, '-3.274')] [2022-07-13 10:27:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 275134464. Throughput: 0: 9670.9. Samples: 550276516. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:13,989][27935] Avg episode reward: [(0, '-3.546')] [2022-07-13 10:27:18,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 275159040. Throughput: 0: 9677.2. Samples: 550334876. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:18,989][27935] Avg episode reward: [(0, '-4.529')] [2022-07-13 10:27:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.3, 300 sec: 4835.4). Total num frames: 275182592. Throughput: 0: 9689.3. Samples: 550364772. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:23,989][27935] Avg episode reward: [(0, '-4.051')] [2022-07-13 10:27:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 275207168. Throughput: 0: 9690.0. Samples: 550423360. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:28,990][27935] Avg episode reward: [(0, '-3.736')] [2022-07-13 10:27:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 275230720. Throughput: 0: 9682.0. Samples: 550481620. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:33,989][27935] Avg episode reward: [(0, '-3.833')] [2022-07-13 10:27:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 275256320. Throughput: 0: 9684.0. Samples: 550511048. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:38,990][27935] Avg episode reward: [(0, '-2.920')] [2022-07-13 10:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 275278848. Throughput: 0: 9687.1. Samples: 550569476. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:43,989][27935] Avg episode reward: [(0, '-3.405')] [2022-07-13 10:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 275304448. Throughput: 0: 9786.6. Samples: 550628540. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:48,990][27935] Avg episode reward: [(0, '-3.312')] [2022-07-13 10:27:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 275330048. Throughput: 0: 9794.0. Samples: 550658124. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:53,989][27935] Avg episode reward: [(0, '-2.666')] [2022-07-13 10:27:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 275354624. Throughput: 0: 9790.5. Samples: 550717088. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:27:58,989][27935] Avg episode reward: [(0, '-2.398')] [2022-07-13 10:28:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 275376128. Throughput: 0: 9711.3. Samples: 550771884. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:03,989][27935] Avg episode reward: [(0, '-1.623')] [2022-07-13 10:28:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 275400704. Throughput: 0: 9699.1. Samples: 550801232. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:08,990][27935] Avg episode reward: [(0, '-3.607')] [2022-07-13 10:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 275425280. Throughput: 0: 9714.1. Samples: 550860496. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:13,989][27935] Avg episode reward: [(0, '-3.548')] [2022-07-13 10:28:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 275449856. Throughput: 0: 9079.6. Samples: 550890204. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:18,989][27935] Avg episode reward: [(0, '-2.840')] [2022-07-13 10:28:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 275474432. Throughput: 0: 9738.6. Samples: 550949284. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:23,989][27935] Avg episode reward: [(0, '-2.669')] [2022-07-13 10:28:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 275500032. Throughput: 0: 9757.0. Samples: 551008540. Policy #0 lag: (min: 0.0, avg: 7.4, max: 20.0) [2022-07-13 10:28:28,990][27935] Avg episode reward: [(0, '-2.073')] [2022-07-13 10:28:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 275523584. Throughput: 0: 9744.8. Samples: 551067056. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:33,989][27935] Avg episode reward: [(0, '-1.882')] [2022-07-13 10:28:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 275548160. Throughput: 0: 9743.6. Samples: 551096588. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:38,990][27935] Avg episode reward: [(0, '0.267')] [2022-07-13 10:28:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 275572736. Throughput: 0: 9755.2. Samples: 551156072. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:43,989][27935] Avg episode reward: [(0, '0.108')] [2022-07-13 10:28:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 275598336. Throughput: 0: 9840.4. Samples: 551214700. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:48,991][27935] Avg episode reward: [(0, '0.744')] [2022-07-13 10:28:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 275621888. Throughput: 0: 9842.8. Samples: 551244156. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:53,991][27935] Avg episode reward: [(0, '-0.406')] [2022-07-13 10:28:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 275645440. Throughput: 0: 9831.8. Samples: 551302928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:28:58,991][27935] Avg episode reward: [(0, '-0.855')] [2022-07-13 10:29:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 275667968. Throughput: 0: 10384.9. Samples: 551357524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:03,990][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 10:29:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 275693568. Throughput: 0: 9721.4. Samples: 551386748. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:08,989][27935] Avg episode reward: [(0, '-2.331')] [2022-07-13 10:29:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 275718144. Throughput: 0: 9706.8. Samples: 551445348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:13,989][27935] Avg episode reward: [(0, '-2.707')] [2022-07-13 10:29:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 275742720. Throughput: 0: 9693.3. Samples: 551503256. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:18,989][27935] Avg episode reward: [(0, '-2.749')] [2022-07-13 10:29:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 275765248. Throughput: 0: 9694.5. Samples: 551532840. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:23,990][27935] Avg episode reward: [(0, '-2.354')] [2022-07-13 10:29:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 275791872. Throughput: 0: 9673.6. Samples: 551591384. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:28,989][27935] Avg episode reward: [(0, '-1.997')] [2022-07-13 10:29:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 275814400. Throughput: 0: 9668.4. Samples: 551649776. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:33,989][27935] Avg episode reward: [(0, '-2.197')] [2022-07-13 10:29:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.3). Total num frames: 275840000. Throughput: 0: 9668.1. Samples: 551679220. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:38,989][27935] Avg episode reward: [(0, '-1.757')] [2022-07-13 10:29:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 275863552. Throughput: 0: 9679.6. Samples: 551738512. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:43,989][27935] Avg episode reward: [(0, '-1.516')] [2022-07-13 10:29:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 275890176. Throughput: 0: 9771.9. Samples: 551797260. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:48,991][27935] Avg episode reward: [(0, '-1.936')] [2022-07-13 10:29:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 275913728. Throughput: 0: 9774.2. Samples: 551826588. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:53,989][27935] Avg episode reward: [(0, '-1.873')] [2022-07-13 10:29:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 275937280. Throughput: 0: 9783.5. Samples: 551885604. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:29:58,989][27935] Avg episode reward: [(0, '-1.664')] [2022-07-13 10:30:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 275960832. Throughput: 0: 9151.0. Samples: 551915052. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:03,989][27935] Avg episode reward: [(0, '-1.323')] [2022-07-13 10:30:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 275984384. Throughput: 0: 9701.9. Samples: 551969424. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:08,990][27935] Avg episode reward: [(0, '-1.310')] [2022-07-13 10:30:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 276009984. Throughput: 0: 9718.2. Samples: 552028704. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:13,989][27935] Avg episode reward: [(0, '-1.143')] [2022-07-13 10:30:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 276034560. Throughput: 0: 9724.4. Samples: 552087376. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:18,989][27935] Avg episode reward: [(0, '-1.251')] [2022-07-13 10:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 276059136. Throughput: 0: 9734.2. Samples: 552117260. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:23,989][27935] Avg episode reward: [(0, '-0.502')] [2022-07-13 10:30:28,991][27935] Fps is (10 sec: 4811.5, 60 sec: 4846.7, 300 sec: 4856.1). Total num frames: 276082688. Throughput: 0: 9723.8. Samples: 552176108. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:28,992][27935] Avg episode reward: [(0, '-0.840')] [2022-07-13 10:30:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 276107264. Throughput: 0: 9710.1. Samples: 552234216. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:33,989][27935] Avg episode reward: [(0, '-1.780')] [2022-07-13 10:30:38,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 276130816. Throughput: 0: 9709.8. Samples: 552263528. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:38,989][27935] Avg episode reward: [(0, '-2.148')] [2022-07-13 10:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 276156416. Throughput: 0: 9702.0. Samples: 552322192. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:43,989][27935] Avg episode reward: [(0, '-1.953')] [2022-07-13 10:30:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 276179968. Throughput: 0: 10348.8. Samples: 552380748. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 10:30:48,989][27935] Avg episode reward: [(0, '-2.302')] [2022-07-13 10:30:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 276204544. Throughput: 0: 9797.9. Samples: 552410332. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:30:53,989][27935] Avg episode reward: [(0, '-3.107')] [2022-07-13 10:30:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 276229120. Throughput: 0: 9776.9. Samples: 552468664. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:30:58,989][27935] Avg episode reward: [(0, '-3.731')] [2022-07-13 10:31:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 276252672. Throughput: 0: 9684.0. Samples: 552523156. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:03,989][27935] Avg episode reward: [(0, '-3.831')] [2022-07-13 10:31:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 276276224. Throughput: 0: 9668.5. Samples: 552552340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:08,990][27935] Avg episode reward: [(0, '-4.819')] [2022-07-13 10:31:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 276300800. Throughput: 0: 9653.8. Samples: 552610504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:13,990][27935] Avg episode reward: [(0, '-5.258')] [2022-07-13 10:31:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.2). Total num frames: 276325376. Throughput: 0: 9653.1. Samples: 552668604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:18,990][27935] Avg episode reward: [(0, '-4.867')] [2022-07-13 10:31:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 276347904. Throughput: 0: 9645.1. Samples: 552697560. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:23,989][27935] Avg episode reward: [(0, '-4.561')] [2022-07-13 10:31:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.1, 300 sec: 4856.2). Total num frames: 276372480. Throughput: 0: 9642.0. Samples: 552756080. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:28,989][27935] Avg episode reward: [(0, '-4.525')] [2022-07-13 10:31:33,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 276398080. Throughput: 0: 9628.7. Samples: 552814040. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:33,989][27935] Avg episode reward: [(0, '-4.562')] [2022-07-13 10:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 276421632. Throughput: 0: 9613.4. Samples: 552842936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:38,991][27935] Avg episode reward: [(0, '-3.399')] [2022-07-13 10:31:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 276446208. Throughput: 0: 9617.8. Samples: 552901464. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:43,989][27935] Avg episode reward: [(0, '-2.646')] [2022-07-13 10:31:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 276469760. Throughput: 0: 9049.4. Samples: 552930380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:48,989][27935] Avg episode reward: [(0, '-2.154')] [2022-07-13 10:31:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 276494336. Throughput: 0: 9695.0. Samples: 552988616. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:53,989][27935] Avg episode reward: [(0, '-3.546')] [2022-07-13 10:31:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 276517888. Throughput: 0: 9704.1. Samples: 553047188. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:31:58,991][27935] Avg episode reward: [(0, '-4.891')] [2022-07-13 10:32:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 276541440. Throughput: 0: 9626.8. Samples: 553101808. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:03,991][27935] Avg episode reward: [(0, '-4.337')] [2022-07-13 10:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 276566016. Throughput: 0: 9629.5. Samples: 553130888. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:08,990][27935] Avg episode reward: [(0, '-3.869')] [2022-07-13 10:32:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 276589568. Throughput: 0: 9638.1. Samples: 553189796. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:13,989][27935] Avg episode reward: [(0, '-5.079')] [2022-07-13 10:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 276614144. Throughput: 0: 8982.7. Samples: 553218264. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:18,989][27935] Avg episode reward: [(0, '-5.251')] [2022-07-13 10:32:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 276637696. Throughput: 0: 9608.3. Samples: 553275308. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:23,990][27935] Avg episode reward: [(0, '-4.203')] [2022-07-13 10:32:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 276661248. Throughput: 0: 9616.8. Samples: 553334220. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:28,989][27935] Avg episode reward: [(0, '-5.038')] [2022-07-13 10:32:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 276686848. Throughput: 0: 10271.3. Samples: 553392588. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:33,990][27935] Avg episode reward: [(0, '-5.183')] [2022-07-13 10:32:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 276710400. Throughput: 0: 9629.1. Samples: 553421924. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:38,989][27935] Avg episode reward: [(0, '-6.444')] [2022-07-13 10:32:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 276733952. Throughput: 0: 9604.5. Samples: 553479388. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:43,989][27935] Avg episode reward: [(0, '-6.792')] [2022-07-13 10:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 276758528. Throughput: 0: 9690.2. Samples: 553537868. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:48,989][27935] Avg episode reward: [(0, '-6.527')] [2022-07-13 10:32:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 276783104. Throughput: 0: 9688.5. Samples: 553566872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:53,996][27935] Avg episode reward: [(0, '-5.109')] [2022-07-13 10:32:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 276808704. Throughput: 0: 9686.0. Samples: 553625668. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:32:58,989][27935] Avg episode reward: [(0, '-4.751')] [2022-07-13 10:33:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 276829184. Throughput: 0: 10269.7. Samples: 553680400. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:33:03,989][27935] Avg episode reward: [(0, '-4.182')] [2022-07-13 10:33:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 276855808. Throughput: 0: 9658.2. Samples: 553709928. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:33:08,989][27935] Avg episode reward: [(0, '-2.989')] [2022-07-13 10:33:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 276879360. Throughput: 0: 9651.5. Samples: 553768536. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:33:13,989][27935] Avg episode reward: [(0, '-2.439')] [2022-07-13 10:33:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 276903936. Throughput: 0: 9658.0. Samples: 553827200. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:18,989][27935] Avg episode reward: [(0, '-1.727')] [2022-07-13 10:33:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 276927488. Throughput: 0: 9662.4. Samples: 553856732. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:23,990][27935] Avg episode reward: [(0, '-1.583')] [2022-07-13 10:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 276953088. Throughput: 0: 9678.6. Samples: 553914924. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:28,990][27935] Avg episode reward: [(0, '-2.210')] [2022-07-13 10:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 276976640. Throughput: 0: 9680.4. Samples: 553973488. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:33,989][27935] Avg episode reward: [(0, '-3.067')] [2022-07-13 10:33:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 277001216. Throughput: 0: 9685.9. Samples: 554002736. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:38,989][27935] Avg episode reward: [(0, '-1.734')] [2022-07-13 10:33:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 277025792. Throughput: 0: 9684.5. Samples: 554061468. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:43,989][27935] Avg episode reward: [(0, '-2.500')] [2022-07-13 10:33:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 277050368. Throughput: 0: 9757.8. Samples: 554119500. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:48,989][27935] Avg episode reward: [(0, '-3.718')] [2022-07-13 10:33:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 277072896. Throughput: 0: 9754.6. Samples: 554148884. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:53,989][27935] Avg episode reward: [(0, '-4.951')] [2022-07-13 10:33:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 277101568. Throughput: 0: 9762.5. Samples: 554207848. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:33:58,989][27935] Avg episode reward: [(0, '-4.577')] [2022-07-13 10:34:03,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 277123072. Throughput: 0: 9673.2. Samples: 554262492. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:03,989][27935] Avg episode reward: [(0, '-4.673')] [2022-07-13 10:34:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 277145600. Throughput: 0: 9676.8. Samples: 554292188. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:08,989][27935] Avg episode reward: [(0, '-4.430')] [2022-07-13 10:34:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 277170176. Throughput: 0: 9687.6. Samples: 554350868. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:13,989][27935] Avg episode reward: [(0, '-5.056')] [2022-07-13 10:34:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 277194752. Throughput: 0: 9696.4. Samples: 554409824. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:18,989][27935] Avg episode reward: [(0, '-6.140')] [2022-07-13 10:34:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 277219328. Throughput: 0: 9701.8. Samples: 554439316. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:23,990][27935] Avg episode reward: [(0, '-5.812')] [2022-07-13 10:34:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 277243904. Throughput: 0: 9699.3. Samples: 554497936. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:28,989][27935] Avg episode reward: [(0, '-4.814')] [2022-07-13 10:34:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 277269504. Throughput: 0: 9696.5. Samples: 554555844. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:33,990][27935] Avg episode reward: [(0, '-5.710')] [2022-07-13 10:34:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 277292032. Throughput: 0: 9689.8. Samples: 554584924. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:38,990][27935] Avg episode reward: [(0, '-6.878')] [2022-07-13 10:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 277317632. Throughput: 0: 9671.6. Samples: 554643068. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:43,989][27935] Avg episode reward: [(0, '-5.130')] [2022-07-13 10:34:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 277340160. Throughput: 0: 9746.5. Samples: 554701084. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:48,991][27935] Avg episode reward: [(0, '-5.791')] [2022-07-13 10:34:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 277365760. Throughput: 0: 9730.3. Samples: 554730052. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:53,990][27935] Avg episode reward: [(0, '-5.801')] [2022-07-13 10:34:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 277389312. Throughput: 0: 9723.2. Samples: 554788412. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:34:58,989][27935] Avg episode reward: [(0, '-5.271')] [2022-07-13 10:35:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 277411840. Throughput: 0: 9622.7. Samples: 554842844. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:03,991][27935] Avg episode reward: [(0, '-5.399')] [2022-07-13 10:35:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 277436416. Throughput: 0: 9617.9. Samples: 554872120. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:08,989][27935] Avg episode reward: [(0, '-4.515')] [2022-07-13 10:35:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 277459968. Throughput: 0: 9608.0. Samples: 554930296. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:13,990][27935] Avg episode reward: [(0, '-3.093')] [2022-07-13 10:35:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 277484544. Throughput: 0: 9613.9. Samples: 554988472. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:18,989][27935] Avg episode reward: [(0, '-3.109')] [2022-07-13 10:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 277509120. Throughput: 0: 9621.5. Samples: 555017892. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:23,989][27935] Avg episode reward: [(0, '-2.368')] [2022-07-13 10:35:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 277532672. Throughput: 0: 9612.6. Samples: 555075636. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:28,989][27935] Avg episode reward: [(0, '-3.846')] [2022-07-13 10:35:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 277558272. Throughput: 0: 9610.7. Samples: 555133564. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 10:35:33,989][27935] Avg episode reward: [(0, '-3.891')] [2022-07-13 10:35:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 277581824. Throughput: 0: 9612.5. Samples: 555162616. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:35:38,989][27935] Avg episode reward: [(0, '-3.700')] [2022-07-13 10:35:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 277605376. Throughput: 0: 9611.6. Samples: 555220932. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:35:43,989][27935] Avg episode reward: [(0, '-3.608')] [2022-07-13 10:35:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 277629952. Throughput: 0: 9692.3. Samples: 555278996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:35:48,989][27935] Avg episode reward: [(0, '-3.241')] [2022-07-13 10:35:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 277654528. Throughput: 0: 9691.2. Samples: 555308224. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:35:53,989][27935] Avg episode reward: [(0, '-2.584')] [2022-07-13 10:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 277679104. Throughput: 0: 9688.1. Samples: 555366260. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:35:58,989][27935] Avg episode reward: [(0, '-2.125')] [2022-07-13 10:36:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 277700608. Throughput: 0: 9603.1. Samples: 555420612. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:03,991][27935] Avg episode reward: [(0, '-2.329')] [2022-07-13 10:36:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 277725184. Throughput: 0: 9598.5. Samples: 555449824. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:08,990][27935] Avg episode reward: [(0, '-3.180')] [2022-07-13 10:36:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 277747712. Throughput: 0: 9611.1. Samples: 555508136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:13,991][27935] Avg episode reward: [(0, '-3.465')] [2022-07-13 10:36:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 277774336. Throughput: 0: 9614.1. Samples: 555566200. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:18,989][27935] Avg episode reward: [(0, '-5.065')] [2022-07-13 10:36:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 277796864. Throughput: 0: 9610.3. Samples: 555595080. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:23,989][27935] Avg episode reward: [(0, '-5.818')] [2022-07-13 10:36:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 277822464. Throughput: 0: 9607.4. Samples: 555653264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:28,989][27935] Avg episode reward: [(0, '-5.216')] [2022-07-13 10:36:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 277846016. Throughput: 0: 9605.5. Samples: 555711244. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:33,989][27935] Avg episode reward: [(0, '-6.933')] [2022-07-13 10:36:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 277870592. Throughput: 0: 9600.9. Samples: 555740264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:38,990][27935] Avg episode reward: [(0, '-5.681')] [2022-07-13 10:36:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 277894144. Throughput: 0: 9605.4. Samples: 555798504. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:43,989][27935] Avg episode reward: [(0, '-5.400')] [2022-07-13 10:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 277918720. Throughput: 0: 9697.6. Samples: 555857004. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:48,989][27935] Avg episode reward: [(0, '-4.178')] [2022-07-13 10:36:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 277943296. Throughput: 0: 9696.7. Samples: 555886176. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:53,989][27935] Avg episode reward: [(0, '-3.841')] [2022-07-13 10:36:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 277968896. Throughput: 0: 9693.4. Samples: 555944336. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:36:58,989][27935] Avg episode reward: [(0, '-3.041')] [2022-07-13 10:37:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 277989376. Throughput: 0: 9610.6. Samples: 555998676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:03,989][27935] Avg episode reward: [(0, '-2.212')] [2022-07-13 10:37:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 278013952. Throughput: 0: 9616.3. Samples: 556027812. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:08,989][27935] Avg episode reward: [(0, '-0.843')] [2022-07-13 10:37:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 278037504. Throughput: 0: 9624.3. Samples: 556086360. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:13,989][27935] Avg episode reward: [(0, '-0.689')] [2022-07-13 10:37:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 278063104. Throughput: 0: 9625.6. Samples: 556144396. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:18,989][27935] Avg episode reward: [(0, '-1.570')] [2022-07-13 10:37:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 278087680. Throughput: 0: 9629.8. Samples: 556173604. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:23,989][27935] Avg episode reward: [(0, '-2.882')] [2022-07-13 10:37:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 278111232. Throughput: 0: 9626.9. Samples: 556231716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:28,989][27935] Avg episode reward: [(0, '-3.324')] [2022-07-13 10:37:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 278134784. Throughput: 0: 9623.3. Samples: 556290052. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:33,989][27935] Avg episode reward: [(0, '-3.889')] [2022-07-13 10:37:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 278160384. Throughput: 0: 9627.8. Samples: 556319428. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:38,989][27935] Avg episode reward: [(0, '-3.854')] [2022-07-13 10:37:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 278183936. Throughput: 0: 9618.7. Samples: 556377176. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:43,990][27935] Avg episode reward: [(0, '-4.597')] [2022-07-13 10:37:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 278208512. Throughput: 0: 9718.8. Samples: 556436024. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:48,989][27935] Avg episode reward: [(0, '-4.243')] [2022-07-13 10:37:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 278232064. Throughput: 0: 9726.1. Samples: 556465488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:53,991][27935] Avg episode reward: [(0, '-3.274')] [2022-07-13 10:37:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 278257664. Throughput: 0: 9738.1. Samples: 556524572. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:37:58,989][27935] Avg episode reward: [(0, '-3.144')] [2022-07-13 10:38:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 278279168. Throughput: 0: 9668.1. Samples: 556579460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:03,989][27935] Avg episode reward: [(0, '-1.911')] [2022-07-13 10:38:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 278304768. Throughput: 0: 9672.3. Samples: 556608856. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:08,989][27935] Avg episode reward: [(0, '-2.210')] [2022-07-13 10:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 278329344. Throughput: 0: 9684.6. Samples: 556667524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:13,989][27935] Avg episode reward: [(0, '-2.150')] [2022-07-13 10:38:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 278353920. Throughput: 0: 9689.0. Samples: 556726056. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:18,990][27935] Avg episode reward: [(0, '-2.039')] [2022-07-13 10:38:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278377472. Throughput: 0: 9691.2. Samples: 556755532. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:23,989][27935] Avg episode reward: [(0, '-3.114')] [2022-07-13 10:38:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278401024. Throughput: 0: 9673.3. Samples: 556812476. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:28,989][27935] Avg episode reward: [(0, '-3.923')] [2022-07-13 10:38:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 278426624. Throughput: 0: 9660.9. Samples: 556870764. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:33,989][27935] Avg episode reward: [(0, '-3.083')] [2022-07-13 10:38:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 278451200. Throughput: 0: 9663.9. Samples: 556900364. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:38,989][27935] Avg episode reward: [(0, '-3.047')] [2022-07-13 10:38:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 278474752. Throughput: 0: 9650.3. Samples: 556958836. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:43,989][27935] Avg episode reward: [(0, '-3.408')] [2022-07-13 10:38:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 278500352. Throughput: 0: 9738.8. Samples: 557017704. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:48,989][27935] Avg episode reward: [(0, '-2.685')] [2022-07-13 10:38:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4821.5). Total num frames: 278523904. Throughput: 0: 9744.0. Samples: 557047336. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:53,989][27935] Avg episode reward: [(0, '-2.620')] [2022-07-13 10:38:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278547456. Throughput: 0: 9739.2. Samples: 557105788. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:38:58,989][27935] Avg episode reward: [(0, '-2.989')] [2022-07-13 10:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 278571008. Throughput: 0: 9651.9. Samples: 557160392. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:03,989][27935] Avg episode reward: [(0, '-3.034')] [2022-07-13 10:39:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 278595584. Throughput: 0: 9647.6. Samples: 557189672. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:08,989][27935] Avg episode reward: [(0, '-3.031')] [2022-07-13 10:39:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278619136. Throughput: 0: 9683.5. Samples: 557248236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:13,990][27935] Avg episode reward: [(0, '-3.525')] [2022-07-13 10:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278643712. Throughput: 0: 9698.8. Samples: 557307212. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:18,989][27935] Avg episode reward: [(0, '-4.598')] [2022-07-13 10:39:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 278669312. Throughput: 0: 9697.1. Samples: 557336732. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:23,989][27935] Avg episode reward: [(0, '-5.150')] [2022-07-13 10:39:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 278692864. Throughput: 0: 9709.5. Samples: 557395764. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:28,989][27935] Avg episode reward: [(0, '-4.569')] [2022-07-13 10:39:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 278717440. Throughput: 0: 9710.1. Samples: 557454660. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:33,989][27935] Avg episode reward: [(0, '-4.151')] [2022-07-13 10:39:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 278740992. Throughput: 0: 9704.2. Samples: 557484024. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:38,989][27935] Avg episode reward: [(0, '-4.517')] [2022-07-13 10:39:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 278767616. Throughput: 0: 9707.1. Samples: 557542608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:43,989][27935] Avg episode reward: [(0, '-4.320')] [2022-07-13 10:39:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 278790144. Throughput: 0: 9802.9. Samples: 557601524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:48,989][27935] Avg episode reward: [(0, '-3.483')] [2022-07-13 10:39:53,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4863.8, 300 sec: 4835.3). Total num frames: 278815744. Throughput: 0: 9809.3. Samples: 557631112. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:53,992][27935] Avg episode reward: [(0, '-2.158')] [2022-07-13 10:39:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 278840320. Throughput: 0: 9815.5. Samples: 557689932. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:39:58,990][27935] Avg episode reward: [(0, '-2.620')] [2022-07-13 10:40:03,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 278862848. Throughput: 0: 9719.1. Samples: 557744572. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:40:03,989][27935] Avg episode reward: [(0, '-1.973')] [2022-07-13 10:40:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 278886400. Throughput: 0: 9712.4. Samples: 557773792. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:40:08,989][27935] Avg episode reward: [(0, '-2.134')] [2022-07-13 10:40:13,992][27935] Fps is (10 sec: 4913.6, 60 sec: 4880.8, 300 sec: 4838.8). Total num frames: 278912000. Throughput: 0: 9706.1. Samples: 557832568. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:40:13,993][27935] Avg episode reward: [(0, '-2.159')] [2022-07-13 10:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 278935552. Throughput: 0: 9690.4. Samples: 557890728. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 10:40:18,989][27935] Avg episode reward: [(0, '-3.026')] [2022-07-13 10:40:23,989][27935] Fps is (10 sec: 4711.9, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 278959104. Throughput: 0: 9683.5. Samples: 557919780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:23,989][27935] Avg episode reward: [(0, '-2.488')] [2022-07-13 10:40:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 278984704. Throughput: 0: 9686.8. Samples: 557978516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:28,990][27935] Avg episode reward: [(0, '-2.480')] [2022-07-13 10:40:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 279008256. Throughput: 0: 9667.2. Samples: 558036548. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:33,989][27935] Avg episode reward: [(0, '-1.485')] [2022-07-13 10:40:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 279032832. Throughput: 0: 9655.1. Samples: 558065568. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:38,990][27935] Avg episode reward: [(0, '-2.972')] [2022-07-13 10:40:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 279057408. Throughput: 0: 9645.5. Samples: 558123980. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:43,990][27935] Avg episode reward: [(0, '-2.632')] [2022-07-13 10:40:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 279080960. Throughput: 0: 9726.2. Samples: 558182252. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:48,990][27935] Avg episode reward: [(0, '-3.302')] [2022-07-13 10:40:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4838.8). Total num frames: 279106560. Throughput: 0: 9726.7. Samples: 558211492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:53,989][27935] Avg episode reward: [(0, '-3.947')] [2022-07-13 10:40:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 279130112. Throughput: 0: 9718.0. Samples: 558269848. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:40:58,989][27935] Avg episode reward: [(0, '-4.357')] [2022-07-13 10:41:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 279152640. Throughput: 0: 9640.7. Samples: 558324560. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:03,989][27935] Avg episode reward: [(0, '-4.837')] [2022-07-13 10:41:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 279177216. Throughput: 0: 9642.1. Samples: 558353676. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:08,989][27935] Avg episode reward: [(0, '-4.754')] [2022-07-13 10:41:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.1, 300 sec: 4835.4). Total num frames: 279200768. Throughput: 0: 9633.6. Samples: 558412028. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:13,989][27935] Avg episode reward: [(0, '-4.801')] [2022-07-13 10:41:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 279225344. Throughput: 0: 9639.7. Samples: 558470336. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:18,989][27935] Avg episode reward: [(0, '-4.050')] [2022-07-13 10:41:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 279249920. Throughput: 0: 9635.6. Samples: 558499168. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:23,989][27935] Avg episode reward: [(0, '-3.439')] [2022-07-13 10:41:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 279274496. Throughput: 0: 9629.5. Samples: 558557308. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:28,989][27935] Avg episode reward: [(0, '-4.091')] [2022-07-13 10:41:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 279297024. Throughput: 0: 9617.6. Samples: 558615044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:33,989][27935] Avg episode reward: [(0, '-3.916')] [2022-07-13 10:41:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 279321600. Throughput: 0: 9618.4. Samples: 558644320. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:38,989][27935] Avg episode reward: [(0, '-2.680')] [2022-07-13 10:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 279346176. Throughput: 0: 9624.1. Samples: 558702932. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:43,989][27935] Avg episode reward: [(0, '-2.689')] [2022-07-13 10:41:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 279371776. Throughput: 0: 9703.7. Samples: 558761224. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:48,989][27935] Avg episode reward: [(0, '-2.676')] [2022-07-13 10:41:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 279395328. Throughput: 0: 9712.3. Samples: 558790728. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:53,989][27935] Avg episode reward: [(0, '-2.783')] [2022-07-13 10:41:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 279418880. Throughput: 0: 9714.7. Samples: 558849188. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:41:58,990][27935] Avg episode reward: [(0, '-2.895')] [2022-07-13 10:42:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 279442432. Throughput: 0: 9629.7. Samples: 558903672. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:03,991][27935] Avg episode reward: [(0, '-2.613')] [2022-07-13 10:42:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 279465984. Throughput: 0: 9639.1. Samples: 558932928. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:08,990][27935] Avg episode reward: [(0, '-1.914')] [2022-07-13 10:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 279490560. Throughput: 0: 9647.6. Samples: 558991452. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:13,989][27935] Avg episode reward: [(0, '-2.007')] [2022-07-13 10:42:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 279515136. Throughput: 0: 9658.1. Samples: 559049660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:18,989][27935] Avg episode reward: [(0, '-3.434')] [2022-07-13 10:42:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 279539712. Throughput: 0: 9658.1. Samples: 559078936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:23,991][27935] Avg episode reward: [(0, '-4.496')] [2022-07-13 10:42:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 279563264. Throughput: 0: 9651.9. Samples: 559137268. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:28,990][27935] Avg episode reward: [(0, '-3.569')] [2022-07-13 10:42:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 279587840. Throughput: 0: 9640.2. Samples: 559195032. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:33,989][27935] Avg episode reward: [(0, '-3.477')] [2022-07-13 10:42:38,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4829.8, 300 sec: 4838.8). Total num frames: 279611392. Throughput: 0: 9632.4. Samples: 559224196. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:38,991][27935] Avg episode reward: [(0, '-3.597')] [2022-07-13 10:42:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 279636992. Throughput: 0: 9622.0. Samples: 559282176. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:42:43,989][27935] Avg episode reward: [(0, '-4.123')] [2022-07-13 10:42:48,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 279660544. Throughput: 0: 9704.7. Samples: 559340384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:42:48,990][27935] Avg episode reward: [(0, '-3.492')] [2022-07-13 10:42:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 279684096. Throughput: 0: 9706.6. Samples: 559369724. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:42:53,989][27935] Avg episode reward: [(0, '-2.312')] [2022-07-13 10:42:58,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 279709696. Throughput: 0: 9708.3. Samples: 559428324. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:42:58,989][27935] Avg episode reward: [(0, '-1.254')] [2022-07-13 10:43:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 279732224. Throughput: 0: 9635.6. Samples: 559483260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:03,989][27935] Avg episode reward: [(0, '-2.614')] [2022-07-13 10:43:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 279756800. Throughput: 0: 9640.6. Samples: 559512764. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:08,990][27935] Avg episode reward: [(0, '-1.945')] [2022-07-13 10:43:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 279781376. Throughput: 0: 9644.7. Samples: 559571280. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:13,989][27935] Avg episode reward: [(0, '-2.116')] [2022-07-13 10:43:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 279803904. Throughput: 0: 9654.1. Samples: 559629464. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:18,989][27935] Avg episode reward: [(0, '-1.760')] [2022-07-13 10:43:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 279829504. Throughput: 0: 9663.2. Samples: 559659028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:23,990][27935] Avg episode reward: [(0, '-2.066')] [2022-07-13 10:43:28,993][27935] Fps is (10 sec: 5117.7, 60 sec: 4863.6, 300 sec: 4842.2). Total num frames: 279855104. Throughput: 0: 9677.7. Samples: 559717716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:28,994][27935] Avg episode reward: [(0, '-3.382')] [2022-07-13 10:43:33,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4829.6, 300 sec: 4835.3). Total num frames: 279877632. Throughput: 0: 9687.8. Samples: 559776368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:33,993][27935] Avg episode reward: [(0, '-4.488')] [2022-07-13 10:43:38,989][27935] Fps is (10 sec: 4814.9, 60 sec: 4864.1, 300 sec: 4842.3). Total num frames: 279903232. Throughput: 0: 9684.4. Samples: 559805524. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:38,989][27935] Avg episode reward: [(0, '-3.784')] [2022-07-13 10:43:43,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 279926784. Throughput: 0: 9689.1. Samples: 559864332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:43,989][27935] Avg episode reward: [(0, '-4.296')] [2022-07-13 10:43:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 279951360. Throughput: 0: 9771.1. Samples: 559922960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:48,991][27935] Avg episode reward: [(0, '-4.822')] [2022-07-13 10:43:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 279976960. Throughput: 0: 9776.7. Samples: 559952716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:53,991][27935] Avg episode reward: [(0, '-4.494')] [2022-07-13 10:43:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 280000512. Throughput: 0: 9772.3. Samples: 560011032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:43:58,990][27935] Avg episode reward: [(0, '-3.896')] [2022-07-13 10:44:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 280024064. Throughput: 0: 9691.5. Samples: 560065580. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:03,990][27935] Avg episode reward: [(0, '-3.619')] [2022-07-13 10:44:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 280047616. Throughput: 0: 9680.0. Samples: 560094628. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:08,989][27935] Avg episode reward: [(0, '-2.690')] [2022-07-13 10:44:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 280071168. Throughput: 0: 9674.8. Samples: 560153040. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:13,993][27935] Avg episode reward: [(0, '-1.869')] [2022-07-13 10:44:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 280094720. Throughput: 0: 9660.6. Samples: 560211060. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:18,989][27935] Avg episode reward: [(0, '-2.564')] [2022-07-13 10:44:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 280120320. Throughput: 0: 9654.4. Samples: 560239972. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:23,990][27935] Avg episode reward: [(0, '-3.443')] [2022-07-13 10:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.2, 300 sec: 4835.4). Total num frames: 280143872. Throughput: 0: 9650.9. Samples: 560298624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:28,990][27935] Avg episode reward: [(0, '-4.855')] [2022-07-13 10:44:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.1, 300 sec: 4835.4). Total num frames: 280167424. Throughput: 0: 9605.2. Samples: 560355192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:33,989][27935] Avg episode reward: [(0, '-3.230')] [2022-07-13 10:44:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 280192000. Throughput: 0: 9575.6. Samples: 560383616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:38,990][27935] Avg episode reward: [(0, '-4.356')] [2022-07-13 10:44:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 280215552. Throughput: 0: 9580.0. Samples: 560442132. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:43,990][27935] Avg episode reward: [(0, '-4.568')] [2022-07-13 10:44:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 280241152. Throughput: 0: 9666.7. Samples: 560500580. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:48,990][27935] Avg episode reward: [(0, '-5.646')] [2022-07-13 10:44:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 280264704. Throughput: 0: 9675.4. Samples: 560530020. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:53,990][27935] Avg episode reward: [(0, '-4.880')] [2022-07-13 10:44:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 280289280. Throughput: 0: 9684.3. Samples: 560588832. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:44:58,989][27935] Avg episode reward: [(0, '-4.389')] [2022-07-13 10:45:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 280311808. Throughput: 0: 9599.3. Samples: 560643028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:45:03,991][27935] Avg episode reward: [(0, '-3.945')] [2022-07-13 10:45:08,990][27935] Fps is (10 sec: 4607.6, 60 sec: 4795.7, 300 sec: 4825.0). Total num frames: 280335360. Throughput: 0: 9607.8. Samples: 560672332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 10:45:08,990][27935] Avg episode reward: [(0, '-3.601')] [2022-07-13 10:45:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 280359936. Throughput: 0: 9605.1. Samples: 560730852. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:13,989][27935] Avg episode reward: [(0, '-2.450')] [2022-07-13 10:45:18,989][27935] Fps is (10 sec: 5018.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 280385536. Throughput: 0: 9648.3. Samples: 560789364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:18,989][27935] Avg episode reward: [(0, '-2.504')] [2022-07-13 10:45:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 280409088. Throughput: 0: 9672.1. Samples: 560818860. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:23,989][27935] Avg episode reward: [(0, '-2.819')] [2022-07-13 10:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 280433664. Throughput: 0: 9681.1. Samples: 560877780. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:28,989][27935] Avg episode reward: [(0, '-2.980')] [2022-07-13 10:45:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 280457216. Throughput: 0: 9683.6. Samples: 560936344. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:33,989][27935] Avg episode reward: [(0, '-3.393')] [2022-07-13 10:45:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 280482816. Throughput: 0: 9676.6. Samples: 560965468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:38,989][27935] Avg episode reward: [(0, '-2.920')] [2022-07-13 10:45:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 280507392. Throughput: 0: 9684.2. Samples: 561024620. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:43,989][27935] Avg episode reward: [(0, '-3.617')] [2022-07-13 10:45:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 280532992. Throughput: 0: 9785.4. Samples: 561083372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:48,989][27935] Avg episode reward: [(0, '-3.472')] [2022-07-13 10:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 280556544. Throughput: 0: 9788.9. Samples: 561112824. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:53,989][27935] Avg episode reward: [(0, '-2.307')] [2022-07-13 10:45:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 280580096. Throughput: 0: 9798.9. Samples: 561171800. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:45:58,989][27935] Avg episode reward: [(0, '-3.217')] [2022-07-13 10:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 280603648. Throughput: 0: 9719.4. Samples: 561226736. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:03,989][27935] Avg episode reward: [(0, '-2.938')] [2022-07-13 10:46:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 280628224. Throughput: 0: 9714.3. Samples: 561256004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:08,989][27935] Avg episode reward: [(0, '-2.266')] [2022-07-13 10:46:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 280652800. Throughput: 0: 9713.8. Samples: 561314900. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:13,989][27935] Avg episode reward: [(0, '-1.481')] [2022-07-13 10:46:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 280676352. Throughput: 0: 9714.7. Samples: 561373504. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:18,989][27935] Avg episode reward: [(0, '-1.733')] [2022-07-13 10:46:23,991][27935] Fps is (10 sec: 4812.0, 60 sec: 4863.9, 300 sec: 4835.3). Total num frames: 280700928. Throughput: 0: 9709.2. Samples: 561402400. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:23,991][27935] Avg episode reward: [(0, '-2.112')] [2022-07-13 10:46:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 280726528. Throughput: 0: 9710.1. Samples: 561461576. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:28,989][27935] Avg episode reward: [(0, '-2.850')] [2022-07-13 10:46:33,989][27935] Fps is (10 sec: 4916.1, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 280750080. Throughput: 0: 9702.0. Samples: 561519960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:33,989][27935] Avg episode reward: [(0, '-1.927')] [2022-07-13 10:46:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 280774656. Throughput: 0: 9701.0. Samples: 561549368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:38,989][27935] Avg episode reward: [(0, '-1.915')] [2022-07-13 10:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 280799232. Throughput: 0: 9705.4. Samples: 561608544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:43,989][27935] Avg episode reward: [(0, '-3.079')] [2022-07-13 10:46:48,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 280823808. Throughput: 0: 9794.6. Samples: 561667500. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:48,990][27935] Avg episode reward: [(0, '-3.104')] [2022-07-13 10:46:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 280848384. Throughput: 0: 9802.5. Samples: 561697116. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:53,989][27935] Avg episode reward: [(0, '-2.868')] [2022-07-13 10:46:58,989][27935] Fps is (10 sec: 5017.9, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 280873984. Throughput: 0: 9814.9. Samples: 561756572. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:46:58,989][27935] Avg episode reward: [(0, '-2.951')] [2022-07-13 10:47:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 280896512. Throughput: 0: 9728.0. Samples: 561811264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:03,989][27935] Avg episode reward: [(0, '-4.244')] [2022-07-13 10:47:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 280920064. Throughput: 0: 9738.1. Samples: 561840596. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:08,991][27935] Avg episode reward: [(0, '-5.258')] [2022-07-13 10:47:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 280944640. Throughput: 0: 9731.8. Samples: 561899508. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:13,989][27935] Avg episode reward: [(0, '-5.934')] [2022-07-13 10:47:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 280969216. Throughput: 0: 9744.8. Samples: 561958476. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:18,989][27935] Avg episode reward: [(0, '-5.354')] [2022-07-13 10:47:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.1, 300 sec: 4845.8). Total num frames: 280992768. Throughput: 0: 9742.1. Samples: 561987764. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:23,990][27935] Avg episode reward: [(0, '-5.949')] [2022-07-13 10:47:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 281018368. Throughput: 0: 9742.0. Samples: 562046932. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 10:47:28,989][27935] Avg episode reward: [(0, '-5.177')] [2022-07-13 10:47:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 281042944. Throughput: 0: 9729.0. Samples: 562105300. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:33,991][27935] Avg episode reward: [(0, '-3.546')] [2022-07-13 10:47:38,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4881.0, 300 sec: 4849.2). Total num frames: 281067520. Throughput: 0: 9712.0. Samples: 562134160. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:38,990][27935] Avg episode reward: [(0, '-3.918')] [2022-07-13 10:47:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 281091072. Throughput: 0: 9678.8. Samples: 562192116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:43,993][27935] Avg episode reward: [(0, '-3.211')] [2022-07-13 10:47:48,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 281115648. Throughput: 0: 9775.4. Samples: 562251156. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:48,989][27935] Avg episode reward: [(0, '-3.044')] [2022-07-13 10:47:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 281140224. Throughput: 0: 9774.2. Samples: 562280436. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:53,989][27935] Avg episode reward: [(0, '-3.267')] [2022-07-13 10:47:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 281164800. Throughput: 0: 9763.8. Samples: 562338880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:47:58,989][27935] Avg episode reward: [(0, '-4.207')] [2022-07-13 10:48:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 281186304. Throughput: 0: 9670.6. Samples: 562393652. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:03,991][27935] Avg episode reward: [(0, '-3.642')] [2022-07-13 10:48:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 281211904. Throughput: 0: 9669.2. Samples: 562422880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:08,989][27935] Avg episode reward: [(0, '-4.286')] [2022-07-13 10:48:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 281235456. Throughput: 0: 9651.2. Samples: 562481236. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:13,989][27935] Avg episode reward: [(0, '-3.603')] [2022-07-13 10:48:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 281260032. Throughput: 0: 9661.9. Samples: 562540084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:18,990][27935] Avg episode reward: [(0, '-3.742')] [2022-07-13 10:48:23,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4863.7, 300 sec: 4845.8). Total num frames: 281284608. Throughput: 0: 9664.3. Samples: 562569084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:23,993][27935] Avg episode reward: [(0, '-4.464')] [2022-07-13 10:48:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.3). Total num frames: 281308160. Throughput: 0: 9687.3. Samples: 562628044. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:28,989][27935] Avg episode reward: [(0, '-3.199')] [2022-07-13 10:48:33,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 281333760. Throughput: 0: 9676.4. Samples: 562686596. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:33,989][27935] Avg episode reward: [(0, '-4.251')] [2022-07-13 10:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 281357312. Throughput: 0: 9684.4. Samples: 562716232. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:38,989][27935] Avg episode reward: [(0, '-3.126')] [2022-07-13 10:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 281382912. Throughput: 0: 9693.4. Samples: 562775084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:43,989][27935] Avg episode reward: [(0, '-3.858')] [2022-07-13 10:48:48,997][27935] Fps is (10 sec: 4911.4, 60 sec: 4846.3, 300 sec: 4845.6). Total num frames: 281406464. Throughput: 0: 9791.6. Samples: 562834352. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:48,997][27935] Avg episode reward: [(0, '-4.078')] [2022-07-13 10:48:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 281433088. Throughput: 0: 9796.4. Samples: 562863716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:53,989][27935] Avg episode reward: [(0, '-3.453')] [2022-07-13 10:48:58,989][27935] Fps is (10 sec: 4919.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 281455616. Throughput: 0: 9812.5. Samples: 562922796. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:48:58,989][27935] Avg episode reward: [(0, '-3.768')] [2022-07-13 10:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 281480192. Throughput: 0: 9731.6. Samples: 562978008. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:03,989][27935] Avg episode reward: [(0, '-4.696')] [2022-07-13 10:49:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 281502720. Throughput: 0: 9743.5. Samples: 563007508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:08,993][27935] Avg episode reward: [(0, '-4.681')] [2022-07-13 10:49:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 281527296. Throughput: 0: 9738.9. Samples: 563066296. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:13,989][27935] Avg episode reward: [(0, '-4.448')] [2022-07-13 10:49:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 281553920. Throughput: 0: 9752.2. Samples: 563125444. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:18,989][27935] Avg episode reward: [(0, '-6.079')] [2022-07-13 10:49:23,991][27935] Fps is (10 sec: 4914.0, 60 sec: 4864.1, 300 sec: 4856.2). Total num frames: 281576448. Throughput: 0: 9735.6. Samples: 563154356. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:23,992][27935] Avg episode reward: [(0, '-4.381')] [2022-07-13 10:49:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 281601024. Throughput: 0: 9724.2. Samples: 563212672. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:28,989][27935] Avg episode reward: [(0, '-4.403')] [2022-07-13 10:49:33,989][27935] Fps is (10 sec: 4916.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 281625600. Throughput: 0: 9697.9. Samples: 563270680. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:33,989][27935] Avg episode reward: [(0, '-2.892')] [2022-07-13 10:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 281650176. Throughput: 0: 9700.4. Samples: 563300236. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:38,990][27935] Avg episode reward: [(0, '-2.488')] [2022-07-13 10:49:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 281675776. Throughput: 0: 9684.1. Samples: 563358580. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:43,989][27935] Avg episode reward: [(0, '-2.035')] [2022-07-13 10:49:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.6, 300 sec: 4859.7). Total num frames: 281698304. Throughput: 0: 9770.0. Samples: 563417660. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:48,990][27935] Avg episode reward: [(0, '-1.187')] [2022-07-13 10:49:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 281722880. Throughput: 0: 9764.4. Samples: 563446908. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 10:49:53,990][27935] Avg episode reward: [(0, '-0.501')] [2022-07-13 10:49:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 281748480. Throughput: 0: 9763.2. Samples: 563505640. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:49:58,990][27935] Avg episode reward: [(0, '-0.540')] [2022-07-13 10:50:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 281771008. Throughput: 0: 9669.2. Samples: 563560556. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:03,992][27935] Avg episode reward: [(0, '-0.170')] [2022-07-13 10:50:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 281794560. Throughput: 0: 9670.3. Samples: 563589496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:08,989][27935] Avg episode reward: [(0, '-1.499')] [2022-07-13 10:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 281819136. Throughput: 0: 9683.5. Samples: 563648432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:13,989][27935] Avg episode reward: [(0, '-1.801')] [2022-07-13 10:50:18,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 281843712. Throughput: 0: 9698.9. Samples: 563707132. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:18,989][27935] Avg episode reward: [(0, '-0.800')] [2022-07-13 10:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.2, 300 sec: 4863.1). Total num frames: 281868288. Throughput: 0: 9693.8. Samples: 563736456. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:23,989][27935] Avg episode reward: [(0, '-1.698')] [2022-07-13 10:50:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 281891840. Throughput: 0: 9691.9. Samples: 563794716. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:28,990][27935] Avg episode reward: [(0, '-2.495')] [2022-07-13 10:50:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 281916416. Throughput: 0: 9663.6. Samples: 563852524. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:33,989][27935] Avg episode reward: [(0, '-2.728')] [2022-07-13 10:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 281939968. Throughput: 0: 9646.2. Samples: 563880988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:38,989][27935] Avg episode reward: [(0, '-2.008')] [2022-07-13 10:50:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 281964544. Throughput: 0: 9629.3. Samples: 563938956. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:43,989][27935] Avg episode reward: [(0, '-1.520')] [2022-07-13 10:50:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 281989120. Throughput: 0: 9708.5. Samples: 563997440. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:48,990][27935] Avg episode reward: [(0, '-2.260')] [2022-07-13 10:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 282014720. Throughput: 0: 9721.6. Samples: 564026964. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:53,990][27935] Avg episode reward: [(0, '-3.135')] [2022-07-13 10:50:58,990][27935] Fps is (10 sec: 4914.7, 60 sec: 4829.8, 300 sec: 4863.1). Total num frames: 282038272. Throughput: 0: 9705.9. Samples: 564085208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:50:58,990][27935] Avg episode reward: [(0, '-2.557')] [2022-07-13 10:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 282059776. Throughput: 0: 9618.5. Samples: 564139964. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:03,989][27935] Avg episode reward: [(0, '-2.381')] [2022-07-13 10:51:08,989][27935] Fps is (10 sec: 4506.1, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 282083328. Throughput: 0: 9616.9. Samples: 564169216. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:08,989][27935] Avg episode reward: [(0, '-2.125')] [2022-07-13 10:51:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 282109952. Throughput: 0: 9619.1. Samples: 564227576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:13,990][27935] Avg episode reward: [(0, '-1.861')] [2022-07-13 10:51:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 282133504. Throughput: 0: 9615.5. Samples: 564285220. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:18,989][27935] Avg episode reward: [(0, '-1.223')] [2022-07-13 10:51:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 282156032. Throughput: 0: 9628.3. Samples: 564314260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:23,990][27935] Avg episode reward: [(0, '-0.439')] [2022-07-13 10:51:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 282180608. Throughput: 0: 9628.7. Samples: 564372248. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:28,989][27935] Avg episode reward: [(0, '-0.345')] [2022-07-13 10:51:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 282205184. Throughput: 0: 9618.6. Samples: 564430276. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:33,989][27935] Avg episode reward: [(0, '0.459')] [2022-07-13 10:51:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 282231808. Throughput: 0: 9615.5. Samples: 564459660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:38,989][27935] Avg episode reward: [(0, '-0.253')] [2022-07-13 10:51:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.3). Total num frames: 282254336. Throughput: 0: 9620.0. Samples: 564518100. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:43,989][27935] Avg episode reward: [(0, '-1.349')] [2022-07-13 10:51:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 282277888. Throughput: 0: 9694.4. Samples: 564576212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:48,989][27935] Avg episode reward: [(0, '-1.620')] [2022-07-13 10:51:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 282302464. Throughput: 0: 9691.6. Samples: 564605336. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:53,989][27935] Avg episode reward: [(0, '-1.677')] [2022-07-13 10:51:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 282328064. Throughput: 0: 9702.9. Samples: 564664204. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:51:58,989][27935] Avg episode reward: [(0, '-2.284')] [2022-07-13 10:52:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 282350592. Throughput: 0: 9074.1. Samples: 564693556. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:52:03,991][27935] Avg episode reward: [(0, '-2.909')] [2022-07-13 10:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 282374144. Throughput: 0: 9645.1. Samples: 564748292. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:52:08,990][27935] Avg episode reward: [(0, '-4.654')] [2022-07-13 10:52:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 282397696. Throughput: 0: 9657.9. Samples: 564806852. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:52:13,989][27935] Avg episode reward: [(0, '-3.687')] [2022-07-13 10:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 282422272. Throughput: 0: 9662.0. Samples: 564865068. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 10:52:18,989][27935] Avg episode reward: [(0, '-3.732')] [2022-07-13 10:52:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 282447872. Throughput: 0: 9664.9. Samples: 564894580. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:23,989][27935] Avg episode reward: [(0, '-4.350')] [2022-07-13 10:52:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282471424. Throughput: 0: 9658.5. Samples: 564952732. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:28,989][27935] Avg episode reward: [(0, '-5.472')] [2022-07-13 10:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282496000. Throughput: 0: 9668.3. Samples: 565011284. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:33,990][27935] Avg episode reward: [(0, '-5.275')] [2022-07-13 10:52:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 282520576. Throughput: 0: 9674.7. Samples: 565040696. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:38,989][27935] Avg episode reward: [(0, '-4.926')] [2022-07-13 10:52:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 282545152. Throughput: 0: 9647.5. Samples: 565098340. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:43,990][27935] Avg episode reward: [(0, '-4.142')] [2022-07-13 10:52:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282568704. Throughput: 0: 10295.5. Samples: 565156852. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:48,990][27935] Avg episode reward: [(0, '-5.154')] [2022-07-13 10:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282593280. Throughput: 0: 9733.3. Samples: 565186288. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:53,990][27935] Avg episode reward: [(0, '-5.813')] [2022-07-13 10:52:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 282616832. Throughput: 0: 9732.9. Samples: 565244832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:52:58,989][27935] Avg episode reward: [(0, '-4.261')] [2022-07-13 10:53:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 282639360. Throughput: 0: 9657.4. Samples: 565299652. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:03,991][27935] Avg episode reward: [(0, '-5.951')] [2022-07-13 10:53:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 282664960. Throughput: 0: 9647.6. Samples: 565328724. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:08,989][27935] Avg episode reward: [(0, '-5.687')] [2022-07-13 10:53:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282688512. Throughput: 0: 9659.5. Samples: 565387412. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:13,989][27935] Avg episode reward: [(0, '-6.318')] [2022-07-13 10:53:18,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4863.8, 300 sec: 4845.8). Total num frames: 282714112. Throughput: 0: 9659.0. Samples: 565445960. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:18,991][27935] Avg episode reward: [(0, '-5.557')] [2022-07-13 10:53:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 282737664. Throughput: 0: 9662.9. Samples: 565475528. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:23,989][27935] Avg episode reward: [(0, '-5.089')] [2022-07-13 10:53:28,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282762240. Throughput: 0: 9686.5. Samples: 565534232. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:28,989][27935] Avg episode reward: [(0, '-4.671')] [2022-07-13 10:53:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 282786816. Throughput: 0: 9686.8. Samples: 565592760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:33,989][27935] Avg episode reward: [(0, '-5.264')] [2022-07-13 10:53:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 282811392. Throughput: 0: 9674.9. Samples: 565621656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:38,989][27935] Avg episode reward: [(0, '-2.522')] [2022-07-13 10:53:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.9). Total num frames: 282835968. Throughput: 0: 9676.0. Samples: 565680252. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:43,989][27935] Avg episode reward: [(0, '-2.978')] [2022-07-13 10:53:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 282860544. Throughput: 0: 9758.0. Samples: 565738760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:48,989][27935] Avg episode reward: [(0, '-2.538')] [2022-07-13 10:53:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 282883072. Throughput: 0: 9767.6. Samples: 565768268. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:53,991][27935] Avg episode reward: [(0, '-1.731')] [2022-07-13 10:53:58,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4863.9, 300 sec: 4842.3). Total num frames: 282908672. Throughput: 0: 9762.2. Samples: 565826728. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:53:58,991][27935] Avg episode reward: [(0, '-1.820')] [2022-07-13 10:54:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 282931200. Throughput: 0: 9655.1. Samples: 565880420. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:03,990][27935] Avg episode reward: [(0, '-1.630')] [2022-07-13 10:54:08,989][27935] Fps is (10 sec: 4506.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 282953728. Throughput: 0: 9637.4. Samples: 565909212. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:08,989][27935] Avg episode reward: [(0, '-1.454')] [2022-07-13 10:54:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 282979328. Throughput: 0: 9623.6. Samples: 565967296. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:13,989][27935] Avg episode reward: [(0, '-1.927')] [2022-07-13 10:54:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.0, 300 sec: 4835.4). Total num frames: 283002880. Throughput: 0: 9627.9. Samples: 566026016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:18,990][27935] Avg episode reward: [(0, '-2.339')] [2022-07-13 10:54:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 283027456. Throughput: 0: 9634.7. Samples: 566055220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:23,989][27935] Avg episode reward: [(0, '-2.696')] [2022-07-13 10:54:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 283051008. Throughput: 0: 9636.3. Samples: 566113884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:28,990][27935] Avg episode reward: [(0, '-2.794')] [2022-07-13 10:54:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 283077632. Throughput: 0: 9636.4. Samples: 566172400. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:33,991][27935] Avg episode reward: [(0, '-3.062')] [2022-07-13 10:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 283100160. Throughput: 0: 9635.4. Samples: 566201860. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:38,989][27935] Avg episode reward: [(0, '-1.923')] [2022-07-13 10:54:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 283126784. Throughput: 0: 9640.0. Samples: 566260512. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 10:54:43,989][27935] Avg episode reward: [(0, '-1.704')] [2022-07-13 10:54:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 283149312. Throughput: 0: 9758.0. Samples: 566319528. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:54:48,989][27935] Avg episode reward: [(0, '-2.421')] [2022-07-13 10:54:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 283173888. Throughput: 0: 9768.6. Samples: 566348800. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:54:53,989][27935] Avg episode reward: [(0, '-2.013')] [2022-07-13 10:54:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.1, 300 sec: 4842.3). Total num frames: 283199488. Throughput: 0: 9776.3. Samples: 566407228. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:54:58,989][27935] Avg episode reward: [(0, '-2.197')] [2022-07-13 10:55:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 283222016. Throughput: 0: 9691.4. Samples: 566462128. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:03,989][27935] Avg episode reward: [(0, '-2.911')] [2022-07-13 10:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 283245568. Throughput: 0: 9690.1. Samples: 566491276. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:08,990][27935] Avg episode reward: [(0, '-3.449')] [2022-07-13 10:55:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 283271168. Throughput: 0: 9691.5. Samples: 566550000. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:13,990][27935] Avg episode reward: [(0, '-4.129')] [2022-07-13 10:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 283293696. Throughput: 0: 9693.8. Samples: 566608624. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:18,989][27935] Avg episode reward: [(0, '-3.794')] [2022-07-13 10:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 283319296. Throughput: 0: 9690.8. Samples: 566637948. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:23,989][27935] Avg episode reward: [(0, '-4.983')] [2022-07-13 10:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 283342848. Throughput: 0: 9698.0. Samples: 566696924. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:28,989][27935] Avg episode reward: [(0, '-5.259')] [2022-07-13 10:55:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 283368448. Throughput: 0: 9673.4. Samples: 566754832. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:33,990][27935] Avg episode reward: [(0, '-5.616')] [2022-07-13 10:55:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 283393024. Throughput: 0: 9671.7. Samples: 566784028. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:38,989][27935] Avg episode reward: [(0, '-4.975')] [2022-07-13 10:55:43,992][27935] Fps is (10 sec: 4913.7, 60 sec: 4846.7, 300 sec: 4842.3). Total num frames: 283417600. Throughput: 0: 9680.9. Samples: 566842896. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:43,992][27935] Avg episode reward: [(0, '-4.635')] [2022-07-13 10:55:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 283439104. Throughput: 0: 9770.8. Samples: 566901812. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:48,992][27935] Avg episode reward: [(0, '-3.810')] [2022-07-13 10:55:53,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 283466752. Throughput: 0: 9774.4. Samples: 566931124. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:53,989][27935] Avg episode reward: [(0, '-4.163')] [2022-07-13 10:55:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 283490304. Throughput: 0: 9778.3. Samples: 566990024. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:55:58,989][27935] Avg episode reward: [(0, '-2.416')] [2022-07-13 10:56:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 283512832. Throughput: 0: 9696.7. Samples: 567044976. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:03,990][27935] Avg episode reward: [(0, '-0.856')] [2022-07-13 10:56:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 283536384. Throughput: 0: 9694.3. Samples: 567074192. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:08,989][27935] Avg episode reward: [(0, '-0.682')] [2022-07-13 10:56:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 283561984. Throughput: 0: 9697.5. Samples: 567133312. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:13,989][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 10:56:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 283585536. Throughput: 0: 9717.0. Samples: 567192096. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:18,989][27935] Avg episode reward: [(0, '-1.073')] [2022-07-13 10:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 283610112. Throughput: 0: 9712.2. Samples: 567221076. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:23,989][27935] Avg episode reward: [(0, '-1.687')] [2022-07-13 10:56:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 283635712. Throughput: 0: 9705.9. Samples: 567279632. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:28,990][27935] Avg episode reward: [(0, '-0.806')] [2022-07-13 10:56:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 283660288. Throughput: 0: 9686.8. Samples: 567337720. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:33,990][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 10:56:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 283682816. Throughput: 0: 9670.7. Samples: 567366304. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:38,989][27935] Avg episode reward: [(0, '-1.390')] [2022-07-13 10:56:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4813.0, 300 sec: 4842.3). Total num frames: 283706368. Throughput: 0: 9623.2. Samples: 567423068. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:43,989][27935] Avg episode reward: [(0, '-1.004')] [2022-07-13 10:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 283731968. Throughput: 0: 9699.3. Samples: 567481444. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:48,991][27935] Avg episode reward: [(0, '-0.581')] [2022-07-13 10:56:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 283754496. Throughput: 0: 9696.9. Samples: 567510552. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:53,990][27935] Avg episode reward: [(0, '-0.547')] [2022-07-13 10:56:58,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4846.8, 300 sec: 4849.2). Total num frames: 283781120. Throughput: 0: 9677.9. Samples: 567568836. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:56:58,991][27935] Avg episode reward: [(0, '-1.138')] [2022-07-13 10:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 283801600. Throughput: 0: 9586.6. Samples: 567623492. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 10:57:03,989][27935] Avg episode reward: [(0, '-0.981')] [2022-07-13 10:57:08,989][27935] Fps is (10 sec: 4608.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 283827200. Throughput: 0: 9587.8. Samples: 567652528. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:08,989][27935] Avg episode reward: [(0, '-1.150')] [2022-07-13 10:57:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 283850752. Throughput: 0: 9592.0. Samples: 567711272. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:13,989][27935] Avg episode reward: [(0, '-1.144')] [2022-07-13 10:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 283875328. Throughput: 0: 9601.5. Samples: 567769788. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:18,989][27935] Avg episode reward: [(0, '-1.441')] [2022-07-13 10:57:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 283898880. Throughput: 0: 9615.8. Samples: 567799016. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:23,989][27935] Avg episode reward: [(0, '-3.205')] [2022-07-13 10:57:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 283924480. Throughput: 0: 9643.3. Samples: 567857016. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:28,989][27935] Avg episode reward: [(0, '-2.114')] [2022-07-13 10:57:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 283948032. Throughput: 0: 9636.4. Samples: 567915080. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:33,990][27935] Avg episode reward: [(0, '-2.177')] [2022-07-13 10:57:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 283971584. Throughput: 0: 9634.7. Samples: 567944112. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:38,990][27935] Avg episode reward: [(0, '-2.047')] [2022-07-13 10:57:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 283996160. Throughput: 0: 9616.7. Samples: 568001568. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:43,990][27935] Avg episode reward: [(0, '-3.481')] [2022-07-13 10:57:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 284019712. Throughput: 0: 9699.3. Samples: 568059960. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:48,989][27935] Avg episode reward: [(0, '-3.612')] [2022-07-13 10:57:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 284044288. Throughput: 0: 9695.8. Samples: 568088836. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:53,989][27935] Avg episode reward: [(0, '-3.471')] [2022-07-13 10:57:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.8, 300 sec: 4842.3). Total num frames: 284067840. Throughput: 0: 9683.0. Samples: 568147008. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:57:58,989][27935] Avg episode reward: [(0, '-2.158')] [2022-07-13 10:58:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 284091392. Throughput: 0: 9592.7. Samples: 568201460. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:03,989][27935] Avg episode reward: [(0, '-2.445')] [2022-07-13 10:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 284114944. Throughput: 0: 9592.6. Samples: 568230684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:08,992][27935] Avg episode reward: [(0, '-2.307')] [2022-07-13 10:58:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 284139520. Throughput: 0: 9600.6. Samples: 568289044. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:13,989][27935] Avg episode reward: [(0, '-2.177')] [2022-07-13 10:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 284163072. Throughput: 0: 9594.7. Samples: 568346840. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:18,989][27935] Avg episode reward: [(0, '-2.458')] [2022-07-13 10:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 284187648. Throughput: 0: 9598.9. Samples: 568376064. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:23,989][27935] Avg episode reward: [(0, '-2.151')] [2022-07-13 10:58:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 284212224. Throughput: 0: 9621.6. Samples: 568434540. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:28,989][27935] Avg episode reward: [(0, '-2.161')] [2022-07-13 10:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 284235776. Throughput: 0: 9612.5. Samples: 568492524. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:33,989][27935] Avg episode reward: [(0, '-2.096')] [2022-07-13 10:58:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 284260352. Throughput: 0: 9611.1. Samples: 568521336. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:38,989][27935] Avg episode reward: [(0, '-2.099')] [2022-07-13 10:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 284284928. Throughput: 0: 9610.0. Samples: 568579460. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:43,989][27935] Avg episode reward: [(0, '-2.786')] [2022-07-13 10:58:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 284309504. Throughput: 0: 9705.1. Samples: 568638192. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:48,989][27935] Avg episode reward: [(0, '-3.383')] [2022-07-13 10:58:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 284334080. Throughput: 0: 9702.6. Samples: 568667300. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:53,990][27935] Avg episode reward: [(0, '-2.739')] [2022-07-13 10:58:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 284357632. Throughput: 0: 9695.3. Samples: 568725332. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:58:58,990][27935] Avg episode reward: [(0, '-2.364')] [2022-07-13 10:59:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 284380160. Throughput: 0: 9605.9. Samples: 568779104. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:03,989][27935] Avg episode reward: [(0, '-2.341')] [2022-07-13 10:59:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 284404736. Throughput: 0: 9601.2. Samples: 568808120. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:08,989][27935] Avg episode reward: [(0, '-2.265')] [2022-07-13 10:59:13,992][27935] Fps is (10 sec: 4709.0, 60 sec: 4795.5, 300 sec: 4828.4). Total num frames: 284427264. Throughput: 0: 9593.7. Samples: 568866284. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:13,992][27935] Avg episode reward: [(0, '-1.999')] [2022-07-13 10:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 284451840. Throughput: 0: 9595.9. Samples: 568924340. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:18,991][27935] Avg episode reward: [(0, '-1.175')] [2022-07-13 10:59:23,989][27935] Fps is (10 sec: 5019.1, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 284477440. Throughput: 0: 9607.0. Samples: 568953652. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:23,989][27935] Avg episode reward: [(0, '-0.812')] [2022-07-13 10:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 284500992. Throughput: 0: 9600.0. Samples: 569011460. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 10:59:28,991][27935] Avg episode reward: [(0, '-1.180')] [2022-07-13 10:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 284525568. Throughput: 0: 8934.3. Samples: 569040236. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:33,989][27935] Avg episode reward: [(0, '-2.281')] [2022-07-13 10:59:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 284548096. Throughput: 0: 9574.6. Samples: 569098156. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:38,991][27935] Avg episode reward: [(0, '-2.813')] [2022-07-13 10:59:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 284573696. Throughput: 0: 9575.4. Samples: 569156224. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:43,989][27935] Avg episode reward: [(0, '-2.412')] [2022-07-13 10:59:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 284597248. Throughput: 0: 9677.8. Samples: 569214604. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:48,989][27935] Avg episode reward: [(0, '-3.121')] [2022-07-13 10:59:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 284621824. Throughput: 0: 9677.5. Samples: 569243608. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:53,989][27935] Avg episode reward: [(0, '-3.156')] [2022-07-13 10:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 284646400. Throughput: 0: 9688.3. Samples: 569302228. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 10:59:58,989][27935] Avg episode reward: [(0, '-3.392')] [2022-07-13 11:00:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 284667904. Throughput: 0: 9606.5. Samples: 569356632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:03,989][27935] Avg episode reward: [(0, '-2.509')] [2022-07-13 11:00:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 284693504. Throughput: 0: 9611.3. Samples: 569386160. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:08,989][27935] Avg episode reward: [(0, '-1.509')] [2022-07-13 11:00:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.1, 300 sec: 4824.9). Total num frames: 284717056. Throughput: 0: 9628.9. Samples: 569444760. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:13,989][27935] Avg episode reward: [(0, '-2.314')] [2022-07-13 11:00:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 284741632. Throughput: 0: 10282.5. Samples: 569502948. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:18,989][27935] Avg episode reward: [(0, '-1.816')] [2022-07-13 11:00:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 284766208. Throughput: 0: 9639.7. Samples: 569531944. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:23,989][27935] Avg episode reward: [(0, '-1.226')] [2022-07-13 11:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 284789760. Throughput: 0: 9647.3. Samples: 569590352. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:28,989][27935] Avg episode reward: [(0, '-1.754')] [2022-07-13 11:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 284815360. Throughput: 0: 9634.2. Samples: 569648144. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:33,989][27935] Avg episode reward: [(0, '-1.870')] [2022-07-13 11:00:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.1). Total num frames: 284838912. Throughput: 0: 9641.0. Samples: 569677452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:38,990][27935] Avg episode reward: [(0, '-1.854')] [2022-07-13 11:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 284863488. Throughput: 0: 9637.2. Samples: 569735900. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:43,989][27935] Avg episode reward: [(0, '-2.251')] [2022-07-13 11:00:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 284887040. Throughput: 0: 9728.9. Samples: 569794432. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:48,989][27935] Avg episode reward: [(0, '-2.360')] [2022-07-13 11:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 284911616. Throughput: 0: 9713.9. Samples: 569823284. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:53,989][27935] Avg episode reward: [(0, '-3.018')] [2022-07-13 11:00:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 284936192. Throughput: 0: 9723.2. Samples: 569882304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:00:58,991][27935] Avg episode reward: [(0, '-1.898')] [2022-07-13 11:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 284958720. Throughput: 0: 9630.9. Samples: 569936340. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:03,989][27935] Avg episode reward: [(0, '-0.841')] [2022-07-13 11:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 284983296. Throughput: 0: 9638.7. Samples: 569965688. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:08,989][27935] Avg episode reward: [(0, '-0.789')] [2022-07-13 11:01:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 285006848. Throughput: 0: 9633.9. Samples: 570023876. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:13,989][27935] Avg episode reward: [(0, '-1.551')] [2022-07-13 11:01:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 285031424. Throughput: 0: 9645.8. Samples: 570082204. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:18,989][27935] Avg episode reward: [(0, '-1.123')] [2022-07-13 11:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 285054976. Throughput: 0: 9639.1. Samples: 570111212. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:23,989][27935] Avg episode reward: [(0, '-1.030')] [2022-07-13 11:01:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 285080576. Throughput: 0: 9642.3. Samples: 570169804. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:28,989][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 11:01:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 285104128. Throughput: 0: 9624.8. Samples: 570227548. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:33,989][27935] Avg episode reward: [(0, '-0.913')] [2022-07-13 11:01:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 285127680. Throughput: 0: 9623.6. Samples: 570256344. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:38,989][27935] Avg episode reward: [(0, '-1.953')] [2022-07-13 11:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 285153280. Throughput: 0: 9610.6. Samples: 570314780. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:43,989][27935] Avg episode reward: [(0, '-2.602')] [2022-07-13 11:01:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285177856. Throughput: 0: 9705.7. Samples: 570373096. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:48,989][27935] Avg episode reward: [(0, '-1.903')] [2022-07-13 11:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.6). Total num frames: 285201408. Throughput: 0: 9698.4. Samples: 570402116. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:01:53,989][27935] Avg episode reward: [(0, '-2.429')] [2022-07-13 11:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 285225984. Throughput: 0: 9714.9. Samples: 570461044. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:01:58,990][27935] Avg episode reward: [(0, '-2.108')] [2022-07-13 11:02:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 285247488. Throughput: 0: 9631.7. Samples: 570515628. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:03,989][27935] Avg episode reward: [(0, '-2.321')] [2022-07-13 11:02:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 285272064. Throughput: 0: 9638.4. Samples: 570544940. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:08,989][27935] Avg episode reward: [(0, '-2.181')] [2022-07-13 11:02:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 285296640. Throughput: 0: 9640.8. Samples: 570603640. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:13,989][27935] Avg episode reward: [(0, '-1.595')] [2022-07-13 11:02:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285322240. Throughput: 0: 9653.1. Samples: 570661936. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:18,991][27935] Avg episode reward: [(0, '-0.744')] [2022-07-13 11:02:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 285345792. Throughput: 0: 9667.9. Samples: 570691400. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:23,989][27935] Avg episode reward: [(0, '-0.749')] [2022-07-13 11:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 285370368. Throughput: 0: 9680.4. Samples: 570750400. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:28,990][27935] Avg episode reward: [(0, '-0.673')] [2022-07-13 11:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285394944. Throughput: 0: 9673.5. Samples: 570808404. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:33,989][27935] Avg episode reward: [(0, '-0.541')] [2022-07-13 11:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 285418496. Throughput: 0: 9682.4. Samples: 570837824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:38,989][27935] Avg episode reward: [(0, '-2.122')] [2022-07-13 11:02:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 285442048. Throughput: 0: 9633.2. Samples: 570894540. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:43,989][27935] Avg episode reward: [(0, '-1.896')] [2022-07-13 11:02:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 285466624. Throughput: 0: 9703.0. Samples: 570952264. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:48,990][27935] Avg episode reward: [(0, '-2.676')] [2022-07-13 11:02:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 285489152. Throughput: 0: 9699.7. Samples: 570981428. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:53,990][27935] Avg episode reward: [(0, '-2.357')] [2022-07-13 11:02:58,990][27935] Fps is (10 sec: 4812.1, 60 sec: 4812.7, 300 sec: 4824.9). Total num frames: 285514752. Throughput: 0: 9699.2. Samples: 571040116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:02:58,991][27935] Avg episode reward: [(0, '-2.454')] [2022-07-13 11:03:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 285537280. Throughput: 0: 9615.7. Samples: 571094644. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:03,989][27935] Avg episode reward: [(0, '-1.749')] [2022-07-13 11:03:08,989][27935] Fps is (10 sec: 4813.5, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285562880. Throughput: 0: 9605.9. Samples: 571123664. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:08,991][27935] Avg episode reward: [(0, '-1.717')] [2022-07-13 11:03:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 285586432. Throughput: 0: 9596.7. Samples: 571182252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:13,989][27935] Avg episode reward: [(0, '-1.803')] [2022-07-13 11:03:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 285609984. Throughput: 0: 9605.7. Samples: 571240660. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:18,989][27935] Avg episode reward: [(0, '-2.443')] [2022-07-13 11:03:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 285634560. Throughput: 0: 9597.9. Samples: 571269728. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:23,989][27935] Avg episode reward: [(0, '-2.216')] [2022-07-13 11:03:28,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4812.7, 300 sec: 4824.9). Total num frames: 285659136. Throughput: 0: 9638.9. Samples: 571328308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:28,991][27935] Avg episode reward: [(0, '-2.684')] [2022-07-13 11:03:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 285684736. Throughput: 0: 9654.8. Samples: 571386728. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:33,989][27935] Avg episode reward: [(0, '-2.829')] [2022-07-13 11:03:38,989][27935] Fps is (10 sec: 4916.1, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 285708288. Throughput: 0: 9657.8. Samples: 571416028. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:38,989][27935] Avg episode reward: [(0, '-3.251')] [2022-07-13 11:03:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285732864. Throughput: 0: 9664.2. Samples: 571474992. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:43,990][27935] Avg episode reward: [(0, '-1.754')] [2022-07-13 11:03:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 285757440. Throughput: 0: 9098.3. Samples: 571504068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:48,989][27935] Avg episode reward: [(0, '-1.690')] [2022-07-13 11:03:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 285782016. Throughput: 0: 9763.7. Samples: 571563032. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:53,989][27935] Avg episode reward: [(0, '-1.882')] [2022-07-13 11:03:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.1, 300 sec: 4835.4). Total num frames: 285806592. Throughput: 0: 9761.3. Samples: 571621508. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:03:58,989][27935] Avg episode reward: [(0, '-2.309')] [2022-07-13 11:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4825.0). Total num frames: 285828096. Throughput: 0: 9673.2. Samples: 571675956. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:04:03,989][27935] Avg episode reward: [(0, '-1.486')] [2022-07-13 11:04:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 285852672. Throughput: 0: 9675.3. Samples: 571705116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:04:08,989][27935] Avg episode reward: [(0, '-1.579')] [2022-07-13 11:04:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 285875200. Throughput: 0: 9670.4. Samples: 571763460. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:04:13,990][27935] Avg episode reward: [(0, '-1.827')] [2022-07-13 11:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 285901824. Throughput: 0: 9668.8. Samples: 571821824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 11:04:18,989][27935] Avg episode reward: [(0, '-2.369')] [2022-07-13 11:04:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 285925376. Throughput: 0: 9672.1. Samples: 571851272. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:24,001][27935] Avg episode reward: [(0, '-2.871')] [2022-07-13 11:04:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4828.4). Total num frames: 285949952. Throughput: 0: 9646.4. Samples: 571909080. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:28,990][27935] Avg episode reward: [(0, '-2.354')] [2022-07-13 11:04:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 285973504. Throughput: 0: 10301.6. Samples: 571967640. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:33,989][27935] Avg episode reward: [(0, '-1.820')] [2022-07-13 11:04:38,990][27935] Fps is (10 sec: 4812.3, 60 sec: 4829.8, 300 sec: 4828.4). Total num frames: 285998080. Throughput: 0: 9634.5. Samples: 571996596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:38,990][27935] Avg episode reward: [(0, '-2.015')] [2022-07-13 11:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286022656. Throughput: 0: 9642.0. Samples: 572055396. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:43,989][27935] Avg episode reward: [(0, '-2.908')] [2022-07-13 11:04:48,989][27935] Fps is (10 sec: 4915.7, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286047232. Throughput: 0: 9728.7. Samples: 572113748. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:48,989][27935] Avg episode reward: [(0, '-2.598')] [2022-07-13 11:04:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286071808. Throughput: 0: 9728.5. Samples: 572142900. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:53,990][27935] Avg episode reward: [(0, '-2.155')] [2022-07-13 11:04:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 286096384. Throughput: 0: 9730.6. Samples: 572201336. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:04:58,989][27935] Avg episode reward: [(0, '-2.404')] [2022-07-13 11:05:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 286117888. Throughput: 0: 9635.2. Samples: 572255408. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:03,989][27935] Avg episode reward: [(0, '-1.701')] [2022-07-13 11:05:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 286141440. Throughput: 0: 9624.4. Samples: 572284368. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:08,989][27935] Avg episode reward: [(0, '-3.214')] [2022-07-13 11:05:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 286167040. Throughput: 0: 9636.7. Samples: 572342732. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:13,989][27935] Avg episode reward: [(0, '-2.185')] [2022-07-13 11:05:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286191616. Throughput: 0: 9641.3. Samples: 572401500. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:18,989][27935] Avg episode reward: [(0, '-1.801')] [2022-07-13 11:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286215168. Throughput: 0: 9653.4. Samples: 572430988. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:23,989][27935] Avg episode reward: [(0, '-1.951')] [2022-07-13 11:05:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 286237696. Throughput: 0: 9644.1. Samples: 572489380. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:28,989][27935] Avg episode reward: [(0, '-2.054')] [2022-07-13 11:05:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 286265344. Throughput: 0: 9645.8. Samples: 572547808. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:33,989][27935] Avg episode reward: [(0, '-1.677')] [2022-07-13 11:05:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4847.0, 300 sec: 4831.9). Total num frames: 286288896. Throughput: 0: 9644.8. Samples: 572576916. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:38,989][27935] Avg episode reward: [(0, '-1.114')] [2022-07-13 11:05:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 286313472. Throughput: 0: 9647.1. Samples: 572635456. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:43,989][27935] Avg episode reward: [(0, '-0.967')] [2022-07-13 11:05:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286337024. Throughput: 0: 9744.1. Samples: 572693892. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:48,991][27935] Avg episode reward: [(0, '-1.558')] [2022-07-13 11:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 286360576. Throughput: 0: 9755.7. Samples: 572723376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:53,989][27935] Avg episode reward: [(0, '-2.513')] [2022-07-13 11:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 286386176. Throughput: 0: 9762.0. Samples: 572782020. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:05:58,989][27935] Avg episode reward: [(0, '-1.871')] [2022-07-13 11:06:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 286408704. Throughput: 0: 9674.5. Samples: 572836852. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:03,989][27935] Avg episode reward: [(0, '-2.415')] [2022-07-13 11:06:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 286433280. Throughput: 0: 9668.6. Samples: 572866076. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:08,990][27935] Avg episode reward: [(0, '-2.810')] [2022-07-13 11:06:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286456832. Throughput: 0: 9665.3. Samples: 572924320. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:13,989][27935] Avg episode reward: [(0, '-3.130')] [2022-07-13 11:06:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 286481408. Throughput: 0: 9667.6. Samples: 572982848. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:18,991][27935] Avg episode reward: [(0, '-2.401')] [2022-07-13 11:06:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 286507008. Throughput: 0: 9666.9. Samples: 573011928. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:23,990][27935] Avg episode reward: [(0, '-2.616')] [2022-07-13 11:06:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 286529536. Throughput: 0: 9669.2. Samples: 573070568. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:28,991][27935] Avg episode reward: [(0, '-3.221')] [2022-07-13 11:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 286555136. Throughput: 0: 9665.9. Samples: 573128856. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:33,989][27935] Avg episode reward: [(0, '-3.598')] [2022-07-13 11:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 286578688. Throughput: 0: 9661.5. Samples: 573158144. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:38,990][27935] Avg episode reward: [(0, '-2.765')] [2022-07-13 11:06:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 286602240. Throughput: 0: 9658.9. Samples: 573216668. Policy #0 lag: (min: 0.0, avg: 10.0, max: 19.0) [2022-07-13 11:06:43,990][27935] Avg episode reward: [(0, '-2.666')] [2022-07-13 11:06:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 286627840. Throughput: 0: 9735.9. Samples: 573274968. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:06:48,991][27935] Avg episode reward: [(0, '-3.251')] [2022-07-13 11:06:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 286651392. Throughput: 0: 9744.0. Samples: 573304556. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:06:53,989][27935] Avg episode reward: [(0, '-3.011')] [2022-07-13 11:06:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 286676992. Throughput: 0: 9748.0. Samples: 573362980. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:06:58,989][27935] Avg episode reward: [(0, '-3.934')] [2022-07-13 11:07:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 286699520. Throughput: 0: 9665.5. Samples: 573417796. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:03,990][27935] Avg episode reward: [(0, '-3.936')] [2022-07-13 11:07:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 286723072. Throughput: 0: 9662.4. Samples: 573446736. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:08,989][27935] Avg episode reward: [(0, '-3.682')] [2022-07-13 11:07:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 286746624. Throughput: 0: 9656.6. Samples: 573505116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:13,989][27935] Avg episode reward: [(0, '-4.095')] [2022-07-13 11:07:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 286772224. Throughput: 0: 9655.7. Samples: 573563364. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:18,989][27935] Avg episode reward: [(0, '-3.933')] [2022-07-13 11:07:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 286796800. Throughput: 0: 9659.8. Samples: 573592836. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:23,989][27935] Avg episode reward: [(0, '-3.399')] [2022-07-13 11:07:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 286820352. Throughput: 0: 9661.7. Samples: 573651444. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:28,989][27935] Avg episode reward: [(0, '-4.108')] [2022-07-13 11:07:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 286845952. Throughput: 0: 9663.0. Samples: 573709804. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:33,989][27935] Avg episode reward: [(0, '-3.342')] [2022-07-13 11:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 286869504. Throughput: 0: 9660.7. Samples: 573739288. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:38,989][27935] Avg episode reward: [(0, '-3.032')] [2022-07-13 11:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 286893056. Throughput: 0: 9651.8. Samples: 573797312. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:43,991][27935] Avg episode reward: [(0, '-2.906')] [2022-07-13 11:07:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 286918656. Throughput: 0: 9738.8. Samples: 573856044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:48,990][27935] Avg episode reward: [(0, '-2.742')] [2022-07-13 11:07:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 286943232. Throughput: 0: 9750.9. Samples: 573885524. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:53,989][27935] Avg episode reward: [(0, '-1.992')] [2022-07-13 11:07:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 286966784. Throughput: 0: 9748.4. Samples: 573943796. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:07:58,989][27935] Avg episode reward: [(0, '-1.055')] [2022-07-13 11:08:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 286989312. Throughput: 0: 9677.1. Samples: 573998832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:03,991][27935] Avg episode reward: [(0, '-1.607')] [2022-07-13 11:08:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 287014912. Throughput: 0: 9674.5. Samples: 574028188. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:08,989][27935] Avg episode reward: [(0, '-2.096')] [2022-07-13 11:08:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 287038464. Throughput: 0: 9657.0. Samples: 574086008. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:13,990][27935] Avg episode reward: [(0, '-1.653')] [2022-07-13 11:08:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 287062016. Throughput: 0: 9635.1. Samples: 574143384. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:18,991][27935] Avg episode reward: [(0, '-1.521')] [2022-07-13 11:08:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.9). Total num frames: 287086592. Throughput: 0: 9626.3. Samples: 574172472. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:23,990][27935] Avg episode reward: [(0, '-1.833')] [2022-07-13 11:08:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 287109120. Throughput: 0: 9622.2. Samples: 574230312. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:28,989][27935] Avg episode reward: [(0, '-1.597')] [2022-07-13 11:08:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 287135744. Throughput: 0: 9622.7. Samples: 574289064. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:33,989][27935] Avg episode reward: [(0, '-2.683')] [2022-07-13 11:08:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 287160320. Throughput: 0: 9619.9. Samples: 574318420. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:38,990][27935] Avg episode reward: [(0, '-2.070')] [2022-07-13 11:08:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 287182848. Throughput: 0: 9629.7. Samples: 574377132. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:43,989][27935] Avg episode reward: [(0, '-1.280')] [2022-07-13 11:08:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 287207424. Throughput: 0: 9681.7. Samples: 574434508. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:48,989][27935] Avg episode reward: [(0, '-1.462')] [2022-07-13 11:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 287230976. Throughput: 0: 9676.3. Samples: 574463620. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:53,989][27935] Avg episode reward: [(0, '-1.448')] [2022-07-13 11:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 287257600. Throughput: 0: 9697.6. Samples: 574522400. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:08:58,989][27935] Avg episode reward: [(0, '-2.516')] [2022-07-13 11:09:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 287279104. Throughput: 0: 9646.2. Samples: 574577464. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:09:03,989][27935] Avg episode reward: [(0, '-1.849')] [2022-07-13 11:09:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 287302656. Throughput: 0: 9648.7. Samples: 574606664. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:08,990][27935] Avg episode reward: [(0, '-1.766')] [2022-07-13 11:09:13,992][27935] Fps is (10 sec: 4811.3, 60 sec: 4812.6, 300 sec: 4831.8). Total num frames: 287327232. Throughput: 0: 9671.9. Samples: 574665576. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:13,992][27935] Avg episode reward: [(0, '-1.378')] [2022-07-13 11:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 287351808. Throughput: 0: 9665.8. Samples: 574724024. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:18,989][27935] Avg episode reward: [(0, '-1.590')] [2022-07-13 11:09:23,990][27935] Fps is (10 sec: 5018.6, 60 sec: 4846.8, 300 sec: 4838.8). Total num frames: 287377408. Throughput: 0: 9671.6. Samples: 574753652. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:23,990][27935] Avg episode reward: [(0, '-1.498')] [2022-07-13 11:09:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 287401984. Throughput: 0: 9671.0. Samples: 574812328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:28,989][27935] Avg episode reward: [(0, '-1.457')] [2022-07-13 11:09:33,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4829.9, 300 sec: 4838.9). Total num frames: 287425536. Throughput: 0: 9690.7. Samples: 574870588. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:33,989][27935] Avg episode reward: [(0, '-1.735')] [2022-07-13 11:09:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 287448064. Throughput: 0: 9690.6. Samples: 574899696. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:38,989][27935] Avg episode reward: [(0, '-1.711')] [2022-07-13 11:09:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 287474688. Throughput: 0: 9692.2. Samples: 574958548. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:43,989][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 11:09:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 287499264. Throughput: 0: 9768.8. Samples: 575017060. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:48,989][27935] Avg episode reward: [(0, '-1.877')] [2022-07-13 11:09:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 287522816. Throughput: 0: 9774.2. Samples: 575046504. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:53,989][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 11:09:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 287548416. Throughput: 0: 9770.5. Samples: 575105220. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:09:58,989][27935] Avg episode reward: [(0, '-1.888')] [2022-07-13 11:10:03,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4863.8, 300 sec: 4845.7). Total num frames: 287570944. Throughput: 0: 9688.4. Samples: 575160028. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:03,992][27935] Avg episode reward: [(0, '-1.670')] [2022-07-13 11:10:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 287594496. Throughput: 0: 9677.6. Samples: 575189132. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:08,989][27935] Avg episode reward: [(0, '-1.217')] [2022-07-13 11:10:13,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4864.2, 300 sec: 4838.8). Total num frames: 287619072. Throughput: 0: 9676.4. Samples: 575247764. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:13,989][27935] Avg episode reward: [(0, '-1.469')] [2022-07-13 11:10:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 287643648. Throughput: 0: 9670.2. Samples: 575305748. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:18,989][27935] Avg episode reward: [(0, '-1.741')] [2022-07-13 11:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4845.8). Total num frames: 287667200. Throughput: 0: 9673.1. Samples: 575334984. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:23,989][27935] Avg episode reward: [(0, '-1.845')] [2022-07-13 11:10:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 287692800. Throughput: 0: 9663.4. Samples: 575393400. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:28,989][27935] Avg episode reward: [(0, '-1.102')] [2022-07-13 11:10:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 287715328. Throughput: 0: 9665.2. Samples: 575451996. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:33,989][27935] Avg episode reward: [(0, '-0.808')] [2022-07-13 11:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 287740928. Throughput: 0: 9657.5. Samples: 575481092. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:38,989][27935] Avg episode reward: [(0, '-1.734')] [2022-07-13 11:10:43,992][27935] Fps is (10 sec: 5015.9, 60 sec: 4846.7, 300 sec: 4842.3). Total num frames: 287765504. Throughput: 0: 9654.3. Samples: 575539696. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:43,993][27935] Avg episode reward: [(0, '-2.427')] [2022-07-13 11:10:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 287789056. Throughput: 0: 9751.3. Samples: 575598808. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:48,989][27935] Avg episode reward: [(0, '-3.159')] [2022-07-13 11:10:53,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 287814656. Throughput: 0: 9755.8. Samples: 575628144. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:53,989][27935] Avg episode reward: [(0, '-3.255')] [2022-07-13 11:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 287838208. Throughput: 0: 9750.9. Samples: 575686552. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:10:58,990][27935] Avg episode reward: [(0, '-2.821')] [2022-07-13 11:11:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.2, 300 sec: 4842.3). Total num frames: 287861760. Throughput: 0: 9682.5. Samples: 575741460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:03,989][27935] Avg episode reward: [(0, '-2.298')] [2022-07-13 11:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 287885312. Throughput: 0: 9685.2. Samples: 575770816. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:08,989][27935] Avg episode reward: [(0, '-3.397')] [2022-07-13 11:11:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 287909888. Throughput: 0: 9697.0. Samples: 575829764. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:13,990][27935] Avg episode reward: [(0, '-2.607')] [2022-07-13 11:11:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 287933440. Throughput: 0: 9697.2. Samples: 575888368. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:18,991][27935] Avg episode reward: [(0, '-1.463')] [2022-07-13 11:11:23,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4846.3, 300 sec: 4842.2). Total num frames: 287958016. Throughput: 0: 9690.7. Samples: 575917248. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:23,997][27935] Avg episode reward: [(0, '-1.489')] [2022-07-13 11:11:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 287983616. Throughput: 0: 9698.1. Samples: 575976076. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 11:11:28,989][27935] Avg episode reward: [(0, '-1.513')] [2022-07-13 11:11:33,989][27935] Fps is (10 sec: 5021.5, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 288008192. Throughput: 0: 9684.6. Samples: 576034616. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:33,989][27935] Avg episode reward: [(0, '-1.943')] [2022-07-13 11:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 288031744. Throughput: 0: 9688.4. Samples: 576064124. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:38,989][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 11:11:43,992][27935] Fps is (10 sec: 4913.7, 60 sec: 4864.0, 300 sec: 4845.7). Total num frames: 288057344. Throughput: 0: 9700.2. Samples: 576123092. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:43,996][27935] Avg episode reward: [(0, '-1.907')] [2022-07-13 11:11:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 288081920. Throughput: 0: 9775.6. Samples: 576181360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:48,989][27935] Avg episode reward: [(0, '-3.784')] [2022-07-13 11:11:53,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 288105472. Throughput: 0: 9782.1. Samples: 576211012. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:53,989][27935] Avg episode reward: [(0, '-3.548')] [2022-07-13 11:11:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 288130048. Throughput: 0: 9777.8. Samples: 576269764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:11:58,989][27935] Avg episode reward: [(0, '-3.083')] [2022-07-13 11:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 288152576. Throughput: 0: 9694.7. Samples: 576324628. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:03,989][27935] Avg episode reward: [(0, '-3.967')] [2022-07-13 11:12:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 288177152. Throughput: 0: 9712.5. Samples: 576354236. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:08,989][27935] Avg episode reward: [(0, '-4.274')] [2022-07-13 11:12:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 288201728. Throughput: 0: 9713.8. Samples: 576413196. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:13,989][27935] Avg episode reward: [(0, '-3.392')] [2022-07-13 11:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 288226304. Throughput: 0: 9712.4. Samples: 576471676. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:18,989][27935] Avg episode reward: [(0, '-2.971')] [2022-07-13 11:12:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.7, 300 sec: 4849.2). Total num frames: 288250880. Throughput: 0: 9712.5. Samples: 576501188. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:23,989][27935] Avg episode reward: [(0, '-3.502')] [2022-07-13 11:12:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 288274432. Throughput: 0: 9702.6. Samples: 576559680. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:28,990][27935] Avg episode reward: [(0, '-4.059')] [2022-07-13 11:12:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 288300032. Throughput: 0: 9714.9. Samples: 576618532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:33,989][27935] Avg episode reward: [(0, '-3.860')] [2022-07-13 11:12:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 288324608. Throughput: 0: 9708.4. Samples: 576647888. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:38,990][27935] Avg episode reward: [(0, '-4.143')] [2022-07-13 11:12:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.1, 300 sec: 4842.3). Total num frames: 288347136. Throughput: 0: 9693.3. Samples: 576705964. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:43,989][27935] Avg episode reward: [(0, '-4.294')] [2022-07-13 11:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 288372736. Throughput: 0: 9776.6. Samples: 576764576. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:48,989][27935] Avg episode reward: [(0, '-4.412')] [2022-07-13 11:12:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 288397312. Throughput: 0: 9776.5. Samples: 576794180. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:53,989][27935] Avg episode reward: [(0, '-2.198')] [2022-07-13 11:12:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 288420864. Throughput: 0: 9759.5. Samples: 576852372. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:12:58,990][27935] Avg episode reward: [(0, '-3.506')] [2022-07-13 11:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 288443392. Throughput: 0: 9675.8. Samples: 576907088. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:03,991][27935] Avg episode reward: [(0, '-4.376')] [2022-07-13 11:13:08,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4846.7, 300 sec: 4845.7). Total num frames: 288467968. Throughput: 0: 9672.9. Samples: 576936500. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:08,993][27935] Avg episode reward: [(0, '-5.477')] [2022-07-13 11:13:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 288493568. Throughput: 0: 9679.8. Samples: 576995272. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:13,989][27935] Avg episode reward: [(0, '-5.781')] [2022-07-13 11:13:18,989][27935] Fps is (10 sec: 4916.7, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 288517120. Throughput: 0: 9672.3. Samples: 577053784. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:18,989][27935] Avg episode reward: [(0, '-5.258')] [2022-07-13 11:13:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 288540672. Throughput: 0: 9673.1. Samples: 577083176. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:23,989][27935] Avg episode reward: [(0, '-6.072')] [2022-07-13 11:13:28,994][27935] Fps is (10 sec: 5015.0, 60 sec: 4880.6, 300 sec: 4852.6). Total num frames: 288567296. Throughput: 0: 9686.3. Samples: 577141900. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:28,995][27935] Avg episode reward: [(0, '-6.137')] [2022-07-13 11:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 288589824. Throughput: 0: 9682.5. Samples: 577200288. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:33,989][27935] Avg episode reward: [(0, '-4.456')] [2022-07-13 11:13:38,989][27935] Fps is (10 sec: 4917.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 288616448. Throughput: 0: 9676.1. Samples: 577229604. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:38,989][27935] Avg episode reward: [(0, '-2.993')] [2022-07-13 11:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 288638976. Throughput: 0: 9683.6. Samples: 577288132. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:43,989][27935] Avg episode reward: [(0, '-1.615')] [2022-07-13 11:13:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 288663552. Throughput: 0: 9767.4. Samples: 577346620. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:48,989][27935] Avg episode reward: [(0, '-1.605')] [2022-07-13 11:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 288688128. Throughput: 0: 9768.8. Samples: 577376064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 11:13:53,989][27935] Avg episode reward: [(0, '-1.429')] [2022-07-13 11:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 288712704. Throughput: 0: 9762.0. Samples: 577434560. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:13:58,989][27935] Avg episode reward: [(0, '-1.167')] [2022-07-13 11:14:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 288735232. Throughput: 0: 9672.8. Samples: 577489060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:03,989][27935] Avg episode reward: [(0, '-1.586')] [2022-07-13 11:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.2, 300 sec: 4852.8). Total num frames: 288758784. Throughput: 0: 9673.1. Samples: 577518464. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:08,989][27935] Avg episode reward: [(0, '-2.197')] [2022-07-13 11:14:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 288783360. Throughput: 0: 9676.0. Samples: 577577268. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:13,990][27935] Avg episode reward: [(0, '-2.446')] [2022-07-13 11:14:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 288808960. Throughput: 0: 9686.6. Samples: 577636184. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:18,989][27935] Avg episode reward: [(0, '-3.543')] [2022-07-13 11:14:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 288833536. Throughput: 0: 9690.8. Samples: 577665692. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:23,989][27935] Avg episode reward: [(0, '-3.736')] [2022-07-13 11:14:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.3, 300 sec: 4852.7). Total num frames: 288857088. Throughput: 0: 9684.2. Samples: 577723920. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:28,989][27935] Avg episode reward: [(0, '-3.062')] [2022-07-13 11:14:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 288880640. Throughput: 0: 9666.1. Samples: 577781596. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:33,989][27935] Avg episode reward: [(0, '-2.908')] [2022-07-13 11:14:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 288904192. Throughput: 0: 9659.9. Samples: 577810760. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:38,989][27935] Avg episode reward: [(0, '-2.374')] [2022-07-13 11:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 288929792. Throughput: 0: 9651.6. Samples: 577868884. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:43,989][27935] Avg episode reward: [(0, '-2.357')] [2022-07-13 11:14:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 288954368. Throughput: 0: 9733.7. Samples: 577927076. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:48,989][27935] Avg episode reward: [(0, '-2.464')] [2022-07-13 11:14:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 288976896. Throughput: 0: 9702.8. Samples: 577955088. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:53,989][27935] Avg episode reward: [(0, '-1.172')] [2022-07-13 11:14:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 289000448. Throughput: 0: 9669.2. Samples: 578012384. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:14:58,989][27935] Avg episode reward: [(0, '-1.001')] [2022-07-13 11:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 289024000. Throughput: 0: 9559.6. Samples: 578066368. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:03,990][27935] Avg episode reward: [(0, '-1.180')] [2022-07-13 11:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 289048576. Throughput: 0: 9554.7. Samples: 578095656. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:08,989][27935] Avg episode reward: [(0, '-0.678')] [2022-07-13 11:15:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 289071104. Throughput: 0: 9552.3. Samples: 578153776. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:13,989][27935] Avg episode reward: [(0, '-1.232')] [2022-07-13 11:15:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4842.3). Total num frames: 289095680. Throughput: 0: 9559.3. Samples: 578211764. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:18,989][27935] Avg episode reward: [(0, '-1.512')] [2022-07-13 11:15:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4838.8). Total num frames: 289120256. Throughput: 0: 9555.5. Samples: 578240756. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:23,990][27935] Avg episode reward: [(0, '-1.817')] [2022-07-13 11:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 289144832. Throughput: 0: 9550.4. Samples: 578298652. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:28,989][27935] Avg episode reward: [(0, '-3.439')] [2022-07-13 11:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 289168384. Throughput: 0: 9546.3. Samples: 578356660. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:33,989][27935] Avg episode reward: [(0, '-3.936')] [2022-07-13 11:15:38,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4812.6, 300 sec: 4838.8). Total num frames: 289192960. Throughput: 0: 9565.7. Samples: 578385572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:38,992][27935] Avg episode reward: [(0, '-4.934')] [2022-07-13 11:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 289217536. Throughput: 0: 9595.8. Samples: 578444196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:43,989][27935] Avg episode reward: [(0, '-5.939')] [2022-07-13 11:15:48,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 289242112. Throughput: 0: 9697.1. Samples: 578502740. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:48,989][27935] Avg episode reward: [(0, '-6.061')] [2022-07-13 11:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 289265664. Throughput: 0: 9698.6. Samples: 578532092. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:53,989][27935] Avg episode reward: [(0, '-6.701')] [2022-07-13 11:15:58,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4829.6, 300 sec: 4842.2). Total num frames: 289290240. Throughput: 0: 9703.2. Samples: 578590452. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:15:58,996][27935] Avg episode reward: [(0, '-6.146')] [2022-07-13 11:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 289312768. Throughput: 0: 9621.3. Samples: 578644720. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:16:03,989][27935] Avg episode reward: [(0, '-4.730')] [2022-07-13 11:16:08,992][27935] Fps is (10 sec: 4608.2, 60 sec: 4795.5, 300 sec: 4835.3). Total num frames: 289336320. Throughput: 0: 9626.0. Samples: 578673956. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:16:08,992][27935] Avg episode reward: [(0, '-4.070')] [2022-07-13 11:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 289360896. Throughput: 0: 9634.5. Samples: 578732204. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:16:13,989][27935] Avg episode reward: [(0, '-2.792')] [2022-07-13 11:16:18,989][27935] Fps is (10 sec: 4916.7, 60 sec: 4829.9, 300 sec: 4839.0). Total num frames: 289385472. Throughput: 0: 9639.6. Samples: 578790440. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 11:16:18,989][27935] Avg episode reward: [(0, '-2.737')] [2022-07-13 11:16:23,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4812.6, 300 sec: 4831.9). Total num frames: 289409024. Throughput: 0: 9642.4. Samples: 578819472. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:23,992][27935] Avg episode reward: [(0, '-2.299')] [2022-07-13 11:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 289433600. Throughput: 0: 9642.1. Samples: 578878092. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:28,989][27935] Avg episode reward: [(0, '-1.805')] [2022-07-13 11:16:33,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 289458176. Throughput: 0: 9629.1. Samples: 578936048. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:33,989][27935] Avg episode reward: [(0, '-1.932')] [2022-07-13 11:16:38,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4829.8, 300 sec: 4831.9). Total num frames: 289482752. Throughput: 0: 9631.1. Samples: 578965524. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:38,993][27935] Avg episode reward: [(0, '-1.757')] [2022-07-13 11:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 289507328. Throughput: 0: 9643.3. Samples: 579024368. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:43,989][27935] Avg episode reward: [(0, '-0.964')] [2022-07-13 11:16:48,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 289531904. Throughput: 0: 9739.4. Samples: 579082992. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:48,989][27935] Avg episode reward: [(0, '-1.247')] [2022-07-13 11:16:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 289556480. Throughput: 0: 9745.7. Samples: 579112484. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:53,989][27935] Avg episode reward: [(0, '-0.987')] [2022-07-13 11:16:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.2, 300 sec: 4838.8). Total num frames: 289580032. Throughput: 0: 9756.4. Samples: 579171240. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:16:58,989][27935] Avg episode reward: [(0, '-0.574')] [2022-07-13 11:17:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 289603584. Throughput: 0: 9679.6. Samples: 579226020. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:03,989][27935] Avg episode reward: [(0, '-0.672')] [2022-07-13 11:17:08,995][27935] Fps is (10 sec: 4809.8, 60 sec: 4863.7, 300 sec: 4835.3). Total num frames: 289628160. Throughput: 0: 9689.3. Samples: 579255532. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:08,996][27935] Avg episode reward: [(0, '-1.088')] [2022-07-13 11:17:14,000][27935] Fps is (10 sec: 4807.2, 60 sec: 4846.0, 300 sec: 4831.7). Total num frames: 289651712. Throughput: 0: 9699.3. Samples: 579314672. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:14,001][27935] Avg episode reward: [(0, '-1.843')] [2022-07-13 11:17:18,989][27935] Fps is (10 sec: 4918.3, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 289677312. Throughput: 0: 9719.7. Samples: 579373436. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:18,990][27935] Avg episode reward: [(0, '-2.461')] [2022-07-13 11:17:23,989][27935] Fps is (10 sec: 4920.9, 60 sec: 4864.2, 300 sec: 4835.4). Total num frames: 289700864. Throughput: 0: 9720.0. Samples: 579402888. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:23,989][27935] Avg episode reward: [(0, '-3.794')] [2022-07-13 11:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 289726464. Throughput: 0: 9718.8. Samples: 579461712. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:28,989][27935] Avg episode reward: [(0, '-3.698')] [2022-07-13 11:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 289750016. Throughput: 0: 9714.9. Samples: 579520160. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:33,989][27935] Avg episode reward: [(0, '-3.968')] [2022-07-13 11:17:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.4, 300 sec: 4842.3). Total num frames: 289775616. Throughput: 0: 9709.5. Samples: 579549412. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:38,989][27935] Avg episode reward: [(0, '-4.180')] [2022-07-13 11:17:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 289800192. Throughput: 0: 9697.9. Samples: 579607644. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:43,989][27935] Avg episode reward: [(0, '-3.806')] [2022-07-13 11:17:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 289823744. Throughput: 0: 9784.8. Samples: 579666336. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:48,989][27935] Avg episode reward: [(0, '-2.823')] [2022-07-13 11:17:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 289847296. Throughput: 0: 9786.5. Samples: 579695864. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:53,989][27935] Avg episode reward: [(0, '-2.613')] [2022-07-13 11:17:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 289870848. Throughput: 0: 9766.2. Samples: 579754036. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:17:58,990][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 11:18:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.9). Total num frames: 289895424. Throughput: 0: 9671.7. Samples: 579808664. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:03,989][27935] Avg episode reward: [(0, '-1.419')] [2022-07-13 11:18:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.4, 300 sec: 4831.9). Total num frames: 289918976. Throughput: 0: 9664.4. Samples: 579837784. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:08,989][27935] Avg episode reward: [(0, '-0.900')] [2022-07-13 11:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.9, 300 sec: 4835.4). Total num frames: 289943552. Throughput: 0: 9671.7. Samples: 579896940. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:13,989][27935] Avg episode reward: [(0, '-1.199')] [2022-07-13 11:18:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 289968128. Throughput: 0: 9673.4. Samples: 579955464. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:18,989][27935] Avg episode reward: [(0, '-0.640')] [2022-07-13 11:18:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4832.0). Total num frames: 289992704. Throughput: 0: 9683.9. Samples: 579985188. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:23,989][27935] Avg episode reward: [(0, '-0.482')] [2022-07-13 11:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 290017280. Throughput: 0: 9691.7. Samples: 580043772. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:28,989][27935] Avg episode reward: [(0, '-0.985')] [2022-07-13 11:18:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 290041856. Throughput: 0: 9686.3. Samples: 580102220. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:33,989][27935] Avg episode reward: [(0, '-0.847')] [2022-07-13 11:18:38,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4829.7, 300 sec: 4835.3). Total num frames: 290065408. Throughput: 0: 9683.7. Samples: 580131652. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:38,991][27935] Avg episode reward: [(0, '-1.021')] [2022-07-13 11:18:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 290091008. Throughput: 0: 9706.0. Samples: 580190808. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 11:18:43,989][27935] Avg episode reward: [(0, '-1.437')] [2022-07-13 11:18:48,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 290114560. Throughput: 0: 9798.4. Samples: 580249592. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:18:48,989][27935] Avg episode reward: [(0, '-0.954')] [2022-07-13 11:18:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 290138112. Throughput: 0: 9804.4. Samples: 580278984. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:18:53,989][27935] Avg episode reward: [(0, '-1.121')] [2022-07-13 11:18:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 290164736. Throughput: 0: 9794.8. Samples: 580337708. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:18:58,991][27935] Avg episode reward: [(0, '-0.944')] [2022-07-13 11:19:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 290186240. Throughput: 0: 9707.7. Samples: 580392312. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:03,990][27935] Avg episode reward: [(0, '-1.792')] [2022-07-13 11:19:08,990][27935] Fps is (10 sec: 4505.1, 60 sec: 4846.8, 300 sec: 4835.3). Total num frames: 290209792. Throughput: 0: 9697.2. Samples: 580421572. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:08,991][27935] Avg episode reward: [(0, '-1.581')] [2022-07-13 11:19:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 290235392. Throughput: 0: 9703.8. Samples: 580480444. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:13,991][27935] Avg episode reward: [(0, '-1.097')] [2022-07-13 11:19:18,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 290258944. Throughput: 0: 9704.1. Samples: 580538904. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:18,989][27935] Avg episode reward: [(0, '-0.822')] [2022-07-13 11:19:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 290285568. Throughput: 0: 9701.8. Samples: 580568212. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:23,989][27935] Avg episode reward: [(0, '-1.197')] [2022-07-13 11:19:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 290308096. Throughput: 0: 9684.8. Samples: 580626624. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:28,989][27935] Avg episode reward: [(0, '-1.813')] [2022-07-13 11:19:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 290332672. Throughput: 0: 9668.3. Samples: 580684664. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:33,989][27935] Avg episode reward: [(0, '-1.193')] [2022-07-13 11:19:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.2, 300 sec: 4838.8). Total num frames: 290357248. Throughput: 0: 9670.7. Samples: 580714164. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:38,989][27935] Avg episode reward: [(0, '-0.702')] [2022-07-13 11:19:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 290381824. Throughput: 0: 9667.8. Samples: 580772760. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:43,989][27935] Avg episode reward: [(0, '-1.157')] [2022-07-13 11:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 290405376. Throughput: 0: 9759.5. Samples: 580831488. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:48,989][27935] Avg episode reward: [(0, '-1.939')] [2022-07-13 11:19:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 290429952. Throughput: 0: 9764.3. Samples: 580860952. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:53,989][27935] Avg episode reward: [(0, '-1.371')] [2022-07-13 11:19:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 290455552. Throughput: 0: 9758.8. Samples: 580919588. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:19:58,989][27935] Avg episode reward: [(0, '-1.204')] [2022-07-13 11:20:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 290476032. Throughput: 0: 9673.3. Samples: 580974200. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:03,989][27935] Avg episode reward: [(0, '-0.912')] [2022-07-13 11:20:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4847.0, 300 sec: 4845.8). Total num frames: 290500608. Throughput: 0: 9668.5. Samples: 581003296. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:08,989][27935] Avg episode reward: [(0, '-0.738')] [2022-07-13 11:20:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 290525184. Throughput: 0: 9674.0. Samples: 581061956. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:13,989][27935] Avg episode reward: [(0, '-1.439')] [2022-07-13 11:20:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 290550784. Throughput: 0: 9688.8. Samples: 581120660. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:18,990][27935] Avg episode reward: [(0, '-2.053')] [2022-07-13 11:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 290575360. Throughput: 0: 9687.3. Samples: 581150092. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:23,989][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 11:20:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 290598912. Throughput: 0: 9679.6. Samples: 581208344. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:28,989][27935] Avg episode reward: [(0, '-2.223')] [2022-07-13 11:20:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 290623488. Throughput: 0: 9658.2. Samples: 581266108. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:33,989][27935] Avg episode reward: [(0, '-2.390')] [2022-07-13 11:20:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 290647040. Throughput: 0: 9655.2. Samples: 581295436. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:38,989][27935] Avg episode reward: [(0, '-2.209')] [2022-07-13 11:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 290672640. Throughput: 0: 9661.5. Samples: 581354356. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:43,989][27935] Avg episode reward: [(0, '-2.123')] [2022-07-13 11:20:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 290697216. Throughput: 0: 9095.5. Samples: 581383496. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:48,989][27935] Avg episode reward: [(0, '-1.498')] [2022-07-13 11:20:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 290719744. Throughput: 0: 9755.7. Samples: 581442304. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:53,989][27935] Avg episode reward: [(0, '-0.316')] [2022-07-13 11:20:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 290744320. Throughput: 0: 9718.3. Samples: 581499280. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:20:58,990][27935] Avg episode reward: [(0, '-0.171')] [2022-07-13 11:21:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 290766848. Throughput: 0: 9614.1. Samples: 581553296. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:21:03,989][27935] Avg episode reward: [(0, '0.211')] [2022-07-13 11:21:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 290791424. Throughput: 0: 9616.9. Samples: 581582852. Policy #0 lag: (min: 0.0, avg: 10.2, max: 21.0) [2022-07-13 11:21:08,989][27935] Avg episode reward: [(0, '0.186')] [2022-07-13 11:21:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 290816000. Throughput: 0: 9629.9. Samples: 581641688. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:13,989][27935] Avg episode reward: [(0, '-0.227')] [2022-07-13 11:21:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.8). Total num frames: 290840576. Throughput: 0: 9649.0. Samples: 581700312. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:18,991][27935] Avg episode reward: [(0, '-0.722')] [2022-07-13 11:21:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 290865152. Throughput: 0: 9645.0. Samples: 581729460. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:23,989][27935] Avg episode reward: [(0, '-1.997')] [2022-07-13 11:21:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 290887680. Throughput: 0: 9643.2. Samples: 581788300. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:28,990][27935] Avg episode reward: [(0, '-2.196')] [2022-07-13 11:21:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.3). Total num frames: 290913280. Throughput: 0: 10292.6. Samples: 581846664. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:33,989][27935] Avg episode reward: [(0, '-1.882')] [2022-07-13 11:21:38,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 290939904. Throughput: 0: 9649.0. Samples: 581876508. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:38,989][27935] Avg episode reward: [(0, '-3.652')] [2022-07-13 11:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 290962432. Throughput: 0: 9694.5. Samples: 581935532. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:43,989][27935] Avg episode reward: [(0, '-3.001')] [2022-07-13 11:21:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 290987008. Throughput: 0: 9798.9. Samples: 581994248. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:48,989][27935] Avg episode reward: [(0, '-2.865')] [2022-07-13 11:21:53,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4863.8, 300 sec: 4852.7). Total num frames: 291011584. Throughput: 0: 9799.5. Samples: 582023848. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:53,992][27935] Avg episode reward: [(0, '-1.742')] [2022-07-13 11:21:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 291037184. Throughput: 0: 9802.2. Samples: 582082788. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:21:58,989][27935] Avg episode reward: [(0, '-1.628')] [2022-07-13 11:22:03,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4881.1, 300 sec: 4852.8). Total num frames: 291059712. Throughput: 0: 9726.1. Samples: 582137988. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:03,989][27935] Avg episode reward: [(0, '-1.624')] [2022-07-13 11:22:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4852.9). Total num frames: 291083264. Throughput: 0: 9724.9. Samples: 582167080. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:08,989][27935] Avg episode reward: [(0, '-2.491')] [2022-07-13 11:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 291107840. Throughput: 0: 9722.8. Samples: 582225828. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:13,989][27935] Avg episode reward: [(0, '-1.124')] [2022-07-13 11:22:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291132416. Throughput: 0: 9074.6. Samples: 582255020. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:18,990][27935] Avg episode reward: [(0, '-2.471')] [2022-07-13 11:22:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 291158016. Throughput: 0: 9711.7. Samples: 582313536. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:23,989][27935] Avg episode reward: [(0, '-2.527')] [2022-07-13 11:22:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 291179520. Throughput: 0: 9705.8. Samples: 582372292. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:28,996][27935] Avg episode reward: [(0, '-2.767')] [2022-07-13 11:22:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 291207168. Throughput: 0: 9701.9. Samples: 582430832. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:33,989][27935] Avg episode reward: [(0, '-2.685')] [2022-07-13 11:22:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 291229696. Throughput: 0: 9693.3. Samples: 582460028. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:38,989][27935] Avg episode reward: [(0, '-2.356')] [2022-07-13 11:22:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 291253248. Throughput: 0: 9678.7. Samples: 582518328. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:43,989][27935] Avg episode reward: [(0, '-2.993')] [2022-07-13 11:22:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 291279872. Throughput: 0: 9761.4. Samples: 582577252. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:48,989][27935] Avg episode reward: [(0, '-2.486')] [2022-07-13 11:22:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.2, 300 sec: 4856.2). Total num frames: 291303424. Throughput: 0: 9768.9. Samples: 582606680. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:53,989][27935] Avg episode reward: [(0, '-1.875')] [2022-07-13 11:22:58,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4846.7, 300 sec: 4856.1). Total num frames: 291328000. Throughput: 0: 9774.3. Samples: 582665696. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:22:58,992][27935] Avg episode reward: [(0, '-1.719')] [2022-07-13 11:23:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 291350528. Throughput: 0: 10356.7. Samples: 582721072. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:03,989][27935] Avg episode reward: [(0, '-2.268')] [2022-07-13 11:23:08,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291375104. Throughput: 0: 9702.0. Samples: 582750128. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:08,990][27935] Avg episode reward: [(0, '-2.846')] [2022-07-13 11:23:13,992][27935] Fps is (10 sec: 5016.1, 60 sec: 4880.8, 300 sec: 4856.1). Total num frames: 291400704. Throughput: 0: 9710.7. Samples: 582809304. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:13,992][27935] Avg episode reward: [(0, '-3.122')] [2022-07-13 11:23:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291424256. Throughput: 0: 9706.6. Samples: 582867628. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:18,989][27935] Avg episode reward: [(0, '-2.296')] [2022-07-13 11:23:23,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 291448832. Throughput: 0: 9711.8. Samples: 582897064. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:23,990][27935] Avg episode reward: [(0, '-1.584')] [2022-07-13 11:23:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 291472384. Throughput: 0: 9723.4. Samples: 582955880. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:28,989][27935] Avg episode reward: [(0, '-1.693')] [2022-07-13 11:23:33,989][27935] Fps is (10 sec: 5017.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 291499008. Throughput: 0: 9715.7. Samples: 583014460. Policy #0 lag: (min: 0.0, avg: 8.2, max: 18.0) [2022-07-13 11:23:33,989][27935] Avg episode reward: [(0, '-1.664')] [2022-07-13 11:23:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 291520512. Throughput: 0: 9709.2. Samples: 583043592. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:23:38,990][27935] Avg episode reward: [(0, '-1.895')] [2022-07-13 11:23:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 291546112. Throughput: 0: 9706.1. Samples: 583102444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:23:43,989][27935] Avg episode reward: [(0, '-3.095')] [2022-07-13 11:23:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 291570688. Throughput: 0: 9779.9. Samples: 583161168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:23:48,989][27935] Avg episode reward: [(0, '-2.306')] [2022-07-13 11:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 291595264. Throughput: 0: 9792.2. Samples: 583190776. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:23:53,989][27935] Avg episode reward: [(0, '-2.767')] [2022-07-13 11:23:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4856.2). Total num frames: 291618816. Throughput: 0: 9764.2. Samples: 583248664. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:23:58,990][27935] Avg episode reward: [(0, '-2.910')] [2022-07-13 11:24:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 291641344. Throughput: 0: 9688.4. Samples: 583303604. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:03,989][27935] Avg episode reward: [(0, '-2.777')] [2022-07-13 11:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291666944. Throughput: 0: 9675.5. Samples: 583332456. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:08,989][27935] Avg episode reward: [(0, '-1.975')] [2022-07-13 11:24:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.2, 300 sec: 4856.2). Total num frames: 291691520. Throughput: 0: 9674.8. Samples: 583391244. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:13,989][27935] Avg episode reward: [(0, '-1.836')] [2022-07-13 11:24:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 291716096. Throughput: 0: 9681.6. Samples: 583450132. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:18,989][27935] Avg episode reward: [(0, '-1.517')] [2022-07-13 11:24:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 291738624. Throughput: 0: 9693.2. Samples: 583479788. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:23,989][27935] Avg episode reward: [(0, '-1.324')] [2022-07-13 11:24:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291764224. Throughput: 0: 9693.4. Samples: 583538648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:28,990][27935] Avg episode reward: [(0, '-1.571')] [2022-07-13 11:24:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 291788800. Throughput: 0: 9695.6. Samples: 583597472. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:33,989][27935] Avg episode reward: [(0, '-1.516')] [2022-07-13 11:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 291813376. Throughput: 0: 9682.1. Samples: 583626472. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:38,989][27935] Avg episode reward: [(0, '-2.071')] [2022-07-13 11:24:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 291837952. Throughput: 0: 9706.5. Samples: 583685456. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:43,990][27935] Avg episode reward: [(0, '-3.092')] [2022-07-13 11:24:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 291861504. Throughput: 0: 9796.2. Samples: 583744432. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:48,989][27935] Avg episode reward: [(0, '-2.173')] [2022-07-13 11:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 291887104. Throughput: 0: 9810.0. Samples: 583773904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:53,990][27935] Avg episode reward: [(0, '-1.814')] [2022-07-13 11:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 291910656. Throughput: 0: 9807.8. Samples: 583832596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:24:58,989][27935] Avg episode reward: [(0, '-2.700')] [2022-07-13 11:25:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 291935232. Throughput: 0: 9728.3. Samples: 583887904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:03,989][27935] Avg episode reward: [(0, '-3.886')] [2022-07-13 11:25:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 291957760. Throughput: 0: 9717.8. Samples: 583917088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:08,989][27935] Avg episode reward: [(0, '-3.056')] [2022-07-13 11:25:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 291984384. Throughput: 0: 9717.2. Samples: 583975924. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:13,989][27935] Avg episode reward: [(0, '-3.324')] [2022-07-13 11:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 292007936. Throughput: 0: 9703.7. Samples: 584034140. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:18,989][27935] Avg episode reward: [(0, '-2.622')] [2022-07-13 11:25:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 292031488. Throughput: 0: 9712.6. Samples: 584063540. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:23,989][27935] Avg episode reward: [(0, '-3.928')] [2022-07-13 11:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 292057088. Throughput: 0: 9694.9. Samples: 584121728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:28,989][27935] Avg episode reward: [(0, '-4.127')] [2022-07-13 11:25:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 292080640. Throughput: 0: 9679.1. Samples: 584179992. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:33,989][27935] Avg episode reward: [(0, '-3.347')] [2022-07-13 11:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 292104192. Throughput: 0: 9671.6. Samples: 584209124. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:38,990][27935] Avg episode reward: [(0, '-1.948')] [2022-07-13 11:25:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 292127744. Throughput: 0: 9668.6. Samples: 584267684. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:43,990][27935] Avg episode reward: [(0, '-2.082')] [2022-07-13 11:25:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 292154368. Throughput: 0: 9736.5. Samples: 584326044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:48,989][27935] Avg episode reward: [(0, '-1.362')] [2022-07-13 11:25:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 292177920. Throughput: 0: 9741.1. Samples: 584355436. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:53,989][27935] Avg episode reward: [(0, '0.102')] [2022-07-13 11:25:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 292201472. Throughput: 0: 9731.1. Samples: 584413824. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 11:25:58,991][27935] Avg episode reward: [(0, '0.400')] [2022-07-13 11:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 292225024. Throughput: 0: 9665.7. Samples: 584469096. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:03,990][27935] Avg episode reward: [(0, '-0.268')] [2022-07-13 11:26:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 292249600. Throughput: 0: 9658.3. Samples: 584498164. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:08,989][27935] Avg episode reward: [(0, '-0.148')] [2022-07-13 11:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 292274176. Throughput: 0: 9680.0. Samples: 584557328. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:13,989][27935] Avg episode reward: [(0, '-0.381')] [2022-07-13 11:26:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 292298752. Throughput: 0: 9691.0. Samples: 584616088. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:18,989][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 11:26:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 292322304. Throughput: 0: 9687.2. Samples: 584645048. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:23,990][27935] Avg episode reward: [(0, '-1.904')] [2022-07-13 11:26:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 292345856. Throughput: 0: 9689.1. Samples: 584703692. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:28,989][27935] Avg episode reward: [(0, '-2.136')] [2022-07-13 11:26:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 292371456. Throughput: 0: 9686.7. Samples: 584761944. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:33,989][27935] Avg episode reward: [(0, '-1.888')] [2022-07-13 11:26:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 292397056. Throughput: 0: 9687.6. Samples: 584791380. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:38,989][27935] Avg episode reward: [(0, '-2.137')] [2022-07-13 11:26:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 292419584. Throughput: 0: 9697.9. Samples: 584850228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:43,989][27935] Avg episode reward: [(0, '-2.168')] [2022-07-13 11:26:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 292444160. Throughput: 0: 9774.4. Samples: 584908944. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:48,989][27935] Avg episode reward: [(0, '-2.487')] [2022-07-13 11:26:53,990][27935] Fps is (10 sec: 4914.5, 60 sec: 4846.8, 300 sec: 4852.7). Total num frames: 292468736. Throughput: 0: 9778.3. Samples: 584938200. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:53,991][27935] Avg episode reward: [(0, '-1.458')] [2022-07-13 11:26:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 292493312. Throughput: 0: 9758.7. Samples: 584996468. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:26:58,989][27935] Avg episode reward: [(0, '-1.460')] [2022-07-13 11:27:03,989][27935] Fps is (10 sec: 4608.7, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 292514816. Throughput: 0: 9633.5. Samples: 585049596. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:03,989][27935] Avg episode reward: [(0, '-1.910')] [2022-07-13 11:27:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 292539392. Throughput: 0: 9636.6. Samples: 585078696. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:08,989][27935] Avg episode reward: [(0, '-2.903')] [2022-07-13 11:27:13,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4829.8, 300 sec: 4852.7). Total num frames: 292563968. Throughput: 0: 9637.3. Samples: 585137372. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:13,990][27935] Avg episode reward: [(0, '-2.728')] [2022-07-13 11:27:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 292588544. Throughput: 0: 9644.2. Samples: 585195932. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:18,989][27935] Avg episode reward: [(0, '-3.996')] [2022-07-13 11:27:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 292613120. Throughput: 0: 9648.3. Samples: 585225556. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:23,990][27935] Avg episode reward: [(0, '-3.568')] [2022-07-13 11:27:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 292636672. Throughput: 0: 9643.5. Samples: 585284184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:28,989][27935] Avg episode reward: [(0, '-3.620')] [2022-07-13 11:27:33,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 292662272. Throughput: 0: 9646.4. Samples: 585343032. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:33,989][27935] Avg episode reward: [(0, '-3.230')] [2022-07-13 11:27:38,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4812.6, 300 sec: 4856.2). Total num frames: 292685824. Throughput: 0: 9654.3. Samples: 585372648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:38,992][27935] Avg episode reward: [(0, '-1.706')] [2022-07-13 11:27:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 292711424. Throughput: 0: 9654.1. Samples: 585430900. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:43,989][27935] Avg episode reward: [(0, '-1.651')] [2022-07-13 11:27:48,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 292734976. Throughput: 0: 9765.2. Samples: 585489032. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:48,990][27935] Avg episode reward: [(0, '-1.642')] [2022-07-13 11:27:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4852.8). Total num frames: 292759552. Throughput: 0: 9779.8. Samples: 585518788. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:53,989][27935] Avg episode reward: [(0, '-0.771')] [2022-07-13 11:27:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 292784128. Throughput: 0: 9780.1. Samples: 585577472. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:27:58,989][27935] Avg episode reward: [(0, '-0.523')] [2022-07-13 11:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 292806656. Throughput: 0: 9690.8. Samples: 585632016. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:28:03,989][27935] Avg episode reward: [(0, '-0.528')] [2022-07-13 11:28:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 292830208. Throughput: 0: 9684.1. Samples: 585661340. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:28:08,989][27935] Avg episode reward: [(0, '-0.970')] [2022-07-13 11:28:13,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4863.7, 300 sec: 4852.7). Total num frames: 292855808. Throughput: 0: 9686.1. Samples: 585720096. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:28:13,993][27935] Avg episode reward: [(0, '-1.541')] [2022-07-13 11:28:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 292879360. Throughput: 0: 9676.6. Samples: 585778480. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:28:18,989][27935] Avg episode reward: [(0, '-1.557')] [2022-07-13 11:28:23,989][27935] Fps is (10 sec: 4917.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 292904960. Throughput: 0: 9674.1. Samples: 585807964. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 11:28:23,989][27935] Avg episode reward: [(0, '-0.851')] [2022-07-13 11:28:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 292927488. Throughput: 0: 9686.4. Samples: 585866788. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:28,989][27935] Avg episode reward: [(0, '-1.422')] [2022-07-13 11:28:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 292953088. Throughput: 0: 9696.7. Samples: 585925384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:33,989][27935] Avg episode reward: [(0, '-1.105')] [2022-07-13 11:28:38,990][27935] Fps is (10 sec: 5017.0, 60 sec: 4864.1, 300 sec: 4852.7). Total num frames: 292977664. Throughput: 0: 9692.4. Samples: 585954960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:38,991][27935] Avg episode reward: [(0, '-2.094')] [2022-07-13 11:28:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 293002240. Throughput: 0: 9690.5. Samples: 586013544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:43,989][27935] Avg episode reward: [(0, '-2.517')] [2022-07-13 11:28:48,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 293026816. Throughput: 0: 9775.2. Samples: 586071900. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:48,989][27935] Avg episode reward: [(0, '-2.213')] [2022-07-13 11:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 293050368. Throughput: 0: 9776.3. Samples: 586101276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:53,989][27935] Avg episode reward: [(0, '-2.363')] [2022-07-13 11:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 293074944. Throughput: 0: 9782.3. Samples: 586160260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:28:58,989][27935] Avg episode reward: [(0, '-2.475')] [2022-07-13 11:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 293097472. Throughput: 0: 9681.3. Samples: 586214140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:03,989][27935] Avg episode reward: [(0, '-3.385')] [2022-07-13 11:29:08,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4863.8, 300 sec: 4849.2). Total num frames: 293122048. Throughput: 0: 9675.8. Samples: 586243396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:08,991][27935] Avg episode reward: [(0, '-3.271')] [2022-07-13 11:29:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.2, 300 sec: 4845.8). Total num frames: 293145600. Throughput: 0: 9672.8. Samples: 586302064. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:13,989][27935] Avg episode reward: [(0, '-3.243')] [2022-07-13 11:29:18,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 293170176. Throughput: 0: 9665.4. Samples: 586360328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:18,989][27935] Avg episode reward: [(0, '-2.976')] [2022-07-13 11:29:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 293193728. Throughput: 0: 9657.0. Samples: 586389512. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:23,989][27935] Avg episode reward: [(0, '-2.820')] [2022-07-13 11:29:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 293219328. Throughput: 0: 9651.3. Samples: 586447852. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:28,989][27935] Avg episode reward: [(0, '-2.051')] [2022-07-13 11:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 293243904. Throughput: 0: 9640.7. Samples: 586505732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:33,989][27935] Avg episode reward: [(0, '-2.422')] [2022-07-13 11:29:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4845.8). Total num frames: 293267456. Throughput: 0: 9638.6. Samples: 586535012. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:38,990][27935] Avg episode reward: [(0, '-3.064')] [2022-07-13 11:29:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 293292032. Throughput: 0: 9625.0. Samples: 586593384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:43,989][27935] Avg episode reward: [(0, '-2.930')] [2022-07-13 11:29:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 293315584. Throughput: 0: 9732.9. Samples: 586652120. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:48,990][27935] Avg episode reward: [(0, '-1.750')] [2022-07-13 11:29:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 293341184. Throughput: 0: 9729.3. Samples: 586681192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:53,989][27935] Avg episode reward: [(0, '-1.606')] [2022-07-13 11:29:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 293364736. Throughput: 0: 9723.7. Samples: 586739628. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:29:58,989][27935] Avg episode reward: [(0, '-1.714')] [2022-07-13 11:30:03,990][27935] Fps is (10 sec: 4607.5, 60 sec: 4829.8, 300 sec: 4845.8). Total num frames: 293387264. Throughput: 0: 9632.0. Samples: 586793780. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:03,992][27935] Avg episode reward: [(0, '-1.698')] [2022-07-13 11:30:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4842.3). Total num frames: 293412864. Throughput: 0: 9635.6. Samples: 586823112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:08,989][27935] Avg episode reward: [(0, '-1.329')] [2022-07-13 11:30:13,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 293435392. Throughput: 0: 9643.7. Samples: 586881820. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:13,989][27935] Avg episode reward: [(0, '-2.424')] [2022-07-13 11:30:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 293460992. Throughput: 0: 9651.9. Samples: 586940068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:18,989][27935] Avg episode reward: [(0, '-2.417')] [2022-07-13 11:30:23,990][27935] Fps is (10 sec: 5017.2, 60 sec: 4863.9, 300 sec: 4842.3). Total num frames: 293485568. Throughput: 0: 9649.1. Samples: 586969232. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:23,991][27935] Avg episode reward: [(0, '-4.154')] [2022-07-13 11:30:28,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4829.7, 300 sec: 4842.3). Total num frames: 293509120. Throughput: 0: 9650.4. Samples: 587027672. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:28,991][27935] Avg episode reward: [(0, '-4.550')] [2022-07-13 11:30:33,989][27935] Fps is (10 sec: 4710.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 293532672. Throughput: 0: 9626.7. Samples: 587085320. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:33,990][27935] Avg episode reward: [(0, '-4.536')] [2022-07-13 11:30:38,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 293557248. Throughput: 0: 9627.5. Samples: 587114428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:38,990][27935] Avg episode reward: [(0, '-4.449')] [2022-07-13 11:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 293581824. Throughput: 0: 9625.1. Samples: 587172756. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:43,990][27935] Avg episode reward: [(0, '-3.920')] [2022-07-13 11:30:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 293605376. Throughput: 0: 9707.5. Samples: 587230608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 11:30:48,990][27935] Avg episode reward: [(0, '-3.197')] [2022-07-13 11:30:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 293628928. Throughput: 0: 9695.9. Samples: 587259428. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:30:53,989][27935] Avg episode reward: [(0, '-1.329')] [2022-07-13 11:30:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 293652480. Throughput: 0: 9682.2. Samples: 587317520. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:30:58,990][27935] Avg episode reward: [(0, '-2.054')] [2022-07-13 11:31:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.9, 300 sec: 4835.4). Total num frames: 293676032. Throughput: 0: 9595.1. Samples: 587371848. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:03,991][27935] Avg episode reward: [(0, '-1.335')] [2022-07-13 11:31:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 293700608. Throughput: 0: 9601.8. Samples: 587401304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:08,990][27935] Avg episode reward: [(0, '-1.739')] [2022-07-13 11:31:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 293725184. Throughput: 0: 9593.6. Samples: 587459364. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:13,989][27935] Avg episode reward: [(0, '-2.014')] [2022-07-13 11:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 293748736. Throughput: 0: 9605.1. Samples: 587517548. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:18,989][27935] Avg episode reward: [(0, '-1.797')] [2022-07-13 11:31:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4835.4). Total num frames: 293772288. Throughput: 0: 9597.1. Samples: 587546296. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:23,989][27935] Avg episode reward: [(0, '-1.552')] [2022-07-13 11:31:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4831.9). Total num frames: 293796864. Throughput: 0: 9594.1. Samples: 587604492. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:28,989][27935] Avg episode reward: [(0, '-1.318')] [2022-07-13 11:31:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 293822464. Throughput: 0: 9580.4. Samples: 587661728. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:33,989][27935] Avg episode reward: [(0, '-0.608')] [2022-07-13 11:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 293846016. Throughput: 0: 9585.5. Samples: 587690776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:38,989][27935] Avg episode reward: [(0, '-0.916')] [2022-07-13 11:31:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 293869568. Throughput: 0: 9594.2. Samples: 587749260. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:43,990][27935] Avg episode reward: [(0, '-1.790')] [2022-07-13 11:31:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4825.0). Total num frames: 293892096. Throughput: 0: 9682.5. Samples: 587807560. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:48,989][27935] Avg episode reward: [(0, '-1.491')] [2022-07-13 11:31:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 293916672. Throughput: 0: 9674.0. Samples: 587836636. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:53,990][27935] Avg episode reward: [(0, '-1.304')] [2022-07-13 11:31:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 293943296. Throughput: 0: 9679.7. Samples: 587894948. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:31:58,991][27935] Avg episode reward: [(0, '-1.241')] [2022-07-13 11:32:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 293965824. Throughput: 0: 9032.5. Samples: 587924008. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:03,990][27935] Avg episode reward: [(0, '-2.165')] [2022-07-13 11:32:08,991][27935] Fps is (10 sec: 4504.8, 60 sec: 4795.6, 300 sec: 4828.4). Total num frames: 293988352. Throughput: 0: 9600.2. Samples: 587978324. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:08,991][27935] Avg episode reward: [(0, '-2.151')] [2022-07-13 11:32:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 294012928. Throughput: 0: 9609.6. Samples: 588036924. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:13,990][27935] Avg episode reward: [(0, '-3.663')] [2022-07-13 11:32:18,989][27935] Fps is (10 sec: 4916.1, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 294037504. Throughput: 0: 9628.3. Samples: 588095004. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:18,990][27935] Avg episode reward: [(0, '-2.948')] [2022-07-13 11:32:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 294063104. Throughput: 0: 9636.3. Samples: 588124408. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:23,991][27935] Avg episode reward: [(0, '-3.000')] [2022-07-13 11:32:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 294087680. Throughput: 0: 9635.0. Samples: 588182836. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:28,990][27935] Avg episode reward: [(0, '-3.583')] [2022-07-13 11:32:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 294112256. Throughput: 0: 9625.2. Samples: 588240692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:33,989][27935] Avg episode reward: [(0, '-2.993')] [2022-07-13 11:32:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 294134784. Throughput: 0: 9631.1. Samples: 588270036. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:38,990][27935] Avg episode reward: [(0, '-2.884')] [2022-07-13 11:32:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 294158336. Throughput: 0: 9621.3. Samples: 588327904. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:43,989][27935] Avg episode reward: [(0, '-1.885')] [2022-07-13 11:32:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 294183936. Throughput: 0: 10274.0. Samples: 588386336. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:48,989][27935] Avg episode reward: [(0, '-1.468')] [2022-07-13 11:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 294208512. Throughput: 0: 9718.9. Samples: 588415656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:53,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 11:32:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 294233088. Throughput: 0: 9718.5. Samples: 588474256. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:32:58,989][27935] Avg episode reward: [(0, '-0.973')] [2022-07-13 11:33:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 294254592. Throughput: 0: 9619.6. Samples: 588527884. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:33:03,989][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 11:33:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4830.0, 300 sec: 4821.5). Total num frames: 294278144. Throughput: 0: 9593.5. Samples: 588556116. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:33:08,989][27935] Avg episode reward: [(0, '-1.248')] [2022-07-13 11:33:13,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4846.8, 300 sec: 4828.4). Total num frames: 294303744. Throughput: 0: 9604.7. Samples: 588615064. Policy #0 lag: (min: 0.0, avg: 9.1, max: 21.0) [2022-07-13 11:33:13,991][27935] Avg episode reward: [(0, '-0.662')] [2022-07-13 11:33:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 294326272. Throughput: 0: 9620.2. Samples: 588673600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:18,989][27935] Avg episode reward: [(0, '-1.283')] [2022-07-13 11:33:23,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 294351872. Throughput: 0: 9618.6. Samples: 588702872. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:23,989][27935] Avg episode reward: [(0, '-0.874')] [2022-07-13 11:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 294375424. Throughput: 0: 9635.8. Samples: 588761516. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:28,989][27935] Avg episode reward: [(0, '-1.125')] [2022-07-13 11:33:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 294400000. Throughput: 0: 9633.8. Samples: 588819856. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:33,989][27935] Avg episode reward: [(0, '-2.257')] [2022-07-13 11:33:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 294424576. Throughput: 0: 9623.3. Samples: 588848704. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:38,989][27935] Avg episode reward: [(0, '-1.696')] [2022-07-13 11:33:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 294450176. Throughput: 0: 9631.0. Samples: 588907652. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:43,989][27935] Avg episode reward: [(0, '-1.069')] [2022-07-13 11:33:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 294473728. Throughput: 0: 9740.4. Samples: 588966204. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:48,989][27935] Avg episode reward: [(0, '-0.254')] [2022-07-13 11:33:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 294497280. Throughput: 0: 9760.1. Samples: 588995320. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:53,989][27935] Avg episode reward: [(0, '-0.944')] [2022-07-13 11:33:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 294522880. Throughput: 0: 9757.8. Samples: 589054148. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:33:58,989][27935] Avg episode reward: [(0, '-0.986')] [2022-07-13 11:34:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 294544384. Throughput: 0: 9661.6. Samples: 589108372. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:03,989][27935] Avg episode reward: [(0, '-1.663')] [2022-07-13 11:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4825.0). Total num frames: 294568960. Throughput: 0: 9656.7. Samples: 589137424. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:08,991][27935] Avg episode reward: [(0, '-0.417')] [2022-07-13 11:34:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.9, 300 sec: 4821.5). Total num frames: 294592512. Throughput: 0: 9655.7. Samples: 589196024. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:13,989][27935] Avg episode reward: [(0, '-1.097')] [2022-07-13 11:34:18,989][27935] Fps is (10 sec: 4812.5, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 294617088. Throughput: 0: 9660.2. Samples: 589254568. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:18,990][27935] Avg episode reward: [(0, '-1.088')] [2022-07-13 11:34:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 294641664. Throughput: 0: 9670.9. Samples: 589283896. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:23,989][27935] Avg episode reward: [(0, '-2.520')] [2022-07-13 11:34:28,989][27935] Fps is (10 sec: 4915.5, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 294666240. Throughput: 0: 9663.3. Samples: 589342500. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:28,989][27935] Avg episode reward: [(0, '-3.638')] [2022-07-13 11:34:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 294690816. Throughput: 0: 9657.1. Samples: 589400772. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:33,989][27935] Avg episode reward: [(0, '-3.577')] [2022-07-13 11:34:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 294715392. Throughput: 0: 9666.3. Samples: 589430304. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:38,989][27935] Avg episode reward: [(0, '-3.027')] [2022-07-13 11:34:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 294739968. Throughput: 0: 9666.5. Samples: 589489140. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:43,989][27935] Avg episode reward: [(0, '-3.149')] [2022-07-13 11:34:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 294763520. Throughput: 0: 9779.1. Samples: 589548432. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:48,989][27935] Avg episode reward: [(0, '-3.095')] [2022-07-13 11:34:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 294789120. Throughput: 0: 9780.5. Samples: 589577548. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:53,990][27935] Avg episode reward: [(0, '-2.129')] [2022-07-13 11:34:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 294812672. Throughput: 0: 9777.5. Samples: 589636012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:34:58,990][27935] Avg episode reward: [(0, '-0.221')] [2022-07-13 11:35:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 294836224. Throughput: 0: 9697.2. Samples: 589690936. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:03,991][27935] Avg episode reward: [(0, '-0.846')] [2022-07-13 11:35:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 294859776. Throughput: 0: 9695.7. Samples: 589720204. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:08,990][27935] Avg episode reward: [(0, '-1.860')] [2022-07-13 11:35:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 294884352. Throughput: 0: 9696.6. Samples: 589778848. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:13,990][27935] Avg episode reward: [(0, '-1.468')] [2022-07-13 11:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 294909952. Throughput: 0: 9694.2. Samples: 589837012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:18,989][27935] Avg episode reward: [(0, '-1.353')] [2022-07-13 11:35:23,996][27935] Fps is (10 sec: 4911.5, 60 sec: 4863.4, 300 sec: 4828.3). Total num frames: 294933504. Throughput: 0: 9688.2. Samples: 589866348. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:23,997][27935] Avg episode reward: [(0, '-3.086')] [2022-07-13 11:35:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 294956032. Throughput: 0: 9671.5. Samples: 589924356. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:28,989][27935] Avg episode reward: [(0, '-4.266')] [2022-07-13 11:35:33,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 294981632. Throughput: 0: 9633.2. Samples: 589981928. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:33,989][27935] Avg episode reward: [(0, '-3.215')] [2022-07-13 11:35:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 295005184. Throughput: 0: 9626.3. Samples: 590010732. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 11:35:38,989][27935] Avg episode reward: [(0, '-3.300')] [2022-07-13 11:35:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 295030784. Throughput: 0: 9630.0. Samples: 590069360. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:35:43,990][27935] Avg episode reward: [(0, '-2.795')] [2022-07-13 11:35:48,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4829.7, 300 sec: 4828.4). Total num frames: 295053312. Throughput: 0: 9705.5. Samples: 590127704. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:35:48,993][27935] Avg episode reward: [(0, '-2.890')] [2022-07-13 11:35:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 295077888. Throughput: 0: 9694.0. Samples: 590156436. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:35:53,990][27935] Avg episode reward: [(0, '-3.089')] [2022-07-13 11:35:58,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 295102464. Throughput: 0: 9685.9. Samples: 590214712. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:35:58,991][27935] Avg episode reward: [(0, '-1.181')] [2022-07-13 11:36:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 295123968. Throughput: 0: 9589.2. Samples: 590268524. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:03,989][27935] Avg episode reward: [(0, '-1.548')] [2022-07-13 11:36:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 295148544. Throughput: 0: 9584.4. Samples: 590297572. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:08,989][27935] Avg episode reward: [(0, '-1.574')] [2022-07-13 11:36:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 295173120. Throughput: 0: 9585.4. Samples: 590355700. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:13,989][27935] Avg episode reward: [(0, '-0.893')] [2022-07-13 11:36:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 295197696. Throughput: 0: 9585.3. Samples: 590413268. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:18,989][27935] Avg episode reward: [(0, '-0.643')] [2022-07-13 11:36:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.3, 300 sec: 4828.4). Total num frames: 295221248. Throughput: 0: 9581.1. Samples: 590441880. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:23,989][27935] Avg episode reward: [(0, '-0.636')] [2022-07-13 11:36:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 295243776. Throughput: 0: 9569.3. Samples: 590499980. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:28,989][27935] Avg episode reward: [(0, '-1.219')] [2022-07-13 11:36:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 295268352. Throughput: 0: 9556.7. Samples: 590557736. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:33,989][27935] Avg episode reward: [(0, '-1.285')] [2022-07-13 11:36:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 295293952. Throughput: 0: 9564.8. Samples: 590586852. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:38,989][27935] Avg episode reward: [(0, '-0.707')] [2022-07-13 11:36:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 295317504. Throughput: 0: 9565.6. Samples: 590645164. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:43,989][27935] Avg episode reward: [(0, '-2.427')] [2022-07-13 11:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.0, 300 sec: 4831.9). Total num frames: 295342080. Throughput: 0: 9669.8. Samples: 590703664. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:48,990][27935] Avg episode reward: [(0, '-2.171')] [2022-07-13 11:36:53,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 295365632. Throughput: 0: 9669.8. Samples: 590732716. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:53,989][27935] Avg episode reward: [(0, '-2.058')] [2022-07-13 11:36:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 295391232. Throughput: 0: 9674.7. Samples: 590791060. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:36:58,989][27935] Avg episode reward: [(0, '-2.911')] [2022-07-13 11:37:03,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 295414784. Throughput: 0: 9046.8. Samples: 590820372. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:03,991][27935] Avg episode reward: [(0, '-2.513')] [2022-07-13 11:37:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 295436288. Throughput: 0: 9623.1. Samples: 590874920. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:08,989][27935] Avg episode reward: [(0, '-2.197')] [2022-07-13 11:37:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 295462912. Throughput: 0: 9637.5. Samples: 590933668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:13,990][27935] Avg episode reward: [(0, '-2.311')] [2022-07-13 11:37:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 295486464. Throughput: 0: 9652.7. Samples: 590992108. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:18,989][27935] Avg episode reward: [(0, '-0.756')] [2022-07-13 11:37:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 295511040. Throughput: 0: 9652.8. Samples: 591021228. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:23,990][27935] Avg episode reward: [(0, '-0.817')] [2022-07-13 11:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 295535616. Throughput: 0: 9652.6. Samples: 591079532. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:28,990][27935] Avg episode reward: [(0, '-1.361')] [2022-07-13 11:37:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 295559168. Throughput: 0: 9649.1. Samples: 591137876. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:33,990][27935] Avg episode reward: [(0, '-1.022')] [2022-07-13 11:37:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 295582720. Throughput: 0: 9653.3. Samples: 591167112. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:38,991][27935] Avg episode reward: [(0, '-1.260')] [2022-07-13 11:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 295607296. Throughput: 0: 9638.4. Samples: 591224788. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:43,990][27935] Avg episode reward: [(0, '-1.828')] [2022-07-13 11:37:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 295632896. Throughput: 0: 10281.2. Samples: 591283024. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:48,991][27935] Avg episode reward: [(0, '-2.471')] [2022-07-13 11:37:53,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4829.8, 300 sec: 4821.5). Total num frames: 295655424. Throughput: 0: 9716.8. Samples: 591312188. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:53,991][27935] Avg episode reward: [(0, '-2.368')] [2022-07-13 11:37:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 295680000. Throughput: 0: 9703.5. Samples: 591370324. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:37:58,990][27935] Avg episode reward: [(0, '-3.135')] [2022-07-13 11:38:03,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 295702528. Throughput: 0: 9614.5. Samples: 591424760. Policy #0 lag: (min: 0.0, avg: 9.9, max: 23.0) [2022-07-13 11:38:03,989][27935] Avg episode reward: [(0, '-3.193')] [2022-07-13 11:38:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 295726080. Throughput: 0: 9610.9. Samples: 591453720. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:08,990][27935] Avg episode reward: [(0, '-2.803')] [2022-07-13 11:38:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 295751680. Throughput: 0: 9618.0. Samples: 591512344. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:13,989][27935] Avg episode reward: [(0, '-3.058')] [2022-07-13 11:38:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 295776256. Throughput: 0: 9622.6. Samples: 591570892. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:18,991][27935] Avg episode reward: [(0, '-2.692')] [2022-07-13 11:38:23,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4812.6, 300 sec: 4828.4). Total num frames: 295799808. Throughput: 0: 9627.7. Samples: 591600376. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:23,991][27935] Avg episode reward: [(0, '-2.426')] [2022-07-13 11:38:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 295825408. Throughput: 0: 9645.9. Samples: 591658856. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:28,989][27935] Avg episode reward: [(0, '-2.421')] [2022-07-13 11:38:33,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 295848960. Throughput: 0: 9649.8. Samples: 591717264. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:33,989][27935] Avg episode reward: [(0, '-1.672')] [2022-07-13 11:38:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 295872512. Throughput: 0: 9649.8. Samples: 591746416. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:38,989][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 11:38:43,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 295898112. Throughput: 0: 9667.3. Samples: 591805356. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:43,990][27935] Avg episode reward: [(0, '-1.313')] [2022-07-13 11:38:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 295921664. Throughput: 0: 9757.8. Samples: 591863860. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:48,989][27935] Avg episode reward: [(0, '-0.705')] [2022-07-13 11:38:53,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4847.0, 300 sec: 4824.9). Total num frames: 295946240. Throughput: 0: 9764.2. Samples: 591893108. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:53,989][27935] Avg episode reward: [(0, '-0.631')] [2022-07-13 11:38:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 295970816. Throughput: 0: 9759.5. Samples: 591951520. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:38:58,989][27935] Avg episode reward: [(0, '-2.142')] [2022-07-13 11:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 295993344. Throughput: 0: 9682.7. Samples: 592006612. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:03,989][27935] Avg episode reward: [(0, '-2.110')] [2022-07-13 11:39:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 296017920. Throughput: 0: 9658.7. Samples: 592035000. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:08,989][27935] Avg episode reward: [(0, '-2.618')] [2022-07-13 11:39:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 296041472. Throughput: 0: 9626.7. Samples: 592092060. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:13,989][27935] Avg episode reward: [(0, '-3.370')] [2022-07-13 11:39:18,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4829.7, 300 sec: 4828.4). Total num frames: 296066048. Throughput: 0: 9619.1. Samples: 592150148. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:18,992][27935] Avg episode reward: [(0, '-3.310')] [2022-07-13 11:39:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4824.9). Total num frames: 296089600. Throughput: 0: 9628.9. Samples: 592179716. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:23,989][27935] Avg episode reward: [(0, '-4.199')] [2022-07-13 11:39:28,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 296115200. Throughput: 0: 9618.8. Samples: 592238200. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:28,989][27935] Avg episode reward: [(0, '-4.662')] [2022-07-13 11:39:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 296137728. Throughput: 0: 9619.6. Samples: 592296744. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:33,989][27935] Avg episode reward: [(0, '-3.229')] [2022-07-13 11:39:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 296162304. Throughput: 0: 9612.1. Samples: 592325652. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:38,989][27935] Avg episode reward: [(0, '-2.858')] [2022-07-13 11:39:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 296187904. Throughput: 0: 9612.7. Samples: 592384092. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:43,989][27935] Avg episode reward: [(0, '-2.345')] [2022-07-13 11:39:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 296210432. Throughput: 0: 9694.8. Samples: 592442876. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:48,989][27935] Avg episode reward: [(0, '-2.418')] [2022-07-13 11:39:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 296237056. Throughput: 0: 9718.2. Samples: 592472320. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:53,989][27935] Avg episode reward: [(0, '-1.727')] [2022-07-13 11:39:58,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4812.6, 300 sec: 4824.9). Total num frames: 296259584. Throughput: 0: 9745.8. Samples: 592530644. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:39:58,992][27935] Avg episode reward: [(0, '-2.835')] [2022-07-13 11:40:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 296283136. Throughput: 0: 9674.2. Samples: 592585460. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:03,989][27935] Avg episode reward: [(0, '-2.386')] [2022-07-13 11:40:08,989][27935] Fps is (10 sec: 4813.9, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 296307712. Throughput: 0: 9671.6. Samples: 592614936. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:08,990][27935] Avg episode reward: [(0, '-1.829')] [2022-07-13 11:40:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 296332288. Throughput: 0: 9675.0. Samples: 592673576. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:13,989][27935] Avg episode reward: [(0, '-2.008')] [2022-07-13 11:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4825.1). Total num frames: 296356864. Throughput: 0: 9676.8. Samples: 592732200. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:18,990][27935] Avg episode reward: [(0, '-2.394')] [2022-07-13 11:40:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 296381440. Throughput: 0: 9689.8. Samples: 592761692. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:23,989][27935] Avg episode reward: [(0, '-2.237')] [2022-07-13 11:40:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 296406016. Throughput: 0: 9690.7. Samples: 592820172. Policy #0 lag: (min: 0.0, avg: 10.1, max: 20.0) [2022-07-13 11:40:28,989][27935] Avg episode reward: [(0, '-1.203')] [2022-07-13 11:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 296429568. Throughput: 0: 9037.1. Samples: 592849544. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:33,989][27935] Avg episode reward: [(0, '-1.619')] [2022-07-13 11:40:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 296454144. Throughput: 0: 9677.6. Samples: 592907812. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:38,989][27935] Avg episode reward: [(0, '-2.341')] [2022-07-13 11:40:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.5). Total num frames: 296477696. Throughput: 0: 9692.6. Samples: 592966788. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:43,990][27935] Avg episode reward: [(0, '-1.953')] [2022-07-13 11:40:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 296503296. Throughput: 0: 9773.8. Samples: 593025280. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:48,990][27935] Avg episode reward: [(0, '-2.083')] [2022-07-13 11:40:53,991][27935] Fps is (10 sec: 5016.7, 60 sec: 4846.8, 300 sec: 4831.9). Total num frames: 296527872. Throughput: 0: 9776.9. Samples: 593054916. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:53,996][27935] Avg episode reward: [(0, '-2.541')] [2022-07-13 11:40:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.3, 300 sec: 4842.3). Total num frames: 296552448. Throughput: 0: 9783.2. Samples: 593113820. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:40:58,989][27935] Avg episode reward: [(0, '-2.194')] [2022-07-13 11:41:03,989][27935] Fps is (10 sec: 4711.3, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 296574976. Throughput: 0: 9687.3. Samples: 593168128. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:03,990][27935] Avg episode reward: [(0, '-1.643')] [2022-07-13 11:41:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 296598528. Throughput: 0: 9683.6. Samples: 593197456. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:08,989][27935] Avg episode reward: [(0, '-1.544')] [2022-07-13 11:41:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 296622080. Throughput: 0: 9667.5. Samples: 593255208. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:13,989][27935] Avg episode reward: [(0, '-1.186')] [2022-07-13 11:41:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 296647680. Throughput: 0: 10303.0. Samples: 593313180. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:18,989][27935] Avg episode reward: [(0, '-1.025')] [2022-07-13 11:41:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 296671232. Throughput: 0: 9649.1. Samples: 593342020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:23,989][27935] Avg episode reward: [(0, '-0.386')] [2022-07-13 11:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 296695808. Throughput: 0: 9640.8. Samples: 593400624. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:28,989][27935] Avg episode reward: [(0, '-0.629')] [2022-07-13 11:41:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 296719360. Throughput: 0: 9629.0. Samples: 593458584. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:33,989][27935] Avg episode reward: [(0, '-1.504')] [2022-07-13 11:41:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 296742912. Throughput: 0: 9607.8. Samples: 593487248. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:38,989][27935] Avg episode reward: [(0, '-1.988')] [2022-07-13 11:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 296768512. Throughput: 0: 9588.8. Samples: 593545316. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:43,990][27935] Avg episode reward: [(0, '-1.424')] [2022-07-13 11:41:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 296792064. Throughput: 0: 9670.0. Samples: 593603276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:48,990][27935] Avg episode reward: [(0, '-2.158')] [2022-07-13 11:41:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4828.4). Total num frames: 296815616. Throughput: 0: 9667.8. Samples: 593632508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:53,989][27935] Avg episode reward: [(0, '-1.876')] [2022-07-13 11:41:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 296840192. Throughput: 0: 9678.9. Samples: 593690760. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:41:58,990][27935] Avg episode reward: [(0, '-1.774')] [2022-07-13 11:42:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 296862720. Throughput: 0: 9587.3. Samples: 593744608. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:03,991][27935] Avg episode reward: [(0, '-1.659')] [2022-07-13 11:42:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 296885248. Throughput: 0: 9593.5. Samples: 593773728. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:08,990][27935] Avg episode reward: [(0, '-1.173')] [2022-07-13 11:42:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 296911872. Throughput: 0: 9583.4. Samples: 593831876. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:13,990][27935] Avg episode reward: [(0, '-1.108')] [2022-07-13 11:42:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 296934400. Throughput: 0: 9595.8. Samples: 593890396. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:18,989][27935] Avg episode reward: [(0, '-1.800')] [2022-07-13 11:42:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 296961024. Throughput: 0: 9612.8. Samples: 593919824. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:23,989][27935] Avg episode reward: [(0, '-1.458')] [2022-07-13 11:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 296983552. Throughput: 0: 9618.0. Samples: 593978128. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:28,989][27935] Avg episode reward: [(0, '-1.274')] [2022-07-13 11:42:33,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 297009152. Throughput: 0: 9627.3. Samples: 594036504. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:33,989][27935] Avg episode reward: [(0, '-1.836')] [2022-07-13 11:42:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 297032704. Throughput: 0: 9630.7. Samples: 594065888. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:38,989][27935] Avg episode reward: [(0, '-1.892')] [2022-07-13 11:42:43,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 297056256. Throughput: 0: 9617.3. Samples: 594123536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:43,989][27935] Avg episode reward: [(0, '-1.235')] [2022-07-13 11:42:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 297080832. Throughput: 0: 9717.0. Samples: 594181872. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:48,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 11:42:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 297105408. Throughput: 0: 9711.6. Samples: 594210752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 11:42:53,989][27935] Avg episode reward: [(0, '-2.442')] [2022-07-13 11:42:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 297129984. Throughput: 0: 9712.4. Samples: 594268932. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:42:58,989][27935] Avg episode reward: [(0, '-2.954')] [2022-07-13 11:43:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 297152512. Throughput: 0: 9618.0. Samples: 594323208. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:03,989][27935] Avg episode reward: [(0, '-2.510')] [2022-07-13 11:43:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 297175040. Throughput: 0: 9613.4. Samples: 594352428. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:08,989][27935] Avg episode reward: [(0, '-2.537')] [2022-07-13 11:43:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 297199616. Throughput: 0: 9606.3. Samples: 594410412. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:13,990][27935] Avg episode reward: [(0, '-2.917')] [2022-07-13 11:43:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 297225216. Throughput: 0: 9597.7. Samples: 594468400. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:18,989][27935] Avg episode reward: [(0, '-2.614')] [2022-07-13 11:43:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 297248768. Throughput: 0: 9594.0. Samples: 594497620. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:23,990][27935] Avg episode reward: [(0, '-2.346')] [2022-07-13 11:43:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 297273344. Throughput: 0: 9603.0. Samples: 594555672. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:28,989][27935] Avg episode reward: [(0, '-1.679')] [2022-07-13 11:43:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 297296896. Throughput: 0: 9590.1. Samples: 594613428. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:33,990][27935] Avg episode reward: [(0, '-0.521')] [2022-07-13 11:43:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 297321472. Throughput: 0: 9590.3. Samples: 594642316. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:38,989][27935] Avg episode reward: [(0, '-3.036')] [2022-07-13 11:43:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 297344000. Throughput: 0: 9586.0. Samples: 594700300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:43,989][27935] Avg episode reward: [(0, '-2.843')] [2022-07-13 11:43:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 297370624. Throughput: 0: 9678.3. Samples: 594758732. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:48,989][27935] Avg episode reward: [(0, '-3.059')] [2022-07-13 11:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 297393152. Throughput: 0: 9677.6. Samples: 594787920. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:53,989][27935] Avg episode reward: [(0, '-2.552')] [2022-07-13 11:43:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 297418752. Throughput: 0: 9675.3. Samples: 594845800. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:43:58,990][27935] Avg episode reward: [(0, '-2.943')] [2022-07-13 11:44:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 297440256. Throughput: 0: 9600.8. Samples: 594900436. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:03,989][27935] Avg episode reward: [(0, '-3.478')] [2022-07-13 11:44:08,990][27935] Fps is (10 sec: 4607.4, 60 sec: 4829.8, 300 sec: 4824.9). Total num frames: 297464832. Throughput: 0: 9598.7. Samples: 594929572. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:08,991][27935] Avg episode reward: [(0, '-1.716')] [2022-07-13 11:44:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 297488384. Throughput: 0: 9594.4. Samples: 594987420. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:13,990][27935] Avg episode reward: [(0, '-0.445')] [2022-07-13 11:44:18,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 297512960. Throughput: 0: 9600.3. Samples: 595045440. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:18,989][27935] Avg episode reward: [(0, '-1.059')] [2022-07-13 11:44:23,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 297537536. Throughput: 0: 9605.4. Samples: 595074560. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:23,989][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 11:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 297562112. Throughput: 0: 9609.6. Samples: 595132732. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:28,989][27935] Avg episode reward: [(0, '-1.645')] [2022-07-13 11:44:33,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 297584640. Throughput: 0: 9595.6. Samples: 595190532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:33,989][27935] Avg episode reward: [(0, '-1.704')] [2022-07-13 11:44:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 297609216. Throughput: 0: 9591.5. Samples: 595219536. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:38,989][27935] Avg episode reward: [(0, '-1.741')] [2022-07-13 11:44:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 297633792. Throughput: 0: 9600.0. Samples: 595277800. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:43,989][27935] Avg episode reward: [(0, '-3.017')] [2022-07-13 11:44:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 297658368. Throughput: 0: 9040.4. Samples: 595307256. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:48,989][27935] Avg episode reward: [(0, '-3.384')] [2022-07-13 11:44:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.5). Total num frames: 297683968. Throughput: 0: 9693.8. Samples: 595365780. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:53,989][27935] Avg episode reward: [(0, '-2.881')] [2022-07-13 11:44:58,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4812.7, 300 sec: 4828.4). Total num frames: 297707520. Throughput: 0: 9701.1. Samples: 595423976. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:44:58,990][27935] Avg episode reward: [(0, '-2.209')] [2022-07-13 11:45:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 297729024. Throughput: 0: 9619.7. Samples: 595478328. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:45:03,989][27935] Avg episode reward: [(0, '-2.287')] [2022-07-13 11:45:08,989][27935] Fps is (10 sec: 4710.7, 60 sec: 4830.0, 300 sec: 4821.5). Total num frames: 297754624. Throughput: 0: 9621.0. Samples: 595507504. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:45:08,990][27935] Avg episode reward: [(0, '-3.126')] [2022-07-13 11:45:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 297777152. Throughput: 0: 9602.9. Samples: 595564864. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:45:13,990][27935] Avg episode reward: [(0, '-3.175')] [2022-07-13 11:45:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 297800704. Throughput: 0: 9585.5. Samples: 595621880. Policy #0 lag: (min: 0.0, avg: 9.6, max: 22.0) [2022-07-13 11:45:18,990][27935] Avg episode reward: [(0, '-3.191')] [2022-07-13 11:45:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 297824256. Throughput: 0: 9581.4. Samples: 595650700. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:23,990][27935] Avg episode reward: [(0, '-3.703')] [2022-07-13 11:45:28,997][27935] Fps is (10 sec: 4911.4, 60 sec: 4795.1, 300 sec: 4814.4). Total num frames: 297849856. Throughput: 0: 9576.8. Samples: 595708832. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:28,997][27935] Avg episode reward: [(0, '-3.931')] [2022-07-13 11:45:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 297872384. Throughput: 0: 10206.7. Samples: 595766556. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:33,989][27935] Avg episode reward: [(0, '-3.331')] [2022-07-13 11:45:38,989][27935] Fps is (10 sec: 4714.1, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 297896960. Throughput: 0: 9542.9. Samples: 595795212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:38,989][27935] Avg episode reward: [(0, '-2.216')] [2022-07-13 11:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 297920512. Throughput: 0: 9538.0. Samples: 595853180. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:43,989][27935] Avg episode reward: [(0, '-2.338')] [2022-07-13 11:45:48,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 297946112. Throughput: 0: 9619.6. Samples: 595911212. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:48,989][27935] Avg episode reward: [(0, '-2.540')] [2022-07-13 11:45:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 297970688. Throughput: 0: 9619.6. Samples: 595940384. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:53,989][27935] Avg episode reward: [(0, '-0.760')] [2022-07-13 11:45:58,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4761.7, 300 sec: 4807.6). Total num frames: 297993216. Throughput: 0: 9638.7. Samples: 595998604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:45:58,989][27935] Avg episode reward: [(0, '-0.605')] [2022-07-13 11:46:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 298016768. Throughput: 0: 9578.9. Samples: 596052932. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:03,989][27935] Avg episode reward: [(0, '-1.493')] [2022-07-13 11:46:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 298040320. Throughput: 0: 9586.0. Samples: 596082072. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:08,990][27935] Avg episode reward: [(0, '-1.813')] [2022-07-13 11:46:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 298065920. Throughput: 0: 9586.5. Samples: 596140148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:13,990][27935] Avg episode reward: [(0, '-3.026')] [2022-07-13 11:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 298089472. Throughput: 0: 9582.7. Samples: 596197776. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:18,991][27935] Avg episode reward: [(0, '-3.336')] [2022-07-13 11:46:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 298113024. Throughput: 0: 9583.6. Samples: 596226476. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:23,989][27935] Avg episode reward: [(0, '-3.204')] [2022-07-13 11:46:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4796.4, 300 sec: 4807.6). Total num frames: 298137600. Throughput: 0: 9587.8. Samples: 596284632. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:28,989][27935] Avg episode reward: [(0, '-3.521')] [2022-07-13 11:46:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 298161152. Throughput: 0: 9568.7. Samples: 596341800. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:33,989][27935] Avg episode reward: [(0, '-3.352')] [2022-07-13 11:46:38,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 298185728. Throughput: 0: 9559.9. Samples: 596370580. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:38,989][27935] Avg episode reward: [(0, '-2.223')] [2022-07-13 11:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 298210304. Throughput: 0: 9566.2. Samples: 596429084. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:43,989][27935] Avg episode reward: [(0, '-1.798')] [2022-07-13 11:46:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 298233856. Throughput: 0: 9657.3. Samples: 596487512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:48,989][27935] Avg episode reward: [(0, '-0.972')] [2022-07-13 11:46:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 298257408. Throughput: 0: 9658.7. Samples: 596516712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:53,990][27935] Avg episode reward: [(0, '0.018')] [2022-07-13 11:46:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 298283008. Throughput: 0: 9671.7. Samples: 596575376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:46:58,989][27935] Avg episode reward: [(0, '-0.667')] [2022-07-13 11:47:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 298304512. Throughput: 0: 9603.7. Samples: 596629940. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:03,989][27935] Avg episode reward: [(0, '-0.280')] [2022-07-13 11:47:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 298329088. Throughput: 0: 9613.2. Samples: 596659072. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:08,989][27935] Avg episode reward: [(0, '-1.029')] [2022-07-13 11:47:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 298354688. Throughput: 0: 9628.4. Samples: 596717908. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:13,989][27935] Avg episode reward: [(0, '-1.515')] [2022-07-13 11:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 298377216. Throughput: 0: 9644.4. Samples: 596775800. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:18,989][27935] Avg episode reward: [(0, '-1.165')] [2022-07-13 11:47:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 298403840. Throughput: 0: 9648.9. Samples: 596804780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:23,989][27935] Avg episode reward: [(0, '-1.152')] [2022-07-13 11:47:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 298427392. Throughput: 0: 9639.5. Samples: 596862860. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:28,989][27935] Avg episode reward: [(0, '-1.452')] [2022-07-13 11:47:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 298449920. Throughput: 0: 9645.5. Samples: 596921560. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:33,989][27935] Avg episode reward: [(0, '-1.519')] [2022-07-13 11:47:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 298474496. Throughput: 0: 9642.0. Samples: 596950604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:38,990][27935] Avg episode reward: [(0, '-1.894')] [2022-07-13 11:47:43,991][27935] Fps is (10 sec: 5016.3, 60 sec: 4829.7, 300 sec: 4811.0). Total num frames: 298500096. Throughput: 0: 9635.3. Samples: 597008988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 11:47:43,992][27935] Avg episode reward: [(0, '-0.971')] [2022-07-13 11:47:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 298524672. Throughput: 0: 9074.2. Samples: 597038280. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:47:48,990][27935] Avg episode reward: [(0, '-0.134')] [2022-07-13 11:47:53,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4864.0, 300 sec: 4811.1). Total num frames: 298549248. Throughput: 0: 9728.8. Samples: 597096868. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:47:53,989][27935] Avg episode reward: [(0, '-0.065')] [2022-07-13 11:47:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 298571776. Throughput: 0: 9720.1. Samples: 597155312. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:47:58,989][27935] Avg episode reward: [(0, '-0.565')] [2022-07-13 11:48:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 298594304. Throughput: 0: 9646.6. Samples: 597209896. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:03,989][27935] Avg episode reward: [(0, '-0.428')] [2022-07-13 11:48:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 298618880. Throughput: 0: 9657.2. Samples: 597239356. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:08,989][27935] Avg episode reward: [(0, '-0.831')] [2022-07-13 11:48:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 298645504. Throughput: 0: 9665.0. Samples: 597297784. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:13,989][27935] Avg episode reward: [(0, '-0.821')] [2022-07-13 11:48:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 298669056. Throughput: 0: 9657.2. Samples: 597356136. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:18,989][27935] Avg episode reward: [(0, '-1.025')] [2022-07-13 11:48:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 298692608. Throughput: 0: 9664.2. Samples: 597385492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:23,989][27935] Avg episode reward: [(0, '-1.530')] [2022-07-13 11:48:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 298716160. Throughput: 0: 9673.6. Samples: 597444276. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:28,989][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 11:48:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 298740736. Throughput: 0: 10312.6. Samples: 597502348. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:33,989][27935] Avg episode reward: [(0, '-1.507')] [2022-07-13 11:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 298765312. Throughput: 0: 9661.0. Samples: 597531612. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:38,989][27935] Avg episode reward: [(0, '-2.131')] [2022-07-13 11:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.1, 300 sec: 4811.1). Total num frames: 298789888. Throughput: 0: 9652.0. Samples: 597589652. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:43,989][27935] Avg episode reward: [(0, '-1.946')] [2022-07-13 11:48:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 298813440. Throughput: 0: 9086.8. Samples: 597618804. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:48,989][27935] Avg episode reward: [(0, '-2.520')] [2022-07-13 11:48:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 298838016. Throughput: 0: 9727.6. Samples: 597677100. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:53,989][27935] Avg episode reward: [(0, '-2.082')] [2022-07-13 11:48:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 298862592. Throughput: 0: 9725.3. Samples: 597735420. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:48:58,989][27935] Avg episode reward: [(0, '-2.177')] [2022-07-13 11:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4814.6). Total num frames: 298885120. Throughput: 0: 9641.3. Samples: 597789996. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:03,989][27935] Avg episode reward: [(0, '-2.377')] [2022-07-13 11:49:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4821.5). Total num frames: 298910720. Throughput: 0: 9644.4. Samples: 597819492. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:08,989][27935] Avg episode reward: [(0, '-1.670')] [2022-07-13 11:49:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 298934272. Throughput: 0: 9633.7. Samples: 597877792. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:13,990][27935] Avg episode reward: [(0, '-1.182')] [2022-07-13 11:49:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 298957824. Throughput: 0: 9651.4. Samples: 597936664. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:18,990][27935] Avg episode reward: [(0, '-1.345')] [2022-07-13 11:49:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 298982400. Throughput: 0: 9648.8. Samples: 597965808. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:23,989][27935] Avg episode reward: [(0, '-1.004')] [2022-07-13 11:49:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 299006976. Throughput: 0: 9658.8. Samples: 598024296. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:28,989][27935] Avg episode reward: [(0, '-0.896')] [2022-07-13 11:49:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 299031552. Throughput: 0: 10302.6. Samples: 598082420. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:33,989][27935] Avg episode reward: [(0, '-1.461')] [2022-07-13 11:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 299056128. Throughput: 0: 9658.1. Samples: 598111716. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:38,991][27935] Avg episode reward: [(0, '-1.546')] [2022-07-13 11:49:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 299081728. Throughput: 0: 9666.7. Samples: 598170420. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:43,989][27935] Avg episode reward: [(0, '-1.911')] [2022-07-13 11:49:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 299103232. Throughput: 0: 9763.1. Samples: 598229336. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:48,989][27935] Avg episode reward: [(0, '-2.168')] [2022-07-13 11:49:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 299128832. Throughput: 0: 9762.0. Samples: 598258780. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:53,990][27935] Avg episode reward: [(0, '-1.164')] [2022-07-13 11:49:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 299153408. Throughput: 0: 9765.3. Samples: 598317228. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:49:58,991][27935] Avg episode reward: [(0, '-1.186')] [2022-07-13 11:50:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 299175936. Throughput: 0: 9662.6. Samples: 598371480. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:50:03,991][27935] Avg episode reward: [(0, '-1.213')] [2022-07-13 11:50:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 299201536. Throughput: 0: 9666.5. Samples: 598400800. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 11:50:08,992][27935] Avg episode reward: [(0, '-0.611')] [2022-07-13 11:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 299224064. Throughput: 0: 9665.3. Samples: 598459236. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:13,989][27935] Avg episode reward: [(0, '-0.551')] [2022-07-13 11:50:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 299248640. Throughput: 0: 9668.8. Samples: 598517516. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:18,990][27935] Avg episode reward: [(0, '-0.007')] [2022-07-13 11:50:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4828.5). Total num frames: 299274240. Throughput: 0: 9664.6. Samples: 598546624. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:23,989][27935] Avg episode reward: [(0, '0.479')] [2022-07-13 11:50:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 299298816. Throughput: 0: 9655.4. Samples: 598604912. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:28,989][27935] Avg episode reward: [(0, '0.173')] [2022-07-13 11:50:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 299321344. Throughput: 0: 9636.2. Samples: 598662964. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:33,989][27935] Avg episode reward: [(0, '-0.815')] [2022-07-13 11:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 299346944. Throughput: 0: 9635.6. Samples: 598692380. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:38,989][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 11:50:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4825.0). Total num frames: 299369472. Throughput: 0: 9633.0. Samples: 598750712. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:43,989][27935] Avg episode reward: [(0, '-2.043')] [2022-07-13 11:50:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 299394048. Throughput: 0: 9729.9. Samples: 598809324. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:48,989][27935] Avg episode reward: [(0, '-2.402')] [2022-07-13 11:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 299419648. Throughput: 0: 9730.5. Samples: 598838672. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:53,989][27935] Avg episode reward: [(0, '-2.430')] [2022-07-13 11:50:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 299444224. Throughput: 0: 9729.9. Samples: 598897080. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:50:58,989][27935] Avg episode reward: [(0, '-2.592')] [2022-07-13 11:51:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 299465728. Throughput: 0: 9640.2. Samples: 598951324. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:03,989][27935] Avg episode reward: [(0, '-2.910')] [2022-07-13 11:51:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 299490304. Throughput: 0: 9645.6. Samples: 598980676. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:08,989][27935] Avg episode reward: [(0, '-2.039')] [2022-07-13 11:51:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 299514880. Throughput: 0: 9649.6. Samples: 599039144. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:13,989][27935] Avg episode reward: [(0, '-2.670')] [2022-07-13 11:51:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 299538432. Throughput: 0: 9618.3. Samples: 599095788. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:18,989][27935] Avg episode reward: [(0, '-2.046')] [2022-07-13 11:51:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 299561984. Throughput: 0: 9604.5. Samples: 599124584. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:23,989][27935] Avg episode reward: [(0, '-1.886')] [2022-07-13 11:51:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 299585536. Throughput: 0: 9585.1. Samples: 599182040. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:28,989][27935] Avg episode reward: [(0, '-1.983')] [2022-07-13 11:51:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 299610112. Throughput: 0: 9559.7. Samples: 599239508. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:33,996][27935] Avg episode reward: [(0, '-2.315')] [2022-07-13 11:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 299634688. Throughput: 0: 9558.6. Samples: 599268808. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:38,989][27935] Avg episode reward: [(0, '-1.584')] [2022-07-13 11:51:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 299658240. Throughput: 0: 9554.7. Samples: 599327040. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:43,989][27935] Avg episode reward: [(0, '-1.239')] [2022-07-13 11:51:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 299682816. Throughput: 0: 9639.1. Samples: 599385084. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:48,989][27935] Avg episode reward: [(0, '-0.494')] [2022-07-13 11:51:53,990][27935] Fps is (10 sec: 4914.4, 60 sec: 4795.6, 300 sec: 4828.4). Total num frames: 299707392. Throughput: 0: 9636.0. Samples: 599414312. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:53,991][27935] Avg episode reward: [(0, '-0.515')] [2022-07-13 11:51:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 299731968. Throughput: 0: 9638.9. Samples: 599472896. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:51:58,989][27935] Avg episode reward: [(0, '-1.223')] [2022-07-13 11:52:03,989][27935] Fps is (10 sec: 4608.7, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 299753472. Throughput: 0: 9590.9. Samples: 599527380. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:03,989][27935] Avg episode reward: [(0, '-1.007')] [2022-07-13 11:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4825.0). Total num frames: 299778048. Throughput: 0: 9597.7. Samples: 599556480. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:08,989][27935] Avg episode reward: [(0, '-1.204')] [2022-07-13 11:52:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 299802624. Throughput: 0: 9620.0. Samples: 599614940. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:13,989][27935] Avg episode reward: [(0, '-1.104')] [2022-07-13 11:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 299826176. Throughput: 0: 9625.7. Samples: 599672664. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:18,989][27935] Avg episode reward: [(0, '-1.158')] [2022-07-13 11:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 299850752. Throughput: 0: 9623.3. Samples: 599701856. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:23,989][27935] Avg episode reward: [(0, '-2.045')] [2022-07-13 11:52:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 299875328. Throughput: 0: 9625.9. Samples: 599760204. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:28,989][27935] Avg episode reward: [(0, '-1.920')] [2022-07-13 11:52:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 299899904. Throughput: 0: 9619.8. Samples: 599817976. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:33,989][27935] Avg episode reward: [(0, '-2.038')] [2022-07-13 11:52:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 299923456. Throughput: 0: 9621.3. Samples: 599847256. Policy #0 lag: (min: 0.0, avg: 8.2, max: 21.0) [2022-07-13 11:52:38,990][27935] Avg episode reward: [(0, '-1.778')] [2022-07-13 11:52:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 299948032. Throughput: 0: 9591.1. Samples: 599904496. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:52:43,989][27935] Avg episode reward: [(0, '-2.063')] [2022-07-13 11:52:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 299971584. Throughput: 0: 9674.0. Samples: 599962712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:52:48,989][27935] Avg episode reward: [(0, '-2.535')] [2022-07-13 11:52:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4824.9). Total num frames: 299995136. Throughput: 0: 9674.7. Samples: 599991844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:52:53,989][27935] Avg episode reward: [(0, '-2.616')] [2022-07-13 11:52:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 300019712. Throughput: 0: 9666.5. Samples: 600049932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:52:58,989][27935] Avg episode reward: [(0, '-2.739')] [2022-07-13 11:53:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 300043264. Throughput: 0: 9589.7. Samples: 600104200. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:03,989][27935] Avg episode reward: [(0, '-1.751')] [2022-07-13 11:53:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 300066816. Throughput: 0: 9585.0. Samples: 600133180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:08,989][27935] Avg episode reward: [(0, '-0.836')] [2022-07-13 11:53:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 300091392. Throughput: 0: 9579.7. Samples: 600191292. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:13,989][27935] Avg episode reward: [(0, '-1.071')] [2022-07-13 11:53:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 300113920. Throughput: 0: 9587.2. Samples: 600249400. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:18,991][27935] Avg episode reward: [(0, '-1.804')] [2022-07-13 11:53:23,992][27935] Fps is (10 sec: 4708.9, 60 sec: 4795.5, 300 sec: 4821.4). Total num frames: 300138496. Throughput: 0: 9581.1. Samples: 600278436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:23,993][27935] Avg episode reward: [(0, '-1.786')] [2022-07-13 11:53:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 300164096. Throughput: 0: 9602.4. Samples: 600336604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:28,989][27935] Avg episode reward: [(0, '-1.970')] [2022-07-13 11:53:33,989][27935] Fps is (10 sec: 4814.4, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 300186624. Throughput: 0: 9596.9. Samples: 600394572. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:33,989][27935] Avg episode reward: [(0, '-1.872')] [2022-07-13 11:53:38,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4795.5, 300 sec: 4818.0). Total num frames: 300211200. Throughput: 0: 9593.8. Samples: 600423588. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:38,992][27935] Avg episode reward: [(0, '-1.956')] [2022-07-13 11:53:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 300235776. Throughput: 0: 9597.8. Samples: 600481832. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:43,989][27935] Avg episode reward: [(0, '-1.651')] [2022-07-13 11:53:48,989][27935] Fps is (10 sec: 4916.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 300260352. Throughput: 0: 9688.3. Samples: 600540172. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:48,989][27935] Avg episode reward: [(0, '-1.685')] [2022-07-13 11:53:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 300284928. Throughput: 0: 9692.4. Samples: 600569336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:53,989][27935] Avg episode reward: [(0, '-1.723')] [2022-07-13 11:53:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 300308480. Throughput: 0: 9702.6. Samples: 600627908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:53:58,990][27935] Avg episode reward: [(0, '-1.452')] [2022-07-13 11:54:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 300331008. Throughput: 0: 9621.0. Samples: 600682344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:03,989][27935] Avg episode reward: [(0, '-0.314')] [2022-07-13 11:54:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 300355584. Throughput: 0: 9614.1. Samples: 600711040. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:08,989][27935] Avg episode reward: [(0, '-0.705')] [2022-07-13 11:54:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 300379136. Throughput: 0: 9609.2. Samples: 600769020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:13,989][27935] Avg episode reward: [(0, '-1.039')] [2022-07-13 11:54:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 300403712. Throughput: 0: 9603.6. Samples: 600826732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:18,990][27935] Avg episode reward: [(0, '-0.371')] [2022-07-13 11:54:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.1, 300 sec: 4818.0). Total num frames: 300428288. Throughput: 0: 9605.3. Samples: 600855804. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:23,993][27935] Avg episode reward: [(0, '-0.828')] [2022-07-13 11:54:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 300452864. Throughput: 0: 9600.4. Samples: 600913852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:28,989][27935] Avg episode reward: [(0, '-0.381')] [2022-07-13 11:54:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 300476416. Throughput: 0: 9596.7. Samples: 600972024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:33,990][27935] Avg episode reward: [(0, '-0.329')] [2022-07-13 11:54:38,990][27935] Fps is (10 sec: 4607.5, 60 sec: 4795.8, 300 sec: 4804.1). Total num frames: 300498944. Throughput: 0: 9594.4. Samples: 601001096. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:38,992][27935] Avg episode reward: [(0, '-0.224')] [2022-07-13 11:54:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 300524544. Throughput: 0: 9591.5. Samples: 601059524. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:43,989][27935] Avg episode reward: [(0, '-0.518')] [2022-07-13 11:54:48,989][27935] Fps is (10 sec: 4915.7, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 300548096. Throughput: 0: 9677.6. Samples: 601117836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:48,990][27935] Avg episode reward: [(0, '-0.551')] [2022-07-13 11:54:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 300572672. Throughput: 0: 9681.1. Samples: 601146688. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:53,990][27935] Avg episode reward: [(0, '-1.823')] [2022-07-13 11:54:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 300598272. Throughput: 0: 9688.7. Samples: 601205012. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:54:58,989][27935] Avg episode reward: [(0, '-1.191')] [2022-07-13 11:55:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 300620800. Throughput: 0: 9613.7. Samples: 601259348. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 11:55:03,989][27935] Avg episode reward: [(0, '-1.385')] [2022-07-13 11:55:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 300643328. Throughput: 0: 9602.3. Samples: 601287908. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:08,991][27935] Avg episode reward: [(0, '-2.676')] [2022-07-13 11:55:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 300668928. Throughput: 0: 9610.9. Samples: 601346344. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:13,989][27935] Avg episode reward: [(0, '-2.329')] [2022-07-13 11:55:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 300692480. Throughput: 0: 9602.6. Samples: 601404140. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:18,989][27935] Avg episode reward: [(0, '-2.499')] [2022-07-13 11:55:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 300716032. Throughput: 0: 9603.7. Samples: 601433252. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:23,989][27935] Avg episode reward: [(0, '-1.952')] [2022-07-13 11:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 300741632. Throughput: 0: 9611.3. Samples: 601492032. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:28,989][27935] Avg episode reward: [(0, '-1.718')] [2022-07-13 11:55:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 300766208. Throughput: 0: 9597.5. Samples: 601549724. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:33,989][27935] Avg episode reward: [(0, '-2.397')] [2022-07-13 11:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.0, 300 sec: 4814.5). Total num frames: 300789760. Throughput: 0: 9603.8. Samples: 601578860. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:38,990][27935] Avg episode reward: [(0, '-2.237')] [2022-07-13 11:55:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 300812288. Throughput: 0: 9589.9. Samples: 601636556. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:43,989][27935] Avg episode reward: [(0, '-1.655')] [2022-07-13 11:55:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 300836864. Throughput: 0: 9669.4. Samples: 601694472. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:48,989][27935] Avg episode reward: [(0, '-2.716')] [2022-07-13 11:55:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 300861440. Throughput: 0: 9678.8. Samples: 601723456. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:53,995][27935] Avg episode reward: [(0, '-2.642')] [2022-07-13 11:55:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 300886016. Throughput: 0: 9665.9. Samples: 601781308. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:55:58,989][27935] Avg episode reward: [(0, '-2.187')] [2022-07-13 11:56:03,990][27935] Fps is (10 sec: 4709.8, 60 sec: 4795.6, 300 sec: 4807.6). Total num frames: 300908544. Throughput: 0: 9587.0. Samples: 601835568. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:03,991][27935] Avg episode reward: [(0, '-1.605')] [2022-07-13 11:56:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 300933120. Throughput: 0: 9587.5. Samples: 601864688. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:08,989][27935] Avg episode reward: [(0, '-1.597')] [2022-07-13 11:56:13,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 300955648. Throughput: 0: 9575.1. Samples: 601922912. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:13,989][27935] Avg episode reward: [(0, '-1.523')] [2022-07-13 11:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 300980224. Throughput: 0: 9582.0. Samples: 601980912. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:18,989][27935] Avg episode reward: [(0, '-1.562')] [2022-07-13 11:56:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 301004800. Throughput: 0: 9565.9. Samples: 602009324. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:23,989][27935] Avg episode reward: [(0, '-0.683')] [2022-07-13 11:56:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 301028352. Throughput: 0: 9568.6. Samples: 602067144. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:28,990][27935] Avg episode reward: [(0, '-0.584')] [2022-07-13 11:56:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 301052928. Throughput: 0: 9559.1. Samples: 602124632. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:33,990][27935] Avg episode reward: [(0, '-1.457')] [2022-07-13 11:56:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 301076480. Throughput: 0: 9557.6. Samples: 602153548. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:38,990][27935] Avg episode reward: [(0, '-1.085')] [2022-07-13 11:56:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301100032. Throughput: 0: 9551.6. Samples: 602211128. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:43,990][27935] Avg episode reward: [(0, '-1.099')] [2022-07-13 11:56:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301124608. Throughput: 0: 9633.2. Samples: 602269052. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:48,989][27935] Avg episode reward: [(0, '-0.671')] [2022-07-13 11:56:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301149184. Throughput: 0: 9624.3. Samples: 602297780. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:53,989][27935] Avg episode reward: [(0, '-0.988')] [2022-07-13 11:56:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 301171712. Throughput: 0: 9628.6. Samples: 602356200. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:56:58,989][27935] Avg episode reward: [(0, '-0.845')] [2022-07-13 11:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.8, 300 sec: 4807.6). Total num frames: 301196288. Throughput: 0: 9533.6. Samples: 602409924. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:03,989][27935] Avg episode reward: [(0, '-0.316')] [2022-07-13 11:57:08,992][27935] Fps is (10 sec: 4709.1, 60 sec: 4761.4, 300 sec: 4800.6). Total num frames: 301218816. Throughput: 0: 9546.9. Samples: 602438960. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:08,992][27935] Avg episode reward: [(0, '-0.770')] [2022-07-13 11:57:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301243392. Throughput: 0: 9556.3. Samples: 602497180. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:13,989][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 11:57:18,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301267968. Throughput: 0: 9566.6. Samples: 602555128. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:18,989][27935] Avg episode reward: [(0, '-1.764')] [2022-07-13 11:57:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 301291520. Throughput: 0: 9545.6. Samples: 602583100. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:23,989][27935] Avg episode reward: [(0, '-1.937')] [2022-07-13 11:57:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 301315072. Throughput: 0: 9547.3. Samples: 602640756. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 11:57:28,989][27935] Avg episode reward: [(0, '-2.166')] [2022-07-13 11:57:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 301338624. Throughput: 0: 9539.8. Samples: 602698344. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:33,989][27935] Avg episode reward: [(0, '-2.993')] [2022-07-13 11:57:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 301364224. Throughput: 0: 9557.6. Samples: 602727872. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:38,989][27935] Avg episode reward: [(0, '-2.767')] [2022-07-13 11:57:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 301388800. Throughput: 0: 9526.2. Samples: 602784880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:43,989][27935] Avg episode reward: [(0, '-2.851')] [2022-07-13 11:57:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 301410304. Throughput: 0: 9628.2. Samples: 602843192. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:48,991][27935] Avg episode reward: [(0, '-2.796')] [2022-07-13 11:57:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 301436928. Throughput: 0: 9621.6. Samples: 602871904. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:53,990][27935] Avg episode reward: [(0, '-2.206')] [2022-07-13 11:57:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 301459456. Throughput: 0: 9618.9. Samples: 602930028. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:57:58,989][27935] Avg episode reward: [(0, '-3.016')] [2022-07-13 11:58:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 301481984. Throughput: 0: 9534.3. Samples: 602984172. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:03,989][27935] Avg episode reward: [(0, '-3.345')] [2022-07-13 11:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4796.0, 300 sec: 4797.2). Total num frames: 301506560. Throughput: 0: 9557.6. Samples: 603013192. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:08,989][27935] Avg episode reward: [(0, '-2.756')] [2022-07-13 11:58:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 301530112. Throughput: 0: 9560.6. Samples: 603070984. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:13,990][27935] Avg episode reward: [(0, '-1.904')] [2022-07-13 11:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 301554688. Throughput: 0: 9575.4. Samples: 603129236. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:18,990][27935] Avg episode reward: [(0, '-2.428')] [2022-07-13 11:58:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 301579264. Throughput: 0: 9567.5. Samples: 603158408. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:23,991][27935] Avg episode reward: [(0, '-2.558')] [2022-07-13 11:58:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 301603840. Throughput: 0: 9588.4. Samples: 603216360. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:28,989][27935] Avg episode reward: [(0, '-2.075')] [2022-07-13 11:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 301627392. Throughput: 0: 9580.5. Samples: 603274316. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:33,990][27935] Avg episode reward: [(0, '-1.263')] [2022-07-13 11:58:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 301651968. Throughput: 0: 9591.3. Samples: 603303512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:38,989][27935] Avg episode reward: [(0, '0.166')] [2022-07-13 11:58:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 301675520. Throughput: 0: 9589.1. Samples: 603361536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:43,990][27935] Avg episode reward: [(0, '-0.136')] [2022-07-13 11:58:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 301700096. Throughput: 0: 9680.8. Samples: 603419808. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:48,990][27935] Avg episode reward: [(0, '-0.056')] [2022-07-13 11:58:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 301724672. Throughput: 0: 9682.2. Samples: 603448892. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:53,989][27935] Avg episode reward: [(0, '0.368')] [2022-07-13 11:58:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 301747200. Throughput: 0: 9684.2. Samples: 603506772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:58:58,989][27935] Avg episode reward: [(0, '0.265')] [2022-07-13 11:59:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 301770752. Throughput: 0: 9593.2. Samples: 603560932. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:03,989][27935] Avg episode reward: [(0, '0.219')] [2022-07-13 11:59:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 301796352. Throughput: 0: 9592.5. Samples: 603590072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:08,989][27935] Avg episode reward: [(0, '0.267')] [2022-07-13 11:59:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4800.6). Total num frames: 301819904. Throughput: 0: 9593.1. Samples: 603648048. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:13,990][27935] Avg episode reward: [(0, '0.219')] [2022-07-13 11:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 301843456. Throughput: 0: 9600.1. Samples: 603706320. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:18,989][27935] Avg episode reward: [(0, '0.235')] [2022-07-13 11:59:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 301864960. Throughput: 0: 9597.9. Samples: 603735416. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:23,989][27935] Avg episode reward: [(0, '0.329')] [2022-07-13 11:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 301892608. Throughput: 0: 9598.6. Samples: 603793472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:28,989][27935] Avg episode reward: [(0, '0.366')] [2022-07-13 11:59:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 301916160. Throughput: 0: 9590.0. Samples: 603851356. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:33,989][27935] Avg episode reward: [(0, '-0.044')] [2022-07-13 11:59:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 301940736. Throughput: 0: 9592.9. Samples: 603880572. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:38,989][27935] Avg episode reward: [(0, '-0.068')] [2022-07-13 11:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 301965312. Throughput: 0: 9594.8. Samples: 603938536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:43,989][27935] Avg episode reward: [(0, '0.004')] [2022-07-13 11:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 301988864. Throughput: 0: 9683.7. Samples: 603996700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:48,989][27935] Avg episode reward: [(0, '-1.493')] [2022-07-13 11:59:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 302012416. Throughput: 0: 9671.8. Samples: 604025300. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 11:59:53,991][27935] Avg episode reward: [(0, '-1.405')] [2022-07-13 11:59:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 302035968. Throughput: 0: 9673.1. Samples: 604083336. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 11:59:58,989][27935] Avg episode reward: [(0, '-1.499')] [2022-07-13 12:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 302059520. Throughput: 0: 9582.4. Samples: 604137528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:03,989][27935] Avg episode reward: [(0, '-2.820')] [2022-07-13 12:00:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 302084096. Throughput: 0: 9584.0. Samples: 604166696. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:08,989][27935] Avg episode reward: [(0, '-3.293')] [2022-07-13 12:00:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 302106624. Throughput: 0: 9591.7. Samples: 604225100. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:13,989][27935] Avg episode reward: [(0, '-3.219')] [2022-07-13 12:00:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 302132224. Throughput: 0: 9601.2. Samples: 604283412. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:18,990][27935] Avg episode reward: [(0, '-3.132')] [2022-07-13 12:00:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4797.2). Total num frames: 302156800. Throughput: 0: 9597.1. Samples: 604312440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:23,989][27935] Avg episode reward: [(0, '-1.815')] [2022-07-13 12:00:28,990][27935] Fps is (10 sec: 4812.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 302180352. Throughput: 0: 9584.8. Samples: 604369860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:28,990][27935] Avg episode reward: [(0, '-3.101')] [2022-07-13 12:00:33,990][27935] Fps is (10 sec: 4709.7, 60 sec: 4795.6, 300 sec: 4793.7). Total num frames: 302203904. Throughput: 0: 9581.1. Samples: 604427864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:33,991][27935] Avg episode reward: [(0, '-2.504')] [2022-07-13 12:00:38,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 302228480. Throughput: 0: 9593.8. Samples: 604457020. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:38,990][27935] Avg episode reward: [(0, '-1.654')] [2022-07-13 12:00:43,989][27935] Fps is (10 sec: 4813.5, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 302252032. Throughput: 0: 9600.0. Samples: 604515336. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:43,989][27935] Avg episode reward: [(0, '-0.547')] [2022-07-13 12:00:48,996][27935] Fps is (10 sec: 4911.8, 60 sec: 4812.2, 300 sec: 4800.5). Total num frames: 302277632. Throughput: 0: 9689.9. Samples: 604573640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:48,996][27935] Avg episode reward: [(0, '-1.465')] [2022-07-13 12:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 302300160. Throughput: 0: 9689.2. Samples: 604602708. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:53,989][27935] Avg episode reward: [(0, '-1.448')] [2022-07-13 12:00:58,989][27935] Fps is (10 sec: 4816.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 302325760. Throughput: 0: 9669.2. Samples: 604660212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:00:58,989][27935] Avg episode reward: [(0, '-0.323')] [2022-07-13 12:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 302347264. Throughput: 0: 9582.9. Samples: 604714644. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:03,989][27935] Avg episode reward: [(0, '0.129')] [2022-07-13 12:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 302372864. Throughput: 0: 9586.1. Samples: 604743816. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:08,989][27935] Avg episode reward: [(0, '-0.128')] [2022-07-13 12:01:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4804.1). Total num frames: 302397440. Throughput: 0: 9614.2. Samples: 604802488. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:13,989][27935] Avg episode reward: [(0, '0.206')] [2022-07-13 12:01:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 302419968. Throughput: 0: 9627.7. Samples: 604861096. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:18,989][27935] Avg episode reward: [(0, '1.092')] [2022-07-13 12:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 302445568. Throughput: 0: 9621.2. Samples: 604889976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:23,989][27935] Avg episode reward: [(0, '0.854')] [2022-07-13 12:01:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.9, 300 sec: 4800.7). Total num frames: 302469120. Throughput: 0: 9622.4. Samples: 604948344. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:28,989][27935] Avg episode reward: [(0, '1.157')] [2022-07-13 12:01:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4804.1). Total num frames: 302493696. Throughput: 0: 9615.5. Samples: 605006272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:33,989][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 12:01:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 302518272. Throughput: 0: 9614.6. Samples: 605035364. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:38,989][27935] Avg episode reward: [(0, '0.016')] [2022-07-13 12:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 302542848. Throughput: 0: 9632.1. Samples: 605093656. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:43,989][27935] Avg episode reward: [(0, '0.098')] [2022-07-13 12:01:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4796.3, 300 sec: 4800.7). Total num frames: 302565376. Throughput: 0: 9714.9. Samples: 605151816. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:48,989][27935] Avg episode reward: [(0, '-0.087')] [2022-07-13 12:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 302590976. Throughput: 0: 9711.4. Samples: 605180828. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:53,989][27935] Avg episode reward: [(0, '-0.126')] [2022-07-13 12:01:58,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4812.7, 300 sec: 4807.6). Total num frames: 302614528. Throughput: 0: 9689.0. Samples: 605238504. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:01:58,990][27935] Avg episode reward: [(0, '-0.825')] [2022-07-13 12:02:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 302637056. Throughput: 0: 9590.1. Samples: 605292652. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:02:03,989][27935] Avg episode reward: [(0, '-0.280')] [2022-07-13 12:02:08,989][27935] Fps is (10 sec: 4710.9, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 302661632. Throughput: 0: 9597.8. Samples: 605321876. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:02:08,990][27935] Avg episode reward: [(0, '-0.001')] [2022-07-13 12:02:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 302685184. Throughput: 0: 9595.8. Samples: 605380156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:02:13,990][27935] Avg episode reward: [(0, '0.196')] [2022-07-13 12:02:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 302709760. Throughput: 0: 9601.3. Samples: 605438332. Policy #0 lag: (min: 0.0, avg: 9.4, max: 21.0) [2022-07-13 12:02:18,989][27935] Avg episode reward: [(0, '-0.193')] [2022-07-13 12:02:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 302734336. Throughput: 0: 9604.8. Samples: 605467580. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:23,990][27935] Avg episode reward: [(0, '-0.671')] [2022-07-13 12:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 302757888. Throughput: 0: 9597.4. Samples: 605525540. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:28,989][27935] Avg episode reward: [(0, '-0.696')] [2022-07-13 12:02:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 302782464. Throughput: 0: 8953.2. Samples: 605554712. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:33,989][27935] Avg episode reward: [(0, '-0.026')] [2022-07-13 12:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 302806016. Throughput: 0: 9602.6. Samples: 605612944. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:38,989][27935] Avg episode reward: [(0, '-0.351')] [2022-07-13 12:02:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 302829568. Throughput: 0: 9607.5. Samples: 605670832. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:43,989][27935] Avg episode reward: [(0, '-0.319')] [2022-07-13 12:02:48,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4829.6, 300 sec: 4807.5). Total num frames: 302855168. Throughput: 0: 9695.2. Samples: 605728972. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:48,993][27935] Avg episode reward: [(0, '0.228')] [2022-07-13 12:02:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 302878720. Throughput: 0: 9695.6. Samples: 605758180. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:53,989][27935] Avg episode reward: [(0, '0.654')] [2022-07-13 12:02:58,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4830.0, 300 sec: 4821.5). Total num frames: 302904320. Throughput: 0: 9699.5. Samples: 605816632. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:02:58,996][27935] Avg episode reward: [(0, '0.368')] [2022-07-13 12:03:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 302925824. Throughput: 0: 9611.2. Samples: 605870836. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:03,989][27935] Avg episode reward: [(0, '-0.125')] [2022-07-13 12:03:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 302949376. Throughput: 0: 9614.4. Samples: 605900228. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:08,989][27935] Avg episode reward: [(0, '0.087')] [2022-07-13 12:03:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 302972928. Throughput: 0: 9620.3. Samples: 605958456. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:13,989][27935] Avg episode reward: [(0, '-0.096')] [2022-07-13 12:03:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 302999552. Throughput: 0: 10265.2. Samples: 606016644. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:18,989][27935] Avg episode reward: [(0, '-0.809')] [2022-07-13 12:03:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 303023104. Throughput: 0: 9625.7. Samples: 606046100. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:23,989][27935] Avg episode reward: [(0, '-1.132')] [2022-07-13 12:03:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 303045632. Throughput: 0: 9591.2. Samples: 606102436. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:28,990][27935] Avg episode reward: [(0, '-1.049')] [2022-07-13 12:03:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 303070208. Throughput: 0: 9565.9. Samples: 606159404. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:33,990][27935] Avg episode reward: [(0, '-0.167')] [2022-07-13 12:03:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 303093760. Throughput: 0: 9562.6. Samples: 606188496. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:38,989][27935] Avg episode reward: [(0, '-0.812')] [2022-07-13 12:03:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 303119360. Throughput: 0: 9553.2. Samples: 606246524. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:43,989][27935] Avg episode reward: [(0, '-1.321')] [2022-07-13 12:03:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4796.0, 300 sec: 4807.6). Total num frames: 303142912. Throughput: 0: 9639.1. Samples: 606304596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:48,989][27935] Avg episode reward: [(0, '-1.711')] [2022-07-13 12:03:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 303166464. Throughput: 0: 9628.4. Samples: 606333504. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:53,990][27935] Avg episode reward: [(0, '-1.395')] [2022-07-13 12:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 303191040. Throughput: 0: 9626.0. Samples: 606391624. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:03:58,989][27935] Avg episode reward: [(0, '-1.663')] [2022-07-13 12:04:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303213568. Throughput: 0: 9531.7. Samples: 606445572. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:03,989][27935] Avg episode reward: [(0, '-1.812')] [2022-07-13 12:04:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 303236096. Throughput: 0: 9523.9. Samples: 606474676. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:08,989][27935] Avg episode reward: [(0, '-1.961')] [2022-07-13 12:04:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303260672. Throughput: 0: 9561.3. Samples: 606532696. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:13,989][27935] Avg episode reward: [(0, '-1.826')] [2022-07-13 12:04:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 303286272. Throughput: 0: 9589.0. Samples: 606590908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:19,000][27935] Avg episode reward: [(0, '-0.999')] [2022-07-13 12:04:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 303309824. Throughput: 0: 9590.8. Samples: 606620080. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:23,989][27935] Avg episode reward: [(0, '-0.720')] [2022-07-13 12:04:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 303334400. Throughput: 0: 9597.6. Samples: 606678416. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:28,989][27935] Avg episode reward: [(0, '-0.521')] [2022-07-13 12:04:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303357952. Throughput: 0: 9590.1. Samples: 606736152. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:33,989][27935] Avg episode reward: [(0, '0.076')] [2022-07-13 12:04:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 303383552. Throughput: 0: 9598.7. Samples: 606765444. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:38,989][27935] Avg episode reward: [(0, '-0.145')] [2022-07-13 12:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 303407104. Throughput: 0: 9604.6. Samples: 606823832. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:43,989][27935] Avg episode reward: [(0, '-0.177')] [2022-07-13 12:04:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 303430656. Throughput: 0: 9702.6. Samples: 606882188. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 12:04:48,989][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 12:04:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 303456256. Throughput: 0: 9706.3. Samples: 606911460. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:04:53,989][27935] Avg episode reward: [(0, '0.678')] [2022-07-13 12:04:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 303479808. Throughput: 0: 9712.3. Samples: 606969748. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:04:58,989][27935] Avg episode reward: [(0, '0.510')] [2022-07-13 12:05:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303501312. Throughput: 0: 9618.5. Samples: 607023740. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:03,989][27935] Avg episode reward: [(0, '-0.319')] [2022-07-13 12:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 303525888. Throughput: 0: 9605.1. Samples: 607052308. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:08,989][27935] Avg episode reward: [(0, '-0.518')] [2022-07-13 12:05:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 303550464. Throughput: 0: 9584.8. Samples: 607109732. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:13,989][27935] Avg episode reward: [(0, '-1.480')] [2022-07-13 12:05:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 303572992. Throughput: 0: 9578.8. Samples: 607167196. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:18,989][27935] Avg episode reward: [(0, '-1.414')] [2022-07-13 12:05:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303597568. Throughput: 0: 9566.7. Samples: 607195944. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:23,989][27935] Avg episode reward: [(0, '-1.459')] [2022-07-13 12:05:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 303621120. Throughput: 0: 9547.8. Samples: 607253484. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:28,989][27935] Avg episode reward: [(0, '-2.435')] [2022-07-13 12:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 303645696. Throughput: 0: 9516.7. Samples: 607310440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:33,990][27935] Avg episode reward: [(0, '-1.408')] [2022-07-13 12:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 303670272. Throughput: 0: 9509.3. Samples: 607339380. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:38,989][27935] Avg episode reward: [(0, '-1.790')] [2022-07-13 12:05:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.8). Total num frames: 303693824. Throughput: 0: 9494.0. Samples: 607396980. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:43,989][27935] Avg episode reward: [(0, '-2.557')] [2022-07-13 12:05:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 303716352. Throughput: 0: 9565.5. Samples: 607454188. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:48,989][27935] Avg episode reward: [(0, '-1.100')] [2022-07-13 12:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4797.2). Total num frames: 303740928. Throughput: 0: 9568.7. Samples: 607482900. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:53,989][27935] Avg episode reward: [(0, '-0.420')] [2022-07-13 12:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 303765504. Throughput: 0: 9557.6. Samples: 607539824. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:05:58,989][27935] Avg episode reward: [(0, '-0.536')] [2022-07-13 12:06:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 303787008. Throughput: 0: 9468.4. Samples: 607593272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:03,989][27935] Avg episode reward: [(0, '-0.434')] [2022-07-13 12:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 303811584. Throughput: 0: 9461.8. Samples: 607621724. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:08,989][27935] Avg episode reward: [(0, '-1.161')] [2022-07-13 12:06:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4793.7). Total num frames: 303834112. Throughput: 0: 9456.9. Samples: 607679044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:13,989][27935] Avg episode reward: [(0, '-1.981')] [2022-07-13 12:06:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 303858688. Throughput: 0: 9466.7. Samples: 607736440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:18,989][27935] Avg episode reward: [(0, '-0.979')] [2022-07-13 12:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 303882240. Throughput: 0: 9458.0. Samples: 607764988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:23,989][27935] Avg episode reward: [(0, '-0.861')] [2022-07-13 12:06:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 303905792. Throughput: 0: 9457.7. Samples: 607822576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:28,989][27935] Avg episode reward: [(0, '-1.605')] [2022-07-13 12:06:33,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4761.3, 300 sec: 4790.2). Total num frames: 303931392. Throughput: 0: 9462.4. Samples: 607880028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:33,993][27935] Avg episode reward: [(0, '-1.796')] [2022-07-13 12:06:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4783.3). Total num frames: 303953920. Throughput: 0: 9461.2. Samples: 607908656. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:38,990][27935] Avg episode reward: [(0, '-1.198')] [2022-07-13 12:06:43,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4727.5, 300 sec: 4786.8). Total num frames: 303977472. Throughput: 0: 9486.9. Samples: 607966736. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:43,989][27935] Avg episode reward: [(0, '-1.361')] [2022-07-13 12:06:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 304003072. Throughput: 0: 9578.1. Samples: 608024288. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:48,990][27935] Avg episode reward: [(0, '-1.369')] [2022-07-13 12:06:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 304026624. Throughput: 0: 9584.5. Samples: 608053028. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:53,989][27935] Avg episode reward: [(0, '-1.553')] [2022-07-13 12:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 304051200. Throughput: 0: 9581.5. Samples: 608110212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:06:58,989][27935] Avg episode reward: [(0, '-1.833')] [2022-07-13 12:07:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4779.8). Total num frames: 304071680. Throughput: 0: 9497.1. Samples: 608163808. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:07:03,991][27935] Avg episode reward: [(0, '-1.652')] [2022-07-13 12:07:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 4779.8). Total num frames: 304095232. Throughput: 0: 9493.2. Samples: 608192184. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:07:08,989][27935] Avg episode reward: [(0, '-1.423')] [2022-07-13 12:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 304120832. Throughput: 0: 9494.3. Samples: 608249820. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 12:07:13,990][27935] Avg episode reward: [(0, '-2.418')] [2022-07-13 12:07:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 304143360. Throughput: 0: 9492.7. Samples: 608307168. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:18,989][27935] Avg episode reward: [(0, '-1.400')] [2022-07-13 12:07:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 304168960. Throughput: 0: 9500.4. Samples: 608336176. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:23,990][27935] Avg episode reward: [(0, '-2.384')] [2022-07-13 12:07:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4776.4). Total num frames: 304191488. Throughput: 0: 9493.7. Samples: 608393952. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:28,989][27935] Avg episode reward: [(0, '-2.510')] [2022-07-13 12:07:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.8, 300 sec: 4779.8). Total num frames: 304216064. Throughput: 0: 9496.0. Samples: 608451608. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:33,989][27935] Avg episode reward: [(0, '-1.967')] [2022-07-13 12:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 304240640. Throughput: 0: 9503.3. Samples: 608480676. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:38,989][27935] Avg episode reward: [(0, '-1.972')] [2022-07-13 12:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 304263168. Throughput: 0: 9517.0. Samples: 608538476. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:43,990][27935] Avg episode reward: [(0, '-1.989')] [2022-07-13 12:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 304288768. Throughput: 0: 9620.4. Samples: 608596728. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:48,989][27935] Avg episode reward: [(0, '-1.028')] [2022-07-13 12:07:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 304312320. Throughput: 0: 9633.6. Samples: 608625696. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:53,989][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 12:07:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 304336896. Throughput: 0: 9652.8. Samples: 608684196. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:07:58,989][27935] Avg episode reward: [(0, '0.370')] [2022-07-13 12:08:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 304359424. Throughput: 0: 9583.4. Samples: 608738420. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:03,989][27935] Avg episode reward: [(0, '-0.089')] [2022-07-13 12:08:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 304384000. Throughput: 0: 9588.2. Samples: 608767644. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:08,989][27935] Avg episode reward: [(0, '0.005')] [2022-07-13 12:08:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 304407552. Throughput: 0: 9607.2. Samples: 608826276. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:13,989][27935] Avg episode reward: [(0, '-0.245')] [2022-07-13 12:08:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4779.8). Total num frames: 304433152. Throughput: 0: 9616.9. Samples: 608884368. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:18,989][27935] Avg episode reward: [(0, '-0.361')] [2022-07-13 12:08:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 304456704. Throughput: 0: 9621.1. Samples: 608913624. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:23,990][27935] Avg episode reward: [(0, '-0.733')] [2022-07-13 12:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 304481280. Throughput: 0: 9638.1. Samples: 608972192. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:28,989][27935] Avg episode reward: [(0, '-1.356')] [2022-07-13 12:08:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 304504832. Throughput: 0: 9636.3. Samples: 609030360. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:33,989][27935] Avg episode reward: [(0, '-1.284')] [2022-07-13 12:08:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 304529408. Throughput: 0: 9638.1. Samples: 609059412. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:38,989][27935] Avg episode reward: [(0, '-0.531')] [2022-07-13 12:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4783.3). Total num frames: 304553984. Throughput: 0: 9632.6. Samples: 609117664. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:43,989][27935] Avg episode reward: [(0, '-1.414')] [2022-07-13 12:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 304578560. Throughput: 0: 9717.2. Samples: 609175696. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:48,989][27935] Avg episode reward: [(0, '-2.794')] [2022-07-13 12:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4786.8). Total num frames: 304603136. Throughput: 0: 9715.9. Samples: 609204860. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:53,989][27935] Avg episode reward: [(0, '-3.064')] [2022-07-13 12:08:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 304625664. Throughput: 0: 9708.3. Samples: 609263148. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:08:58,989][27935] Avg episode reward: [(0, '-3.676')] [2022-07-13 12:09:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 304649216. Throughput: 0: 9618.0. Samples: 609317176. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:03,989][27935] Avg episode reward: [(0, '-2.854')] [2022-07-13 12:09:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 304672768. Throughput: 0: 9617.1. Samples: 609346392. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:08,989][27935] Avg episode reward: [(0, '-3.162')] [2022-07-13 12:09:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 304697344. Throughput: 0: 9604.2. Samples: 609404380. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:13,989][27935] Avg episode reward: [(0, '-3.018')] [2022-07-13 12:09:18,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 304721920. Throughput: 0: 9598.4. Samples: 609462288. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:18,989][27935] Avg episode reward: [(0, '-1.248')] [2022-07-13 12:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 304746496. Throughput: 0: 9599.1. Samples: 609491372. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:23,989][27935] Avg episode reward: [(0, '-1.695')] [2022-07-13 12:09:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 304771072. Throughput: 0: 9599.5. Samples: 609549640. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:28,989][27935] Avg episode reward: [(0, '-1.619')] [2022-07-13 12:09:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 304791552. Throughput: 0: 9561.0. Samples: 609605940. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:33,989][27935] Avg episode reward: [(0, '-1.104')] [2022-07-13 12:09:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 304817152. Throughput: 0: 9553.1. Samples: 609634748. Policy #0 lag: (min: 1.0, avg: 8.6, max: 22.0) [2022-07-13 12:09:38,989][27935] Avg episode reward: [(0, '-1.517')] [2022-07-13 12:09:43,991][27935] Fps is (10 sec: 5016.4, 60 sec: 4795.5, 300 sec: 4783.3). Total num frames: 304841728. Throughput: 0: 9553.3. Samples: 609693068. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:09:43,992][27935] Avg episode reward: [(0, '-1.504')] [2022-07-13 12:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 304866304. Throughput: 0: 9653.5. Samples: 609751584. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:09:48,989][27935] Avg episode reward: [(0, '-1.889')] [2022-07-13 12:09:53,990][27935] Fps is (10 sec: 4915.9, 60 sec: 4795.6, 300 sec: 4783.3). Total num frames: 304890880. Throughput: 0: 9655.8. Samples: 609780912. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:09:53,990][27935] Avg episode reward: [(0, '-1.606')] [2022-07-13 12:09:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 304914432. Throughput: 0: 9660.5. Samples: 609839100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:09:58,989][27935] Avg episode reward: [(0, '-1.608')] [2022-07-13 12:10:03,989][27935] Fps is (10 sec: 4608.5, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 304936960. Throughput: 0: 9582.9. Samples: 609893516. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:03,992][27935] Avg episode reward: [(0, '-1.648')] [2022-07-13 12:10:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 304961536. Throughput: 0: 9582.8. Samples: 609922600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:08,989][27935] Avg episode reward: [(0, '-1.792')] [2022-07-13 12:10:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 304987136. Throughput: 0: 9582.0. Samples: 609980832. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:13,989][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 12:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 305009664. Throughput: 0: 9616.8. Samples: 610038696. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:18,989][27935] Avg episode reward: [(0, '-1.253')] [2022-07-13 12:10:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 305033216. Throughput: 0: 9624.5. Samples: 610067852. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:23,989][27935] Avg episode reward: [(0, '-2.540')] [2022-07-13 12:10:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 305058816. Throughput: 0: 9638.0. Samples: 610126756. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:28,989][27935] Avg episode reward: [(0, '-3.972')] [2022-07-13 12:10:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4786.8). Total num frames: 305082368. Throughput: 0: 9620.7. Samples: 610184516. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:33,989][27935] Avg episode reward: [(0, '-2.734')] [2022-07-13 12:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 305106944. Throughput: 0: 9612.5. Samples: 610213464. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:38,989][27935] Avg episode reward: [(0, '-3.497')] [2022-07-13 12:10:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.1, 300 sec: 4797.2). Total num frames: 305131520. Throughput: 0: 9612.8. Samples: 610271676. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:43,989][27935] Avg episode reward: [(0, '-3.545')] [2022-07-13 12:10:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 305155072. Throughput: 0: 9697.8. Samples: 610329916. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:48,990][27935] Avg episode reward: [(0, '-3.215')] [2022-07-13 12:10:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.8, 300 sec: 4790.2). Total num frames: 305178624. Throughput: 0: 9697.1. Samples: 610358968. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:53,989][27935] Avg episode reward: [(0, '-3.298')] [2022-07-13 12:10:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 305203200. Throughput: 0: 9691.3. Samples: 610416940. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:10:58,989][27935] Avg episode reward: [(0, '-1.876')] [2022-07-13 12:11:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 305226752. Throughput: 0: 9607.6. Samples: 610471040. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:03,991][27935] Avg episode reward: [(0, '-0.532')] [2022-07-13 12:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 305250304. Throughput: 0: 9600.3. Samples: 610499864. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:08,989][27935] Avg episode reward: [(0, '0.129')] [2022-07-13 12:11:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 305272832. Throughput: 0: 9581.5. Samples: 610557924. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:13,990][27935] Avg episode reward: [(0, '-0.058')] [2022-07-13 12:11:18,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 305298432. Throughput: 0: 9592.7. Samples: 610616188. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:18,989][27935] Avg episode reward: [(0, '0.350')] [2022-07-13 12:11:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 305323008. Throughput: 0: 9591.8. Samples: 610645096. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:23,989][27935] Avg episode reward: [(0, '0.892')] [2022-07-13 12:11:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 305347584. Throughput: 0: 9588.4. Samples: 610703152. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:28,989][27935] Avg episode reward: [(0, '-0.100')] [2022-07-13 12:11:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 305370112. Throughput: 0: 9569.2. Samples: 610760528. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:33,989][27935] Avg episode reward: [(0, '-0.396')] [2022-07-13 12:11:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 305394688. Throughput: 0: 9566.0. Samples: 610789436. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:38,989][27935] Avg episode reward: [(0, '-0.187')] [2022-07-13 12:11:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 305419264. Throughput: 0: 9559.6. Samples: 610847120. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:43,989][27935] Avg episode reward: [(0, '-0.655')] [2022-07-13 12:11:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 305441792. Throughput: 0: 9647.0. Samples: 610905156. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:48,989][27935] Avg episode reward: [(0, '-1.019')] [2022-07-13 12:11:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 305466368. Throughput: 0: 9648.6. Samples: 610934048. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:53,989][27935] Avg episode reward: [(0, '-1.980')] [2022-07-13 12:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 305490944. Throughput: 0: 9656.6. Samples: 610992472. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:11:58,989][27935] Avg episode reward: [(0, '-0.908')] [2022-07-13 12:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 305513472. Throughput: 0: 9561.2. Samples: 611046440. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:12:03,989][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 12:12:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 305538048. Throughput: 0: 9563.2. Samples: 611075440. Policy #0 lag: (min: 0.0, avg: 9.5, max: 20.0) [2022-07-13 12:12:08,989][27935] Avg episode reward: [(0, '-1.405')] [2022-07-13 12:12:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 305560576. Throughput: 0: 9557.2. Samples: 611133228. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:13,989][27935] Avg episode reward: [(0, '-0.827')] [2022-07-13 12:12:18,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4795.5, 300 sec: 4804.1). Total num frames: 305586176. Throughput: 0: 9558.4. Samples: 611190684. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:18,993][27935] Avg episode reward: [(0, '-0.304')] [2022-07-13 12:12:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 305610752. Throughput: 0: 9560.9. Samples: 611219676. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:23,989][27935] Avg episode reward: [(0, '-0.277')] [2022-07-13 12:12:28,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 305634304. Throughput: 0: 9566.1. Samples: 611277596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:28,990][27935] Avg episode reward: [(0, '-0.263')] [2022-07-13 12:12:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 305657856. Throughput: 0: 9563.8. Samples: 611335528. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:33,989][27935] Avg episode reward: [(0, '-0.875')] [2022-07-13 12:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 305682432. Throughput: 0: 9560.5. Samples: 611364272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:38,989][27935] Avg episode reward: [(0, '-2.071')] [2022-07-13 12:12:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 305707008. Throughput: 0: 9537.8. Samples: 611421672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:43,989][27935] Avg episode reward: [(0, '-2.012')] [2022-07-13 12:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 305730560. Throughput: 0: 9633.4. Samples: 611479944. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:48,989][27935] Avg episode reward: [(0, '-2.169')] [2022-07-13 12:12:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 305753088. Throughput: 0: 9628.5. Samples: 611508724. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:53,990][27935] Avg episode reward: [(0, '-1.972')] [2022-07-13 12:12:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 305779712. Throughput: 0: 9637.6. Samples: 611566920. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:12:58,990][27935] Avg episode reward: [(0, '-1.945')] [2022-07-13 12:13:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 305800192. Throughput: 0: 9555.4. Samples: 611620648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:03,990][27935] Avg episode reward: [(0, '-2.047')] [2022-07-13 12:13:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 305824768. Throughput: 0: 9556.1. Samples: 611649700. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:08,989][27935] Avg episode reward: [(0, '-1.326')] [2022-07-13 12:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 305848320. Throughput: 0: 9560.0. Samples: 611707796. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:13,989][27935] Avg episode reward: [(0, '-0.384')] [2022-07-13 12:13:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.9, 300 sec: 4800.7). Total num frames: 305872896. Throughput: 0: 9556.2. Samples: 611765556. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:18,990][27935] Avg episode reward: [(0, '-0.839')] [2022-07-13 12:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 305896448. Throughput: 0: 9554.5. Samples: 611794224. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:23,990][27935] Avg episode reward: [(0, '-1.328')] [2022-07-13 12:13:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 305921024. Throughput: 0: 9571.9. Samples: 611852408. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:28,989][27935] Avg episode reward: [(0, '-2.836')] [2022-07-13 12:13:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 305946624. Throughput: 0: 9556.3. Samples: 611909976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:33,989][27935] Avg episode reward: [(0, '-2.706')] [2022-07-13 12:13:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 305969152. Throughput: 0: 9554.8. Samples: 611938692. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:38,989][27935] Avg episode reward: [(0, '-2.465')] [2022-07-13 12:13:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 305993728. Throughput: 0: 9541.7. Samples: 611996296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:43,989][27935] Avg episode reward: [(0, '-2.018')] [2022-07-13 12:13:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 306016256. Throughput: 0: 9647.1. Samples: 612054768. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:48,989][27935] Avg episode reward: [(0, '-1.676')] [2022-07-13 12:13:53,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 306041856. Throughput: 0: 9646.7. Samples: 612083804. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:53,990][27935] Avg episode reward: [(0, '-1.944')] [2022-07-13 12:13:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 306067456. Throughput: 0: 9658.8. Samples: 612142440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:13:58,989][27935] Avg episode reward: [(0, '-2.155')] [2022-07-13 12:14:03,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 306088960. Throughput: 0: 9584.6. Samples: 612196864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:03,989][27935] Avg episode reward: [(0, '-0.281')] [2022-07-13 12:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 306113536. Throughput: 0: 9595.1. Samples: 612226004. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:08,989][27935] Avg episode reward: [(0, '-0.375')] [2022-07-13 12:14:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 306137088. Throughput: 0: 9594.2. Samples: 612284148. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:13,989][27935] Avg episode reward: [(0, '-0.222')] [2022-07-13 12:14:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306160640. Throughput: 0: 9611.4. Samples: 612342488. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:18,989][27935] Avg episode reward: [(0, '-0.029')] [2022-07-13 12:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 306185216. Throughput: 0: 9618.1. Samples: 612371508. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:23,989][27935] Avg episode reward: [(0, '0.316')] [2022-07-13 12:14:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 306210816. Throughput: 0: 9627.3. Samples: 612429524. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:28,990][27935] Avg episode reward: [(0, '0.485')] [2022-07-13 12:14:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 306233344. Throughput: 0: 9609.0. Samples: 612487172. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 12:14:33,991][27935] Avg episode reward: [(0, '0.518')] [2022-07-13 12:14:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 306257920. Throughput: 0: 9604.1. Samples: 612515988. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:14:38,991][27935] Avg episode reward: [(0, '0.161')] [2022-07-13 12:14:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 306281472. Throughput: 0: 9591.0. Samples: 612574036. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:14:43,990][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 12:14:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 306307072. Throughput: 0: 9676.9. Samples: 612632324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:14:48,989][27935] Avg episode reward: [(0, '0.027')] [2022-07-13 12:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 306330624. Throughput: 0: 9671.9. Samples: 612661240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:14:53,990][27935] Avg episode reward: [(0, '-0.111')] [2022-07-13 12:14:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 306354176. Throughput: 0: 9668.7. Samples: 612719240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:14:58,989][27935] Avg episode reward: [(0, '-0.863')] [2022-07-13 12:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 306376704. Throughput: 0: 9570.7. Samples: 612773168. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:03,989][27935] Avg episode reward: [(0, '-0.818')] [2022-07-13 12:15:08,990][27935] Fps is (10 sec: 4710.0, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306401280. Throughput: 0: 9567.1. Samples: 612802036. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:08,990][27935] Avg episode reward: [(0, '-2.108')] [2022-07-13 12:15:13,996][27935] Fps is (10 sec: 4809.1, 60 sec: 4795.1, 300 sec: 4797.1). Total num frames: 306424832. Throughput: 0: 9571.4. Samples: 612860308. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:13,997][27935] Avg episode reward: [(0, '-1.825')] [2022-07-13 12:15:18,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 306449408. Throughput: 0: 9581.1. Samples: 612918320. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:18,989][27935] Avg episode reward: [(0, '-1.531')] [2022-07-13 12:15:23,996][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.2, 300 sec: 4797.1). Total num frames: 306473984. Throughput: 0: 9585.7. Samples: 612947416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:23,997][27935] Avg episode reward: [(0, '-1.177')] [2022-07-13 12:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 306497536. Throughput: 0: 9584.4. Samples: 613005332. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:28,989][27935] Avg episode reward: [(0, '-0.705')] [2022-07-13 12:15:33,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 306522112. Throughput: 0: 9561.9. Samples: 613062608. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:33,989][27935] Avg episode reward: [(0, '-0.439')] [2022-07-13 12:15:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306545664. Throughput: 0: 9541.9. Samples: 613090624. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:38,989][27935] Avg episode reward: [(0, '-0.809')] [2022-07-13 12:15:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306569216. Throughput: 0: 9538.4. Samples: 613148468. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:43,989][27935] Avg episode reward: [(0, '-0.199')] [2022-07-13 12:15:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 306593792. Throughput: 0: 9625.9. Samples: 613206332. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:48,989][27935] Avg episode reward: [(0, '-0.300')] [2022-07-13 12:15:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 306616320. Throughput: 0: 9626.1. Samples: 613235204. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:53,989][27935] Avg episode reward: [(0, '-0.296')] [2022-07-13 12:15:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 306641920. Throughput: 0: 9622.0. Samples: 613293224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:15:58,989][27935] Avg episode reward: [(0, '-0.585')] [2022-07-13 12:16:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306664448. Throughput: 0: 9537.7. Samples: 613347516. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:03,989][27935] Avg episode reward: [(0, '-0.703')] [2022-07-13 12:16:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.8, 300 sec: 4800.7). Total num frames: 306689024. Throughput: 0: 9543.9. Samples: 613376820. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:08,989][27935] Avg episode reward: [(0, '-0.296')] [2022-07-13 12:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.3, 300 sec: 4793.7). Total num frames: 306712576. Throughput: 0: 9534.1. Samples: 613434368. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:13,990][27935] Avg episode reward: [(0, '-0.506')] [2022-07-13 12:16:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306737152. Throughput: 0: 9545.4. Samples: 613492152. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:18,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 12:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4779.3, 300 sec: 4790.2). Total num frames: 306760704. Throughput: 0: 9563.6. Samples: 613520984. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:23,989][27935] Avg episode reward: [(0, '0.277')] [2022-07-13 12:16:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 306783232. Throughput: 0: 9560.1. Samples: 613578672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:28,990][27935] Avg episode reward: [(0, '0.330')] [2022-07-13 12:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 306808832. Throughput: 0: 9551.7. Samples: 613636160. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:33,990][27935] Avg episode reward: [(0, '0.194')] [2022-07-13 12:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306833408. Throughput: 0: 9549.4. Samples: 613664928. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:38,989][27935] Avg episode reward: [(0, '-0.214')] [2022-07-13 12:16:43,989][27935] Fps is (10 sec: 4710.2, 60 sec: 4778.6, 300 sec: 4793.7). Total num frames: 306855936. Throughput: 0: 9539.2. Samples: 613722492. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:43,990][27935] Avg episode reward: [(0, '-0.382')] [2022-07-13 12:16:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 306879488. Throughput: 0: 9617.2. Samples: 613780288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:48,990][27935] Avg episode reward: [(0, '-0.153')] [2022-07-13 12:16:53,989][27935] Fps is (10 sec: 4710.6, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 306903040. Throughput: 0: 9614.0. Samples: 613809448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:53,990][27935] Avg episode reward: [(0, '-0.621')] [2022-07-13 12:16:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 306929664. Throughput: 0: 9630.7. Samples: 613867748. Policy #0 lag: (min: 0.0, avg: 9.3, max: 23.0) [2022-07-13 12:16:58,990][27935] Avg episode reward: [(0, '-0.923')] [2022-07-13 12:17:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 306952192. Throughput: 0: 8997.2. Samples: 613897024. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:03,989][27935] Avg episode reward: [(0, '-1.263')] [2022-07-13 12:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 306975744. Throughput: 0: 9564.6. Samples: 613951392. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:08,989][27935] Avg episode reward: [(0, '-1.244')] [2022-07-13 12:17:13,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4795.5, 300 sec: 4793.7). Total num frames: 307000320. Throughput: 0: 9583.5. Samples: 614009956. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:13,995][27935] Avg episode reward: [(0, '-0.984')] [2022-07-13 12:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 307024896. Throughput: 0: 9603.4. Samples: 614068312. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:18,989][27935] Avg episode reward: [(0, '-1.136')] [2022-07-13 12:17:23,989][27935] Fps is (10 sec: 4711.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 307047424. Throughput: 0: 9615.3. Samples: 614097616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:23,989][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 12:17:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 307073024. Throughput: 0: 9635.2. Samples: 614156072. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:28,989][27935] Avg episode reward: [(0, '-1.207')] [2022-07-13 12:17:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 307098624. Throughput: 0: 9645.8. Samples: 614214348. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:33,989][27935] Avg episode reward: [(0, '-1.810')] [2022-07-13 12:17:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 307122176. Throughput: 0: 9648.8. Samples: 614243644. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:38,989][27935] Avg episode reward: [(0, '-1.359')] [2022-07-13 12:17:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 307145728. Throughput: 0: 9636.8. Samples: 614301404. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:43,989][27935] Avg episode reward: [(0, '-2.087')] [2022-07-13 12:17:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 307169280. Throughput: 0: 10291.6. Samples: 614360148. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:48,990][27935] Avg episode reward: [(0, '-1.978')] [2022-07-13 12:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4797.2). Total num frames: 307194880. Throughput: 0: 9736.1. Samples: 614389516. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:53,990][27935] Avg episode reward: [(0, '-1.980')] [2022-07-13 12:17:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 307220480. Throughput: 0: 9739.2. Samples: 614448192. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:17:58,990][27935] Avg episode reward: [(0, '-2.664')] [2022-07-13 12:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 307241984. Throughput: 0: 9657.9. Samples: 614502916. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:03,991][27935] Avg episode reward: [(0, '-1.267')] [2022-07-13 12:18:08,989][27935] Fps is (10 sec: 4505.5, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 307265536. Throughput: 0: 9660.8. Samples: 614532352. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:08,989][27935] Avg episode reward: [(0, '-0.621')] [2022-07-13 12:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4804.1). Total num frames: 307290112. Throughput: 0: 9668.9. Samples: 614591172. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:13,990][27935] Avg episode reward: [(0, '-0.695')] [2022-07-13 12:18:18,989][27935] Fps is (10 sec: 5120.1, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 307316736. Throughput: 0: 9686.8. Samples: 614650256. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:18,989][27935] Avg episode reward: [(0, '0.050')] [2022-07-13 12:18:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4811.1). Total num frames: 307340288. Throughput: 0: 9687.3. Samples: 614679572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:23,989][27935] Avg episode reward: [(0, '0.481')] [2022-07-13 12:18:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4807.6). Total num frames: 307364864. Throughput: 0: 9695.1. Samples: 614737684. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:28,989][27935] Avg episode reward: [(0, '1.279')] [2022-07-13 12:18:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 307387392. Throughput: 0: 9685.7. Samples: 614796004. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:33,989][27935] Avg episode reward: [(0, '0.793')] [2022-07-13 12:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 307411968. Throughput: 0: 9675.2. Samples: 614824900. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:38,989][27935] Avg episode reward: [(0, '0.149')] [2022-07-13 12:18:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 307437568. Throughput: 0: 9672.9. Samples: 614883472. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:43,989][27935] Avg episode reward: [(0, '-0.168')] [2022-07-13 12:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4811.1). Total num frames: 307461120. Throughput: 0: 9756.7. Samples: 614941968. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:48,989][27935] Avg episode reward: [(0, '-0.202')] [2022-07-13 12:18:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 307485696. Throughput: 0: 9757.0. Samples: 614971416. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:53,989][27935] Avg episode reward: [(0, '-0.306')] [2022-07-13 12:18:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 307510272. Throughput: 0: 9741.1. Samples: 615029520. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:18:58,992][27935] Avg episode reward: [(0, '-0.423')] [2022-07-13 12:19:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 307532800. Throughput: 0: 9642.3. Samples: 615084160. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:03,989][27935] Avg episode reward: [(0, '-0.419')] [2022-07-13 12:19:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 307557376. Throughput: 0: 9653.4. Samples: 615113976. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:08,989][27935] Avg episode reward: [(0, '0.529')] [2022-07-13 12:19:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 307580928. Throughput: 0: 9660.5. Samples: 615172408. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:13,990][27935] Avg episode reward: [(0, '0.065')] [2022-07-13 12:19:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 307605504. Throughput: 0: 9666.0. Samples: 615230976. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:18,989][27935] Avg episode reward: [(0, '-1.359')] [2022-07-13 12:19:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 307631104. Throughput: 0: 9680.4. Samples: 615260516. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:23,989][27935] Avg episode reward: [(0, '-1.286')] [2022-07-13 12:19:28,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4829.7, 300 sec: 4818.0). Total num frames: 307654656. Throughput: 0: 9671.3. Samples: 615318704. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:19:28,992][27935] Avg episode reward: [(0, '-1.026')] [2022-07-13 12:19:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 307678208. Throughput: 0: 9656.8. Samples: 615376524. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:33,989][27935] Avg episode reward: [(0, '-2.584')] [2022-07-13 12:19:38,989][27935] Fps is (10 sec: 4813.9, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 307702784. Throughput: 0: 9651.5. Samples: 615405732. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:38,989][27935] Avg episode reward: [(0, '-2.723')] [2022-07-13 12:19:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 307727360. Throughput: 0: 9660.9. Samples: 615464260. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:43,990][27935] Avg episode reward: [(0, '-2.484')] [2022-07-13 12:19:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 307751936. Throughput: 0: 9743.1. Samples: 615522600. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:48,990][27935] Avg episode reward: [(0, '-1.070')] [2022-07-13 12:19:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 307775488. Throughput: 0: 9730.6. Samples: 615551852. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:53,990][27935] Avg episode reward: [(0, '-1.358')] [2022-07-13 12:19:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 307800064. Throughput: 0: 9736.9. Samples: 615610568. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:19:58,990][27935] Avg episode reward: [(0, '-2.085')] [2022-07-13 12:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 307823616. Throughput: 0: 9650.9. Samples: 615665264. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:03,989][27935] Avg episode reward: [(0, '-2.593')] [2022-07-13 12:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.6). Total num frames: 307847168. Throughput: 0: 9647.5. Samples: 615694652. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:08,989][27935] Avg episode reward: [(0, '-2.540')] [2022-07-13 12:20:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 307871744. Throughput: 0: 9662.1. Samples: 615753476. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:13,990][27935] Avg episode reward: [(0, '-2.243')] [2022-07-13 12:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.6). Total num frames: 307896320. Throughput: 0: 9674.1. Samples: 615811860. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:18,989][27935] Avg episode reward: [(0, '-2.303')] [2022-07-13 12:20:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 307919872. Throughput: 0: 9667.6. Samples: 615840776. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:23,989][27935] Avg episode reward: [(0, '-4.099')] [2022-07-13 12:20:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4821.5). Total num frames: 307944448. Throughput: 0: 9667.0. Samples: 615899276. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:28,989][27935] Avg episode reward: [(0, '-5.049')] [2022-07-13 12:20:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 307969024. Throughput: 0: 9663.0. Samples: 615957436. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:33,989][27935] Avg episode reward: [(0, '-3.588')] [2022-07-13 12:20:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 307993600. Throughput: 0: 9658.3. Samples: 615986476. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:38,990][27935] Avg episode reward: [(0, '-3.534')] [2022-07-13 12:20:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 308017152. Throughput: 0: 9662.0. Samples: 616045360. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:43,991][27935] Avg episode reward: [(0, '-4.077')] [2022-07-13 12:20:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 308042752. Throughput: 0: 9737.9. Samples: 616103468. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:48,989][27935] Avg episode reward: [(0, '-3.509')] [2022-07-13 12:20:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 308067328. Throughput: 0: 9740.6. Samples: 616132980. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:53,990][27935] Avg episode reward: [(0, '-3.589')] [2022-07-13 12:20:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 308091904. Throughput: 0: 9730.8. Samples: 616191360. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:20:58,990][27935] Avg episode reward: [(0, '-2.931')] [2022-07-13 12:21:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 308113408. Throughput: 0: 9650.7. Samples: 616246144. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:03,990][27935] Avg episode reward: [(0, '-1.712')] [2022-07-13 12:21:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 308136960. Throughput: 0: 9652.5. Samples: 616275140. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:08,990][27935] Avg episode reward: [(0, '-0.454')] [2022-07-13 12:21:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 308161536. Throughput: 0: 9661.6. Samples: 616334048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:13,989][27935] Avg episode reward: [(0, '0.176')] [2022-07-13 12:21:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308186112. Throughput: 0: 9667.2. Samples: 616392460. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:18,989][27935] Avg episode reward: [(0, '0.072')] [2022-07-13 12:21:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 308212736. Throughput: 0: 9666.9. Samples: 616421488. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:23,989][27935] Avg episode reward: [(0, '-0.029')] [2022-07-13 12:21:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 308235264. Throughput: 0: 9665.5. Samples: 616480308. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:28,989][27935] Avg episode reward: [(0, '-0.026')] [2022-07-13 12:21:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308258816. Throughput: 0: 9666.2. Samples: 616538448. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:33,989][27935] Avg episode reward: [(0, '0.366')] [2022-07-13 12:21:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 308282368. Throughput: 0: 9648.5. Samples: 616567164. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:38,989][27935] Avg episode reward: [(0, '-0.243')] [2022-07-13 12:21:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 308306944. Throughput: 0: 9619.7. Samples: 616624248. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:43,989][27935] Avg episode reward: [(0, '-0.040')] [2022-07-13 12:21:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 308332544. Throughput: 0: 9704.7. Samples: 616682856. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:48,989][27935] Avg episode reward: [(0, '-0.728')] [2022-07-13 12:21:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 308356096. Throughput: 0: 9716.1. Samples: 616712364. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 12:21:53,989][27935] Avg episode reward: [(0, '-0.539')] [2022-07-13 12:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 308380672. Throughput: 0: 9705.2. Samples: 616770780. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:21:58,989][27935] Avg episode reward: [(0, '-1.431')] [2022-07-13 12:22:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 308403200. Throughput: 0: 9616.4. Samples: 616825196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:03,989][27935] Avg episode reward: [(0, '-1.200')] [2022-07-13 12:22:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 308426752. Throughput: 0: 9620.0. Samples: 616854388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:08,989][27935] Avg episode reward: [(0, '-1.272')] [2022-07-13 12:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 308451328. Throughput: 0: 9614.4. Samples: 616912956. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:13,990][27935] Avg episode reward: [(0, '-0.733')] [2022-07-13 12:22:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 308475904. Throughput: 0: 9618.8. Samples: 616971296. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:18,989][27935] Avg episode reward: [(0, '-0.529')] [2022-07-13 12:22:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 308500480. Throughput: 0: 9633.8. Samples: 617000684. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:23,992][27935] Avg episode reward: [(0, '-0.591')] [2022-07-13 12:22:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 308524032. Throughput: 0: 9666.4. Samples: 617059236. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:28,989][27935] Avg episode reward: [(0, '-1.287')] [2022-07-13 12:22:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 308548608. Throughput: 0: 9652.4. Samples: 617117212. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:33,989][27935] Avg episode reward: [(0, '-0.972')] [2022-07-13 12:22:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 308573184. Throughput: 0: 9644.3. Samples: 617146356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:38,989][27935] Avg episode reward: [(0, '-1.045')] [2022-07-13 12:22:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 308597760. Throughput: 0: 9627.6. Samples: 617204024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:43,989][27935] Avg episode reward: [(0, '-0.442')] [2022-07-13 12:22:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 308621312. Throughput: 0: 9718.7. Samples: 617262536. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:48,990][27935] Avg episode reward: [(0, '-0.593')] [2022-07-13 12:22:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308645888. Throughput: 0: 9721.8. Samples: 617291868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:53,989][27935] Avg episode reward: [(0, '-0.973')] [2022-07-13 12:22:58,989][27935] Fps is (10 sec: 4812.6, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 308669440. Throughput: 0: 9722.3. Samples: 617350464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:22:58,990][27935] Avg episode reward: [(0, '-0.179')] [2022-07-13 12:23:03,995][27935] Fps is (10 sec: 4707.3, 60 sec: 4829.3, 300 sec: 4838.7). Total num frames: 308692992. Throughput: 0: 9640.4. Samples: 617405180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:03,997][27935] Avg episode reward: [(0, '-0.052')] [2022-07-13 12:23:08,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 308717568. Throughput: 0: 9641.1. Samples: 617434532. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:08,989][27935] Avg episode reward: [(0, '-0.146')] [2022-07-13 12:23:13,989][27935] Fps is (10 sec: 4918.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 308742144. Throughput: 0: 9642.1. Samples: 617493132. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:13,989][27935] Avg episode reward: [(0, '-1.151')] [2022-07-13 12:23:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308765696. Throughput: 0: 9658.2. Samples: 617551832. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:18,989][27935] Avg episode reward: [(0, '-2.008')] [2022-07-13 12:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308790272. Throughput: 0: 9662.6. Samples: 617581172. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:23,989][27935] Avg episode reward: [(0, '-1.746')] [2022-07-13 12:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 308814848. Throughput: 0: 9666.3. Samples: 617639008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:28,989][27935] Avg episode reward: [(0, '-2.331')] [2022-07-13 12:23:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 308839424. Throughput: 0: 9654.2. Samples: 617696976. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:33,989][27935] Avg episode reward: [(0, '-1.784')] [2022-07-13 12:23:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308862976. Throughput: 0: 9647.5. Samples: 617726004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:38,989][27935] Avg episode reward: [(0, '-2.566')] [2022-07-13 12:23:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 308887552. Throughput: 0: 9641.1. Samples: 617784312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:43,989][27935] Avg episode reward: [(0, '-2.157')] [2022-07-13 12:23:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 308911104. Throughput: 0: 9715.7. Samples: 617842324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:48,991][27935] Avg episode reward: [(0, '-1.420')] [2022-07-13 12:23:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 308934656. Throughput: 0: 9709.0. Samples: 617871436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:53,990][27935] Avg episode reward: [(0, '-1.491')] [2022-07-13 12:23:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.0, 300 sec: 4838.8). Total num frames: 308960256. Throughput: 0: 9712.2. Samples: 617930180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:23:58,989][27935] Avg episode reward: [(0, '-1.325')] [2022-07-13 12:24:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.4, 300 sec: 4831.9). Total num frames: 308982784. Throughput: 0: 9051.2. Samples: 617959136. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:24:03,989][27935] Avg episode reward: [(0, '-0.577')] [2022-07-13 12:24:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 309007360. Throughput: 0: 9612.9. Samples: 618013752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:24:08,989][27935] Avg episode reward: [(0, '0.158')] [2022-07-13 12:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 309031936. Throughput: 0: 9627.4. Samples: 618072240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:24:13,989][27935] Avg episode reward: [(0, '0.928')] [2022-07-13 12:24:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 309054464. Throughput: 0: 9631.9. Samples: 618130412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 12:24:18,991][27935] Avg episode reward: [(0, '0.984')] [2022-07-13 12:24:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 309081088. Throughput: 0: 9636.8. Samples: 618159660. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:23,989][27935] Avg episode reward: [(0, '1.603')] [2022-07-13 12:24:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 309104640. Throughput: 0: 9640.7. Samples: 618218144. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:28,991][27935] Avg episode reward: [(0, '1.311')] [2022-07-13 12:24:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 309128192. Throughput: 0: 9639.7. Samples: 618276108. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:33,989][27935] Avg episode reward: [(0, '1.183')] [2022-07-13 12:24:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 309152768. Throughput: 0: 9641.8. Samples: 618305316. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:38,989][27935] Avg episode reward: [(0, '0.685')] [2022-07-13 12:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 309176320. Throughput: 0: 9628.6. Samples: 618363468. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:43,990][27935] Avg episode reward: [(0, '0.131')] [2022-07-13 12:24:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 309200896. Throughput: 0: 10285.9. Samples: 618422000. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:48,989][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 12:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 309225472. Throughput: 0: 9717.0. Samples: 618451016. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:53,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 12:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 309250048. Throughput: 0: 9709.9. Samples: 618509184. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:24:58,989][27935] Avg episode reward: [(0, '-0.467')] [2022-07-13 12:25:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 309271552. Throughput: 0: 9623.8. Samples: 618563484. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:03,989][27935] Avg episode reward: [(0, '-1.555')] [2022-07-13 12:25:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 309295104. Throughput: 0: 9626.7. Samples: 618592860. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:08,989][27935] Avg episode reward: [(0, '-1.171')] [2022-07-13 12:25:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 309320704. Throughput: 0: 9616.7. Samples: 618650896. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:13,989][27935] Avg episode reward: [(0, '-0.618')] [2022-07-13 12:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 309345280. Throughput: 0: 9621.0. Samples: 618709052. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:18,989][27935] Avg episode reward: [(0, '-0.413')] [2022-07-13 12:25:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 309368832. Throughput: 0: 9625.8. Samples: 618738476. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:23,989][27935] Avg episode reward: [(0, '-1.378')] [2022-07-13 12:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 309394432. Throughput: 0: 9618.0. Samples: 618796280. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:28,989][27935] Avg episode reward: [(0, '-1.356')] [2022-07-13 12:25:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 309415936. Throughput: 0: 9597.9. Samples: 618853904. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:33,989][27935] Avg episode reward: [(0, '-2.538')] [2022-07-13 12:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 309441536. Throughput: 0: 9591.7. Samples: 618882644. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:38,989][27935] Avg episode reward: [(0, '-1.654')] [2022-07-13 12:25:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 309466112. Throughput: 0: 9585.9. Samples: 618940548. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:43,989][27935] Avg episode reward: [(0, '-1.781')] [2022-07-13 12:25:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 309489664. Throughput: 0: 9669.5. Samples: 618998612. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:48,989][27935] Avg episode reward: [(0, '-1.985')] [2022-07-13 12:25:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 309514240. Throughput: 0: 9668.2. Samples: 619027928. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:53,990][27935] Avg episode reward: [(0, '-1.106')] [2022-07-13 12:25:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4825.0). Total num frames: 309536768. Throughput: 0: 9673.7. Samples: 619086212. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:25:58,990][27935] Avg episode reward: [(0, '-1.343')] [2022-07-13 12:26:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 309560320. Throughput: 0: 9573.6. Samples: 619139864. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:03,989][27935] Avg episode reward: [(0, '-1.633')] [2022-07-13 12:26:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 309584896. Throughput: 0: 9569.1. Samples: 619169084. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:08,989][27935] Avg episode reward: [(0, '-1.542')] [2022-07-13 12:26:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 309607424. Throughput: 0: 9566.0. Samples: 619226752. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:13,989][27935] Avg episode reward: [(0, '-2.015')] [2022-07-13 12:26:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 309633024. Throughput: 0: 9568.6. Samples: 619284492. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:18,990][27935] Avg episode reward: [(0, '-1.844')] [2022-07-13 12:26:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4811.1). Total num frames: 309654528. Throughput: 0: 9566.1. Samples: 619313120. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:23,990][27935] Avg episode reward: [(0, '-2.203')] [2022-07-13 12:26:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 309680128. Throughput: 0: 9565.2. Samples: 619370980. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:28,989][27935] Avg episode reward: [(0, '-3.019')] [2022-07-13 12:26:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 309703680. Throughput: 0: 8912.1. Samples: 619399656. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:33,990][27935] Avg episode reward: [(0, '-2.321')] [2022-07-13 12:26:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 309729280. Throughput: 0: 9549.2. Samples: 619457644. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:38,990][27935] Avg episode reward: [(0, '-2.014')] [2022-07-13 12:26:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 309753856. Throughput: 0: 9551.6. Samples: 619516036. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:43,990][27935] Avg episode reward: [(0, '-0.508')] [2022-07-13 12:26:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 309777408. Throughput: 0: 9659.6. Samples: 619574548. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 12:26:48,990][27935] Avg episode reward: [(0, '-0.776')] [2022-07-13 12:26:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 309800960. Throughput: 0: 9659.5. Samples: 619603760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:26:53,989][27935] Avg episode reward: [(0, '-1.637')] [2022-07-13 12:26:58,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4829.8, 300 sec: 4824.9). Total num frames: 309826560. Throughput: 0: 9683.2. Samples: 619662500. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:26:58,990][27935] Avg episode reward: [(0, '-1.588')] [2022-07-13 12:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 309849088. Throughput: 0: 9606.0. Samples: 619716760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:03,989][27935] Avg episode reward: [(0, '-1.040')] [2022-07-13 12:27:08,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 309872640. Throughput: 0: 9615.6. Samples: 619745824. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:08,989][27935] Avg episode reward: [(0, '-1.767')] [2022-07-13 12:27:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 309897216. Throughput: 0: 9625.0. Samples: 619804104. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:13,989][27935] Avg episode reward: [(0, '-1.820')] [2022-07-13 12:27:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 309920768. Throughput: 0: 10284.4. Samples: 619862456. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:18,989][27935] Avg episode reward: [(0, '-1.689')] [2022-07-13 12:27:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4824.9). Total num frames: 309947392. Throughput: 0: 9647.0. Samples: 619891760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:23,989][27935] Avg episode reward: [(0, '-1.691')] [2022-07-13 12:27:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 309969920. Throughput: 0: 9642.0. Samples: 619949924. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:28,990][27935] Avg episode reward: [(0, '-1.427')] [2022-07-13 12:27:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 309994496. Throughput: 0: 9631.4. Samples: 620007960. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:33,990][27935] Avg episode reward: [(0, '-2.043')] [2022-07-13 12:27:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 310019072. Throughput: 0: 9628.3. Samples: 620037032. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:38,990][27935] Avg episode reward: [(0, '-1.688')] [2022-07-13 12:27:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 310040576. Throughput: 0: 9584.3. Samples: 620093788. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:43,989][27935] Avg episode reward: [(0, '-1.003')] [2022-07-13 12:27:48,994][27935] Fps is (10 sec: 4605.5, 60 sec: 4795.3, 300 sec: 4811.0). Total num frames: 310065152. Throughput: 0: 9641.0. Samples: 620150660. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:48,995][27935] Avg episode reward: [(0, '-1.034')] [2022-07-13 12:27:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 310090752. Throughput: 0: 9642.1. Samples: 620179716. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:53,990][27935] Avg episode reward: [(0, '-0.977')] [2022-07-13 12:27:58,989][27935] Fps is (10 sec: 5020.4, 60 sec: 4812.8, 300 sec: 4821.6). Total num frames: 310115328. Throughput: 0: 9649.3. Samples: 620238324. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:27:58,989][27935] Avg episode reward: [(0, '-0.367')] [2022-07-13 12:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 310137856. Throughput: 0: 9569.9. Samples: 620293100. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:03,992][27935] Avg episode reward: [(0, '-0.395')] [2022-07-13 12:28:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 310160384. Throughput: 0: 9565.8. Samples: 620322220. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:08,990][27935] Avg episode reward: [(0, '0.252')] [2022-07-13 12:28:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 310184960. Throughput: 0: 9572.7. Samples: 620380696. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:13,989][27935] Avg episode reward: [(0, '-0.536')] [2022-07-13 12:28:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 310209536. Throughput: 0: 9582.7. Samples: 620439180. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:18,989][27935] Avg episode reward: [(0, '-1.328')] [2022-07-13 12:28:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 310234112. Throughput: 0: 9579.5. Samples: 620468108. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:23,989][27935] Avg episode reward: [(0, '-1.589')] [2022-07-13 12:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 310258688. Throughput: 0: 9611.9. Samples: 620526324. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:28,989][27935] Avg episode reward: [(0, '-2.178')] [2022-07-13 12:28:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 310282240. Throughput: 0: 9636.5. Samples: 620584248. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:33,990][27935] Avg episode reward: [(0, '-2.790')] [2022-07-13 12:28:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 310306816. Throughput: 0: 9634.5. Samples: 620613268. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:38,989][27935] Avg episode reward: [(0, '-2.826')] [2022-07-13 12:28:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 310330368. Throughput: 0: 9625.9. Samples: 620671488. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:43,990][27935] Avg episode reward: [(0, '-2.566')] [2022-07-13 12:28:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.3, 300 sec: 4814.5). Total num frames: 310354944. Throughput: 0: 9707.9. Samples: 620729956. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:48,991][27935] Avg episode reward: [(0, '-2.759')] [2022-07-13 12:28:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 310379520. Throughput: 0: 9709.8. Samples: 620759160. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:53,989][27935] Avg episode reward: [(0, '-2.459')] [2022-07-13 12:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 310403072. Throughput: 0: 9701.2. Samples: 620817252. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:28:58,990][27935] Avg episode reward: [(0, '-2.349')] [2022-07-13 12:29:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 310425600. Throughput: 0: 9601.3. Samples: 620871240. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:29:03,989][27935] Avg episode reward: [(0, '-3.041')] [2022-07-13 12:29:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 310449152. Throughput: 0: 9598.3. Samples: 620900032. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:29:08,989][27935] Avg episode reward: [(0, '-3.368')] [2022-07-13 12:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 310474752. Throughput: 0: 9597.3. Samples: 620958204. Policy #0 lag: (min: 0.0, avg: 8.0, max: 20.0) [2022-07-13 12:29:13,989][27935] Avg episode reward: [(0, '-3.126')] [2022-07-13 12:29:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 310499328. Throughput: 0: 9593.8. Samples: 621015968. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:18,989][27935] Avg episode reward: [(0, '-2.111')] [2022-07-13 12:29:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 310522880. Throughput: 0: 9594.0. Samples: 621044996. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:23,991][27935] Avg episode reward: [(0, '-2.318')] [2022-07-13 12:29:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 310545408. Throughput: 0: 9587.5. Samples: 621102924. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:28,989][27935] Avg episode reward: [(0, '-2.547')] [2022-07-13 12:29:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 310571008. Throughput: 0: 9572.4. Samples: 621160716. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:33,990][27935] Avg episode reward: [(0, '-2.029')] [2022-07-13 12:29:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 310594560. Throughput: 0: 9569.2. Samples: 621189772. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:38,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 12:29:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 310619136. Throughput: 0: 9561.2. Samples: 621247508. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:43,989][27935] Avg episode reward: [(0, '-0.682')] [2022-07-13 12:29:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 310642688. Throughput: 0: 9654.1. Samples: 621305676. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:48,989][27935] Avg episode reward: [(0, '-0.708')] [2022-07-13 12:29:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 310667264. Throughput: 0: 9658.9. Samples: 621334680. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:53,989][27935] Avg episode reward: [(0, '-0.481')] [2022-07-13 12:29:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 310691840. Throughput: 0: 9668.4. Samples: 621393280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:29:58,989][27935] Avg episode reward: [(0, '0.277')] [2022-07-13 12:30:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 310715392. Throughput: 0: 9038.6. Samples: 621422704. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:03,989][27935] Avg episode reward: [(0, '0.377')] [2022-07-13 12:30:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 310738944. Throughput: 0: 9608.6. Samples: 621477384. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:08,989][27935] Avg episode reward: [(0, '-0.455')] [2022-07-13 12:30:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 310762496. Throughput: 0: 9613.1. Samples: 621535512. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:13,989][27935] Avg episode reward: [(0, '-1.381')] [2022-07-13 12:30:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 310787072. Throughput: 0: 9631.9. Samples: 621594152. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:18,989][27935] Avg episode reward: [(0, '-2.521')] [2022-07-13 12:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 310811648. Throughput: 0: 9635.4. Samples: 621623364. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:23,989][27935] Avg episode reward: [(0, '-3.553')] [2022-07-13 12:30:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 310835200. Throughput: 0: 9648.3. Samples: 621681680. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:28,989][27935] Avg episode reward: [(0, '-3.408')] [2022-07-13 12:30:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 310860800. Throughput: 0: 9654.6. Samples: 621740132. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:33,990][27935] Avg episode reward: [(0, '-4.772')] [2022-07-13 12:30:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 310884352. Throughput: 0: 9655.9. Samples: 621769196. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:38,991][27935] Avg episode reward: [(0, '-4.880')] [2022-07-13 12:30:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 310908928. Throughput: 0: 9653.6. Samples: 621827692. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:43,989][27935] Avg episode reward: [(0, '-4.893')] [2022-07-13 12:30:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 310932480. Throughput: 0: 10301.8. Samples: 621886284. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:48,989][27935] Avg episode reward: [(0, '-4.622')] [2022-07-13 12:30:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 310958080. Throughput: 0: 9741.1. Samples: 621915732. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:53,989][27935] Avg episode reward: [(0, '-4.278')] [2022-07-13 12:30:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 310982656. Throughput: 0: 9748.1. Samples: 621974176. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:30:58,990][27935] Avg episode reward: [(0, '-4.257')] [2022-07-13 12:31:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 311003136. Throughput: 0: 9660.1. Samples: 622028856. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:03,989][27935] Avg episode reward: [(0, '-3.362')] [2022-07-13 12:31:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 311029760. Throughput: 0: 9661.6. Samples: 622058136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:08,989][27935] Avg episode reward: [(0, '-3.392')] [2022-07-13 12:31:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 311054336. Throughput: 0: 9668.9. Samples: 622116780. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:13,990][27935] Avg episode reward: [(0, '-4.025')] [2022-07-13 12:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 311077888. Throughput: 0: 9667.8. Samples: 622175184. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:18,991][27935] Avg episode reward: [(0, '-3.479')] [2022-07-13 12:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 311102464. Throughput: 0: 9659.2. Samples: 622203860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:23,990][27935] Avg episode reward: [(0, '-2.472')] [2022-07-13 12:31:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 311127040. Throughput: 0: 9661.1. Samples: 622262440. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:28,990][27935] Avg episode reward: [(0, '-1.432')] [2022-07-13 12:31:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 311148544. Throughput: 0: 8998.4. Samples: 622291212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:33,989][27935] Avg episode reward: [(0, '-1.412')] [2022-07-13 12:31:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 311175168. Throughput: 0: 9640.2. Samples: 622349540. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:38,989][27935] Avg episode reward: [(0, '-1.516')] [2022-07-13 12:31:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 311198720. Throughput: 0: 9637.3. Samples: 622407856. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 12:31:43,989][27935] Avg episode reward: [(0, '-0.645')] [2022-07-13 12:31:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 311222272. Throughput: 0: 9067.7. Samples: 622436904. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:31:48,990][27935] Avg episode reward: [(0, '-0.385')] [2022-07-13 12:31:53,990][27935] Fps is (10 sec: 5017.1, 60 sec: 4846.8, 300 sec: 4821.5). Total num frames: 311248896. Throughput: 0: 9716.4. Samples: 622495384. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:31:53,990][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 12:31:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 311271424. Throughput: 0: 9718.8. Samples: 622554124. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:31:58,989][27935] Avg episode reward: [(0, '-0.818')] [2022-07-13 12:32:03,989][27935] Fps is (10 sec: 4506.1, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 311293952. Throughput: 0: 9635.9. Samples: 622608800. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:03,989][27935] Avg episode reward: [(0, '-1.821')] [2022-07-13 12:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 311319552. Throughput: 0: 9645.8. Samples: 622637920. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:08,989][27935] Avg episode reward: [(0, '-0.972')] [2022-07-13 12:32:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 311343104. Throughput: 0: 9646.0. Samples: 622696512. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:13,989][27935] Avg episode reward: [(0, '-2.294')] [2022-07-13 12:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 311367680. Throughput: 0: 10300.3. Samples: 622754724. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:18,989][27935] Avg episode reward: [(0, '-2.217')] [2022-07-13 12:32:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 311391232. Throughput: 0: 9653.4. Samples: 622783944. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:23,989][27935] Avg episode reward: [(0, '-1.073')] [2022-07-13 12:32:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 311416832. Throughput: 0: 9642.2. Samples: 622841756. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:28,989][27935] Avg episode reward: [(0, '-1.209')] [2022-07-13 12:32:33,989][27935] Fps is (10 sec: 4812.6, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 311439360. Throughput: 0: 10285.2. Samples: 622899744. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:33,991][27935] Avg episode reward: [(0, '-0.122')] [2022-07-13 12:32:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 311464960. Throughput: 0: 9636.0. Samples: 622928992. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:38,990][27935] Avg episode reward: [(0, '-0.904')] [2022-07-13 12:32:43,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4812.8, 300 sec: 4821.6). Total num frames: 311487488. Throughput: 0: 9607.8. Samples: 622986476. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:43,989][27935] Avg episode reward: [(0, '-1.824')] [2022-07-13 12:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 311513088. Throughput: 0: 9694.4. Samples: 623045048. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:48,991][27935] Avg episode reward: [(0, '-1.214')] [2022-07-13 12:32:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.8, 300 sec: 4814.5). Total num frames: 311535616. Throughput: 0: 9699.9. Samples: 623074416. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:53,989][27935] Avg episode reward: [(0, '-0.341')] [2022-07-13 12:32:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 311561216. Throughput: 0: 9684.4. Samples: 623132308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:32:58,989][27935] Avg episode reward: [(0, '-0.459')] [2022-07-13 12:33:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 311583744. Throughput: 0: 9593.3. Samples: 623186424. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:03,991][27935] Avg episode reward: [(0, '-0.493')] [2022-07-13 12:33:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 311607296. Throughput: 0: 9592.3. Samples: 623215596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:08,989][27935] Avg episode reward: [(0, '-0.582')] [2022-07-13 12:33:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 311631872. Throughput: 0: 9597.8. Samples: 623273656. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:13,989][27935] Avg episode reward: [(0, '-0.583')] [2022-07-13 12:33:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 311655424. Throughput: 0: 9603.8. Samples: 623331912. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:18,991][27935] Avg episode reward: [(0, '0.297')] [2022-07-13 12:33:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4825.0). Total num frames: 311682048. Throughput: 0: 9602.5. Samples: 623361104. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:23,990][27935] Avg episode reward: [(0, '0.151')] [2022-07-13 12:33:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 311705600. Throughput: 0: 9622.3. Samples: 623419480. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:28,989][27935] Avg episode reward: [(0, '0.060')] [2022-07-13 12:33:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 311729152. Throughput: 0: 9607.6. Samples: 623477392. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:33,989][27935] Avg episode reward: [(0, '0.243')] [2022-07-13 12:33:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 311752704. Throughput: 0: 9602.6. Samples: 623506532. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:38,990][27935] Avg episode reward: [(0, '1.114')] [2022-07-13 12:33:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 311776256. Throughput: 0: 9619.3. Samples: 623565176. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:43,989][27935] Avg episode reward: [(0, '-0.342')] [2022-07-13 12:33:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 311802880. Throughput: 0: 9681.4. Samples: 623622088. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:48,989][27935] Avg episode reward: [(0, '-0.422')] [2022-07-13 12:33:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 311826432. Throughput: 0: 9678.7. Samples: 623651136. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:53,989][27935] Avg episode reward: [(0, '-0.471')] [2022-07-13 12:33:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 311849984. Throughput: 0: 9685.4. Samples: 623709500. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:33:58,989][27935] Avg episode reward: [(0, '-0.295')] [2022-07-13 12:34:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 311872512. Throughput: 0: 9611.2. Samples: 623764416. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:34:03,989][27935] Avg episode reward: [(0, '-0.715')] [2022-07-13 12:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 311896064. Throughput: 0: 9613.1. Samples: 623793692. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 12:34:08,990][27935] Avg episode reward: [(0, '-0.942')] [2022-07-13 12:34:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 311922688. Throughput: 0: 9616.2. Samples: 623852208. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:13,989][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 12:34:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 311945216. Throughput: 0: 9627.6. Samples: 623910636. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:18,989][27935] Avg episode reward: [(0, '-0.307')] [2022-07-13 12:34:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 311969792. Throughput: 0: 9638.0. Samples: 623940240. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:23,989][27935] Avg episode reward: [(0, '-0.222')] [2022-07-13 12:34:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 311994368. Throughput: 0: 9631.7. Samples: 623998604. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:28,989][27935] Avg episode reward: [(0, '-2.564')] [2022-07-13 12:34:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 312018944. Throughput: 0: 9657.2. Samples: 624056664. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:33,989][27935] Avg episode reward: [(0, '-2.641')] [2022-07-13 12:34:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312043520. Throughput: 0: 9658.2. Samples: 624085756. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:38,989][27935] Avg episode reward: [(0, '-3.004')] [2022-07-13 12:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312067072. Throughput: 0: 9669.0. Samples: 624144604. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:43,989][27935] Avg episode reward: [(0, '-3.044')] [2022-07-13 12:34:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 312091648. Throughput: 0: 9096.3. Samples: 624173748. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:48,989][27935] Avg episode reward: [(0, '-3.117')] [2022-07-13 12:34:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 312116224. Throughput: 0: 9754.7. Samples: 624232652. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:53,989][27935] Avg episode reward: [(0, '-3.142')] [2022-07-13 12:34:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 312141824. Throughput: 0: 9755.9. Samples: 624291224. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:34:58,989][27935] Avg episode reward: [(0, '-3.959')] [2022-07-13 12:35:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312163328. Throughput: 0: 9664.5. Samples: 624345540. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:03,991][27935] Avg episode reward: [(0, '-2.677')] [2022-07-13 12:35:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 312187904. Throughput: 0: 9654.1. Samples: 624374676. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:08,992][27935] Avg episode reward: [(0, '-1.909')] [2022-07-13 12:35:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 312212480. Throughput: 0: 9666.0. Samples: 624433572. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:13,990][27935] Avg episode reward: [(0, '-1.140')] [2022-07-13 12:35:18,992][27935] Fps is (10 sec: 4811.2, 60 sec: 4846.7, 300 sec: 4828.4). Total num frames: 312236032. Throughput: 0: 9689.6. Samples: 624492728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:18,993][27935] Avg episode reward: [(0, '-1.127')] [2022-07-13 12:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 312261632. Throughput: 0: 9699.1. Samples: 624522216. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:23,989][27935] Avg episode reward: [(0, '-0.926')] [2022-07-13 12:35:28,989][27935] Fps is (10 sec: 5019.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 312286208. Throughput: 0: 9685.7. Samples: 624580460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:28,989][27935] Avg episode reward: [(0, '-1.481')] [2022-07-13 12:35:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 312309760. Throughput: 0: 10336.4. Samples: 624638884. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:33,989][27935] Avg episode reward: [(0, '-0.016')] [2022-07-13 12:35:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 312333312. Throughput: 0: 9670.7. Samples: 624667832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:38,989][27935] Avg episode reward: [(0, '0.092')] [2022-07-13 12:35:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 312357888. Throughput: 0: 9675.1. Samples: 624726604. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:43,990][27935] Avg episode reward: [(0, '0.409')] [2022-07-13 12:35:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312382464. Throughput: 0: 9769.8. Samples: 624785180. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:48,989][27935] Avg episode reward: [(0, '0.163')] [2022-07-13 12:35:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312407040. Throughput: 0: 9782.7. Samples: 624814896. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:53,991][27935] Avg episode reward: [(0, '-0.549')] [2022-07-13 12:35:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 312432640. Throughput: 0: 9764.0. Samples: 624872952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:35:58,989][27935] Avg episode reward: [(0, '0.163')] [2022-07-13 12:36:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 312454144. Throughput: 0: 9676.4. Samples: 624928136. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:03,989][27935] Avg episode reward: [(0, '-0.114')] [2022-07-13 12:36:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 312477696. Throughput: 0: 9671.5. Samples: 624957432. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:08,990][27935] Avg episode reward: [(0, '-1.371')] [2022-07-13 12:36:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 312503296. Throughput: 0: 9680.3. Samples: 625016072. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:13,989][27935] Avg episode reward: [(0, '-1.114')] [2022-07-13 12:36:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.3, 300 sec: 4831.9). Total num frames: 312527872. Throughput: 0: 9027.5. Samples: 625045120. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:18,989][27935] Avg episode reward: [(0, '-1.748')] [2022-07-13 12:36:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 312551424. Throughput: 0: 9680.1. Samples: 625103436. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:23,989][27935] Avg episode reward: [(0, '-1.461')] [2022-07-13 12:36:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 312574976. Throughput: 0: 9671.9. Samples: 625161840. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:28,989][27935] Avg episode reward: [(0, '-2.463')] [2022-07-13 12:36:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 312600576. Throughput: 0: 9665.8. Samples: 625220140. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:33,989][27935] Avg episode reward: [(0, '-3.027')] [2022-07-13 12:36:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 312626176. Throughput: 0: 9663.3. Samples: 625249744. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 12:36:38,989][27935] Avg episode reward: [(0, '-2.893')] [2022-07-13 12:36:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 312648704. Throughput: 0: 9672.2. Samples: 625308200. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:36:43,989][27935] Avg episode reward: [(0, '-2.975')] [2022-07-13 12:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 312674304. Throughput: 0: 9740.4. Samples: 625366452. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:36:48,989][27935] Avg episode reward: [(0, '-3.123')] [2022-07-13 12:36:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 312696832. Throughput: 0: 9741.9. Samples: 625395816. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:36:53,989][27935] Avg episode reward: [(0, '-2.876')] [2022-07-13 12:36:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 312722432. Throughput: 0: 9739.3. Samples: 625454340. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:36:58,990][27935] Avg episode reward: [(0, '-2.591')] [2022-07-13 12:37:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 312745984. Throughput: 0: 10312.1. Samples: 625509164. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:03,989][27935] Avg episode reward: [(0, '-1.282')] [2022-07-13 12:37:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 312770560. Throughput: 0: 9669.2. Samples: 625538548. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:08,989][27935] Avg episode reward: [(0, '-1.143')] [2022-07-13 12:37:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 312794112. Throughput: 0: 9663.6. Samples: 625596704. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:13,989][27935] Avg episode reward: [(0, '-0.792')] [2022-07-13 12:37:19,000][27935] Fps is (10 sec: 4704.9, 60 sec: 4828.9, 300 sec: 4835.2). Total num frames: 312817664. Throughput: 0: 9677.7. Samples: 625655748. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:19,001][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 12:37:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 312842240. Throughput: 0: 9677.3. Samples: 625685220. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:23,989][27935] Avg episode reward: [(0, '-0.878')] [2022-07-13 12:37:28,989][27935] Fps is (10 sec: 5023.5, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 312867840. Throughput: 0: 9671.0. Samples: 625743396. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:28,989][27935] Avg episode reward: [(0, '-1.303')] [2022-07-13 12:37:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 312891392. Throughput: 0: 9672.2. Samples: 625801700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:33,989][27935] Avg episode reward: [(0, '-1.520')] [2022-07-13 12:37:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 312914944. Throughput: 0: 9671.4. Samples: 625831028. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:38,989][27935] Avg episode reward: [(0, '-1.256')] [2022-07-13 12:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 312939520. Throughput: 0: 9654.8. Samples: 625888808. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:43,989][27935] Avg episode reward: [(0, '-1.731')] [2022-07-13 12:37:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 312965120. Throughput: 0: 9747.3. Samples: 625947792. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:48,990][27935] Avg episode reward: [(0, '-2.168')] [2022-07-13 12:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 312988672. Throughput: 0: 9740.7. Samples: 625976880. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:53,989][27935] Avg episode reward: [(0, '-1.665')] [2022-07-13 12:37:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 313013248. Throughput: 0: 9743.1. Samples: 626035144. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:37:58,989][27935] Avg episode reward: [(0, '-2.129')] [2022-07-13 12:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 313034752. Throughput: 0: 9079.3. Samples: 626064212. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:03,991][27935] Avg episode reward: [(0, '-2.092')] [2022-07-13 12:38:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 313059328. Throughput: 0: 9641.9. Samples: 626119104. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:08,989][27935] Avg episode reward: [(0, '-1.882')] [2022-07-13 12:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 313084928. Throughput: 0: 9641.2. Samples: 626177248. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:13,991][27935] Avg episode reward: [(0, '-1.904')] [2022-07-13 12:38:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.9, 300 sec: 4835.4). Total num frames: 313108480. Throughput: 0: 9642.2. Samples: 626235600. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:18,991][27935] Avg episode reward: [(0, '-2.136')] [2022-07-13 12:38:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 313132032. Throughput: 0: 9640.2. Samples: 626264836. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:23,990][27935] Avg episode reward: [(0, '-1.410')] [2022-07-13 12:38:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 313156608. Throughput: 0: 9647.6. Samples: 626322948. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:28,990][27935] Avg episode reward: [(0, '-0.834')] [2022-07-13 12:38:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 313181184. Throughput: 0: 9625.6. Samples: 626380944. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:33,989][27935] Avg episode reward: [(0, '-0.580')] [2022-07-13 12:38:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 313204736. Throughput: 0: 9629.0. Samples: 626410184. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:38,989][27935] Avg episode reward: [(0, '0.201')] [2022-07-13 12:38:43,991][27935] Fps is (10 sec: 4914.0, 60 sec: 4846.7, 300 sec: 4838.8). Total num frames: 313230336. Throughput: 0: 9623.3. Samples: 626468216. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:43,992][27935] Avg episode reward: [(0, '0.022')] [2022-07-13 12:38:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 313252864. Throughput: 0: 10279.2. Samples: 626526776. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:48,989][27935] Avg episode reward: [(0, '0.880')] [2022-07-13 12:38:53,989][27935] Fps is (10 sec: 4506.7, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 313275392. Throughput: 0: 9698.7. Samples: 626555544. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:53,989][27935] Avg episode reward: [(0, '0.840')] [2022-07-13 12:38:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 313303040. Throughput: 0: 9702.2. Samples: 626613848. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:38:58,990][27935] Avg episode reward: [(0, '0.620')] [2022-07-13 12:39:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 313324544. Throughput: 0: 9616.9. Samples: 626668360. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 12:39:03,989][27935] Avg episode reward: [(0, '0.691')] [2022-07-13 12:39:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 313349120. Throughput: 0: 9617.8. Samples: 626697636. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:08,990][27935] Avg episode reward: [(0, '0.931')] [2022-07-13 12:39:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 313372672. Throughput: 0: 9615.9. Samples: 626755664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:13,990][27935] Avg episode reward: [(0, '0.464')] [2022-07-13 12:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 313397248. Throughput: 0: 9619.8. Samples: 626813836. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:18,989][27935] Avg episode reward: [(0, '-0.595')] [2022-07-13 12:39:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 313421824. Throughput: 0: 9621.2. Samples: 626843140. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:23,989][27935] Avg episode reward: [(0, '-1.110')] [2022-07-13 12:39:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 313445376. Throughput: 0: 9633.5. Samples: 626901700. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:28,989][27935] Avg episode reward: [(0, '-0.716')] [2022-07-13 12:39:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 313469952. Throughput: 0: 9619.6. Samples: 626959656. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:33,990][27935] Avg episode reward: [(0, '-1.209')] [2022-07-13 12:39:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 313493504. Throughput: 0: 9625.7. Samples: 626988700. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:38,991][27935] Avg episode reward: [(0, '-0.992')] [2022-07-13 12:39:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4835.4). Total num frames: 313518080. Throughput: 0: 9621.4. Samples: 627046812. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:43,989][27935] Avg episode reward: [(0, '-0.918')] [2022-07-13 12:39:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 313542656. Throughput: 0: 9687.2. Samples: 627104284. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:48,991][27935] Avg episode reward: [(0, '-1.876')] [2022-07-13 12:39:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 313565184. Throughput: 0: 9664.5. Samples: 627132540. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:53,989][27935] Avg episode reward: [(0, '-1.170')] [2022-07-13 12:39:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4835.4). Total num frames: 313589760. Throughput: 0: 9641.0. Samples: 627189508. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:39:58,991][27935] Avg episode reward: [(0, '-1.790')] [2022-07-13 12:40:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 313613312. Throughput: 0: 9547.4. Samples: 627243468. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:03,989][27935] Avg episode reward: [(0, '-2.149')] [2022-07-13 12:40:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 313635840. Throughput: 0: 9546.0. Samples: 627272708. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:08,989][27935] Avg episode reward: [(0, '-1.916')] [2022-07-13 12:40:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 313661440. Throughput: 0: 9539.9. Samples: 627330996. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:13,989][27935] Avg episode reward: [(0, '-2.081')] [2022-07-13 12:40:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 313683968. Throughput: 0: 9544.3. Samples: 627389148. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:18,989][27935] Avg episode reward: [(0, '-1.093')] [2022-07-13 12:40:23,990][27935] Fps is (10 sec: 4709.9, 60 sec: 4778.6, 300 sec: 4821.5). Total num frames: 313708544. Throughput: 0: 9552.8. Samples: 627418588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:23,990][27935] Avg episode reward: [(0, '-1.252')] [2022-07-13 12:40:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 313734144. Throughput: 0: 9561.3. Samples: 627477072. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:28,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 12:40:33,992][27935] Fps is (10 sec: 5016.3, 60 sec: 4812.5, 300 sec: 4831.8). Total num frames: 313758720. Throughput: 0: 8926.6. Samples: 627506012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:33,993][27935] Avg episode reward: [(0, '-0.074')] [2022-07-13 12:40:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 313782272. Throughput: 0: 9590.5. Samples: 627564112. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:38,989][27935] Avg episode reward: [(0, '-0.593')] [2022-07-13 12:40:43,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 313806848. Throughput: 0: 9631.3. Samples: 627622916. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:43,990][27935] Avg episode reward: [(0, '-0.186')] [2022-07-13 12:40:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 313831424. Throughput: 0: 9076.6. Samples: 627651916. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:48,989][27935] Avg episode reward: [(0, '0.137')] [2022-07-13 12:40:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 313854976. Throughput: 0: 9730.3. Samples: 627710572. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:53,989][27935] Avg episode reward: [(0, '-0.360')] [2022-07-13 12:40:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 313879552. Throughput: 0: 9733.6. Samples: 627769008. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:40:58,989][27935] Avg episode reward: [(0, '-1.107')] [2022-07-13 12:41:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 313901056. Throughput: 0: 9641.0. Samples: 627822992. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:03,991][27935] Avg episode reward: [(0, '-1.055')] [2022-07-13 12:41:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 313925632. Throughput: 0: 9626.3. Samples: 627851760. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:08,989][27935] Avg episode reward: [(0, '-1.670')] [2022-07-13 12:41:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 313951232. Throughput: 0: 9629.8. Samples: 627910412. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:13,989][27935] Avg episode reward: [(0, '-1.782')] [2022-07-13 12:41:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 313973760. Throughput: 0: 10274.1. Samples: 627968312. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:18,989][27935] Avg episode reward: [(0, '-1.625')] [2022-07-13 12:41:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.0, 300 sec: 4825.0). Total num frames: 313998336. Throughput: 0: 9618.2. Samples: 627996932. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:23,989][27935] Avg episode reward: [(0, '-1.517')] [2022-07-13 12:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 314021888. Throughput: 0: 9593.0. Samples: 628054600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:28,989][27935] Avg episode reward: [(0, '-1.620')] [2022-07-13 12:41:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4814.5). Total num frames: 314046464. Throughput: 0: 10226.0. Samples: 628112084. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 12:41:33,989][27935] Avg episode reward: [(0, '-0.770')] [2022-07-13 12:41:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 314070016. Throughput: 0: 9565.4. Samples: 628141016. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:41:38,989][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 12:41:43,993][27935] Fps is (10 sec: 4811.0, 60 sec: 4795.4, 300 sec: 4814.5). Total num frames: 314094592. Throughput: 0: 9554.5. Samples: 628198996. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:41:43,993][27935] Avg episode reward: [(0, '-0.908')] [2022-07-13 12:41:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 314118144. Throughput: 0: 9632.8. Samples: 628256468. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:41:48,989][27935] Avg episode reward: [(0, '-0.258')] [2022-07-13 12:41:53,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 314142720. Throughput: 0: 9639.4. Samples: 628285532. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:41:53,989][27935] Avg episode reward: [(0, '-0.465')] [2022-07-13 12:41:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 314167296. Throughput: 0: 9626.3. Samples: 628343596. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:41:58,989][27935] Avg episode reward: [(0, '-0.475')] [2022-07-13 12:42:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 314189824. Throughput: 0: 9535.7. Samples: 628397416. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:03,989][27935] Avg episode reward: [(0, '-0.118')] [2022-07-13 12:42:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 314213376. Throughput: 0: 9550.1. Samples: 628426688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:08,989][27935] Avg episode reward: [(0, '-0.570')] [2022-07-13 12:42:13,990][27935] Fps is (10 sec: 4812.3, 60 sec: 4778.6, 300 sec: 4814.7). Total num frames: 314237952. Throughput: 0: 9556.1. Samples: 628484636. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:13,992][27935] Avg episode reward: [(0, '-0.243')] [2022-07-13 12:42:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 314261504. Throughput: 0: 9566.7. Samples: 628542584. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:18,989][27935] Avg episode reward: [(0, '-1.113')] [2022-07-13 12:42:23,989][27935] Fps is (10 sec: 4710.9, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 314285056. Throughput: 0: 9574.4. Samples: 628571864. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:23,989][27935] Avg episode reward: [(0, '-1.822')] [2022-07-13 12:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 314310656. Throughput: 0: 9579.6. Samples: 628630040. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:28,989][27935] Avg episode reward: [(0, '-1.860')] [2022-07-13 12:42:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 314334208. Throughput: 0: 9585.5. Samples: 628687816. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:33,989][27935] Avg episode reward: [(0, '-2.314')] [2022-07-13 12:42:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 314358784. Throughput: 0: 9581.2. Samples: 628716684. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:38,989][27935] Avg episode reward: [(0, '-2.435')] [2022-07-13 12:42:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4804.1). Total num frames: 314382336. Throughput: 0: 9564.7. Samples: 628774008. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:43,990][27935] Avg episode reward: [(0, '-2.695')] [2022-07-13 12:42:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 314405888. Throughput: 0: 9651.9. Samples: 628831752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:48,989][27935] Avg episode reward: [(0, '-2.786')] [2022-07-13 12:42:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.6). Total num frames: 314429440. Throughput: 0: 9638.3. Samples: 628860412. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:53,989][27935] Avg episode reward: [(0, '-1.626')] [2022-07-13 12:42:58,996][27935] Fps is (10 sec: 4809.5, 60 sec: 4778.1, 300 sec: 4811.0). Total num frames: 314454016. Throughput: 0: 9625.3. Samples: 628917828. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:42:58,996][27935] Avg episode reward: [(0, '-1.029')] [2022-07-13 12:43:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 314476544. Throughput: 0: 9541.2. Samples: 628971936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:03,989][27935] Avg episode reward: [(0, '-1.750')] [2022-07-13 12:43:08,989][27935] Fps is (10 sec: 4508.6, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 314499072. Throughput: 0: 9529.1. Samples: 629000672. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:08,989][27935] Avg episode reward: [(0, '-1.284')] [2022-07-13 12:43:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.8, 300 sec: 4804.1). Total num frames: 314525696. Throughput: 0: 9525.2. Samples: 629058672. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:13,989][27935] Avg episode reward: [(0, '-0.655')] [2022-07-13 12:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 314548224. Throughput: 0: 9518.8. Samples: 629116164. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:18,989][27935] Avg episode reward: [(0, '-0.054')] [2022-07-13 12:43:23,989][27935] Fps is (10 sec: 4607.7, 60 sec: 4778.6, 300 sec: 4797.2). Total num frames: 314571776. Throughput: 0: 9516.2. Samples: 629144920. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:23,991][27935] Avg episode reward: [(0, '-0.237')] [2022-07-13 12:43:28,991][27935] Fps is (10 sec: 4811.5, 60 sec: 4761.4, 300 sec: 4797.1). Total num frames: 314596352. Throughput: 0: 9525.7. Samples: 629202692. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:28,992][27935] Avg episode reward: [(0, '-0.149')] [2022-07-13 12:43:33,989][27935] Fps is (10 sec: 4915.5, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 314620928. Throughput: 0: 9533.0. Samples: 629260736. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:33,990][27935] Avg episode reward: [(0, '0.001')] [2022-07-13 12:43:38,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 314645504. Throughput: 0: 9538.0. Samples: 629289624. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:38,989][27935] Avg episode reward: [(0, '0.070')] [2022-07-13 12:43:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 314670080. Throughput: 0: 9547.6. Samples: 629347404. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:43,990][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 12:43:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 314691584. Throughput: 0: 9630.6. Samples: 629405312. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:48,991][27935] Avg episode reward: [(0, '-0.606')] [2022-07-13 12:43:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 314717184. Throughput: 0: 9630.0. Samples: 629434020. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:53,989][27935] Avg episode reward: [(0, '-2.044')] [2022-07-13 12:43:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4779.2, 300 sec: 4800.7). Total num frames: 314740736. Throughput: 0: 9626.7. Samples: 629491872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 12:43:58,989][27935] Avg episode reward: [(0, '-2.413')] [2022-07-13 12:44:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 314762240. Throughput: 0: 9542.0. Samples: 629545552. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:03,989][27935] Avg episode reward: [(0, '-2.350')] [2022-07-13 12:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 314786816. Throughput: 0: 9546.5. Samples: 629574508. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:08,990][27935] Avg episode reward: [(0, '-2.558')] [2022-07-13 12:44:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 314812416. Throughput: 0: 9543.5. Samples: 629632124. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:13,989][27935] Avg episode reward: [(0, '-2.462')] [2022-07-13 12:44:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 314834944. Throughput: 0: 9543.4. Samples: 629690188. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:18,989][27935] Avg episode reward: [(0, '-1.499')] [2022-07-13 12:44:23,991][27935] Fps is (10 sec: 4709.2, 60 sec: 4795.6, 300 sec: 4793.7). Total num frames: 314859520. Throughput: 0: 9547.1. Samples: 629719268. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:23,992][27935] Avg episode reward: [(0, '-1.534')] [2022-07-13 12:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4796.0, 300 sec: 4793.7). Total num frames: 314884096. Throughput: 0: 9550.2. Samples: 629777164. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:28,989][27935] Avg episode reward: [(0, '-0.319')] [2022-07-13 12:44:33,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 314907648. Throughput: 0: 8903.4. Samples: 629805964. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:33,989][27935] Avg episode reward: [(0, '-0.472')] [2022-07-13 12:44:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 314931200. Throughput: 0: 9542.3. Samples: 629863424. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:38,989][27935] Avg episode reward: [(0, '-0.690')] [2022-07-13 12:44:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 314954752. Throughput: 0: 9545.4. Samples: 629921416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:43,989][27935] Avg episode reward: [(0, '-0.793')] [2022-07-13 12:44:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 314980352. Throughput: 0: 9644.8. Samples: 629979568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:48,989][27935] Avg episode reward: [(0, '-0.117')] [2022-07-13 12:44:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 315004928. Throughput: 0: 9639.9. Samples: 630008304. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:53,990][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 12:44:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 315028480. Throughput: 0: 9655.6. Samples: 630066624. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:44:58,989][27935] Avg episode reward: [(0, '-0.288')] [2022-07-13 12:45:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 315052032. Throughput: 0: 9019.7. Samples: 630096072. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:03,991][27935] Avg episode reward: [(0, '-0.370')] [2022-07-13 12:45:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315074560. Throughput: 0: 9583.0. Samples: 630150476. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:08,989][27935] Avg episode reward: [(0, '-0.674')] [2022-07-13 12:45:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 315099136. Throughput: 0: 9582.7. Samples: 630208384. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:13,989][27935] Avg episode reward: [(0, '-0.596')] [2022-07-13 12:45:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 315123712. Throughput: 0: 10231.8. Samples: 630266396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:18,989][27935] Avg episode reward: [(0, '-0.403')] [2022-07-13 12:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4790.2). Total num frames: 315147264. Throughput: 0: 9594.4. Samples: 630295172. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:23,989][27935] Avg episode reward: [(0, '-0.249')] [2022-07-13 12:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.3). Total num frames: 315171840. Throughput: 0: 9600.7. Samples: 630353448. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:28,989][27935] Avg episode reward: [(0, '0.004')] [2022-07-13 12:45:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 315196416. Throughput: 0: 9594.3. Samples: 630411312. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:33,989][27935] Avg episode reward: [(0, '-0.408')] [2022-07-13 12:45:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 315218944. Throughput: 0: 9589.8. Samples: 630439844. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:38,989][27935] Avg episode reward: [(0, '-0.682')] [2022-07-13 12:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 315244544. Throughput: 0: 9590.4. Samples: 630498192. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:43,990][27935] Avg episode reward: [(0, '-0.830')] [2022-07-13 12:45:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 315269120. Throughput: 0: 10230.8. Samples: 630556456. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:48,989][27935] Avg episode reward: [(0, '-0.184')] [2022-07-13 12:45:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 315291648. Throughput: 0: 9664.6. Samples: 630585384. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:53,990][27935] Avg episode reward: [(0, '-0.795')] [2022-07-13 12:45:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 315315200. Throughput: 0: 9636.4. Samples: 630642020. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:45:58,990][27935] Avg episode reward: [(0, '-0.994')] [2022-07-13 12:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 315338752. Throughput: 0: 9551.4. Samples: 630696208. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:03,991][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 12:46:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 315362304. Throughput: 0: 9559.3. Samples: 630725340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:08,990][27935] Avg episode reward: [(0, '-0.082')] [2022-07-13 12:46:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315386880. Throughput: 0: 9540.9. Samples: 630782788. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:13,989][27935] Avg episode reward: [(0, '-0.244')] [2022-07-13 12:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315411456. Throughput: 0: 9538.3. Samples: 630840536. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:18,991][27935] Avg episode reward: [(0, '-0.492')] [2022-07-13 12:46:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315435008. Throughput: 0: 9542.3. Samples: 630869248. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:23,989][27935] Avg episode reward: [(0, '-0.832')] [2022-07-13 12:46:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 315458560. Throughput: 0: 9537.7. Samples: 630927388. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 12:46:28,989][27935] Avg episode reward: [(0, '-0.182')] [2022-07-13 12:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 315482112. Throughput: 0: 9522.9. Samples: 630984988. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:33,989][27935] Avg episode reward: [(0, '-0.286')] [2022-07-13 12:46:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 315506688. Throughput: 0: 9526.1. Samples: 631014060. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:38,991][27935] Avg episode reward: [(0, '0.271')] [2022-07-13 12:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 315531264. Throughput: 0: 9554.5. Samples: 631071972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:43,989][27935] Avg episode reward: [(0, '0.005')] [2022-07-13 12:46:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 315554816. Throughput: 0: 9657.6. Samples: 631130800. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:48,989][27935] Avg episode reward: [(0, '-0.797')] [2022-07-13 12:46:53,996][27935] Fps is (10 sec: 4809.5, 60 sec: 4795.2, 300 sec: 4786.7). Total num frames: 315579392. Throughput: 0: 9650.9. Samples: 631159700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:53,996][27935] Avg episode reward: [(0, '0.003')] [2022-07-13 12:46:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 315603968. Throughput: 0: 9663.9. Samples: 631217664. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:46:58,989][27935] Avg episode reward: [(0, '-0.215')] [2022-07-13 12:47:03,989][27935] Fps is (10 sec: 4713.7, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315626496. Throughput: 0: 9584.6. Samples: 631271844. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:03,989][27935] Avg episode reward: [(0, '-0.536')] [2022-07-13 12:47:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4790.3). Total num frames: 315651072. Throughput: 0: 9593.4. Samples: 631300952. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:08,989][27935] Avg episode reward: [(0, '-1.485')] [2022-07-13 12:47:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315674624. Throughput: 0: 9589.0. Samples: 631358892. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:13,989][27935] Avg episode reward: [(0, '-1.516')] [2022-07-13 12:47:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 315698176. Throughput: 0: 9599.6. Samples: 631416972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:18,989][27935] Avg episode reward: [(0, '-1.840')] [2022-07-13 12:47:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 315722752. Throughput: 0: 9595.2. Samples: 631445844. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:23,989][27935] Avg episode reward: [(0, '-1.256')] [2022-07-13 12:47:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 315746304. Throughput: 0: 9589.4. Samples: 631503496. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:28,989][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 12:47:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 315771904. Throughput: 0: 9566.0. Samples: 631561268. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:33,989][27935] Avg episode reward: [(0, '-1.432')] [2022-07-13 12:47:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 315795456. Throughput: 0: 9565.8. Samples: 631590092. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:38,989][27935] Avg episode reward: [(0, '-0.828')] [2022-07-13 12:47:43,992][27935] Fps is (10 sec: 4606.4, 60 sec: 4778.4, 300 sec: 4786.7). Total num frames: 315817984. Throughput: 0: 9537.7. Samples: 631646896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:43,994][27935] Avg episode reward: [(0, '-1.089')] [2022-07-13 12:47:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 315842560. Throughput: 0: 9626.6. Samples: 631705040. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:48,989][27935] Avg episode reward: [(0, '-2.120')] [2022-07-13 12:47:53,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4796.3, 300 sec: 4790.3). Total num frames: 315867136. Throughput: 0: 9625.1. Samples: 631734084. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:53,989][27935] Avg episode reward: [(0, '-1.786')] [2022-07-13 12:47:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 315890688. Throughput: 0: 9618.6. Samples: 631791728. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:47:58,989][27935] Avg episode reward: [(0, '-1.663')] [2022-07-13 12:48:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 315913216. Throughput: 0: 9524.2. Samples: 631845560. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:03,989][27935] Avg episode reward: [(0, '-1.964')] [2022-07-13 12:48:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 315937792. Throughput: 0: 9523.0. Samples: 631874380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:08,989][27935] Avg episode reward: [(0, '-2.176')] [2022-07-13 12:48:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 315961344. Throughput: 0: 9522.8. Samples: 631932024. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:13,989][27935] Avg episode reward: [(0, '-2.487')] [2022-07-13 12:48:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 315984896. Throughput: 0: 9523.4. Samples: 631989820. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:18,989][27935] Avg episode reward: [(0, '-1.118')] [2022-07-13 12:48:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.3). Total num frames: 316009472. Throughput: 0: 9525.5. Samples: 632018740. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:23,989][27935] Avg episode reward: [(0, '-1.395')] [2022-07-13 12:48:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 316033024. Throughput: 0: 9542.0. Samples: 632076252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:28,989][27935] Avg episode reward: [(0, '-0.732')] [2022-07-13 12:48:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 316056576. Throughput: 0: 9528.5. Samples: 632133824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:33,989][27935] Avg episode reward: [(0, '-0.637')] [2022-07-13 12:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 316082176. Throughput: 0: 9528.2. Samples: 632162852. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:38,989][27935] Avg episode reward: [(0, '-0.591')] [2022-07-13 12:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4796.0, 300 sec: 4793.7). Total num frames: 316105728. Throughput: 0: 9548.5. Samples: 632221412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:43,989][27935] Avg episode reward: [(0, '0.110')] [2022-07-13 12:48:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 316130304. Throughput: 0: 9645.7. Samples: 632279616. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:48,989][27935] Avg episode reward: [(0, '0.133')] [2022-07-13 12:48:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 316153856. Throughput: 0: 9643.4. Samples: 632308332. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:53,989][27935] Avg episode reward: [(0, '0.340')] [2022-07-13 12:48:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 316179456. Throughput: 0: 9640.2. Samples: 632365832. Policy #0 lag: (min: 0.0, avg: 8.7, max: 19.0) [2022-07-13 12:48:58,989][27935] Avg episode reward: [(0, '1.009')] [2022-07-13 12:49:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 316199936. Throughput: 0: 9560.4. Samples: 632420040. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:03,989][27935] Avg episode reward: [(0, '1.259')] [2022-07-13 12:49:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 316224512. Throughput: 0: 9565.4. Samples: 632449184. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:08,989][27935] Avg episode reward: [(0, '1.004')] [2022-07-13 12:49:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 316250112. Throughput: 0: 9580.0. Samples: 632507352. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:13,989][27935] Avg episode reward: [(0, '0.634')] [2022-07-13 12:49:18,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4812.5, 300 sec: 4793.7). Total num frames: 316273664. Throughput: 0: 9586.7. Samples: 632565264. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:18,994][27935] Avg episode reward: [(0, '0.160')] [2022-07-13 12:49:23,992][27935] Fps is (10 sec: 4708.8, 60 sec: 4795.5, 300 sec: 4790.2). Total num frames: 316297216. Throughput: 0: 9589.8. Samples: 632594428. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:23,993][27935] Avg episode reward: [(0, '0.108')] [2022-07-13 12:49:28,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 316321792. Throughput: 0: 9576.9. Samples: 632652372. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:28,989][27935] Avg episode reward: [(0, '0.100')] [2022-07-13 12:49:33,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 316345344. Throughput: 0: 9574.1. Samples: 632710452. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:33,989][27935] Avg episode reward: [(0, '-0.030')] [2022-07-13 12:49:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 316369920. Throughput: 0: 9579.5. Samples: 632739408. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:38,989][27935] Avg episode reward: [(0, '-1.464')] [2022-07-13 12:49:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 316393472. Throughput: 0: 9605.8. Samples: 632798092. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:43,989][27935] Avg episode reward: [(0, '-1.811')] [2022-07-13 12:49:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 316418048. Throughput: 0: 9704.5. Samples: 632856744. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:48,989][27935] Avg episode reward: [(0, '-2.293')] [2022-07-13 12:49:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 316443648. Throughput: 0: 9704.0. Samples: 632885864. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:53,989][27935] Avg episode reward: [(0, '-3.554')] [2022-07-13 12:49:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 316467200. Throughput: 0: 9697.2. Samples: 632943724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:49:58,989][27935] Avg episode reward: [(0, '-3.540')] [2022-07-13 12:50:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 316489728. Throughput: 0: 9619.2. Samples: 632998092. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:03,989][27935] Avg episode reward: [(0, '-3.247')] [2022-07-13 12:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 316513280. Throughput: 0: 9624.1. Samples: 633027480. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:08,989][27935] Avg episode reward: [(0, '-2.621')] [2022-07-13 12:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 316537856. Throughput: 0: 9636.6. Samples: 633086020. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:13,989][27935] Avg episode reward: [(0, '-2.311')] [2022-07-13 12:50:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4793.7). Total num frames: 316561408. Throughput: 0: 9652.6. Samples: 633144820. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:18,989][27935] Avg episode reward: [(0, '-1.976')] [2022-07-13 12:50:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.2, 300 sec: 4800.7). Total num frames: 316588032. Throughput: 0: 9660.0. Samples: 633174108. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:23,989][27935] Avg episode reward: [(0, '-1.252')] [2022-07-13 12:50:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 316612608. Throughput: 0: 9648.9. Samples: 633232292. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:28,990][27935] Avg episode reward: [(0, '-0.359')] [2022-07-13 12:50:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 316634112. Throughput: 0: 8989.3. Samples: 633261264. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:33,990][27935] Avg episode reward: [(0, '0.190')] [2022-07-13 12:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 316660736. Throughput: 0: 9633.3. Samples: 633319364. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:38,989][27935] Avg episode reward: [(0, '-0.235')] [2022-07-13 12:50:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 316683264. Throughput: 0: 9642.0. Samples: 633377616. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:43,989][27935] Avg episode reward: [(0, '-0.297')] [2022-07-13 12:50:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 316707840. Throughput: 0: 9724.4. Samples: 633435688. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:48,989][27935] Avg episode reward: [(0, '-0.598')] [2022-07-13 12:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 316733440. Throughput: 0: 9724.6. Samples: 633465088. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:53,989][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 12:50:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 316755968. Throughput: 0: 9718.2. Samples: 633523340. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:50:58,989][27935] Avg episode reward: [(0, '-0.736')] [2022-07-13 12:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 316778496. Throughput: 0: 9598.6. Samples: 633576756. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:51:03,989][27935] Avg episode reward: [(0, '-0.945')] [2022-07-13 12:51:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 316802048. Throughput: 0: 9580.6. Samples: 633605236. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:51:08,990][27935] Avg episode reward: [(0, '-0.296')] [2022-07-13 12:51:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 316824576. Throughput: 0: 9512.7. Samples: 633660364. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:51:13,989][27935] Avg episode reward: [(0, '0.064')] [2022-07-13 12:51:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 316848128. Throughput: 0: 10051.9. Samples: 633713600. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:51:18,989][27935] Avg episode reward: [(0, '0.632')] [2022-07-13 12:51:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4786.8). Total num frames: 316870656. Throughput: 0: 9381.9. Samples: 633741548. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 12:51:23,989][27935] Avg episode reward: [(0, '0.642')] [2022-07-13 12:51:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4786.8). Total num frames: 316894208. Throughput: 0: 9375.1. Samples: 633799496. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:28,989][27935] Avg episode reward: [(0, '0.578')] [2022-07-13 12:51:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4786.8). Total num frames: 316918784. Throughput: 0: 9369.2. Samples: 633857300. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:33,989][27935] Avg episode reward: [(0, '0.658')] [2022-07-13 12:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4786.8). Total num frames: 316943360. Throughput: 0: 9355.0. Samples: 633886064. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:38,989][27935] Avg episode reward: [(0, '-1.053')] [2022-07-13 12:51:43,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4744.3, 300 sec: 4790.2). Total num frames: 316967936. Throughput: 0: 9351.0. Samples: 633944168. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:43,993][27935] Avg episode reward: [(0, '-1.361')] [2022-07-13 12:51:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4786.9). Total num frames: 316991488. Throughput: 0: 9460.2. Samples: 634002464. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:48,989][27935] Avg episode reward: [(0, '-1.098')] [2022-07-13 12:51:53,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4710.4, 300 sec: 4786.8). Total num frames: 317016064. Throughput: 0: 9475.7. Samples: 634031640. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:53,989][27935] Avg episode reward: [(0, '-1.034')] [2022-07-13 12:51:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4786.8). Total num frames: 317038592. Throughput: 0: 9531.2. Samples: 634089268. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:51:58,989][27935] Avg episode reward: [(0, '-0.766')] [2022-07-13 12:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4783.3). Total num frames: 317062144. Throughput: 0: 9528.5. Samples: 634142384. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:03,991][27935] Avg episode reward: [(0, '-0.657')] [2022-07-13 12:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4779.8). Total num frames: 317084672. Throughput: 0: 9549.8. Samples: 634171288. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:08,989][27935] Avg episode reward: [(0, '-0.723')] [2022-07-13 12:52:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4786.8). Total num frames: 317110272. Throughput: 0: 9560.2. Samples: 634229704. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:13,991][27935] Avg episode reward: [(0, '1.056')] [2022-07-13 12:52:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 317134848. Throughput: 0: 9572.4. Samples: 634288056. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:18,991][27935] Avg episode reward: [(0, '1.376')] [2022-07-13 12:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 317158400. Throughput: 0: 9582.2. Samples: 634317264. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:23,989][27935] Avg episode reward: [(0, '0.835')] [2022-07-13 12:52:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 317182976. Throughput: 0: 9594.7. Samples: 634375896. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:28,989][27935] Avg episode reward: [(0, '0.783')] [2022-07-13 12:52:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 317207552. Throughput: 0: 9584.7. Samples: 634433776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:33,989][27935] Avg episode reward: [(0, '0.019')] [2022-07-13 12:52:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.8). Total num frames: 317232128. Throughput: 0: 9589.8. Samples: 634463180. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:38,990][27935] Avg episode reward: [(0, '-0.148')] [2022-07-13 12:52:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4790.2). Total num frames: 317255680. Throughput: 0: 9584.5. Samples: 634520572. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:43,989][27935] Avg episode reward: [(0, '-1.718')] [2022-07-13 12:52:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 317279232. Throughput: 0: 9699.3. Samples: 634578852. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:48,990][27935] Avg episode reward: [(0, '-1.741')] [2022-07-13 12:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 317303808. Throughput: 0: 9702.8. Samples: 634607916. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:53,989][27935] Avg episode reward: [(0, '-1.228')] [2022-07-13 12:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 317328384. Throughput: 0: 9701.3. Samples: 634666264. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:52:58,990][27935] Avg episode reward: [(0, '-1.321')] [2022-07-13 12:53:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 317349888. Throughput: 0: 9596.2. Samples: 634719884. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:03,989][27935] Avg episode reward: [(0, '-1.185')] [2022-07-13 12:53:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 317374464. Throughput: 0: 9595.5. Samples: 634749060. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:08,990][27935] Avg episode reward: [(0, '-0.320')] [2022-07-13 12:53:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 317398016. Throughput: 0: 9581.3. Samples: 634807056. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:13,990][27935] Avg episode reward: [(0, '-0.975')] [2022-07-13 12:53:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 317423616. Throughput: 0: 9576.6. Samples: 634864724. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:18,991][27935] Avg episode reward: [(0, '1.212')] [2022-07-13 12:53:23,992][27935] Fps is (10 sec: 4811.3, 60 sec: 4795.5, 300 sec: 4790.2). Total num frames: 317446144. Throughput: 0: 9567.6. Samples: 634893752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:23,993][27935] Avg episode reward: [(0, '1.069')] [2022-07-13 12:53:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 317469696. Throughput: 0: 9577.4. Samples: 634951556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:28,989][27935] Avg episode reward: [(0, '0.644')] [2022-07-13 12:53:33,989][27935] Fps is (10 sec: 4916.7, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 317495296. Throughput: 0: 9557.6. Samples: 635008944. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:33,989][27935] Avg episode reward: [(0, '0.643')] [2022-07-13 12:53:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 317518848. Throughput: 0: 9556.3. Samples: 635037948. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:38,989][27935] Avg episode reward: [(0, '0.445')] [2022-07-13 12:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 317543424. Throughput: 0: 9550.3. Samples: 635096028. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:43,989][27935] Avg episode reward: [(0, '1.107')] [2022-07-13 12:53:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 317568000. Throughput: 0: 9654.0. Samples: 635154316. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:48,989][27935] Avg episode reward: [(0, '0.880')] [2022-07-13 12:53:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 317590528. Throughput: 0: 9658.5. Samples: 635183692. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 12:53:53,989][27935] Avg episode reward: [(0, '0.770')] [2022-07-13 12:53:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 317616128. Throughput: 0: 9665.2. Samples: 635241988. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:53:58,989][27935] Avg episode reward: [(0, '0.106')] [2022-07-13 12:54:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 317639680. Throughput: 0: 9587.2. Samples: 635296148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:03,989][27935] Avg episode reward: [(0, '0.440')] [2022-07-13 12:54:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4786.8). Total num frames: 317662208. Throughput: 0: 9588.2. Samples: 635325192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:08,989][27935] Avg episode reward: [(0, '0.582')] [2022-07-13 12:54:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4793.8). Total num frames: 317687808. Throughput: 0: 9589.9. Samples: 635383100. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:13,989][27935] Avg episode reward: [(0, '0.740')] [2022-07-13 12:54:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.3). Total num frames: 317710336. Throughput: 0: 9607.2. Samples: 635441268. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:18,991][27935] Avg episode reward: [(0, '-0.320')] [2022-07-13 12:54:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4813.0, 300 sec: 4790.2). Total num frames: 317734912. Throughput: 0: 9611.3. Samples: 635470456. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:23,989][27935] Avg episode reward: [(0, '-0.953')] [2022-07-13 12:54:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 317758464. Throughput: 0: 9616.1. Samples: 635528752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:28,993][27935] Avg episode reward: [(0, '-0.198')] [2022-07-13 12:54:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 317784064. Throughput: 0: 9602.1. Samples: 635586412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:33,989][27935] Avg episode reward: [(0, '-0.894')] [2022-07-13 12:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 317807616. Throughput: 0: 9594.1. Samples: 635615428. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:38,989][27935] Avg episode reward: [(0, '-0.811')] [2022-07-13 12:54:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4790.2). Total num frames: 317831168. Throughput: 0: 9595.2. Samples: 635673772. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:43,989][27935] Avg episode reward: [(0, '-0.944')] [2022-07-13 12:54:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 317856768. Throughput: 0: 9682.6. Samples: 635731864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:48,989][27935] Avg episode reward: [(0, '-0.715')] [2022-07-13 12:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 317880320. Throughput: 0: 9690.0. Samples: 635761240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:53,989][27935] Avg episode reward: [(0, '0.582')] [2022-07-13 12:54:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 317904896. Throughput: 0: 9690.0. Samples: 635819148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:54:58,989][27935] Avg episode reward: [(0, '0.421')] [2022-07-13 12:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 317927424. Throughput: 0: 9587.9. Samples: 635872724. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:03,989][27935] Avg episode reward: [(0, '-0.251')] [2022-07-13 12:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 317950976. Throughput: 0: 9590.0. Samples: 635902008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:08,989][27935] Avg episode reward: [(0, '0.452')] [2022-07-13 12:55:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 317975552. Throughput: 0: 9593.5. Samples: 635960460. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:13,990][27935] Avg episode reward: [(0, '0.167')] [2022-07-13 12:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 317999104. Throughput: 0: 9596.1. Samples: 636018236. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:18,989][27935] Avg episode reward: [(0, '-1.237')] [2022-07-13 12:55:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 318024704. Throughput: 0: 9599.9. Samples: 636047424. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:23,989][27935] Avg episode reward: [(0, '-1.019')] [2022-07-13 12:55:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 318047232. Throughput: 0: 9587.8. Samples: 636105224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:28,989][27935] Avg episode reward: [(0, '-1.044')] [2022-07-13 12:55:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 318071808. Throughput: 0: 9584.1. Samples: 636163148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:33,989][27935] Avg episode reward: [(0, '-0.989')] [2022-07-13 12:55:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 318096384. Throughput: 0: 9574.2. Samples: 636192080. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:38,994][27935] Avg episode reward: [(0, '-1.301')] [2022-07-13 12:55:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 318120960. Throughput: 0: 9584.8. Samples: 636250464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:43,989][27935] Avg episode reward: [(0, '-1.365')] [2022-07-13 12:55:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 318145536. Throughput: 0: 9684.7. Samples: 636308536. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:48,989][27935] Avg episode reward: [(0, '-2.247')] [2022-07-13 12:55:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 318169088. Throughput: 0: 9685.8. Samples: 636337868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:53,989][27935] Avg episode reward: [(0, '-1.120')] [2022-07-13 12:55:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 318191616. Throughput: 0: 9678.7. Samples: 636396000. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:55:58,990][27935] Avg episode reward: [(0, '-1.138')] [2022-07-13 12:56:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 318214144. Throughput: 0: 9034.4. Samples: 636424784. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:56:03,989][27935] Avg episode reward: [(0, '-0.989')] [2022-07-13 12:56:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 318240768. Throughput: 0: 9584.4. Samples: 636478720. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:56:08,989][27935] Avg episode reward: [(0, '-0.892')] [2022-07-13 12:56:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 318264320. Throughput: 0: 9590.0. Samples: 636536776. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:56:13,989][27935] Avg episode reward: [(0, '-1.324')] [2022-07-13 12:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 318287872. Throughput: 0: 9586.9. Samples: 636594560. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 12:56:18,989][27935] Avg episode reward: [(0, '-1.177')] [2022-07-13 12:56:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 318311424. Throughput: 0: 9578.3. Samples: 636623104. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:23,989][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 12:56:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 318334976. Throughput: 0: 9562.2. Samples: 636680764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:28,989][27935] Avg episode reward: [(0, '-1.378')] [2022-07-13 12:56:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 318359552. Throughput: 0: 9555.8. Samples: 636738548. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:33,989][27935] Avg episode reward: [(0, '-1.575')] [2022-07-13 12:56:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 318383104. Throughput: 0: 9546.1. Samples: 636767444. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:38,989][27935] Avg episode reward: [(0, '-1.668')] [2022-07-13 12:56:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 318408704. Throughput: 0: 9540.5. Samples: 636825324. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:43,989][27935] Avg episode reward: [(0, '-0.988')] [2022-07-13 12:56:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 318431232. Throughput: 0: 10189.3. Samples: 636883304. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:48,989][27935] Avg episode reward: [(0, '-0.433')] [2022-07-13 12:56:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 318455808. Throughput: 0: 9637.0. Samples: 636912384. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:53,989][27935] Avg episode reward: [(0, '-0.189')] [2022-07-13 12:56:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 318480384. Throughput: 0: 9634.7. Samples: 636970336. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:56:58,989][27935] Avg episode reward: [(0, '0.079')] [2022-07-13 12:57:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 318501888. Throughput: 0: 9541.4. Samples: 637023924. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:03,989][27935] Avg episode reward: [(0, '0.279')] [2022-07-13 12:57:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 318526464. Throughput: 0: 9548.0. Samples: 637052764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:08,989][27935] Avg episode reward: [(0, '0.786')] [2022-07-13 12:57:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.6). Total num frames: 318551040. Throughput: 0: 9557.2. Samples: 637110840. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:13,989][27935] Avg episode reward: [(0, '0.092')] [2022-07-13 12:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.6). Total num frames: 318574592. Throughput: 0: 9555.5. Samples: 637168548. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:18,990][27935] Avg episode reward: [(0, '0.198')] [2022-07-13 12:57:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 318597120. Throughput: 0: 9553.5. Samples: 637197352. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:23,989][27935] Avg episode reward: [(0, '0.099')] [2022-07-13 12:57:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 318622720. Throughput: 0: 9556.8. Samples: 637255380. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:28,990][27935] Avg episode reward: [(0, '0.594')] [2022-07-13 12:57:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 318646272. Throughput: 0: 9558.8. Samples: 637313448. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:33,989][27935] Avg episode reward: [(0, '-0.110')] [2022-07-13 12:57:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318671872. Throughput: 0: 9561.4. Samples: 637342648. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:38,989][27935] Avg episode reward: [(0, '-0.665')] [2022-07-13 12:57:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 318695424. Throughput: 0: 9554.8. Samples: 637400300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:43,990][27935] Avg episode reward: [(0, '-1.475')] [2022-07-13 12:57:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318720000. Throughput: 0: 9670.2. Samples: 637459084. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:48,991][27935] Avg episode reward: [(0, '-2.846')] [2022-07-13 12:57:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 318743552. Throughput: 0: 9685.8. Samples: 637488624. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:53,989][27935] Avg episode reward: [(0, '-2.634')] [2022-07-13 12:57:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 318768128. Throughput: 0: 9696.4. Samples: 637547176. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:57:58,989][27935] Avg episode reward: [(0, '-1.927')] [2022-07-13 12:58:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318790656. Throughput: 0: 9601.8. Samples: 637600628. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:03,991][27935] Avg episode reward: [(0, '-1.947')] [2022-07-13 12:58:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 318814208. Throughput: 0: 9595.7. Samples: 637629160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:08,990][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 12:58:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318839808. Throughput: 0: 9605.2. Samples: 637687616. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:13,989][27935] Avg episode reward: [(0, '-1.666')] [2022-07-13 12:58:18,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4812.7, 300 sec: 4804.1). Total num frames: 318863360. Throughput: 0: 9615.0. Samples: 637746140. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:18,992][27935] Avg episode reward: [(0, '-1.261')] [2022-07-13 12:58:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318885888. Throughput: 0: 9614.1. Samples: 637775284. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:23,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 12:58:28,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 318912512. Throughput: 0: 9633.5. Samples: 637833808. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:28,989][27935] Avg episode reward: [(0, '-0.343')] [2022-07-13 12:58:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 318936064. Throughput: 0: 9614.2. Samples: 637891724. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:33,989][27935] Avg episode reward: [(0, '-0.579')] [2022-07-13 12:58:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 318959616. Throughput: 0: 9597.0. Samples: 637920488. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:38,989][27935] Avg episode reward: [(0, '-1.219')] [2022-07-13 12:58:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 318984192. Throughput: 0: 9582.7. Samples: 637978396. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:43,989][27935] Avg episode reward: [(0, '-2.519')] [2022-07-13 12:58:48,992][27935] Fps is (10 sec: 4913.8, 60 sec: 4812.6, 300 sec: 4807.5). Total num frames: 319008768. Throughput: 0: 9675.8. Samples: 638036068. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 12:58:48,993][27935] Avg episode reward: [(0, '-2.161')] [2022-07-13 12:58:53,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 319032320. Throughput: 0: 9693.8. Samples: 638065380. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:58:53,989][27935] Avg episode reward: [(0, '-1.303')] [2022-07-13 12:58:58,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 319057920. Throughput: 0: 9676.9. Samples: 638123076. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:58:58,989][27935] Avg episode reward: [(0, '-1.664')] [2022-07-13 12:59:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 319079424. Throughput: 0: 9582.5. Samples: 638177332. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:03,989][27935] Avg episode reward: [(0, '-2.446')] [2022-07-13 12:59:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 319102976. Throughput: 0: 9582.2. Samples: 638206484. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:08,989][27935] Avg episode reward: [(0, '-2.427')] [2022-07-13 12:59:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 319127552. Throughput: 0: 9570.6. Samples: 638264484. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:13,989][27935] Avg episode reward: [(0, '-3.209')] [2022-07-13 12:59:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.9, 300 sec: 4800.7). Total num frames: 319151104. Throughput: 0: 9580.2. Samples: 638322832. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:18,989][27935] Avg episode reward: [(0, '-2.906')] [2022-07-13 12:59:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 319175680. Throughput: 0: 9581.7. Samples: 638351664. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:23,989][27935] Avg episode reward: [(0, '-2.999')] [2022-07-13 12:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 319200256. Throughput: 0: 9596.0. Samples: 638410216. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:28,989][27935] Avg episode reward: [(0, '-3.611')] [2022-07-13 12:59:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 319225856. Throughput: 0: 9590.8. Samples: 638467628. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:33,989][27935] Avg episode reward: [(0, '-3.702')] [2022-07-13 12:59:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 319248384. Throughput: 0: 9589.6. Samples: 638496912. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:38,989][27935] Avg episode reward: [(0, '-3.670')] [2022-07-13 12:59:43,996][27935] Fps is (10 sec: 4706.8, 60 sec: 4812.2, 300 sec: 4800.5). Total num frames: 319272960. Throughput: 0: 9598.5. Samples: 638555080. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:43,997][27935] Avg episode reward: [(0, '-2.464')] [2022-07-13 12:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4800.7). Total num frames: 319296512. Throughput: 0: 9688.7. Samples: 638613324. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:48,989][27935] Avg episode reward: [(0, '-2.163')] [2022-07-13 12:59:53,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 319321088. Throughput: 0: 9689.4. Samples: 638642508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:53,989][27935] Avg episode reward: [(0, '-1.342')] [2022-07-13 12:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 319345664. Throughput: 0: 9696.9. Samples: 638700844. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 12:59:58,989][27935] Avg episode reward: [(0, '-0.778')] [2022-07-13 13:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 319368192. Throughput: 0: 9596.0. Samples: 638754652. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:03,989][27935] Avg episode reward: [(0, '-0.047')] [2022-07-13 13:00:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 319391744. Throughput: 0: 9596.3. Samples: 638783496. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:08,989][27935] Avg episode reward: [(0, '0.677')] [2022-07-13 13:00:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 319415296. Throughput: 0: 9569.2. Samples: 638840828. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:13,989][27935] Avg episode reward: [(0, '0.119')] [2022-07-13 13:00:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 319439872. Throughput: 0: 8934.2. Samples: 638869668. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:18,989][27935] Avg episode reward: [(0, '0.161')] [2022-07-13 13:00:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 319462400. Throughput: 0: 9564.3. Samples: 638927304. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:23,989][27935] Avg episode reward: [(0, '-0.206')] [2022-07-13 13:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 319489024. Throughput: 0: 9571.0. Samples: 638985704. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:28,992][27935] Avg episode reward: [(0, '-0.363')] [2022-07-13 13:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 319511552. Throughput: 0: 9552.4. Samples: 639043180. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:33,989][27935] Avg episode reward: [(0, '-0.808')] [2022-07-13 13:00:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 319535104. Throughput: 0: 9541.5. Samples: 639071876. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:38,989][27935] Avg episode reward: [(0, '-1.242')] [2022-07-13 13:00:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4796.3, 300 sec: 4797.2). Total num frames: 319560704. Throughput: 0: 9536.9. Samples: 639130004. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:43,989][27935] Avg episode reward: [(0, '-0.656')] [2022-07-13 13:00:48,991][27935] Fps is (10 sec: 4914.0, 60 sec: 4795.5, 300 sec: 4797.1). Total num frames: 319584256. Throughput: 0: 9629.1. Samples: 639187988. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:48,992][27935] Avg episode reward: [(0, '-0.323')] [2022-07-13 13:00:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 319607808. Throughput: 0: 9632.1. Samples: 639216940. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:53,989][27935] Avg episode reward: [(0, '-1.461')] [2022-07-13 13:00:58,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 319632384. Throughput: 0: 9640.9. Samples: 639274668. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:00:58,989][27935] Avg episode reward: [(0, '-1.708')] [2022-07-13 13:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 319654912. Throughput: 0: 10196.2. Samples: 639328496. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:01:03,990][27935] Avg episode reward: [(0, '-2.455')] [2022-07-13 13:01:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 319678464. Throughput: 0: 9559.7. Samples: 639357492. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:01:08,989][27935] Avg episode reward: [(0, '-1.643')] [2022-07-13 13:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 319704064. Throughput: 0: 9553.4. Samples: 639415608. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:01:13,989][27935] Avg episode reward: [(0, '-1.946')] [2022-07-13 13:01:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 319727616. Throughput: 0: 8920.6. Samples: 639444608. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:01:18,989][27935] Avg episode reward: [(0, '-2.461')] [2022-07-13 13:01:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 319751168. Throughput: 0: 9564.6. Samples: 639502284. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:23,990][27935] Avg episode reward: [(0, '-1.453')] [2022-07-13 13:01:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 319774720. Throughput: 0: 9558.2. Samples: 639560124. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:28,989][27935] Avg episode reward: [(0, '-1.416')] [2022-07-13 13:01:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 319799296. Throughput: 0: 9547.0. Samples: 639617580. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:33,989][27935] Avg episode reward: [(0, '-1.052')] [2022-07-13 13:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 319822848. Throughput: 0: 9543.2. Samples: 639646384. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:38,989][27935] Avg episode reward: [(0, '0.005')] [2022-07-13 13:01:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 319847424. Throughput: 0: 9551.6. Samples: 639704488. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:43,989][27935] Avg episode reward: [(0, '-0.775')] [2022-07-13 13:01:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.9, 300 sec: 4800.7). Total num frames: 319872000. Throughput: 0: 9643.4. Samples: 639762448. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:48,990][27935] Avg episode reward: [(0, '-0.779')] [2022-07-13 13:01:53,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4795.6, 300 sec: 4797.2). Total num frames: 319895552. Throughput: 0: 9644.0. Samples: 639791484. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:53,991][27935] Avg episode reward: [(0, '-0.542')] [2022-07-13 13:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 319920128. Throughput: 0: 9638.9. Samples: 639849356. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:01:58,989][27935] Avg episode reward: [(0, '-1.169')] [2022-07-13 13:02:03,989][27935] Fps is (10 sec: 4608.6, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 319941632. Throughput: 0: 10194.8. Samples: 639903372. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:03,991][27935] Avg episode reward: [(0, '-0.983')] [2022-07-13 13:02:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 319966208. Throughput: 0: 9556.5. Samples: 639932328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:08,989][27935] Avg episode reward: [(0, '-1.081')] [2022-07-13 13:02:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 319990784. Throughput: 0: 9557.2. Samples: 639990196. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:13,989][27935] Avg episode reward: [(0, '-0.748')] [2022-07-13 13:02:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 320014336. Throughput: 0: 9567.0. Samples: 640048096. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:18,989][27935] Avg episode reward: [(0, '0.430')] [2022-07-13 13:02:24,005][27935] Fps is (10 sec: 4703.0, 60 sec: 4777.4, 300 sec: 4796.9). Total num frames: 320037888. Throughput: 0: 9569.2. Samples: 640077152. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:24,005][27935] Avg episode reward: [(0, '0.812')] [2022-07-13 13:02:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 320061440. Throughput: 0: 9573.6. Samples: 640135300. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:28,989][27935] Avg episode reward: [(0, '0.892')] [2022-07-13 13:02:33,989][27935] Fps is (10 sec: 5128.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 320089088. Throughput: 0: 9578.9. Samples: 640193496. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:33,989][27935] Avg episode reward: [(0, '0.243')] [2022-07-13 13:02:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 320110592. Throughput: 0: 9580.9. Samples: 640222612. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:38,989][27935] Avg episode reward: [(0, '0.191')] [2022-07-13 13:02:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 320135168. Throughput: 0: 9573.4. Samples: 640280160. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:43,991][27935] Avg episode reward: [(0, '0.424')] [2022-07-13 13:02:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 320159744. Throughput: 0: 9665.0. Samples: 640338296. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:48,989][27935] Avg episode reward: [(0, '0.497')] [2022-07-13 13:02:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.9, 300 sec: 4800.7). Total num frames: 320184320. Throughput: 0: 9671.4. Samples: 640367540. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:53,989][27935] Avg episode reward: [(0, '0.160')] [2022-07-13 13:02:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 320207872. Throughput: 0: 9673.0. Samples: 640425480. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:02:58,989][27935] Avg episode reward: [(0, '0.113')] [2022-07-13 13:03:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 320230400. Throughput: 0: 9590.1. Samples: 640479652. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:03,991][27935] Avg episode reward: [(0, '0.587')] [2022-07-13 13:03:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 320254976. Throughput: 0: 9585.5. Samples: 640508348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:08,989][27935] Avg episode reward: [(0, '0.019')] [2022-07-13 13:03:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 320277504. Throughput: 0: 9583.3. Samples: 640566548. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:13,989][27935] Avg episode reward: [(0, '0.079')] [2022-07-13 13:03:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 320302080. Throughput: 0: 9577.7. Samples: 640624492. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:18,989][27935] Avg episode reward: [(0, '0.186')] [2022-07-13 13:03:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4831.1, 300 sec: 4797.2). Total num frames: 320327680. Throughput: 0: 9577.6. Samples: 640653604. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:23,989][27935] Avg episode reward: [(0, '0.475')] [2022-07-13 13:03:28,991][27935] Fps is (10 sec: 4812.0, 60 sec: 4812.7, 300 sec: 4793.7). Total num frames: 320350208. Throughput: 0: 9593.6. Samples: 640711888. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:28,992][27935] Avg episode reward: [(0, '0.421')] [2022-07-13 13:03:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 320375808. Throughput: 0: 9594.0. Samples: 640770028. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:33,989][27935] Avg episode reward: [(0, '0.413')] [2022-07-13 13:03:38,989][27935] Fps is (10 sec: 4813.6, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 320398336. Throughput: 0: 9592.2. Samples: 640799188. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:38,989][27935] Avg episode reward: [(0, '-0.486')] [2022-07-13 13:03:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 320424960. Throughput: 0: 9608.2. Samples: 640857848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:43,989][27935] Avg episode reward: [(0, '0.236')] [2022-07-13 13:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 320448512. Throughput: 0: 9698.6. Samples: 640916088. Policy #0 lag: (min: 0.0, avg: 9.2, max: 22.0) [2022-07-13 13:03:48,989][27935] Avg episode reward: [(0, '0.272')] [2022-07-13 13:03:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 320472064. Throughput: 0: 9708.4. Samples: 640945224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:03:53,989][27935] Avg episode reward: [(0, '-0.087')] [2022-07-13 13:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 320496640. Throughput: 0: 9696.0. Samples: 641002868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:03:58,989][27935] Avg episode reward: [(0, '0.201')] [2022-07-13 13:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 320518144. Throughput: 0: 9610.8. Samples: 641056980. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:03,989][27935] Avg episode reward: [(0, '0.708')] [2022-07-13 13:04:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 320541696. Throughput: 0: 9589.6. Samples: 641085136. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:08,990][27935] Avg episode reward: [(0, '0.838')] [2022-07-13 13:04:13,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4812.7, 300 sec: 4797.2). Total num frames: 320566272. Throughput: 0: 9566.7. Samples: 641142384. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:13,991][27935] Avg episode reward: [(0, '1.678')] [2022-07-13 13:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 320590848. Throughput: 0: 9551.8. Samples: 641199860. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:18,989][27935] Avg episode reward: [(0, '1.659')] [2022-07-13 13:04:23,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 320614400. Throughput: 0: 9555.7. Samples: 641229196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:23,989][27935] Avg episode reward: [(0, '1.619')] [2022-07-13 13:04:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4786.8). Total num frames: 320637952. Throughput: 0: 9542.0. Samples: 641287240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:28,991][27935] Avg episode reward: [(0, '1.764')] [2022-07-13 13:04:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 320662528. Throughput: 0: 9538.0. Samples: 641345300. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:33,989][27935] Avg episode reward: [(0, '0.677')] [2022-07-13 13:04:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4790.4). Total num frames: 320686080. Throughput: 0: 9536.3. Samples: 641374356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:38,989][27935] Avg episode reward: [(0, '0.596')] [2022-07-13 13:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 320711680. Throughput: 0: 9552.4. Samples: 641432724. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:43,989][27935] Avg episode reward: [(0, '0.129')] [2022-07-13 13:04:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 320736256. Throughput: 0: 9650.0. Samples: 641491228. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:48,989][27935] Avg episode reward: [(0, '-0.356')] [2022-07-13 13:04:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 320761856. Throughput: 0: 9675.4. Samples: 641520528. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:53,990][27935] Avg episode reward: [(0, '-1.085')] [2022-07-13 13:04:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 320784384. Throughput: 0: 9706.6. Samples: 641579168. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:04:58,990][27935] Avg episode reward: [(0, '-1.356')] [2022-07-13 13:05:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 320806912. Throughput: 0: 9634.7. Samples: 641633420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:03,991][27935] Avg episode reward: [(0, '-1.354')] [2022-07-13 13:05:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 320831488. Throughput: 0: 9634.8. Samples: 641662764. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:08,990][27935] Avg episode reward: [(0, '-0.801')] [2022-07-13 13:05:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4800.6). Total num frames: 320856064. Throughput: 0: 9653.9. Samples: 641721668. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:13,990][27935] Avg episode reward: [(0, '-0.674')] [2022-07-13 13:05:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 320880640. Throughput: 0: 9658.0. Samples: 641779912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:18,992][27935] Avg episode reward: [(0, '-4.051')] [2022-07-13 13:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 320904192. Throughput: 0: 9669.2. Samples: 641809472. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:23,989][27935] Avg episode reward: [(0, '-3.600')] [2022-07-13 13:05:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4804.1). Total num frames: 320928768. Throughput: 0: 9665.8. Samples: 641867684. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:28,989][27935] Avg episode reward: [(0, '-2.622')] [2022-07-13 13:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 320952320. Throughput: 0: 9652.4. Samples: 641925588. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:33,989][27935] Avg episode reward: [(0, '-2.764')] [2022-07-13 13:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4804.1). Total num frames: 320977920. Throughput: 0: 9652.2. Samples: 641954876. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:38,990][27935] Avg episode reward: [(0, '-3.523')] [2022-07-13 13:05:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 321002496. Throughput: 0: 9641.2. Samples: 642013024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:43,989][27935] Avg episode reward: [(0, '-4.126')] [2022-07-13 13:05:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 321025024. Throughput: 0: 9726.8. Samples: 642071124. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:48,989][27935] Avg episode reward: [(0, '-3.353')] [2022-07-13 13:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 321049600. Throughput: 0: 9726.4. Samples: 642100452. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:53,989][27935] Avg episode reward: [(0, '-0.543')] [2022-07-13 13:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 321074176. Throughput: 0: 9710.8. Samples: 642158652. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:05:58,989][27935] Avg episode reward: [(0, '-0.455')] [2022-07-13 13:06:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 321097728. Throughput: 0: 9619.5. Samples: 642212788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:03,989][27935] Avg episode reward: [(0, '-0.451')] [2022-07-13 13:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 321120256. Throughput: 0: 9613.5. Samples: 642242080. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:08,989][27935] Avg episode reward: [(0, '-0.409')] [2022-07-13 13:06:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 321144832. Throughput: 0: 9613.0. Samples: 642300268. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:13,989][27935] Avg episode reward: [(0, '0.241')] [2022-07-13 13:06:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 321170432. Throughput: 0: 9611.1. Samples: 642358088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:18,990][27935] Avg episode reward: [(0, '0.492')] [2022-07-13 13:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 321192960. Throughput: 0: 9602.8. Samples: 642387004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:23,989][27935] Avg episode reward: [(0, '0.644')] [2022-07-13 13:06:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 321217536. Throughput: 0: 9606.8. Samples: 642445332. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:28,989][27935] Avg episode reward: [(0, '-0.924')] [2022-07-13 13:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 321241088. Throughput: 0: 9597.8. Samples: 642503024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:33,989][27935] Avg episode reward: [(0, '-1.801')] [2022-07-13 13:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 321266688. Throughput: 0: 9593.1. Samples: 642532140. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:38,989][27935] Avg episode reward: [(0, '-2.732')] [2022-07-13 13:06:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 321291264. Throughput: 0: 9597.1. Samples: 642590520. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:43,989][27935] Avg episode reward: [(0, '-2.863')] [2022-07-13 13:06:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 321313792. Throughput: 0: 9683.4. Samples: 642648540. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:48,989][27935] Avg episode reward: [(0, '-2.374')] [2022-07-13 13:06:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 321338368. Throughput: 0: 9673.7. Samples: 642677396. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:53,989][27935] Avg episode reward: [(0, '-2.333')] [2022-07-13 13:06:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 321363968. Throughput: 0: 9675.4. Samples: 642735660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:06:58,989][27935] Avg episode reward: [(0, '-1.402')] [2022-07-13 13:07:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 321385472. Throughput: 0: 9596.1. Samples: 642789912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:03,989][27935] Avg episode reward: [(0, '-1.191')] [2022-07-13 13:07:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 321408000. Throughput: 0: 9600.6. Samples: 642819032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:08,989][27935] Avg episode reward: [(0, '-1.104')] [2022-07-13 13:07:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 321433600. Throughput: 0: 9608.4. Samples: 642877712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:13,989][27935] Avg episode reward: [(0, '-0.332')] [2022-07-13 13:07:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4814.8). Total num frames: 321458176. Throughput: 0: 9610.7. Samples: 642935508. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:18,989][27935] Avg episode reward: [(0, '-1.026')] [2022-07-13 13:07:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 321482752. Throughput: 0: 9607.1. Samples: 642964460. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:23,989][27935] Avg episode reward: [(0, '-0.833')] [2022-07-13 13:07:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 321506304. Throughput: 0: 9601.5. Samples: 643022588. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:28,989][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 13:07:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 321530880. Throughput: 0: 9608.1. Samples: 643080904. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:33,989][27935] Avg episode reward: [(0, '-1.822')] [2022-07-13 13:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 321555456. Throughput: 0: 9613.3. Samples: 643109992. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:38,990][27935] Avg episode reward: [(0, '-1.712')] [2022-07-13 13:07:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 321579008. Throughput: 0: 9606.8. Samples: 643167964. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:43,989][27935] Avg episode reward: [(0, '-0.469')] [2022-07-13 13:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 321603584. Throughput: 0: 9701.6. Samples: 643226484. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:48,989][27935] Avg episode reward: [(0, '0.068')] [2022-07-13 13:07:53,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4812.5, 300 sec: 4811.0). Total num frames: 321627136. Throughput: 0: 9699.9. Samples: 643255564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:53,994][27935] Avg episode reward: [(0, '-0.604')] [2022-07-13 13:07:58,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4795.6, 300 sec: 4818.0). Total num frames: 321651712. Throughput: 0: 9701.7. Samples: 643314304. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:07:58,991][27935] Avg episode reward: [(0, '-0.665')] [2022-07-13 13:08:03,989][27935] Fps is (10 sec: 4712.1, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 321674240. Throughput: 0: 9620.8. Samples: 643368444. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:03,992][27935] Avg episode reward: [(0, '-0.798')] [2022-07-13 13:08:08,992][27935] Fps is (10 sec: 4709.5, 60 sec: 4846.6, 300 sec: 4818.0). Total num frames: 321698816. Throughput: 0: 9625.3. Samples: 643397632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:08,993][27935] Avg episode reward: [(0, '-1.193')] [2022-07-13 13:08:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 321723392. Throughput: 0: 9621.5. Samples: 643455556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:13,989][27935] Avg episode reward: [(0, '-1.696')] [2022-07-13 13:08:18,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 321747968. Throughput: 0: 9619.0. Samples: 643513760. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:18,989][27935] Avg episode reward: [(0, '-2.293')] [2022-07-13 13:08:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.6). Total num frames: 321770496. Throughput: 0: 9624.0. Samples: 643543072. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:23,996][27935] Avg episode reward: [(0, '-2.108')] [2022-07-13 13:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 321796096. Throughput: 0: 9632.2. Samples: 643601412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:28,989][27935] Avg episode reward: [(0, '-2.755')] [2022-07-13 13:08:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 321820672. Throughput: 0: 9621.6. Samples: 643659456. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:33,989][27935] Avg episode reward: [(0, '-2.815')] [2022-07-13 13:08:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 321844224. Throughput: 0: 9631.3. Samples: 643688940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:38,991][27935] Avg episode reward: [(0, '-1.802')] [2022-07-13 13:08:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 321868800. Throughput: 0: 9625.8. Samples: 643747448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 13:08:43,989][27935] Avg episode reward: [(0, '-1.826')] [2022-07-13 13:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 321893376. Throughput: 0: 9718.5. Samples: 643805776. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:08:48,989][27935] Avg episode reward: [(0, '-0.968')] [2022-07-13 13:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.2, 300 sec: 4814.5). Total num frames: 321916928. Throughput: 0: 9722.2. Samples: 643835096. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:08:53,994][27935] Avg episode reward: [(0, '-0.758')] [2022-07-13 13:08:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4828.4). Total num frames: 321942528. Throughput: 0: 9740.3. Samples: 643893868. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:08:58,989][27935] Avg episode reward: [(0, '-0.523')] [2022-07-13 13:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 321964032. Throughput: 0: 9655.4. Samples: 643948252. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:03,991][27935] Avg episode reward: [(0, '0.372')] [2022-07-13 13:09:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.2, 300 sec: 4825.0). Total num frames: 321989632. Throughput: 0: 9657.0. Samples: 643977636. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:08,990][27935] Avg episode reward: [(0, '0.505')] [2022-07-13 13:09:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 322012160. Throughput: 0: 9664.2. Samples: 644036304. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:13,992][27935] Avg episode reward: [(0, '1.130')] [2022-07-13 13:09:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 322036736. Throughput: 0: 9673.7. Samples: 644094772. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:18,990][27935] Avg episode reward: [(0, '0.941')] [2022-07-13 13:09:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 322063360. Throughput: 0: 9666.9. Samples: 644123952. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:23,990][27935] Avg episode reward: [(0, '0.350')] [2022-07-13 13:09:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 322086912. Throughput: 0: 9666.3. Samples: 644182432. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:28,989][27935] Avg episode reward: [(0, '-0.577')] [2022-07-13 13:09:33,990][27935] Fps is (10 sec: 4709.7, 60 sec: 4829.7, 300 sec: 4828.4). Total num frames: 322110464. Throughput: 0: 9680.4. Samples: 644241408. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:33,991][27935] Avg episode reward: [(0, '-2.004')] [2022-07-13 13:09:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 322135040. Throughput: 0: 9676.4. Samples: 644270536. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:38,989][27935] Avg episode reward: [(0, '-2.529')] [2022-07-13 13:09:43,989][27935] Fps is (10 sec: 4916.0, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 322159616. Throughput: 0: 9684.6. Samples: 644329676. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:43,989][27935] Avg episode reward: [(0, '-3.075')] [2022-07-13 13:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 322184192. Throughput: 0: 9781.3. Samples: 644388412. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:48,989][27935] Avg episode reward: [(0, '-3.688')] [2022-07-13 13:09:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 322209792. Throughput: 0: 9780.6. Samples: 644417764. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:53,989][27935] Avg episode reward: [(0, '-3.449')] [2022-07-13 13:09:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 322234368. Throughput: 0: 9783.9. Samples: 644476576. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:09:58,989][27935] Avg episode reward: [(0, '-2.969')] [2022-07-13 13:10:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 322255872. Throughput: 0: 9707.3. Samples: 644531600. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:03,989][27935] Avg episode reward: [(0, '-1.612')] [2022-07-13 13:10:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 322279424. Throughput: 0: 9704.5. Samples: 644560656. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:08,991][27935] Avg episode reward: [(0, '-0.863')] [2022-07-13 13:10:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 322304000. Throughput: 0: 9681.3. Samples: 644618092. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:13,990][27935] Avg episode reward: [(0, '0.409')] [2022-07-13 13:10:18,991][27935] Fps is (10 sec: 5016.3, 60 sec: 4880.9, 300 sec: 4831.8). Total num frames: 322329600. Throughput: 0: 9653.9. Samples: 644675844. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:18,992][27935] Avg episode reward: [(0, '-0.152')] [2022-07-13 13:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 322352128. Throughput: 0: 9662.4. Samples: 644705344. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:23,989][27935] Avg episode reward: [(0, '-0.184')] [2022-07-13 13:10:28,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 322377728. Throughput: 0: 9654.9. Samples: 644764148. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:28,989][27935] Avg episode reward: [(0, '-0.380')] [2022-07-13 13:10:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4821.5). Total num frames: 322400256. Throughput: 0: 9650.9. Samples: 644822704. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:33,989][27935] Avg episode reward: [(0, '-0.725')] [2022-07-13 13:10:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 322426880. Throughput: 0: 9640.3. Samples: 644851576. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:38,989][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 13:10:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 322450432. Throughput: 0: 9636.2. Samples: 644910204. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:43,989][27935] Avg episode reward: [(0, '-0.372')] [2022-07-13 13:10:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 322473984. Throughput: 0: 9719.2. Samples: 644968964. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:48,989][27935] Avg episode reward: [(0, '0.279')] [2022-07-13 13:10:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 322498560. Throughput: 0: 9721.5. Samples: 644998124. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:53,989][27935] Avg episode reward: [(0, '-0.372')] [2022-07-13 13:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 322523136. Throughput: 0: 9747.1. Samples: 645056712. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:10:58,989][27935] Avg episode reward: [(0, '-0.661')] [2022-07-13 13:11:03,993][27935] Fps is (10 sec: 4810.7, 60 sec: 4846.6, 300 sec: 4835.3). Total num frames: 322546688. Throughput: 0: 9679.6. Samples: 645111444. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:11:03,994][27935] Avg episode reward: [(0, '-1.134')] [2022-07-13 13:11:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 322571264. Throughput: 0: 9667.4. Samples: 645140376. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:11:08,989][27935] Avg episode reward: [(0, '-0.799')] [2022-07-13 13:11:13,989][27935] Fps is (10 sec: 4814.9, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 322594816. Throughput: 0: 9655.2. Samples: 645198632. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 13:11:13,989][27935] Avg episode reward: [(0, '-1.037')] [2022-07-13 13:11:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4835.4). Total num frames: 322619392. Throughput: 0: 9650.2. Samples: 645256964. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:18,989][27935] Avg episode reward: [(0, '-1.303')] [2022-07-13 13:11:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 322641920. Throughput: 0: 9648.4. Samples: 645285752. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:23,989][27935] Avg episode reward: [(0, '-1.435')] [2022-07-13 13:11:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 322666496. Throughput: 0: 9635.0. Samples: 645343780. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:28,989][27935] Avg episode reward: [(0, '-2.397')] [2022-07-13 13:11:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 322692096. Throughput: 0: 9613.9. Samples: 645401588. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:33,989][27935] Avg episode reward: [(0, '-1.488')] [2022-07-13 13:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 322714624. Throughput: 0: 9617.5. Samples: 645430912. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:38,989][27935] Avg episode reward: [(0, '-1.018')] [2022-07-13 13:11:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 322740224. Throughput: 0: 9617.2. Samples: 645489488. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:43,989][27935] Avg episode reward: [(0, '-0.971')] [2022-07-13 13:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 322763776. Throughput: 0: 9695.8. Samples: 645547712. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:48,989][27935] Avg episode reward: [(0, '-1.253')] [2022-07-13 13:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 322789376. Throughput: 0: 9703.7. Samples: 645577040. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:53,989][27935] Avg episode reward: [(0, '-0.819')] [2022-07-13 13:11:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 322813952. Throughput: 0: 9702.5. Samples: 645635244. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:11:58,989][27935] Avg episode reward: [(0, '-0.998')] [2022-07-13 13:12:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4813.1, 300 sec: 4838.8). Total num frames: 322835456. Throughput: 0: 9613.8. Samples: 645689584. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:03,989][27935] Avg episode reward: [(0, '-1.021')] [2022-07-13 13:12:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 322859008. Throughput: 0: 9615.8. Samples: 645718464. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:08,989][27935] Avg episode reward: [(0, '-1.094')] [2022-07-13 13:12:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 322882560. Throughput: 0: 9618.1. Samples: 645776592. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:13,989][27935] Avg episode reward: [(0, '-1.286')] [2022-07-13 13:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 322908160. Throughput: 0: 9621.3. Samples: 645834548. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:18,990][27935] Avg episode reward: [(0, '-1.915')] [2022-07-13 13:12:23,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 322931712. Throughput: 0: 9620.3. Samples: 645863824. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:23,990][27935] Avg episode reward: [(0, '-2.536')] [2022-07-13 13:12:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 322957312. Throughput: 0: 9613.4. Samples: 645922092. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:28,989][27935] Avg episode reward: [(0, '-2.627')] [2022-07-13 13:12:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 322979840. Throughput: 0: 9607.6. Samples: 645980052. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:33,989][27935] Avg episode reward: [(0, '-1.907')] [2022-07-13 13:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 323005440. Throughput: 0: 9603.0. Samples: 646009176. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:38,989][27935] Avg episode reward: [(0, '-1.734')] [2022-07-13 13:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 323027968. Throughput: 0: 9591.6. Samples: 646066864. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:43,990][27935] Avg episode reward: [(0, '-2.773')] [2022-07-13 13:12:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 323052544. Throughput: 0: 9687.1. Samples: 646125504. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:48,989][27935] Avg episode reward: [(0, '-2.892')] [2022-07-13 13:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 323077120. Throughput: 0: 9692.9. Samples: 646154644. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:53,990][27935] Avg episode reward: [(0, '-1.700')] [2022-07-13 13:12:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4835.4). Total num frames: 323100672. Throughput: 0: 9700.5. Samples: 646213116. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:12:58,989][27935] Avg episode reward: [(0, '-1.912')] [2022-07-13 13:13:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4832.0). Total num frames: 323124224. Throughput: 0: 9616.3. Samples: 646267280. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:03,989][27935] Avg episode reward: [(0, '-0.878')] [2022-07-13 13:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 323148800. Throughput: 0: 9615.9. Samples: 646296540. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:08,989][27935] Avg episode reward: [(0, '-0.988')] [2022-07-13 13:13:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 323172352. Throughput: 0: 9606.9. Samples: 646354404. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:13,990][27935] Avg episode reward: [(0, '-0.117')] [2022-07-13 13:13:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 323196928. Throughput: 0: 9619.7. Samples: 646412940. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:18,989][27935] Avg episode reward: [(0, '-0.477')] [2022-07-13 13:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 323220480. Throughput: 0: 9614.5. Samples: 646441828. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:23,989][27935] Avg episode reward: [(0, '-1.691')] [2022-07-13 13:13:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 323245056. Throughput: 0: 9620.5. Samples: 646499788. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:28,989][27935] Avg episode reward: [(0, '-1.564')] [2022-07-13 13:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 323269632. Throughput: 0: 9593.9. Samples: 646557228. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:33,989][27935] Avg episode reward: [(0, '-1.426')] [2022-07-13 13:13:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 323294208. Throughput: 0: 9592.4. Samples: 646586300. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:38,990][27935] Avg episode reward: [(0, '-1.584')] [2022-07-13 13:13:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 323315712. Throughput: 0: 9585.2. Samples: 646644448. Policy #0 lag: (min: 0.0, avg: 7.5, max: 18.0) [2022-07-13 13:13:43,989][27935] Avg episode reward: [(0, '-2.191')] [2022-07-13 13:13:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 323342336. Throughput: 0: 9681.4. Samples: 646702944. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:13:48,989][27935] Avg episode reward: [(0, '-2.423')] [2022-07-13 13:13:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 323365888. Throughput: 0: 9674.8. Samples: 646731904. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:13:53,989][27935] Avg episode reward: [(0, '-1.798')] [2022-07-13 13:13:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 323390464. Throughput: 0: 9682.2. Samples: 646790104. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:13:58,989][27935] Avg episode reward: [(0, '-1.062')] [2022-07-13 13:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 323411968. Throughput: 0: 9585.1. Samples: 646844268. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:03,991][27935] Avg episode reward: [(0, '-1.570')] [2022-07-13 13:14:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4825.0). Total num frames: 323435520. Throughput: 0: 9595.1. Samples: 646873608. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:08,990][27935] Avg episode reward: [(0, '-1.705')] [2022-07-13 13:14:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 323462144. Throughput: 0: 9597.1. Samples: 646931660. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:13,989][27935] Avg episode reward: [(0, '-1.566')] [2022-07-13 13:14:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 323484672. Throughput: 0: 9608.8. Samples: 646989624. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:18,989][27935] Avg episode reward: [(0, '-0.779')] [2022-07-13 13:14:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 323508224. Throughput: 0: 9603.8. Samples: 647018472. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:23,989][27935] Avg episode reward: [(0, '-1.147')] [2022-07-13 13:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 323533824. Throughput: 0: 9596.2. Samples: 647076276. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:28,989][27935] Avg episode reward: [(0, '-1.499')] [2022-07-13 13:14:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 323558400. Throughput: 0: 9580.7. Samples: 647134076. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:33,989][27935] Avg episode reward: [(0, '-1.131')] [2022-07-13 13:14:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 323581952. Throughput: 0: 9583.7. Samples: 647163172. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:38,989][27935] Avg episode reward: [(0, '-1.054')] [2022-07-13 13:14:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 323605504. Throughput: 0: 9581.7. Samples: 647221280. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:43,989][27935] Avg episode reward: [(0, '-1.057')] [2022-07-13 13:14:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 323628032. Throughput: 0: 9683.3. Samples: 647280016. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:48,989][27935] Avg episode reward: [(0, '-0.940')] [2022-07-13 13:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 323654656. Throughput: 0: 9675.8. Samples: 647309020. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:53,990][27935] Avg episode reward: [(0, '-0.646')] [2022-07-13 13:14:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 323680256. Throughput: 0: 9689.4. Samples: 647367684. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:14:58,990][27935] Avg episode reward: [(0, '0.318')] [2022-07-13 13:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 323701760. Throughput: 0: 9596.9. Samples: 647421484. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:03,991][27935] Avg episode reward: [(0, '0.909')] [2022-07-13 13:15:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 323726336. Throughput: 0: 9607.0. Samples: 647450788. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:08,996][27935] Avg episode reward: [(0, '0.883')] [2022-07-13 13:15:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 323748864. Throughput: 0: 9617.2. Samples: 647509052. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:13,989][27935] Avg episode reward: [(0, '0.901')] [2022-07-13 13:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 323774464. Throughput: 0: 8976.1. Samples: 647538000. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:18,990][27935] Avg episode reward: [(0, '0.509')] [2022-07-13 13:15:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 323798016. Throughput: 0: 9636.3. Samples: 647596804. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:23,989][27935] Avg episode reward: [(0, '-0.232')] [2022-07-13 13:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 323823616. Throughput: 0: 9646.8. Samples: 647655384. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:28,989][27935] Avg episode reward: [(0, '-0.868')] [2022-07-13 13:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 323846144. Throughput: 0: 9623.0. Samples: 647713052. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:33,989][27935] Avg episode reward: [(0, '-1.602')] [2022-07-13 13:15:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 323870720. Throughput: 0: 9625.4. Samples: 647742164. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:38,989][27935] Avg episode reward: [(0, '-1.781')] [2022-07-13 13:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 323895296. Throughput: 0: 9619.4. Samples: 647800556. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:43,989][27935] Avg episode reward: [(0, '-1.555')] [2022-07-13 13:15:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 323919872. Throughput: 0: 9713.1. Samples: 647858572. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:48,989][27935] Avg episode reward: [(0, '-2.303')] [2022-07-13 13:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 323943424. Throughput: 0: 9706.7. Samples: 647887592. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:53,989][27935] Avg episode reward: [(0, '-2.111')] [2022-07-13 13:15:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.1). Total num frames: 323968000. Throughput: 0: 9701.7. Samples: 647945628. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:15:58,989][27935] Avg episode reward: [(0, '-1.318')] [2022-07-13 13:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 323990528. Throughput: 0: 10265.7. Samples: 647999956. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:16:03,989][27935] Avg episode reward: [(0, '0.299')] [2022-07-13 13:16:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 324013056. Throughput: 0: 9602.1. Samples: 648028900. Policy #0 lag: (min: 0.0, avg: 7.6, max: 19.0) [2022-07-13 13:16:08,989][27935] Avg episode reward: [(0, '0.328')] [2022-07-13 13:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 324038656. Throughput: 0: 9593.0. Samples: 648087068. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:13,989][27935] Avg episode reward: [(0, '-1.190')] [2022-07-13 13:16:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 324062208. Throughput: 0: 9549.3. Samples: 648142772. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:18,989][27935] Avg episode reward: [(0, '-0.221')] [2022-07-13 13:16:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 324085760. Throughput: 0: 9540.2. Samples: 648171472. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:23,989][27935] Avg episode reward: [(0, '-0.404')] [2022-07-13 13:16:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4800.7). Total num frames: 324108288. Throughput: 0: 9530.2. Samples: 648229416. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:28,989][27935] Avg episode reward: [(0, '-0.711')] [2022-07-13 13:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 324133888. Throughput: 0: 9511.7. Samples: 648286600. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:33,989][27935] Avg episode reward: [(0, '-1.106')] [2022-07-13 13:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 324158464. Throughput: 0: 9508.5. Samples: 648315472. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:38,989][27935] Avg episode reward: [(0, '-1.650')] [2022-07-13 13:16:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 324182016. Throughput: 0: 9513.2. Samples: 648373724. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:43,990][27935] Avg episode reward: [(0, '-0.730')] [2022-07-13 13:16:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 324206592. Throughput: 0: 9590.9. Samples: 648431548. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:48,989][27935] Avg episode reward: [(0, '-0.270')] [2022-07-13 13:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 324230144. Throughput: 0: 9591.6. Samples: 648460524. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:53,989][27935] Avg episode reward: [(0, '0.197')] [2022-07-13 13:16:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 324254720. Throughput: 0: 9594.1. Samples: 648518800. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:16:58,989][27935] Avg episode reward: [(0, '0.238')] [2022-07-13 13:17:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 324277248. Throughput: 0: 9561.8. Samples: 648573052. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:03,989][27935] Avg episode reward: [(0, '-0.033')] [2022-07-13 13:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 324300800. Throughput: 0: 9574.0. Samples: 648602304. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:08,991][27935] Avg episode reward: [(0, '-0.179')] [2022-07-13 13:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 324325376. Throughput: 0: 9586.0. Samples: 648660788. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:13,989][27935] Avg episode reward: [(0, '-0.222')] [2022-07-13 13:17:18,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 324349952. Throughput: 0: 9608.8. Samples: 648718996. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:18,989][27935] Avg episode reward: [(0, '-1.192')] [2022-07-13 13:17:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 324372480. Throughput: 0: 9614.1. Samples: 648748108. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:23,989][27935] Avg episode reward: [(0, '-1.434')] [2022-07-13 13:17:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 324398080. Throughput: 0: 9614.5. Samples: 648806376. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:28,989][27935] Avg episode reward: [(0, '-1.440')] [2022-07-13 13:17:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 324422656. Throughput: 0: 9610.2. Samples: 648864008. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:33,989][27935] Avg episode reward: [(0, '-1.353')] [2022-07-13 13:17:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 324446208. Throughput: 0: 9613.9. Samples: 648893148. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:38,989][27935] Avg episode reward: [(0, '-2.239')] [2022-07-13 13:17:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 324469760. Throughput: 0: 9600.1. Samples: 648950804. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:43,989][27935] Avg episode reward: [(0, '-2.826')] [2022-07-13 13:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 324495360. Throughput: 0: 9692.7. Samples: 649009224. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:48,990][27935] Avg episode reward: [(0, '-2.345')] [2022-07-13 13:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 324518912. Throughput: 0: 9694.7. Samples: 649038564. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:53,989][27935] Avg episode reward: [(0, '-1.734')] [2022-07-13 13:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 324544512. Throughput: 0: 9708.3. Samples: 649097660. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:17:58,989][27935] Avg episode reward: [(0, '-2.788')] [2022-07-13 13:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 324566016. Throughput: 0: 9617.9. Samples: 649151804. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:03,991][27935] Avg episode reward: [(0, '-4.221')] [2022-07-13 13:18:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 324589568. Throughput: 0: 9622.7. Samples: 649181128. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:08,989][27935] Avg episode reward: [(0, '-3.897')] [2022-07-13 13:18:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 324616192. Throughput: 0: 9630.7. Samples: 649239756. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:13,989][27935] Avg episode reward: [(0, '-2.709')] [2022-07-13 13:18:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 324639744. Throughput: 0: 9647.6. Samples: 649298152. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:18,989][27935] Avg episode reward: [(0, '-2.865')] [2022-07-13 13:18:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4811.1). Total num frames: 324664320. Throughput: 0: 9659.9. Samples: 649327844. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:23,992][27935] Avg episode reward: [(0, '-4.089')] [2022-07-13 13:18:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 324686848. Throughput: 0: 9679.5. Samples: 649386380. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:28,989][27935] Avg episode reward: [(0, '-2.592')] [2022-07-13 13:18:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 324713472. Throughput: 0: 9683.5. Samples: 649444980. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:33,989][27935] Avg episode reward: [(0, '-2.122')] [2022-07-13 13:18:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 324737024. Throughput: 0: 9683.5. Samples: 649474320. Policy #0 lag: (min: 0.0, avg: 7.2, max: 19.0) [2022-07-13 13:18:38,989][27935] Avg episode reward: [(0, '-1.487')] [2022-07-13 13:18:43,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4881.1, 300 sec: 4814.5). Total num frames: 324762624. Throughput: 0: 9670.2. Samples: 649532820. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:18:43,989][27935] Avg episode reward: [(0, '-0.850')] [2022-07-13 13:18:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 324785152. Throughput: 0: 9777.0. Samples: 649591768. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:18:48,989][27935] Avg episode reward: [(0, '-2.360')] [2022-07-13 13:18:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 324810752. Throughput: 0: 9778.6. Samples: 649621164. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:18:53,989][27935] Avg episode reward: [(0, '-2.269')] [2022-07-13 13:18:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 324835328. Throughput: 0: 9779.3. Samples: 649679824. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:18:58,989][27935] Avg episode reward: [(0, '-0.959')] [2022-07-13 13:19:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 324856832. Throughput: 0: 9698.1. Samples: 649734568. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:03,991][27935] Avg episode reward: [(0, '-1.691')] [2022-07-13 13:19:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4818.0). Total num frames: 324883456. Throughput: 0: 9687.9. Samples: 649763800. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:08,989][27935] Avg episode reward: [(0, '-2.677')] [2022-07-13 13:19:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 324905984. Throughput: 0: 9690.6. Samples: 649822460. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:13,989][27935] Avg episode reward: [(0, '-4.038')] [2022-07-13 13:19:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 324931584. Throughput: 0: 9689.8. Samples: 649881020. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:18,989][27935] Avg episode reward: [(0, '-3.368')] [2022-07-13 13:19:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 324955136. Throughput: 0: 9693.8. Samples: 649910540. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:23,989][27935] Avg episode reward: [(0, '-2.355')] [2022-07-13 13:19:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4818.0). Total num frames: 324979712. Throughput: 0: 9695.5. Samples: 649969116. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:28,989][27935] Avg episode reward: [(0, '-2.362')] [2022-07-13 13:19:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 325003264. Throughput: 0: 9676.2. Samples: 650027196. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:33,989][27935] Avg episode reward: [(0, '-3.328')] [2022-07-13 13:19:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 325027840. Throughput: 0: 9667.8. Samples: 650056216. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:38,989][27935] Avg episode reward: [(0, '-2.057')] [2022-07-13 13:19:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 325053440. Throughput: 0: 9669.3. Samples: 650114944. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:43,989][27935] Avg episode reward: [(0, '-0.665')] [2022-07-13 13:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 325075968. Throughput: 0: 9758.0. Samples: 650173680. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:48,989][27935] Avg episode reward: [(0, '-0.787')] [2022-07-13 13:19:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4821.5). Total num frames: 325102592. Throughput: 0: 9760.8. Samples: 650203036. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:53,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 13:19:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 325126144. Throughput: 0: 9763.8. Samples: 650261832. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:19:58,989][27935] Avg episode reward: [(0, '-1.336')] [2022-07-13 13:20:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 325147648. Throughput: 0: 9690.1. Samples: 650317076. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:03,989][27935] Avg episode reward: [(0, '-1.255')] [2022-07-13 13:20:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 325174272. Throughput: 0: 9686.3. Samples: 650346424. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:08,989][27935] Avg episode reward: [(0, '-0.485')] [2022-07-13 13:20:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 325196800. Throughput: 0: 9694.7. Samples: 650405376. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:13,989][27935] Avg episode reward: [(0, '0.263')] [2022-07-13 13:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 325223424. Throughput: 0: 9708.1. Samples: 650464060. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:18,989][27935] Avg episode reward: [(0, '-0.245')] [2022-07-13 13:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 325246976. Throughput: 0: 9718.6. Samples: 650493552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:23,989][27935] Avg episode reward: [(0, '0.284')] [2022-07-13 13:20:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 325271552. Throughput: 0: 9718.5. Samples: 650552276. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:28,989][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 13:20:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 325295104. Throughput: 0: 9056.9. Samples: 650581240. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:33,989][27935] Avg episode reward: [(0, '0.233')] [2022-07-13 13:20:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 325319680. Throughput: 0: 9705.0. Samples: 650639760. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:38,989][27935] Avg episode reward: [(0, '-0.332')] [2022-07-13 13:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 325344256. Throughput: 0: 9708.3. Samples: 650698708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:43,989][27935] Avg episode reward: [(0, '-0.937')] [2022-07-13 13:20:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4835.4). Total num frames: 325369856. Throughput: 0: 9788.4. Samples: 650757556. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:48,990][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 13:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 325393408. Throughput: 0: 9793.6. Samples: 650787136. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:53,990][27935] Avg episode reward: [(0, '-1.871')] [2022-07-13 13:20:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 325417984. Throughput: 0: 9797.7. Samples: 650846272. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:20:58,989][27935] Avg episode reward: [(0, '-2.785')] [2022-07-13 13:21:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 325440512. Throughput: 0: 9719.0. Samples: 650901416. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:21:03,990][27935] Avg episode reward: [(0, '-2.324')] [2022-07-13 13:21:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 325465088. Throughput: 0: 9720.3. Samples: 650930968. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 13:21:08,991][27935] Avg episode reward: [(0, '-2.979')] [2022-07-13 13:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 325490688. Throughput: 0: 9714.5. Samples: 650989428. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:13,989][27935] Avg episode reward: [(0, '-2.565')] [2022-07-13 13:21:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 325513216. Throughput: 0: 10368.9. Samples: 651047840. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:18,989][27935] Avg episode reward: [(0, '-1.542')] [2022-07-13 13:21:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 325537792. Throughput: 0: 9710.6. Samples: 651076736. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:23,991][27935] Avg episode reward: [(0, '-1.806')] [2022-07-13 13:21:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 325562368. Throughput: 0: 9705.4. Samples: 651135452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:28,989][27935] Avg episode reward: [(0, '-2.238')] [2022-07-13 13:21:33,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 325586944. Throughput: 0: 9679.9. Samples: 651193152. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:33,989][27935] Avg episode reward: [(0, '-1.565')] [2022-07-13 13:21:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 325611520. Throughput: 0: 9672.3. Samples: 651222388. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:38,989][27935] Avg episode reward: [(0, '-1.875')] [2022-07-13 13:21:43,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 325635072. Throughput: 0: 9654.4. Samples: 651280720. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:43,989][27935] Avg episode reward: [(0, '-1.902')] [2022-07-13 13:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 325659648. Throughput: 0: 9722.8. Samples: 651338944. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:48,989][27935] Avg episode reward: [(0, '-0.889')] [2022-07-13 13:21:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 325683200. Throughput: 0: 9713.8. Samples: 651368088. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:53,989][27935] Avg episode reward: [(0, '-0.874')] [2022-07-13 13:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 325707776. Throughput: 0: 9713.5. Samples: 651426536. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:21:58,989][27935] Avg episode reward: [(0, '-0.994')] [2022-07-13 13:22:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 325731328. Throughput: 0: 9632.6. Samples: 651481308. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:03,989][27935] Avg episode reward: [(0, '-1.327')] [2022-07-13 13:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 325754880. Throughput: 0: 9643.7. Samples: 651510704. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:08,989][27935] Avg episode reward: [(0, '-1.453')] [2022-07-13 13:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 325779456. Throughput: 0: 9630.1. Samples: 651568808. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:13,989][27935] Avg episode reward: [(0, '-2.178')] [2022-07-13 13:22:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 325803008. Throughput: 0: 9627.3. Samples: 651626380. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:18,989][27935] Avg episode reward: [(0, '-2.480')] [2022-07-13 13:22:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 325826560. Throughput: 0: 9606.0. Samples: 651654660. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:23,989][27935] Avg episode reward: [(0, '-3.205')] [2022-07-13 13:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 325852160. Throughput: 0: 9596.1. Samples: 651712544. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:28,989][27935] Avg episode reward: [(0, '-3.176')] [2022-07-13 13:22:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 325874688. Throughput: 0: 9596.8. Samples: 651770800. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:33,989][27935] Avg episode reward: [(0, '-2.644')] [2022-07-13 13:22:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 325899264. Throughput: 0: 9591.7. Samples: 651799716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:38,989][27935] Avg episode reward: [(0, '-1.973')] [2022-07-13 13:22:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 325924864. Throughput: 0: 9581.4. Samples: 651857700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:43,991][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 13:22:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 325948416. Throughput: 0: 9660.8. Samples: 651916044. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:48,989][27935] Avg episode reward: [(0, '-0.211')] [2022-07-13 13:22:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 325972992. Throughput: 0: 9663.4. Samples: 651945556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:53,999][27935] Avg episode reward: [(0, '0.251')] [2022-07-13 13:22:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 325996544. Throughput: 0: 9674.8. Samples: 652004176. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:22:58,989][27935] Avg episode reward: [(0, '0.304')] [2022-07-13 13:23:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 326020096. Throughput: 0: 9612.9. Samples: 652058960. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:03,989][27935] Avg episode reward: [(0, '-0.554')] [2022-07-13 13:23:08,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 326045696. Throughput: 0: 9636.8. Samples: 652088316. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:08,990][27935] Avg episode reward: [(0, '-0.378')] [2022-07-13 13:23:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 326069248. Throughput: 0: 9653.0. Samples: 652146928. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:13,989][27935] Avg episode reward: [(0, '-0.337')] [2022-07-13 13:23:18,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 326092800. Throughput: 0: 9656.2. Samples: 652205328. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:18,989][27935] Avg episode reward: [(0, '-0.078')] [2022-07-13 13:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 326117376. Throughput: 0: 9669.7. Samples: 652234852. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:23,989][27935] Avg episode reward: [(0, '-0.483')] [2022-07-13 13:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 326141952. Throughput: 0: 9685.7. Samples: 652293556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:28,989][27935] Avg episode reward: [(0, '-1.443')] [2022-07-13 13:23:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326165504. Throughput: 0: 9687.4. Samples: 652351976. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:33,991][27935] Avg episode reward: [(0, '-1.106')] [2022-07-13 13:23:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 326192128. Throughput: 0: 9680.2. Samples: 652381164. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 13:23:38,991][27935] Avg episode reward: [(0, '-1.192')] [2022-07-13 13:23:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 326214656. Throughput: 0: 9681.5. Samples: 652439844. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:23:43,989][27935] Avg episode reward: [(0, '-1.333')] [2022-07-13 13:23:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326240256. Throughput: 0: 9771.4. Samples: 652498672. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:23:48,989][27935] Avg episode reward: [(0, '-1.199')] [2022-07-13 13:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326263808. Throughput: 0: 9777.6. Samples: 652528308. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:23:53,989][27935] Avg episode reward: [(0, '-1.447')] [2022-07-13 13:23:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 326288384. Throughput: 0: 9781.1. Samples: 652587076. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:23:58,989][27935] Avg episode reward: [(0, '-0.641')] [2022-07-13 13:24:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 326311936. Throughput: 0: 9705.7. Samples: 652642084. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:03,990][27935] Avg episode reward: [(0, '0.244')] [2022-07-13 13:24:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 326336512. Throughput: 0: 9703.9. Samples: 652671528. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:08,989][27935] Avg episode reward: [(0, '-0.076')] [2022-07-13 13:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326361088. Throughput: 0: 9696.6. Samples: 652729904. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:13,989][27935] Avg episode reward: [(0, '-0.014')] [2022-07-13 13:24:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326384640. Throughput: 0: 9694.5. Samples: 652788228. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:18,992][27935] Avg episode reward: [(0, '-1.219')] [2022-07-13 13:24:23,990][27935] Fps is (10 sec: 4709.8, 60 sec: 4846.8, 300 sec: 4842.3). Total num frames: 326408192. Throughput: 0: 9696.0. Samples: 652817496. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:23,991][27935] Avg episode reward: [(0, '-1.545')] [2022-07-13 13:24:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 326431744. Throughput: 0: 9702.5. Samples: 652876456. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:28,989][27935] Avg episode reward: [(0, '-2.347')] [2022-07-13 13:24:33,989][27935] Fps is (10 sec: 5018.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 326458368. Throughput: 0: 9694.4. Samples: 652934920. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:33,989][27935] Avg episode reward: [(0, '-2.519')] [2022-07-13 13:24:38,992][27935] Fps is (10 sec: 5118.5, 60 sec: 4846.7, 300 sec: 4845.7). Total num frames: 326482944. Throughput: 0: 9690.2. Samples: 652964396. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:38,994][27935] Avg episode reward: [(0, '-2.285')] [2022-07-13 13:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 326506496. Throughput: 0: 9691.7. Samples: 653023204. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:43,989][27935] Avg episode reward: [(0, '-2.169')] [2022-07-13 13:24:48,989][27935] Fps is (10 sec: 4814.3, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326531072. Throughput: 0: 9778.6. Samples: 653082120. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:48,989][27935] Avg episode reward: [(0, '-2.984')] [2022-07-13 13:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326555648. Throughput: 0: 9776.3. Samples: 653111460. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:53,989][27935] Avg episode reward: [(0, '-2.203')] [2022-07-13 13:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 326580224. Throughput: 0: 9779.0. Samples: 653169960. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:24:58,989][27935] Avg episode reward: [(0, '-1.945')] [2022-07-13 13:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326602752. Throughput: 0: 9683.4. Samples: 653223980. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:03,989][27935] Avg episode reward: [(0, '-2.136')] [2022-07-13 13:25:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 326626304. Throughput: 0: 9685.8. Samples: 653253344. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:08,989][27935] Avg episode reward: [(0, '-2.087')] [2022-07-13 13:25:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 326650880. Throughput: 0: 9674.1. Samples: 653311792. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:13,989][27935] Avg episode reward: [(0, '-1.582')] [2022-07-13 13:25:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326675456. Throughput: 0: 9671.7. Samples: 653370148. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:18,989][27935] Avg episode reward: [(0, '-1.048')] [2022-07-13 13:25:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.0, 300 sec: 4838.8). Total num frames: 326699008. Throughput: 0: 9660.0. Samples: 653399068. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:23,990][27935] Avg episode reward: [(0, '-0.270')] [2022-07-13 13:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 326724608. Throughput: 0: 9659.8. Samples: 653457896. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:28,989][27935] Avg episode reward: [(0, '-0.280')] [2022-07-13 13:25:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 326747136. Throughput: 0: 9648.7. Samples: 653516312. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:33,989][27935] Avg episode reward: [(0, '0.320')] [2022-07-13 13:25:38,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4830.1, 300 sec: 4842.3). Total num frames: 326772736. Throughput: 0: 9649.3. Samples: 653545676. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:38,990][27935] Avg episode reward: [(0, '0.620')] [2022-07-13 13:25:43,990][27935] Fps is (10 sec: 4914.8, 60 sec: 4829.8, 300 sec: 4835.4). Total num frames: 326796288. Throughput: 0: 9657.0. Samples: 653604532. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:43,990][27935] Avg episode reward: [(0, '-0.962')] [2022-07-13 13:25:48,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326822912. Throughput: 0: 9765.3. Samples: 653663420. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:48,989][27935] Avg episode reward: [(0, '-1.469')] [2022-07-13 13:25:53,989][27935] Fps is (10 sec: 5018.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326846464. Throughput: 0: 9765.8. Samples: 653692804. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:53,989][27935] Avg episode reward: [(0, '-1.260')] [2022-07-13 13:25:58,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4846.7, 300 sec: 4849.2). Total num frames: 326871040. Throughput: 0: 9783.2. Samples: 653752060. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:25:58,993][27935] Avg episode reward: [(0, '-2.666')] [2022-07-13 13:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 326893568. Throughput: 0: 9135.6. Samples: 653781252. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:26:03,991][27935] Avg episode reward: [(0, '-3.294')] [2022-07-13 13:26:08,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 326918144. Throughput: 0: 9714.1. Samples: 653836204. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:26:08,990][27935] Avg episode reward: [(0, '-3.028')] [2022-07-13 13:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 326942720. Throughput: 0: 9719.1. Samples: 653895256. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:13,989][27935] Avg episode reward: [(0, '-1.707')] [2022-07-13 13:26:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 326968320. Throughput: 0: 9739.4. Samples: 653954584. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:18,989][27935] Avg episode reward: [(0, '-2.275')] [2022-07-13 13:26:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 326992896. Throughput: 0: 9734.8. Samples: 653983744. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:23,989][27935] Avg episode reward: [(0, '-1.851')] [2022-07-13 13:26:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 327015424. Throughput: 0: 9733.8. Samples: 654042544. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:28,989][27935] Avg episode reward: [(0, '-1.891')] [2022-07-13 13:26:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 327041024. Throughput: 0: 9724.2. Samples: 654101008. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:33,989][27935] Avg episode reward: [(0, '-2.536')] [2022-07-13 13:26:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 327065600. Throughput: 0: 9728.1. Samples: 654130568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:38,989][27935] Avg episode reward: [(0, '-2.504')] [2022-07-13 13:26:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.2, 300 sec: 4849.2). Total num frames: 327090176. Throughput: 0: 9713.3. Samples: 654189132. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:43,989][27935] Avg episode reward: [(0, '-2.557')] [2022-07-13 13:26:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 327114752. Throughput: 0: 10378.4. Samples: 654248280. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:48,989][27935] Avg episode reward: [(0, '-2.240')] [2022-07-13 13:26:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 327138304. Throughput: 0: 9807.7. Samples: 654277552. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:53,990][27935] Avg episode reward: [(0, '-3.086')] [2022-07-13 13:26:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.2, 300 sec: 4852.7). Total num frames: 327162880. Throughput: 0: 9807.2. Samples: 654336580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:26:58,989][27935] Avg episode reward: [(0, '-3.355')] [2022-07-13 13:27:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 327186432. Throughput: 0: 9707.7. Samples: 654391432. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:03,989][27935] Avg episode reward: [(0, '-3.031')] [2022-07-13 13:27:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 327211008. Throughput: 0: 9719.4. Samples: 654421116. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:08,990][27935] Avg episode reward: [(0, '-3.043')] [2022-07-13 13:27:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 327235584. Throughput: 0: 9722.2. Samples: 654480044. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:13,990][27935] Avg episode reward: [(0, '-2.386')] [2022-07-13 13:27:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327259136. Throughput: 0: 9725.9. Samples: 654538672. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:18,992][27935] Avg episode reward: [(0, '-2.817')] [2022-07-13 13:27:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 327283712. Throughput: 0: 9717.4. Samples: 654567852. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:23,989][27935] Avg episode reward: [(0, '-2.845')] [2022-07-13 13:27:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 327308288. Throughput: 0: 9726.6. Samples: 654626828. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:28,989][27935] Avg episode reward: [(0, '-1.566')] [2022-07-13 13:27:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 327333888. Throughput: 0: 9712.6. Samples: 654685348. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:33,989][27935] Avg episode reward: [(0, '-1.395')] [2022-07-13 13:27:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 327358464. Throughput: 0: 9717.9. Samples: 654714856. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:38,989][27935] Avg episode reward: [(0, '-1.751')] [2022-07-13 13:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 327382016. Throughput: 0: 9697.0. Samples: 654772944. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:43,989][27935] Avg episode reward: [(0, '-1.048')] [2022-07-13 13:27:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327405568. Throughput: 0: 9789.2. Samples: 654831948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:48,989][27935] Avg episode reward: [(0, '-0.237')] [2022-07-13 13:27:53,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4881.0, 300 sec: 4863.1). Total num frames: 327431168. Throughput: 0: 9792.1. Samples: 654861772. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:53,990][27935] Avg episode reward: [(0, '-0.833')] [2022-07-13 13:27:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 327455744. Throughput: 0: 9788.5. Samples: 654920524. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:27:58,989][27935] Avg episode reward: [(0, '-0.463')] [2022-07-13 13:28:03,989][27935] Fps is (10 sec: 4608.5, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 327477248. Throughput: 0: 9702.4. Samples: 654975280. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:03,991][27935] Avg episode reward: [(0, '-1.044')] [2022-07-13 13:28:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 327502848. Throughput: 0: 9709.1. Samples: 655004760. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:08,989][27935] Avg episode reward: [(0, '-0.674')] [2022-07-13 13:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 327526400. Throughput: 0: 9702.1. Samples: 655063424. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:13,991][27935] Avg episode reward: [(0, '-0.515')] [2022-07-13 13:28:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327549952. Throughput: 0: 9711.1. Samples: 655122348. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:18,991][27935] Avg episode reward: [(0, '-1.079')] [2022-07-13 13:28:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327574528. Throughput: 0: 9692.3. Samples: 655151008. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:23,990][27935] Avg episode reward: [(0, '-0.818')] [2022-07-13 13:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 327599104. Throughput: 0: 9670.4. Samples: 655208112. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:28,989][27935] Avg episode reward: [(0, '-0.772')] [2022-07-13 13:28:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 327623680. Throughput: 0: 9650.0. Samples: 655266196. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:33,989][27935] Avg episode reward: [(0, '-0.663')] [2022-07-13 13:28:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 327647232. Throughput: 0: 9647.4. Samples: 655295896. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 13:28:38,989][27935] Avg episode reward: [(0, '-1.170')] [2022-07-13 13:28:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327672832. Throughput: 0: 9649.5. Samples: 655354752. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:28:43,989][27935] Avg episode reward: [(0, '-1.462')] [2022-07-13 13:28:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 327697408. Throughput: 0: 9738.3. Samples: 655413504. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:28:48,990][27935] Avg episode reward: [(0, '-3.304')] [2022-07-13 13:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4856.2). Total num frames: 327720960. Throughput: 0: 9742.2. Samples: 655443160. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:28:53,996][27935] Avg episode reward: [(0, '-2.538')] [2022-07-13 13:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 327745536. Throughput: 0: 9742.9. Samples: 655501852. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:28:58,989][27935] Avg episode reward: [(0, '-2.221')] [2022-07-13 13:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 327768064. Throughput: 0: 9654.6. Samples: 655556804. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:03,989][27935] Avg episode reward: [(0, '-3.037')] [2022-07-13 13:29:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327793664. Throughput: 0: 9666.0. Samples: 655585976. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:08,989][27935] Avg episode reward: [(0, '-2.265')] [2022-07-13 13:29:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 327818240. Throughput: 0: 9712.4. Samples: 655645172. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:13,989][27935] Avg episode reward: [(0, '-1.710')] [2022-07-13 13:29:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 327843840. Throughput: 0: 9733.9. Samples: 655704220. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:18,989][27935] Avg episode reward: [(0, '-0.967')] [2022-07-13 13:29:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 327866368. Throughput: 0: 9727.7. Samples: 655733640. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:23,989][27935] Avg episode reward: [(0, '-0.547')] [2022-07-13 13:29:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 327890944. Throughput: 0: 9727.6. Samples: 655792492. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:28,989][27935] Avg episode reward: [(0, '-0.883')] [2022-07-13 13:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 327916544. Throughput: 0: 9725.3. Samples: 655851144. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:33,991][27935] Avg episode reward: [(0, '-1.214')] [2022-07-13 13:29:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 327940096. Throughput: 0: 9718.5. Samples: 655880492. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:38,989][27935] Avg episode reward: [(0, '-0.964')] [2022-07-13 13:29:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327963648. Throughput: 0: 9717.2. Samples: 655939124. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:43,989][27935] Avg episode reward: [(0, '-1.139')] [2022-07-13 13:29:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 327988224. Throughput: 0: 9801.4. Samples: 655997868. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:48,991][27935] Avg episode reward: [(0, '-0.527')] [2022-07-13 13:29:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328013824. Throughput: 0: 9798.5. Samples: 656026908. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:53,989][27935] Avg episode reward: [(0, '-0.851')] [2022-07-13 13:29:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328038400. Throughput: 0: 9786.9. Samples: 656085580. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:29:58,989][27935] Avg episode reward: [(0, '-0.931')] [2022-07-13 13:30:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 328059904. Throughput: 0: 9699.2. Samples: 656140684. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:03,989][27935] Avg episode reward: [(0, '-1.414')] [2022-07-13 13:30:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328086528. Throughput: 0: 9702.8. Samples: 656170268. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:08,989][27935] Avg episode reward: [(0, '-0.514')] [2022-07-13 13:30:13,990][27935] Fps is (10 sec: 4914.8, 60 sec: 4846.9, 300 sec: 4859.6). Total num frames: 328109056. Throughput: 0: 9692.5. Samples: 656228664. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:13,990][27935] Avg episode reward: [(0, '-0.440')] [2022-07-13 13:30:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 328133632. Throughput: 0: 9697.7. Samples: 656287540. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:18,989][27935] Avg episode reward: [(0, '-1.130')] [2022-07-13 13:30:23,989][27935] Fps is (10 sec: 4915.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 328158208. Throughput: 0: 9692.6. Samples: 656316660. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:23,989][27935] Avg episode reward: [(0, '-1.625')] [2022-07-13 13:30:28,991][27935] Fps is (10 sec: 5016.3, 60 sec: 4880.9, 300 sec: 4870.0). Total num frames: 328183808. Throughput: 0: 9696.1. Samples: 656375472. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:28,992][27935] Avg episode reward: [(0, '-1.619')] [2022-07-13 13:30:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 328207360. Throughput: 0: 9698.3. Samples: 656434292. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:33,989][27935] Avg episode reward: [(0, '-0.614')] [2022-07-13 13:30:38,992][27935] Fps is (10 sec: 4812.5, 60 sec: 4863.7, 300 sec: 4866.6). Total num frames: 328231936. Throughput: 0: 9699.8. Samples: 656463432. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:38,993][27935] Avg episode reward: [(0, '-0.992')] [2022-07-13 13:30:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328256512. Throughput: 0: 9706.2. Samples: 656522360. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:43,989][27935] Avg episode reward: [(0, '-1.354')] [2022-07-13 13:30:48,989][27935] Fps is (10 sec: 4916.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 328281088. Throughput: 0: 9794.2. Samples: 656581424. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:48,989][27935] Avg episode reward: [(0, '-1.558')] [2022-07-13 13:30:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328306688. Throughput: 0: 9793.2. Samples: 656610964. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:53,989][27935] Avg episode reward: [(0, '-1.982')] [2022-07-13 13:30:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 328329216. Throughput: 0: 9804.0. Samples: 656669836. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:30:58,989][27935] Avg episode reward: [(0, '-1.983')] [2022-07-13 13:31:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 328351744. Throughput: 0: 9707.5. Samples: 656724376. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:31:03,989][27935] Avg episode reward: [(0, '-2.988')] [2022-07-13 13:31:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 328376320. Throughput: 0: 9714.6. Samples: 656753816. Policy #0 lag: (min: 0.0, avg: 10.7, max: 23.0) [2022-07-13 13:31:08,989][27935] Avg episode reward: [(0, '-2.079')] [2022-07-13 13:31:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328401920. Throughput: 0: 9708.9. Samples: 656812348. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:13,991][27935] Avg episode reward: [(0, '-2.298')] [2022-07-13 13:31:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328426496. Throughput: 0: 9710.7. Samples: 656871276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:18,989][27935] Avg episode reward: [(0, '-2.289')] [2022-07-13 13:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 328450048. Throughput: 0: 9708.8. Samples: 656900296. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:23,990][27935] Avg episode reward: [(0, '-1.477')] [2022-07-13 13:31:28,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4846.9, 300 sec: 4859.6). Total num frames: 328474624. Throughput: 0: 9696.9. Samples: 656958748. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:28,992][27935] Avg episode reward: [(0, '-1.022')] [2022-07-13 13:31:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 328499200. Throughput: 0: 9683.5. Samples: 657017180. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:33,989][27935] Avg episode reward: [(0, '-0.271')] [2022-07-13 13:31:38,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4847.2, 300 sec: 4856.2). Total num frames: 328522752. Throughput: 0: 9684.0. Samples: 657046744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:38,989][27935] Avg episode reward: [(0, '0.692')] [2022-07-13 13:31:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 328548352. Throughput: 0: 9686.9. Samples: 657105744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:43,989][27935] Avg episode reward: [(0, '0.044')] [2022-07-13 13:31:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328573952. Throughput: 0: 9792.7. Samples: 657165048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:48,989][27935] Avg episode reward: [(0, '1.125')] [2022-07-13 13:31:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 328597504. Throughput: 0: 9789.2. Samples: 657194328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:53,989][27935] Avg episode reward: [(0, '0.901')] [2022-07-13 13:31:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328622080. Throughput: 0: 9800.5. Samples: 657253372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:31:58,989][27935] Avg episode reward: [(0, '0.179')] [2022-07-13 13:32:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328644608. Throughput: 0: 9707.4. Samples: 657308108. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:03,989][27935] Avg episode reward: [(0, '0.318')] [2022-07-13 13:32:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328669184. Throughput: 0: 9721.1. Samples: 657337744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:08,991][27935] Avg episode reward: [(0, '0.000')] [2022-07-13 13:32:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 328692736. Throughput: 0: 9732.4. Samples: 657396676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:13,990][27935] Avg episode reward: [(0, '0.627')] [2022-07-13 13:32:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 328718336. Throughput: 0: 9740.1. Samples: 657455484. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:18,991][27935] Avg episode reward: [(0, '-0.208')] [2022-07-13 13:32:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 328742912. Throughput: 0: 9730.0. Samples: 657484592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:23,991][27935] Avg episode reward: [(0, '-0.636')] [2022-07-13 13:32:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.2, 300 sec: 4856.2). Total num frames: 328766464. Throughput: 0: 9729.3. Samples: 657543564. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:28,989][27935] Avg episode reward: [(0, '-0.588')] [2022-07-13 13:32:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 328791040. Throughput: 0: 9708.3. Samples: 657601920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:33,990][27935] Avg episode reward: [(0, '-1.600')] [2022-07-13 13:32:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 328815616. Throughput: 0: 9707.7. Samples: 657631176. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:38,989][27935] Avg episode reward: [(0, '-1.783')] [2022-07-13 13:32:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 328841216. Throughput: 0: 9685.2. Samples: 657689204. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:43,989][27935] Avg episode reward: [(0, '-2.453')] [2022-07-13 13:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 328863744. Throughput: 0: 9778.5. Samples: 657748140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:48,989][27935] Avg episode reward: [(0, '-1.691')] [2022-07-13 13:32:53,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4863.7, 300 sec: 4859.6). Total num frames: 328889344. Throughput: 0: 9770.3. Samples: 657777440. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:53,993][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 13:32:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 328912896. Throughput: 0: 9771.1. Samples: 657836376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:32:58,989][27935] Avg episode reward: [(0, '-1.367')] [2022-07-13 13:33:03,993][27935] Fps is (10 sec: 4710.2, 60 sec: 4863.7, 300 sec: 4859.6). Total num frames: 328936448. Throughput: 0: 9687.4. Samples: 657891456. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:03,993][27935] Avg episode reward: [(0, '-1.377')] [2022-07-13 13:33:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 328961024. Throughput: 0: 9695.4. Samples: 657920884. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:08,989][27935] Avg episode reward: [(0, '-1.037')] [2022-07-13 13:33:14,001][27935] Fps is (10 sec: 4911.1, 60 sec: 4880.1, 300 sec: 4866.4). Total num frames: 328985600. Throughput: 0: 9697.0. Samples: 657980048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:14,002][27935] Avg episode reward: [(0, '-0.036')] [2022-07-13 13:33:18,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4846.7, 300 sec: 4863.1). Total num frames: 329009152. Throughput: 0: 9720.7. Samples: 658039376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:18,992][27935] Avg episode reward: [(0, '-0.978')] [2022-07-13 13:33:23,989][27935] Fps is (10 sec: 4921.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 329034752. Throughput: 0: 9721.1. Samples: 658068624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:23,989][27935] Avg episode reward: [(0, '-3.038')] [2022-07-13 13:33:28,989][27935] Fps is (10 sec: 5121.2, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 329060352. Throughput: 0: 9737.2. Samples: 658127380. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:28,989][27935] Avg episode reward: [(0, '-2.888')] [2022-07-13 13:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 329083904. Throughput: 0: 9731.8. Samples: 658186072. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:33,989][27935] Avg episode reward: [(0, '-2.554')] [2022-07-13 13:33:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 329106432. Throughput: 0: 9734.6. Samples: 658215464. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 13:33:38,990][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 13:33:43,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 329132032. Throughput: 0: 9726.6. Samples: 658274072. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:33:43,989][27935] Avg episode reward: [(0, '-2.327')] [2022-07-13 13:33:48,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 329156608. Throughput: 0: 9810.0. Samples: 658332868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:33:48,989][27935] Avg episode reward: [(0, '-2.578')] [2022-07-13 13:33:53,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.3, 300 sec: 4866.6). Total num frames: 329181184. Throughput: 0: 9811.2. Samples: 658362388. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:33:53,991][27935] Avg episode reward: [(0, '-0.391')] [2022-07-13 13:33:58,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 329205760. Throughput: 0: 9800.6. Samples: 658420956. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:33:58,989][27935] Avg episode reward: [(0, '-0.366')] [2022-07-13 13:34:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.3, 300 sec: 4863.1). Total num frames: 329228288. Throughput: 0: 9702.9. Samples: 658475984. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:03,991][27935] Avg episode reward: [(0, '-0.723')] [2022-07-13 13:34:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 329253888. Throughput: 0: 9703.8. Samples: 658505296. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:08,989][27935] Avg episode reward: [(0, '-0.673')] [2022-07-13 13:34:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4865.0, 300 sec: 4859.7). Total num frames: 329277440. Throughput: 0: 9705.5. Samples: 658564128. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:13,989][27935] Avg episode reward: [(0, '-0.812')] [2022-07-13 13:34:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.3, 300 sec: 4866.6). Total num frames: 329302016. Throughput: 0: 9704.0. Samples: 658622752. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:18,991][27935] Avg episode reward: [(0, '-0.537')] [2022-07-13 13:34:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 329326592. Throughput: 0: 9703.8. Samples: 658652136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:23,989][27935] Avg episode reward: [(0, '-0.234')] [2022-07-13 13:34:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 329349120. Throughput: 0: 9674.0. Samples: 658709404. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:28,991][27935] Avg episode reward: [(0, '-0.897')] [2022-07-13 13:34:34,009][27935] Fps is (10 sec: 4598.9, 60 sec: 4811.2, 300 sec: 4855.9). Total num frames: 329372672. Throughput: 0: 9646.8. Samples: 658767164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:34,009][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 13:34:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 329398272. Throughput: 0: 9647.1. Samples: 658796508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:38,989][27935] Avg episode reward: [(0, '-1.277')] [2022-07-13 13:34:43,989][27935] Fps is (10 sec: 4925.0, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 329421824. Throughput: 0: 9645.9. Samples: 658855020. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:43,989][27935] Avg episode reward: [(0, '-1.409')] [2022-07-13 13:34:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 329446400. Throughput: 0: 9724.6. Samples: 658913592. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:48,990][27935] Avg episode reward: [(0, '-1.436')] [2022-07-13 13:34:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 329472000. Throughput: 0: 9727.4. Samples: 658943028. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:53,989][27935] Avg episode reward: [(0, '-2.475')] [2022-07-13 13:34:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 329496576. Throughput: 0: 9719.6. Samples: 659001508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:34:58,989][27935] Avg episode reward: [(0, '-1.685')] [2022-07-13 13:35:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 329519104. Throughput: 0: 9621.4. Samples: 659055716. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:03,989][27935] Avg episode reward: [(0, '-2.555')] [2022-07-13 13:35:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4856.2). Total num frames: 329541632. Throughput: 0: 9617.7. Samples: 659084932. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:08,989][27935] Avg episode reward: [(0, '-3.373')] [2022-07-13 13:35:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 329566208. Throughput: 0: 9655.2. Samples: 659143888. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:13,989][27935] Avg episode reward: [(0, '-2.584')] [2022-07-13 13:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 329591808. Throughput: 0: 9672.7. Samples: 659202244. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:18,989][27935] Avg episode reward: [(0, '-2.891')] [2022-07-13 13:35:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 329616384. Throughput: 0: 9668.4. Samples: 659231584. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:23,990][27935] Avg episode reward: [(0, '-1.484')] [2022-07-13 13:35:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 329638912. Throughput: 0: 9666.0. Samples: 659289988. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:28,989][27935] Avg episode reward: [(0, '-1.386')] [2022-07-13 13:35:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4865.6, 300 sec: 4856.2). Total num frames: 329664512. Throughput: 0: 9661.8. Samples: 659348372. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:33,990][27935] Avg episode reward: [(0, '0.142')] [2022-07-13 13:35:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 329688064. Throughput: 0: 9651.6. Samples: 659377352. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:38,989][27935] Avg episode reward: [(0, '0.316')] [2022-07-13 13:35:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 329714688. Throughput: 0: 9656.7. Samples: 659436060. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:43,989][27935] Avg episode reward: [(0, '0.147')] [2022-07-13 13:35:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 329737216. Throughput: 0: 9752.0. Samples: 659494556. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:48,989][27935] Avg episode reward: [(0, '0.194')] [2022-07-13 13:35:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 329761792. Throughput: 0: 9759.3. Samples: 659524100. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:53,992][27935] Avg episode reward: [(0, '0.013')] [2022-07-13 13:35:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 329787392. Throughput: 0: 9756.4. Samples: 659582924. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:35:58,989][27935] Avg episode reward: [(0, '0.169')] [2022-07-13 13:36:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 329808896. Throughput: 0: 9678.3. Samples: 659637768. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 13:36:03,989][27935] Avg episode reward: [(0, '0.206')] [2022-07-13 13:36:08,996][27935] Fps is (10 sec: 4604.4, 60 sec: 4863.4, 300 sec: 4852.6). Total num frames: 329833472. Throughput: 0: 9671.9. Samples: 659666892. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:08,997][27935] Avg episode reward: [(0, '0.064')] [2022-07-13 13:36:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 329859072. Throughput: 0: 9681.1. Samples: 659725636. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:13,989][27935] Avg episode reward: [(0, '0.423')] [2022-07-13 13:36:18,989][27935] Fps is (10 sec: 4919.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 329882624. Throughput: 0: 9680.5. Samples: 659783996. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:18,989][27935] Avg episode reward: [(0, '0.253')] [2022-07-13 13:36:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4849.3). Total num frames: 329905152. Throughput: 0: 9678.5. Samples: 659812884. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:23,989][27935] Avg episode reward: [(0, '-0.060')] [2022-07-13 13:36:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 329931776. Throughput: 0: 9674.6. Samples: 659871416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:28,989][27935] Avg episode reward: [(0, '-0.139')] [2022-07-13 13:36:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 329955328. Throughput: 0: 9674.1. Samples: 659929892. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:33,990][27935] Avg episode reward: [(0, '-0.800')] [2022-07-13 13:36:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 329978880. Throughput: 0: 9672.7. Samples: 659959372. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:38,989][27935] Avg episode reward: [(0, '-0.799')] [2022-07-13 13:36:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 330003456. Throughput: 0: 9674.0. Samples: 660018252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:43,989][27935] Avg episode reward: [(0, '-0.975')] [2022-07-13 13:36:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 330030080. Throughput: 0: 9762.0. Samples: 660077060. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:48,992][27935] Avg episode reward: [(0, '-0.837')] [2022-07-13 13:36:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 330052608. Throughput: 0: 9772.6. Samples: 660106584. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:53,989][27935] Avg episode reward: [(0, '-0.617')] [2022-07-13 13:36:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 330077184. Throughput: 0: 9774.7. Samples: 660165496. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:36:58,989][27935] Avg episode reward: [(0, '-0.087')] [2022-07-13 13:37:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 330099712. Throughput: 0: 9688.5. Samples: 660219980. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:03,989][27935] Avg episode reward: [(0, '-0.126')] [2022-07-13 13:37:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.6, 300 sec: 4856.2). Total num frames: 330125312. Throughput: 0: 9696.1. Samples: 660249208. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:08,996][27935] Avg episode reward: [(0, '0.599')] [2022-07-13 13:37:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 330149888. Throughput: 0: 9703.3. Samples: 660308064. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:13,989][27935] Avg episode reward: [(0, '0.517')] [2022-07-13 13:37:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 330172416. Throughput: 0: 9708.3. Samples: 660366768. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:18,989][27935] Avg episode reward: [(0, '-0.709')] [2022-07-13 13:37:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 330198016. Throughput: 0: 9704.6. Samples: 660396080. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:23,989][27935] Avg episode reward: [(0, '-0.662')] [2022-07-13 13:37:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 330222592. Throughput: 0: 9699.9. Samples: 660454748. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:28,989][27935] Avg episode reward: [(0, '-0.261')] [2022-07-13 13:37:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 330248192. Throughput: 0: 9682.9. Samples: 660512792. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:33,989][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 13:37:38,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4880.9, 300 sec: 4849.2). Total num frames: 330271744. Throughput: 0: 9684.7. Samples: 660542420. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:38,992][27935] Avg episode reward: [(0, '-0.409')] [2022-07-13 13:37:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 330295296. Throughput: 0: 9668.8. Samples: 660600592. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:43,989][27935] Avg episode reward: [(0, '-1.461')] [2022-07-13 13:37:48,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4846.9, 300 sec: 4852.8). Total num frames: 330320896. Throughput: 0: 9758.6. Samples: 660659116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:48,989][27935] Avg episode reward: [(0, '-1.146')] [2022-07-13 13:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 330344448. Throughput: 0: 9758.1. Samples: 660688324. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:53,989][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 13:37:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.8). Total num frames: 330368000. Throughput: 0: 9753.6. Samples: 660746976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:37:58,989][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 13:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 330390528. Throughput: 0: 9656.5. Samples: 660801308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:03,989][27935] Avg episode reward: [(0, '-0.332')] [2022-07-13 13:38:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4846.0). Total num frames: 330415104. Throughput: 0: 9657.9. Samples: 660830684. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:08,991][27935] Avg episode reward: [(0, '-0.784')] [2022-07-13 13:38:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 330438656. Throughput: 0: 9660.5. Samples: 660889472. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:13,989][27935] Avg episode reward: [(0, '0.101')] [2022-07-13 13:38:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 330464256. Throughput: 0: 9667.1. Samples: 660947812. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:18,991][27935] Avg episode reward: [(0, '-1.539')] [2022-07-13 13:38:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 330488832. Throughput: 0: 9662.6. Samples: 660977212. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:23,989][27935] Avg episode reward: [(0, '-1.827')] [2022-07-13 13:38:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 330513408. Throughput: 0: 9675.9. Samples: 661036008. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:28,989][27935] Avg episode reward: [(0, '-1.355')] [2022-07-13 13:38:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 330536960. Throughput: 0: 9672.9. Samples: 661094396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 13:38:33,991][27935] Avg episode reward: [(0, '-1.849')] [2022-07-13 13:38:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4845.8). Total num frames: 330561536. Throughput: 0: 9673.8. Samples: 661123644. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:38:38,989][27935] Avg episode reward: [(0, '-1.614')] [2022-07-13 13:38:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 330587136. Throughput: 0: 9682.2. Samples: 661182676. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:38:43,989][27935] Avg episode reward: [(0, '-2.823')] [2022-07-13 13:38:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 330610688. Throughput: 0: 9773.4. Samples: 661241112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:38:48,989][27935] Avg episode reward: [(0, '-3.171')] [2022-07-13 13:38:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 330635264. Throughput: 0: 9772.3. Samples: 661270436. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:38:53,990][27935] Avg episode reward: [(0, '-2.036')] [2022-07-13 13:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 330658816. Throughput: 0: 9771.8. Samples: 661329204. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:38:58,990][27935] Avg episode reward: [(0, '-2.203')] [2022-07-13 13:39:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 330681344. Throughput: 0: 9684.5. Samples: 661383616. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:03,989][27935] Avg episode reward: [(0, '-2.373')] [2022-07-13 13:39:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 330707968. Throughput: 0: 9683.1. Samples: 661412952. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:08,991][27935] Avg episode reward: [(0, '-1.209')] [2022-07-13 13:39:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 330730496. Throughput: 0: 9684.0. Samples: 661471788. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:13,991][27935] Avg episode reward: [(0, '-1.461')] [2022-07-13 13:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 330756096. Throughput: 0: 9691.3. Samples: 661530504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:18,989][27935] Avg episode reward: [(0, '-0.962')] [2022-07-13 13:39:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 330779648. Throughput: 0: 9697.5. Samples: 661560032. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:23,989][27935] Avg episode reward: [(0, '-0.841')] [2022-07-13 13:39:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4853.0). Total num frames: 330804224. Throughput: 0: 9696.9. Samples: 661619036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:28,989][27935] Avg episode reward: [(0, '-1.177')] [2022-07-13 13:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 330828800. Throughput: 0: 9694.7. Samples: 661677376. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:33,989][27935] Avg episode reward: [(0, '-1.165')] [2022-07-13 13:39:38,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4863.7, 300 sec: 4852.7). Total num frames: 330853376. Throughput: 0: 9695.4. Samples: 661706764. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:38,993][27935] Avg episode reward: [(0, '-1.669')] [2022-07-13 13:39:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 330877952. Throughput: 0: 9691.3. Samples: 661765312. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:43,989][27935] Avg episode reward: [(0, '-1.624')] [2022-07-13 13:39:48,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 330902528. Throughput: 0: 9784.8. Samples: 661823932. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:48,989][27935] Avg episode reward: [(0, '-1.055')] [2022-07-13 13:39:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 330926080. Throughput: 0: 9782.2. Samples: 661853152. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:53,989][27935] Avg episode reward: [(0, '-0.623')] [2022-07-13 13:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 330951680. Throughput: 0: 9787.3. Samples: 661912216. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:39:58,989][27935] Avg episode reward: [(0, '0.002')] [2022-07-13 13:40:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 330974208. Throughput: 0: 9700.8. Samples: 661967040. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:03,989][27935] Avg episode reward: [(0, '0.064')] [2022-07-13 13:40:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 330998784. Throughput: 0: 9696.4. Samples: 661996368. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:08,989][27935] Avg episode reward: [(0, '0.679')] [2022-07-13 13:40:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 331022336. Throughput: 0: 9692.4. Samples: 662055196. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:13,989][27935] Avg episode reward: [(0, '1.124')] [2022-07-13 13:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 331047936. Throughput: 0: 9698.1. Samples: 662113792. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:18,989][27935] Avg episode reward: [(0, '0.964')] [2022-07-13 13:40:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331070464. Throughput: 0: 9696.3. Samples: 662143064. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:23,991][27935] Avg episode reward: [(0, '0.821')] [2022-07-13 13:40:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 331095040. Throughput: 0: 9707.0. Samples: 662202128. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:28,989][27935] Avg episode reward: [(0, '-0.295')] [2022-07-13 13:40:33,995][27935] Fps is (10 sec: 5014.3, 60 sec: 4863.5, 300 sec: 4856.1). Total num frames: 331120640. Throughput: 0: 9663.5. Samples: 662258852. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:33,996][27935] Avg episode reward: [(0, '-0.658')] [2022-07-13 13:40:38,996][27935] Fps is (10 sec: 4911.5, 60 sec: 4846.6, 300 sec: 4845.7). Total num frames: 331144192. Throughput: 0: 9657.5. Samples: 662287812. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:38,997][27935] Avg episode reward: [(0, '-1.758')] [2022-07-13 13:40:43,989][27935] Fps is (10 sec: 4713.5, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 331167744. Throughput: 0: 9654.8. Samples: 662346680. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:43,993][27935] Avg episode reward: [(0, '-1.969')] [2022-07-13 13:40:48,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331193344. Throughput: 0: 9744.0. Samples: 662405520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:48,989][27935] Avg episode reward: [(0, '-2.477')] [2022-07-13 13:40:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 331216896. Throughput: 0: 9738.0. Samples: 662434580. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:53,989][27935] Avg episode reward: [(0, '-2.385')] [2022-07-13 13:40:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 331242496. Throughput: 0: 9738.6. Samples: 662493432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:40:58,989][27935] Avg episode reward: [(0, '-2.366')] [2022-07-13 13:41:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4845.9). Total num frames: 331262976. Throughput: 0: 9654.4. Samples: 662548240. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 13:41:03,989][27935] Avg episode reward: [(0, '-2.453')] [2022-07-13 13:41:08,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 331289600. Throughput: 0: 9646.7. Samples: 662577168. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:08,989][27935] Avg episode reward: [(0, '-2.063')] [2022-07-13 13:41:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 331313152. Throughput: 0: 9643.8. Samples: 662636100. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:13,989][27935] Avg episode reward: [(0, '-1.768')] [2022-07-13 13:41:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 331336704. Throughput: 0: 9691.8. Samples: 662694920. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:18,989][27935] Avg episode reward: [(0, '-1.309')] [2022-07-13 13:41:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 331361280. Throughput: 0: 9686.0. Samples: 662723608. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:23,989][27935] Avg episode reward: [(0, '-1.933')] [2022-07-13 13:41:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 331386880. Throughput: 0: 9686.3. Samples: 662782564. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:28,989][27935] Avg episode reward: [(0, '-1.480')] [2022-07-13 13:41:33,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4830.3, 300 sec: 4852.7). Total num frames: 331410432. Throughput: 0: 9675.8. Samples: 662840940. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:33,990][27935] Avg episode reward: [(0, '-1.069')] [2022-07-13 13:41:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.5, 300 sec: 4852.7). Total num frames: 331435008. Throughput: 0: 9677.3. Samples: 662870060. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:38,989][27935] Avg episode reward: [(0, '-0.943')] [2022-07-13 13:41:43,989][27935] Fps is (10 sec: 4813.1, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 331458560. Throughput: 0: 9673.5. Samples: 662928740. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:43,989][27935] Avg episode reward: [(0, '-2.040')] [2022-07-13 13:41:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331484160. Throughput: 0: 9764.6. Samples: 662987648. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:48,989][27935] Avg episode reward: [(0, '-1.833')] [2022-07-13 13:41:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 331508736. Throughput: 0: 9766.4. Samples: 663016656. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:53,990][27935] Avg episode reward: [(0, '-2.404')] [2022-07-13 13:41:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 331532288. Throughput: 0: 9769.4. Samples: 663075724. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:41:58,989][27935] Avg episode reward: [(0, '-1.734')] [2022-07-13 13:42:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 331553792. Throughput: 0: 9684.5. Samples: 663130724. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:03,989][27935] Avg episode reward: [(0, '-2.209')] [2022-07-13 13:42:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 331580416. Throughput: 0: 9698.0. Samples: 663160016. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:08,989][27935] Avg episode reward: [(0, '-1.989')] [2022-07-13 13:42:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331603968. Throughput: 0: 9699.9. Samples: 663219060. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:13,991][27935] Avg episode reward: [(0, '-2.068')] [2022-07-13 13:42:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 331630592. Throughput: 0: 9713.6. Samples: 663278044. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:18,991][27935] Avg episode reward: [(0, '-1.572')] [2022-07-13 13:42:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 331654144. Throughput: 0: 9724.4. Samples: 663307656. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:23,990][27935] Avg episode reward: [(0, '-2.843')] [2022-07-13 13:42:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 331677696. Throughput: 0: 9726.1. Samples: 663366416. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:28,989][27935] Avg episode reward: [(0, '-3.717')] [2022-07-13 13:42:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.8). Total num frames: 331703296. Throughput: 0: 9724.5. Samples: 663425252. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:33,989][27935] Avg episode reward: [(0, '-3.942')] [2022-07-13 13:42:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 331726848. Throughput: 0: 9729.0. Samples: 663454460. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:38,989][27935] Avg episode reward: [(0, '-3.576')] [2022-07-13 13:42:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 331752448. Throughput: 0: 9701.6. Samples: 663512296. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:43,996][27935] Avg episode reward: [(0, '-3.519')] [2022-07-13 13:42:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 331776000. Throughput: 0: 9795.4. Samples: 663571516. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:48,989][27935] Avg episode reward: [(0, '-2.694')] [2022-07-13 13:42:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331799552. Throughput: 0: 9787.8. Samples: 663600468. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:53,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 13:42:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 331826176. Throughput: 0: 9788.1. Samples: 663659524. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:42:58,989][27935] Avg episode reward: [(0, '-0.313')] [2022-07-13 13:43:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4859.7). Total num frames: 331848704. Throughput: 0: 9699.4. Samples: 663714516. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:03,989][27935] Avg episode reward: [(0, '0.698')] [2022-07-13 13:43:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 331871232. Throughput: 0: 9689.3. Samples: 663743676. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:08,989][27935] Avg episode reward: [(0, '-0.356')] [2022-07-13 13:43:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 331897856. Throughput: 0: 9687.5. Samples: 663802352. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:13,989][27935] Avg episode reward: [(0, '-0.367')] [2022-07-13 13:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 331920384. Throughput: 0: 9682.5. Samples: 663860964. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:18,991][27935] Avg episode reward: [(0, '0.054')] [2022-07-13 13:43:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 331944960. Throughput: 0: 9686.4. Samples: 663890348. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:23,989][27935] Avg episode reward: [(0, '-0.071')] [2022-07-13 13:43:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 331969536. Throughput: 0: 9702.0. Samples: 663948888. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:28,989][27935] Avg episode reward: [(0, '-1.019')] [2022-07-13 13:43:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 331994112. Throughput: 0: 9677.3. Samples: 664006996. Policy #0 lag: (min: 0.0, avg: 10.4, max: 23.0) [2022-07-13 13:43:33,989][27935] Avg episode reward: [(0, '-1.235')] [2022-07-13 13:43:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 332017664. Throughput: 0: 9680.8. Samples: 664036104. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:43:38,989][27935] Avg episode reward: [(0, '-0.006')] [2022-07-13 13:43:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 332042240. Throughput: 0: 9674.9. Samples: 664094896. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:43:43,989][27935] Avg episode reward: [(0, '0.057')] [2022-07-13 13:43:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332066816. Throughput: 0: 9756.2. Samples: 664153548. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:43:48,989][27935] Avg episode reward: [(0, '-0.289')] [2022-07-13 13:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332091392. Throughput: 0: 9762.2. Samples: 664182976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:43:53,989][27935] Avg episode reward: [(0, '-0.771')] [2022-07-13 13:43:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 332116992. Throughput: 0: 9763.3. Samples: 664241700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:43:58,989][27935] Avg episode reward: [(0, '-1.945')] [2022-07-13 13:44:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332139520. Throughput: 0: 9683.9. Samples: 664296740. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:03,989][27935] Avg episode reward: [(0, '-1.131')] [2022-07-13 13:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332163072. Throughput: 0: 9681.4. Samples: 664326012. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:08,989][27935] Avg episode reward: [(0, '-1.609')] [2022-07-13 13:44:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 332187648. Throughput: 0: 9683.8. Samples: 664384660. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:13,989][27935] Avg episode reward: [(0, '-1.794')] [2022-07-13 13:44:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332211200. Throughput: 0: 9040.8. Samples: 664413832. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:18,989][27935] Avg episode reward: [(0, '-2.386')] [2022-07-13 13:44:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332235776. Throughput: 0: 9696.9. Samples: 664472464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:23,991][27935] Avg episode reward: [(0, '-2.518')] [2022-07-13 13:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332260352. Throughput: 0: 9695.7. Samples: 664531204. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:28,989][27935] Avg episode reward: [(0, '-1.956')] [2022-07-13 13:44:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332285952. Throughput: 0: 9696.2. Samples: 664589876. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:33,989][27935] Avg episode reward: [(0, '-1.260')] [2022-07-13 13:44:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 332310528. Throughput: 0: 9689.5. Samples: 664619004. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:38,990][27935] Avg episode reward: [(0, '-1.806')] [2022-07-13 13:44:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 332334080. Throughput: 0: 9682.1. Samples: 664677396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:43,990][27935] Avg episode reward: [(0, '-1.595')] [2022-07-13 13:44:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332357632. Throughput: 0: 9773.6. Samples: 664736552. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:48,989][27935] Avg episode reward: [(0, '-1.923')] [2022-07-13 13:44:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 332383232. Throughput: 0: 9775.4. Samples: 664765904. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:53,989][27935] Avg episode reward: [(0, '-0.558')] [2022-07-13 13:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 332406784. Throughput: 0: 9770.9. Samples: 664824348. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:44:58,989][27935] Avg episode reward: [(0, '-0.335')] [2022-07-13 13:45:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 332429312. Throughput: 0: 10343.9. Samples: 664879308. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:03,989][27935] Avg episode reward: [(0, '-0.210')] [2022-07-13 13:45:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332453888. Throughput: 0: 9694.2. Samples: 664908704. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:08,989][27935] Avg episode reward: [(0, '-1.020')] [2022-07-13 13:45:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 332479488. Throughput: 0: 9691.6. Samples: 664967328. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:13,989][27935] Avg episode reward: [(0, '-0.155')] [2022-07-13 13:45:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332503040. Throughput: 0: 9694.8. Samples: 665026144. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:18,989][27935] Avg episode reward: [(0, '-0.341')] [2022-07-13 13:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332527616. Throughput: 0: 9699.6. Samples: 665055484. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:23,989][27935] Avg episode reward: [(0, '-0.078')] [2022-07-13 13:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.4). Total num frames: 332551168. Throughput: 0: 9704.9. Samples: 665114116. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:28,989][27935] Avg episode reward: [(0, '0.017')] [2022-07-13 13:45:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.3). Total num frames: 332576768. Throughput: 0: 9682.5. Samples: 665172264. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:33,989][27935] Avg episode reward: [(0, '-0.373')] [2022-07-13 13:45:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 332600320. Throughput: 0: 9687.2. Samples: 665201828. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:38,989][27935] Avg episode reward: [(0, '-1.127')] [2022-07-13 13:45:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332625920. Throughput: 0: 9690.0. Samples: 665260400. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:43,990][27935] Avg episode reward: [(0, '-0.951')] [2022-07-13 13:45:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332648448. Throughput: 0: 9770.4. Samples: 665318976. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:48,989][27935] Avg episode reward: [(0, '-0.844')] [2022-07-13 13:45:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 332674048. Throughput: 0: 9764.1. Samples: 665348088. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:53,990][27935] Avg episode reward: [(0, '-0.699')] [2022-07-13 13:45:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 332699648. Throughput: 0: 9770.8. Samples: 665407012. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:45:58,989][27935] Avg episode reward: [(0, '-1.127')] [2022-07-13 13:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 332721152. Throughput: 0: 9683.7. Samples: 665461908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 18.0) [2022-07-13 13:46:03,989][27935] Avg episode reward: [(0, '-0.889')] [2022-07-13 13:46:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 332745728. Throughput: 0: 9685.9. Samples: 665491352. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:08,989][27935] Avg episode reward: [(0, '-0.823')] [2022-07-13 13:46:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 332769280. Throughput: 0: 9690.2. Samples: 665550176. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:13,993][27935] Avg episode reward: [(0, '-0.209')] [2022-07-13 13:46:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 332793856. Throughput: 0: 9053.8. Samples: 665579684. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:18,989][27935] Avg episode reward: [(0, '0.046')] [2022-07-13 13:46:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 332820480. Throughput: 0: 9699.3. Samples: 665638296. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:23,989][27935] Avg episode reward: [(0, '-0.958')] [2022-07-13 13:46:28,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4863.8, 300 sec: 4856.2). Total num frames: 332843008. Throughput: 0: 9704.6. Samples: 665697128. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:29,000][27935] Avg episode reward: [(0, '-0.641')] [2022-07-13 13:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 332867584. Throughput: 0: 9683.1. Samples: 665754716. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:33,989][27935] Avg episode reward: [(0, '-0.668')] [2022-07-13 13:46:38,989][27935] Fps is (10 sec: 4813.9, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 332891136. Throughput: 0: 9662.3. Samples: 665782892. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:38,989][27935] Avg episode reward: [(0, '-1.369')] [2022-07-13 13:46:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 332914688. Throughput: 0: 9639.6. Samples: 665840792. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:43,989][27935] Avg episode reward: [(0, '-1.119')] [2022-07-13 13:46:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 332940288. Throughput: 0: 9725.7. Samples: 665899564. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:48,991][27935] Avg episode reward: [(0, '-1.156')] [2022-07-13 13:46:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 332964864. Throughput: 0: 9729.8. Samples: 665929192. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:53,991][27935] Avg episode reward: [(0, '-0.147')] [2022-07-13 13:46:58,991][27935] Fps is (10 sec: 4914.0, 60 sec: 4829.7, 300 sec: 4866.6). Total num frames: 332989440. Throughput: 0: 9719.8. Samples: 665987592. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:46:58,993][27935] Avg episode reward: [(0, '-0.106')] [2022-07-13 13:47:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 333010944. Throughput: 0: 10281.4. Samples: 666042348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:03,990][27935] Avg episode reward: [(0, '-1.120')] [2022-07-13 13:47:08,989][27935] Fps is (10 sec: 4609.1, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 333035520. Throughput: 0: 9626.8. Samples: 666071500. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:08,991][27935] Avg episode reward: [(0, '-1.257')] [2022-07-13 13:47:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 333060096. Throughput: 0: 9632.4. Samples: 666130564. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:13,989][27935] Avg episode reward: [(0, '-0.762')] [2022-07-13 13:47:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 333085696. Throughput: 0: 9650.5. Samples: 666188988. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:18,989][27935] Avg episode reward: [(0, '-0.119')] [2022-07-13 13:47:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 333109248. Throughput: 0: 9687.6. Samples: 666218836. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:23,989][27935] Avg episode reward: [(0, '0.000')] [2022-07-13 13:47:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4847.1, 300 sec: 4849.2). Total num frames: 333133824. Throughput: 0: 9703.9. Samples: 666277468. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:28,989][27935] Avg episode reward: [(0, '-0.204')] [2022-07-13 13:47:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 333157376. Throughput: 0: 9698.0. Samples: 666335976. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:33,989][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 13:47:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 333182976. Throughput: 0: 9694.5. Samples: 666365444. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:38,990][27935] Avg episode reward: [(0, '0.144')] [2022-07-13 13:47:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 333207552. Throughput: 0: 9693.5. Samples: 666423776. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:43,990][27935] Avg episode reward: [(0, '-0.075')] [2022-07-13 13:47:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 333231104. Throughput: 0: 9786.0. Samples: 666482716. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:48,991][27935] Avg episode reward: [(0, '-0.166')] [2022-07-13 13:47:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 333255680. Throughput: 0: 9799.6. Samples: 666512484. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:53,991][27935] Avg episode reward: [(0, '-0.858')] [2022-07-13 13:47:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4852.7). Total num frames: 333280256. Throughput: 0: 9795.4. Samples: 666571356. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:47:58,989][27935] Avg episode reward: [(0, '-0.821')] [2022-07-13 13:48:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333303808. Throughput: 0: 9722.0. Samples: 666626476. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:03,991][27935] Avg episode reward: [(0, '-0.927')] [2022-07-13 13:48:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 333328384. Throughput: 0: 9712.4. Samples: 666655892. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:08,990][27935] Avg episode reward: [(0, '0.087')] [2022-07-13 13:48:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333352960. Throughput: 0: 9720.9. Samples: 666714908. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:13,989][27935] Avg episode reward: [(0, '-1.042')] [2022-07-13 13:48:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 333376512. Throughput: 0: 9728.4. Samples: 666773752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:18,989][27935] Avg episode reward: [(0, '-1.115')] [2022-07-13 13:48:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 333401088. Throughput: 0: 9735.1. Samples: 666803524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:23,989][27935] Avg episode reward: [(0, '-1.147')] [2022-07-13 13:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333426688. Throughput: 0: 9739.7. Samples: 666862064. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:28,990][27935] Avg episode reward: [(0, '-1.164')] [2022-07-13 13:48:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333450240. Throughput: 0: 9740.8. Samples: 666921052. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 13:48:33,989][27935] Avg episode reward: [(0, '-0.785')] [2022-07-13 13:48:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 333473792. Throughput: 0: 9728.0. Samples: 666950244. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:48:38,990][27935] Avg episode reward: [(0, '-0.886')] [2022-07-13 13:48:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 333498368. Throughput: 0: 9731.6. Samples: 667009276. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:48:43,989][27935] Avg episode reward: [(0, '-0.773')] [2022-07-13 13:48:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333523968. Throughput: 0: 9816.6. Samples: 667068224. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:48:48,990][27935] Avg episode reward: [(0, '-1.257')] [2022-07-13 13:48:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 333549568. Throughput: 0: 9814.4. Samples: 667097540. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:48:53,989][27935] Avg episode reward: [(0, '-0.220')] [2022-07-13 13:48:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 333573120. Throughput: 0: 9813.4. Samples: 667156512. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:48:58,990][27935] Avg episode reward: [(0, '-0.182')] [2022-07-13 13:49:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 333594624. Throughput: 0: 9731.1. Samples: 667211652. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:03,991][27935] Avg episode reward: [(0, '-1.229')] [2022-07-13 13:49:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 333621248. Throughput: 0: 9720.8. Samples: 667240960. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:08,991][27935] Avg episode reward: [(0, '-1.494')] [2022-07-13 13:49:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 333644800. Throughput: 0: 9728.3. Samples: 667299836. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:13,990][27935] Avg episode reward: [(0, '-1.509')] [2022-07-13 13:49:18,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4880.9, 300 sec: 4859.6). Total num frames: 333669376. Throughput: 0: 9723.2. Samples: 667358620. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:18,992][27935] Avg episode reward: [(0, '-2.325')] [2022-07-13 13:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 333693952. Throughput: 0: 9734.7. Samples: 667388308. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:23,989][27935] Avg episode reward: [(0, '-1.926')] [2022-07-13 13:49:28,989][27935] Fps is (10 sec: 4916.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 333718528. Throughput: 0: 9731.3. Samples: 667447184. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:28,989][27935] Avg episode reward: [(0, '-2.274')] [2022-07-13 13:49:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 333743104. Throughput: 0: 9731.1. Samples: 667506124. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:33,989][27935] Avg episode reward: [(0, '-1.476')] [2022-07-13 13:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 333767680. Throughput: 0: 9720.3. Samples: 667534952. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:38,989][27935] Avg episode reward: [(0, '-1.185')] [2022-07-13 13:49:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 333792256. Throughput: 0: 9722.0. Samples: 667594000. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:43,992][27935] Avg episode reward: [(0, '-1.899')] [2022-07-13 13:49:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 333817856. Throughput: 0: 9806.0. Samples: 667652924. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:48,989][27935] Avg episode reward: [(0, '-1.931')] [2022-07-13 13:49:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 333840384. Throughput: 0: 9806.2. Samples: 667682240. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:53,989][27935] Avg episode reward: [(0, '-1.890')] [2022-07-13 13:49:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 333865984. Throughput: 0: 9805.5. Samples: 667741084. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:49:58,991][27935] Avg episode reward: [(0, '-2.282')] [2022-07-13 13:50:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 333888512. Throughput: 0: 9712.4. Samples: 667795652. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:03,989][27935] Avg episode reward: [(0, '-1.633')] [2022-07-13 13:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 333912064. Throughput: 0: 9704.3. Samples: 667825000. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:08,989][27935] Avg episode reward: [(0, '-1.357')] [2022-07-13 13:50:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 333937664. Throughput: 0: 9704.6. Samples: 667883892. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:13,990][27935] Avg episode reward: [(0, '-2.556')] [2022-07-13 13:50:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.2, 300 sec: 4859.7). Total num frames: 333961216. Throughput: 0: 9696.0. Samples: 667942444. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:18,989][27935] Avg episode reward: [(0, '-2.771')] [2022-07-13 13:50:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 333985792. Throughput: 0: 9713.0. Samples: 667972036. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:23,989][27935] Avg episode reward: [(0, '-2.250')] [2022-07-13 13:50:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 334009344. Throughput: 0: 9699.5. Samples: 668030476. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:28,989][27935] Avg episode reward: [(0, '-1.677')] [2022-07-13 13:50:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 334034944. Throughput: 0: 9679.9. Samples: 668088520. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:33,989][27935] Avg episode reward: [(0, '-2.801')] [2022-07-13 13:50:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 334058496. Throughput: 0: 9680.7. Samples: 668117872. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:38,989][27935] Avg episode reward: [(0, '-3.172')] [2022-07-13 13:50:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 334084096. Throughput: 0: 9673.2. Samples: 668176380. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:43,989][27935] Avg episode reward: [(0, '-2.501')] [2022-07-13 13:50:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 334107648. Throughput: 0: 9766.7. Samples: 668235152. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:48,991][27935] Avg episode reward: [(0, '-1.742')] [2022-07-13 13:50:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 334132224. Throughput: 0: 9767.7. Samples: 668264548. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:53,989][27935] Avg episode reward: [(0, '-1.294')] [2022-07-13 13:50:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 334156800. Throughput: 0: 9770.6. Samples: 668323568. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:50:58,989][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 13:51:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 334179328. Throughput: 0: 9685.2. Samples: 668378280. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:51:03,991][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 13:51:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 334203904. Throughput: 0: 9682.4. Samples: 668407744. Policy #0 lag: (min: 0.0, avg: 6.7, max: 19.0) [2022-07-13 13:51:08,990][27935] Avg episode reward: [(0, '-0.305')] [2022-07-13 13:51:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 334228480. Throughput: 0: 9692.3. Samples: 668466628. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:13,991][27935] Avg episode reward: [(0, '-0.651')] [2022-07-13 13:51:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 334253056. Throughput: 0: 9704.4. Samples: 668525220. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:18,991][27935] Avg episode reward: [(0, '-1.839')] [2022-07-13 13:51:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 334276608. Throughput: 0: 9701.5. Samples: 668554440. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:23,989][27935] Avg episode reward: [(0, '-1.948')] [2022-07-13 13:51:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 334302208. Throughput: 0: 9712.6. Samples: 668613448. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:28,991][27935] Avg episode reward: [(0, '-1.851')] [2022-07-13 13:51:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 334325760. Throughput: 0: 9696.5. Samples: 668671496. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:33,989][27935] Avg episode reward: [(0, '-1.659')] [2022-07-13 13:51:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 334348288. Throughput: 0: 9694.0. Samples: 668700776. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:38,991][27935] Avg episode reward: [(0, '-1.921')] [2022-07-13 13:51:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 334376960. Throughput: 0: 9694.2. Samples: 668759808. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:43,991][27935] Avg episode reward: [(0, '-1.722')] [2022-07-13 13:51:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 334399488. Throughput: 0: 9791.4. Samples: 668818892. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:48,989][27935] Avg episode reward: [(0, '-1.832')] [2022-07-13 13:51:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 334425088. Throughput: 0: 9784.2. Samples: 668848032. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:53,990][27935] Avg episode reward: [(0, '-1.222')] [2022-07-13 13:51:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 334447616. Throughput: 0: 9772.5. Samples: 668906392. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:51:58,990][27935] Avg episode reward: [(0, '-1.503')] [2022-07-13 13:52:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 334470144. Throughput: 0: 9687.0. Samples: 668961136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:03,989][27935] Avg episode reward: [(0, '-1.752')] [2022-07-13 13:52:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 334495744. Throughput: 0: 9689.8. Samples: 668990480. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:08,989][27935] Avg episode reward: [(0, '-1.579')] [2022-07-13 13:52:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 334519296. Throughput: 0: 9677.7. Samples: 669048944. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:13,991][27935] Avg episode reward: [(0, '-1.886')] [2022-07-13 13:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 334543872. Throughput: 0: 9677.1. Samples: 669106964. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:18,989][27935] Avg episode reward: [(0, '-1.611')] [2022-07-13 13:52:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 334568448. Throughput: 0: 9680.0. Samples: 669136376. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:23,990][27935] Avg episode reward: [(0, '-1.494')] [2022-07-13 13:52:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4859.7). Total num frames: 334590976. Throughput: 0: 9662.6. Samples: 669194624. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:28,989][27935] Avg episode reward: [(0, '-0.997')] [2022-07-13 13:52:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 334617600. Throughput: 0: 9646.0. Samples: 669252960. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:33,989][27935] Avg episode reward: [(0, '-1.660')] [2022-07-13 13:52:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 334641152. Throughput: 0: 9647.3. Samples: 669282160. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:38,989][27935] Avg episode reward: [(0, '-1.360')] [2022-07-13 13:52:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4859.7). Total num frames: 334664704. Throughput: 0: 9597.1. Samples: 669338260. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:43,991][27935] Avg episode reward: [(0, '-0.575')] [2022-07-13 13:52:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 334688256. Throughput: 0: 9679.7. Samples: 669396724. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:48,989][27935] Avg episode reward: [(0, '-0.699')] [2022-07-13 13:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4856.2). Total num frames: 334712832. Throughput: 0: 9675.3. Samples: 669425868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:53,989][27935] Avg episode reward: [(0, '-1.026')] [2022-07-13 13:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 334737408. Throughput: 0: 9680.4. Samples: 669484560. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:52:58,989][27935] Avg episode reward: [(0, '-1.589')] [2022-07-13 13:53:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 334759936. Throughput: 0: 9600.3. Samples: 669538976. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:03,989][27935] Avg episode reward: [(0, '-1.549')] [2022-07-13 13:53:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 334784512. Throughput: 0: 9595.8. Samples: 669568188. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:08,989][27935] Avg episode reward: [(0, '-1.014')] [2022-07-13 13:53:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 334809088. Throughput: 0: 9606.0. Samples: 669626896. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:13,991][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 13:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 334832640. Throughput: 0: 9603.5. Samples: 669685116. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:18,991][27935] Avg episode reward: [(0, '-2.602')] [2022-07-13 13:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 334857216. Throughput: 0: 9606.5. Samples: 669714452. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:23,990][27935] Avg episode reward: [(0, '-2.257')] [2022-07-13 13:53:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 334880768. Throughput: 0: 9666.6. Samples: 669773256. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:28,990][27935] Avg episode reward: [(0, '-2.812')] [2022-07-13 13:53:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 334907392. Throughput: 0: 9675.3. Samples: 669832112. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:33,989][27935] Avg episode reward: [(0, '-2.914')] [2022-07-13 13:53:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 334930944. Throughput: 0: 9684.3. Samples: 669861660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 13:53:38,990][27935] Avg episode reward: [(0, '-2.389')] [2022-07-13 13:53:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 334954496. Throughput: 0: 9680.8. Samples: 669920196. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:53:43,990][27935] Avg episode reward: [(0, '-3.000')] [2022-07-13 13:53:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 334980096. Throughput: 0: 9776.9. Samples: 669978936. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:53:48,991][27935] Avg episode reward: [(0, '-2.087')] [2022-07-13 13:53:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335004672. Throughput: 0: 9783.6. Samples: 670008452. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:53:53,989][27935] Avg episode reward: [(0, '-2.062')] [2022-07-13 13:53:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 335028224. Throughput: 0: 9775.4. Samples: 670066788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:53:58,990][27935] Avg episode reward: [(0, '-1.395')] [2022-07-13 13:54:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 335049728. Throughput: 0: 9707.0. Samples: 670121932. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:03,989][27935] Avg episode reward: [(0, '-1.210')] [2022-07-13 13:54:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 335077376. Throughput: 0: 9703.8. Samples: 670151124. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:08,989][27935] Avg episode reward: [(0, '-1.916')] [2022-07-13 13:54:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 335099904. Throughput: 0: 9708.1. Samples: 670210120. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:13,990][27935] Avg episode reward: [(0, '-3.112')] [2022-07-13 13:54:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335124480. Throughput: 0: 9706.0. Samples: 670268880. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:18,990][27935] Avg episode reward: [(0, '-2.548')] [2022-07-13 13:54:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335149056. Throughput: 0: 9698.8. Samples: 670298104. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:23,989][27935] Avg episode reward: [(0, '-4.817')] [2022-07-13 13:54:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 335173632. Throughput: 0: 9700.0. Samples: 670356696. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:28,989][27935] Avg episode reward: [(0, '-5.000')] [2022-07-13 13:54:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 335197184. Throughput: 0: 9700.5. Samples: 670415460. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:33,989][27935] Avg episode reward: [(0, '-5.424')] [2022-07-13 13:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335222784. Throughput: 0: 9694.8. Samples: 670444716. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:38,989][27935] Avg episode reward: [(0, '-3.768')] [2022-07-13 13:54:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 335247360. Throughput: 0: 9708.9. Samples: 670503688. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:43,992][27935] Avg episode reward: [(0, '-2.580')] [2022-07-13 13:54:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 335272960. Throughput: 0: 9792.8. Samples: 670562608. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:48,990][27935] Avg episode reward: [(0, '-3.030')] [2022-07-13 13:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335296512. Throughput: 0: 9795.3. Samples: 670591912. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:53,989][27935] Avg episode reward: [(0, '-3.153')] [2022-07-13 13:54:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 335321088. Throughput: 0: 9792.7. Samples: 670650792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:54:58,989][27935] Avg episode reward: [(0, '-1.636')] [2022-07-13 13:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 335343616. Throughput: 0: 9708.3. Samples: 670705752. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:03,989][27935] Avg episode reward: [(0, '-1.749')] [2022-07-13 13:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 335367168. Throughput: 0: 9712.9. Samples: 670735184. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:08,990][27935] Avg episode reward: [(0, '-1.371')] [2022-07-13 13:55:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 335392768. Throughput: 0: 9721.3. Samples: 670794156. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:13,991][27935] Avg episode reward: [(0, '-2.002')] [2022-07-13 13:55:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 335417344. Throughput: 0: 9729.7. Samples: 670853296. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:18,989][27935] Avg episode reward: [(0, '-2.112')] [2022-07-13 13:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335440896. Throughput: 0: 9728.8. Samples: 670882512. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:23,991][27935] Avg episode reward: [(0, '-2.585')] [2022-07-13 13:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 335466496. Throughput: 0: 9727.7. Samples: 670941436. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:28,991][27935] Avg episode reward: [(0, '-1.566')] [2022-07-13 13:55:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 335490048. Throughput: 0: 9722.0. Samples: 671000100. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:33,991][27935] Avg episode reward: [(0, '-2.108')] [2022-07-13 13:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335514624. Throughput: 0: 9717.0. Samples: 671029176. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:38,991][27935] Avg episode reward: [(0, '-1.531')] [2022-07-13 13:55:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335539200. Throughput: 0: 9704.2. Samples: 671087480. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:43,989][27935] Avg episode reward: [(0, '-1.760')] [2022-07-13 13:55:48,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4846.8, 300 sec: 4852.7). Total num frames: 335563776. Throughput: 0: 9785.7. Samples: 671146128. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:48,992][27935] Avg episode reward: [(0, '-1.598')] [2022-07-13 13:55:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 335586304. Throughput: 0: 9792.4. Samples: 671175844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:53,989][27935] Avg episode reward: [(0, '-0.894')] [2022-07-13 13:55:58,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 335612928. Throughput: 0: 9796.5. Samples: 671234996. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:55:58,990][27935] Avg episode reward: [(0, '-1.389')] [2022-07-13 13:56:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335635456. Throughput: 0: 9705.9. Samples: 671290060. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:56:03,990][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 13:56:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 335660032. Throughput: 0: 9715.6. Samples: 671319712. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 13:56:08,989][27935] Avg episode reward: [(0, '-1.482')] [2022-07-13 13:56:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 335683584. Throughput: 0: 9718.3. Samples: 671378760. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:13,989][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 13:56:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 335709184. Throughput: 0: 9719.9. Samples: 671437496. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:18,989][27935] Avg episode reward: [(0, '-0.868')] [2022-07-13 13:56:23,989][27935] Fps is (10 sec: 4915.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 335732736. Throughput: 0: 9721.0. Samples: 671466624. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:23,990][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 13:56:28,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 335757312. Throughput: 0: 9723.7. Samples: 671525048. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:28,991][27935] Avg episode reward: [(0, '-1.421')] [2022-07-13 13:56:33,989][27935] Fps is (10 sec: 4915.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 335781888. Throughput: 0: 9711.8. Samples: 671583140. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:33,989][27935] Avg episode reward: [(0, '-1.775')] [2022-07-13 13:56:38,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 335806464. Throughput: 0: 9701.3. Samples: 671612404. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:38,989][27935] Avg episode reward: [(0, '-1.477')] [2022-07-13 13:56:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335831040. Throughput: 0: 9699.3. Samples: 671671464. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:43,989][27935] Avg episode reward: [(0, '-2.208')] [2022-07-13 13:56:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4845.8). Total num frames: 335854592. Throughput: 0: 9796.6. Samples: 671730908. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:48,990][27935] Avg episode reward: [(0, '-2.529')] [2022-07-13 13:56:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 335880192. Throughput: 0: 9790.1. Samples: 671760264. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:53,990][27935] Avg episode reward: [(0, '-2.275')] [2022-07-13 13:56:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 335904768. Throughput: 0: 9792.5. Samples: 671819424. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:56:58,990][27935] Avg episode reward: [(0, '-1.481')] [2022-07-13 13:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 335927296. Throughput: 0: 9704.8. Samples: 671874212. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:03,989][27935] Avg episode reward: [(0, '-2.309')] [2022-07-13 13:57:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 335951872. Throughput: 0: 9712.8. Samples: 671903696. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:08,997][27935] Avg episode reward: [(0, '-1.387')] [2022-07-13 13:57:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 335977472. Throughput: 0: 9724.7. Samples: 671962660. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:13,989][27935] Avg episode reward: [(0, '-2.351')] [2022-07-13 13:57:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 336001024. Throughput: 0: 9748.4. Samples: 672021816. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:18,989][27935] Avg episode reward: [(0, '-2.077')] [2022-07-13 13:57:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 336024576. Throughput: 0: 9746.1. Samples: 672050980. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:23,989][27935] Avg episode reward: [(0, '-2.576')] [2022-07-13 13:57:28,990][27935] Fps is (10 sec: 4914.4, 60 sec: 4880.9, 300 sec: 4856.2). Total num frames: 336050176. Throughput: 0: 9745.0. Samples: 672110004. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:28,991][27935] Avg episode reward: [(0, '-2.595')] [2022-07-13 13:57:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 336074752. Throughput: 0: 9714.6. Samples: 672168064. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:33,991][27935] Avg episode reward: [(0, '-1.842')] [2022-07-13 13:57:38,989][27935] Fps is (10 sec: 4916.0, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 336099328. Throughput: 0: 9722.5. Samples: 672197776. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:38,989][27935] Avg episode reward: [(0, '-2.315')] [2022-07-13 13:57:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 336122880. Throughput: 0: 9699.6. Samples: 672255904. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:43,989][27935] Avg episode reward: [(0, '-1.418')] [2022-07-13 13:57:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 336148480. Throughput: 0: 9804.0. Samples: 672315392. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:48,991][27935] Avg episode reward: [(0, '-1.344')] [2022-07-13 13:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 336172032. Throughput: 0: 9811.0. Samples: 672345192. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:53,992][27935] Avg episode reward: [(0, '-1.329')] [2022-07-13 13:57:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 336197632. Throughput: 0: 9808.2. Samples: 672404028. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:57:58,989][27935] Avg episode reward: [(0, '-0.708')] [2022-07-13 13:58:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 336220160. Throughput: 0: 9720.5. Samples: 672459240. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:03,989][27935] Avg episode reward: [(0, '-0.713')] [2022-07-13 13:58:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 336245760. Throughput: 0: 9731.6. Samples: 672488904. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:08,990][27935] Avg episode reward: [(0, '-0.120')] [2022-07-13 13:58:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 336267264. Throughput: 0: 9729.5. Samples: 672547816. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:13,989][27935] Avg episode reward: [(0, '-0.967')] [2022-07-13 13:58:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 336294912. Throughput: 0: 9758.7. Samples: 672607204. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:18,989][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 13:58:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 336318464. Throughput: 0: 9751.7. Samples: 672636600. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:23,989][27935] Avg episode reward: [(0, '-1.076')] [2022-07-13 13:58:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.2, 300 sec: 4866.6). Total num frames: 336343040. Throughput: 0: 9773.3. Samples: 672695704. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:28,989][27935] Avg episode reward: [(0, '-1.365')] [2022-07-13 13:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336366592. Throughput: 0: 9757.7. Samples: 672754488. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:33,989][27935] Avg episode reward: [(0, '-1.777')] [2022-07-13 13:58:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 336392192. Throughput: 0: 9743.5. Samples: 672783648. Policy #0 lag: (min: 0.0, avg: 7.9, max: 19.0) [2022-07-13 13:58:38,989][27935] Avg episode reward: [(0, '-1.463')] [2022-07-13 13:58:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 336417792. Throughput: 0: 9734.4. Samples: 672842076. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:58:43,990][27935] Avg episode reward: [(0, '-1.429')] [2022-07-13 13:58:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 336439296. Throughput: 0: 9792.3. Samples: 672899892. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:58:48,989][27935] Avg episode reward: [(0, '-0.464')] [2022-07-13 13:58:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 336464896. Throughput: 0: 9789.3. Samples: 672929420. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:58:53,989][27935] Avg episode reward: [(0, '-0.307')] [2022-07-13 13:58:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 336489472. Throughput: 0: 9795.0. Samples: 672988592. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:58:58,996][27935] Avg episode reward: [(0, '-0.052')] [2022-07-13 13:59:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 336512000. Throughput: 0: 9696.9. Samples: 673043564. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:03,989][27935] Avg episode reward: [(0, '0.377')] [2022-07-13 13:59:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 336536576. Throughput: 0: 9704.6. Samples: 673073308. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:08,989][27935] Avg episode reward: [(0, '0.296')] [2022-07-13 13:59:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 336561152. Throughput: 0: 9696.4. Samples: 673132044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:13,989][27935] Avg episode reward: [(0, '0.310')] [2022-07-13 13:59:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 336585728. Throughput: 0: 9697.6. Samples: 673190880. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:18,989][27935] Avg episode reward: [(0, '0.006')] [2022-07-13 13:59:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 336610304. Throughput: 0: 9703.8. Samples: 673220320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:23,989][27935] Avg episode reward: [(0, '0.094')] [2022-07-13 13:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 336634880. Throughput: 0: 9707.9. Samples: 673278932. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:28,989][27935] Avg episode reward: [(0, '0.576')] [2022-07-13 13:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336658432. Throughput: 0: 9730.7. Samples: 673337772. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:33,989][27935] Avg episode reward: [(0, '0.654')] [2022-07-13 13:59:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 336684032. Throughput: 0: 9725.3. Samples: 673367060. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:38,989][27935] Avg episode reward: [(0, '0.828')] [2022-07-13 13:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 336707584. Throughput: 0: 9719.7. Samples: 673425980. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:43,989][27935] Avg episode reward: [(0, '0.637')] [2022-07-13 13:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 336732160. Throughput: 0: 9796.8. Samples: 673484420. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:48,989][27935] Avg episode reward: [(0, '0.876')] [2022-07-13 13:59:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336756736. Throughput: 0: 9792.0. Samples: 673513948. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:53,989][27935] Avg episode reward: [(0, '0.450')] [2022-07-13 13:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 336781312. Throughput: 0: 9783.5. Samples: 673572300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 13:59:58,989][27935] Avg episode reward: [(0, '-0.010')] [2022-07-13 14:00:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 336802816. Throughput: 0: 9682.1. Samples: 673626576. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:03,989][27935] Avg episode reward: [(0, '-0.639')] [2022-07-13 14:00:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336828416. Throughput: 0: 9681.0. Samples: 673655964. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:08,989][27935] Avg episode reward: [(0, '-0.853')] [2022-07-13 14:00:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336852992. Throughput: 0: 9678.7. Samples: 673714476. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:13,990][27935] Avg episode reward: [(0, '-1.009')] [2022-07-13 14:00:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 336875520. Throughput: 0: 9677.0. Samples: 673773236. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:18,990][27935] Avg episode reward: [(0, '-0.484')] [2022-07-13 14:00:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336902144. Throughput: 0: 9678.2. Samples: 673802580. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:23,991][27935] Avg episode reward: [(0, '-0.719')] [2022-07-13 14:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 336924672. Throughput: 0: 9669.5. Samples: 673861108. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:28,991][27935] Avg episode reward: [(0, '-0.748')] [2022-07-13 14:00:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 336950272. Throughput: 0: 9664.4. Samples: 673919316. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:33,989][27935] Avg episode reward: [(0, '-0.071')] [2022-07-13 14:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 336974848. Throughput: 0: 9657.3. Samples: 673948528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:38,990][27935] Avg episode reward: [(0, '0.024')] [2022-07-13 14:00:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 336997376. Throughput: 0: 9677.1. Samples: 674007772. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:43,990][27935] Avg episode reward: [(0, '-0.309')] [2022-07-13 14:00:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 337024000. Throughput: 0: 9771.6. Samples: 674066300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:48,990][27935] Avg episode reward: [(0, '-0.299')] [2022-07-13 14:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 337047552. Throughput: 0: 9778.0. Samples: 674095972. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:53,989][27935] Avg episode reward: [(0, '-0.507')] [2022-07-13 14:00:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 337073152. Throughput: 0: 9785.9. Samples: 674154840. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:00:58,989][27935] Avg episode reward: [(0, '-0.433')] [2022-07-13 14:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337094656. Throughput: 0: 9706.7. Samples: 674210036. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:01:03,991][27935] Avg episode reward: [(0, '0.149')] [2022-07-13 14:01:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 337121280. Throughput: 0: 9706.9. Samples: 674239392. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:01:08,990][27935] Avg episode reward: [(0, '0.258')] [2022-07-13 14:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 337143808. Throughput: 0: 9719.1. Samples: 674298468. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:13,989][27935] Avg episode reward: [(0, '-0.840')] [2022-07-13 14:01:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 337168384. Throughput: 0: 9733.9. Samples: 674357344. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:18,989][27935] Avg episode reward: [(0, '-0.693')] [2022-07-13 14:01:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 337192960. Throughput: 0: 9729.1. Samples: 674386336. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:23,989][27935] Avg episode reward: [(0, '-0.517')] [2022-07-13 14:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 337218560. Throughput: 0: 9724.0. Samples: 674445352. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:28,989][27935] Avg episode reward: [(0, '-0.094')] [2022-07-13 14:01:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 337242112. Throughput: 0: 9717.0. Samples: 674503564. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:33,989][27935] Avg episode reward: [(0, '0.159')] [2022-07-13 14:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 337266688. Throughput: 0: 9704.7. Samples: 674532684. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:38,989][27935] Avg episode reward: [(0, '-0.410')] [2022-07-13 14:01:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 337290240. Throughput: 0: 9720.4. Samples: 674592260. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:43,989][27935] Avg episode reward: [(0, '-0.933')] [2022-07-13 14:01:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 337314816. Throughput: 0: 9788.5. Samples: 674650520. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:48,989][27935] Avg episode reward: [(0, '-0.341')] [2022-07-13 14:01:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 337341440. Throughput: 0: 9797.8. Samples: 674680292. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:53,989][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 14:01:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 337364992. Throughput: 0: 9788.0. Samples: 674738928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:01:58,989][27935] Avg episode reward: [(0, '-1.067')] [2022-07-13 14:02:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337386496. Throughput: 0: 9700.0. Samples: 674793844. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:03,991][27935] Avg episode reward: [(0, '-1.756')] [2022-07-13 14:02:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 337411072. Throughput: 0: 9710.7. Samples: 674823316. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:08,990][27935] Avg episode reward: [(0, '-1.500')] [2022-07-13 14:02:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337435648. Throughput: 0: 9707.5. Samples: 674882188. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:13,989][27935] Avg episode reward: [(0, '-1.297')] [2022-07-13 14:02:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 337461248. Throughput: 0: 9708.4. Samples: 674940440. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:18,989][27935] Avg episode reward: [(0, '-1.326')] [2022-07-13 14:02:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 337485824. Throughput: 0: 9712.2. Samples: 674969732. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:23,989][27935] Avg episode reward: [(0, '-0.543')] [2022-07-13 14:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 337509376. Throughput: 0: 9693.1. Samples: 675028448. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:28,989][27935] Avg episode reward: [(0, '0.069')] [2022-07-13 14:02:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337533952. Throughput: 0: 9704.5. Samples: 675087224. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:33,989][27935] Avg episode reward: [(0, '-0.371')] [2022-07-13 14:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 337557504. Throughput: 0: 9687.0. Samples: 675116208. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:38,989][27935] Avg episode reward: [(0, '0.246')] [2022-07-13 14:02:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 337584128. Throughput: 0: 9676.3. Samples: 675174360. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:43,989][27935] Avg episode reward: [(0, '0.034')] [2022-07-13 14:02:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 337607680. Throughput: 0: 9772.7. Samples: 675233616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:48,989][27935] Avg episode reward: [(0, '0.208')] [2022-07-13 14:02:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 337631232. Throughput: 0: 9772.5. Samples: 675263076. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:53,989][27935] Avg episode reward: [(0, '0.577')] [2022-07-13 14:02:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 337655808. Throughput: 0: 9770.1. Samples: 675321840. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:02:58,989][27935] Avg episode reward: [(0, '0.591')] [2022-07-13 14:03:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 337679360. Throughput: 0: 9698.5. Samples: 675376872. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:03,989][27935] Avg episode reward: [(0, '0.758')] [2022-07-13 14:03:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 337702912. Throughput: 0: 9704.1. Samples: 675406416. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:08,989][27935] Avg episode reward: [(0, '0.993')] [2022-07-13 14:03:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 337727488. Throughput: 0: 9712.4. Samples: 675465508. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:13,989][27935] Avg episode reward: [(0, '1.204')] [2022-07-13 14:03:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 337754112. Throughput: 0: 9714.4. Samples: 675524372. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:18,989][27935] Avg episode reward: [(0, '0.859')] [2022-07-13 14:03:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337777664. Throughput: 0: 9729.2. Samples: 675554024. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:23,989][27935] Avg episode reward: [(0, '1.058')] [2022-07-13 14:03:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 337800192. Throughput: 0: 9736.4. Samples: 675612496. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:28,989][27935] Avg episode reward: [(0, '1.123')] [2022-07-13 14:03:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 337825792. Throughput: 0: 9717.1. Samples: 675670884. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:33,989][27935] Avg episode reward: [(0, '0.235')] [2022-07-13 14:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 337849344. Throughput: 0: 9717.8. Samples: 675700376. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 14:03:38,990][27935] Avg episode reward: [(0, '0.154')] [2022-07-13 14:03:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 337875968. Throughput: 0: 9726.1. Samples: 675759512. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:03:43,989][27935] Avg episode reward: [(0, '0.024')] [2022-07-13 14:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 337899520. Throughput: 0: 9808.4. Samples: 675818248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:03:48,989][27935] Avg episode reward: [(0, '-0.231')] [2022-07-13 14:03:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 337924096. Throughput: 0: 9809.5. Samples: 675847844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:03:53,989][27935] Avg episode reward: [(0, '0.420')] [2022-07-13 14:03:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 337948672. Throughput: 0: 9807.4. Samples: 675906840. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:03:58,990][27935] Avg episode reward: [(0, '0.384')] [2022-07-13 14:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 337970176. Throughput: 0: 9719.7. Samples: 675961760. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:03,992][27935] Avg episode reward: [(0, '0.541')] [2022-07-13 14:04:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 337996800. Throughput: 0: 9720.0. Samples: 675991424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:08,990][27935] Avg episode reward: [(0, '1.153')] [2022-07-13 14:04:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 338020352. Throughput: 0: 9724.4. Samples: 676050096. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:13,990][27935] Avg episode reward: [(0, '1.170')] [2022-07-13 14:04:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 338043904. Throughput: 0: 9735.2. Samples: 676108968. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:18,991][27935] Avg episode reward: [(0, '1.646')] [2022-07-13 14:04:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338069504. Throughput: 0: 9734.8. Samples: 676138440. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:23,989][27935] Avg episode reward: [(0, '1.730')] [2022-07-13 14:04:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 338094080. Throughput: 0: 9725.0. Samples: 676197136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:28,989][27935] Avg episode reward: [(0, '0.717')] [2022-07-13 14:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 338118656. Throughput: 0: 9726.5. Samples: 676255940. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:33,989][27935] Avg episode reward: [(0, '0.634')] [2022-07-13 14:04:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 338142208. Throughput: 0: 9729.0. Samples: 676285648. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:38,989][27935] Avg episode reward: [(0, '-0.119')] [2022-07-13 14:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 338167808. Throughput: 0: 9736.2. Samples: 676344968. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:43,989][27935] Avg episode reward: [(0, '0.053')] [2022-07-13 14:04:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338191360. Throughput: 0: 9808.0. Samples: 676403120. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:48,990][27935] Avg episode reward: [(0, '0.010')] [2022-07-13 14:04:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338215936. Throughput: 0: 9782.0. Samples: 676431616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:53,989][27935] Avg episode reward: [(0, '0.088')] [2022-07-13 14:04:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 338239488. Throughput: 0: 9773.2. Samples: 676489888. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:04:58,989][27935] Avg episode reward: [(0, '-0.387')] [2022-07-13 14:05:03,990][27935] Fps is (10 sec: 4710.0, 60 sec: 4881.0, 300 sec: 4863.1). Total num frames: 338263040. Throughput: 0: 9680.3. Samples: 676544592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:03,990][27935] Avg episode reward: [(0, '-0.436')] [2022-07-13 14:05:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338287616. Throughput: 0: 9682.4. Samples: 676574148. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:08,995][27935] Avg episode reward: [(0, '-0.278')] [2022-07-13 14:05:13,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 338311168. Throughput: 0: 9688.1. Samples: 676633100. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:13,989][27935] Avg episode reward: [(0, '-0.579')] [2022-07-13 14:05:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 338335744. Throughput: 0: 9693.7. Samples: 676692156. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:18,989][27935] Avg episode reward: [(0, '-0.694')] [2022-07-13 14:05:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 338362368. Throughput: 0: 9689.8. Samples: 676721688. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:23,989][27935] Avg episode reward: [(0, '-2.007')] [2022-07-13 14:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338384896. Throughput: 0: 9676.4. Samples: 676780408. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:28,989][27935] Avg episode reward: [(0, '-1.489')] [2022-07-13 14:05:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338409472. Throughput: 0: 9678.9. Samples: 676838672. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:33,989][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 14:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 338434048. Throughput: 0: 9698.0. Samples: 676868028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:38,989][27935] Avg episode reward: [(0, '-0.681')] [2022-07-13 14:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338458624. Throughput: 0: 9714.3. Samples: 676927032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:43,989][27935] Avg episode reward: [(0, '-0.681')] [2022-07-13 14:05:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338482176. Throughput: 0: 9801.4. Samples: 676985648. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:48,990][27935] Avg episode reward: [(0, '-0.425')] [2022-07-13 14:05:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338507776. Throughput: 0: 9800.6. Samples: 677015176. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:53,991][27935] Avg episode reward: [(0, '0.560')] [2022-07-13 14:05:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 338532352. Throughput: 0: 9792.3. Samples: 677073752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:05:58,989][27935] Avg episode reward: [(0, '0.554')] [2022-07-13 14:06:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.1, 300 sec: 4859.7). Total num frames: 338554880. Throughput: 0: 9698.2. Samples: 677128576. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:06:03,989][27935] Avg episode reward: [(0, '0.512')] [2022-07-13 14:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338578432. Throughput: 0: 9696.7. Samples: 677158040. Policy #0 lag: (min: 0.0, avg: 8.9, max: 22.0) [2022-07-13 14:06:08,989][27935] Avg episode reward: [(0, '0.227')] [2022-07-13 14:06:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338603008. Throughput: 0: 9693.2. Samples: 677216604. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:13,989][27935] Avg episode reward: [(0, '0.090')] [2022-07-13 14:06:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338627584. Throughput: 0: 9702.6. Samples: 677275288. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:18,989][27935] Avg episode reward: [(0, '0.019')] [2022-07-13 14:06:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 338652160. Throughput: 0: 9705.7. Samples: 677304784. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:23,989][27935] Avg episode reward: [(0, '0.379')] [2022-07-13 14:06:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338676736. Throughput: 0: 9697.2. Samples: 677363404. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:28,989][27935] Avg episode reward: [(0, '0.517')] [2022-07-13 14:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 338700288. Throughput: 0: 9690.1. Samples: 677421704. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:33,989][27935] Avg episode reward: [(0, '0.439')] [2022-07-13 14:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 338725888. Throughput: 0: 9687.8. Samples: 677451128. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:38,989][27935] Avg episode reward: [(0, '-0.403')] [2022-07-13 14:06:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338749440. Throughput: 0: 9697.9. Samples: 677510156. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:43,989][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 14:06:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 338776064. Throughput: 0: 9784.3. Samples: 677568868. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:48,989][27935] Avg episode reward: [(0, '-1.822')] [2022-07-13 14:06:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338799616. Throughput: 0: 9783.7. Samples: 677598308. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:53,991][27935] Avg episode reward: [(0, '-2.192')] [2022-07-13 14:06:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 338823168. Throughput: 0: 9785.4. Samples: 677656948. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:06:58,989][27935] Avg episode reward: [(0, '-2.308')] [2022-07-13 14:07:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 338845696. Throughput: 0: 9699.6. Samples: 677711772. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:03,989][27935] Avg episode reward: [(0, '-2.032')] [2022-07-13 14:07:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 338870272. Throughput: 0: 9688.5. Samples: 677740768. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:08,989][27935] Avg episode reward: [(0, '-1.378')] [2022-07-13 14:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 338894848. Throughput: 0: 9691.6. Samples: 677799528. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:13,989][27935] Avg episode reward: [(0, '-1.208')] [2022-07-13 14:07:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 338919424. Throughput: 0: 9688.3. Samples: 677857676. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:18,989][27935] Avg episode reward: [(0, '-1.250')] [2022-07-13 14:07:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 338942976. Throughput: 0: 9680.1. Samples: 677886732. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:23,989][27935] Avg episode reward: [(0, '-0.682')] [2022-07-13 14:07:28,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 338967552. Throughput: 0: 9667.1. Samples: 677945176. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:28,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 14:07:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 338991104. Throughput: 0: 9649.8. Samples: 678003108. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:33,990][27935] Avg episode reward: [(0, '-0.692')] [2022-07-13 14:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 339016704. Throughput: 0: 9641.5. Samples: 678032176. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:38,989][27935] Avg episode reward: [(0, '-0.438')] [2022-07-13 14:07:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 339040256. Throughput: 0: 9621.5. Samples: 678089916. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:43,989][27935] Avg episode reward: [(0, '-0.010')] [2022-07-13 14:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4859.7). Total num frames: 339064832. Throughput: 0: 9706.3. Samples: 678148556. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:48,989][27935] Avg episode reward: [(0, '-0.888')] [2022-07-13 14:07:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 339088384. Throughput: 0: 9710.5. Samples: 678177740. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:53,991][27935] Avg episode reward: [(0, '-0.106')] [2022-07-13 14:07:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 339113984. Throughput: 0: 9713.2. Samples: 678236620. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:07:58,991][27935] Avg episode reward: [(0, '-0.089')] [2022-07-13 14:08:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 339136512. Throughput: 0: 9631.0. Samples: 678291068. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:03,989][27935] Avg episode reward: [(0, '-0.648')] [2022-07-13 14:08:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 339160064. Throughput: 0: 9635.6. Samples: 678320332. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:08,992][27935] Avg episode reward: [(0, '-0.630')] [2022-07-13 14:08:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 339184640. Throughput: 0: 9644.3. Samples: 678379172. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:13,989][27935] Avg episode reward: [(0, '-0.671')] [2022-07-13 14:08:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 339209216. Throughput: 0: 9661.2. Samples: 678437864. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:18,989][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 14:08:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 339233792. Throughput: 0: 9673.5. Samples: 678467484. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:23,989][27935] Avg episode reward: [(0, '-0.128')] [2022-07-13 14:08:28,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4829.8, 300 sec: 4852.7). Total num frames: 339257344. Throughput: 0: 9692.5. Samples: 678526092. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:28,991][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 14:08:33,990][27935] Fps is (10 sec: 4914.7, 60 sec: 4863.9, 300 sec: 4859.6). Total num frames: 339282944. Throughput: 0: 9686.8. Samples: 678584472. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:33,990][27935] Avg episode reward: [(0, '-0.190')] [2022-07-13 14:08:38,989][27935] Fps is (10 sec: 4915.6, 60 sec: 4829.8, 300 sec: 4849.2). Total num frames: 339306496. Throughput: 0: 9684.4. Samples: 678613544. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:38,990][27935] Avg episode reward: [(0, '-0.118')] [2022-07-13 14:08:43,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 339331072. Throughput: 0: 9678.1. Samples: 678672132. Policy #0 lag: (min: 0.0, avg: 7.8, max: 18.0) [2022-07-13 14:08:43,989][27935] Avg episode reward: [(0, '-0.315')] [2022-07-13 14:08:48,989][27935] Fps is (10 sec: 4915.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 339355648. Throughput: 0: 9769.6. Samples: 678730700. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:08:48,989][27935] Avg episode reward: [(0, '-0.096')] [2022-07-13 14:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 339380224. Throughput: 0: 9775.6. Samples: 678760232. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:08:53,990][27935] Avg episode reward: [(0, '0.415')] [2022-07-13 14:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 339405824. Throughput: 0: 9776.5. Samples: 678819112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:08:58,989][27935] Avg episode reward: [(0, '0.753')] [2022-07-13 14:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 339427328. Throughput: 0: 9682.3. Samples: 678873568. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:03,989][27935] Avg episode reward: [(0, '-0.230')] [2022-07-13 14:09:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 339450880. Throughput: 0: 9668.8. Samples: 678902580. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:08,991][27935] Avg episode reward: [(0, '-0.297')] [2022-07-13 14:09:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 339475456. Throughput: 0: 9674.5. Samples: 678961432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:13,989][27935] Avg episode reward: [(0, '-0.363')] [2022-07-13 14:09:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 339501056. Throughput: 0: 9671.9. Samples: 679019700. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:18,989][27935] Avg episode reward: [(0, '-0.314')] [2022-07-13 14:09:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 339523584. Throughput: 0: 9669.2. Samples: 679048656. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:23,989][27935] Avg episode reward: [(0, '-1.765')] [2022-07-13 14:09:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.1, 300 sec: 4849.2). Total num frames: 339549184. Throughput: 0: 9657.0. Samples: 679106696. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:28,989][27935] Avg episode reward: [(0, '-2.435')] [2022-07-13 14:09:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 339572736. Throughput: 0: 9654.9. Samples: 679165172. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:33,989][27935] Avg episode reward: [(0, '-1.353')] [2022-07-13 14:09:38,991][27935] Fps is (10 sec: 4709.1, 60 sec: 4829.7, 300 sec: 4842.3). Total num frames: 339596288. Throughput: 0: 9645.7. Samples: 679194316. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:38,992][27935] Avg episode reward: [(0, '-1.331')] [2022-07-13 14:09:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 339621888. Throughput: 0: 9634.4. Samples: 679252660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:43,989][27935] Avg episode reward: [(0, '-0.558')] [2022-07-13 14:09:48,989][27935] Fps is (10 sec: 5018.9, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 339646464. Throughput: 0: 9719.2. Samples: 679310932. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:48,989][27935] Avg episode reward: [(0, '-0.978')] [2022-07-13 14:09:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 339670016. Throughput: 0: 9725.7. Samples: 679340236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:53,991][27935] Avg episode reward: [(0, '-1.213')] [2022-07-13 14:09:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 339694592. Throughput: 0: 9714.2. Samples: 679398572. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:09:58,991][27935] Avg episode reward: [(0, '-0.586')] [2022-07-13 14:10:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 339717120. Throughput: 0: 9633.2. Samples: 679453192. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:03,989][27935] Avg episode reward: [(0, '0.323')] [2022-07-13 14:10:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 339740672. Throughput: 0: 9632.4. Samples: 679482116. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:08,989][27935] Avg episode reward: [(0, '-0.387')] [2022-07-13 14:10:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 339766272. Throughput: 0: 9626.0. Samples: 679539868. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:13,989][27935] Avg episode reward: [(0, '-0.648')] [2022-07-13 14:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 339788800. Throughput: 0: 9617.6. Samples: 679597964. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:18,990][27935] Avg episode reward: [(0, '-0.689')] [2022-07-13 14:10:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 339812352. Throughput: 0: 9618.1. Samples: 679627104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:23,990][27935] Avg episode reward: [(0, '-0.216')] [2022-07-13 14:10:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 339837952. Throughput: 0: 9618.4. Samples: 679685488. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:28,991][27935] Avg episode reward: [(0, '-0.168')] [2022-07-13 14:10:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 339862528. Throughput: 0: 8973.3. Samples: 679714732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:33,989][27935] Avg episode reward: [(0, '-0.314')] [2022-07-13 14:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4838.8). Total num frames: 339886080. Throughput: 0: 9617.8. Samples: 679773036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:38,990][27935] Avg episode reward: [(0, '-0.533')] [2022-07-13 14:10:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 339910656. Throughput: 0: 9609.9. Samples: 679831016. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:43,990][27935] Avg episode reward: [(0, '-0.696')] [2022-07-13 14:10:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 339935232. Throughput: 0: 9046.3. Samples: 679860276. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:48,992][27935] Avg episode reward: [(0, '-0.391')] [2022-07-13 14:10:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 339959808. Throughput: 0: 9694.8. Samples: 679918380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:53,989][27935] Avg episode reward: [(0, '-0.108')] [2022-07-13 14:10:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 339982336. Throughput: 0: 9670.3. Samples: 679975032. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:10:58,989][27935] Avg episode reward: [(0, '-0.351')] [2022-07-13 14:11:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 340003840. Throughput: 0: 9587.3. Samples: 680029392. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:11:03,989][27935] Avg episode reward: [(0, '-0.229')] [2022-07-13 14:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 340029440. Throughput: 0: 9585.7. Samples: 680058460. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:11:08,989][27935] Avg episode reward: [(0, '0.134')] [2022-07-13 14:11:13,989][27935] Fps is (10 sec: 5017.3, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 340054016. Throughput: 0: 9580.9. Samples: 680116636. Policy #0 lag: (min: 0.0, avg: 8.8, max: 19.0) [2022-07-13 14:11:13,990][27935] Avg episode reward: [(0, '-0.154')] [2022-07-13 14:11:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 340078592. Throughput: 0: 10214.9. Samples: 680174404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:18,989][27935] Avg episode reward: [(0, '-0.736')] [2022-07-13 14:11:23,989][27935] Fps is (10 sec: 4710.7, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 340101120. Throughput: 0: 9556.6. Samples: 680203084. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:23,989][27935] Avg episode reward: [(0, '-1.160')] [2022-07-13 14:11:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 340125696. Throughput: 0: 9561.6. Samples: 680261288. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:28,989][27935] Avg episode reward: [(0, '-0.944')] [2022-07-13 14:11:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 340151296. Throughput: 0: 10199.5. Samples: 680319252. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:33,989][27935] Avg episode reward: [(0, '-0.729')] [2022-07-13 14:11:38,991][27935] Fps is (10 sec: 4811.7, 60 sec: 4795.6, 300 sec: 4828.4). Total num frames: 340173824. Throughput: 0: 9558.0. Samples: 680348512. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:38,992][27935] Avg episode reward: [(0, '-1.533')] [2022-07-13 14:11:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 340198400. Throughput: 0: 9591.7. Samples: 680406660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:43,989][27935] Avg episode reward: [(0, '-1.484')] [2022-07-13 14:11:48,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 340222976. Throughput: 0: 9690.9. Samples: 680465484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:48,991][27935] Avg episode reward: [(0, '-0.051')] [2022-07-13 14:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 340247552. Throughput: 0: 9685.4. Samples: 680494304. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:53,991][27935] Avg episode reward: [(0, '0.650')] [2022-07-13 14:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 340272128. Throughput: 0: 9696.9. Samples: 680552992. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:11:58,990][27935] Avg episode reward: [(0, '0.435')] [2022-07-13 14:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 340294656. Throughput: 0: 9624.8. Samples: 680607520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:03,991][27935] Avg episode reward: [(0, '-1.897')] [2022-07-13 14:12:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 340317184. Throughput: 0: 9628.6. Samples: 680636372. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:08,989][27935] Avg episode reward: [(0, '-1.968')] [2022-07-13 14:12:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 340342784. Throughput: 0: 9632.9. Samples: 680694768. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:13,989][27935] Avg episode reward: [(0, '-1.369')] [2022-07-13 14:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 340366336. Throughput: 0: 9645.7. Samples: 680753308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:18,989][27935] Avg episode reward: [(0, '-2.073')] [2022-07-13 14:12:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 340390912. Throughput: 0: 9642.3. Samples: 680782396. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:23,990][27935] Avg episode reward: [(0, '-2.108')] [2022-07-13 14:12:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 340414464. Throughput: 0: 9646.7. Samples: 680840760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:28,989][27935] Avg episode reward: [(0, '-2.113')] [2022-07-13 14:12:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 340440064. Throughput: 0: 9626.3. Samples: 680898668. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:33,990][27935] Avg episode reward: [(0, '-2.047')] [2022-07-13 14:12:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.1, 300 sec: 4828.4). Total num frames: 340464640. Throughput: 0: 9639.9. Samples: 680928100. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:38,989][27935] Avg episode reward: [(0, '-0.306')] [2022-07-13 14:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 340488192. Throughput: 0: 9621.2. Samples: 680985948. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:43,989][27935] Avg episode reward: [(0, '-0.704')] [2022-07-13 14:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 340512768. Throughput: 0: 9709.5. Samples: 681044448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:48,990][27935] Avg episode reward: [(0, '-0.630')] [2022-07-13 14:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 340537344. Throughput: 0: 9711.7. Samples: 681073400. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:53,989][27935] Avg episode reward: [(0, '-0.234')] [2022-07-13 14:12:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 340560896. Throughput: 0: 9721.1. Samples: 681132216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:12:58,990][27935] Avg episode reward: [(0, '-0.760')] [2022-07-13 14:13:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 340582400. Throughput: 0: 9629.5. Samples: 681186636. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:03,991][27935] Avg episode reward: [(0, '-0.830')] [2022-07-13 14:13:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 340609024. Throughput: 0: 9626.6. Samples: 681215592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:08,989][27935] Avg episode reward: [(0, '-0.399')] [2022-07-13 14:13:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 340632576. Throughput: 0: 9623.8. Samples: 681273832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:13,990][27935] Avg episode reward: [(0, '-0.361')] [2022-07-13 14:13:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 340656128. Throughput: 0: 9641.1. Samples: 681332520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:18,989][27935] Avg episode reward: [(0, '0.146')] [2022-07-13 14:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 340680704. Throughput: 0: 9636.1. Samples: 681361724. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:23,989][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 14:13:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 340705280. Throughput: 0: 9656.6. Samples: 681420496. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:28,989][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 14:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 340729856. Throughput: 0: 9656.7. Samples: 681479000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:33,989][27935] Avg episode reward: [(0, '0.299')] [2022-07-13 14:13:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 340753408. Throughput: 0: 9660.9. Samples: 681508140. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:38,990][27935] Avg episode reward: [(0, '0.245')] [2022-07-13 14:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 340779008. Throughput: 0: 9647.1. Samples: 681566336. Policy #0 lag: (min: 0.0, avg: 8.6, max: 18.0) [2022-07-13 14:13:43,991][27935] Avg episode reward: [(0, '0.034')] [2022-07-13 14:13:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4825.0). Total num frames: 340803584. Throughput: 0: 9733.1. Samples: 681624624. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:13:48,990][27935] Avg episode reward: [(0, '-0.476')] [2022-07-13 14:13:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 340827136. Throughput: 0: 9742.2. Samples: 681653992. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:13:53,990][27935] Avg episode reward: [(0, '-1.450')] [2022-07-13 14:13:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 340851712. Throughput: 0: 9734.9. Samples: 681711904. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:13:58,989][27935] Avg episode reward: [(0, '-1.275')] [2022-07-13 14:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 340873216. Throughput: 0: 9640.7. Samples: 681766352. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:03,989][27935] Avg episode reward: [(0, '-1.397')] [2022-07-13 14:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 340897792. Throughput: 0: 9638.3. Samples: 681795448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:08,989][27935] Avg episode reward: [(0, '-2.123')] [2022-07-13 14:14:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 340920320. Throughput: 0: 9629.1. Samples: 681853808. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:13,989][27935] Avg episode reward: [(0, '-1.851')] [2022-07-13 14:14:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 340946944. Throughput: 0: 9631.2. Samples: 681912404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:18,989][27935] Avg episode reward: [(0, '-3.605')] [2022-07-13 14:14:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 340971520. Throughput: 0: 9639.0. Samples: 681941896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:23,989][27935] Avg episode reward: [(0, '-3.329')] [2022-07-13 14:14:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 340995072. Throughput: 0: 9643.1. Samples: 682000276. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:28,989][27935] Avg episode reward: [(0, '-3.472')] [2022-07-13 14:14:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 341019648. Throughput: 0: 9646.9. Samples: 682058736. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:33,990][27935] Avg episode reward: [(0, '-3.132')] [2022-07-13 14:14:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 341044224. Throughput: 0: 9639.7. Samples: 682087780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:38,989][27935] Avg episode reward: [(0, '-2.698')] [2022-07-13 14:14:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 341067776. Throughput: 0: 9658.9. Samples: 682146556. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:43,990][27935] Avg episode reward: [(0, '-2.749')] [2022-07-13 14:14:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 341093376. Throughput: 0: 9745.1. Samples: 682204880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:48,989][27935] Avg episode reward: [(0, '-2.887')] [2022-07-13 14:14:53,990][27935] Fps is (10 sec: 4812.4, 60 sec: 4812.7, 300 sec: 4818.0). Total num frames: 341115904. Throughput: 0: 9746.7. Samples: 682234056. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:53,990][27935] Avg episode reward: [(0, '-1.501')] [2022-07-13 14:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 341141504. Throughput: 0: 9751.7. Samples: 682292632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:14:59,000][27935] Avg episode reward: [(0, '-2.894')] [2022-07-13 14:15:03,989][27935] Fps is (10 sec: 4915.6, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 341165056. Throughput: 0: 9663.7. Samples: 682347272. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:03,989][27935] Avg episode reward: [(0, '-2.336')] [2022-07-13 14:15:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 341188608. Throughput: 0: 9657.1. Samples: 682376464. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:08,989][27935] Avg episode reward: [(0, '-2.316')] [2022-07-13 14:15:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 341213184. Throughput: 0: 9668.8. Samples: 682435372. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:13,989][27935] Avg episode reward: [(0, '-2.311')] [2022-07-13 14:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 341236736. Throughput: 0: 9671.2. Samples: 682493940. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:18,989][27935] Avg episode reward: [(0, '-2.782')] [2022-07-13 14:15:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 341261312. Throughput: 0: 9668.7. Samples: 682522872. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:23,989][27935] Avg episode reward: [(0, '-2.327')] [2022-07-13 14:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 341285888. Throughput: 0: 9664.5. Samples: 682581460. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:28,989][27935] Avg episode reward: [(0, '-2.254')] [2022-07-13 14:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 341309440. Throughput: 0: 9671.0. Samples: 682640076. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:33,991][27935] Avg episode reward: [(0, '-1.496')] [2022-07-13 14:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 341335040. Throughput: 0: 9670.5. Samples: 682669220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:38,989][27935] Avg episode reward: [(0, '-1.049')] [2022-07-13 14:15:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 341360640. Throughput: 0: 9675.7. Samples: 682728040. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:43,989][27935] Avg episode reward: [(0, '-1.194')] [2022-07-13 14:15:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 341384192. Throughput: 0: 9763.5. Samples: 682786628. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:48,989][27935] Avg episode reward: [(0, '-2.125')] [2022-07-13 14:15:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.1, 300 sec: 4831.9). Total num frames: 341407744. Throughput: 0: 9763.5. Samples: 682815820. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:53,989][27935] Avg episode reward: [(0, '-3.223')] [2022-07-13 14:15:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 341431296. Throughput: 0: 9747.5. Samples: 682874008. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:15:58,989][27935] Avg episode reward: [(0, '-3.284')] [2022-07-13 14:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 341454848. Throughput: 0: 9653.1. Samples: 682928328. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:16:03,989][27935] Avg episode reward: [(0, '-3.181')] [2022-07-13 14:16:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 341479424. Throughput: 0: 9661.1. Samples: 682957620. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:16:08,989][27935] Avg episode reward: [(0, '-2.515')] [2022-07-13 14:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 341502976. Throughput: 0: 9651.9. Samples: 683015796. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:16:13,991][27935] Avg episode reward: [(0, '-2.549')] [2022-07-13 14:16:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 341526528. Throughput: 0: 9638.4. Samples: 683073804. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:18,989][27935] Avg episode reward: [(0, '-2.680')] [2022-07-13 14:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 341551104. Throughput: 0: 9636.9. Samples: 683102880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:23,997][27935] Avg episode reward: [(0, '-1.973')] [2022-07-13 14:16:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 341575680. Throughput: 0: 9613.3. Samples: 683160640. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:28,990][27935] Avg episode reward: [(0, '-1.105')] [2022-07-13 14:16:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 341599232. Throughput: 0: 9594.8. Samples: 683218396. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:33,989][27935] Avg episode reward: [(0, '-0.444')] [2022-07-13 14:16:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 341623808. Throughput: 0: 9600.3. Samples: 683247832. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:38,989][27935] Avg episode reward: [(0, '-1.298')] [2022-07-13 14:16:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 341647360. Throughput: 0: 9602.8. Samples: 683306132. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:43,989][27935] Avg episode reward: [(0, '-0.851')] [2022-07-13 14:16:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 341672960. Throughput: 0: 9691.1. Samples: 683364428. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:48,989][27935] Avg episode reward: [(0, '-1.597')] [2022-07-13 14:16:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 341697536. Throughput: 0: 9689.4. Samples: 683393644. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:53,989][27935] Avg episode reward: [(0, '-0.741')] [2022-07-13 14:16:58,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 341719040. Throughput: 0: 9667.5. Samples: 683450836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:16:58,990][27935] Avg episode reward: [(0, '-1.295')] [2022-07-13 14:17:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 341742592. Throughput: 0: 9556.7. Samples: 683503856. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:03,991][27935] Avg episode reward: [(0, '-2.142')] [2022-07-13 14:17:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 341766144. Throughput: 0: 9552.0. Samples: 683532720. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:08,989][27935] Avg episode reward: [(0, '-2.097')] [2022-07-13 14:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 341790720. Throughput: 0: 9560.0. Samples: 683590840. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:13,991][27935] Avg episode reward: [(0, '-1.724')] [2022-07-13 14:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 341815296. Throughput: 0: 9572.6. Samples: 683649164. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:18,989][27935] Avg episode reward: [(0, '-1.496')] [2022-07-13 14:17:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 341838848. Throughput: 0: 9565.4. Samples: 683678276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:23,991][27935] Avg episode reward: [(0, '-1.825')] [2022-07-13 14:17:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 341862400. Throughput: 0: 9564.3. Samples: 683736524. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:28,990][27935] Avg episode reward: [(0, '-2.328')] [2022-07-13 14:17:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 341886976. Throughput: 0: 9570.1. Samples: 683795084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:33,989][27935] Avg episode reward: [(0, '-1.503')] [2022-07-13 14:17:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 341912576. Throughput: 0: 9572.9. Samples: 683824424. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:38,989][27935] Avg episode reward: [(0, '-0.242')] [2022-07-13 14:17:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 341936128. Throughput: 0: 9579.0. Samples: 683881888. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:43,990][27935] Avg episode reward: [(0, '-0.277')] [2022-07-13 14:17:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 341960704. Throughput: 0: 9701.1. Samples: 683940404. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:48,991][27935] Avg episode reward: [(0, '-0.252')] [2022-07-13 14:17:54,000][27935] Fps is (10 sec: 4807.2, 60 sec: 4777.7, 300 sec: 4824.8). Total num frames: 341984256. Throughput: 0: 9703.1. Samples: 683969472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:54,001][27935] Avg episode reward: [(0, '0.682')] [2022-07-13 14:17:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 342008832. Throughput: 0: 9709.2. Samples: 684027752. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:17:58,989][27935] Avg episode reward: [(0, '0.824')] [2022-07-13 14:18:03,989][27935] Fps is (10 sec: 4715.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342031360. Throughput: 0: 9625.8. Samples: 684082324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:03,989][27935] Avg episode reward: [(0, '0.745')] [2022-07-13 14:18:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342054912. Throughput: 0: 9620.8. Samples: 684111212. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:08,989][27935] Avg episode reward: [(0, '0.580')] [2022-07-13 14:18:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 342079488. Throughput: 0: 9616.0. Samples: 684169244. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:13,989][27935] Avg episode reward: [(0, '0.484')] [2022-07-13 14:18:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 342105088. Throughput: 0: 9609.4. Samples: 684227508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:18,989][27935] Avg episode reward: [(0, '0.727')] [2022-07-13 14:18:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342127616. Throughput: 0: 9608.2. Samples: 684256792. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:23,989][27935] Avg episode reward: [(0, '-0.026')] [2022-07-13 14:18:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 342153216. Throughput: 0: 9634.8. Samples: 684315452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:28,989][27935] Avg episode reward: [(0, '0.123')] [2022-07-13 14:18:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342175744. Throughput: 0: 9623.0. Samples: 684373440. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:33,989][27935] Avg episode reward: [(0, '0.199')] [2022-07-13 14:18:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342201344. Throughput: 0: 9625.1. Samples: 684402488. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:38,989][27935] Avg episode reward: [(0, '-0.030')] [2022-07-13 14:18:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 342225920. Throughput: 0: 9617.5. Samples: 684460540. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:43,989][27935] Avg episode reward: [(0, '-0.575')] [2022-07-13 14:18:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342249472. Throughput: 0: 9712.1. Samples: 684519368. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 14:18:48,994][27935] Avg episode reward: [(0, '-1.331')] [2022-07-13 14:18:53,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4847.6, 300 sec: 4824.9). Total num frames: 342275072. Throughput: 0: 9713.6. Samples: 684548360. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:18:53,993][27935] Avg episode reward: [(0, '-0.876')] [2022-07-13 14:18:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 342297600. Throughput: 0: 9721.4. Samples: 684606708. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:18:58,989][27935] Avg episode reward: [(0, '-0.947')] [2022-07-13 14:19:03,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342321152. Throughput: 0: 9637.8. Samples: 684661208. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:03,989][27935] Avg episode reward: [(0, '-0.889')] [2022-07-13 14:19:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 342346752. Throughput: 0: 9637.2. Samples: 684690464. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:08,989][27935] Avg episode reward: [(0, '-0.941')] [2022-07-13 14:19:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 342369280. Throughput: 0: 9630.7. Samples: 684748832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:13,989][27935] Avg episode reward: [(0, '-0.405')] [2022-07-13 14:19:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 342393856. Throughput: 0: 9646.1. Samples: 684807516. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:18,989][27935] Avg episode reward: [(0, '-0.115')] [2022-07-13 14:19:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 342417408. Throughput: 0: 9644.6. Samples: 684836496. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:23,989][27935] Avg episode reward: [(0, '0.046')] [2022-07-13 14:19:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342443008. Throughput: 0: 9648.2. Samples: 684894708. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:28,990][27935] Avg episode reward: [(0, '-0.072')] [2022-07-13 14:19:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 342466560. Throughput: 0: 9625.2. Samples: 684952504. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:33,989][27935] Avg episode reward: [(0, '0.276')] [2022-07-13 14:19:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342491136. Throughput: 0: 9630.0. Samples: 684981676. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:38,989][27935] Avg episode reward: [(0, '0.354')] [2022-07-13 14:19:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 342515712. Throughput: 0: 9631.5. Samples: 685040124. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:43,989][27935] Avg episode reward: [(0, '0.761')] [2022-07-13 14:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 342539264. Throughput: 0: 9721.7. Samples: 685098684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:48,990][27935] Avg episode reward: [(0, '0.797')] [2022-07-13 14:19:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.2, 300 sec: 4824.9). Total num frames: 342564864. Throughput: 0: 9717.7. Samples: 685127760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:53,989][27935] Avg episode reward: [(0, '1.220')] [2022-07-13 14:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 342588416. Throughput: 0: 9718.0. Samples: 685186140. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:19:58,989][27935] Avg episode reward: [(0, '1.054')] [2022-07-13 14:20:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 342610944. Throughput: 0: 9617.7. Samples: 685240312. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:03,992][27935] Avg episode reward: [(0, '0.712')] [2022-07-13 14:20:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 342634496. Throughput: 0: 9620.0. Samples: 685269396. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:08,991][27935] Avg episode reward: [(0, '0.469')] [2022-07-13 14:20:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 342658048. Throughput: 0: 9630.4. Samples: 685328076. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:13,989][27935] Avg episode reward: [(0, '0.587')] [2022-07-13 14:20:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 342682624. Throughput: 0: 9651.1. Samples: 685386804. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:18,989][27935] Avg episode reward: [(0, '0.645')] [2022-07-13 14:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 342708224. Throughput: 0: 9649.4. Samples: 685415900. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:23,989][27935] Avg episode reward: [(0, '-0.368')] [2022-07-13 14:20:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342732800. Throughput: 0: 9648.3. Samples: 685474296. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:28,989][27935] Avg episode reward: [(0, '-0.782')] [2022-07-13 14:20:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 342755328. Throughput: 0: 9635.0. Samples: 685532260. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:33,989][27935] Avg episode reward: [(0, '-0.432')] [2022-07-13 14:20:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 342780928. Throughput: 0: 9637.8. Samples: 685561460. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:38,989][27935] Avg episode reward: [(0, '-0.063')] [2022-07-13 14:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 342804480. Throughput: 0: 9631.5. Samples: 685619556. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:43,989][27935] Avg episode reward: [(0, '-0.195')] [2022-07-13 14:20:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 342830080. Throughput: 0: 9722.8. Samples: 685677840. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:48,989][27935] Avg episode reward: [(0, '-1.414')] [2022-07-13 14:20:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342854656. Throughput: 0: 9729.6. Samples: 685707228. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:53,989][27935] Avg episode reward: [(0, '-1.494')] [2022-07-13 14:20:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 342878208. Throughput: 0: 9724.1. Samples: 685765660. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:20:58,989][27935] Avg episode reward: [(0, '-0.662')] [2022-07-13 14:21:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 342899712. Throughput: 0: 9618.8. Samples: 685819652. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:21:03,991][27935] Avg episode reward: [(0, '-0.654')] [2022-07-13 14:21:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 342923264. Throughput: 0: 9620.3. Samples: 685848812. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:21:08,989][27935] Avg episode reward: [(0, '-1.289')] [2022-07-13 14:21:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 342948864. Throughput: 0: 9627.5. Samples: 685907536. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:21:13,989][27935] Avg episode reward: [(0, '-1.468')] [2022-07-13 14:21:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 342974464. Throughput: 0: 9619.1. Samples: 685965120. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 14:21:18,989][27935] Avg episode reward: [(0, '-1.440')] [2022-07-13 14:21:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 342995968. Throughput: 0: 9614.6. Samples: 685994116. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:23,989][27935] Avg episode reward: [(0, '-0.447')] [2022-07-13 14:21:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 343021568. Throughput: 0: 9609.4. Samples: 686051980. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:28,989][27935] Avg episode reward: [(0, '-0.685')] [2022-07-13 14:21:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 343044096. Throughput: 0: 9587.5. Samples: 686109276. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:33,989][27935] Avg episode reward: [(0, '-0.091')] [2022-07-13 14:21:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 343069696. Throughput: 0: 9576.8. Samples: 686138184. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:38,990][27935] Avg episode reward: [(0, '-0.955')] [2022-07-13 14:21:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 343094272. Throughput: 0: 9579.0. Samples: 686196716. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:43,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 14:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 343117824. Throughput: 0: 9677.3. Samples: 686255132. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:48,989][27935] Avg episode reward: [(0, '0.042')] [2022-07-13 14:21:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 343141376. Throughput: 0: 9673.4. Samples: 686284116. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:53,989][27935] Avg episode reward: [(0, '-0.075')] [2022-07-13 14:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 343165952. Throughput: 0: 9665.4. Samples: 686342480. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:21:58,989][27935] Avg episode reward: [(0, '-0.139')] [2022-07-13 14:22:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 343189504. Throughput: 0: 9593.9. Samples: 686396844. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:03,990][27935] Avg episode reward: [(0, '-0.110')] [2022-07-13 14:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 343213056. Throughput: 0: 9603.6. Samples: 686426276. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:08,990][27935] Avg episode reward: [(0, '-0.439')] [2022-07-13 14:22:13,991][27935] Fps is (10 sec: 4811.5, 60 sec: 4812.6, 300 sec: 4821.4). Total num frames: 343237632. Throughput: 0: 9611.2. Samples: 686484508. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:13,992][27935] Avg episode reward: [(0, '-0.064')] [2022-07-13 14:22:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 343261184. Throughput: 0: 9629.8. Samples: 686542616. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:18,989][27935] Avg episode reward: [(0, '-0.522')] [2022-07-13 14:22:23,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 343286784. Throughput: 0: 9643.3. Samples: 686572132. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:23,989][27935] Avg episode reward: [(0, '-0.510')] [2022-07-13 14:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 343310336. Throughput: 0: 9639.8. Samples: 686630508. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:28,989][27935] Avg episode reward: [(0, '0.358')] [2022-07-13 14:22:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 343334912. Throughput: 0: 9626.1. Samples: 686688308. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:33,989][27935] Avg episode reward: [(0, '0.390')] [2022-07-13 14:22:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 343358464. Throughput: 0: 9629.6. Samples: 686717448. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:38,989][27935] Avg episode reward: [(0, '0.700')] [2022-07-13 14:22:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 343382016. Throughput: 0: 9619.0. Samples: 686775336. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:43,989][27935] Avg episode reward: [(0, '1.164')] [2022-07-13 14:22:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.1). Total num frames: 343407616. Throughput: 0: 9709.0. Samples: 686833748. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:48,989][27935] Avg episode reward: [(0, '1.494')] [2022-07-13 14:22:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 343432192. Throughput: 0: 9704.1. Samples: 686862960. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:53,989][27935] Avg episode reward: [(0, '1.682')] [2022-07-13 14:22:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 343456768. Throughput: 0: 9709.1. Samples: 686921392. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:22:58,989][27935] Avg episode reward: [(0, '1.254')] [2022-07-13 14:23:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 343477248. Throughput: 0: 9595.2. Samples: 686974400. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:03,989][27935] Avg episode reward: [(0, '0.420')] [2022-07-13 14:23:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 343500800. Throughput: 0: 9570.0. Samples: 687002780. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:08,989][27935] Avg episode reward: [(0, '0.421')] [2022-07-13 14:23:13,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 343525376. Throughput: 0: 9565.0. Samples: 687060956. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:13,992][27935] Avg episode reward: [(0, '0.544')] [2022-07-13 14:23:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 343549952. Throughput: 0: 9575.7. Samples: 687119212. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:18,989][27935] Avg episode reward: [(0, '0.515')] [2022-07-13 14:23:23,989][27935] Fps is (10 sec: 5018.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 343575552. Throughput: 0: 9575.4. Samples: 687148340. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:23,989][27935] Avg episode reward: [(0, '0.056')] [2022-07-13 14:23:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 343598080. Throughput: 0: 9591.9. Samples: 687206972. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:28,989][27935] Avg episode reward: [(0, '0.282')] [2022-07-13 14:23:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 343622656. Throughput: 0: 9582.7. Samples: 687264968. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:33,989][27935] Avg episode reward: [(0, '1.327')] [2022-07-13 14:23:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 343646208. Throughput: 0: 9586.7. Samples: 687294364. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:38,992][27935] Avg episode reward: [(0, '-0.229')] [2022-07-13 14:23:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 343672832. Throughput: 0: 9598.9. Samples: 687353340. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:43,989][27935] Avg episode reward: [(0, '-0.163')] [2022-07-13 14:23:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4818.1). Total num frames: 343696384. Throughput: 0: 9717.1. Samples: 687411668. Policy #0 lag: (min: 0.0, avg: 7.5, max: 20.0) [2022-07-13 14:23:48,989][27935] Avg episode reward: [(0, '-0.288')] [2022-07-13 14:23:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 343720960. Throughput: 0: 9739.2. Samples: 687441044. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:23:53,989][27935] Avg episode reward: [(0, '-0.320')] [2022-07-13 14:23:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4824.9). Total num frames: 343744512. Throughput: 0: 9752.8. Samples: 687499808. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:23:58,989][27935] Avg episode reward: [(0, '0.017')] [2022-07-13 14:24:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 343768064. Throughput: 0: 9675.6. Samples: 687554616. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:03,989][27935] Avg episode reward: [(0, '-0.296')] [2022-07-13 14:24:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4828.4). Total num frames: 343793664. Throughput: 0: 9683.6. Samples: 687584100. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:08,990][27935] Avg episode reward: [(0, '-0.658')] [2022-07-13 14:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.2, 300 sec: 4824.9). Total num frames: 343817216. Throughput: 0: 9690.1. Samples: 687643028. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:13,990][27935] Avg episode reward: [(0, '0.714')] [2022-07-13 14:24:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 343840768. Throughput: 0: 9698.2. Samples: 687701388. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:18,989][27935] Avg episode reward: [(0, '-0.025')] [2022-07-13 14:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 343865344. Throughput: 0: 9702.0. Samples: 687730952. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:23,989][27935] Avg episode reward: [(0, '-0.107')] [2022-07-13 14:24:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 343889920. Throughput: 0: 9700.2. Samples: 687789848. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:28,990][27935] Avg episode reward: [(0, '-0.824')] [2022-07-13 14:24:33,999][27935] Fps is (10 sec: 4910.1, 60 sec: 4863.2, 300 sec: 4824.8). Total num frames: 343914496. Throughput: 0: 9707.1. Samples: 687848588. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:34,000][27935] Avg episode reward: [(0, '-0.988')] [2022-07-13 14:24:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4828.4). Total num frames: 343940096. Throughput: 0: 9709.7. Samples: 687877980. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:38,989][27935] Avg episode reward: [(0, '-1.128')] [2022-07-13 14:24:43,989][27935] Fps is (10 sec: 4817.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 343962624. Throughput: 0: 9712.8. Samples: 687936884. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:43,989][27935] Avg episode reward: [(0, '-0.579')] [2022-07-13 14:24:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 343988224. Throughput: 0: 9800.0. Samples: 687995616. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:48,989][27935] Avg episode reward: [(0, '-0.698')] [2022-07-13 14:24:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 344012800. Throughput: 0: 9799.0. Samples: 688025056. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:53,989][27935] Avg episode reward: [(0, '-0.442')] [2022-07-13 14:24:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 344037376. Throughput: 0: 9795.9. Samples: 688083844. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:24:58,989][27935] Avg episode reward: [(0, '-0.231')] [2022-07-13 14:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 344059904. Throughput: 0: 9717.7. Samples: 688138684. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:03,989][27935] Avg episode reward: [(0, '0.399')] [2022-07-13 14:25:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 344083456. Throughput: 0: 9713.0. Samples: 688168036. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:08,989][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 14:25:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 344108032. Throughput: 0: 9710.3. Samples: 688226812. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:13,989][27935] Avg episode reward: [(0, '0.029')] [2022-07-13 14:25:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 344133632. Throughput: 0: 9708.0. Samples: 688285348. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:18,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 14:25:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4831.9). Total num frames: 344158208. Throughput: 0: 9712.5. Samples: 688315044. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:23,989][27935] Avg episode reward: [(0, '0.624')] [2022-07-13 14:25:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 344181760. Throughput: 0: 9705.9. Samples: 688373648. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:28,989][27935] Avg episode reward: [(0, '-0.305')] [2022-07-13 14:25:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.8, 300 sec: 4831.9). Total num frames: 344206336. Throughput: 0: 9691.0. Samples: 688431712. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:33,991][27935] Avg episode reward: [(0, '-0.043')] [2022-07-13 14:25:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 344230912. Throughput: 0: 9686.6. Samples: 688460952. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:38,989][27935] Avg episode reward: [(0, '-0.861')] [2022-07-13 14:25:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 344253440. Throughput: 0: 9682.0. Samples: 688519532. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:43,992][27935] Avg episode reward: [(0, '-1.151')] [2022-07-13 14:25:48,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4863.7, 300 sec: 4831.8). Total num frames: 344280064. Throughput: 0: 9764.1. Samples: 688578104. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:48,993][27935] Avg episode reward: [(0, '-1.464')] [2022-07-13 14:25:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 344303616. Throughput: 0: 9771.3. Samples: 688607744. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:53,989][27935] Avg episode reward: [(0, '-1.774')] [2022-07-13 14:25:58,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 344329216. Throughput: 0: 9778.9. Samples: 688666864. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:25:58,989][27935] Avg episode reward: [(0, '-0.869')] [2022-07-13 14:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 344350720. Throughput: 0: 9695.2. Samples: 688721632. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:26:03,989][27935] Avg episode reward: [(0, '-1.711')] [2022-07-13 14:26:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 344374272. Throughput: 0: 9691.3. Samples: 688751152. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:26:08,989][27935] Avg episode reward: [(0, '-1.181')] [2022-07-13 14:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 344399872. Throughput: 0: 9698.8. Samples: 688810092. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:26:13,989][27935] Avg episode reward: [(0, '-0.811')] [2022-07-13 14:26:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 344424448. Throughput: 0: 9717.2. Samples: 688868984. Policy #0 lag: (min: 0.0, avg: 10.5, max: 19.0) [2022-07-13 14:26:18,989][27935] Avg episode reward: [(0, '-0.895')] [2022-07-13 14:26:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 344449024. Throughput: 0: 9721.8. Samples: 688898432. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:23,989][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 14:26:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 344473600. Throughput: 0: 9727.6. Samples: 688957276. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:28,989][27935] Avg episode reward: [(0, '-1.393')] [2022-07-13 14:26:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 344498176. Throughput: 0: 9726.9. Samples: 689015780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:33,989][27935] Avg episode reward: [(0, '-1.547')] [2022-07-13 14:26:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 344522752. Throughput: 0: 9724.4. Samples: 689045340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:38,990][27935] Avg episode reward: [(0, '-1.287')] [2022-07-13 14:26:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 344546304. Throughput: 0: 9714.2. Samples: 689104004. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:43,989][27935] Avg episode reward: [(0, '-1.398')] [2022-07-13 14:26:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.3, 300 sec: 4849.2). Total num frames: 344571904. Throughput: 0: 9799.5. Samples: 689162608. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:48,989][27935] Avg episode reward: [(0, '-1.421')] [2022-07-13 14:26:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 344595456. Throughput: 0: 9792.9. Samples: 689191832. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:53,989][27935] Avg episode reward: [(0, '-2.233')] [2022-07-13 14:26:59,000][27935] Fps is (10 sec: 4909.5, 60 sec: 4863.1, 300 sec: 4852.5). Total num frames: 344621056. Throughput: 0: 9792.6. Samples: 689250872. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:26:59,001][27935] Avg episode reward: [(0, '-2.133')] [2022-07-13 14:27:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 344642560. Throughput: 0: 9696.9. Samples: 689305344. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:03,989][27935] Avg episode reward: [(0, '-0.278')] [2022-07-13 14:27:08,991][27935] Fps is (10 sec: 4612.3, 60 sec: 4880.9, 300 sec: 4845.8). Total num frames: 344667136. Throughput: 0: 9699.0. Samples: 689334912. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:08,992][27935] Avg episode reward: [(0, '-0.581')] [2022-07-13 14:27:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 344691712. Throughput: 0: 9689.5. Samples: 689393304. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:13,989][27935] Avg episode reward: [(0, '-0.911')] [2022-07-13 14:27:18,989][27935] Fps is (10 sec: 4813.9, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 344715264. Throughput: 0: 9687.4. Samples: 689451712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:18,989][27935] Avg episode reward: [(0, '-0.577')] [2022-07-13 14:27:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 344739840. Throughput: 0: 9672.7. Samples: 689480612. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:23,989][27935] Avg episode reward: [(0, '-0.438')] [2022-07-13 14:27:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 344765440. Throughput: 0: 9665.0. Samples: 689538928. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:28,990][27935] Avg episode reward: [(0, '-0.115')] [2022-07-13 14:27:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 344787968. Throughput: 0: 9648.4. Samples: 689596784. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:33,989][27935] Avg episode reward: [(0, '-0.673')] [2022-07-13 14:27:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 344812544. Throughput: 0: 9649.0. Samples: 689626036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:38,989][27935] Avg episode reward: [(0, '-0.118')] [2022-07-13 14:27:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 344838144. Throughput: 0: 9625.3. Samples: 689683900. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:43,989][27935] Avg episode reward: [(0, '-0.323')] [2022-07-13 14:27:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 344862720. Throughput: 0: 9716.0. Samples: 689742564. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:48,989][27935] Avg episode reward: [(0, '0.309')] [2022-07-13 14:27:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 344885248. Throughput: 0: 9711.7. Samples: 689771916. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:53,989][27935] Avg episode reward: [(0, '-0.006')] [2022-07-13 14:27:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.8, 300 sec: 4859.7). Total num frames: 344910848. Throughput: 0: 9718.2. Samples: 689830620. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:27:58,992][27935] Avg episode reward: [(0, '0.281')] [2022-07-13 14:28:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 344932352. Throughput: 0: 9644.9. Samples: 689885732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:03,989][27935] Avg episode reward: [(0, '0.821')] [2022-07-13 14:28:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.1, 300 sec: 4856.2). Total num frames: 344957952. Throughput: 0: 9660.9. Samples: 689915352. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:08,989][27935] Avg episode reward: [(0, '0.708')] [2022-07-13 14:28:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 344981504. Throughput: 0: 9669.2. Samples: 689974044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:13,989][27935] Avg episode reward: [(0, '0.848')] [2022-07-13 14:28:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 345008128. Throughput: 0: 9684.3. Samples: 690032576. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:18,989][27935] Avg episode reward: [(0, '1.073')] [2022-07-13 14:28:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 345031680. Throughput: 0: 9687.7. Samples: 690061984. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:23,989][27935] Avg episode reward: [(0, '0.389')] [2022-07-13 14:28:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 345054208. Throughput: 0: 9717.2. Samples: 690121172. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:28,989][27935] Avg episode reward: [(0, '0.416')] [2022-07-13 14:28:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 345080832. Throughput: 0: 9063.5. Samples: 690150420. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:33,989][27935] Avg episode reward: [(0, '0.186')] [2022-07-13 14:28:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 345104384. Throughput: 0: 9710.7. Samples: 690208896. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:38,989][27935] Avg episode reward: [(0, '0.267')] [2022-07-13 14:28:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 345127936. Throughput: 0: 9710.6. Samples: 690267596. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:43,990][27935] Avg episode reward: [(0, '0.411')] [2022-07-13 14:28:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 345153536. Throughput: 0: 9799.6. Samples: 690326712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:48,989][27935] Avg episode reward: [(0, '0.462')] [2022-07-13 14:28:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 345179136. Throughput: 0: 9797.2. Samples: 690356228. Policy #0 lag: (min: 0.0, avg: 8.8, max: 18.0) [2022-07-13 14:28:53,989][27935] Avg episode reward: [(0, '0.379')] [2022-07-13 14:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 345201664. Throughput: 0: 9799.3. Samples: 690415012. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:28:58,994][27935] Avg episode reward: [(0, '0.839')] [2022-07-13 14:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 345226240. Throughput: 0: 9710.0. Samples: 690469528. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:03,989][27935] Avg episode reward: [(0, '0.457')] [2022-07-13 14:29:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 345248768. Throughput: 0: 9684.4. Samples: 690497784. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:08,989][27935] Avg episode reward: [(0, '0.536')] [2022-07-13 14:29:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 345273344. Throughput: 0: 9652.8. Samples: 690555548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:13,989][27935] Avg episode reward: [(0, '0.895')] [2022-07-13 14:29:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 345297920. Throughput: 0: 10309.0. Samples: 690614328. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:18,989][27935] Avg episode reward: [(0, '0.554')] [2022-07-13 14:29:23,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 345320448. Throughput: 0: 9655.9. Samples: 690643412. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:23,989][27935] Avg episode reward: [(0, '-0.322')] [2022-07-13 14:29:28,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4846.9, 300 sec: 4849.4). Total num frames: 345345024. Throughput: 0: 9660.5. Samples: 690702320. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:28,989][27935] Avg episode reward: [(0, '-0.397')] [2022-07-13 14:29:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 345370624. Throughput: 0: 9649.9. Samples: 690760956. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:33,990][27935] Avg episode reward: [(0, '-0.180')] [2022-07-13 14:29:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 345395200. Throughput: 0: 9645.7. Samples: 690790284. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:38,989][27935] Avg episode reward: [(0, '0.293')] [2022-07-13 14:29:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 345419776. Throughput: 0: 9647.7. Samples: 690849160. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:43,990][27935] Avg episode reward: [(0, '0.123')] [2022-07-13 14:29:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 345444352. Throughput: 0: 9742.1. Samples: 690907924. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:48,989][27935] Avg episode reward: [(0, '-0.214')] [2022-07-13 14:29:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 345468928. Throughput: 0: 9768.5. Samples: 690937368. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:53,991][27935] Avg episode reward: [(0, '-0.250')] [2022-07-13 14:29:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 345491456. Throughput: 0: 9789.7. Samples: 690996084. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:29:58,989][27935] Avg episode reward: [(0, '0.163')] [2022-07-13 14:30:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 345517056. Throughput: 0: 9695.3. Samples: 691050616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:03,989][27935] Avg episode reward: [(0, '-0.187')] [2022-07-13 14:30:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 345539584. Throughput: 0: 9700.4. Samples: 691079932. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:08,989][27935] Avg episode reward: [(0, '0.086')] [2022-07-13 14:30:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 345564160. Throughput: 0: 9699.9. Samples: 691138816. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:13,989][27935] Avg episode reward: [(0, '0.007')] [2022-07-13 14:30:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 345588736. Throughput: 0: 9704.2. Samples: 691197644. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:18,989][27935] Avg episode reward: [(0, '0.551')] [2022-07-13 14:30:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 345614336. Throughput: 0: 9707.6. Samples: 691227124. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:23,990][27935] Avg episode reward: [(0, '0.518')] [2022-07-13 14:30:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 345637888. Throughput: 0: 9710.2. Samples: 691286120. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:28,989][27935] Avg episode reward: [(0, '0.572')] [2022-07-13 14:30:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 345661440. Throughput: 0: 9699.5. Samples: 691344400. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:33,991][27935] Avg episode reward: [(0, '1.115')] [2022-07-13 14:30:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 345687040. Throughput: 0: 9690.2. Samples: 691373428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:38,989][27935] Avg episode reward: [(0, '1.112')] [2022-07-13 14:30:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.8). Total num frames: 345711616. Throughput: 0: 9685.8. Samples: 691431944. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:43,989][27935] Avg episode reward: [(0, '0.928')] [2022-07-13 14:30:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 345736192. Throughput: 0: 9777.1. Samples: 691490588. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:48,989][27935] Avg episode reward: [(0, '1.045')] [2022-07-13 14:30:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 345759744. Throughput: 0: 9774.8. Samples: 691519800. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:53,990][27935] Avg episode reward: [(0, '0.586')] [2022-07-13 14:30:58,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4881.0, 300 sec: 4859.6). Total num frames: 345784320. Throughput: 0: 9770.9. Samples: 691578520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:30:58,991][27935] Avg episode reward: [(0, '0.636')] [2022-07-13 14:31:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 345805824. Throughput: 0: 9671.1. Samples: 691632844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:31:03,991][27935] Avg episode reward: [(0, '0.332')] [2022-07-13 14:31:08,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 345831424. Throughput: 0: 9661.3. Samples: 691661884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:31:08,990][27935] Avg episode reward: [(0, '0.230')] [2022-07-13 14:31:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 345853952. Throughput: 0: 9647.2. Samples: 691720244. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:31:13,989][27935] Avg episode reward: [(0, '-0.318')] [2022-07-13 14:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 345879552. Throughput: 0: 9655.1. Samples: 691778880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:31:18,989][27935] Avg episode reward: [(0, '-0.381')] [2022-07-13 14:31:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 345903104. Throughput: 0: 9644.6. Samples: 691807436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 14:31:23,989][27935] Avg episode reward: [(0, '-0.550')] [2022-07-13 14:31:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 345927680. Throughput: 0: 9641.1. Samples: 691865792. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:28,989][27935] Avg episode reward: [(0, '-0.801')] [2022-07-13 14:31:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 345952256. Throughput: 0: 8976.1. Samples: 691894512. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:33,989][27935] Avg episode reward: [(0, '-0.657')] [2022-07-13 14:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 345976832. Throughput: 0: 9614.1. Samples: 691952436. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:38,989][27935] Avg episode reward: [(0, '-1.524')] [2022-07-13 14:31:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 346000384. Throughput: 0: 9604.6. Samples: 692010716. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:43,989][27935] Avg episode reward: [(0, '-0.956')] [2022-07-13 14:31:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 346024960. Throughput: 0: 9695.6. Samples: 692069144. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:48,989][27935] Avg episode reward: [(0, '-1.383')] [2022-07-13 14:31:53,992][27935] Fps is (10 sec: 4913.9, 60 sec: 4829.6, 300 sec: 4842.5). Total num frames: 346049536. Throughput: 0: 9699.2. Samples: 692098376. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:53,992][27935] Avg episode reward: [(0, '-1.419')] [2022-07-13 14:31:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.9, 300 sec: 4849.2). Total num frames: 346073088. Throughput: 0: 9693.8. Samples: 692156464. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:31:58,989][27935] Avg episode reward: [(0, '-1.542')] [2022-07-13 14:32:03,989][27935] Fps is (10 sec: 4711.7, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 346096640. Throughput: 0: 9593.8. Samples: 692210600. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:03,996][27935] Avg episode reward: [(0, '-0.373')] [2022-07-13 14:32:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 346120192. Throughput: 0: 9615.5. Samples: 692240132. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:08,989][27935] Avg episode reward: [(0, '-0.644')] [2022-07-13 14:32:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 346144768. Throughput: 0: 9610.4. Samples: 692298260. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:13,990][27935] Avg episode reward: [(0, '0.053')] [2022-07-13 14:32:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 346167296. Throughput: 0: 9618.1. Samples: 692327328. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:18,990][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 14:32:23,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 346193920. Throughput: 0: 9645.1. Samples: 692386468. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:23,989][27935] Avg episode reward: [(0, '0.165')] [2022-07-13 14:32:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 346217472. Throughput: 0: 9647.6. Samples: 692444856. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:28,989][27935] Avg episode reward: [(0, '0.265')] [2022-07-13 14:32:33,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 346240000. Throughput: 0: 9642.8. Samples: 692503072. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:33,990][27935] Avg episode reward: [(0, '0.021')] [2022-07-13 14:32:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 346265600. Throughput: 0: 9645.9. Samples: 692532416. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:38,989][27935] Avg episode reward: [(0, '-0.143')] [2022-07-13 14:32:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 346290176. Throughput: 0: 9632.3. Samples: 692589916. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:43,992][27935] Avg episode reward: [(0, '-0.614')] [2022-07-13 14:32:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 346314752. Throughput: 0: 9725.4. Samples: 692648244. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:48,989][27935] Avg episode reward: [(0, '-0.542')] [2022-07-13 14:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.2, 300 sec: 4845.8). Total num frames: 346340352. Throughput: 0: 9722.5. Samples: 692677644. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:53,989][27935] Avg episode reward: [(0, '-0.045')] [2022-07-13 14:32:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 346362880. Throughput: 0: 9729.7. Samples: 692736096. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:32:58,989][27935] Avg episode reward: [(0, '-1.117')] [2022-07-13 14:33:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 346385408. Throughput: 0: 10289.2. Samples: 692790344. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:03,989][27935] Avg episode reward: [(0, '-1.002')] [2022-07-13 14:33:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 346408960. Throughput: 0: 9622.1. Samples: 692819460. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:08,990][27935] Avg episode reward: [(0, '-1.046')] [2022-07-13 14:33:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346435584. Throughput: 0: 9626.0. Samples: 692878028. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:13,989][27935] Avg episode reward: [(0, '-0.980')] [2022-07-13 14:33:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 346458112. Throughput: 0: 8970.0. Samples: 692906724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:18,989][27935] Avg episode reward: [(0, '-0.067')] [2022-07-13 14:33:23,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4812.6, 300 sec: 4842.3). Total num frames: 346482688. Throughput: 0: 9627.4. Samples: 692965672. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:23,993][27935] Avg episode reward: [(0, '-0.403')] [2022-07-13 14:33:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 346506240. Throughput: 0: 9640.5. Samples: 693023736. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:28,989][27935] Avg episode reward: [(0, '-0.132')] [2022-07-13 14:33:33,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 346530816. Throughput: 0: 9631.6. Samples: 693081664. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:33,990][27935] Avg episode reward: [(0, '0.370')] [2022-07-13 14:33:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 346556416. Throughput: 0: 9632.6. Samples: 693111112. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:38,989][27935] Avg episode reward: [(0, '0.449')] [2022-07-13 14:33:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 346579968. Throughput: 0: 9636.5. Samples: 693169740. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:43,989][27935] Avg episode reward: [(0, '-0.086')] [2022-07-13 14:33:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 346604544. Throughput: 0: 9738.8. Samples: 693228592. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:48,989][27935] Avg episode reward: [(0, '-0.326')] [2022-07-13 14:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 346629120. Throughput: 0: 9749.7. Samples: 693258196. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:53,990][27935] Avg episode reward: [(0, '-0.472')] [2022-07-13 14:33:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346653696. Throughput: 0: 9752.5. Samples: 693316888. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 14:33:58,989][27935] Avg episode reward: [(0, '-1.118')] [2022-07-13 14:34:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346676224. Throughput: 0: 10337.5. Samples: 693371912. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:03,989][27935] Avg episode reward: [(0, '-1.538')] [2022-07-13 14:34:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 346700800. Throughput: 0: 9679.4. Samples: 693401220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:08,989][27935] Avg episode reward: [(0, '-0.955')] [2022-07-13 14:34:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 346725376. Throughput: 0: 9691.2. Samples: 693459840. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:13,990][27935] Avg episode reward: [(0, '-1.877')] [2022-07-13 14:34:18,990][27935] Fps is (10 sec: 4709.8, 60 sec: 4829.8, 300 sec: 4838.8). Total num frames: 346747904. Throughput: 0: 9699.8. Samples: 693518168. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:18,991][27935] Avg episode reward: [(0, '-1.144')] [2022-07-13 14:34:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4842.3). Total num frames: 346773504. Throughput: 0: 9698.8. Samples: 693547560. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:23,989][27935] Avg episode reward: [(0, '-1.181')] [2022-07-13 14:34:28,989][27935] Fps is (10 sec: 5120.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 346799104. Throughput: 0: 9697.6. Samples: 693606132. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:28,989][27935] Avg episode reward: [(0, '-0.181')] [2022-07-13 14:34:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 346821632. Throughput: 0: 9685.7. Samples: 693664448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:33,989][27935] Avg episode reward: [(0, '-0.379')] [2022-07-13 14:34:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346847232. Throughput: 0: 9675.2. Samples: 693693580. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:38,990][27935] Avg episode reward: [(0, '0.513')] [2022-07-13 14:34:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 346870784. Throughput: 0: 9673.8. Samples: 693752208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:43,989][27935] Avg episode reward: [(0, '1.021')] [2022-07-13 14:34:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 346896384. Throughput: 0: 9745.9. Samples: 693810476. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:48,989][27935] Avg episode reward: [(0, '1.327')] [2022-07-13 14:34:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 346919936. Throughput: 0: 9747.7. Samples: 693839868. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:53,989][27935] Avg episode reward: [(0, '1.221')] [2022-07-13 14:34:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346944512. Throughput: 0: 9753.6. Samples: 693898752. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:34:58,989][27935] Avg episode reward: [(0, '1.221')] [2022-07-13 14:35:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346967040. Throughput: 0: 9669.0. Samples: 693953260. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:03,989][27935] Avg episode reward: [(0, '0.807')] [2022-07-13 14:35:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 346991616. Throughput: 0: 9665.2. Samples: 693982496. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:08,989][27935] Avg episode reward: [(0, '0.538')] [2022-07-13 14:35:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347015168. Throughput: 0: 9634.3. Samples: 694039676. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:13,989][27935] Avg episode reward: [(0, '0.226')] [2022-07-13 14:35:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.0, 300 sec: 4828.4). Total num frames: 347038720. Throughput: 0: 8978.2. Samples: 694068468. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:18,991][27935] Avg episode reward: [(0, '-0.190')] [2022-07-13 14:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 347064320. Throughput: 0: 9636.1. Samples: 694127204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:23,990][27935] Avg episode reward: [(0, '-1.659')] [2022-07-13 14:35:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 347087872. Throughput: 0: 9628.4. Samples: 694185488. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:28,989][27935] Avg episode reward: [(0, '-2.353')] [2022-07-13 14:35:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 347111424. Throughput: 0: 9626.6. Samples: 694243672. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:33,989][27935] Avg episode reward: [(0, '-2.943')] [2022-07-13 14:35:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 347137024. Throughput: 0: 9618.4. Samples: 694272696. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:38,989][27935] Avg episode reward: [(0, '-2.855')] [2022-07-13 14:35:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 347160576. Throughput: 0: 9605.6. Samples: 694331004. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:43,989][27935] Avg episode reward: [(0, '-2.459')] [2022-07-13 14:35:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 347184128. Throughput: 0: 9697.7. Samples: 694389656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:48,989][27935] Avg episode reward: [(0, '-2.103')] [2022-07-13 14:35:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 347209728. Throughput: 0: 9709.8. Samples: 694419436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:53,989][27935] Avg episode reward: [(0, '-1.843')] [2022-07-13 14:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 347233280. Throughput: 0: 9733.3. Samples: 694477672. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:35:58,989][27935] Avg episode reward: [(0, '-1.170')] [2022-07-13 14:36:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 347256832. Throughput: 0: 10317.8. Samples: 694532768. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:03,989][27935] Avg episode reward: [(0, '-0.670')] [2022-07-13 14:36:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 347281408. Throughput: 0: 9662.6. Samples: 694562020. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:08,989][27935] Avg episode reward: [(0, '0.387')] [2022-07-13 14:36:13,996][27935] Fps is (10 sec: 5013.8, 60 sec: 4863.4, 300 sec: 4838.7). Total num frames: 347307008. Throughput: 0: 9678.4. Samples: 694621088. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:13,998][27935] Avg episode reward: [(0, '0.573')] [2022-07-13 14:36:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 347330560. Throughput: 0: 9684.5. Samples: 694679472. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:18,989][27935] Avg episode reward: [(0, '-0.177')] [2022-07-13 14:36:23,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347354112. Throughput: 0: 9682.9. Samples: 694708428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:23,989][27935] Avg episode reward: [(0, '-0.137')] [2022-07-13 14:36:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 347377664. Throughput: 0: 9685.1. Samples: 694766832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 21.0) [2022-07-13 14:36:28,989][27935] Avg episode reward: [(0, '0.501')] [2022-07-13 14:36:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 347403264. Throughput: 0: 9673.5. Samples: 694824964. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:33,989][27935] Avg episode reward: [(0, '0.339')] [2022-07-13 14:36:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 347427840. Throughput: 0: 9665.6. Samples: 694854388. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:38,989][27935] Avg episode reward: [(0, '-0.055')] [2022-07-13 14:36:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 347451392. Throughput: 0: 9666.0. Samples: 694912644. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:43,989][27935] Avg episode reward: [(0, '-0.136')] [2022-07-13 14:36:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 347474944. Throughput: 0: 9748.5. Samples: 694971452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:48,989][27935] Avg episode reward: [(0, '-0.270')] [2022-07-13 14:36:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 347500544. Throughput: 0: 9749.6. Samples: 695000752. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:53,990][27935] Avg episode reward: [(0, '-0.339')] [2022-07-13 14:36:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 347524096. Throughput: 0: 9724.4. Samples: 695058612. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:36:58,989][27935] Avg episode reward: [(0, '-0.232')] [2022-07-13 14:37:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347546624. Throughput: 0: 9071.4. Samples: 695087688. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:03,991][27935] Avg episode reward: [(0, '-0.085')] [2022-07-13 14:37:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347571200. Throughput: 0: 9625.4. Samples: 695141572. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:08,989][27935] Avg episode reward: [(0, '0.251')] [2022-07-13 14:37:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.3, 300 sec: 4838.8). Total num frames: 347594752. Throughput: 0: 9614.9. Samples: 695199504. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:13,989][27935] Avg episode reward: [(0, '-0.350')] [2022-07-13 14:37:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 347618304. Throughput: 0: 9629.3. Samples: 695258284. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:18,989][27935] Avg episode reward: [(0, '-0.320')] [2022-07-13 14:37:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347643904. Throughput: 0: 9622.8. Samples: 695287412. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:23,989][27935] Avg episode reward: [(0, '0.481')] [2022-07-13 14:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 347667456. Throughput: 0: 9640.2. Samples: 695346452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:28,990][27935] Avg episode reward: [(0, '0.603')] [2022-07-13 14:37:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 347694080. Throughput: 0: 9629.4. Samples: 695404776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:33,989][27935] Avg episode reward: [(0, '0.258')] [2022-07-13 14:37:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 347716608. Throughput: 0: 9632.0. Samples: 695434192. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:38,989][27935] Avg episode reward: [(0, '0.331')] [2022-07-13 14:37:43,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4829.7, 300 sec: 4835.3). Total num frames: 347741184. Throughput: 0: 9613.7. Samples: 695491248. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:43,991][27935] Avg episode reward: [(0, '0.910')] [2022-07-13 14:37:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 347764736. Throughput: 0: 10267.5. Samples: 695549724. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:48,989][27935] Avg episode reward: [(0, '0.990')] [2022-07-13 14:37:53,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 347789312. Throughput: 0: 9719.7. Samples: 695578960. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:53,991][27935] Avg episode reward: [(0, '0.471')] [2022-07-13 14:37:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 347814912. Throughput: 0: 9729.4. Samples: 695637328. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:37:58,989][27935] Avg episode reward: [(0, '-0.926')] [2022-07-13 14:38:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 347836416. Throughput: 0: 9628.4. Samples: 695691560. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:03,989][27935] Avg episode reward: [(0, '-1.041')] [2022-07-13 14:38:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 347859968. Throughput: 0: 9632.0. Samples: 695720852. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:08,989][27935] Avg episode reward: [(0, '-0.890')] [2022-07-13 14:38:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347884544. Throughput: 0: 9619.0. Samples: 695779308. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:13,989][27935] Avg episode reward: [(0, '-0.785')] [2022-07-13 14:38:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 347909120. Throughput: 0: 9619.0. Samples: 695837632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:18,989][27935] Avg episode reward: [(0, '-0.764')] [2022-07-13 14:38:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 347932672. Throughput: 0: 9612.7. Samples: 695866764. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:23,989][27935] Avg episode reward: [(0, '-0.412')] [2022-07-13 14:38:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 347957248. Throughput: 0: 9641.7. Samples: 695925104. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:28,989][27935] Avg episode reward: [(0, '0.152')] [2022-07-13 14:38:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 347981824. Throughput: 0: 8980.2. Samples: 695953832. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:33,989][27935] Avg episode reward: [(0, '1.453')] [2022-07-13 14:38:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 348006400. Throughput: 0: 9623.5. Samples: 696012016. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:38,989][27935] Avg episode reward: [(0, '1.405')] [2022-07-13 14:38:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.9, 300 sec: 4828.4). Total num frames: 348028928. Throughput: 0: 9615.8. Samples: 696070040. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:43,989][27935] Avg episode reward: [(0, '0.543')] [2022-07-13 14:38:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 348054528. Throughput: 0: 9706.9. Samples: 696128372. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:48,989][27935] Avg episode reward: [(0, '0.447')] [2022-07-13 14:38:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348078080. Throughput: 0: 9707.4. Samples: 696157684. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:53,989][27935] Avg episode reward: [(0, '0.173')] [2022-07-13 14:38:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 348103680. Throughput: 0: 9701.0. Samples: 696215852. Policy #0 lag: (min: 0.0, avg: 9.1, max: 19.0) [2022-07-13 14:38:58,989][27935] Avg episode reward: [(0, '0.018')] [2022-07-13 14:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348125184. Throughput: 0: 9614.4. Samples: 696270280. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:03,989][27935] Avg episode reward: [(0, '-0.332')] [2022-07-13 14:39:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 348149760. Throughput: 0: 9615.2. Samples: 696299448. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:08,989][27935] Avg episode reward: [(0, '0.367')] [2022-07-13 14:39:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 348174336. Throughput: 0: 9616.2. Samples: 696357832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:13,989][27935] Avg episode reward: [(0, '0.359')] [2022-07-13 14:39:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 348198912. Throughput: 0: 10272.5. Samples: 696416096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:18,989][27935] Avg episode reward: [(0, '0.945')] [2022-07-13 14:39:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 348222464. Throughput: 0: 9633.6. Samples: 696445528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:23,989][27935] Avg episode reward: [(0, '0.424')] [2022-07-13 14:39:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 348247040. Throughput: 0: 9644.5. Samples: 696504044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:28,989][27935] Avg episode reward: [(0, '-0.007')] [2022-07-13 14:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 348271616. Throughput: 0: 9627.7. Samples: 696561620. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:33,989][27935] Avg episode reward: [(0, '-0.406')] [2022-07-13 14:39:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348295168. Throughput: 0: 9638.7. Samples: 696591424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:38,989][27935] Avg episode reward: [(0, '-0.210')] [2022-07-13 14:39:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 348319744. Throughput: 0: 9652.4. Samples: 696650208. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:43,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 14:39:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 348344320. Throughput: 0: 9742.0. Samples: 696708672. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:48,989][27935] Avg episode reward: [(0, '-0.166')] [2022-07-13 14:39:53,990][27935] Fps is (10 sec: 4914.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 348368896. Throughput: 0: 9752.5. Samples: 696738320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:53,990][27935] Avg episode reward: [(0, '-0.231')] [2022-07-13 14:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 348393472. Throughput: 0: 9761.7. Samples: 696797108. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:39:58,989][27935] Avg episode reward: [(0, '-0.152')] [2022-07-13 14:40:03,989][27935] Fps is (10 sec: 4710.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 348416000. Throughput: 0: 9678.7. Samples: 696851636. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:03,989][27935] Avg episode reward: [(0, '0.365')] [2022-07-13 14:40:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 348441600. Throughput: 0: 9673.4. Samples: 696880832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:08,989][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 14:40:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 348464128. Throughput: 0: 9677.5. Samples: 696939532. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:13,989][27935] Avg episode reward: [(0, '0.275')] [2022-07-13 14:40:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 348489728. Throughput: 0: 9688.8. Samples: 696997616. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:18,989][27935] Avg episode reward: [(0, '0.034')] [2022-07-13 14:40:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 348513280. Throughput: 0: 9683.1. Samples: 697027164. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:23,989][27935] Avg episode reward: [(0, '-0.294')] [2022-07-13 14:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 348537856. Throughput: 0: 9671.9. Samples: 697085444. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:28,989][27935] Avg episode reward: [(0, '-0.003')] [2022-07-13 14:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 348561408. Throughput: 0: 9020.4. Samples: 697114592. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:33,989][27935] Avg episode reward: [(0, '0.142')] [2022-07-13 14:40:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 348585984. Throughput: 0: 9650.3. Samples: 697172576. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:38,989][27935] Avg episode reward: [(0, '0.271')] [2022-07-13 14:40:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 348610560. Throughput: 0: 9637.7. Samples: 697230804. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:43,989][27935] Avg episode reward: [(0, '1.047')] [2022-07-13 14:40:48,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4829.3, 300 sec: 4828.3). Total num frames: 348634112. Throughput: 0: 9713.1. Samples: 697288800. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:48,997][27935] Avg episode reward: [(0, '1.094')] [2022-07-13 14:40:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 348658688. Throughput: 0: 9716.4. Samples: 697318068. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:53,989][27935] Avg episode reward: [(0, '1.244')] [2022-07-13 14:40:58,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 348683264. Throughput: 0: 9708.7. Samples: 697376424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:40:58,989][27935] Avg episode reward: [(0, '0.115')] [2022-07-13 14:41:03,989][27935] Fps is (10 sec: 4710.2, 60 sec: 4829.8, 300 sec: 4828.4). Total num frames: 348705792. Throughput: 0: 9627.2. Samples: 697430844. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:03,990][27935] Avg episode reward: [(0, '0.157')] [2022-07-13 14:41:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4821.6). Total num frames: 348729344. Throughput: 0: 9618.3. Samples: 697459988. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:08,989][27935] Avg episode reward: [(0, '0.175')] [2022-07-13 14:41:13,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 348753920. Throughput: 0: 9621.8. Samples: 697518424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:13,989][27935] Avg episode reward: [(0, '-0.000')] [2022-07-13 14:41:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348778496. Throughput: 0: 10230.5. Samples: 697574964. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:18,990][27935] Avg episode reward: [(0, '-0.045')] [2022-07-13 14:41:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348802048. Throughput: 0: 9585.7. Samples: 697603932. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:23,989][27935] Avg episode reward: [(0, '-0.198')] [2022-07-13 14:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 348826624. Throughput: 0: 9593.0. Samples: 697662488. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:28,989][27935] Avg episode reward: [(0, '-0.185')] [2022-07-13 14:41:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 348850176. Throughput: 0: 9599.3. Samples: 697720696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 18.0) [2022-07-13 14:41:33,989][27935] Avg episode reward: [(0, '0.462')] [2022-07-13 14:41:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 348875776. Throughput: 0: 9592.6. Samples: 697749736. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:41:38,990][27935] Avg episode reward: [(0, '0.718')] [2022-07-13 14:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 348899328. Throughput: 0: 9595.4. Samples: 697808216. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:41:43,991][27935] Avg episode reward: [(0, '-1.376')] [2022-07-13 14:41:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4813.4, 300 sec: 4821.5). Total num frames: 348922880. Throughput: 0: 9668.9. Samples: 697865940. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:41:48,990][27935] Avg episode reward: [(0, '-1.986')] [2022-07-13 14:41:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 348946432. Throughput: 0: 9672.3. Samples: 697895240. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:41:53,989][27935] Avg episode reward: [(0, '-2.009')] [2022-07-13 14:41:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 348973056. Throughput: 0: 9674.2. Samples: 697953764. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:41:58,989][27935] Avg episode reward: [(0, '-2.227')] [2022-07-13 14:42:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 348994560. Throughput: 0: 9627.3. Samples: 698008192. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:03,989][27935] Avg episode reward: [(0, '-1.504')] [2022-07-13 14:42:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 349019136. Throughput: 0: 9627.8. Samples: 698037184. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:08,990][27935] Avg episode reward: [(0, '-1.383')] [2022-07-13 14:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 349042688. Throughput: 0: 9623.5. Samples: 698095548. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:13,989][27935] Avg episode reward: [(0, '-2.244')] [2022-07-13 14:42:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 349066240. Throughput: 0: 9616.1. Samples: 698153420. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:18,989][27935] Avg episode reward: [(0, '-1.941')] [2022-07-13 14:42:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 349091840. Throughput: 0: 9614.4. Samples: 698182384. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:23,989][27935] Avg episode reward: [(0, '-1.844')] [2022-07-13 14:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 349115392. Throughput: 0: 9606.1. Samples: 698240492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:28,989][27935] Avg episode reward: [(0, '-2.063')] [2022-07-13 14:42:33,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349139968. Throughput: 0: 9612.7. Samples: 698298512. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:33,989][27935] Avg episode reward: [(0, '-2.207')] [2022-07-13 14:42:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 349163520. Throughput: 0: 9610.2. Samples: 698327700. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:38,989][27935] Avg episode reward: [(0, '-2.311')] [2022-07-13 14:42:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 349188096. Throughput: 0: 9597.9. Samples: 698385668. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:43,989][27935] Avg episode reward: [(0, '-1.437')] [2022-07-13 14:42:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 349212672. Throughput: 0: 9683.0. Samples: 698443928. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:48,990][27935] Avg episode reward: [(0, '-0.194')] [2022-07-13 14:42:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 349236224. Throughput: 0: 9692.5. Samples: 698473348. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:53,989][27935] Avg episode reward: [(0, '0.991')] [2022-07-13 14:42:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 349260800. Throughput: 0: 9698.6. Samples: 698531984. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:42:58,989][27935] Avg episode reward: [(0, '0.994')] [2022-07-13 14:43:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 349284352. Throughput: 0: 9623.4. Samples: 698586472. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:03,991][27935] Avg episode reward: [(0, '0.692')] [2022-07-13 14:43:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 349307904. Throughput: 0: 9630.6. Samples: 698615760. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:08,995][27935] Avg episode reward: [(0, '0.899')] [2022-07-13 14:43:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 349331456. Throughput: 0: 9639.4. Samples: 698674268. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:13,990][27935] Avg episode reward: [(0, '-0.153')] [2022-07-13 14:43:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349356032. Throughput: 0: 9643.9. Samples: 698732488. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:18,989][27935] Avg episode reward: [(0, '-0.146')] [2022-07-13 14:43:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 349380608. Throughput: 0: 9642.7. Samples: 698761620. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:23,989][27935] Avg episode reward: [(0, '-0.325')] [2022-07-13 14:43:28,993][27935] Fps is (10 sec: 5015.7, 60 sec: 4846.6, 300 sec: 4828.4). Total num frames: 349406208. Throughput: 0: 9656.6. Samples: 698820252. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:28,993][27935] Avg episode reward: [(0, '-0.155')] [2022-07-13 14:43:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 349428736. Throughput: 0: 9648.9. Samples: 698878128. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:33,989][27935] Avg episode reward: [(0, '0.343')] [2022-07-13 14:43:38,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 349454336. Throughput: 0: 9645.1. Samples: 698907376. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:38,989][27935] Avg episode reward: [(0, '0.355')] [2022-07-13 14:43:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349477888. Throughput: 0: 9645.5. Samples: 698966032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:43,989][27935] Avg episode reward: [(0, '0.851')] [2022-07-13 14:43:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 349502464. Throughput: 0: 9724.8. Samples: 699024088. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:48,989][27935] Avg episode reward: [(0, '1.046')] [2022-07-13 14:43:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 349524992. Throughput: 0: 9722.2. Samples: 699053260. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:53,999][27935] Avg episode reward: [(0, '0.995')] [2022-07-13 14:43:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 349551616. Throughput: 0: 9732.3. Samples: 699112220. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:43:58,989][27935] Avg episode reward: [(0, '0.979')] [2022-07-13 14:44:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 349574144. Throughput: 0: 9649.2. Samples: 699166700. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 14:44:03,989][27935] Avg episode reward: [(0, '0.807')] [2022-07-13 14:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 349597696. Throughput: 0: 9650.1. Samples: 699195872. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:08,989][27935] Avg episode reward: [(0, '0.823')] [2022-07-13 14:44:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 349621248. Throughput: 0: 9652.1. Samples: 699254560. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:13,989][27935] Avg episode reward: [(0, '0.623')] [2022-07-13 14:44:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349645824. Throughput: 0: 9656.2. Samples: 699312656. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:18,989][27935] Avg episode reward: [(0, '0.256')] [2022-07-13 14:44:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 349671424. Throughput: 0: 9654.4. Samples: 699341824. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:23,989][27935] Avg episode reward: [(0, '-0.455')] [2022-07-13 14:44:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.1, 300 sec: 4824.9). Total num frames: 349694976. Throughput: 0: 9638.2. Samples: 699399752. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:28,989][27935] Avg episode reward: [(0, '-0.964')] [2022-07-13 14:44:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 349719552. Throughput: 0: 9628.1. Samples: 699457352. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:33,989][27935] Avg episode reward: [(0, '-1.145')] [2022-07-13 14:44:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 349742080. Throughput: 0: 9626.3. Samples: 699486444. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:38,989][27935] Avg episode reward: [(0, '-1.093')] [2022-07-13 14:44:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 349766656. Throughput: 0: 9621.0. Samples: 699545164. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:43,989][27935] Avg episode reward: [(0, '-1.286')] [2022-07-13 14:44:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 349792256. Throughput: 0: 9701.5. Samples: 699603268. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:48,989][27935] Avg episode reward: [(0, '-1.132')] [2022-07-13 14:44:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 349816832. Throughput: 0: 9705.1. Samples: 699632604. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:53,989][27935] Avg episode reward: [(0, '-1.214')] [2022-07-13 14:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 349841408. Throughput: 0: 9699.4. Samples: 699691032. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:44:58,990][27935] Avg episode reward: [(0, '-0.410')] [2022-07-13 14:45:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 349862912. Throughput: 0: 9613.9. Samples: 699745280. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:03,989][27935] Avg episode reward: [(0, '-0.590')] [2022-07-13 14:45:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 349886464. Throughput: 0: 9613.0. Samples: 699774408. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:08,989][27935] Avg episode reward: [(0, '-0.422')] [2022-07-13 14:45:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 349910016. Throughput: 0: 9618.1. Samples: 699832568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:13,989][27935] Avg episode reward: [(0, '-1.140')] [2022-07-13 14:45:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 349935616. Throughput: 0: 9633.6. Samples: 699890864. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:18,989][27935] Avg episode reward: [(0, '-1.158')] [2022-07-13 14:45:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349961216. Throughput: 0: 9630.0. Samples: 699919792. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:23,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 14:45:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 349984768. Throughput: 0: 9624.2. Samples: 699978252. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:28,990][27935] Avg episode reward: [(0, '-0.931')] [2022-07-13 14:45:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350008320. Throughput: 0: 9626.0. Samples: 700036440. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:33,989][27935] Avg episode reward: [(0, '-0.687')] [2022-07-13 14:45:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 350031872. Throughput: 0: 9610.3. Samples: 700065068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:38,990][27935] Avg episode reward: [(0, '-1.412')] [2022-07-13 14:45:43,996][27935] Fps is (10 sec: 4809.1, 60 sec: 4829.3, 300 sec: 4821.5). Total num frames: 350056448. Throughput: 0: 9617.4. Samples: 700123888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:43,997][27935] Avg episode reward: [(0, '-1.670')] [2022-07-13 14:45:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 350082048. Throughput: 0: 9702.4. Samples: 700181888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:48,989][27935] Avg episode reward: [(0, '-0.881')] [2022-07-13 14:45:53,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350105600. Throughput: 0: 9703.5. Samples: 700211064. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:53,992][27935] Avg episode reward: [(0, '-0.798')] [2022-07-13 14:45:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 350130176. Throughput: 0: 9707.8. Samples: 700269416. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:45:58,989][27935] Avg episode reward: [(0, '-2.030')] [2022-07-13 14:46:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350151680. Throughput: 0: 9624.5. Samples: 700323964. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:03,989][27935] Avg episode reward: [(0, '-1.837')] [2022-07-13 14:46:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 350176256. Throughput: 0: 9630.4. Samples: 700353160. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:08,991][27935] Avg episode reward: [(0, '-0.902')] [2022-07-13 14:46:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 350200832. Throughput: 0: 9636.0. Samples: 700411872. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:13,991][27935] Avg episode reward: [(0, '-1.724')] [2022-07-13 14:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 350225408. Throughput: 0: 9626.0. Samples: 700469608. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:18,989][27935] Avg episode reward: [(0, '-1.389')] [2022-07-13 14:46:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 350248960. Throughput: 0: 9631.4. Samples: 700498480. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:23,989][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 14:46:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 350272512. Throughput: 0: 9607.2. Samples: 700556140. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:28,990][27935] Avg episode reward: [(0, '0.221')] [2022-07-13 14:46:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 350297088. Throughput: 0: 9603.6. Samples: 700614048. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:33,989][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 14:46:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 350322688. Throughput: 0: 9607.6. Samples: 700643404. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 14:46:38,990][27935] Avg episode reward: [(0, '-1.269')] [2022-07-13 14:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.5, 300 sec: 4824.9). Total num frames: 350346240. Throughput: 0: 9608.5. Samples: 700701800. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:46:43,990][27935] Avg episode reward: [(0, '-1.321')] [2022-07-13 14:46:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 350368768. Throughput: 0: 9696.7. Samples: 700760316. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:46:48,991][27935] Avg episode reward: [(0, '-1.698')] [2022-07-13 14:46:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 350394368. Throughput: 0: 9698.8. Samples: 700789604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:46:53,990][27935] Avg episode reward: [(0, '-2.319')] [2022-07-13 14:46:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 350418944. Throughput: 0: 9679.2. Samples: 700847436. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:46:58,989][27935] Avg episode reward: [(0, '-2.868')] [2022-07-13 14:47:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 350440448. Throughput: 0: 9605.4. Samples: 700901852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:03,991][27935] Avg episode reward: [(0, '-2.089')] [2022-07-13 14:47:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 350466048. Throughput: 0: 9609.5. Samples: 700930908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:08,989][27935] Avg episode reward: [(0, '-1.423')] [2022-07-13 14:47:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 350489600. Throughput: 0: 9631.6. Samples: 700989564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:13,989][27935] Avg episode reward: [(0, '-1.617')] [2022-07-13 14:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350514176. Throughput: 0: 9625.9. Samples: 701047216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:18,991][27935] Avg episode reward: [(0, '-0.382')] [2022-07-13 14:47:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350537728. Throughput: 0: 9607.1. Samples: 701075724. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:23,993][27935] Avg episode reward: [(0, '-0.425')] [2022-07-13 14:47:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 350561280. Throughput: 0: 9590.8. Samples: 701133388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:28,989][27935] Avg episode reward: [(0, '-1.329')] [2022-07-13 14:47:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 350584832. Throughput: 0: 9584.7. Samples: 701191628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:33,989][27935] Avg episode reward: [(0, '-1.603')] [2022-07-13 14:47:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 350610432. Throughput: 0: 9579.0. Samples: 701220660. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:38,989][27935] Avg episode reward: [(0, '-2.073')] [2022-07-13 14:47:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 350633984. Throughput: 0: 9575.4. Samples: 701278328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:43,990][27935] Avg episode reward: [(0, '-2.632')] [2022-07-13 14:47:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 350659584. Throughput: 0: 9666.7. Samples: 701336852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:48,991][27935] Avg episode reward: [(0, '-2.840')] [2022-07-13 14:47:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350683136. Throughput: 0: 9669.4. Samples: 701366032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:53,989][27935] Avg episode reward: [(0, '-2.365')] [2022-07-13 14:47:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 350707712. Throughput: 0: 9671.7. Samples: 701424788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:47:58,989][27935] Avg episode reward: [(0, '-2.501')] [2022-07-13 14:48:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 350731264. Throughput: 0: 9608.2. Samples: 701479584. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:03,989][27935] Avg episode reward: [(0, '-0.963')] [2022-07-13 14:48:08,990][27935] Fps is (10 sec: 4607.4, 60 sec: 4795.6, 300 sec: 4821.5). Total num frames: 350753792. Throughput: 0: 9625.2. Samples: 701508868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:08,991][27935] Avg episode reward: [(0, '-0.619')] [2022-07-13 14:48:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350778368. Throughput: 0: 9652.1. Samples: 701567732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:13,989][27935] Avg episode reward: [(0, '-0.137')] [2022-07-13 14:48:18,989][27935] Fps is (10 sec: 4915.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 350802944. Throughput: 0: 9651.3. Samples: 701625936. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:18,991][27935] Avg episode reward: [(0, '0.142')] [2022-07-13 14:48:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.1). Total num frames: 350827520. Throughput: 0: 9653.2. Samples: 701655052. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:23,989][27935] Avg episode reward: [(0, '0.006')] [2022-07-13 14:48:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 350852096. Throughput: 0: 9672.8. Samples: 701713604. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:28,990][27935] Avg episode reward: [(0, '-0.188')] [2022-07-13 14:48:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 350875648. Throughput: 0: 9666.8. Samples: 701771860. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:33,989][27935] Avg episode reward: [(0, '-0.301')] [2022-07-13 14:48:38,991][27935] Fps is (10 sec: 4914.3, 60 sec: 4846.8, 300 sec: 4824.9). Total num frames: 350901248. Throughput: 0: 9662.6. Samples: 701800868. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:38,991][27935] Avg episode reward: [(0, '-0.185')] [2022-07-13 14:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 350924800. Throughput: 0: 9661.5. Samples: 701859556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:43,990][27935] Avg episode reward: [(0, '-0.325')] [2022-07-13 14:48:48,989][27935] Fps is (10 sec: 4711.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 350948352. Throughput: 0: 9743.6. Samples: 701918044. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:48,990][27935] Avg episode reward: [(0, '0.255')] [2022-07-13 14:48:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 350973952. Throughput: 0: 9740.5. Samples: 701947180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:53,989][27935] Avg episode reward: [(0, '0.546')] [2022-07-13 14:48:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 350998528. Throughput: 0: 9738.0. Samples: 702005940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:48:58,989][27935] Avg episode reward: [(0, '0.896')] [2022-07-13 14:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 351021056. Throughput: 0: 9660.0. Samples: 702060636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:49:03,989][27935] Avg episode reward: [(0, '0.921')] [2022-07-13 14:49:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.0, 300 sec: 4825.0). Total num frames: 351044608. Throughput: 0: 9654.6. Samples: 702089508. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 14:49:08,989][27935] Avg episode reward: [(0, '0.935')] [2022-07-13 14:49:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 351069184. Throughput: 0: 9657.9. Samples: 702148212. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:13,989][27935] Avg episode reward: [(0, '1.157')] [2022-07-13 14:49:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 351092736. Throughput: 0: 9653.4. Samples: 702206264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:18,989][27935] Avg episode reward: [(0, '0.963')] [2022-07-13 14:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 351118336. Throughput: 0: 9660.1. Samples: 702235556. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:23,989][27935] Avg episode reward: [(0, '1.016')] [2022-07-13 14:49:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 351141888. Throughput: 0: 9652.7. Samples: 702293928. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:28,997][27935] Avg episode reward: [(0, '0.842')] [2022-07-13 14:49:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 351165440. Throughput: 0: 9644.9. Samples: 702352064. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:33,989][27935] Avg episode reward: [(0, '1.201')] [2022-07-13 14:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4828.4). Total num frames: 351191040. Throughput: 0: 9640.2. Samples: 702380988. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:38,989][27935] Avg episode reward: [(0, '1.219')] [2022-07-13 14:49:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 351213568. Throughput: 0: 9637.2. Samples: 702439616. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:43,989][27935] Avg episode reward: [(0, '0.934')] [2022-07-13 14:49:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 351240192. Throughput: 0: 9714.3. Samples: 702497780. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:48,989][27935] Avg episode reward: [(0, '0.826')] [2022-07-13 14:49:53,992][27935] Fps is (10 sec: 5015.8, 60 sec: 4829.6, 300 sec: 4821.4). Total num frames: 351263744. Throughput: 0: 9719.1. Samples: 702526904. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:53,993][27935] Avg episode reward: [(0, '0.703')] [2022-07-13 14:49:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 351288320. Throughput: 0: 9722.7. Samples: 702585732. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:49:58,989][27935] Avg episode reward: [(0, '0.158')] [2022-07-13 14:50:03,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 351309824. Throughput: 0: 9644.5. Samples: 702640268. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:03,989][27935] Avg episode reward: [(0, '-0.003')] [2022-07-13 14:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 351334400. Throughput: 0: 9638.8. Samples: 702669304. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:08,989][27935] Avg episode reward: [(0, '0.107')] [2022-07-13 14:50:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 351358976. Throughput: 0: 9648.1. Samples: 702728092. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:13,989][27935] Avg episode reward: [(0, '0.104')] [2022-07-13 14:50:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 351383552. Throughput: 0: 9657.2. Samples: 702786640. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:18,990][27935] Avg episode reward: [(0, '-1.260')] [2022-07-13 14:50:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 351407104. Throughput: 0: 9671.2. Samples: 702816192. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:23,989][27935] Avg episode reward: [(0, '-1.377')] [2022-07-13 14:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 351432704. Throughput: 0: 9678.0. Samples: 702875124. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:28,989][27935] Avg episode reward: [(0, '-1.246')] [2022-07-13 14:50:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 351457280. Throughput: 0: 9681.6. Samples: 702933452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:33,989][27935] Avg episode reward: [(0, '-0.962')] [2022-07-13 14:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.5). Total num frames: 351480832. Throughput: 0: 9685.6. Samples: 702962720. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:38,989][27935] Avg episode reward: [(0, '-1.050')] [2022-07-13 14:50:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4824.9). Total num frames: 351505408. Throughput: 0: 9687.6. Samples: 703021676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:43,989][27935] Avg episode reward: [(0, '-1.095')] [2022-07-13 14:50:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 351529984. Throughput: 0: 9783.1. Samples: 703080508. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:48,991][27935] Avg episode reward: [(0, '0.650')] [2022-07-13 14:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.3, 300 sec: 4831.9). Total num frames: 351555584. Throughput: 0: 9789.0. Samples: 703109808. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:53,989][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 14:50:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 351579136. Throughput: 0: 9787.6. Samples: 703168532. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:50:58,991][27935] Avg episode reward: [(0, '-0.370')] [2022-07-13 14:51:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 351601664. Throughput: 0: 9704.4. Samples: 703223336. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:03,989][27935] Avg episode reward: [(0, '-0.178')] [2022-07-13 14:51:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 351627264. Throughput: 0: 9698.5. Samples: 703252624. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:08,989][27935] Avg episode reward: [(0, '-0.878')] [2022-07-13 14:51:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 351651840. Throughput: 0: 9700.3. Samples: 703311640. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:13,989][27935] Avg episode reward: [(0, '-0.687')] [2022-07-13 14:51:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 351674368. Throughput: 0: 9703.7. Samples: 703370120. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:18,989][27935] Avg episode reward: [(0, '-1.486')] [2022-07-13 14:51:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 351700992. Throughput: 0: 9705.1. Samples: 703399448. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:23,989][27935] Avg episode reward: [(0, '-1.558')] [2022-07-13 14:51:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 351723520. Throughput: 0: 9687.1. Samples: 703457596. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:28,989][27935] Avg episode reward: [(0, '-0.539')] [2022-07-13 14:51:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 351748096. Throughput: 0: 9680.8. Samples: 703516144. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:33,989][27935] Avg episode reward: [(0, '0.119')] [2022-07-13 14:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 351772672. Throughput: 0: 9684.2. Samples: 703545596. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:38,989][27935] Avg episode reward: [(0, '0.017')] [2022-07-13 14:51:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 351797248. Throughput: 0: 9682.7. Samples: 703604252. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 14:51:43,990][27935] Avg episode reward: [(0, '0.138')] [2022-07-13 14:51:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 351822848. Throughput: 0: 9774.0. Samples: 703663164. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:51:48,989][27935] Avg episode reward: [(0, '-0.437')] [2022-07-13 14:51:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 351846400. Throughput: 0: 9778.4. Samples: 703692652. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:51:53,989][27935] Avg episode reward: [(0, '-0.202')] [2022-07-13 14:51:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 351870976. Throughput: 0: 9779.0. Samples: 703751692. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:51:58,991][27935] Avg episode reward: [(0, '-0.238')] [2022-07-13 14:52:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 351893504. Throughput: 0: 9697.0. Samples: 703806484. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:03,991][27935] Avg episode reward: [(0, '-0.362')] [2022-07-13 14:52:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 351918080. Throughput: 0: 9697.4. Samples: 703835832. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:08,990][27935] Avg episode reward: [(0, '-0.525')] [2022-07-13 14:52:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 351942656. Throughput: 0: 9699.7. Samples: 703894084. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:13,989][27935] Avg episode reward: [(0, '0.164')] [2022-07-13 14:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 351966208. Throughput: 0: 9697.2. Samples: 703952516. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:18,991][27935] Avg episode reward: [(0, '0.319')] [2022-07-13 14:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 351990784. Throughput: 0: 9694.5. Samples: 703981848. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:23,991][27935] Avg episode reward: [(0, '1.125')] [2022-07-13 14:52:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 352015360. Throughput: 0: 9691.6. Samples: 704040376. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:28,989][27935] Avg episode reward: [(0, '1.188')] [2022-07-13 14:52:33,990][27935] Fps is (10 sec: 4914.5, 60 sec: 4863.9, 300 sec: 4845.8). Total num frames: 352039936. Throughput: 0: 9675.3. Samples: 704098564. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:33,991][27935] Avg episode reward: [(0, '1.213')] [2022-07-13 14:52:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 352063488. Throughput: 0: 9666.8. Samples: 704127660. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:38,989][27935] Avg episode reward: [(0, '0.965')] [2022-07-13 14:52:43,989][27935] Fps is (10 sec: 4711.1, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 352087040. Throughput: 0: 9637.1. Samples: 704185360. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:43,989][27935] Avg episode reward: [(0, '0.781')] [2022-07-13 14:52:48,997][27935] Fps is (10 sec: 4809.1, 60 sec: 4812.2, 300 sec: 4842.2). Total num frames: 352111616. Throughput: 0: 9709.0. Samples: 704243464. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:48,997][27935] Avg episode reward: [(0, '0.871')] [2022-07-13 14:52:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 352136192. Throughput: 0: 9700.1. Samples: 704272336. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:53,993][27935] Avg episode reward: [(0, '0.793')] [2022-07-13 14:52:58,989][27935] Fps is (10 sec: 4919.0, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 352160768. Throughput: 0: 9706.7. Samples: 704330884. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:52:58,989][27935] Avg episode reward: [(0, '0.888')] [2022-07-13 14:53:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 352183296. Throughput: 0: 9619.7. Samples: 704385404. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:03,989][27935] Avg episode reward: [(0, '0.693')] [2022-07-13 14:53:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 352206848. Throughput: 0: 9617.1. Samples: 704414620. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:08,989][27935] Avg episode reward: [(0, '1.198')] [2022-07-13 14:53:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 352232448. Throughput: 0: 9603.4. Samples: 704472528. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:13,989][27935] Avg episode reward: [(0, '1.409')] [2022-07-13 14:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 352254976. Throughput: 0: 9620.1. Samples: 704531456. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:18,989][27935] Avg episode reward: [(0, '-0.174')] [2022-07-13 14:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 352280576. Throughput: 0: 9612.0. Samples: 704560200. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:23,989][27935] Avg episode reward: [(0, '-0.329')] [2022-07-13 14:53:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 352304128. Throughput: 0: 9592.4. Samples: 704617020. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:28,989][27935] Avg episode reward: [(0, '-0.380')] [2022-07-13 14:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.8, 300 sec: 4835.4). Total num frames: 352327680. Throughput: 0: 9586.7. Samples: 704674792. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:33,989][27935] Avg episode reward: [(0, '-0.506')] [2022-07-13 14:53:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 352351232. Throughput: 0: 9589.1. Samples: 704703844. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:38,989][27935] Avg episode reward: [(0, '-0.514')] [2022-07-13 14:53:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 352376832. Throughput: 0: 9592.5. Samples: 704762548. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:43,989][27935] Avg episode reward: [(0, '-0.672')] [2022-07-13 14:53:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4830.5, 300 sec: 4838.8). Total num frames: 352401408. Throughput: 0: 9678.2. Samples: 704820924. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:48,989][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 14:53:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 352423936. Throughput: 0: 9674.1. Samples: 704849956. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:53,989][27935] Avg episode reward: [(0, '-0.036')] [2022-07-13 14:53:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 352450560. Throughput: 0: 9683.3. Samples: 704908276. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:53:58,989][27935] Avg episode reward: [(0, '-0.574')] [2022-07-13 14:54:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 352472064. Throughput: 0: 9589.3. Samples: 704962976. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:54:03,991][27935] Avg episode reward: [(0, '-0.602')] [2022-07-13 14:54:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 352496640. Throughput: 0: 9602.0. Samples: 704992288. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:54:08,990][27935] Avg episode reward: [(0, '-0.669')] [2022-07-13 14:54:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 352520192. Throughput: 0: 9640.2. Samples: 705050828. Policy #0 lag: (min: 0.0, avg: 10.2, max: 23.0) [2022-07-13 14:54:13,989][27935] Avg episode reward: [(0, '-1.728')] [2022-07-13 14:54:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 352544768. Throughput: 0: 9660.3. Samples: 705109504. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:18,989][27935] Avg episode reward: [(0, '-2.038')] [2022-07-13 14:54:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 352570368. Throughput: 0: 9672.2. Samples: 705139092. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:23,989][27935] Avg episode reward: [(0, '-1.339')] [2022-07-13 14:54:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 352593920. Throughput: 0: 9669.2. Samples: 705197664. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:28,989][27935] Avg episode reward: [(0, '-0.833')] [2022-07-13 14:54:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 352618496. Throughput: 0: 9664.3. Samples: 705255816. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:33,989][27935] Avg episode reward: [(0, '-0.439')] [2022-07-13 14:54:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 352642048. Throughput: 0: 9666.7. Samples: 705284960. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:38,990][27935] Avg episode reward: [(0, '-0.300')] [2022-07-13 14:54:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 352667648. Throughput: 0: 9665.1. Samples: 705343208. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:43,990][27935] Avg episode reward: [(0, '0.782')] [2022-07-13 14:54:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 352689152. Throughput: 0: 9749.7. Samples: 705401712. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:48,990][27935] Avg episode reward: [(0, '1.047')] [2022-07-13 14:54:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 352715776. Throughput: 0: 9745.2. Samples: 705430824. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:53,989][27935] Avg episode reward: [(0, '0.325')] [2022-07-13 14:54:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 352740352. Throughput: 0: 9740.4. Samples: 705489148. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:54:58,989][27935] Avg episode reward: [(0, '0.228')] [2022-07-13 14:55:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 352760832. Throughput: 0: 9651.7. Samples: 705543832. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:03,989][27935] Avg episode reward: [(0, '0.217')] [2022-07-13 14:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 352786432. Throughput: 0: 9641.3. Samples: 705572952. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:08,989][27935] Avg episode reward: [(0, '-0.211')] [2022-07-13 14:55:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 352809984. Throughput: 0: 9642.6. Samples: 705631580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:13,989][27935] Avg episode reward: [(0, '-0.613')] [2022-07-13 14:55:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 352836608. Throughput: 0: 9649.0. Samples: 705690020. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:18,991][27935] Avg episode reward: [(0, '-0.910')] [2022-07-13 14:55:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 352859136. Throughput: 0: 9654.9. Samples: 705719432. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:23,990][27935] Avg episode reward: [(0, '-1.220')] [2022-07-13 14:55:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 352883712. Throughput: 0: 9653.2. Samples: 705777604. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:28,989][27935] Avg episode reward: [(0, '-0.462')] [2022-07-13 14:55:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 352907264. Throughput: 0: 9649.1. Samples: 705835920. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:33,991][27935] Avg episode reward: [(0, '-1.627')] [2022-07-13 14:55:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 352932864. Throughput: 0: 9645.0. Samples: 705864848. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:38,990][27935] Avg episode reward: [(0, '-1.553')] [2022-07-13 14:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 352957440. Throughput: 0: 9655.1. Samples: 705923628. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:43,990][27935] Avg episode reward: [(0, '-0.921')] [2022-07-13 14:55:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 352980992. Throughput: 0: 9727.0. Samples: 705981548. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:48,989][27935] Avg episode reward: [(0, '-1.476')] [2022-07-13 14:55:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 353005568. Throughput: 0: 9726.8. Samples: 706010656. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:53,989][27935] Avg episode reward: [(0, '-1.474')] [2022-07-13 14:55:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 353028096. Throughput: 0: 9719.4. Samples: 706068952. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:55:58,990][27935] Avg episode reward: [(0, '-1.572')] [2022-07-13 14:56:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 353052672. Throughput: 0: 9633.3. Samples: 706123520. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:03,990][27935] Avg episode reward: [(0, '-0.904')] [2022-07-13 14:56:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 353076224. Throughput: 0: 9628.6. Samples: 706152720. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:08,989][27935] Avg episode reward: [(0, '-1.049')] [2022-07-13 14:56:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 353100800. Throughput: 0: 9635.4. Samples: 706211196. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:13,989][27935] Avg episode reward: [(0, '-0.181')] [2022-07-13 14:56:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 353125376. Throughput: 0: 9633.2. Samples: 706269416. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:18,989][27935] Avg episode reward: [(0, '0.385')] [2022-07-13 14:56:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 353147904. Throughput: 0: 9638.2. Samples: 706298568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:23,989][27935] Avg episode reward: [(0, '0.151')] [2022-07-13 14:56:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 353174528. Throughput: 0: 9617.8. Samples: 706356428. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:28,989][27935] Avg episode reward: [(0, '0.590')] [2022-07-13 14:56:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 353197056. Throughput: 0: 9632.9. Samples: 706415028. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:33,990][27935] Avg episode reward: [(0, '0.622')] [2022-07-13 14:56:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 353222656. Throughput: 0: 9630.3. Samples: 706444020. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:38,990][27935] Avg episode reward: [(0, '0.869')] [2022-07-13 14:56:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 353245184. Throughput: 0: 9632.7. Samples: 706502424. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:43,989][27935] Avg episode reward: [(0, '1.126')] [2022-07-13 14:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 353271808. Throughput: 0: 9719.5. Samples: 706560896. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 14:56:48,989][27935] Avg episode reward: [(0, '1.016')] [2022-07-13 14:56:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 353294336. Throughput: 0: 9718.0. Samples: 706590032. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:56:53,991][27935] Avg episode reward: [(0, '0.171')] [2022-07-13 14:56:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 353318912. Throughput: 0: 9719.1. Samples: 706648556. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:56:58,991][27935] Avg episode reward: [(0, '0.218')] [2022-07-13 14:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 353341440. Throughput: 0: 9633.1. Samples: 706702904. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:03,989][27935] Avg episode reward: [(0, '0.467')] [2022-07-13 14:57:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 353366016. Throughput: 0: 9636.9. Samples: 706732228. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:08,989][27935] Avg episode reward: [(0, '0.617')] [2022-07-13 14:57:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 353391616. Throughput: 0: 9646.7. Samples: 706790528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:13,989][27935] Avg episode reward: [(0, '0.398')] [2022-07-13 14:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 353414144. Throughput: 0: 9645.9. Samples: 706849096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:18,989][27935] Avg episode reward: [(0, '-1.116')] [2022-07-13 14:57:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 353438720. Throughput: 0: 9653.4. Samples: 706878424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:23,989][27935] Avg episode reward: [(0, '-1.064')] [2022-07-13 14:57:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4825.0). Total num frames: 353463296. Throughput: 0: 9653.5. Samples: 706936832. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:28,989][27935] Avg episode reward: [(0, '-0.612')] [2022-07-13 14:57:33,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4846.8, 300 sec: 4828.4). Total num frames: 353487872. Throughput: 0: 9646.6. Samples: 706995012. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:33,991][27935] Avg episode reward: [(0, '-0.840')] [2022-07-13 14:57:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 353512448. Throughput: 0: 9652.7. Samples: 707024404. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:38,989][27935] Avg episode reward: [(0, '-0.934')] [2022-07-13 14:57:43,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4846.9, 300 sec: 4828.5). Total num frames: 353536000. Throughput: 0: 9639.2. Samples: 707082320. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:43,989][27935] Avg episode reward: [(0, '-1.249')] [2022-07-13 14:57:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 353561600. Throughput: 0: 9738.3. Samples: 707141128. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:48,989][27935] Avg episode reward: [(0, '0.228')] [2022-07-13 14:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 353585152. Throughput: 0: 9744.4. Samples: 707170724. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:53,990][27935] Avg episode reward: [(0, '0.373')] [2022-07-13 14:57:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 353609728. Throughput: 0: 9760.0. Samples: 707229728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:57:58,989][27935] Avg episode reward: [(0, '1.035')] [2022-07-13 14:58:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 353632256. Throughput: 0: 9681.7. Samples: 707284772. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:03,990][27935] Avg episode reward: [(0, '0.970')] [2022-07-13 14:58:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 353657856. Throughput: 0: 9688.4. Samples: 707314400. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:08,990][27935] Avg episode reward: [(0, '0.222')] [2022-07-13 14:58:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 353681408. Throughput: 0: 9693.4. Samples: 707373036. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:13,991][27935] Avg episode reward: [(0, '-0.093')] [2022-07-13 14:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 353705984. Throughput: 0: 9693.4. Samples: 707431196. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:18,989][27935] Avg episode reward: [(0, '0.297')] [2022-07-13 14:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 353729536. Throughput: 0: 9693.5. Samples: 707460612. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:23,989][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 14:58:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 353754112. Throughput: 0: 9704.4. Samples: 707519020. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:28,990][27935] Avg episode reward: [(0, '-1.227')] [2022-07-13 14:58:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4838.8). Total num frames: 353778688. Throughput: 0: 9694.7. Samples: 707577388. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:33,989][27935] Avg episode reward: [(0, '-0.512')] [2022-07-13 14:58:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 353804288. Throughput: 0: 9691.2. Samples: 707606828. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:38,990][27935] Avg episode reward: [(0, '-0.990')] [2022-07-13 14:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 353827840. Throughput: 0: 9687.9. Samples: 707665684. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:43,989][27935] Avg episode reward: [(0, '-0.575')] [2022-07-13 14:58:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 353852416. Throughput: 0: 9774.4. Samples: 707724620. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:48,989][27935] Avg episode reward: [(0, '-1.453')] [2022-07-13 14:58:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 353876992. Throughput: 0: 9770.0. Samples: 707754048. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:53,989][27935] Avg episode reward: [(0, '-2.081')] [2022-07-13 14:58:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 353902592. Throughput: 0: 9781.1. Samples: 707813184. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:58:58,989][27935] Avg episode reward: [(0, '-2.012')] [2022-07-13 14:59:03,992][27935] Fps is (10 sec: 4811.3, 60 sec: 4880.8, 300 sec: 4842.3). Total num frames: 353925120. Throughput: 0: 9696.2. Samples: 707867556. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:59:03,992][27935] Avg episode reward: [(0, '-2.260')] [2022-07-13 14:59:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 353948672. Throughput: 0: 9701.4. Samples: 707897176. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:59:08,989][27935] Avg episode reward: [(0, '-2.250')] [2022-07-13 14:59:13,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 353974272. Throughput: 0: 9700.5. Samples: 707955544. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:59:13,989][27935] Avg episode reward: [(0, '-2.323')] [2022-07-13 14:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 353995776. Throughput: 0: 9704.6. Samples: 708014096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 19.0) [2022-07-13 14:59:18,989][27935] Avg episode reward: [(0, '-2.172')] [2022-07-13 14:59:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 354021376. Throughput: 0: 9697.5. Samples: 708043216. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:23,991][27935] Avg episode reward: [(0, '-1.534')] [2022-07-13 14:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 354044928. Throughput: 0: 9662.8. Samples: 708100512. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:28,989][27935] Avg episode reward: [(0, '-0.354')] [2022-07-13 14:59:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 354070528. Throughput: 0: 9641.5. Samples: 708158488. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:33,989][27935] Avg episode reward: [(0, '-0.913')] [2022-07-13 14:59:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 354093056. Throughput: 0: 9647.7. Samples: 708188196. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:38,989][27935] Avg episode reward: [(0, '-1.147')] [2022-07-13 14:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 354119680. Throughput: 0: 9645.2. Samples: 708247220. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:43,989][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 14:59:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 354143232. Throughput: 0: 9736.7. Samples: 708305680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:48,989][27935] Avg episode reward: [(0, '-0.802')] [2022-07-13 14:59:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 354166784. Throughput: 0: 9727.0. Samples: 708334892. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:53,989][27935] Avg episode reward: [(0, '-0.037')] [2022-07-13 14:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 354192384. Throughput: 0: 9733.4. Samples: 708393548. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 14:59:58,989][27935] Avg episode reward: [(0, '-0.024')] [2022-07-13 15:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4813.0, 300 sec: 4838.8). Total num frames: 354213888. Throughput: 0: 9639.0. Samples: 708447852. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:03,989][27935] Avg episode reward: [(0, '0.498')] [2022-07-13 15:00:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 354238464. Throughput: 0: 9640.5. Samples: 708477036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:08,993][27935] Avg episode reward: [(0, '0.510')] [2022-07-13 15:00:13,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4812.7, 300 sec: 4835.3). Total num frames: 354263040. Throughput: 0: 9670.5. Samples: 708535696. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:13,991][27935] Avg episode reward: [(0, '0.593')] [2022-07-13 15:00:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 354286592. Throughput: 0: 9680.6. Samples: 708594116. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:18,989][27935] Avg episode reward: [(0, '0.329')] [2022-07-13 15:00:23,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 354311168. Throughput: 0: 9671.2. Samples: 708623400. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:23,992][27935] Avg episode reward: [(0, '0.547')] [2022-07-13 15:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 354335744. Throughput: 0: 9666.7. Samples: 708682220. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:28,989][27935] Avg episode reward: [(0, '0.436')] [2022-07-13 15:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 354360320. Throughput: 0: 9661.4. Samples: 708740444. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:33,989][27935] Avg episode reward: [(0, '0.496')] [2022-07-13 15:00:38,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 354384896. Throughput: 0: 9656.2. Samples: 708769420. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:38,989][27935] Avg episode reward: [(0, '0.545')] [2022-07-13 15:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 354408448. Throughput: 0: 9653.1. Samples: 708827936. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:43,989][27935] Avg episode reward: [(0, '0.851')] [2022-07-13 15:00:48,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 354433024. Throughput: 0: 9747.3. Samples: 708886480. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:48,989][27935] Avg episode reward: [(0, '0.845')] [2022-07-13 15:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 354458624. Throughput: 0: 9741.8. Samples: 708915416. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:53,989][27935] Avg episode reward: [(0, '1.344')] [2022-07-13 15:00:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 354482176. Throughput: 0: 9732.4. Samples: 708973640. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:00:58,989][27935] Avg episode reward: [(0, '0.653')] [2022-07-13 15:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 354505728. Throughput: 0: 9080.5. Samples: 709002740. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:03,992][27935] Avg episode reward: [(0, '0.679')] [2022-07-13 15:01:08,996][27935] Fps is (10 sec: 4604.5, 60 sec: 4829.3, 300 sec: 4838.7). Total num frames: 354528256. Throughput: 0: 9636.5. Samples: 709057116. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:08,997][27935] Avg episode reward: [(0, '0.556')] [2022-07-13 15:01:13,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4812.9, 300 sec: 4835.4). Total num frames: 354551808. Throughput: 0: 9628.6. Samples: 709115508. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:13,989][27935] Avg episode reward: [(0, '0.545')] [2022-07-13 15:01:18,989][27935] Fps is (10 sec: 5021.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 354578432. Throughput: 0: 9634.6. Samples: 709174000. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:18,989][27935] Avg episode reward: [(0, '-0.174')] [2022-07-13 15:01:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 354601984. Throughput: 0: 9635.2. Samples: 709203004. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:23,989][27935] Avg episode reward: [(0, '-0.900')] [2022-07-13 15:01:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 354625536. Throughput: 0: 9628.3. Samples: 709261208. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:28,989][27935] Avg episode reward: [(0, '-1.225')] [2022-07-13 15:01:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 354649088. Throughput: 0: 9612.0. Samples: 709319020. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:33,989][27935] Avg episode reward: [(0, '-1.196')] [2022-07-13 15:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 354673664. Throughput: 0: 9609.6. Samples: 709347848. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:38,989][27935] Avg episode reward: [(0, '-1.207')] [2022-07-13 15:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 354698240. Throughput: 0: 9612.8. Samples: 709406216. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:43,989][27935] Avg episode reward: [(0, '-1.499')] [2022-07-13 15:01:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 354722816. Throughput: 0: 10274.7. Samples: 709465100. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:48,989][27935] Avg episode reward: [(0, '-1.682')] [2022-07-13 15:01:53,992][27935] Fps is (10 sec: 5016.0, 60 sec: 4829.6, 300 sec: 4845.7). Total num frames: 354748416. Throughput: 0: 9722.8. Samples: 709494600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 15:01:53,994][27935] Avg episode reward: [(0, '-0.285')] [2022-07-13 15:01:58,990][27935] Fps is (10 sec: 4812.4, 60 sec: 4812.7, 300 sec: 4845.8). Total num frames: 354770944. Throughput: 0: 9720.3. Samples: 709552928. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:01:58,990][27935] Avg episode reward: [(0, '-0.103')] [2022-07-13 15:02:03,994][27935] Fps is (10 sec: 4402.3, 60 sec: 4778.2, 300 sec: 4835.3). Total num frames: 354792448. Throughput: 0: 9640.0. Samples: 709607852. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:03,995][27935] Avg episode reward: [(0, '0.774')] [2022-07-13 15:02:08,992][27935] Fps is (10 sec: 4811.8, 60 sec: 4847.3, 300 sec: 4838.8). Total num frames: 354819072. Throughput: 0: 9638.4. Samples: 709636760. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:08,995][27935] Avg episode reward: [(0, '0.779')] [2022-07-13 15:02:13,989][27935] Fps is (10 sec: 5020.3, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 354842624. Throughput: 0: 9649.1. Samples: 709695420. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:13,989][27935] Avg episode reward: [(0, '0.314')] [2022-07-13 15:02:18,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 354867200. Throughput: 0: 9650.7. Samples: 709753300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:18,989][27935] Avg episode reward: [(0, '0.417')] [2022-07-13 15:02:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 354890752. Throughput: 0: 9651.4. Samples: 709782160. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:23,989][27935] Avg episode reward: [(0, '0.827')] [2022-07-13 15:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.9). Total num frames: 354915328. Throughput: 0: 9635.8. Samples: 709839828. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:28,989][27935] Avg episode reward: [(0, '1.029')] [2022-07-13 15:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 354939904. Throughput: 0: 9620.0. Samples: 709898000. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:33,989][27935] Avg episode reward: [(0, '0.493')] [2022-07-13 15:02:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 354962432. Throughput: 0: 9608.3. Samples: 709926944. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:38,989][27935] Avg episode reward: [(0, '0.126')] [2022-07-13 15:02:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 354987008. Throughput: 0: 9595.6. Samples: 709984724. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:43,990][27935] Avg episode reward: [(0, '0.450')] [2022-07-13 15:02:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 355011584. Throughput: 0: 9673.7. Samples: 710043116. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:48,989][27935] Avg episode reward: [(0, '0.666')] [2022-07-13 15:02:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4796.0, 300 sec: 4835.4). Total num frames: 355036160. Throughput: 0: 9683.1. Samples: 710072472. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:53,989][27935] Avg episode reward: [(0, '-0.030')] [2022-07-13 15:02:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.9, 300 sec: 4838.8). Total num frames: 355059712. Throughput: 0: 9686.2. Samples: 710131300. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:02:58,993][27935] Avg episode reward: [(0, '-0.016')] [2022-07-13 15:03:03,992][27935] Fps is (10 sec: 4709.1, 60 sec: 4847.1, 300 sec: 4831.8). Total num frames: 355083264. Throughput: 0: 9608.2. Samples: 710185696. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:03,992][27935] Avg episode reward: [(0, '0.021')] [2022-07-13 15:03:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.0, 300 sec: 4835.4). Total num frames: 355107840. Throughput: 0: 9616.4. Samples: 710214900. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:08,989][27935] Avg episode reward: [(0, '-0.112')] [2022-07-13 15:03:13,997][27935] Fps is (10 sec: 5015.0, 60 sec: 4846.3, 300 sec: 4838.7). Total num frames: 355133440. Throughput: 0: 9644.4. Samples: 710273904. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:13,997][27935] Avg episode reward: [(0, '-0.110')] [2022-07-13 15:03:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 355155968. Throughput: 0: 9657.7. Samples: 710332596. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:18,989][27935] Avg episode reward: [(0, '0.162')] [2022-07-13 15:03:23,989][27935] Fps is (10 sec: 4816.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 355181568. Throughput: 0: 9671.2. Samples: 710362148. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:23,989][27935] Avg episode reward: [(0, '0.218')] [2022-07-13 15:03:28,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4829.6, 300 sec: 4835.3). Total num frames: 355205120. Throughput: 0: 9696.9. Samples: 710421124. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:28,993][27935] Avg episode reward: [(0, '-0.073')] [2022-07-13 15:03:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 355229696. Throughput: 0: 9707.5. Samples: 710479952. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:33,989][27935] Avg episode reward: [(0, '-0.692')] [2022-07-13 15:03:38,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 355254272. Throughput: 0: 9701.8. Samples: 710509052. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:38,990][27935] Avg episode reward: [(0, '-0.655')] [2022-07-13 15:03:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 355278848. Throughput: 0: 9715.8. Samples: 710568512. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:43,989][27935] Avg episode reward: [(0, '-0.016')] [2022-07-13 15:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 355304448. Throughput: 0: 9814.1. Samples: 710627304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:48,989][27935] Avg episode reward: [(0, '-0.056')] [2022-07-13 15:03:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 355329024. Throughput: 0: 9828.2. Samples: 710657168. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:53,989][27935] Avg episode reward: [(0, '-0.471')] [2022-07-13 15:03:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 355351552. Throughput: 0: 9824.7. Samples: 710715940. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:03:58,989][27935] Avg episode reward: [(0, '0.472')] [2022-07-13 15:04:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.3, 300 sec: 4838.8). Total num frames: 355376128. Throughput: 0: 9744.1. Samples: 710771080. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:03,989][27935] Avg episode reward: [(0, '0.385')] [2022-07-13 15:04:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 355400704. Throughput: 0: 9746.2. Samples: 710800728. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:08,989][27935] Avg episode reward: [(0, '0.274')] [2022-07-13 15:04:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.6, 300 sec: 4842.3). Total num frames: 355424256. Throughput: 0: 9755.9. Samples: 710860104. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:13,989][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 15:04:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4845.8). Total num frames: 355450880. Throughput: 0: 9750.4. Samples: 710918720. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:18,989][27935] Avg episode reward: [(0, '0.083')] [2022-07-13 15:04:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 355474432. Throughput: 0: 9764.6. Samples: 710948460. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:23,990][27935] Avg episode reward: [(0, '-0.709')] [2022-07-13 15:04:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.5, 300 sec: 4845.8). Total num frames: 355500032. Throughput: 0: 9755.9. Samples: 711007528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 15:04:28,989][27935] Avg episode reward: [(0, '-0.655')] [2022-07-13 15:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 355523584. Throughput: 0: 9748.9. Samples: 711066004. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:33,990][27935] Avg episode reward: [(0, '-0.942')] [2022-07-13 15:04:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4838.8). Total num frames: 355547136. Throughput: 0: 9727.2. Samples: 711094892. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:38,992][27935] Avg episode reward: [(0, '0.189')] [2022-07-13 15:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 355572736. Throughput: 0: 9733.2. Samples: 711153932. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:43,989][27935] Avg episode reward: [(0, '0.487')] [2022-07-13 15:04:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 355595264. Throughput: 0: 9817.9. Samples: 711212884. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:48,989][27935] Avg episode reward: [(0, '0.489')] [2022-07-13 15:04:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 355619840. Throughput: 0: 9806.8. Samples: 711242036. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:53,989][27935] Avg episode reward: [(0, '0.725')] [2022-07-13 15:04:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4856.2). Total num frames: 355646464. Throughput: 0: 9792.5. Samples: 711300764. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:04:58,989][27935] Avg episode reward: [(0, '0.613')] [2022-07-13 15:05:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 355668992. Throughput: 0: 9707.0. Samples: 711355536. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:03,989][27935] Avg episode reward: [(0, '0.806')] [2022-07-13 15:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 355692544. Throughput: 0: 9701.4. Samples: 711385024. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:08,989][27935] Avg episode reward: [(0, '0.276')] [2022-07-13 15:05:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 355716096. Throughput: 0: 9702.8. Samples: 711444156. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:13,989][27935] Avg episode reward: [(0, '-0.143')] [2022-07-13 15:05:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 355741696. Throughput: 0: 9700.6. Samples: 711502532. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:18,989][27935] Avg episode reward: [(0, '-0.437')] [2022-07-13 15:05:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 355766272. Throughput: 0: 9717.4. Samples: 711532176. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:23,991][27935] Avg episode reward: [(0, '-0.353')] [2022-07-13 15:05:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 355789824. Throughput: 0: 9711.3. Samples: 711590940. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:28,990][27935] Avg episode reward: [(0, '0.228')] [2022-07-13 15:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 355814400. Throughput: 0: 9648.2. Samples: 711647052. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:33,989][27935] Avg episode reward: [(0, '-0.291')] [2022-07-13 15:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 355837952. Throughput: 0: 9650.6. Samples: 711676312. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:38,989][27935] Avg episode reward: [(0, '-0.250')] [2022-07-13 15:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 355863552. Throughput: 0: 9652.9. Samples: 711735144. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:43,990][27935] Avg episode reward: [(0, '0.032')] [2022-07-13 15:05:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 355887104. Throughput: 0: 9739.9. Samples: 711793832. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:48,991][27935] Avg episode reward: [(0, '0.878')] [2022-07-13 15:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 355910656. Throughput: 0: 9737.8. Samples: 711823224. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:53,990][27935] Avg episode reward: [(0, '0.703')] [2022-07-13 15:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 355936256. Throughput: 0: 9732.3. Samples: 711882108. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:05:58,991][27935] Avg episode reward: [(0, '0.835')] [2022-07-13 15:06:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.4). Total num frames: 355958784. Throughput: 0: 9651.5. Samples: 711936848. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:03,989][27935] Avg episode reward: [(0, '0.062')] [2022-07-13 15:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 355982336. Throughput: 0: 9644.4. Samples: 711966176. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:08,989][27935] Avg episode reward: [(0, '0.460')] [2022-07-13 15:06:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 356007936. Throughput: 0: 9638.4. Samples: 712024668. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:13,996][27935] Avg episode reward: [(0, '-0.504')] [2022-07-13 15:06:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 356033536. Throughput: 0: 9691.2. Samples: 712083156. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:18,989][27935] Avg episode reward: [(0, '-0.623')] [2022-07-13 15:06:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 356055040. Throughput: 0: 9687.3. Samples: 712112240. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:23,989][27935] Avg episode reward: [(0, '-0.794')] [2022-07-13 15:06:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 356080640. Throughput: 0: 9679.9. Samples: 712170740. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:28,989][27935] Avg episode reward: [(0, '-1.171')] [2022-07-13 15:06:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 356105216. Throughput: 0: 9669.0. Samples: 712228936. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:33,989][27935] Avg episode reward: [(0, '-1.110')] [2022-07-13 15:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 356129792. Throughput: 0: 9666.3. Samples: 712258208. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:38,989][27935] Avg episode reward: [(0, '-0.292')] [2022-07-13 15:06:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 356153344. Throughput: 0: 9657.3. Samples: 712316684. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:43,989][27935] Avg episode reward: [(0, '-0.708')] [2022-07-13 15:06:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 356177920. Throughput: 0: 9752.8. Samples: 712375724. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:48,989][27935] Avg episode reward: [(0, '0.134')] [2022-07-13 15:06:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 356203520. Throughput: 0: 9753.1. Samples: 712405064. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:53,989][27935] Avg episode reward: [(0, '0.475')] [2022-07-13 15:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 356226048. Throughput: 0: 9764.5. Samples: 712464068. Policy #0 lag: (min: 0.0, avg: 10.4, max: 20.0) [2022-07-13 15:06:58,989][27935] Avg episode reward: [(0, '0.232')] [2022-07-13 15:07:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4849.3). Total num frames: 356249600. Throughput: 0: 9687.5. Samples: 712519092. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:03,989][27935] Avg episode reward: [(0, '0.003')] [2022-07-13 15:07:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 356275200. Throughput: 0: 9691.1. Samples: 712548340. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:08,989][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 15:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 356298752. Throughput: 0: 9705.4. Samples: 712607484. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:13,989][27935] Avg episode reward: [(0, '0.410')] [2022-07-13 15:07:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 356323328. Throughput: 0: 9716.6. Samples: 712666184. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:18,989][27935] Avg episode reward: [(0, '0.581')] [2022-07-13 15:07:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 356347904. Throughput: 0: 9715.8. Samples: 712695420. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:23,989][27935] Avg episode reward: [(0, '0.540')] [2022-07-13 15:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 356372480. Throughput: 0: 9733.0. Samples: 712754668. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:28,989][27935] Avg episode reward: [(0, '0.605')] [2022-07-13 15:07:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 356397056. Throughput: 0: 9716.1. Samples: 712812948. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:33,989][27935] Avg episode reward: [(0, '0.895')] [2022-07-13 15:07:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 356420608. Throughput: 0: 9711.7. Samples: 712842092. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:38,990][27935] Avg episode reward: [(0, '0.960')] [2022-07-13 15:07:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 356445184. Throughput: 0: 9690.7. Samples: 712900148. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:43,989][27935] Avg episode reward: [(0, '0.562')] [2022-07-13 15:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 356468736. Throughput: 0: 9776.9. Samples: 712959052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:48,989][27935] Avg episode reward: [(0, '0.466')] [2022-07-13 15:07:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 356494336. Throughput: 0: 9779.0. Samples: 712988396. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:53,990][27935] Avg episode reward: [(0, '-0.087')] [2022-07-13 15:07:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 356518912. Throughput: 0: 9766.1. Samples: 713046960. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:07:58,991][27935] Avg episode reward: [(0, '-0.749')] [2022-07-13 15:08:03,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4863.8, 300 sec: 4859.6). Total num frames: 356541440. Throughput: 0: 9670.3. Samples: 713101368. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:03,991][27935] Avg episode reward: [(0, '-1.645')] [2022-07-13 15:08:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4852.8). Total num frames: 356564992. Throughput: 0: 9674.8. Samples: 713130784. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:08,989][27935] Avg episode reward: [(0, '-1.530')] [2022-07-13 15:08:13,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 356589568. Throughput: 0: 9655.3. Samples: 713189156. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:13,989][27935] Avg episode reward: [(0, '-1.379')] [2022-07-13 15:08:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 356614144. Throughput: 0: 9659.1. Samples: 713247608. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:18,989][27935] Avg episode reward: [(0, '-1.483')] [2022-07-13 15:08:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 356638720. Throughput: 0: 9663.9. Samples: 713276968. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:23,989][27935] Avg episode reward: [(0, '-2.847')] [2022-07-13 15:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 356662272. Throughput: 0: 9687.3. Samples: 713336076. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:28,989][27935] Avg episode reward: [(0, '-2.120')] [2022-07-13 15:08:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 356686848. Throughput: 0: 9663.9. Samples: 713393928. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:33,989][27935] Avg episode reward: [(0, '-1.621')] [2022-07-13 15:08:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 356712448. Throughput: 0: 9662.2. Samples: 713423196. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:38,989][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 15:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 356736000. Throughput: 0: 9668.7. Samples: 713482052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:43,989][27935] Avg episode reward: [(0, '-1.641')] [2022-07-13 15:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 356761600. Throughput: 0: 9776.5. Samples: 713541288. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:48,990][27935] Avg episode reward: [(0, '-1.749')] [2022-07-13 15:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 356785152. Throughput: 0: 9778.6. Samples: 713570820. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:53,989][27935] Avg episode reward: [(0, '-0.572')] [2022-07-13 15:08:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 356809728. Throughput: 0: 9787.0. Samples: 713629568. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:08:58,989][27935] Avg episode reward: [(0, '-0.594')] [2022-07-13 15:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.1, 300 sec: 4852.7). Total num frames: 356832256. Throughput: 0: 9710.1. Samples: 713684564. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:03,991][27935] Avg episode reward: [(0, '0.242')] [2022-07-13 15:09:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 356855808. Throughput: 0: 9707.3. Samples: 713713796. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:08,991][27935] Avg episode reward: [(0, '-0.018')] [2022-07-13 15:09:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 356882432. Throughput: 0: 9707.6. Samples: 713772920. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:13,989][27935] Avg episode reward: [(0, '-0.321')] [2022-07-13 15:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 356904960. Throughput: 0: 9731.9. Samples: 713831864. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:18,989][27935] Avg episode reward: [(0, '-0.163')] [2022-07-13 15:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 356931584. Throughput: 0: 9740.2. Samples: 713861504. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:23,989][27935] Avg episode reward: [(0, '-0.143')] [2022-07-13 15:09:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 356955136. Throughput: 0: 9745.1. Samples: 713920580. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:28,991][27935] Avg episode reward: [(0, '0.380')] [2022-07-13 15:09:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 356980736. Throughput: 0: 9730.1. Samples: 713979144. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 15:09:33,989][27935] Avg episode reward: [(0, '-0.062')] [2022-07-13 15:09:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 357003264. Throughput: 0: 9727.5. Samples: 714008556. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:09:38,991][27935] Avg episode reward: [(0, '-0.771')] [2022-07-13 15:09:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4866.6). Total num frames: 357030912. Throughput: 0: 9743.7. Samples: 714068036. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:09:43,989][27935] Avg episode reward: [(0, '-0.777')] [2022-07-13 15:09:48,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 357053440. Throughput: 0: 9831.1. Samples: 714126968. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:09:48,991][27935] Avg episode reward: [(0, '-0.820')] [2022-07-13 15:09:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 357079040. Throughput: 0: 9830.7. Samples: 714156176. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:09:53,989][27935] Avg episode reward: [(0, '-1.488')] [2022-07-13 15:09:58,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 357102592. Throughput: 0: 9817.9. Samples: 714214724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:09:58,989][27935] Avg episode reward: [(0, '-1.381')] [2022-07-13 15:10:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 357125120. Throughput: 0: 9726.6. Samples: 714269560. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:03,991][27935] Avg episode reward: [(0, '-0.856')] [2022-07-13 15:10:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4863.1). Total num frames: 357150720. Throughput: 0: 9720.6. Samples: 714298932. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:08,989][27935] Avg episode reward: [(0, '-1.054')] [2022-07-13 15:10:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 357174272. Throughput: 0: 9714.9. Samples: 714357752. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:13,989][27935] Avg episode reward: [(0, '-0.893')] [2022-07-13 15:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 357198848. Throughput: 0: 9717.4. Samples: 714416428. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:18,990][27935] Avg episode reward: [(0, '0.511')] [2022-07-13 15:10:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 357223424. Throughput: 0: 9717.2. Samples: 714445828. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:23,989][27935] Avg episode reward: [(0, '-0.373')] [2022-07-13 15:10:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 357246976. Throughput: 0: 9697.0. Samples: 714504400. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:28,996][27935] Avg episode reward: [(0, '-0.413')] [2022-07-13 15:10:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 357272576. Throughput: 0: 9686.3. Samples: 714562848. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:33,989][27935] Avg episode reward: [(0, '-0.343')] [2022-07-13 15:10:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 357297152. Throughput: 0: 9693.8. Samples: 714592396. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:38,989][27935] Avg episode reward: [(0, '-0.463')] [2022-07-13 15:10:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 357319680. Throughput: 0: 9705.8. Samples: 714651484. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:43,990][27935] Avg episode reward: [(0, '-0.631')] [2022-07-13 15:10:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.0, 300 sec: 4859.7). Total num frames: 357344256. Throughput: 0: 9804.9. Samples: 714710780. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:48,989][27935] Avg episode reward: [(0, '-0.311')] [2022-07-13 15:10:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 357370880. Throughput: 0: 9803.9. Samples: 714740108. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:53,989][27935] Avg episode reward: [(0, '-0.627')] [2022-07-13 15:10:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 357395456. Throughput: 0: 9813.2. Samples: 714799344. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:10:58,989][27935] Avg episode reward: [(0, '-1.460')] [2022-07-13 15:11:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 357417984. Throughput: 0: 9729.4. Samples: 714854252. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:03,989][27935] Avg episode reward: [(0, '-0.902')] [2022-07-13 15:11:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 357441536. Throughput: 0: 9732.4. Samples: 714883784. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:08,990][27935] Avg episode reward: [(0, '-0.581')] [2022-07-13 15:11:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 357466112. Throughput: 0: 9739.6. Samples: 714942684. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:13,991][27935] Avg episode reward: [(0, '-0.459')] [2022-07-13 15:11:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 357490688. Throughput: 0: 9734.4. Samples: 715000896. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:18,989][27935] Avg episode reward: [(0, '-0.879')] [2022-07-13 15:11:23,996][27935] Fps is (10 sec: 4911.5, 60 sec: 4863.4, 300 sec: 4863.0). Total num frames: 357515264. Throughput: 0: 9715.9. Samples: 715029684. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:23,997][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 15:11:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 357538816. Throughput: 0: 9700.2. Samples: 715087992. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:28,989][27935] Avg episode reward: [(0, '0.101')] [2022-07-13 15:11:33,989][27935] Fps is (10 sec: 4816.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 357563392. Throughput: 0: 9665.4. Samples: 715145724. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:33,989][27935] Avg episode reward: [(0, '0.679')] [2022-07-13 15:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 357586944. Throughput: 0: 9643.4. Samples: 715174060. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:38,990][27935] Avg episode reward: [(0, '0.665')] [2022-07-13 15:11:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 357610496. Throughput: 0: 9619.9. Samples: 715232240. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:43,989][27935] Avg episode reward: [(0, '0.589')] [2022-07-13 15:11:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 357637120. Throughput: 0: 9696.8. Samples: 715290608. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:48,989][27935] Avg episode reward: [(0, '0.473')] [2022-07-13 15:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4859.7). Total num frames: 357659648. Throughput: 0: 9693.6. Samples: 715319996. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:53,989][27935] Avg episode reward: [(0, '0.409')] [2022-07-13 15:11:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4863.1). Total num frames: 357684224. Throughput: 0: 9682.5. Samples: 715378396. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:11:58,989][27935] Avg episode reward: [(0, '0.988')] [2022-07-13 15:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 357706752. Throughput: 0: 9032.3. Samples: 715407348. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:12:03,989][27935] Avg episode reward: [(0, '0.624')] [2022-07-13 15:12:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 357730304. Throughput: 0: 9600.0. Samples: 715461612. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 15:12:08,989][27935] Avg episode reward: [(0, '0.530')] [2022-07-13 15:12:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 357755904. Throughput: 0: 9602.9. Samples: 715520124. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:13,990][27935] Avg episode reward: [(0, '0.566')] [2022-07-13 15:12:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 357779456. Throughput: 0: 9621.2. Samples: 715578676. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:18,989][27935] Avg episode reward: [(0, '1.170')] [2022-07-13 15:12:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.4, 300 sec: 4852.7). Total num frames: 357804032. Throughput: 0: 9634.9. Samples: 715607632. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:23,989][27935] Avg episode reward: [(0, '1.222')] [2022-07-13 15:12:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 357827584. Throughput: 0: 9630.8. Samples: 715665628. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:28,989][27935] Avg episode reward: [(0, '1.420')] [2022-07-13 15:12:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 357852160. Throughput: 0: 9616.3. Samples: 715723340. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:33,990][27935] Avg episode reward: [(0, '1.389')] [2022-07-13 15:12:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 357876736. Throughput: 0: 9617.0. Samples: 715752760. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:38,989][27935] Avg episode reward: [(0, '1.075')] [2022-07-13 15:12:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 357899264. Throughput: 0: 9604.4. Samples: 715810592. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:43,990][27935] Avg episode reward: [(0, '1.043')] [2022-07-13 15:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4849.2). Total num frames: 357924864. Throughput: 0: 10266.2. Samples: 715869328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:48,990][27935] Avg episode reward: [(0, '0.224')] [2022-07-13 15:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 357948416. Throughput: 0: 9708.4. Samples: 715898488. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:53,990][27935] Avg episode reward: [(0, '0.092')] [2022-07-13 15:12:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 357975040. Throughput: 0: 9714.6. Samples: 715957280. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:12:58,989][27935] Avg episode reward: [(0, '-1.111')] [2022-07-13 15:13:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 357996544. Throughput: 0: 9629.7. Samples: 716012012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:03,989][27935] Avg episode reward: [(0, '-0.998')] [2022-07-13 15:13:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 358021120. Throughput: 0: 9639.9. Samples: 716041428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:08,990][27935] Avg episode reward: [(0, '-0.826')] [2022-07-13 15:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 358044672. Throughput: 0: 9635.5. Samples: 716099224. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:13,989][27935] Avg episode reward: [(0, '-1.522')] [2022-07-13 15:13:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 358069248. Throughput: 0: 9646.8. Samples: 716157444. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:18,989][27935] Avg episode reward: [(0, '-0.991')] [2022-07-13 15:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4849.2). Total num frames: 358092800. Throughput: 0: 9627.1. Samples: 716185980. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:23,990][27935] Avg episode reward: [(0, '-0.982')] [2022-07-13 15:13:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 358117376. Throughput: 0: 9653.0. Samples: 716244976. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:28,989][27935] Avg episode reward: [(0, '-0.998')] [2022-07-13 15:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 358141952. Throughput: 0: 9639.1. Samples: 716303088. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:33,989][27935] Avg episode reward: [(0, '-1.209')] [2022-07-13 15:13:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 358165504. Throughput: 0: 9646.3. Samples: 716332572. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:38,989][27935] Avg episode reward: [(0, '-1.311')] [2022-07-13 15:13:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 358190080. Throughput: 0: 9644.4. Samples: 716391280. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:43,989][27935] Avg episode reward: [(0, '-1.273')] [2022-07-13 15:13:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 358214656. Throughput: 0: 9729.2. Samples: 716449828. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:48,989][27935] Avg episode reward: [(0, '-1.276')] [2022-07-13 15:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 358239232. Throughput: 0: 9728.7. Samples: 716479220. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:53,989][27935] Avg episode reward: [(0, '-1.009')] [2022-07-13 15:13:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 358264832. Throughput: 0: 9745.2. Samples: 716537756. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:13:58,989][27935] Avg episode reward: [(0, '-0.899')] [2022-07-13 15:14:03,990][27935] Fps is (10 sec: 4709.9, 60 sec: 4829.8, 300 sec: 4849.2). Total num frames: 358286336. Throughput: 0: 9658.5. Samples: 716592084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:03,990][27935] Avg episode reward: [(0, '-0.065')] [2022-07-13 15:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 358311936. Throughput: 0: 9678.0. Samples: 716621488. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:08,989][27935] Avg episode reward: [(0, '-0.179')] [2022-07-13 15:14:13,989][27935] Fps is (10 sec: 4915.7, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 358335488. Throughput: 0: 9677.1. Samples: 716680444. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:13,989][27935] Avg episode reward: [(0, '-0.309')] [2022-07-13 15:14:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 358359040. Throughput: 0: 9685.0. Samples: 716738912. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:18,990][27935] Avg episode reward: [(0, '0.589')] [2022-07-13 15:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 358383616. Throughput: 0: 9672.8. Samples: 716767848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:23,989][27935] Avg episode reward: [(0, '0.031')] [2022-07-13 15:14:28,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 358409216. Throughput: 0: 9674.7. Samples: 716826644. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:28,989][27935] Avg episode reward: [(0, '-0.092')] [2022-07-13 15:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 358432768. Throughput: 0: 9664.5. Samples: 716884732. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:33,989][27935] Avg episode reward: [(0, '0.007')] [2022-07-13 15:14:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 358456320. Throughput: 0: 9653.1. Samples: 716913608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 15:14:38,989][27935] Avg episode reward: [(0, '0.395')] [2022-07-13 15:14:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 358480896. Throughput: 0: 9662.6. Samples: 716972572. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:14:43,989][27935] Avg episode reward: [(0, '-0.118')] [2022-07-13 15:14:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 358505472. Throughput: 0: 9752.3. Samples: 717030928. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:14:48,989][27935] Avg episode reward: [(0, '-0.459')] [2022-07-13 15:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 358530048. Throughput: 0: 9750.8. Samples: 717060276. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:14:53,989][27935] Avg episode reward: [(0, '0.244')] [2022-07-13 15:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 358553600. Throughput: 0: 9736.4. Samples: 717118584. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:14:58,989][27935] Avg episode reward: [(0, '0.489')] [2022-07-13 15:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 358576128. Throughput: 0: 9648.5. Samples: 717173096. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:03,989][27935] Avg episode reward: [(0, '0.544')] [2022-07-13 15:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 358601728. Throughput: 0: 9653.9. Samples: 717202272. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:08,989][27935] Avg episode reward: [(0, '0.182')] [2022-07-13 15:15:13,990][27935] Fps is (10 sec: 4914.5, 60 sec: 4829.8, 300 sec: 4835.3). Total num frames: 358625280. Throughput: 0: 9648.0. Samples: 717260816. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:13,991][27935] Avg episode reward: [(0, '-0.108')] [2022-07-13 15:15:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 358648832. Throughput: 0: 9652.6. Samples: 717319100. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:18,989][27935] Avg episode reward: [(0, '0.351')] [2022-07-13 15:15:23,989][27935] Fps is (10 sec: 5018.3, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 358675456. Throughput: 0: 9662.8. Samples: 717348432. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:23,989][27935] Avg episode reward: [(0, '-0.650')] [2022-07-13 15:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 358697984. Throughput: 0: 9635.8. Samples: 717406184. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:28,989][27935] Avg episode reward: [(0, '-1.097')] [2022-07-13 15:15:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 358721536. Throughput: 0: 9635.5. Samples: 717464528. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:33,989][27935] Avg episode reward: [(0, '-1.473')] [2022-07-13 15:15:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 358746112. Throughput: 0: 9633.0. Samples: 717493760. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:38,989][27935] Avg episode reward: [(0, '-2.052')] [2022-07-13 15:15:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 358771712. Throughput: 0: 9637.2. Samples: 717552260. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:43,989][27935] Avg episode reward: [(0, '-2.280')] [2022-07-13 15:15:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 358796288. Throughput: 0: 9721.1. Samples: 717610544. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:48,989][27935] Avg episode reward: [(0, '-1.952')] [2022-07-13 15:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 358819840. Throughput: 0: 9727.1. Samples: 717639992. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:53,989][27935] Avg episode reward: [(0, '-2.062')] [2022-07-13 15:15:58,998][27935] Fps is (10 sec: 4705.9, 60 sec: 4829.1, 300 sec: 4831.7). Total num frames: 358843392. Throughput: 0: 9728.3. Samples: 717698668. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:15:58,999][27935] Avg episode reward: [(0, '-1.188')] [2022-07-13 15:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 358865920. Throughput: 0: 9087.2. Samples: 717728024. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:03,989][27935] Avg episode reward: [(0, '-0.930')] [2022-07-13 15:16:08,989][27935] Fps is (10 sec: 4919.9, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 358892544. Throughput: 0: 9644.4. Samples: 717782432. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:08,989][27935] Avg episode reward: [(0, '-0.810')] [2022-07-13 15:16:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4828.4). Total num frames: 358915072. Throughput: 0: 9655.1. Samples: 717840664. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:13,989][27935] Avg episode reward: [(0, '-0.823')] [2022-07-13 15:16:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4832.0). Total num frames: 358940672. Throughput: 0: 9008.8. Samples: 717869924. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:18,989][27935] Avg episode reward: [(0, '-0.053')] [2022-07-13 15:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 358963200. Throughput: 0: 9659.4. Samples: 717928432. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:23,989][27935] Avg episode reward: [(0, '0.232')] [2022-07-13 15:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 358988800. Throughput: 0: 9667.8. Samples: 717987312. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:28,989][27935] Avg episode reward: [(0, '0.091')] [2022-07-13 15:16:33,989][27935] Fps is (10 sec: 5119.7, 60 sec: 4881.0, 300 sec: 4838.8). Total num frames: 359014400. Throughput: 0: 9673.5. Samples: 718045856. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:33,990][27935] Avg episode reward: [(0, '0.213')] [2022-07-13 15:16:38,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 359037952. Throughput: 0: 9681.9. Samples: 718075680. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:38,989][27935] Avg episode reward: [(0, '-0.398')] [2022-07-13 15:16:43,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 359060480. Throughput: 0: 9688.5. Samples: 718134560. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:43,990][27935] Avg episode reward: [(0, '0.451')] [2022-07-13 15:16:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 359087104. Throughput: 0: 10338.9. Samples: 718193272. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:48,990][27935] Avg episode reward: [(0, '0.077')] [2022-07-13 15:16:53,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 359112704. Throughput: 0: 9782.3. Samples: 718222636. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:53,991][27935] Avg episode reward: [(0, '-0.999')] [2022-07-13 15:16:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.9, 300 sec: 4849.2). Total num frames: 359137280. Throughput: 0: 9803.7. Samples: 718281832. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:16:58,990][27935] Avg episode reward: [(0, '-1.222')] [2022-07-13 15:17:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 359158784. Throughput: 0: 10385.0. Samples: 718337248. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:17:03,989][27935] Avg episode reward: [(0, '-1.300')] [2022-07-13 15:17:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 359182336. Throughput: 0: 9735.4. Samples: 718366524. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:17:08,990][27935] Avg episode reward: [(0, '-0.561')] [2022-07-13 15:17:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 359207936. Throughput: 0: 9747.8. Samples: 718425964. Policy #0 lag: (min: 0.0, avg: 7.8, max: 20.0) [2022-07-13 15:17:13,989][27935] Avg episode reward: [(0, '-0.531')] [2022-07-13 15:17:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 359233536. Throughput: 0: 9739.6. Samples: 718484132. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:18,989][27935] Avg episode reward: [(0, '-0.605')] [2022-07-13 15:17:23,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 359255040. Throughput: 0: 9729.5. Samples: 718513508. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:23,989][27935] Avg episode reward: [(0, '0.902')] [2022-07-13 15:17:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 359280640. Throughput: 0: 9723.2. Samples: 718572104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:28,989][27935] Avg episode reward: [(0, '0.967')] [2022-07-13 15:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 359304192. Throughput: 0: 9713.5. Samples: 718630380. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:33,989][27935] Avg episode reward: [(0, '1.109')] [2022-07-13 15:17:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 359330816. Throughput: 0: 9705.5. Samples: 718659384. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:38,990][27935] Avg episode reward: [(0, '0.783')] [2022-07-13 15:17:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 359353344. Throughput: 0: 9640.4. Samples: 718715648. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:43,990][27935] Avg episode reward: [(0, '0.822')] [2022-07-13 15:17:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 359377920. Throughput: 0: 9713.2. Samples: 718774340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:48,990][27935] Avg episode reward: [(0, '0.577')] [2022-07-13 15:17:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 359401472. Throughput: 0: 9715.1. Samples: 718803704. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:53,990][27935] Avg episode reward: [(0, '0.150')] [2022-07-13 15:17:58,991][27935] Fps is (10 sec: 4811.8, 60 sec: 4812.6, 300 sec: 4845.7). Total num frames: 359426048. Throughput: 0: 9701.6. Samples: 718862556. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:17:58,991][27935] Avg episode reward: [(0, '-0.057')] [2022-07-13 15:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 359448576. Throughput: 0: 9635.9. Samples: 718917748. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:03,989][27935] Avg episode reward: [(0, '-0.070')] [2022-07-13 15:18:08,989][27935] Fps is (10 sec: 4609.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 359472128. Throughput: 0: 9629.3. Samples: 718946828. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:08,989][27935] Avg episode reward: [(0, '0.237')] [2022-07-13 15:18:13,992][27935] Fps is (10 sec: 5016.1, 60 sec: 4846.7, 300 sec: 4845.7). Total num frames: 359498752. Throughput: 0: 9627.8. Samples: 719005384. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:14,008][27935] Avg episode reward: [(0, '0.269')] [2022-07-13 15:18:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 359522304. Throughput: 0: 9641.2. Samples: 719064236. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:18,989][27935] Avg episode reward: [(0, '0.310')] [2022-07-13 15:18:23,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 359547904. Throughput: 0: 9647.4. Samples: 719093516. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:23,989][27935] Avg episode reward: [(0, '0.714')] [2022-07-13 15:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 359571456. Throughput: 0: 9707.4. Samples: 719152480. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:28,989][27935] Avg episode reward: [(0, '0.683')] [2022-07-13 15:18:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 359596032. Throughput: 0: 9695.1. Samples: 719210620. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:33,990][27935] Avg episode reward: [(0, '0.150')] [2022-07-13 15:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 359618560. Throughput: 0: 9691.5. Samples: 719239820. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:38,990][27935] Avg episode reward: [(0, '0.153')] [2022-07-13 15:18:43,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4863.8, 300 sec: 4849.2). Total num frames: 359645184. Throughput: 0: 9690.8. Samples: 719298640. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:43,991][27935] Avg episode reward: [(0, '0.256')] [2022-07-13 15:18:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 359669760. Throughput: 0: 9776.0. Samples: 719357668. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:48,989][27935] Avg episode reward: [(0, '0.106')] [2022-07-13 15:18:53,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 359693312. Throughput: 0: 9784.1. Samples: 719387112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:53,989][27935] Avg episode reward: [(0, '-1.296')] [2022-07-13 15:18:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.2, 300 sec: 4856.2). Total num frames: 359718912. Throughput: 0: 9786.8. Samples: 719445764. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:18:58,989][27935] Avg episode reward: [(0, '-1.311')] [2022-07-13 15:19:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 359740416. Throughput: 0: 9703.7. Samples: 719500904. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:03,989][27935] Avg episode reward: [(0, '-1.413')] [2022-07-13 15:19:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 359766016. Throughput: 0: 9702.8. Samples: 719530144. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:08,990][27935] Avg episode reward: [(0, '-1.168')] [2022-07-13 15:19:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.2, 300 sec: 4849.2). Total num frames: 359789568. Throughput: 0: 9702.9. Samples: 719589112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:13,989][27935] Avg episode reward: [(0, '-1.489')] [2022-07-13 15:19:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 359815168. Throughput: 0: 9721.6. Samples: 719648092. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:18,989][27935] Avg episode reward: [(0, '-1.480')] [2022-07-13 15:19:23,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4829.6, 300 sec: 4842.2). Total num frames: 359837696. Throughput: 0: 9723.2. Samples: 719677396. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:23,993][27935] Avg episode reward: [(0, '-1.322')] [2022-07-13 15:19:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 359863296. Throughput: 0: 9732.5. Samples: 719736584. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:28,989][27935] Avg episode reward: [(0, '-2.278')] [2022-07-13 15:19:33,996][27935] Fps is (10 sec: 5117.9, 60 sec: 4880.4, 300 sec: 4856.1). Total num frames: 359888896. Throughput: 0: 9727.5. Samples: 719795480. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:33,997][27935] Avg episode reward: [(0, '-2.971')] [2022-07-13 15:19:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 359912448. Throughput: 0: 9728.1. Samples: 719824876. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:38,990][27935] Avg episode reward: [(0, '-2.973')] [2022-07-13 15:19:43,990][27935] Fps is (10 sec: 4816.0, 60 sec: 4864.1, 300 sec: 4852.7). Total num frames: 359937024. Throughput: 0: 9738.1. Samples: 719883988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:43,990][27935] Avg episode reward: [(0, '-3.289')] [2022-07-13 15:19:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 359961600. Throughput: 0: 9824.2. Samples: 719942992. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 15:19:48,990][27935] Avg episode reward: [(0, '-3.735')] [2022-07-13 15:19:53,989][27935] Fps is (10 sec: 4915.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 359986176. Throughput: 0: 9827.5. Samples: 719972380. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:19:53,990][27935] Avg episode reward: [(0, '-2.627')] [2022-07-13 15:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 360010752. Throughput: 0: 9831.6. Samples: 720031532. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:19:58,990][27935] Avg episode reward: [(0, '-3.856')] [2022-07-13 15:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 360034304. Throughput: 0: 9761.8. Samples: 720087372. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:03,989][27935] Avg episode reward: [(0, '-2.899')] [2022-07-13 15:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 360057856. Throughput: 0: 9755.8. Samples: 720116372. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:08,990][27935] Avg episode reward: [(0, '-1.937')] [2022-07-13 15:20:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 360083456. Throughput: 0: 9755.0. Samples: 720175560. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:13,990][27935] Avg episode reward: [(0, '-2.550')] [2022-07-13 15:20:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 360107008. Throughput: 0: 9772.6. Samples: 720235172. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:18,989][27935] Avg episode reward: [(0, '-3.176')] [2022-07-13 15:20:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.6, 300 sec: 4866.6). Total num frames: 360133632. Throughput: 0: 9781.4. Samples: 720265040. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:23,989][27935] Avg episode reward: [(0, '-2.727')] [2022-07-13 15:20:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 360156160. Throughput: 0: 9779.0. Samples: 720324036. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:28,992][27935] Avg episode reward: [(0, '-2.760')] [2022-07-13 15:20:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.7, 300 sec: 4866.6). Total num frames: 360181760. Throughput: 0: 9778.4. Samples: 720383020. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:33,989][27935] Avg episode reward: [(0, '-2.148')] [2022-07-13 15:20:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 360206336. Throughput: 0: 9780.0. Samples: 720412480. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:38,989][27935] Avg episode reward: [(0, '-1.991')] [2022-07-13 15:20:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4932.3, 300 sec: 4870.1). Total num frames: 360232960. Throughput: 0: 9782.2. Samples: 720471732. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:43,989][27935] Avg episode reward: [(0, '-1.207')] [2022-07-13 15:20:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4870.1). Total num frames: 360256512. Throughput: 0: 9867.2. Samples: 720531396. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:48,989][27935] Avg episode reward: [(0, '-0.305')] [2022-07-13 15:20:53,989][27935] Fps is (10 sec: 4607.8, 60 sec: 4881.0, 300 sec: 4866.8). Total num frames: 360279040. Throughput: 0: 9871.8. Samples: 720560608. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:53,990][27935] Avg episode reward: [(0, '0.602')] [2022-07-13 15:20:58,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 360305664. Throughput: 0: 9871.7. Samples: 720619788. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:20:58,989][27935] Avg episode reward: [(0, '1.468')] [2022-07-13 15:21:03,989][27935] Fps is (10 sec: 4813.0, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 360327168. Throughput: 0: 9781.4. Samples: 720675336. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:03,991][27935] Avg episode reward: [(0, '1.352')] [2022-07-13 15:21:08,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4915.0, 300 sec: 4873.5). Total num frames: 360352768. Throughput: 0: 9764.7. Samples: 720704472. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:08,991][27935] Avg episode reward: [(0, '1.648')] [2022-07-13 15:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 360377344. Throughput: 0: 9766.7. Samples: 720763540. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:13,989][27935] Avg episode reward: [(0, '0.886')] [2022-07-13 15:21:18,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 360400896. Throughput: 0: 9766.2. Samples: 720822500. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:18,989][27935] Avg episode reward: [(0, '0.297')] [2022-07-13 15:21:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 360425472. Throughput: 0: 9765.8. Samples: 720851940. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:23,989][27935] Avg episode reward: [(0, '0.052')] [2022-07-13 15:21:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4870.1). Total num frames: 360451072. Throughput: 0: 9758.6. Samples: 720910868. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:28,989][27935] Avg episode reward: [(0, '0.192')] [2022-07-13 15:21:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 360474624. Throughput: 0: 9741.6. Samples: 720969768. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:33,989][27935] Avg episode reward: [(0, '0.010')] [2022-07-13 15:21:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 360499200. Throughput: 0: 9745.4. Samples: 720999148. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:38,989][27935] Avg episode reward: [(0, '-0.107')] [2022-07-13 15:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 360523776. Throughput: 0: 9739.6. Samples: 721058068. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:43,990][27935] Avg episode reward: [(0, '0.336')] [2022-07-13 15:21:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 360549376. Throughput: 0: 9811.8. Samples: 721116868. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:48,989][27935] Avg episode reward: [(0, '1.127')] [2022-07-13 15:21:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.2, 300 sec: 4866.6). Total num frames: 360572928. Throughput: 0: 9821.8. Samples: 721146432. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:53,989][27935] Avg episode reward: [(0, '0.811')] [2022-07-13 15:21:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 360598528. Throughput: 0: 9826.9. Samples: 721205748. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:21:58,989][27935] Avg episode reward: [(0, '0.770')] [2022-07-13 15:22:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 360621056. Throughput: 0: 9754.6. Samples: 721261456. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:22:03,989][27935] Avg episode reward: [(0, '0.667')] [2022-07-13 15:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.2, 300 sec: 4873.5). Total num frames: 360645632. Throughput: 0: 9758.9. Samples: 721291092. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:22:08,989][27935] Avg episode reward: [(0, '0.784')] [2022-07-13 15:22:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 360670208. Throughput: 0: 9766.9. Samples: 721350380. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:22:13,989][27935] Avg episode reward: [(0, '-0.018')] [2022-07-13 15:22:18,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 360695808. Throughput: 0: 9775.5. Samples: 721409664. Policy #0 lag: (min: 0.0, avg: 9.5, max: 19.0) [2022-07-13 15:22:18,989][27935] Avg episode reward: [(0, '-0.508')] [2022-07-13 15:22:23,994][27935] Fps is (10 sec: 5015.2, 60 sec: 4914.8, 300 sec: 4880.4). Total num frames: 360720384. Throughput: 0: 9790.3. Samples: 721439756. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:24,003][27935] Avg episode reward: [(0, '-1.475')] [2022-07-13 15:22:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 360742912. Throughput: 0: 9787.1. Samples: 721498488. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:28,989][27935] Avg episode reward: [(0, '-1.293')] [2022-07-13 15:22:33,989][27935] Fps is (10 sec: 4917.5, 60 sec: 4915.2, 300 sec: 4877.0). Total num frames: 360769536. Throughput: 0: 9787.2. Samples: 721557292. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:33,990][27935] Avg episode reward: [(0, '-1.695')] [2022-07-13 15:22:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 360794112. Throughput: 0: 9785.8. Samples: 721586792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:38,989][27935] Avg episode reward: [(0, '-1.917')] [2022-07-13 15:22:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 360817664. Throughput: 0: 9771.3. Samples: 721645456. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:43,989][27935] Avg episode reward: [(0, '-1.580')] [2022-07-13 15:22:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 360842240. Throughput: 0: 9850.2. Samples: 721704716. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:48,989][27935] Avg episode reward: [(0, '-1.645')] [2022-07-13 15:22:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4887.5). Total num frames: 360867840. Throughput: 0: 9852.3. Samples: 721734444. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:53,989][27935] Avg episode reward: [(0, '-0.896')] [2022-07-13 15:22:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 360891392. Throughput: 0: 9858.7. Samples: 721794024. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:22:58,989][27935] Avg episode reward: [(0, '0.035')] [2022-07-13 15:23:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4894.4). Total num frames: 360915968. Throughput: 0: 9778.2. Samples: 721849684. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:03,991][27935] Avg episode reward: [(0, '-0.024')] [2022-07-13 15:23:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 360939520. Throughput: 0: 9764.9. Samples: 721879132. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:08,989][27935] Avg episode reward: [(0, '-0.215')] [2022-07-13 15:23:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4890.9). Total num frames: 360965120. Throughput: 0: 9766.8. Samples: 721937996. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:13,989][27935] Avg episode reward: [(0, '0.451')] [2022-07-13 15:23:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 360988672. Throughput: 0: 9780.8. Samples: 721997428. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:18,989][27935] Avg episode reward: [(0, '1.394')] [2022-07-13 15:23:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.5, 300 sec: 4890.9). Total num frames: 361014272. Throughput: 0: 9795.9. Samples: 722027608. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:23,989][27935] Avg episode reward: [(0, '1.183')] [2022-07-13 15:23:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4890.9). Total num frames: 361038848. Throughput: 0: 9802.6. Samples: 722086572. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:28,989][27935] Avg episode reward: [(0, '1.169')] [2022-07-13 15:23:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4897.8). Total num frames: 361063424. Throughput: 0: 9795.9. Samples: 722145532. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:33,989][27935] Avg episode reward: [(0, '1.068')] [2022-07-13 15:23:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4894.4). Total num frames: 361089024. Throughput: 0: 9803.8. Samples: 722175616. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:38,989][27935] Avg episode reward: [(0, '0.809')] [2022-07-13 15:23:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4890.9). Total num frames: 361112576. Throughput: 0: 9771.9. Samples: 722233760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:43,989][27935] Avg episode reward: [(0, '0.775')] [2022-07-13 15:23:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 361135104. Throughput: 0: 9821.6. Samples: 722291656. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:48,998][27935] Avg episode reward: [(0, '0.109')] [2022-07-13 15:23:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 361159680. Throughput: 0: 9824.5. Samples: 722321236. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:53,989][27935] Avg episode reward: [(0, '-0.113')] [2022-07-13 15:23:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4897.8). Total num frames: 361185280. Throughput: 0: 9823.0. Samples: 722380032. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:23:58,989][27935] Avg episode reward: [(0, '-0.538')] [2022-07-13 15:24:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 361208832. Throughput: 0: 9733.7. Samples: 722435444. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:03,989][27935] Avg episode reward: [(0, '-0.556')] [2022-07-13 15:24:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 361231360. Throughput: 0: 9721.5. Samples: 722465076. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:08,989][27935] Avg episode reward: [(0, '-0.497')] [2022-07-13 15:24:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 361257984. Throughput: 0: 9722.8. Samples: 722524100. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:13,989][27935] Avg episode reward: [(0, '-0.477')] [2022-07-13 15:24:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4894.4). Total num frames: 361281536. Throughput: 0: 9725.2. Samples: 722583164. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:18,989][27935] Avg episode reward: [(0, '0.076')] [2022-07-13 15:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4890.9). Total num frames: 361306112. Throughput: 0: 9715.7. Samples: 722612824. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:23,989][27935] Avg episode reward: [(0, '-0.007')] [2022-07-13 15:24:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4891.0). Total num frames: 361331712. Throughput: 0: 9742.8. Samples: 722672188. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:28,989][27935] Avg episode reward: [(0, '0.245')] [2022-07-13 15:24:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4894.4). Total num frames: 361356288. Throughput: 0: 9767.5. Samples: 722731192. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:33,989][27935] Avg episode reward: [(0, '0.426')] [2022-07-13 15:24:38,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4863.7, 300 sec: 4894.3). Total num frames: 361380864. Throughput: 0: 9774.2. Samples: 722761108. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:38,993][27935] Avg episode reward: [(0, '0.528')] [2022-07-13 15:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4890.9). Total num frames: 361404416. Throughput: 0: 9762.9. Samples: 722819364. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:43,990][27935] Avg episode reward: [(0, '-0.135')] [2022-07-13 15:24:48,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4915.2, 300 sec: 4894.4). Total num frames: 361430016. Throughput: 0: 9842.6. Samples: 722878360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:48,989][27935] Avg episode reward: [(0, '-0.672')] [2022-07-13 15:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4890.9). Total num frames: 361453568. Throughput: 0: 9834.0. Samples: 722907608. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 15:24:53,989][27935] Avg episode reward: [(0, '-1.149')] [2022-07-13 15:24:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4894.4). Total num frames: 361478144. Throughput: 0: 9839.6. Samples: 722966880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:24:58,989][27935] Avg episode reward: [(0, '-1.642')] [2022-07-13 15:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4890.9). Total num frames: 361500672. Throughput: 0: 9756.4. Samples: 723022200. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:03,991][27935] Avg episode reward: [(0, '-1.369')] [2022-07-13 15:25:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4932.3, 300 sec: 4894.4). Total num frames: 361527296. Throughput: 0: 9753.9. Samples: 723051748. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:08,989][27935] Avg episode reward: [(0, '-1.293')] [2022-07-13 15:25:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4890.9). Total num frames: 361549824. Throughput: 0: 9745.2. Samples: 723110724. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:13,996][27935] Avg episode reward: [(0, '-1.557')] [2022-07-13 15:25:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4887.4). Total num frames: 361575424. Throughput: 0: 9746.2. Samples: 723169772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:18,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 15:25:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4894.4). Total num frames: 361600000. Throughput: 0: 9746.8. Samples: 723199680. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:23,999][27935] Avg episode reward: [(0, '-0.546')] [2022-07-13 15:25:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 361624576. Throughput: 0: 9764.4. Samples: 723258764. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:28,989][27935] Avg episode reward: [(0, '-0.907')] [2022-07-13 15:25:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 361649152. Throughput: 0: 9764.2. Samples: 723317748. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:33,989][27935] Avg episode reward: [(0, '-0.347')] [2022-07-13 15:25:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.4, 300 sec: 4884.0). Total num frames: 361673728. Throughput: 0: 9772.7. Samples: 723347380. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:38,990][27935] Avg episode reward: [(0, '-0.206')] [2022-07-13 15:25:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4890.9). Total num frames: 361699328. Throughput: 0: 9783.5. Samples: 723407136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:43,990][27935] Avg episode reward: [(0, '-0.188')] [2022-07-13 15:25:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4894.4). Total num frames: 361722880. Throughput: 0: 9871.6. Samples: 723466420. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:48,989][27935] Avg episode reward: [(0, '0.728')] [2022-07-13 15:25:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4932.3, 300 sec: 4894.4). Total num frames: 361749504. Throughput: 0: 9867.2. Samples: 723495772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:53,991][27935] Avg episode reward: [(0, '0.558')] [2022-07-13 15:25:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4897.8). Total num frames: 361772032. Throughput: 0: 9876.1. Samples: 723555148. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:25:58,989][27935] Avg episode reward: [(0, '0.557')] [2022-07-13 15:26:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4932.3, 300 sec: 4894.4). Total num frames: 361796608. Throughput: 0: 9788.5. Samples: 723610252. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:03,991][27935] Avg episode reward: [(0, '-0.039')] [2022-07-13 15:26:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4894.4). Total num frames: 361821184. Throughput: 0: 9784.8. Samples: 723639996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:08,989][27935] Avg episode reward: [(0, '-0.653')] [2022-07-13 15:26:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4894.4). Total num frames: 361844736. Throughput: 0: 9783.5. Samples: 723699020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:13,989][27935] Avg episode reward: [(0, '-0.624')] [2022-07-13 15:26:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4894.4). Total num frames: 361869312. Throughput: 0: 9783.2. Samples: 723757992. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:18,989][27935] Avg episode reward: [(0, '-0.419')] [2022-07-13 15:26:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4890.9). Total num frames: 361893888. Throughput: 0: 9771.9. Samples: 723787116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:23,989][27935] Avg episode reward: [(0, '-1.033')] [2022-07-13 15:26:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4894.4). Total num frames: 361918464. Throughput: 0: 9753.2. Samples: 723846032. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:28,989][27935] Avg episode reward: [(0, '-0.951')] [2022-07-13 15:26:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 361942016. Throughput: 0: 9727.7. Samples: 723904164. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:33,989][27935] Avg episode reward: [(0, '-1.042')] [2022-07-13 15:26:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 361965568. Throughput: 0: 9736.8. Samples: 723933928. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:38,989][27935] Avg episode reward: [(0, '-0.768')] [2022-07-13 15:26:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4887.4). Total num frames: 361991168. Throughput: 0: 9718.5. Samples: 723992480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:43,989][27935] Avg episode reward: [(0, '-0.452')] [2022-07-13 15:26:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 362015744. Throughput: 0: 9804.1. Samples: 724051436. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:48,989][27935] Avg episode reward: [(0, '-0.586')] [2022-07-13 15:26:54,001][27935] Fps is (10 sec: 5011.7, 60 sec: 4863.0, 300 sec: 4890.7). Total num frames: 362041344. Throughput: 0: 9797.2. Samples: 724080988. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:54,001][27935] Avg episode reward: [(0, '-1.084')] [2022-07-13 15:26:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4894.4). Total num frames: 362064896. Throughput: 0: 9794.9. Samples: 724139788. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:26:58,989][27935] Avg episode reward: [(0, '-2.363')] [2022-07-13 15:27:03,992][27935] Fps is (10 sec: 4611.8, 60 sec: 4846.6, 300 sec: 4887.4). Total num frames: 362087424. Throughput: 0: 9708.8. Samples: 724194924. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:03,993][27935] Avg episode reward: [(0, '-1.382')] [2022-07-13 15:27:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4884.0). Total num frames: 362110976. Throughput: 0: 9712.5. Samples: 724224180. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:08,989][27935] Avg episode reward: [(0, '-1.740')] [2022-07-13 15:27:13,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 362137600. Throughput: 0: 9716.3. Samples: 724283264. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:13,989][27935] Avg episode reward: [(0, '-1.598')] [2022-07-13 15:27:18,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4887.5). Total num frames: 362162176. Throughput: 0: 9736.1. Samples: 724342288. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:18,989][27935] Avg episode reward: [(0, '-1.686')] [2022-07-13 15:27:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4887.4). Total num frames: 362184704. Throughput: 0: 9738.0. Samples: 724372136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:23,989][27935] Avg episode reward: [(0, '-1.296')] [2022-07-13 15:27:28,995][27935] Fps is (10 sec: 4912.1, 60 sec: 4880.6, 300 sec: 4887.3). Total num frames: 362211328. Throughput: 0: 9752.9. Samples: 724431420. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 15:27:28,998][27935] Avg episode reward: [(0, '-1.228')] [2022-07-13 15:27:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 362234880. Throughput: 0: 9746.8. Samples: 724490044. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:33,989][27935] Avg episode reward: [(0, '-1.080')] [2022-07-13 15:27:38,989][27935] Fps is (10 sec: 4815.8, 60 sec: 4898.1, 300 sec: 4887.4). Total num frames: 362259456. Throughput: 0: 9736.2. Samples: 724519004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:38,989][27935] Avg episode reward: [(0, '0.269')] [2022-07-13 15:27:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4890.9). Total num frames: 362285056. Throughput: 0: 9718.3. Samples: 724577112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:43,989][27935] Avg episode reward: [(0, '0.408')] [2022-07-13 15:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 362307584. Throughput: 0: 9801.5. Samples: 724635956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:48,989][27935] Avg episode reward: [(0, '0.396')] [2022-07-13 15:27:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.9, 300 sec: 4884.0). Total num frames: 362332160. Throughput: 0: 9801.2. Samples: 724665236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:53,989][27935] Avg episode reward: [(0, '0.520')] [2022-07-13 15:27:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 362356736. Throughput: 0: 9797.4. Samples: 724724148. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:27:58,989][27935] Avg episode reward: [(0, '0.664')] [2022-07-13 15:28:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.2, 300 sec: 4877.0). Total num frames: 362378240. Throughput: 0: 9705.3. Samples: 724779028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:03,989][27935] Avg episode reward: [(0, '0.704')] [2022-07-13 15:28:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 362405888. Throughput: 0: 9698.1. Samples: 724808552. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:08,989][27935] Avg episode reward: [(0, '0.877')] [2022-07-13 15:28:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 362429440. Throughput: 0: 9686.0. Samples: 724867228. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:13,989][27935] Avg episode reward: [(0, '0.428')] [2022-07-13 15:28:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 362454016. Throughput: 0: 9689.0. Samples: 724926048. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:18,990][27935] Avg episode reward: [(0, '0.179')] [2022-07-13 15:28:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 362476544. Throughput: 0: 9696.9. Samples: 724955364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:23,989][27935] Avg episode reward: [(0, '0.706')] [2022-07-13 15:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.5, 300 sec: 4880.5). Total num frames: 362503168. Throughput: 0: 9710.4. Samples: 725014080. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:28,989][27935] Avg episode reward: [(0, '0.048')] [2022-07-13 15:28:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 362526720. Throughput: 0: 9701.3. Samples: 725072516. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:33,989][27935] Avg episode reward: [(0, '-0.505')] [2022-07-13 15:28:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 362551296. Throughput: 0: 9707.4. Samples: 725102068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:38,990][27935] Avg episode reward: [(0, '-0.460')] [2022-07-13 15:28:43,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4846.6, 300 sec: 4883.9). Total num frames: 362575872. Throughput: 0: 9712.8. Samples: 725161260. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:43,993][27935] Avg episode reward: [(0, '-0.966')] [2022-07-13 15:28:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 362599424. Throughput: 0: 9809.3. Samples: 725220444. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:48,989][27935] Avg episode reward: [(0, '-0.877')] [2022-07-13 15:28:53,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 362625024. Throughput: 0: 9807.7. Samples: 725249900. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:53,989][27935] Avg episode reward: [(0, '-1.161')] [2022-07-13 15:28:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 362649600. Throughput: 0: 9817.3. Samples: 725309004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:28:58,989][27935] Avg episode reward: [(0, '-1.963')] [2022-07-13 15:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 362672128. Throughput: 0: 9744.5. Samples: 725364552. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:03,989][27935] Avg episode reward: [(0, '-1.255')] [2022-07-13 15:29:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 362697728. Throughput: 0: 9748.1. Samples: 725394028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:08,989][27935] Avg episode reward: [(0, '-0.369')] [2022-07-13 15:29:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 362720256. Throughput: 0: 9761.8. Samples: 725453364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:13,989][27935] Avg episode reward: [(0, '-0.375')] [2022-07-13 15:29:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 362744832. Throughput: 0: 9767.1. Samples: 725512036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:18,989][27935] Avg episode reward: [(0, '0.702')] [2022-07-13 15:29:23,990][27935] Fps is (10 sec: 5119.3, 60 sec: 4915.1, 300 sec: 4880.5). Total num frames: 362771456. Throughput: 0: 9769.7. Samples: 725541716. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:23,991][27935] Avg episode reward: [(0, '1.095')] [2022-07-13 15:29:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 362795008. Throughput: 0: 9765.9. Samples: 725600688. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:28,990][27935] Avg episode reward: [(0, '1.053')] [2022-07-13 15:29:33,989][27935] Fps is (10 sec: 4915.9, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 362820608. Throughput: 0: 9757.0. Samples: 725659508. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:33,989][27935] Avg episode reward: [(0, '0.572')] [2022-07-13 15:29:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 362844160. Throughput: 0: 9755.3. Samples: 725688888. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:38,989][27935] Avg episode reward: [(0, '-0.774')] [2022-07-13 15:29:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.4, 300 sec: 4880.5). Total num frames: 362869760. Throughput: 0: 9758.2. Samples: 725748124. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:43,990][27935] Avg episode reward: [(0, '-0.883')] [2022-07-13 15:29:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 362894336. Throughput: 0: 9790.7. Samples: 725805136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:48,991][27935] Avg episode reward: [(0, '-0.540')] [2022-07-13 15:29:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 362916864. Throughput: 0: 9779.3. Samples: 725834096. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:53,990][27935] Avg episode reward: [(0, '-0.700')] [2022-07-13 15:29:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4880.5). Total num frames: 362940416. Throughput: 0: 9767.7. Samples: 725892908. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:29:58,990][27935] Avg episode reward: [(0, '-0.783')] [2022-07-13 15:30:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 362963968. Throughput: 0: 9689.8. Samples: 725948076. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 15:30:03,989][27935] Avg episode reward: [(0, '-0.651')] [2022-07-13 15:30:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 362989568. Throughput: 0: 9691.1. Samples: 725977800. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:08,990][27935] Avg episode reward: [(0, '0.931')] [2022-07-13 15:30:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 363014144. Throughput: 0: 9696.8. Samples: 726037044. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:13,989][27935] Avg episode reward: [(0, '0.432')] [2022-07-13 15:30:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 363038720. Throughput: 0: 9698.1. Samples: 726095924. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:18,989][27935] Avg episode reward: [(0, '0.551')] [2022-07-13 15:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.1, 300 sec: 4877.0). Total num frames: 363063296. Throughput: 0: 9703.3. Samples: 726125536. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:23,989][27935] Avg episode reward: [(0, '-0.241')] [2022-07-13 15:30:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 363086848. Throughput: 0: 9695.0. Samples: 726184400. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:28,989][27935] Avg episode reward: [(0, '-1.048')] [2022-07-13 15:30:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 363112448. Throughput: 0: 9733.5. Samples: 726243144. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:33,989][27935] Avg episode reward: [(0, '-1.096')] [2022-07-13 15:30:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 363136000. Throughput: 0: 9739.4. Samples: 726272368. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:38,989][27935] Avg episode reward: [(0, '-1.733')] [2022-07-13 15:30:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 363160576. Throughput: 0: 9736.5. Samples: 726331052. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:43,989][27935] Avg episode reward: [(0, '-1.943')] [2022-07-13 15:30:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 363185152. Throughput: 0: 9826.6. Samples: 726390272. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:48,990][27935] Avg episode reward: [(0, '-1.507')] [2022-07-13 15:30:53,992][27935] Fps is (10 sec: 4913.8, 60 sec: 4880.8, 300 sec: 4873.5). Total num frames: 363209728. Throughput: 0: 9821.6. Samples: 726419800. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:53,992][27935] Avg episode reward: [(0, '-0.652')] [2022-07-13 15:30:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 363234304. Throughput: 0: 9821.4. Samples: 726479008. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:30:58,989][27935] Avg episode reward: [(0, '-0.713')] [2022-07-13 15:31:03,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 363257856. Throughput: 0: 9736.1. Samples: 726534048. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:03,989][27935] Avg episode reward: [(0, '0.100')] [2022-07-13 15:31:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363282432. Throughput: 0: 9739.7. Samples: 726563824. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:08,989][27935] Avg episode reward: [(0, '0.062')] [2022-07-13 15:31:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363307008. Throughput: 0: 9743.5. Samples: 726622856. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:13,989][27935] Avg episode reward: [(0, '0.138')] [2022-07-13 15:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 363330560. Throughput: 0: 9748.4. Samples: 726681824. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:18,989][27935] Avg episode reward: [(0, '-1.233')] [2022-07-13 15:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 363355136. Throughput: 0: 9757.9. Samples: 726711476. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:23,989][27935] Avg episode reward: [(0, '-1.879')] [2022-07-13 15:31:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363379712. Throughput: 0: 9749.8. Samples: 726769792. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:28,991][27935] Avg episode reward: [(0, '-2.810')] [2022-07-13 15:31:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 363404288. Throughput: 0: 9725.3. Samples: 726827908. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:33,989][27935] Avg episode reward: [(0, '-2.843')] [2022-07-13 15:31:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 363427840. Throughput: 0: 9724.6. Samples: 726857380. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:38,991][27935] Avg episode reward: [(0, '-2.744')] [2022-07-13 15:31:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363453440. Throughput: 0: 9725.6. Samples: 726916660. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:43,989][27935] Avg episode reward: [(0, '-2.276')] [2022-07-13 15:31:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.3). Total num frames: 363478016. Throughput: 0: 9831.3. Samples: 726976456. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:48,989][27935] Avg episode reward: [(0, '-2.525')] [2022-07-13 15:31:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.4, 300 sec: 4877.0). Total num frames: 363503616. Throughput: 0: 9821.9. Samples: 727005812. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:53,989][27935] Avg episode reward: [(0, '-2.146')] [2022-07-13 15:31:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 363527168. Throughput: 0: 9825.9. Samples: 727065020. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:31:58,989][27935] Avg episode reward: [(0, '-2.306')] [2022-07-13 15:32:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 363549696. Throughput: 0: 9742.5. Samples: 727120236. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:03,989][27935] Avg episode reward: [(0, '-1.566')] [2022-07-13 15:32:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363575296. Throughput: 0: 9738.8. Samples: 727149720. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:08,989][27935] Avg episode reward: [(0, '-1.521')] [2022-07-13 15:32:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363599872. Throughput: 0: 9746.0. Samples: 727208364. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:13,990][27935] Avg episode reward: [(0, '-0.865')] [2022-07-13 15:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 363623424. Throughput: 0: 9763.8. Samples: 727267280. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:18,989][27935] Avg episode reward: [(0, '0.536')] [2022-07-13 15:32:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.6). Total num frames: 363649024. Throughput: 0: 9762.7. Samples: 727296700. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:23,989][27935] Avg episode reward: [(0, '1.245')] [2022-07-13 15:32:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363672576. Throughput: 0: 9749.0. Samples: 727355364. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:28,989][27935] Avg episode reward: [(0, '1.149')] [2022-07-13 15:32:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 363696128. Throughput: 0: 9730.3. Samples: 727414320. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:33,989][27935] Avg episode reward: [(0, '0.947')] [2022-07-13 15:32:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 363722752. Throughput: 0: 9732.9. Samples: 727443792. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 15:32:38,989][27935] Avg episode reward: [(0, '0.870')] [2022-07-13 15:32:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 363747328. Throughput: 0: 9716.5. Samples: 727502264. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:32:43,989][27935] Avg episode reward: [(0, '-0.095')] [2022-07-13 15:32:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 363769856. Throughput: 0: 9788.1. Samples: 727560700. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:32:48,989][27935] Avg episode reward: [(0, '-0.284')] [2022-07-13 15:32:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 363794432. Throughput: 0: 9779.8. Samples: 727589812. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:32:53,989][27935] Avg episode reward: [(0, '-0.362')] [2022-07-13 15:32:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 363819008. Throughput: 0: 9784.3. Samples: 727648656. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:32:58,989][27935] Avg episode reward: [(0, '-0.442')] [2022-07-13 15:33:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 363841536. Throughput: 0: 9691.5. Samples: 727703396. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:03,989][27935] Avg episode reward: [(0, '-0.530')] [2022-07-13 15:33:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 363868160. Throughput: 0: 9687.4. Samples: 727732632. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:08,989][27935] Avg episode reward: [(0, '0.012')] [2022-07-13 15:33:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 363890688. Throughput: 0: 9688.0. Samples: 727791324. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:13,989][27935] Avg episode reward: [(0, '0.821')] [2022-07-13 15:33:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 363916288. Throughput: 0: 9682.5. Samples: 727850032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:18,990][27935] Avg episode reward: [(0, '0.989')] [2022-07-13 15:33:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 363939840. Throughput: 0: 9682.8. Samples: 727879520. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:23,990][27935] Avg episode reward: [(0, '1.056')] [2022-07-13 15:33:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 363964416. Throughput: 0: 9680.8. Samples: 727937900. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:28,990][27935] Avg episode reward: [(0, '1.029')] [2022-07-13 15:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 363988992. Throughput: 0: 9679.5. Samples: 727996280. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:33,989][27935] Avg episode reward: [(0, '1.225')] [2022-07-13 15:33:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 364012544. Throughput: 0: 9687.7. Samples: 728025760. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:38,991][27935] Avg episode reward: [(0, '1.177')] [2022-07-13 15:33:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 364038144. Throughput: 0: 9686.3. Samples: 728084540. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:43,992][27935] Avg episode reward: [(0, '0.666')] [2022-07-13 15:33:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 364060672. Throughput: 0: 9779.3. Samples: 728143464. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:48,989][27935] Avg episode reward: [(0, '0.508')] [2022-07-13 15:33:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 364086272. Throughput: 0: 9783.1. Samples: 728172872. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:53,989][27935] Avg episode reward: [(0, '0.288')] [2022-07-13 15:33:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 364110848. Throughput: 0: 9776.8. Samples: 728231280. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:33:58,989][27935] Avg episode reward: [(0, '0.331')] [2022-07-13 15:34:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 364133376. Throughput: 0: 9686.2. Samples: 728285908. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:03,989][27935] Avg episode reward: [(0, '0.199')] [2022-07-13 15:34:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 364157952. Throughput: 0: 9679.1. Samples: 728315080. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:08,989][27935] Avg episode reward: [(0, '0.333')] [2022-07-13 15:34:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 364181504. Throughput: 0: 9684.7. Samples: 728373712. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:13,989][27935] Avg episode reward: [(0, '1.248')] [2022-07-13 15:34:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4863.2). Total num frames: 364206080. Throughput: 0: 9699.4. Samples: 728432752. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:18,989][27935] Avg episode reward: [(0, '0.865')] [2022-07-13 15:34:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 364231680. Throughput: 0: 9701.5. Samples: 728462328. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:23,989][27935] Avg episode reward: [(0, '0.825')] [2022-07-13 15:34:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 364255232. Throughput: 0: 9699.5. Samples: 728521016. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:28,989][27935] Avg episode reward: [(0, '0.426')] [2022-07-13 15:34:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 364281856. Throughput: 0: 9697.1. Samples: 728579832. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:33,989][27935] Avg episode reward: [(0, '0.284')] [2022-07-13 15:34:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 364304384. Throughput: 0: 9702.7. Samples: 728609492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:38,989][27935] Avg episode reward: [(0, '0.279')] [2022-07-13 15:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 364329984. Throughput: 0: 9717.8. Samples: 728668580. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:43,989][27935] Avg episode reward: [(0, '0.057')] [2022-07-13 15:34:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 364354560. Throughput: 0: 9832.7. Samples: 728728380. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:48,991][27935] Avg episode reward: [(0, '0.655')] [2022-07-13 15:34:53,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4881.0, 300 sec: 4877.0). Total num frames: 364379136. Throughput: 0: 9850.0. Samples: 728758336. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:53,991][27935] Avg episode reward: [(0, '-0.325')] [2022-07-13 15:34:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 364403712. Throughput: 0: 9860.1. Samples: 728817416. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:34:58,990][27935] Avg episode reward: [(0, '0.295')] [2022-07-13 15:35:03,989][27935] Fps is (10 sec: 4710.7, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 364426240. Throughput: 0: 9776.4. Samples: 728872688. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:35:03,991][27935] Avg episode reward: [(0, '-0.707')] [2022-07-13 15:35:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 364450816. Throughput: 0: 9779.0. Samples: 728902384. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:35:08,989][27935] Avg episode reward: [(0, '-0.592')] [2022-07-13 15:35:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 364475392. Throughput: 0: 9786.7. Samples: 728961416. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 15:35:13,990][27935] Avg episode reward: [(0, '-2.143')] [2022-07-13 15:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 364500992. Throughput: 0: 9792.9. Samples: 729020512. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:18,989][27935] Avg episode reward: [(0, '-2.594')] [2022-07-13 15:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 364524544. Throughput: 0: 9789.5. Samples: 729050020. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:23,989][27935] Avg episode reward: [(0, '-2.307')] [2022-07-13 15:35:28,991][27935] Fps is (10 sec: 4811.6, 60 sec: 4897.9, 300 sec: 4870.0). Total num frames: 364549120. Throughput: 0: 9781.2. Samples: 729108760. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:28,992][27935] Avg episode reward: [(0, '-1.582')] [2022-07-13 15:35:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 364573696. Throughput: 0: 9761.5. Samples: 729167648. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:33,989][27935] Avg episode reward: [(0, '-0.692')] [2022-07-13 15:35:38,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 364598272. Throughput: 0: 9755.1. Samples: 729197312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:38,989][27935] Avg episode reward: [(0, '-1.508')] [2022-07-13 15:35:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 364623872. Throughput: 0: 9754.0. Samples: 729256344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:43,989][27935] Avg episode reward: [(0, '-0.798')] [2022-07-13 15:35:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.6). Total num frames: 364647424. Throughput: 0: 9840.3. Samples: 729315500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:48,989][27935] Avg episode reward: [(0, '0.493')] [2022-07-13 15:35:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 364670976. Throughput: 0: 9807.9. Samples: 729343740. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:53,989][27935] Avg episode reward: [(0, '0.303')] [2022-07-13 15:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 364696576. Throughput: 0: 9787.7. Samples: 729401864. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:35:58,990][27935] Avg episode reward: [(0, '-0.974')] [2022-07-13 15:36:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 364719104. Throughput: 0: 9694.2. Samples: 729456752. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:03,989][27935] Avg episode reward: [(0, '-1.003')] [2022-07-13 15:36:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 364743680. Throughput: 0: 9695.6. Samples: 729486324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:08,989][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 15:36:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 364767232. Throughput: 0: 9700.8. Samples: 729545272. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:13,989][27935] Avg episode reward: [(0, '-0.127')] [2022-07-13 15:36:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 364793856. Throughput: 0: 9703.9. Samples: 729604324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:18,989][27935] Avg episode reward: [(0, '-0.805')] [2022-07-13 15:36:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 364817408. Throughput: 0: 9699.6. Samples: 729633796. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:23,989][27935] Avg episode reward: [(0, '-1.270')] [2022-07-13 15:36:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.2, 300 sec: 4870.1). Total num frames: 364840960. Throughput: 0: 9702.1. Samples: 729692940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:28,989][27935] Avg episode reward: [(0, '-1.386')] [2022-07-13 15:36:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 364866560. Throughput: 0: 9694.3. Samples: 729751744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:33,989][27935] Avg episode reward: [(0, '0.051')] [2022-07-13 15:36:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 364890112. Throughput: 0: 9723.3. Samples: 729781288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:38,990][27935] Avg episode reward: [(0, '0.095')] [2022-07-13 15:36:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 364914688. Throughput: 0: 9754.9. Samples: 729840836. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:43,995][27935] Avg episode reward: [(0, '-1.103')] [2022-07-13 15:36:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 364941312. Throughput: 0: 9859.9. Samples: 729900448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:48,989][27935] Avg episode reward: [(0, '-1.882')] [2022-07-13 15:36:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 364964864. Throughput: 0: 9864.8. Samples: 729930240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:53,989][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 15:36:58,990][27935] Fps is (10 sec: 4812.1, 60 sec: 4881.0, 300 sec: 4880.5). Total num frames: 364989440. Throughput: 0: 9867.5. Samples: 729989324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:36:58,991][27935] Avg episode reward: [(0, '-0.636')] [2022-07-13 15:37:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 365012992. Throughput: 0: 9784.5. Samples: 730044628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:03,989][27935] Avg episode reward: [(0, '-1.633')] [2022-07-13 15:37:08,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 365037568. Throughput: 0: 9783.3. Samples: 730074044. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:08,989][27935] Avg episode reward: [(0, '-1.705')] [2022-07-13 15:37:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 365061120. Throughput: 0: 9777.9. Samples: 730132948. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:13,989][27935] Avg episode reward: [(0, '-0.855')] [2022-07-13 15:37:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 365086720. Throughput: 0: 9785.8. Samples: 730192104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:18,989][27935] Avg episode reward: [(0, '-0.426')] [2022-07-13 15:37:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 365110272. Throughput: 0: 9787.5. Samples: 730221728. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:23,990][27935] Avg episode reward: [(0, '0.175')] [2022-07-13 15:37:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 365135872. Throughput: 0: 9769.5. Samples: 730280460. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:28,989][27935] Avg episode reward: [(0, '0.418')] [2022-07-13 15:37:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 365159424. Throughput: 0: 9752.3. Samples: 730339300. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:33,989][27935] Avg episode reward: [(0, '0.643')] [2022-07-13 15:37:38,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 365185024. Throughput: 0: 9743.0. Samples: 730368676. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:38,991][27935] Avg episode reward: [(0, '0.433')] [2022-07-13 15:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 365207552. Throughput: 0: 9729.7. Samples: 730427148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 15:37:43,990][27935] Avg episode reward: [(0, '-0.090')] [2022-07-13 15:37:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365233152. Throughput: 0: 9812.3. Samples: 730486180. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:37:48,991][27935] Avg episode reward: [(0, '-0.069')] [2022-07-13 15:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 365256704. Throughput: 0: 9815.8. Samples: 730515756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:37:53,989][27935] Avg episode reward: [(0, '-0.994')] [2022-07-13 15:37:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.2, 300 sec: 4884.0). Total num frames: 365282304. Throughput: 0: 9815.7. Samples: 730574656. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:37:58,990][27935] Avg episode reward: [(0, '-0.700')] [2022-07-13 15:38:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 365304832. Throughput: 0: 9719.5. Samples: 730629480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:03,991][27935] Avg episode reward: [(0, '-1.010')] [2022-07-13 15:38:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 365330432. Throughput: 0: 9713.2. Samples: 730658824. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:08,989][27935] Avg episode reward: [(0, '-0.540')] [2022-07-13 15:38:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 365352960. Throughput: 0: 9702.7. Samples: 730717084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:13,989][27935] Avg episode reward: [(0, '-0.886')] [2022-07-13 15:38:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365378560. Throughput: 0: 9700.5. Samples: 730775824. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:18,989][27935] Avg episode reward: [(0, '-0.226')] [2022-07-13 15:38:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 365403136. Throughput: 0: 9701.2. Samples: 730805232. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:23,989][27935] Avg episode reward: [(0, '-0.506')] [2022-07-13 15:38:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 365425664. Throughput: 0: 9715.1. Samples: 730864328. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:28,989][27935] Avg episode reward: [(0, '-0.257')] [2022-07-13 15:38:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 365452288. Throughput: 0: 9705.2. Samples: 730922916. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:33,989][27935] Avg episode reward: [(0, '-0.559')] [2022-07-13 15:38:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 365475840. Throughput: 0: 9703.0. Samples: 730952392. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:38,989][27935] Avg episode reward: [(0, '-0.910')] [2022-07-13 15:38:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 365500416. Throughput: 0: 9709.3. Samples: 731011576. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:43,989][27935] Avg episode reward: [(0, '-0.234')] [2022-07-13 15:38:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 365526016. Throughput: 0: 9807.7. Samples: 731070828. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:48,989][27935] Avg episode reward: [(0, '-0.945')] [2022-07-13 15:38:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 365550592. Throughput: 0: 9801.2. Samples: 731099880. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:53,989][27935] Avg episode reward: [(0, '-0.803')] [2022-07-13 15:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4884.0). Total num frames: 365574144. Throughput: 0: 9814.6. Samples: 731158740. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:38:58,989][27935] Avg episode reward: [(0, '-0.158')] [2022-07-13 15:39:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365596672. Throughput: 0: 9728.2. Samples: 731213592. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:03,989][27935] Avg episode reward: [(0, '-0.757')] [2022-07-13 15:39:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4877.0). Total num frames: 365620224. Throughput: 0: 9728.6. Samples: 731243020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:08,989][27935] Avg episode reward: [(0, '-0.805')] [2022-07-13 15:39:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 365645824. Throughput: 0: 9722.0. Samples: 731301820. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:13,990][27935] Avg episode reward: [(0, '-1.489')] [2022-07-13 15:39:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365670400. Throughput: 0: 9730.3. Samples: 731360780. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:18,989][27935] Avg episode reward: [(0, '-0.566')] [2022-07-13 15:39:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 365694976. Throughput: 0: 9726.9. Samples: 731390104. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:23,989][27935] Avg episode reward: [(0, '-0.531')] [2022-07-13 15:39:28,989][27935] Fps is (10 sec: 4914.9, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 365719552. Throughput: 0: 9721.3. Samples: 731449040. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:28,990][27935] Avg episode reward: [(0, '-0.326')] [2022-07-13 15:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 365744128. Throughput: 0: 9715.7. Samples: 731508036. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:33,989][27935] Avg episode reward: [(0, '0.360')] [2022-07-13 15:39:38,989][27935] Fps is (10 sec: 4915.5, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 365768704. Throughput: 0: 9724.3. Samples: 731537472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:38,990][27935] Avg episode reward: [(0, '0.702')] [2022-07-13 15:39:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 365792256. Throughput: 0: 9728.9. Samples: 731596540. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:43,990][27935] Avg episode reward: [(0, '1.280')] [2022-07-13 15:39:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365817856. Throughput: 0: 9820.1. Samples: 731655496. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:48,989][27935] Avg episode reward: [(0, '1.665')] [2022-07-13 15:39:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 365842432. Throughput: 0: 9823.5. Samples: 731685076. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:53,990][27935] Avg episode reward: [(0, '1.537')] [2022-07-13 15:39:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 365867008. Throughput: 0: 9822.4. Samples: 731743828. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:39:58,990][27935] Avg episode reward: [(0, '1.437')] [2022-07-13 15:40:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 365890560. Throughput: 0: 9734.6. Samples: 731798836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:40:03,989][27935] Avg episode reward: [(0, '1.185')] [2022-07-13 15:40:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 365914112. Throughput: 0: 9736.5. Samples: 731828248. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:40:08,990][27935] Avg episode reward: [(0, '1.316')] [2022-07-13 15:40:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 365939712. Throughput: 0: 9742.6. Samples: 731887452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:40:13,989][27935] Avg episode reward: [(0, '1.226')] [2022-07-13 15:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 365963264. Throughput: 0: 9747.3. Samples: 731946664. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 15:40:18,989][27935] Avg episode reward: [(0, '1.212')] [2022-07-13 15:40:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 365988864. Throughput: 0: 9757.8. Samples: 731976572. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:23,989][27935] Avg episode reward: [(0, '1.042')] [2022-07-13 15:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366011392. Throughput: 0: 9753.0. Samples: 732035424. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:28,989][27935] Avg episode reward: [(0, '1.104')] [2022-07-13 15:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366036992. Throughput: 0: 9746.8. Samples: 732094100. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:33,990][27935] Avg episode reward: [(0, '0.806')] [2022-07-13 15:40:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 366061568. Throughput: 0: 9744.3. Samples: 732123568. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:38,989][27935] Avg episode reward: [(0, '0.706')] [2022-07-13 15:40:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 366086144. Throughput: 0: 9749.3. Samples: 732182548. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:43,989][27935] Avg episode reward: [(0, '0.438')] [2022-07-13 15:40:48,995][27935] Fps is (10 sec: 5014.7, 60 sec: 4897.7, 300 sec: 4883.9). Total num frames: 366111744. Throughput: 0: 9842.0. Samples: 732241784. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:48,995][27935] Avg episode reward: [(0, '0.463')] [2022-07-13 15:40:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366135296. Throughput: 0: 9848.0. Samples: 732271408. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:53,989][27935] Avg episode reward: [(0, '-0.323')] [2022-07-13 15:40:58,989][27935] Fps is (10 sec: 4918.1, 60 sec: 4898.1, 300 sec: 4887.4). Total num frames: 366160896. Throughput: 0: 9847.1. Samples: 732330572. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:40:58,989][27935] Avg episode reward: [(0, '-0.452')] [2022-07-13 15:41:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 366183424. Throughput: 0: 9754.2. Samples: 732385604. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:03,989][27935] Avg episode reward: [(0, '-0.378')] [2022-07-13 15:41:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 366206976. Throughput: 0: 9745.9. Samples: 732415136. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:08,989][27935] Avg episode reward: [(0, '-0.180')] [2022-07-13 15:41:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366232576. Throughput: 0: 9759.7. Samples: 732474612. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:13,989][27935] Avg episode reward: [(0, '0.007')] [2022-07-13 15:41:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366255104. Throughput: 0: 9772.4. Samples: 732533860. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:18,989][27935] Avg episode reward: [(0, '-0.083')] [2022-07-13 15:41:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4890.9). Total num frames: 366283776. Throughput: 0: 9769.7. Samples: 732563204. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:23,989][27935] Avg episode reward: [(0, '-0.830')] [2022-07-13 15:41:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 366305280. Throughput: 0: 9766.6. Samples: 732622044. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:28,991][27935] Avg episode reward: [(0, '0.198')] [2022-07-13 15:41:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 366330880. Throughput: 0: 9759.7. Samples: 732680912. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:33,989][27935] Avg episode reward: [(0, '0.141')] [2022-07-13 15:41:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 366355456. Throughput: 0: 9752.6. Samples: 732710276. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:38,990][27935] Avg episode reward: [(0, '0.237')] [2022-07-13 15:41:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 366381056. Throughput: 0: 9756.4. Samples: 732769612. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:43,990][27935] Avg episode reward: [(0, '-0.703')] [2022-07-13 15:41:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.5, 300 sec: 4877.0). Total num frames: 366403584. Throughput: 0: 9841.1. Samples: 732828452. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:48,991][27935] Avg episode reward: [(0, '-1.222')] [2022-07-13 15:41:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 366429184. Throughput: 0: 9841.2. Samples: 732857992. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:53,990][27935] Avg episode reward: [(0, '-2.091')] [2022-07-13 15:41:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 366452736. Throughput: 0: 9777.8. Samples: 732914612. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:41:58,990][27935] Avg episode reward: [(0, '-1.739')] [2022-07-13 15:42:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366475264. Throughput: 0: 9681.3. Samples: 732969520. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:03,989][27935] Avg episode reward: [(0, '-1.811')] [2022-07-13 15:42:08,995][27935] Fps is (10 sec: 4707.4, 60 sec: 4880.5, 300 sec: 4876.9). Total num frames: 366499840. Throughput: 0: 9685.3. Samples: 732999104. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:08,996][27935] Avg episode reward: [(0, '-1.769')] [2022-07-13 15:42:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366524416. Throughput: 0: 9692.7. Samples: 733058216. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:13,989][27935] Avg episode reward: [(0, '-2.354')] [2022-07-13 15:42:18,989][27935] Fps is (10 sec: 4918.4, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 366548992. Throughput: 0: 9691.7. Samples: 733117040. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:18,989][27935] Avg episode reward: [(0, '-1.362')] [2022-07-13 15:42:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4870.1). Total num frames: 366572544. Throughput: 0: 9704.9. Samples: 733146996. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:23,989][27935] Avg episode reward: [(0, '-0.932')] [2022-07-13 15:42:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366598144. Throughput: 0: 9692.4. Samples: 733205768. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:28,990][27935] Avg episode reward: [(0, '-0.938')] [2022-07-13 15:42:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366623744. Throughput: 0: 9687.7. Samples: 733264400. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:33,990][27935] Avg episode reward: [(0, '-0.989')] [2022-07-13 15:42:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 366647296. Throughput: 0: 9682.8. Samples: 733293716. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:38,989][27935] Avg episode reward: [(0, '-1.833')] [2022-07-13 15:42:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 366670848. Throughput: 0: 9718.7. Samples: 733351956. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:43,989][27935] Avg episode reward: [(0, '-1.712')] [2022-07-13 15:42:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 366694400. Throughput: 0: 9806.5. Samples: 733410812. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:48,989][27935] Avg episode reward: [(0, '-2.410')] [2022-07-13 15:42:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 366721024. Throughput: 0: 9809.0. Samples: 733440444. Policy #0 lag: (min: 0.0, avg: 8.2, max: 19.0) [2022-07-13 15:42:53,989][27935] Avg episode reward: [(0, '-2.416')] [2022-07-13 15:42:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 366744576. Throughput: 0: 9809.9. Samples: 733499660. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:42:58,990][27935] Avg episode reward: [(0, '-2.560')] [2022-07-13 15:43:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 366768128. Throughput: 0: 9722.3. Samples: 733554544. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:03,991][27935] Avg episode reward: [(0, '-1.865')] [2022-07-13 15:43:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.6, 300 sec: 4880.5). Total num frames: 366792704. Throughput: 0: 9714.4. Samples: 733584144. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:08,989][27935] Avg episode reward: [(0, '-0.537')] [2022-07-13 15:43:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366816256. Throughput: 0: 9711.1. Samples: 733642768. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:13,989][27935] Avg episode reward: [(0, '-0.860')] [2022-07-13 15:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 366841856. Throughput: 0: 9705.7. Samples: 733701156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:18,989][27935] Avg episode reward: [(0, '-1.128')] [2022-07-13 15:43:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 366866432. Throughput: 0: 9708.0. Samples: 733730576. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:23,996][27935] Avg episode reward: [(0, '-0.193')] [2022-07-13 15:43:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 366889984. Throughput: 0: 9725.0. Samples: 733789580. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:28,989][27935] Avg episode reward: [(0, '0.505')] [2022-07-13 15:43:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 366913536. Throughput: 0: 9712.5. Samples: 733847876. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:33,990][27935] Avg episode reward: [(0, '-0.528')] [2022-07-13 15:43:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 366939136. Throughput: 0: 9704.4. Samples: 733877144. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:38,991][27935] Avg episode reward: [(0, '-0.593')] [2022-07-13 15:43:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 366962688. Throughput: 0: 9700.2. Samples: 733936168. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:43,989][27935] Avg episode reward: [(0, '-0.848')] [2022-07-13 15:43:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 366988288. Throughput: 0: 9797.8. Samples: 733995444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:48,990][27935] Avg episode reward: [(0, '-0.635')] [2022-07-13 15:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 367011840. Throughput: 0: 9803.4. Samples: 734025296. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:53,989][27935] Avg episode reward: [(0, '0.019')] [2022-07-13 15:43:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 367037440. Throughput: 0: 9810.7. Samples: 734084248. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:43:58,989][27935] Avg episode reward: [(0, '-0.331')] [2022-07-13 15:44:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 367060992. Throughput: 0: 9731.8. Samples: 734139088. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:03,989][27935] Avg episode reward: [(0, '-1.832')] [2022-07-13 15:44:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 367083520. Throughput: 0: 9736.6. Samples: 734168724. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:08,989][27935] Avg episode reward: [(0, '-1.806')] [2022-07-13 15:44:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 367109120. Throughput: 0: 9740.9. Samples: 734227920. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:13,989][27935] Avg episode reward: [(0, '-1.222')] [2022-07-13 15:44:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 367133696. Throughput: 0: 9754.5. Samples: 734286828. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:18,989][27935] Avg episode reward: [(0, '-1.110')] [2022-07-13 15:44:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 367158272. Throughput: 0: 9755.2. Samples: 734316128. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:23,989][27935] Avg episode reward: [(0, '-3.078')] [2022-07-13 15:44:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 367181824. Throughput: 0: 9749.7. Samples: 734374904. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:28,989][27935] Avg episode reward: [(0, '-4.249')] [2022-07-13 15:44:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 367207424. Throughput: 0: 9737.7. Samples: 734433640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:33,989][27935] Avg episode reward: [(0, '-4.928')] [2022-07-13 15:44:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 367230976. Throughput: 0: 9728.1. Samples: 734463060. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:38,989][27935] Avg episode reward: [(0, '-3.505')] [2022-07-13 15:44:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 367257600. Throughput: 0: 9719.8. Samples: 734521640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:43,989][27935] Avg episode reward: [(0, '-2.697')] [2022-07-13 15:44:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 367279104. Throughput: 0: 9803.9. Samples: 734580264. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:48,989][27935] Avg episode reward: [(0, '-4.223')] [2022-07-13 15:44:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 367305728. Throughput: 0: 9798.2. Samples: 734609644. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:53,990][27935] Avg episode reward: [(0, '-4.981')] [2022-07-13 15:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 367328256. Throughput: 0: 9786.5. Samples: 734668312. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:44:58,990][27935] Avg episode reward: [(0, '-3.625')] [2022-07-13 15:45:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 367350784. Throughput: 0: 9695.3. Samples: 734723116. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:03,991][27935] Avg episode reward: [(0, '-1.808')] [2022-07-13 15:45:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 367376384. Throughput: 0: 9696.0. Samples: 734752448. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:08,989][27935] Avg episode reward: [(0, '-2.398')] [2022-07-13 15:45:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 367401984. Throughput: 0: 9697.1. Samples: 734811272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:13,989][27935] Avg episode reward: [(0, '-2.331')] [2022-07-13 15:45:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 367424512. Throughput: 0: 9707.2. Samples: 734870464. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:18,989][27935] Avg episode reward: [(0, '-1.240')] [2022-07-13 15:45:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 367449088. Throughput: 0: 9707.1. Samples: 734899880. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:23,989][27935] Avg episode reward: [(0, '-0.459')] [2022-07-13 15:45:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 367474688. Throughput: 0: 9723.8. Samples: 734959212. Policy #0 lag: (min: 0.0, avg: 9.4, max: 23.0) [2022-07-13 15:45:28,989][27935] Avg episode reward: [(0, '-0.852')] [2022-07-13 15:45:33,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 367499264. Throughput: 0: 9714.2. Samples: 735017404. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:33,990][27935] Avg episode reward: [(0, '-0.509')] [2022-07-13 15:45:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 367523840. Throughput: 0: 9718.6. Samples: 735046980. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:38,989][27935] Avg episode reward: [(0, '-0.516')] [2022-07-13 15:45:43,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4870.2). Total num frames: 367548416. Throughput: 0: 9724.9. Samples: 735105932. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:43,989][27935] Avg episode reward: [(0, '-0.122')] [2022-07-13 15:45:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 367571968. Throughput: 0: 9832.4. Samples: 735165576. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:48,989][27935] Avg episode reward: [(0, '-0.167')] [2022-07-13 15:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 367597568. Throughput: 0: 9836.4. Samples: 735195084. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:53,990][27935] Avg episode reward: [(0, '-0.302')] [2022-07-13 15:45:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 367623168. Throughput: 0: 9844.5. Samples: 735254272. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:45:58,989][27935] Avg episode reward: [(0, '1.099')] [2022-07-13 15:46:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 367644672. Throughput: 0: 9749.3. Samples: 735309180. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:03,989][27935] Avg episode reward: [(0, '0.957')] [2022-07-13 15:46:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 367670272. Throughput: 0: 9760.5. Samples: 735339104. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:08,990][27935] Avg episode reward: [(0, '0.430')] [2022-07-13 15:46:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 367692800. Throughput: 0: 9748.3. Samples: 735397884. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:13,990][27935] Avg episode reward: [(0, '0.259')] [2022-07-13 15:46:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4866.6). Total num frames: 367719424. Throughput: 0: 9770.4. Samples: 735457068. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:18,989][27935] Avg episode reward: [(0, '-0.306')] [2022-07-13 15:46:23,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4932.3, 300 sec: 4880.5). Total num frames: 367745024. Throughput: 0: 9770.0. Samples: 735486632. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:23,989][27935] Avg episode reward: [(0, '-0.361')] [2022-07-13 15:46:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 367768576. Throughput: 0: 9765.9. Samples: 735545400. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:28,990][27935] Avg episode reward: [(0, '-0.403')] [2022-07-13 15:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 367792128. Throughput: 0: 9737.0. Samples: 735603740. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:33,989][27935] Avg episode reward: [(0, '-0.032')] [2022-07-13 15:46:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 367815680. Throughput: 0: 9738.8. Samples: 735633332. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:38,989][27935] Avg episode reward: [(0, '-0.705')] [2022-07-13 15:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 367841280. Throughput: 0: 9733.5. Samples: 735692280. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:43,990][27935] Avg episode reward: [(0, '-0.329')] [2022-07-13 15:46:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 367866880. Throughput: 0: 9822.2. Samples: 735751180. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:48,989][27935] Avg episode reward: [(0, '0.162')] [2022-07-13 15:46:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 367890432. Throughput: 0: 9821.7. Samples: 735781080. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:53,989][27935] Avg episode reward: [(0, '0.845')] [2022-07-13 15:46:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 367915008. Throughput: 0: 9815.2. Samples: 735839568. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:46:58,989][27935] Avg episode reward: [(0, '0.226')] [2022-07-13 15:47:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4870.2). Total num frames: 367936512. Throughput: 0: 9150.2. Samples: 735868828. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:03,989][27935] Avg episode reward: [(0, '0.171')] [2022-07-13 15:47:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 367963136. Throughput: 0: 9713.7. Samples: 735923748. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:08,989][27935] Avg episode reward: [(0, '0.263')] [2022-07-13 15:47:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 367986688. Throughput: 0: 9719.1. Samples: 735982760. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:13,989][27935] Avg episode reward: [(0, '1.062')] [2022-07-13 15:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 368011264. Throughput: 0: 9728.6. Samples: 736041528. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:18,989][27935] Avg episode reward: [(0, '1.053')] [2022-07-13 15:47:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 368034816. Throughput: 0: 9729.6. Samples: 736071164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:23,989][27935] Avg episode reward: [(0, '0.823')] [2022-07-13 15:47:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 368059392. Throughput: 0: 9730.9. Samples: 736130168. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:28,989][27935] Avg episode reward: [(0, '1.185')] [2022-07-13 15:47:33,991][27935] Fps is (10 sec: 5118.7, 60 sec: 4897.9, 300 sec: 4877.0). Total num frames: 368086016. Throughput: 0: 9715.4. Samples: 736188396. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:33,992][27935] Avg episode reward: [(0, '-0.129')] [2022-07-13 15:47:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 368109568. Throughput: 0: 9707.6. Samples: 736217920. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:38,989][27935] Avg episode reward: [(0, '0.121')] [2022-07-13 15:47:43,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 368133120. Throughput: 0: 9703.4. Samples: 736276220. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:43,989][27935] Avg episode reward: [(0, '-0.456')] [2022-07-13 15:47:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 368157696. Throughput: 0: 10368.1. Samples: 736335392. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:48,989][27935] Avg episode reward: [(0, '-0.356')] [2022-07-13 15:47:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 368182272. Throughput: 0: 9811.5. Samples: 736365264. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:53,989][27935] Avg episode reward: [(0, '-0.427')] [2022-07-13 15:47:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 368207872. Throughput: 0: 9799.6. Samples: 736423740. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:47:58,990][27935] Avg episode reward: [(0, '-0.641')] [2022-07-13 15:48:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 368229376. Throughput: 0: 9679.4. Samples: 736477100. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 15:48:03,989][27935] Avg episode reward: [(0, '-0.732')] [2022-07-13 15:48:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 368253952. Throughput: 0: 9668.7. Samples: 736506256. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:08,989][27935] Avg episode reward: [(0, '0.453')] [2022-07-13 15:48:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 368277504. Throughput: 0: 9676.3. Samples: 736565600. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:13,990][27935] Avg episode reward: [(0, '-0.595')] [2022-07-13 15:48:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 368302080. Throughput: 0: 9685.1. Samples: 736624200. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:18,990][27935] Avg episode reward: [(0, '-0.635')] [2022-07-13 15:48:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 368327680. Throughput: 0: 9683.6. Samples: 736653680. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:23,990][27935] Avg episode reward: [(0, '-0.445')] [2022-07-13 15:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 368352256. Throughput: 0: 9699.5. Samples: 736712696. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:28,989][27935] Avg episode reward: [(0, '-1.095')] [2022-07-13 15:48:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4870.1). Total num frames: 368375808. Throughput: 0: 9691.2. Samples: 736771496. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:33,989][27935] Avg episode reward: [(0, '-0.999')] [2022-07-13 15:48:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 368401408. Throughput: 0: 9683.0. Samples: 736801000. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:38,989][27935] Avg episode reward: [(0, '-0.952')] [2022-07-13 15:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 368424960. Throughput: 0: 9696.4. Samples: 736860080. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:43,989][27935] Avg episode reward: [(0, '-0.277')] [2022-07-13 15:48:49,017][27935] Fps is (10 sec: 4901.5, 60 sec: 4878.8, 300 sec: 4876.6). Total num frames: 368450560. Throughput: 0: 9814.0. Samples: 736919004. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:49,017][27935] Avg episode reward: [(0, '-0.491')] [2022-07-13 15:48:53,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4863.7, 300 sec: 4870.0). Total num frames: 368474112. Throughput: 0: 9828.5. Samples: 736948572. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:53,993][27935] Avg episode reward: [(0, '-0.318')] [2022-07-13 15:48:58,989][27935] Fps is (10 sec: 4826.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 368498688. Throughput: 0: 9825.4. Samples: 737007744. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:48:58,989][27935] Avg episode reward: [(0, '-0.754')] [2022-07-13 15:49:03,999][27935] Fps is (10 sec: 4707.4, 60 sec: 4863.2, 300 sec: 4873.4). Total num frames: 368521216. Throughput: 0: 9746.7. Samples: 737062900. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:03,999][27935] Avg episode reward: [(0, '0.241')] [2022-07-13 15:49:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 368546816. Throughput: 0: 9743.6. Samples: 737092144. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:08,990][27935] Avg episode reward: [(0, '0.206')] [2022-07-13 15:49:13,989][27935] Fps is (10 sec: 5022.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 368571392. Throughput: 0: 9739.5. Samples: 737150972. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:13,989][27935] Avg episode reward: [(0, '0.815')] [2022-07-13 15:49:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 368594944. Throughput: 0: 9743.0. Samples: 737209932. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:18,989][27935] Avg episode reward: [(0, '0.456')] [2022-07-13 15:49:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 368619520. Throughput: 0: 9741.7. Samples: 737239376. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:23,989][27935] Avg episode reward: [(0, '0.585')] [2022-07-13 15:49:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 368644096. Throughput: 0: 9737.8. Samples: 737298280. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:28,990][27935] Avg episode reward: [(0, '1.214')] [2022-07-13 15:49:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 368667648. Throughput: 0: 9737.9. Samples: 737356940. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:33,991][27935] Avg episode reward: [(0, '0.943')] [2022-07-13 15:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 368693248. Throughput: 0: 9728.4. Samples: 737386316. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:38,990][27935] Avg episode reward: [(0, '0.692')] [2022-07-13 15:49:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 368716800. Throughput: 0: 9727.9. Samples: 737445500. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:43,989][27935] Avg episode reward: [(0, '1.013')] [2022-07-13 15:49:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4883.3, 300 sec: 4873.5). Total num frames: 368743424. Throughput: 0: 9814.4. Samples: 737504452. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:48,989][27935] Avg episode reward: [(0, '0.711')] [2022-07-13 15:49:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.3, 300 sec: 4873.5). Total num frames: 368765952. Throughput: 0: 9811.8. Samples: 737533676. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:53,989][27935] Avg episode reward: [(0, '0.454')] [2022-07-13 15:49:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 368790528. Throughput: 0: 9817.2. Samples: 737592744. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:49:58,989][27935] Avg episode reward: [(0, '0.021')] [2022-07-13 15:50:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4899.0, 300 sec: 4877.0). Total num frames: 368815104. Throughput: 0: 9737.0. Samples: 737648096. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:03,989][27935] Avg episode reward: [(0, '-0.225')] [2022-07-13 15:50:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 368837632. Throughput: 0: 9731.7. Samples: 737677304. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:08,989][27935] Avg episode reward: [(0, '-0.924')] [2022-07-13 15:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 368863232. Throughput: 0: 9728.4. Samples: 737736060. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:13,990][27935] Avg episode reward: [(0, '-0.734')] [2022-07-13 15:50:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 368887808. Throughput: 0: 9730.5. Samples: 737794812. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:18,989][27935] Avg episode reward: [(0, '-0.858')] [2022-07-13 15:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 368912384. Throughput: 0: 9732.7. Samples: 737824288. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:23,989][27935] Avg episode reward: [(0, '-0.762')] [2022-07-13 15:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 368936960. Throughput: 0: 9729.3. Samples: 737883320. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:28,989][27935] Avg episode reward: [(0, '0.221')] [2022-07-13 15:50:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 368961536. Throughput: 0: 9721.5. Samples: 737941920. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:33,989][27935] Avg episode reward: [(0, '0.613')] [2022-07-13 15:50:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 368986112. Throughput: 0: 9718.2. Samples: 737970996. Policy #0 lag: (min: 0.0, avg: 9.5, max: 23.0) [2022-07-13 15:50:38,989][27935] Avg episode reward: [(0, '1.512')] [2022-07-13 15:50:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 369011712. Throughput: 0: 9712.9. Samples: 738029824. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:50:43,989][27935] Avg episode reward: [(0, '0.209')] [2022-07-13 15:50:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 369035264. Throughput: 0: 9791.7. Samples: 738088724. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:50:48,989][27935] Avg episode reward: [(0, '-0.142')] [2022-07-13 15:50:53,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369057792. Throughput: 0: 9798.1. Samples: 738118220. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:50:53,989][27935] Avg episode reward: [(0, '-1.029')] [2022-07-13 15:50:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 369084416. Throughput: 0: 9797.6. Samples: 738176952. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:50:58,989][27935] Avg episode reward: [(0, '-1.714')] [2022-07-13 15:51:03,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 369105920. Throughput: 0: 9702.1. Samples: 738231408. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:03,989][27935] Avg episode reward: [(0, '-2.271')] [2022-07-13 15:51:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 369129472. Throughput: 0: 9696.6. Samples: 738260636. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:08,989][27935] Avg episode reward: [(0, '-2.655')] [2022-07-13 15:51:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369155072. Throughput: 0: 9690.0. Samples: 738319372. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:13,989][27935] Avg episode reward: [(0, '-2.868')] [2022-07-13 15:51:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 369178624. Throughput: 0: 9688.7. Samples: 738377912. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:18,991][27935] Avg episode reward: [(0, '-0.328')] [2022-07-13 15:51:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369204224. Throughput: 0: 9687.3. Samples: 738406924. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:23,989][27935] Avg episode reward: [(0, '-0.645')] [2022-07-13 15:51:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 369227776. Throughput: 0: 9684.7. Samples: 738465636. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:28,989][27935] Avg episode reward: [(0, '-1.907')] [2022-07-13 15:51:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 369252352. Throughput: 0: 9678.5. Samples: 738524256. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:33,989][27935] Avg episode reward: [(0, '-1.098')] [2022-07-13 15:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 369276928. Throughput: 0: 9676.7. Samples: 738553668. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:38,989][27935] Avg episode reward: [(0, '-0.677')] [2022-07-13 15:51:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 369301504. Throughput: 0: 9684.3. Samples: 738612744. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:43,989][27935] Avg episode reward: [(0, '-1.009')] [2022-07-13 15:51:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 369326080. Throughput: 0: 9774.7. Samples: 738671268. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:48,989][27935] Avg episode reward: [(0, '-1.223')] [2022-07-13 15:51:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369349632. Throughput: 0: 9778.9. Samples: 738700688. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:53,990][27935] Avg episode reward: [(0, '-1.175')] [2022-07-13 15:51:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 369375232. Throughput: 0: 9777.3. Samples: 738759348. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:51:58,990][27935] Avg episode reward: [(0, '0.366')] [2022-07-13 15:52:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 369398784. Throughput: 0: 9696.5. Samples: 738814256. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:03,989][27935] Avg episode reward: [(0, '0.525')] [2022-07-13 15:52:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369421312. Throughput: 0: 9705.5. Samples: 738843672. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:08,989][27935] Avg episode reward: [(0, '1.100')] [2022-07-13 15:52:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369446912. Throughput: 0: 9713.6. Samples: 738902748. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:13,990][27935] Avg episode reward: [(0, '1.217')] [2022-07-13 15:52:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369470464. Throughput: 0: 9722.2. Samples: 738961756. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:18,990][27935] Avg episode reward: [(0, '1.001')] [2022-07-13 15:52:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 369496064. Throughput: 0: 9719.4. Samples: 738991040. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:23,990][27935] Avg episode reward: [(0, '1.084')] [2022-07-13 15:52:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.2). Total num frames: 369520640. Throughput: 0: 9724.9. Samples: 739050364. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:28,989][27935] Avg episode reward: [(0, '0.621')] [2022-07-13 15:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369544192. Throughput: 0: 9730.1. Samples: 739109120. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:33,990][27935] Avg episode reward: [(0, '0.754')] [2022-07-13 15:52:38,991][27935] Fps is (10 sec: 4811.7, 60 sec: 4863.8, 300 sec: 4866.6). Total num frames: 369568768. Throughput: 0: 9723.4. Samples: 739138264. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:38,992][27935] Avg episode reward: [(0, '-0.009')] [2022-07-13 15:52:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 369592320. Throughput: 0: 9713.1. Samples: 739196436. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:43,997][27935] Avg episode reward: [(0, '-0.175')] [2022-07-13 15:52:48,989][27935] Fps is (10 sec: 5121.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 369619968. Throughput: 0: 9793.6. Samples: 739254968. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:48,989][27935] Avg episode reward: [(0, '-0.293')] [2022-07-13 15:52:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 369642496. Throughput: 0: 9791.6. Samples: 739284292. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:53,989][27935] Avg episode reward: [(0, '-0.488')] [2022-07-13 15:52:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 369667072. Throughput: 0: 9787.7. Samples: 739343192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:52:58,989][27935] Avg episode reward: [(0, '-0.852')] [2022-07-13 15:53:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 369689600. Throughput: 0: 9133.8. Samples: 739372776. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:53:03,989][27935] Avg episode reward: [(0, '-0.671')] [2022-07-13 15:53:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369713152. Throughput: 0: 9710.8. Samples: 739428024. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:53:08,989][27935] Avg episode reward: [(0, '-1.211')] [2022-07-13 15:53:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 369739776. Throughput: 0: 9703.0. Samples: 739487000. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 15:53:13,989][27935] Avg episode reward: [(0, '-1.287')] [2022-07-13 15:53:18,992][27935] Fps is (10 sec: 5015.9, 60 sec: 4880.8, 300 sec: 4866.5). Total num frames: 369763328. Throughput: 0: 9696.1. Samples: 739545476. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:18,993][27935] Avg episode reward: [(0, '-1.595')] [2022-07-13 15:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369787904. Throughput: 0: 9703.2. Samples: 739574888. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:23,989][27935] Avg episode reward: [(0, '-0.669')] [2022-07-13 15:53:28,989][27935] Fps is (10 sec: 4712.0, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 369810432. Throughput: 0: 9717.2. Samples: 739633708. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:28,989][27935] Avg episode reward: [(0, '-0.130')] [2022-07-13 15:53:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369836032. Throughput: 0: 9715.2. Samples: 739692152. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:33,989][27935] Avg episode reward: [(0, '0.021')] [2022-07-13 15:53:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.3, 300 sec: 4870.1). Total num frames: 369861632. Throughput: 0: 9727.3. Samples: 739722020. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:38,989][27935] Avg episode reward: [(0, '0.678')] [2022-07-13 15:53:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.6). Total num frames: 369885184. Throughput: 0: 9732.6. Samples: 739781160. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:43,989][27935] Avg episode reward: [(0, '1.487')] [2022-07-13 15:53:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4866.7). Total num frames: 369909760. Throughput: 0: 10391.6. Samples: 739840396. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:48,989][27935] Avg episode reward: [(0, '0.949')] [2022-07-13 15:53:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 369934336. Throughput: 0: 9820.3. Samples: 739869940. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:53,990][27935] Avg episode reward: [(0, '0.373')] [2022-07-13 15:53:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4877.2). Total num frames: 369959936. Throughput: 0: 9824.6. Samples: 739929108. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:53:58,989][27935] Avg episode reward: [(0, '0.408')] [2022-07-13 15:54:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 369981440. Throughput: 0: 9712.1. Samples: 739982488. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:03,996][27935] Avg episode reward: [(0, '0.545')] [2022-07-13 15:54:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 370004992. Throughput: 0: 9694.5. Samples: 740011140. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:08,990][27935] Avg episode reward: [(0, '-0.038')] [2022-07-13 15:54:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 370030592. Throughput: 0: 9685.5. Samples: 740069556. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:13,989][27935] Avg episode reward: [(0, '-0.362')] [2022-07-13 15:54:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.2, 300 sec: 4863.1). Total num frames: 370054144. Throughput: 0: 9699.2. Samples: 740128616. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:18,989][27935] Avg episode reward: [(0, '0.538')] [2022-07-13 15:54:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 370078720. Throughput: 0: 9687.8. Samples: 740157972. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:23,989][27935] Avg episode reward: [(0, '1.030')] [2022-07-13 15:54:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 370104320. Throughput: 0: 9683.3. Samples: 740216908. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:28,989][27935] Avg episode reward: [(0, '0.867')] [2022-07-13 15:54:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 370128896. Throughput: 0: 9019.5. Samples: 740246272. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:33,989][27935] Avg episode reward: [(0, '0.570')] [2022-07-13 15:54:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 370152448. Throughput: 0: 9661.3. Samples: 740304696. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:38,990][27935] Avg episode reward: [(0, '0.275')] [2022-07-13 15:54:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 370176000. Throughput: 0: 9650.7. Samples: 740363388. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:43,989][27935] Avg episode reward: [(0, '-0.095')] [2022-07-13 15:54:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370202624. Throughput: 0: 9771.1. Samples: 740422188. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:48,989][27935] Avg episode reward: [(0, '-0.026')] [2022-07-13 15:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 370225152. Throughput: 0: 9789.4. Samples: 740451664. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:53,990][27935] Avg episode reward: [(0, '-0.379')] [2022-07-13 15:54:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 370250752. Throughput: 0: 9794.9. Samples: 740510328. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:54:58,989][27935] Avg episode reward: [(0, '-0.929')] [2022-07-13 15:55:03,993][27935] Fps is (10 sec: 4810.9, 60 sec: 4863.7, 300 sec: 4866.5). Total num frames: 370273280. Throughput: 0: 9715.9. Samples: 740565868. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:03,995][27935] Avg episode reward: [(0, '-0.690')] [2022-07-13 15:55:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 370298880. Throughput: 0: 9719.2. Samples: 740595336. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:08,989][27935] Avg episode reward: [(0, '-0.872')] [2022-07-13 15:55:13,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 370322432. Throughput: 0: 9724.4. Samples: 740654508. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:13,989][27935] Avg episode reward: [(0, '-0.899')] [2022-07-13 15:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 370347008. Throughput: 0: 10381.7. Samples: 740713448. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:18,989][27935] Avg episode reward: [(0, '-1.135')] [2022-07-13 15:55:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 370371584. Throughput: 0: 9743.4. Samples: 740743148. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:23,989][27935] Avg episode reward: [(0, '-1.540')] [2022-07-13 15:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 370396160. Throughput: 0: 9748.5. Samples: 740802068. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:28,989][27935] Avg episode reward: [(0, '-1.478')] [2022-07-13 15:55:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 370420736. Throughput: 0: 9740.0. Samples: 740860488. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:33,990][27935] Avg episode reward: [(0, '-2.071')] [2022-07-13 15:55:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 370445312. Throughput: 0: 9741.3. Samples: 740890020. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:38,989][27935] Avg episode reward: [(0, '-2.357')] [2022-07-13 15:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4866.6). Total num frames: 370470912. Throughput: 0: 9754.4. Samples: 740949276. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:43,989][27935] Avg episode reward: [(0, '-1.674')] [2022-07-13 15:55:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 370494464. Throughput: 0: 9831.9. Samples: 741008264. Policy #0 lag: (min: 0.0, avg: 8.2, max: 20.0) [2022-07-13 15:55:48,991][27935] Avg episode reward: [(0, '-1.552')] [2022-07-13 15:55:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 370518016. Throughput: 0: 9831.5. Samples: 741037752. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:55:53,990][27935] Avg episode reward: [(0, '-0.882')] [2022-07-13 15:55:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 370543616. Throughput: 0: 9824.8. Samples: 741096624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:55:58,991][27935] Avg episode reward: [(0, '-1.378')] [2022-07-13 15:56:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.4, 300 sec: 4870.1). Total num frames: 370566144. Throughput: 0: 9743.8. Samples: 741151920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:03,991][27935] Avg episode reward: [(0, '-0.981')] [2022-07-13 15:56:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 370590720. Throughput: 0: 9738.1. Samples: 741181364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:08,989][27935] Avg episode reward: [(0, '-0.842')] [2022-07-13 15:56:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370615296. Throughput: 0: 9739.7. Samples: 741240356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:13,989][27935] Avg episode reward: [(0, '-1.079')] [2022-07-13 15:56:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 370639872. Throughput: 0: 9742.0. Samples: 741298876. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:18,989][27935] Avg episode reward: [(0, '-0.747')] [2022-07-13 15:56:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370664448. Throughput: 0: 9733.7. Samples: 741328036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:23,989][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 15:56:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370689024. Throughput: 0: 9712.4. Samples: 741386332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:28,989][27935] Avg episode reward: [(0, '-1.380')] [2022-07-13 15:56:33,992][27935] Fps is (10 sec: 4811.0, 60 sec: 4863.7, 300 sec: 4866.5). Total num frames: 370712576. Throughput: 0: 9705.7. Samples: 741445056. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:33,993][27935] Avg episode reward: [(0, '-1.037')] [2022-07-13 15:56:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370738176. Throughput: 0: 9701.2. Samples: 741474304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:38,990][27935] Avg episode reward: [(0, '-0.935')] [2022-07-13 15:56:43,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 370762752. Throughput: 0: 9704.5. Samples: 741533328. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:43,989][27935] Avg episode reward: [(0, '-0.060')] [2022-07-13 15:56:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 370786304. Throughput: 0: 9800.0. Samples: 741592920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:48,989][27935] Avg episode reward: [(0, '0.249')] [2022-07-13 15:56:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 370811904. Throughput: 0: 9804.5. Samples: 741622568. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:53,989][27935] Avg episode reward: [(0, '-0.282')] [2022-07-13 15:56:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 370835456. Throughput: 0: 9806.2. Samples: 741681636. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:56:58,989][27935] Avg episode reward: [(0, '-0.247')] [2022-07-13 15:57:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 370857984. Throughput: 0: 9730.3. Samples: 741736740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:03,989][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 15:57:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370883584. Throughput: 0: 9740.4. Samples: 741766356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:08,992][27935] Avg episode reward: [(0, '1.070')] [2022-07-13 15:57:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 370906112. Throughput: 0: 9752.8. Samples: 741825208. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:13,989][27935] Avg episode reward: [(0, '-0.112')] [2022-07-13 15:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 370931712. Throughput: 0: 9755.0. Samples: 741883996. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:18,989][27935] Avg episode reward: [(0, '-0.216')] [2022-07-13 15:57:23,989][27935] Fps is (10 sec: 5120.1, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 370957312. Throughput: 0: 9763.8. Samples: 741913676. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:23,989][27935] Avg episode reward: [(0, '-0.302')] [2022-07-13 15:57:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 370982912. Throughput: 0: 9751.4. Samples: 741972140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:28,989][27935] Avg episode reward: [(0, '-0.392')] [2022-07-13 15:57:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.4, 300 sec: 4870.1). Total num frames: 371005440. Throughput: 0: 9732.6. Samples: 742030888. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:33,989][27935] Avg episode reward: [(0, '-0.902')] [2022-07-13 15:57:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 371028992. Throughput: 0: 9729.5. Samples: 742060396. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:38,989][27935] Avg episode reward: [(0, '-1.224')] [2022-07-13 15:57:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 371054592. Throughput: 0: 9721.1. Samples: 742119084. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:43,989][27935] Avg episode reward: [(0, '-1.286')] [2022-07-13 15:57:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 371080192. Throughput: 0: 9795.6. Samples: 742177544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:48,989][27935] Avg episode reward: [(0, '-0.397')] [2022-07-13 15:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 371103744. Throughput: 0: 9794.5. Samples: 742207108. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:53,989][27935] Avg episode reward: [(0, '-0.594')] [2022-07-13 15:57:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 371127296. Throughput: 0: 9789.2. Samples: 742265720. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:57:58,989][27935] Avg episode reward: [(0, '-0.396')] [2022-07-13 15:58:03,992][27935] Fps is (10 sec: 4606.4, 60 sec: 4863.7, 300 sec: 4870.0). Total num frames: 371149824. Throughput: 0: 9698.6. Samples: 742320468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:58:03,993][27935] Avg episode reward: [(0, '0.369')] [2022-07-13 15:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 371174400. Throughput: 0: 9694.1. Samples: 742349912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:58:08,989][27935] Avg episode reward: [(0, '0.810')] [2022-07-13 15:58:13,989][27935] Fps is (10 sec: 5019.4, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 371200000. Throughput: 0: 9695.0. Samples: 742408416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:58:13,989][27935] Avg episode reward: [(0, '0.977')] [2022-07-13 15:58:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 371224576. Throughput: 0: 9696.5. Samples: 742467232. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:58:18,989][27935] Avg episode reward: [(0, '1.222')] [2022-07-13 15:58:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 371249152. Throughput: 0: 9703.0. Samples: 742497032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 15:58:23,989][27935] Avg episode reward: [(0, '1.417')] [2022-07-13 15:58:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4863.1). Total num frames: 371270656. Throughput: 0: 9692.4. Samples: 742555240. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:28,990][27935] Avg episode reward: [(0, '1.249')] [2022-07-13 15:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 371297280. Throughput: 0: 9038.6. Samples: 742584280. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:33,989][27935] Avg episode reward: [(0, '1.183')] [2022-07-13 15:58:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 371321856. Throughput: 0: 9690.8. Samples: 742643192. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:38,989][27935] Avg episode reward: [(0, '-0.824')] [2022-07-13 15:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 371346432. Throughput: 0: 9696.3. Samples: 742702052. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:43,989][27935] Avg episode reward: [(0, '-1.042')] [2022-07-13 15:58:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 371371008. Throughput: 0: 9789.1. Samples: 742760940. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:48,989][27935] Avg episode reward: [(0, '-1.327')] [2022-07-13 15:58:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 371395584. Throughput: 0: 9786.2. Samples: 742790292. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:53,990][27935] Avg episode reward: [(0, '-2.126')] [2022-07-13 15:58:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 371420160. Throughput: 0: 9785.7. Samples: 742848772. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:58:58,990][27935] Avg episode reward: [(0, '-1.908')] [2022-07-13 15:59:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.4, 300 sec: 4873.5). Total num frames: 371442688. Throughput: 0: 9696.8. Samples: 742903588. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:03,991][27935] Avg episode reward: [(0, '-2.275')] [2022-07-13 15:59:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 371466240. Throughput: 0: 9687.4. Samples: 742932964. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:08,989][27935] Avg episode reward: [(0, '-2.090')] [2022-07-13 15:59:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 371489792. Throughput: 0: 9694.8. Samples: 742991508. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:13,990][27935] Avg episode reward: [(0, '-0.379')] [2022-07-13 15:59:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 371514368. Throughput: 0: 10357.0. Samples: 743050344. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:18,991][27935] Avg episode reward: [(0, '-0.825')] [2022-07-13 15:59:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 371539968. Throughput: 0: 9704.2. Samples: 743079880. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:23,989][27935] Avg episode reward: [(0, '-1.033')] [2022-07-13 15:59:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 371564544. Throughput: 0: 9702.9. Samples: 743138684. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:29,000][27935] Avg episode reward: [(0, '-0.149')] [2022-07-13 15:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 371588096. Throughput: 0: 9689.1. Samples: 743196948. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:33,989][27935] Avg episode reward: [(0, '-0.470')] [2022-07-13 15:59:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 371611648. Throughput: 0: 9682.2. Samples: 743225992. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:38,990][27935] Avg episode reward: [(0, '-0.043')] [2022-07-13 15:59:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 371639296. Throughput: 0: 9685.9. Samples: 743284636. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:43,989][27935] Avg episode reward: [(0, '0.150')] [2022-07-13 15:59:48,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 371661824. Throughput: 0: 9767.4. Samples: 743343120. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:48,989][27935] Avg episode reward: [(0, '0.540')] [2022-07-13 15:59:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 371686400. Throughput: 0: 9768.1. Samples: 743372528. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:53,989][27935] Avg episode reward: [(0, '0.549')] [2022-07-13 15:59:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 371709952. Throughput: 0: 9759.7. Samples: 743430692. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 15:59:58,989][27935] Avg episode reward: [(0, '0.705')] [2022-07-13 16:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 371733504. Throughput: 0: 9667.1. Samples: 743485364. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:03,991][27935] Avg episode reward: [(0, '0.650')] [2022-07-13 16:00:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 371756032. Throughput: 0: 9642.6. Samples: 743513796. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:08,990][27935] Avg episode reward: [(0, '-0.150')] [2022-07-13 16:00:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 371779584. Throughput: 0: 9602.8. Samples: 743570812. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:13,989][27935] Avg episode reward: [(0, '-0.462')] [2022-07-13 16:00:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 371805184. Throughput: 0: 9602.5. Samples: 743629060. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:18,989][27935] Avg episode reward: [(0, '-0.564')] [2022-07-13 16:00:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 371828736. Throughput: 0: 9608.3. Samples: 743658364. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:23,989][27935] Avg episode reward: [(0, '-1.172')] [2022-07-13 16:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 371854336. Throughput: 0: 9615.2. Samples: 743717320. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:28,992][27935] Avg episode reward: [(0, '-1.244')] [2022-07-13 16:00:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 371878912. Throughput: 0: 9613.9. Samples: 743775744. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:33,989][27935] Avg episode reward: [(0, '-1.959')] [2022-07-13 16:00:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 371903488. Throughput: 0: 9619.7. Samples: 743805416. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:38,989][27935] Avg episode reward: [(0, '-1.027')] [2022-07-13 16:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4856.2). Total num frames: 371927040. Throughput: 0: 9630.8. Samples: 743864076. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:43,989][27935] Avg episode reward: [(0, '-1.760')] [2022-07-13 16:00:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 371951616. Throughput: 0: 9729.8. Samples: 743923204. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:48,989][27935] Avg episode reward: [(0, '-1.991')] [2022-07-13 16:00:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 371977216. Throughput: 0: 9753.6. Samples: 743952708. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:53,990][27935] Avg episode reward: [(0, '-2.195')] [2022-07-13 16:00:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 372001792. Throughput: 0: 9792.4. Samples: 744011468. Policy #0 lag: (min: 0.0, avg: 11.4, max: 22.0) [2022-07-13 16:00:58,989][27935] Avg episode reward: [(0, '-0.924')] [2022-07-13 16:01:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 372022272. Throughput: 0: 9715.2. Samples: 744066244. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:03,991][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 16:01:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 372047872. Throughput: 0: 9711.1. Samples: 744095364. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:08,989][27935] Avg episode reward: [(0, '-0.658')] [2022-07-13 16:01:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 372072448. Throughput: 0: 9709.8. Samples: 744154260. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:13,989][27935] Avg episode reward: [(0, '-1.005')] [2022-07-13 16:01:18,993][27935] Fps is (10 sec: 4913.4, 60 sec: 4863.7, 300 sec: 4856.1). Total num frames: 372097024. Throughput: 0: 9721.9. Samples: 744213268. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:18,993][27935] Avg episode reward: [(0, '0.305')] [2022-07-13 16:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 372120576. Throughput: 0: 9718.2. Samples: 744242736. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:23,989][27935] Avg episode reward: [(0, '0.273')] [2022-07-13 16:01:28,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4846.9, 300 sec: 4856.3). Total num frames: 372145152. Throughput: 0: 9713.3. Samples: 744301176. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:28,989][27935] Avg episode reward: [(0, '0.072')] [2022-07-13 16:01:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 372170752. Throughput: 0: 9680.0. Samples: 744358804. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:33,989][27935] Avg episode reward: [(0, '0.315')] [2022-07-13 16:01:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 372194304. Throughput: 0: 9671.9. Samples: 744387944. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:38,989][27935] Avg episode reward: [(0, '0.927')] [2022-07-13 16:01:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 372216832. Throughput: 0: 9670.7. Samples: 744446648. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:43,996][27935] Avg episode reward: [(0, '1.075')] [2022-07-13 16:01:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 372243456. Throughput: 0: 9750.9. Samples: 744505036. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:48,990][27935] Avg episode reward: [(0, '1.287')] [2022-07-13 16:01:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 372268032. Throughput: 0: 9761.1. Samples: 744534612. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:53,989][27935] Avg episode reward: [(0, '1.291')] [2022-07-13 16:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 372291584. Throughput: 0: 9758.1. Samples: 744593372. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:01:58,989][27935] Avg episode reward: [(0, '0.780')] [2022-07-13 16:02:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 372314112. Throughput: 0: 9664.4. Samples: 744648128. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:03,991][27935] Avg episode reward: [(0, '-0.110')] [2022-07-13 16:02:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 372338688. Throughput: 0: 9663.4. Samples: 744677588. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:08,989][27935] Avg episode reward: [(0, '-0.231')] [2022-07-13 16:02:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 372362240. Throughput: 0: 9672.4. Samples: 744736432. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:13,990][27935] Avg episode reward: [(0, '-0.250')] [2022-07-13 16:02:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.2, 300 sec: 4849.2). Total num frames: 372387840. Throughput: 0: 9677.5. Samples: 744794292. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:18,991][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 16:02:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 372411392. Throughput: 0: 9681.8. Samples: 744823624. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:23,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 16:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 372435968. Throughput: 0: 9668.4. Samples: 744881724. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:28,989][27935] Avg episode reward: [(0, '-0.997')] [2022-07-13 16:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 372460544. Throughput: 0: 9661.6. Samples: 744939808. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:33,989][27935] Avg episode reward: [(0, '-0.238')] [2022-07-13 16:02:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 372484096. Throughput: 0: 9661.3. Samples: 744969372. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:38,989][27935] Avg episode reward: [(0, '-0.453')] [2022-07-13 16:02:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 372508672. Throughput: 0: 9651.0. Samples: 745027668. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:43,989][27935] Avg episode reward: [(0, '-0.417')] [2022-07-13 16:02:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 372533248. Throughput: 0: 9746.4. Samples: 745086716. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:48,989][27935] Avg episode reward: [(0, '-0.546')] [2022-07-13 16:02:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 372558848. Throughput: 0: 9752.2. Samples: 745116436. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:53,989][27935] Avg episode reward: [(0, '-0.901')] [2022-07-13 16:02:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 372582400. Throughput: 0: 9757.1. Samples: 745175500. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:02:58,990][27935] Avg episode reward: [(0, '0.459')] [2022-07-13 16:03:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 372605952. Throughput: 0: 9692.7. Samples: 745230464. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:03,989][27935] Avg episode reward: [(0, '0.515')] [2022-07-13 16:03:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 372628480. Throughput: 0: 9696.4. Samples: 745259964. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:08,990][27935] Avg episode reward: [(0, '0.582')] [2022-07-13 16:03:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 372655104. Throughput: 0: 9710.9. Samples: 745318716. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:13,989][27935] Avg episode reward: [(0, '0.274')] [2022-07-13 16:03:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 372678656. Throughput: 0: 9714.7. Samples: 745376972. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:18,989][27935] Avg episode reward: [(0, '0.287')] [2022-07-13 16:03:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 372703232. Throughput: 0: 9719.3. Samples: 745406740. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:23,989][27935] Avg episode reward: [(0, '-0.455')] [2022-07-13 16:03:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 372727808. Throughput: 0: 9737.6. Samples: 745465860. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:28,990][27935] Avg episode reward: [(0, '-0.272')] [2022-07-13 16:03:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 372752384. Throughput: 0: 9735.1. Samples: 745524796. Policy #0 lag: (min: 0.0, avg: 10.6, max: 20.0) [2022-07-13 16:03:33,989][27935] Avg episode reward: [(0, '-0.180')] [2022-07-13 16:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 372776960. Throughput: 0: 9730.4. Samples: 745554304. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:03:38,989][27935] Avg episode reward: [(0, '-1.320')] [2022-07-13 16:03:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 372802560. Throughput: 0: 9743.7. Samples: 745613964. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:03:43,990][27935] Avg episode reward: [(0, '-1.042')] [2022-07-13 16:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 372827136. Throughput: 0: 9821.5. Samples: 745672432. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:03:48,989][27935] Avg episode reward: [(0, '-1.255')] [2022-07-13 16:03:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 372850688. Throughput: 0: 9814.5. Samples: 745701616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:03:53,990][27935] Avg episode reward: [(0, '-1.619')] [2022-07-13 16:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 372875264. Throughput: 0: 9823.0. Samples: 745760752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:03:58,990][27935] Avg episode reward: [(0, '-1.863')] [2022-07-13 16:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 372896768. Throughput: 0: 9750.6. Samples: 745815748. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:03,991][27935] Avg episode reward: [(0, '-2.601')] [2022-07-13 16:04:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 372922368. Throughput: 0: 9747.5. Samples: 745845376. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:08,990][27935] Avg episode reward: [(0, '-1.520')] [2022-07-13 16:04:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 372946944. Throughput: 0: 9743.9. Samples: 745904336. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:13,996][27935] Avg episode reward: [(0, '-1.774')] [2022-07-13 16:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 372971520. Throughput: 0: 9746.5. Samples: 745963388. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:18,989][27935] Avg episode reward: [(0, '-1.857')] [2022-07-13 16:04:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 372997120. Throughput: 0: 9755.0. Samples: 745993280. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:23,989][27935] Avg episode reward: [(0, '-2.578')] [2022-07-13 16:04:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 373020672. Throughput: 0: 9755.0. Samples: 746052940. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:28,989][27935] Avg episode reward: [(0, '-2.348')] [2022-07-13 16:04:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 373046272. Throughput: 0: 9753.8. Samples: 746111352. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:33,989][27935] Avg episode reward: [(0, '-2.680')] [2022-07-13 16:04:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 373070848. Throughput: 0: 9764.4. Samples: 746141012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:38,989][27935] Avg episode reward: [(0, '-1.851')] [2022-07-13 16:04:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 373096448. Throughput: 0: 9753.8. Samples: 746199672. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:43,989][27935] Avg episode reward: [(0, '-2.009')] [2022-07-13 16:04:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 373120000. Throughput: 0: 9839.0. Samples: 746258504. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:48,989][27935] Avg episode reward: [(0, '-1.462')] [2022-07-13 16:04:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 373143552. Throughput: 0: 9837.2. Samples: 746288048. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:53,989][27935] Avg episode reward: [(0, '-0.734')] [2022-07-13 16:04:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 373169152. Throughput: 0: 9832.0. Samples: 746346776. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:04:58,989][27935] Avg episode reward: [(0, '-1.631')] [2022-07-13 16:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 373190656. Throughput: 0: 9741.1. Samples: 746401736. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:03,989][27935] Avg episode reward: [(0, '0.253')] [2022-07-13 16:05:08,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 373216256. Throughput: 0: 9727.1. Samples: 746431000. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:08,989][27935] Avg episode reward: [(0, '0.203')] [2022-07-13 16:05:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 373240832. Throughput: 0: 9712.5. Samples: 746490000. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:13,989][27935] Avg episode reward: [(0, '-0.721')] [2022-07-13 16:05:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 373264384. Throughput: 0: 9735.0. Samples: 746549428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:18,989][27935] Avg episode reward: [(0, '-1.419')] [2022-07-13 16:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 373288960. Throughput: 0: 9734.1. Samples: 746579048. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:23,989][27935] Avg episode reward: [(0, '-2.072')] [2022-07-13 16:05:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 373314560. Throughput: 0: 9740.1. Samples: 746637976. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:28,989][27935] Avg episode reward: [(0, '-1.188')] [2022-07-13 16:05:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 373338112. Throughput: 0: 9727.6. Samples: 746696248. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:33,989][27935] Avg episode reward: [(0, '-1.066')] [2022-07-13 16:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 373363712. Throughput: 0: 9719.7. Samples: 746725436. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:38,989][27935] Avg episode reward: [(0, '-0.977')] [2022-07-13 16:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 373387264. Throughput: 0: 9725.7. Samples: 746784432. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:43,989][27935] Avg episode reward: [(0, '-0.148')] [2022-07-13 16:05:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 373411840. Throughput: 0: 9810.4. Samples: 746843204. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:48,989][27935] Avg episode reward: [(0, '0.591')] [2022-07-13 16:05:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 373436416. Throughput: 0: 9811.1. Samples: 746872500. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:53,989][27935] Avg episode reward: [(0, '0.735')] [2022-07-13 16:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 373460992. Throughput: 0: 9816.4. Samples: 746931736. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:05:58,989][27935] Avg episode reward: [(0, '0.537')] [2022-07-13 16:06:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 373482496. Throughput: 0: 9707.6. Samples: 746986268. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:06:03,991][27935] Avg episode reward: [(0, '0.576')] [2022-07-13 16:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373507072. Throughput: 0: 9704.0. Samples: 747015728. Policy #0 lag: (min: 0.0, avg: 9.2, max: 20.0) [2022-07-13 16:06:08,989][27935] Avg episode reward: [(0, '-0.061')] [2022-07-13 16:06:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.2). Total num frames: 373531648. Throughput: 0: 9654.7. Samples: 747072436. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:13,989][27935] Avg episode reward: [(0, '-1.836')] [2022-07-13 16:06:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373555200. Throughput: 0: 9646.5. Samples: 747130340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:18,989][27935] Avg episode reward: [(0, '-1.805')] [2022-07-13 16:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373579776. Throughput: 0: 9647.4. Samples: 747159568. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:23,990][27935] Avg episode reward: [(0, '-2.066')] [2022-07-13 16:06:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 373603328. Throughput: 0: 9633.2. Samples: 747217924. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:28,989][27935] Avg episode reward: [(0, '-2.793')] [2022-07-13 16:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 373627904. Throughput: 0: 9615.1. Samples: 747275884. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:33,989][27935] Avg episode reward: [(0, '-2.068')] [2022-07-13 16:06:38,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4812.6, 300 sec: 4866.6). Total num frames: 373652480. Throughput: 0: 9610.8. Samples: 747305008. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:38,992][27935] Avg episode reward: [(0, '-1.209')] [2022-07-13 16:06:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 373676032. Throughput: 0: 9609.2. Samples: 747364148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:43,989][27935] Avg episode reward: [(0, '-1.426')] [2022-07-13 16:06:48,989][27935] Fps is (10 sec: 5018.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373702656. Throughput: 0: 9700.0. Samples: 747422768. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:48,990][27935] Avg episode reward: [(0, '-0.621')] [2022-07-13 16:06:53,991][27935] Fps is (10 sec: 5016.5, 60 sec: 4829.7, 300 sec: 4863.1). Total num frames: 373726208. Throughput: 0: 9693.5. Samples: 747451956. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:53,991][27935] Avg episode reward: [(0, '-0.100')] [2022-07-13 16:06:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 373751808. Throughput: 0: 9735.6. Samples: 747510536. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:06:58,989][27935] Avg episode reward: [(0, '0.975')] [2022-07-13 16:07:03,993][27935] Fps is (10 sec: 4607.2, 60 sec: 4829.6, 300 sec: 4859.6). Total num frames: 373772288. Throughput: 0: 9659.9. Samples: 747565072. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:03,993][27935] Avg episode reward: [(0, '0.952')] [2022-07-13 16:07:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 373796864. Throughput: 0: 9655.0. Samples: 747594044. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:08,989][27935] Avg episode reward: [(0, '0.595')] [2022-07-13 16:07:13,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4829.8, 300 sec: 4859.7). Total num frames: 373821440. Throughput: 0: 9662.3. Samples: 747652728. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:13,990][27935] Avg episode reward: [(0, '-0.126')] [2022-07-13 16:07:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373846016. Throughput: 0: 9675.0. Samples: 747711260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:18,989][27935] Avg episode reward: [(0, '0.042')] [2022-07-13 16:07:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 373870592. Throughput: 0: 9682.8. Samples: 747740716. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:23,989][27935] Avg episode reward: [(0, '0.211')] [2022-07-13 16:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 373895168. Throughput: 0: 9672.8. Samples: 747799424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:28,989][27935] Avg episode reward: [(0, '-2.277')] [2022-07-13 16:07:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 373919744. Throughput: 0: 9663.6. Samples: 747857628. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:33,989][27935] Avg episode reward: [(0, '-2.291')] [2022-07-13 16:07:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4863.1). Total num frames: 373943296. Throughput: 0: 9665.4. Samples: 747886880. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:38,989][27935] Avg episode reward: [(0, '-1.954')] [2022-07-13 16:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 373966848. Throughput: 0: 9651.0. Samples: 747944832. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:43,990][27935] Avg episode reward: [(0, '-1.112')] [2022-07-13 16:07:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 373992448. Throughput: 0: 9743.9. Samples: 748003512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:48,989][27935] Avg episode reward: [(0, '-1.845')] [2022-07-13 16:07:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.1, 300 sec: 4863.1). Total num frames: 374017024. Throughput: 0: 9755.5. Samples: 748033040. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:53,989][27935] Avg episode reward: [(0, '-1.716')] [2022-07-13 16:07:58,990][27935] Fps is (10 sec: 4812.3, 60 sec: 4812.7, 300 sec: 4863.1). Total num frames: 374040576. Throughput: 0: 9758.2. Samples: 748091852. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:07:58,990][27935] Avg episode reward: [(0, '-0.318')] [2022-07-13 16:08:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.2, 300 sec: 4863.1). Total num frames: 374063104. Throughput: 0: 9680.7. Samples: 748146892. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:03,992][27935] Avg episode reward: [(0, '-0.238')] [2022-07-13 16:08:08,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 374088704. Throughput: 0: 9686.1. Samples: 748176592. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:08,989][27935] Avg episode reward: [(0, '-0.224')] [2022-07-13 16:08:13,996][27935] Fps is (10 sec: 5013.8, 60 sec: 4863.4, 300 sec: 4863.0). Total num frames: 374113280. Throughput: 0: 9684.5. Samples: 748235300. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:13,997][27935] Avg episode reward: [(0, '-0.455')] [2022-07-13 16:08:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 374136832. Throughput: 0: 9698.0. Samples: 748294040. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:18,989][27935] Avg episode reward: [(0, '-0.197')] [2022-07-13 16:08:23,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 374161408. Throughput: 0: 9701.0. Samples: 748323424. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:23,989][27935] Avg episode reward: [(0, '-0.296')] [2022-07-13 16:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 374184960. Throughput: 0: 9709.6. Samples: 748381764. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:28,989][27935] Avg episode reward: [(0, '0.538')] [2022-07-13 16:08:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 374211584. Throughput: 0: 9691.3. Samples: 748439620. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:33,989][27935] Avg episode reward: [(0, '0.462')] [2022-07-13 16:08:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 374234112. Throughput: 0: 9685.4. Samples: 748468884. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:38,989][27935] Avg episode reward: [(0, '-0.246')] [2022-07-13 16:08:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 374258688. Throughput: 0: 9682.1. Samples: 748527536. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 16:08:43,989][27935] Avg episode reward: [(0, '-0.402')] [2022-07-13 16:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 374283264. Throughput: 0: 9761.5. Samples: 748586160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:08:48,989][27935] Avg episode reward: [(0, '-0.775')] [2022-07-13 16:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 374306816. Throughput: 0: 9755.2. Samples: 748615576. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:08:53,990][27935] Avg episode reward: [(0, '-1.357')] [2022-07-13 16:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 374333440. Throughput: 0: 9745.7. Samples: 748673780. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:08:58,990][27935] Avg episode reward: [(0, '-1.911')] [2022-07-13 16:09:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 374354944. Throughput: 0: 9652.7. Samples: 748728412. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:03,989][27935] Avg episode reward: [(0, '-1.887')] [2022-07-13 16:09:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 374379520. Throughput: 0: 9653.9. Samples: 748757848. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:08,989][27935] Avg episode reward: [(0, '-1.614')] [2022-07-13 16:09:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4813.4, 300 sec: 4849.2). Total num frames: 374402048. Throughput: 0: 9647.7. Samples: 748815912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:13,989][27935] Avg episode reward: [(0, '-1.123')] [2022-07-13 16:09:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 374428672. Throughput: 0: 9652.5. Samples: 748873984. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:18,989][27935] Avg episode reward: [(0, '-0.916')] [2022-07-13 16:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 374451200. Throughput: 0: 9658.0. Samples: 748903492. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:23,990][27935] Avg episode reward: [(0, '-0.821')] [2022-07-13 16:09:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 374475776. Throughput: 0: 9644.6. Samples: 748961544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:28,989][27935] Avg episode reward: [(0, '-0.563')] [2022-07-13 16:09:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 374500352. Throughput: 0: 9638.0. Samples: 749019872. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:33,991][27935] Avg episode reward: [(0, '-0.891')] [2022-07-13 16:09:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 374523904. Throughput: 0: 9624.0. Samples: 749048656. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:38,989][27935] Avg episode reward: [(0, '-1.486')] [2022-07-13 16:09:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 374548480. Throughput: 0: 9631.4. Samples: 749107192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:43,989][27935] Avg episode reward: [(0, '-1.227')] [2022-07-13 16:09:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 374574080. Throughput: 0: 9708.7. Samples: 749165304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:48,989][27935] Avg episode reward: [(0, '-1.197')] [2022-07-13 16:09:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 374597632. Throughput: 0: 9698.1. Samples: 749194264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:53,990][27935] Avg episode reward: [(0, '-0.502')] [2022-07-13 16:09:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4845.8). Total num frames: 374620160. Throughput: 0: 9710.2. Samples: 749252872. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:09:58,991][27935] Avg episode reward: [(0, '-0.014')] [2022-07-13 16:10:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 374643712. Throughput: 0: 9626.2. Samples: 749307164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:03,991][27935] Avg episode reward: [(0, '0.677')] [2022-07-13 16:10:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 374668288. Throughput: 0: 9617.5. Samples: 749336280. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:08,990][27935] Avg episode reward: [(0, '0.628')] [2022-07-13 16:10:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 374691840. Throughput: 0: 9621.4. Samples: 749394508. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:13,989][27935] Avg episode reward: [(0, '1.263')] [2022-07-13 16:10:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 374717440. Throughput: 0: 9609.6. Samples: 749452304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:18,991][27935] Avg episode reward: [(0, '1.252')] [2022-07-13 16:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 374739968. Throughput: 0: 9617.1. Samples: 749481424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:23,989][27935] Avg episode reward: [(0, '1.025')] [2022-07-13 16:10:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 374764544. Throughput: 0: 9612.2. Samples: 749539740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:28,990][27935] Avg episode reward: [(0, '1.294')] [2022-07-13 16:10:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 374789120. Throughput: 0: 9611.9. Samples: 749597840. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:33,989][27935] Avg episode reward: [(0, '1.310')] [2022-07-13 16:10:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 374813696. Throughput: 0: 9613.6. Samples: 749626876. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:38,989][27935] Avg episode reward: [(0, '1.402')] [2022-07-13 16:10:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 374837248. Throughput: 0: 9609.7. Samples: 749685308. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:43,989][27935] Avg episode reward: [(0, '1.710')] [2022-07-13 16:10:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 374860800. Throughput: 0: 9702.9. Samples: 749743792. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:48,989][27935] Avg episode reward: [(0, '1.853')] [2022-07-13 16:10:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 374886400. Throughput: 0: 9701.8. Samples: 749772860. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:53,989][27935] Avg episode reward: [(0, '1.595')] [2022-07-13 16:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 374909952. Throughput: 0: 9706.3. Samples: 749831292. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:10:58,989][27935] Avg episode reward: [(0, '0.747')] [2022-07-13 16:11:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 374932480. Throughput: 0: 9625.7. Samples: 749885460. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:11:03,991][27935] Avg episode reward: [(0, '0.647')] [2022-07-13 16:11:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 374958080. Throughput: 0: 9627.1. Samples: 749914644. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:11:08,989][27935] Avg episode reward: [(0, '0.219')] [2022-07-13 16:11:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 374981632. Throughput: 0: 9632.4. Samples: 749973200. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:11:13,989][27935] Avg episode reward: [(0, '-0.197')] [2022-07-13 16:11:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 375006208. Throughput: 0: 9634.2. Samples: 750031380. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:11:18,989][27935] Avg episode reward: [(0, '-0.068')] [2022-07-13 16:11:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 375029760. Throughput: 0: 9633.2. Samples: 750060372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:11:23,989][27935] Avg episode reward: [(0, '-0.065')] [2022-07-13 16:11:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 375055360. Throughput: 0: 9628.9. Samples: 750118608. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:28,989][27935] Avg episode reward: [(0, '0.159')] [2022-07-13 16:11:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 375078912. Throughput: 0: 9633.5. Samples: 750177300. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:33,989][27935] Avg episode reward: [(0, '0.725')] [2022-07-13 16:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 375103488. Throughput: 0: 9640.5. Samples: 750206684. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:38,989][27935] Avg episode reward: [(0, '0.858')] [2022-07-13 16:11:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 375129088. Throughput: 0: 9645.4. Samples: 750265336. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:43,989][27935] Avg episode reward: [(0, '1.143')] [2022-07-13 16:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 375152640. Throughput: 0: 9751.5. Samples: 750324276. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:48,989][27935] Avg episode reward: [(0, '1.424')] [2022-07-13 16:11:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 375176192. Throughput: 0: 9765.3. Samples: 750354084. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:53,990][27935] Avg episode reward: [(0, '1.154')] [2022-07-13 16:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 375201792. Throughput: 0: 9775.2. Samples: 750413084. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:11:58,989][27935] Avg episode reward: [(0, '1.212')] [2022-07-13 16:12:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 375223296. Throughput: 0: 9702.6. Samples: 750467996. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:03,989][27935] Avg episode reward: [(0, '1.076')] [2022-07-13 16:12:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 375248896. Throughput: 0: 9715.9. Samples: 750497588. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:08,989][27935] Avg episode reward: [(0, '0.272')] [2022-07-13 16:12:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 375273472. Throughput: 0: 9732.4. Samples: 750556568. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:13,989][27935] Avg episode reward: [(0, '-0.473')] [2022-07-13 16:12:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 375296000. Throughput: 0: 9692.6. Samples: 750613468. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:18,989][27935] Avg episode reward: [(0, '-0.519')] [2022-07-13 16:12:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 375321600. Throughput: 0: 9689.3. Samples: 750642704. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:23,989][27935] Avg episode reward: [(0, '-0.469')] [2022-07-13 16:12:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 375346176. Throughput: 0: 9687.0. Samples: 750701252. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:28,989][27935] Avg episode reward: [(0, '-0.872')] [2022-07-13 16:12:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 375371776. Throughput: 0: 9680.3. Samples: 750759888. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:33,990][27935] Avg episode reward: [(0, '-0.559')] [2022-07-13 16:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 375394304. Throughput: 0: 9671.0. Samples: 750789280. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:38,989][27935] Avg episode reward: [(0, '0.418')] [2022-07-13 16:12:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 375418880. Throughput: 0: 9654.0. Samples: 750847512. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:43,989][27935] Avg episode reward: [(0, '1.040')] [2022-07-13 16:12:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 375441408. Throughput: 0: 9741.7. Samples: 750906372. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:48,991][27935] Avg episode reward: [(0, '0.957')] [2022-07-13 16:12:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 375469056. Throughput: 0: 9746.1. Samples: 750936164. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:53,989][27935] Avg episode reward: [(0, '0.456')] [2022-07-13 16:12:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 375492608. Throughput: 0: 9747.6. Samples: 750995208. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:12:58,990][27935] Avg episode reward: [(0, '0.422')] [2022-07-13 16:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 375515136. Throughput: 0: 9701.9. Samples: 751050052. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:03,991][27935] Avg episode reward: [(0, '1.000')] [2022-07-13 16:13:08,997][27935] Fps is (10 sec: 4809.0, 60 sec: 4863.4, 300 sec: 4838.8). Total num frames: 375540736. Throughput: 0: 9710.3. Samples: 751079744. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:08,997][27935] Avg episode reward: [(0, '0.807')] [2022-07-13 16:13:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 375564288. Throughput: 0: 9722.5. Samples: 751138764. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:13,989][27935] Avg episode reward: [(0, '0.507')] [2022-07-13 16:13:18,989][27935] Fps is (10 sec: 4919.0, 60 sec: 4898.1, 300 sec: 4842.3). Total num frames: 375589888. Throughput: 0: 9727.9. Samples: 751197644. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:18,989][27935] Avg episode reward: [(0, '0.406')] [2022-07-13 16:13:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 375614464. Throughput: 0: 9731.1. Samples: 751227180. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:23,989][27935] Avg episode reward: [(0, '0.769')] [2022-07-13 16:13:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 375636992. Throughput: 0: 9747.3. Samples: 751286140. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:28,989][27935] Avg episode reward: [(0, '0.428')] [2022-07-13 16:13:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 375662592. Throughput: 0: 9749.1. Samples: 751345080. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:33,989][27935] Avg episode reward: [(0, '0.430')] [2022-07-13 16:13:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 375687168. Throughput: 0: 9743.9. Samples: 751374640. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:38,989][27935] Avg episode reward: [(0, '0.431')] [2022-07-13 16:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 375711744. Throughput: 0: 9751.1. Samples: 751434008. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:43,989][27935] Avg episode reward: [(0, '-0.010')] [2022-07-13 16:13:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4949.3, 300 sec: 4852.7). Total num frames: 375738368. Throughput: 0: 9846.4. Samples: 751493140. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:48,989][27935] Avg episode reward: [(0, '0.354')] [2022-07-13 16:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 375760896. Throughput: 0: 9852.0. Samples: 751523008. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:53,989][27935] Avg episode reward: [(0, '-0.181')] [2022-07-13 16:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4856.2). Total num frames: 375787520. Throughput: 0: 9847.8. Samples: 751581916. Policy #0 lag: (min: 0.0, avg: 7.1, max: 18.0) [2022-07-13 16:13:58,989][27935] Avg episode reward: [(0, '0.061')] [2022-07-13 16:14:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 375809024. Throughput: 0: 9764.0. Samples: 751637024. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:03,989][27935] Avg episode reward: [(0, '0.459')] [2022-07-13 16:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4881.7, 300 sec: 4852.7). Total num frames: 375833600. Throughput: 0: 9766.2. Samples: 751666660. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:08,989][27935] Avg episode reward: [(0, '0.289')] [2022-07-13 16:14:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 375857152. Throughput: 0: 9764.6. Samples: 751725548. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:13,989][27935] Avg episode reward: [(0, '0.693')] [2022-07-13 16:14:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 375882752. Throughput: 0: 9759.5. Samples: 751784256. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:18,989][27935] Avg episode reward: [(0, '0.422')] [2022-07-13 16:14:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 375907328. Throughput: 0: 9752.7. Samples: 751813512. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:23,990][27935] Avg episode reward: [(0, '0.355')] [2022-07-13 16:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4852.7). Total num frames: 375931904. Throughput: 0: 9742.8. Samples: 751872436. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:28,990][27935] Avg episode reward: [(0, '-0.035')] [2022-07-13 16:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 375956480. Throughput: 0: 9733.6. Samples: 751931152. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:33,989][27935] Avg episode reward: [(0, '0.098')] [2022-07-13 16:14:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 375979008. Throughput: 0: 9723.6. Samples: 751960568. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:38,989][27935] Avg episode reward: [(0, '-0.405')] [2022-07-13 16:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 376005632. Throughput: 0: 9716.5. Samples: 752019160. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:43,989][27935] Avg episode reward: [(0, '-0.603')] [2022-07-13 16:14:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 376027136. Throughput: 0: 9796.4. Samples: 752077860. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:48,989][27935] Avg episode reward: [(0, '-1.063')] [2022-07-13 16:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 376054784. Throughput: 0: 9793.8. Samples: 752107380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:53,990][27935] Avg episode reward: [(0, '-1.197')] [2022-07-13 16:14:58,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 376079360. Throughput: 0: 9778.4. Samples: 752165576. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:14:58,989][27935] Avg episode reward: [(0, '-0.923')] [2022-07-13 16:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 376101888. Throughput: 0: 9692.8. Samples: 752220432. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:03,989][27935] Avg episode reward: [(0, '-0.145')] [2022-07-13 16:15:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 376124416. Throughput: 0: 9699.1. Samples: 752249972. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:08,989][27935] Avg episode reward: [(0, '0.532')] [2022-07-13 16:15:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 376150016. Throughput: 0: 9697.4. Samples: 752308820. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:13,990][27935] Avg episode reward: [(0, '0.309')] [2022-07-13 16:15:18,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 376173568. Throughput: 0: 9692.2. Samples: 752367300. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:18,989][27935] Avg episode reward: [(0, '0.488')] [2022-07-13 16:15:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 376199168. Throughput: 0: 9693.5. Samples: 752396776. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:23,989][27935] Avg episode reward: [(0, '0.723')] [2022-07-13 16:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 376222720. Throughput: 0: 9692.5. Samples: 752455320. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:28,989][27935] Avg episode reward: [(0, '1.197')] [2022-07-13 16:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 376247296. Throughput: 0: 9695.0. Samples: 752514136. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:33,990][27935] Avg episode reward: [(0, '0.721')] [2022-07-13 16:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 376271872. Throughput: 0: 9687.7. Samples: 752543328. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:38,989][27935] Avg episode reward: [(0, '-0.533')] [2022-07-13 16:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 376296448. Throughput: 0: 9706.2. Samples: 752602356. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:43,989][27935] Avg episode reward: [(0, '-0.782')] [2022-07-13 16:15:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 376321024. Throughput: 0: 9812.9. Samples: 752662012. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:48,989][27935] Avg episode reward: [(0, '-1.259')] [2022-07-13 16:15:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 376345600. Throughput: 0: 9816.9. Samples: 752691732. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:53,989][27935] Avg episode reward: [(0, '-2.020')] [2022-07-13 16:15:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 376370176. Throughput: 0: 9811.8. Samples: 752750352. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:15:58,989][27935] Avg episode reward: [(0, '-1.962')] [2022-07-13 16:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 376392704. Throughput: 0: 9736.6. Samples: 752805448. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:03,989][27935] Avg episode reward: [(0, '-2.348')] [2022-07-13 16:16:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 376419328. Throughput: 0: 9741.2. Samples: 752835132. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:08,989][27935] Avg episode reward: [(0, '-2.151')] [2022-07-13 16:16:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376442880. Throughput: 0: 9752.8. Samples: 752894196. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:13,989][27935] Avg episode reward: [(0, '-1.442')] [2022-07-13 16:16:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376466432. Throughput: 0: 9751.7. Samples: 752952960. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:18,989][27935] Avg episode reward: [(0, '-0.530')] [2022-07-13 16:16:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 376491008. Throughput: 0: 9753.7. Samples: 752982244. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:23,989][27935] Avg episode reward: [(0, '0.140')] [2022-07-13 16:16:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376515584. Throughput: 0: 9751.6. Samples: 753041180. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:28,989][27935] Avg episode reward: [(0, '0.768')] [2022-07-13 16:16:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 376541184. Throughput: 0: 9720.9. Samples: 753099452. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 16:16:33,989][27935] Avg episode reward: [(0, '0.431')] [2022-07-13 16:16:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 376563712. Throughput: 0: 9719.4. Samples: 753129104. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:16:38,989][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 16:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 376590336. Throughput: 0: 9732.7. Samples: 753188324. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:16:43,989][27935] Avg episode reward: [(0, '0.657')] [2022-07-13 16:16:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 376612864. Throughput: 0: 9812.0. Samples: 753246988. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:16:48,989][27935] Avg episode reward: [(0, '-0.108')] [2022-07-13 16:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376638464. Throughput: 0: 9817.1. Samples: 753276904. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:16:53,990][27935] Avg episode reward: [(0, '-0.614')] [2022-07-13 16:16:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 376663040. Throughput: 0: 9804.4. Samples: 753335396. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:16:58,989][27935] Avg episode reward: [(0, '-1.502')] [2022-07-13 16:17:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376685568. Throughput: 0: 9726.7. Samples: 753390660. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:03,991][27935] Avg episode reward: [(0, '-1.938')] [2022-07-13 16:17:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 376710144. Throughput: 0: 9728.3. Samples: 753420016. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:08,989][27935] Avg episode reward: [(0, '-1.193')] [2022-07-13 16:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 376733696. Throughput: 0: 9731.7. Samples: 753479108. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:13,989][27935] Avg episode reward: [(0, '-1.236')] [2022-07-13 16:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 376759296. Throughput: 0: 9087.0. Samples: 753508368. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:18,991][27935] Avg episode reward: [(0, '-0.530')] [2022-07-13 16:17:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 376782848. Throughput: 0: 9735.8. Samples: 753567216. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:23,989][27935] Avg episode reward: [(0, '-0.528')] [2022-07-13 16:17:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 376809472. Throughput: 0: 9725.8. Samples: 753625984. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:28,989][27935] Avg episode reward: [(0, '-0.614')] [2022-07-13 16:17:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 376833024. Throughput: 0: 9723.3. Samples: 753684536. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:33,989][27935] Avg episode reward: [(0, '0.859')] [2022-07-13 16:17:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 376858624. Throughput: 0: 9713.3. Samples: 753714004. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:38,989][27935] Avg episode reward: [(0, '0.651')] [2022-07-13 16:17:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4880.5). Total num frames: 376881152. Throughput: 0: 9718.9. Samples: 753772748. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:43,989][27935] Avg episode reward: [(0, '0.345')] [2022-07-13 16:17:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 376905728. Throughput: 0: 9142.0. Samples: 753802048. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:48,990][27935] Avg episode reward: [(0, '0.091')] [2022-07-13 16:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 376930304. Throughput: 0: 9804.8. Samples: 753861232. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:53,991][27935] Avg episode reward: [(0, '0.039')] [2022-07-13 16:17:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 376955904. Throughput: 0: 9794.1. Samples: 753919844. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:17:58,989][27935] Avg episode reward: [(0, '-0.766')] [2022-07-13 16:18:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.7). Total num frames: 376978432. Throughput: 0: 10359.7. Samples: 753974552. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:03,991][27935] Avg episode reward: [(0, '-0.189')] [2022-07-13 16:18:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 377000960. Throughput: 0: 9704.4. Samples: 754003916. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:08,989][27935] Avg episode reward: [(0, '-0.551')] [2022-07-13 16:18:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 377027584. Throughput: 0: 9704.8. Samples: 754062700. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:13,990][27935] Avg episode reward: [(0, '-0.088')] [2022-07-13 16:18:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 377050112. Throughput: 0: 9685.1. Samples: 754120364. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:18,989][27935] Avg episode reward: [(0, '0.568')] [2022-07-13 16:18:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 377073664. Throughput: 0: 9660.1. Samples: 754148708. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:23,990][27935] Avg episode reward: [(0, '0.437')] [2022-07-13 16:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 377099264. Throughput: 0: 9658.3. Samples: 754207372. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:28,989][27935] Avg episode reward: [(0, '0.331')] [2022-07-13 16:18:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 377123840. Throughput: 0: 10313.9. Samples: 754266172. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:33,989][27935] Avg episode reward: [(0, '1.641')] [2022-07-13 16:18:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 377148416. Throughput: 0: 9661.2. Samples: 754295988. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:38,989][27935] Avg episode reward: [(0, '1.685')] [2022-07-13 16:18:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 377171968. Throughput: 0: 9672.7. Samples: 754355116. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:43,992][27935] Avg episode reward: [(0, '1.653')] [2022-07-13 16:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 377197568. Throughput: 0: 9769.4. Samples: 754414176. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:48,989][27935] Avg episode reward: [(0, '0.491')] [2022-07-13 16:18:53,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 377223168. Throughput: 0: 9773.5. Samples: 754443724. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:53,989][27935] Avg episode reward: [(0, '0.474')] [2022-07-13 16:18:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 377246720. Throughput: 0: 9786.5. Samples: 754503092. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:18:58,989][27935] Avg episode reward: [(0, '-0.924')] [2022-07-13 16:19:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 377269248. Throughput: 0: 9730.9. Samples: 754558256. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:19:03,989][27935] Avg episode reward: [(0, '-0.953')] [2022-07-13 16:19:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4873.5). Total num frames: 377294848. Throughput: 0: 9753.3. Samples: 754587608. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 16:19:08,989][27935] Avg episode reward: [(0, '-0.959')] [2022-07-13 16:19:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 377319424. Throughput: 0: 9761.6. Samples: 754646644. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:13,989][27935] Avg episode reward: [(0, '-0.650')] [2022-07-13 16:19:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 377342976. Throughput: 0: 9768.5. Samples: 754705756. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:18,989][27935] Avg episode reward: [(0, '-0.585')] [2022-07-13 16:19:23,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4897.8, 300 sec: 4866.5). Total num frames: 377367552. Throughput: 0: 9763.0. Samples: 754735360. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:23,996][27935] Avg episode reward: [(0, '0.343')] [2022-07-13 16:19:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 377393152. Throughput: 0: 9775.3. Samples: 754795004. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:28,989][27935] Avg episode reward: [(0, '0.584')] [2022-07-13 16:19:33,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 377416704. Throughput: 0: 9762.3. Samples: 754853480. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:33,989][27935] Avg episode reward: [(0, '2.099')] [2022-07-13 16:19:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 377441280. Throughput: 0: 9760.0. Samples: 754882924. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:38,989][27935] Avg episode reward: [(0, '1.906')] [2022-07-13 16:19:44,000][27935] Fps is (10 sec: 4909.5, 60 sec: 4897.2, 300 sec: 4876.8). Total num frames: 377465856. Throughput: 0: 9752.9. Samples: 754942084. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:44,001][27935] Avg episode reward: [(0, '1.975')] [2022-07-13 16:19:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4873.5). Total num frames: 377492480. Throughput: 0: 9833.1. Samples: 755000744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:48,989][27935] Avg episode reward: [(0, '0.950')] [2022-07-13 16:19:53,989][27935] Fps is (10 sec: 5023.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 377516032. Throughput: 0: 9836.2. Samples: 755030236. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:53,989][27935] Avg episode reward: [(0, '0.176')] [2022-07-13 16:19:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 377539584. Throughput: 0: 9844.8. Samples: 755089660. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:19:58,989][27935] Avg episode reward: [(0, '-1.313')] [2022-07-13 16:20:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 377563136. Throughput: 0: 9753.7. Samples: 755144672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:03,989][27935] Avg episode reward: [(0, '-1.252')] [2022-07-13 16:20:08,989][27935] Fps is (10 sec: 4710.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 377586688. Throughput: 0: 9755.1. Samples: 755174308. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:08,990][27935] Avg episode reward: [(0, '-1.573')] [2022-07-13 16:20:13,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4880.8, 300 sec: 4877.0). Total num frames: 377612288. Throughput: 0: 9745.4. Samples: 755233580. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:13,993][27935] Avg episode reward: [(0, '-1.253')] [2022-07-13 16:20:18,993][27935] Fps is (10 sec: 5015.9, 60 sec: 4897.8, 300 sec: 4873.5). Total num frames: 377636864. Throughput: 0: 9757.3. Samples: 755292596. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:18,993][27935] Avg episode reward: [(0, '-1.089')] [2022-07-13 16:20:23,989][27935] Fps is (10 sec: 4917.0, 60 sec: 4898.4, 300 sec: 4877.0). Total num frames: 377661440. Throughput: 0: 9762.4. Samples: 755322232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:23,989][27935] Avg episode reward: [(0, '-1.347')] [2022-07-13 16:20:28,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 377686016. Throughput: 0: 9764.4. Samples: 755381368. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:28,989][27935] Avg episode reward: [(0, '-0.482')] [2022-07-13 16:20:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 377708544. Throughput: 0: 9756.1. Samples: 755439768. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:33,989][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 16:20:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 377735168. Throughput: 0: 9753.2. Samples: 755469132. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:38,989][27935] Avg episode reward: [(0, '-0.348')] [2022-07-13 16:20:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4882.0, 300 sec: 4873.5). Total num frames: 377758720. Throughput: 0: 9746.9. Samples: 755528272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:43,989][27935] Avg episode reward: [(0, '-0.228')] [2022-07-13 16:20:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 377784320. Throughput: 0: 9834.3. Samples: 755587216. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:48,989][27935] Avg episode reward: [(0, '0.222')] [2022-07-13 16:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 377807872. Throughput: 0: 9838.4. Samples: 755617032. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:53,989][27935] Avg episode reward: [(0, '0.056')] [2022-07-13 16:20:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 377833472. Throughput: 0: 9837.5. Samples: 755676232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:20:58,990][27935] Avg episode reward: [(0, '-0.009')] [2022-07-13 16:21:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 377856000. Throughput: 0: 9754.3. Samples: 755731504. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:03,991][27935] Avg episode reward: [(0, '1.190')] [2022-07-13 16:21:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.2, 300 sec: 4873.5). Total num frames: 377880576. Throughput: 0: 9759.8. Samples: 755761424. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:08,989][27935] Avg episode reward: [(0, '-0.612')] [2022-07-13 16:21:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.4, 300 sec: 4877.0). Total num frames: 377905152. Throughput: 0: 9761.1. Samples: 755820620. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:13,989][27935] Avg episode reward: [(0, '-0.554')] [2022-07-13 16:21:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.4, 300 sec: 4877.0). Total num frames: 377929728. Throughput: 0: 9776.5. Samples: 755879712. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:18,989][27935] Avg episode reward: [(0, '-0.636')] [2022-07-13 16:21:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 377954304. Throughput: 0: 9770.7. Samples: 755908812. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:23,989][27935] Avg episode reward: [(0, '-0.698')] [2022-07-13 16:21:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 377977856. Throughput: 0: 9768.7. Samples: 755967864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:28,989][27935] Avg episode reward: [(0, '-0.644')] [2022-07-13 16:21:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 378003456. Throughput: 0: 9758.0. Samples: 756026328. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:33,989][27935] Avg episode reward: [(0, '-1.326')] [2022-07-13 16:21:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 378028032. Throughput: 0: 9758.5. Samples: 756056164. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:38,989][27935] Avg episode reward: [(0, '-1.299')] [2022-07-13 16:21:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4915.2, 300 sec: 4884.0). Total num frames: 378053632. Throughput: 0: 9754.0. Samples: 756115164. Policy #0 lag: (min: 0.0, avg: 9.4, max: 22.0) [2022-07-13 16:21:43,989][27935] Avg episode reward: [(0, '-0.432')] [2022-07-13 16:21:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 378077184. Throughput: 0: 9841.3. Samples: 756174364. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:21:48,990][27935] Avg episode reward: [(0, '-1.139')] [2022-07-13 16:21:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4880.5). Total num frames: 378102784. Throughput: 0: 9831.5. Samples: 756203840. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:21:53,990][27935] Avg episode reward: [(0, '-2.002')] [2022-07-13 16:21:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 378125312. Throughput: 0: 9832.0. Samples: 756263060. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:21:58,989][27935] Avg episode reward: [(0, '-1.957')] [2022-07-13 16:22:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 378149888. Throughput: 0: 9743.7. Samples: 756318180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:03,990][27935] Avg episode reward: [(0, '-1.541')] [2022-07-13 16:22:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 378174464. Throughput: 0: 9751.9. Samples: 756347648. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:08,989][27935] Avg episode reward: [(0, '-0.800')] [2022-07-13 16:22:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 378198016. Throughput: 0: 9745.5. Samples: 756406412. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:13,989][27935] Avg episode reward: [(0, '-0.764')] [2022-07-13 16:22:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 378223616. Throughput: 0: 9755.6. Samples: 756465328. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:18,989][27935] Avg episode reward: [(0, '0.188')] [2022-07-13 16:22:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 378248192. Throughput: 0: 9753.0. Samples: 756495048. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:23,989][27935] Avg episode reward: [(0, '1.017')] [2022-07-13 16:22:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4877.0). Total num frames: 378271744. Throughput: 0: 9750.7. Samples: 756553944. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:28,990][27935] Avg episode reward: [(0, '1.884')] [2022-07-13 16:22:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 378296320. Throughput: 0: 9734.2. Samples: 756612404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:33,990][27935] Avg episode reward: [(0, '0.846')] [2022-07-13 16:22:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 378320896. Throughput: 0: 9731.0. Samples: 756641736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:38,989][27935] Avg episode reward: [(0, '0.653')] [2022-07-13 16:22:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4877.0). Total num frames: 378344448. Throughput: 0: 9718.0. Samples: 756700368. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:43,989][27935] Avg episode reward: [(0, '0.369')] [2022-07-13 16:22:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 378370048. Throughput: 0: 9808.4. Samples: 756759556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:48,990][27935] Avg episode reward: [(0, '0.091')] [2022-07-13 16:22:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 378394624. Throughput: 0: 9812.5. Samples: 756789212. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:53,989][27935] Avg episode reward: [(0, '-0.140')] [2022-07-13 16:22:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4884.0). Total num frames: 378419200. Throughput: 0: 9816.5. Samples: 756848156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:22:58,990][27935] Avg episode reward: [(0, '0.089')] [2022-07-13 16:23:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 378442752. Throughput: 0: 9728.5. Samples: 756903112. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:03,989][27935] Avg episode reward: [(0, '0.128')] [2022-07-13 16:23:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 378466304. Throughput: 0: 9720.4. Samples: 756932464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:08,989][27935] Avg episode reward: [(0, '0.642')] [2022-07-13 16:23:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 378490880. Throughput: 0: 9714.7. Samples: 756991104. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:13,989][27935] Avg episode reward: [(0, '0.327')] [2022-07-13 16:23:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4884.0). Total num frames: 378514432. Throughput: 0: 9720.9. Samples: 757049844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:18,989][27935] Avg episode reward: [(0, '0.663')] [2022-07-13 16:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4880.5). Total num frames: 378539008. Throughput: 0: 9724.5. Samples: 757079340. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:23,989][27935] Avg episode reward: [(0, '0.406')] [2022-07-13 16:23:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4884.0). Total num frames: 378564608. Throughput: 0: 9716.3. Samples: 757137600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:28,989][27935] Avg episode reward: [(0, '0.436')] [2022-07-13 16:23:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 378588160. Throughput: 0: 9701.7. Samples: 757196132. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:33,989][27935] Avg episode reward: [(0, '0.389')] [2022-07-13 16:23:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4887.4). Total num frames: 378613760. Throughput: 0: 9692.8. Samples: 757225388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:38,989][27935] Avg episode reward: [(0, '0.052')] [2022-07-13 16:23:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 378637312. Throughput: 0: 9701.2. Samples: 757284708. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:43,989][27935] Avg episode reward: [(0, '-0.432')] [2022-07-13 16:23:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4873.5). Total num frames: 378660864. Throughput: 0: 9789.1. Samples: 757343620. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:48,992][27935] Avg episode reward: [(0, '-1.241')] [2022-07-13 16:23:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 378686464. Throughput: 0: 9796.1. Samples: 757373288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:53,990][27935] Avg episode reward: [(0, '-1.385')] [2022-07-13 16:23:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4890.9). Total num frames: 378712064. Throughput: 0: 9798.4. Samples: 757432032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:23:58,989][27935] Avg episode reward: [(0, '-1.257')] [2022-07-13 16:24:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 378732544. Throughput: 0: 9711.5. Samples: 757486860. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:24:03,989][27935] Avg episode reward: [(0, '-1.298')] [2022-07-13 16:24:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 378759168. Throughput: 0: 9704.1. Samples: 757516024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:24:08,989][27935] Avg episode reward: [(0, '-2.098')] [2022-07-13 16:24:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4880.5). Total num frames: 378782720. Throughput: 0: 9714.2. Samples: 757574740. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:24:13,989][27935] Avg episode reward: [(0, '-1.447')] [2022-07-13 16:24:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4880.5). Total num frames: 378807296. Throughput: 0: 9720.9. Samples: 757633572. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:24:18,989][27935] Avg episode reward: [(0, '-0.508')] [2022-07-13 16:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 378830848. Throughput: 0: 9711.7. Samples: 757662416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:24:23,989][27935] Avg episode reward: [(0, '-1.793')] [2022-07-13 16:24:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4873.5). Total num frames: 378854400. Throughput: 0: 9661.6. Samples: 757719480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:28,989][27935] Avg episode reward: [(0, '-1.880')] [2022-07-13 16:24:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 378880000. Throughput: 0: 9651.3. Samples: 757777928. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:33,989][27935] Avg episode reward: [(0, '-1.629')] [2022-07-13 16:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4873.7). Total num frames: 378903552. Throughput: 0: 9646.6. Samples: 757807384. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:38,989][27935] Avg episode reward: [(0, '-0.987')] [2022-07-13 16:24:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 378929152. Throughput: 0: 9661.2. Samples: 757866788. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:43,990][27935] Avg episode reward: [(0, '-1.444')] [2022-07-13 16:24:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 378952704. Throughput: 0: 9751.5. Samples: 757925676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:48,989][27935] Avg episode reward: [(0, '-1.897')] [2022-07-13 16:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4877.0). Total num frames: 378978304. Throughput: 0: 9753.2. Samples: 757954916. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:53,990][27935] Avg episode reward: [(0, '-1.256')] [2022-07-13 16:24:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4870.1). Total num frames: 378999808. Throughput: 0: 9760.8. Samples: 758013976. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:24:58,989][27935] Avg episode reward: [(0, '-0.791')] [2022-07-13 16:25:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 379025408. Throughput: 0: 9677.4. Samples: 758069056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:03,991][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 16:25:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4870.1). Total num frames: 379048960. Throughput: 0: 9686.8. Samples: 758098324. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:08,989][27935] Avg episode reward: [(0, '-0.713')] [2022-07-13 16:25:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 379073536. Throughput: 0: 9726.7. Samples: 758157184. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:13,989][27935] Avg episode reward: [(0, '-0.299')] [2022-07-13 16:25:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 379098112. Throughput: 0: 9734.4. Samples: 758215976. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:18,989][27935] Avg episode reward: [(0, '0.074')] [2022-07-13 16:25:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 379122688. Throughput: 0: 9736.2. Samples: 758245512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:23,989][27935] Avg episode reward: [(0, '-0.835')] [2022-07-13 16:25:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4880.5). Total num frames: 379148288. Throughput: 0: 9718.7. Samples: 758304128. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:28,990][27935] Avg episode reward: [(0, '-0.771')] [2022-07-13 16:25:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379170816. Throughput: 0: 9705.3. Samples: 758362416. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:33,990][27935] Avg episode reward: [(0, '-0.650')] [2022-07-13 16:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 379195392. Throughput: 0: 9709.3. Samples: 758391836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:38,989][27935] Avg episode reward: [(0, '-0.939')] [2022-07-13 16:25:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379219968. Throughput: 0: 9700.4. Samples: 758450492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:43,990][27935] Avg episode reward: [(0, '-0.783')] [2022-07-13 16:25:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 379245568. Throughput: 0: 9783.5. Samples: 758509312. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:48,989][27935] Avg episode reward: [(0, '-0.778')] [2022-07-13 16:25:54,000][27935] Fps is (10 sec: 5012.1, 60 sec: 4863.1, 300 sec: 4869.9). Total num frames: 379270144. Throughput: 0: 9784.2. Samples: 758538720. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:54,000][27935] Avg episode reward: [(0, '-1.026')] [2022-07-13 16:25:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4915.2, 300 sec: 4877.0). Total num frames: 379294720. Throughput: 0: 9790.0. Samples: 758597732. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:25:58,989][27935] Avg episode reward: [(0, '-0.262')] [2022-07-13 16:26:03,989][27935] Fps is (10 sec: 4613.1, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379316224. Throughput: 0: 9698.0. Samples: 758652384. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:03,989][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 16:26:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 379341824. Throughput: 0: 9702.8. Samples: 758682136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:08,989][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 16:26:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 379365376. Throughput: 0: 9712.6. Samples: 758741196. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:13,989][27935] Avg episode reward: [(0, '-0.335')] [2022-07-13 16:26:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 379390976. Throughput: 0: 9733.2. Samples: 758800408. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:18,989][27935] Avg episode reward: [(0, '0.276')] [2022-07-13 16:26:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 379414528. Throughput: 0: 9728.2. Samples: 758829604. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:23,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 16:26:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379439104. Throughput: 0: 9731.2. Samples: 758888396. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:28,989][27935] Avg episode reward: [(0, '-0.184')] [2022-07-13 16:26:33,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4880.8, 300 sec: 4866.5). Total num frames: 379463680. Throughput: 0: 9719.1. Samples: 758946708. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:33,994][27935] Avg episode reward: [(0, '0.076')] [2022-07-13 16:26:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 379488256. Throughput: 0: 9719.1. Samples: 758975972. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:38,989][27935] Avg episode reward: [(0, '0.493')] [2022-07-13 16:26:43,989][27935] Fps is (10 sec: 5019.5, 60 sec: 4898.1, 300 sec: 4870.1). Total num frames: 379513856. Throughput: 0: 9719.3. Samples: 759035100. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:43,989][27935] Avg episode reward: [(0, '0.428')] [2022-07-13 16:26:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 379536384. Throughput: 0: 9817.2. Samples: 759094160. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:48,989][27935] Avg episode reward: [(0, '0.375')] [2022-07-13 16:26:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.9, 300 sec: 4870.1). Total num frames: 379561984. Throughput: 0: 9804.0. Samples: 759123316. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:53,989][27935] Avg episode reward: [(0, '-0.445')] [2022-07-13 16:26:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379585536. Throughput: 0: 9805.5. Samples: 759182444. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 16:26:58,990][27935] Avg episode reward: [(0, '0.003')] [2022-07-13 16:27:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 379609088. Throughput: 0: 9699.9. Samples: 759236904. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:03,990][27935] Avg episode reward: [(0, '-0.095')] [2022-07-13 16:27:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 379633664. Throughput: 0: 9708.0. Samples: 759266464. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:08,990][27935] Avg episode reward: [(0, '-0.300')] [2022-07-13 16:27:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 379659264. Throughput: 0: 9702.1. Samples: 759324992. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:13,989][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 16:27:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 379683840. Throughput: 0: 9710.5. Samples: 759383644. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:18,989][27935] Avg episode reward: [(0, '-0.428')] [2022-07-13 16:27:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 379705344. Throughput: 0: 9715.0. Samples: 759413148. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:23,989][27935] Avg episode reward: [(0, '-0.253')] [2022-07-13 16:27:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 379731968. Throughput: 0: 9698.8. Samples: 759471548. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:28,989][27935] Avg episode reward: [(0, '-0.117')] [2022-07-13 16:27:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.2, 300 sec: 4859.7). Total num frames: 379754496. Throughput: 0: 9686.6. Samples: 759530056. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:33,989][27935] Avg episode reward: [(0, '-0.115')] [2022-07-13 16:27:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 379781120. Throughput: 0: 9694.7. Samples: 759559576. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:38,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 16:27:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 379804672. Throughput: 0: 9687.9. Samples: 759618400. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:43,989][27935] Avg episode reward: [(0, '0.006')] [2022-07-13 16:27:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 379829248. Throughput: 0: 9789.9. Samples: 759677448. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:48,989][27935] Avg episode reward: [(0, '0.112')] [2022-07-13 16:27:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 379853824. Throughput: 0: 9787.0. Samples: 759706880. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:53,989][27935] Avg episode reward: [(0, '0.573')] [2022-07-13 16:27:58,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 379877376. Throughput: 0: 9794.5. Samples: 759765748. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:27:58,989][27935] Avg episode reward: [(0, '0.545')] [2022-07-13 16:28:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 379901952. Throughput: 0: 9718.7. Samples: 759820984. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:03,989][27935] Avg episode reward: [(0, '0.009')] [2022-07-13 16:28:08,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 379925504. Throughput: 0: 9721.7. Samples: 759850624. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:08,990][27935] Avg episode reward: [(0, '0.157')] [2022-07-13 16:28:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 379949056. Throughput: 0: 9726.3. Samples: 759909232. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:13,996][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 16:28:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 379974656. Throughput: 0: 9746.8. Samples: 759968660. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:18,989][27935] Avg episode reward: [(0, '-0.601')] [2022-07-13 16:28:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4915.2, 300 sec: 4866.6). Total num frames: 380000256. Throughput: 0: 9754.2. Samples: 759998516. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:23,989][27935] Avg episode reward: [(0, '-0.411')] [2022-07-13 16:28:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380023808. Throughput: 0: 9758.2. Samples: 760057520. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:28,989][27935] Avg episode reward: [(0, '-0.435')] [2022-07-13 16:28:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 380048384. Throughput: 0: 9748.4. Samples: 760116124. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:33,989][27935] Avg episode reward: [(0, '-0.237')] [2022-07-13 16:28:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380072960. Throughput: 0: 9748.3. Samples: 760145552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:38,989][27935] Avg episode reward: [(0, '-0.758')] [2022-07-13 16:28:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380096512. Throughput: 0: 9741.5. Samples: 760204112. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:43,990][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 16:28:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 380121088. Throughput: 0: 9817.0. Samples: 760262748. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:48,989][27935] Avg episode reward: [(0, '-0.261')] [2022-07-13 16:28:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 380146688. Throughput: 0: 9806.6. Samples: 760291920. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:53,989][27935] Avg episode reward: [(0, '-0.954')] [2022-07-13 16:28:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4873.5). Total num frames: 380170240. Throughput: 0: 9803.7. Samples: 760350400. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:28:58,989][27935] Avg episode reward: [(0, '-0.895')] [2022-07-13 16:29:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 380191744. Throughput: 0: 9698.7. Samples: 760405100. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:03,990][27935] Avg episode reward: [(0, '-0.607')] [2022-07-13 16:29:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 380217344. Throughput: 0: 9679.5. Samples: 760434092. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:08,991][27935] Avg episode reward: [(0, '-1.457')] [2022-07-13 16:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 380240896. Throughput: 0: 9666.8. Samples: 760492528. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:13,990][27935] Avg episode reward: [(0, '-0.972')] [2022-07-13 16:29:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380266496. Throughput: 0: 9008.9. Samples: 760521524. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:18,990][27935] Avg episode reward: [(0, '-1.634')] [2022-07-13 16:29:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4863.1). Total num frames: 380289024. Throughput: 0: 9667.3. Samples: 760580580. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:23,989][27935] Avg episode reward: [(0, '-0.769')] [2022-07-13 16:29:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380315648. Throughput: 0: 9669.4. Samples: 760639236. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:28,991][27935] Avg episode reward: [(0, '-1.074')] [2022-07-13 16:29:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 380338176. Throughput: 0: 9662.9. Samples: 760697580. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 16:29:33,990][27935] Avg episode reward: [(0, '-0.304')] [2022-07-13 16:29:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 380362752. Throughput: 0: 9661.1. Samples: 760726668. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:29:38,990][27935] Avg episode reward: [(0, '-0.658')] [2022-07-13 16:29:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 380388352. Throughput: 0: 9670.5. Samples: 760785572. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:29:43,989][27935] Avg episode reward: [(0, '-1.089')] [2022-07-13 16:29:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 380411904. Throughput: 0: 9774.3. Samples: 760844944. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:29:48,991][27935] Avg episode reward: [(0, '-1.125')] [2022-07-13 16:29:53,992][27935] Fps is (10 sec: 4913.4, 60 sec: 4846.6, 300 sec: 4873.5). Total num frames: 380437504. Throughput: 0: 9779.5. Samples: 760874204. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:29:54,004][27935] Avg episode reward: [(0, '-1.293')] [2022-07-13 16:29:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 380462080. Throughput: 0: 9777.7. Samples: 760932524. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:29:58,989][27935] Avg episode reward: [(0, '-2.385')] [2022-07-13 16:30:03,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 380483584. Throughput: 0: 10355.2. Samples: 760987508. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:03,989][27935] Avg episode reward: [(0, '-1.588')] [2022-07-13 16:30:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 380508160. Throughput: 0: 9696.4. Samples: 761016920. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:08,989][27935] Avg episode reward: [(0, '-1.933')] [2022-07-13 16:30:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 380532736. Throughput: 0: 9694.5. Samples: 761075488. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:13,989][27935] Avg episode reward: [(0, '-1.847')] [2022-07-13 16:30:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 380557312. Throughput: 0: 9695.4. Samples: 761133872. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:18,989][27935] Avg episode reward: [(0, '-0.570')] [2022-07-13 16:30:24,001][27935] Fps is (10 sec: 4807.1, 60 sec: 4863.0, 300 sec: 4856.0). Total num frames: 380580864. Throughput: 0: 9705.6. Samples: 761163536. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:24,001][27935] Avg episode reward: [(0, '-0.809')] [2022-07-13 16:30:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 380605440. Throughput: 0: 9676.5. Samples: 761221016. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:28,989][27935] Avg episode reward: [(0, '-0.139')] [2022-07-13 16:30:33,991][27935] Fps is (10 sec: 5022.6, 60 sec: 4880.9, 300 sec: 4866.6). Total num frames: 380631040. Throughput: 0: 9639.9. Samples: 761278760. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:33,991][27935] Avg episode reward: [(0, '-0.114')] [2022-07-13 16:30:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 380655616. Throughput: 0: 9641.4. Samples: 761308032. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:38,990][27935] Avg episode reward: [(0, '0.142')] [2022-07-13 16:30:43,989][27935] Fps is (10 sec: 4711.3, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 380678144. Throughput: 0: 9656.2. Samples: 761367052. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:43,989][27935] Avg episode reward: [(0, '0.069')] [2022-07-13 16:30:48,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4863.4, 300 sec: 4859.7). Total num frames: 380703744. Throughput: 0: 9732.8. Samples: 761425556. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:48,998][27935] Avg episode reward: [(0, '0.105')] [2022-07-13 16:30:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.2, 300 sec: 4859.7). Total num frames: 380728320. Throughput: 0: 9738.8. Samples: 761455168. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:53,990][27935] Avg episode reward: [(0, '0.302')] [2022-07-13 16:30:58,989][27935] Fps is (10 sec: 4816.4, 60 sec: 4829.9, 300 sec: 4866.6). Total num frames: 380751872. Throughput: 0: 9732.4. Samples: 761513448. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:30:58,989][27935] Avg episode reward: [(0, '0.474')] [2022-07-13 16:31:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 380774400. Throughput: 0: 9645.1. Samples: 761567904. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:03,989][27935] Avg episode reward: [(0, '0.381')] [2022-07-13 16:31:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 380798976. Throughput: 0: 9637.8. Samples: 761597124. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:08,989][27935] Avg episode reward: [(0, '0.664')] [2022-07-13 16:31:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 380823552. Throughput: 0: 9662.3. Samples: 761655820. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:13,989][27935] Avg episode reward: [(0, '0.654')] [2022-07-13 16:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 380847104. Throughput: 0: 9686.0. Samples: 761714612. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:18,989][27935] Avg episode reward: [(0, '0.337')] [2022-07-13 16:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.9, 300 sec: 4856.2). Total num frames: 380871680. Throughput: 0: 9683.4. Samples: 761743784. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:23,992][27935] Avg episode reward: [(0, '0.317')] [2022-07-13 16:31:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.3). Total num frames: 380896256. Throughput: 0: 9668.2. Samples: 761802120. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:28,989][27935] Avg episode reward: [(0, '0.547')] [2022-07-13 16:31:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4856.2). Total num frames: 380920832. Throughput: 0: 9667.0. Samples: 761860500. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:33,990][27935] Avg episode reward: [(0, '0.509')] [2022-07-13 16:31:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 380945408. Throughput: 0: 9664.4. Samples: 761890068. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:38,989][27935] Avg episode reward: [(0, '0.491')] [2022-07-13 16:31:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 380968960. Throughput: 0: 9671.6. Samples: 761948668. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:43,989][27935] Avg episode reward: [(0, '0.283')] [2022-07-13 16:31:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.5, 300 sec: 4852.7). Total num frames: 380993536. Throughput: 0: 9770.0. Samples: 762007556. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:48,989][27935] Avg episode reward: [(0, '-0.372')] [2022-07-13 16:31:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 381018112. Throughput: 0: 9779.0. Samples: 762037180. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:53,990][27935] Avg episode reward: [(0, '-0.899')] [2022-07-13 16:31:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 381043712. Throughput: 0: 9772.7. Samples: 762095592. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:31:58,989][27935] Avg episode reward: [(0, '-1.005')] [2022-07-13 16:32:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 381065216. Throughput: 0: 9677.0. Samples: 762150076. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:32:03,990][27935] Avg episode reward: [(0, '-2.415')] [2022-07-13 16:32:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381089792. Throughput: 0: 9680.7. Samples: 762179416. Policy #0 lag: (min: 1.0, avg: 10.7, max: 24.0) [2022-07-13 16:32:08,989][27935] Avg episode reward: [(0, '-1.731')] [2022-07-13 16:32:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381114368. Throughput: 0: 9684.3. Samples: 762237912. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:13,990][27935] Avg episode reward: [(0, '-1.396')] [2022-07-13 16:32:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 381137920. Throughput: 0: 9686.0. Samples: 762296368. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:18,991][27935] Avg episode reward: [(0, '-0.720')] [2022-07-13 16:32:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 381163520. Throughput: 0: 9686.8. Samples: 762325972. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:23,990][27935] Avg episode reward: [(0, '-0.511')] [2022-07-13 16:32:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 381187072. Throughput: 0: 9676.5. Samples: 762384112. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:28,989][27935] Avg episode reward: [(0, '0.136')] [2022-07-13 16:32:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381211648. Throughput: 0: 9022.4. Samples: 762413564. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:33,989][27935] Avg episode reward: [(0, '1.126')] [2022-07-13 16:32:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 381236224. Throughput: 0: 9663.6. Samples: 762472044. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:38,989][27935] Avg episode reward: [(0, '1.029')] [2022-07-13 16:32:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381259776. Throughput: 0: 9649.3. Samples: 762529808. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:43,989][27935] Avg episode reward: [(0, '0.436')] [2022-07-13 16:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381284352. Throughput: 0: 9739.8. Samples: 762588368. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:48,989][27935] Avg episode reward: [(0, '0.511')] [2022-07-13 16:32:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 381308928. Throughput: 0: 9742.8. Samples: 762617844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:53,990][27935] Avg episode reward: [(0, '0.333')] [2022-07-13 16:32:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 381333504. Throughput: 0: 9752.4. Samples: 762676768. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:32:58,989][27935] Avg episode reward: [(0, '0.241')] [2022-07-13 16:33:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381356032. Throughput: 0: 9669.4. Samples: 762731492. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:03,989][27935] Avg episode reward: [(0, '0.441')] [2022-07-13 16:33:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 381380608. Throughput: 0: 9669.4. Samples: 762761096. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:08,989][27935] Avg episode reward: [(0, '0.256')] [2022-07-13 16:33:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381405184. Throughput: 0: 9688.4. Samples: 762820092. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:13,989][27935] Avg episode reward: [(0, '0.089')] [2022-07-13 16:33:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 381430784. Throughput: 0: 10337.2. Samples: 762878736. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:18,989][27935] Avg episode reward: [(0, '0.536')] [2022-07-13 16:33:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381454336. Throughput: 0: 9700.1. Samples: 762908548. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:23,989][27935] Avg episode reward: [(0, '-0.287')] [2022-07-13 16:33:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 381477888. Throughput: 0: 9726.5. Samples: 762967500. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:28,991][27935] Avg episode reward: [(0, '-0.343')] [2022-07-13 16:33:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 381503488. Throughput: 0: 9710.6. Samples: 763025344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:33,990][27935] Avg episode reward: [(0, '-0.014')] [2022-07-13 16:33:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 381527040. Throughput: 0: 9711.1. Samples: 763054844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:38,990][27935] Avg episode reward: [(0, '-0.760')] [2022-07-13 16:33:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 381551616. Throughput: 0: 9708.2. Samples: 763113636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:43,989][27935] Avg episode reward: [(0, '-1.155')] [2022-07-13 16:33:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 381576192. Throughput: 0: 9804.9. Samples: 763172712. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:48,989][27935] Avg episode reward: [(0, '-1.710')] [2022-07-13 16:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 381600768. Throughput: 0: 9801.3. Samples: 763202156. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:53,991][27935] Avg episode reward: [(0, '-0.799')] [2022-07-13 16:33:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 381626368. Throughput: 0: 9807.4. Samples: 763261424. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:33:58,991][27935] Avg episode reward: [(0, '-1.068')] [2022-07-13 16:34:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 381648896. Throughput: 0: 9714.6. Samples: 763315892. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:03,990][27935] Avg episode reward: [(0, '-1.980')] [2022-07-13 16:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 381672448. Throughput: 0: 9698.1. Samples: 763344964. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:08,990][27935] Avg episode reward: [(0, '-2.685')] [2022-07-13 16:34:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 381697024. Throughput: 0: 9689.8. Samples: 763403540. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:13,990][27935] Avg episode reward: [(0, '-1.403')] [2022-07-13 16:34:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 381721600. Throughput: 0: 9715.4. Samples: 763462536. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:18,989][27935] Avg episode reward: [(0, '0.044')] [2022-07-13 16:34:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 381746176. Throughput: 0: 9714.4. Samples: 763491992. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:23,989][27935] Avg episode reward: [(0, '0.091')] [2022-07-13 16:34:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 381769728. Throughput: 0: 9711.4. Samples: 763550648. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:28,989][27935] Avg episode reward: [(0, '0.187')] [2022-07-13 16:34:33,992][27935] Fps is (10 sec: 4811.5, 60 sec: 4846.7, 300 sec: 4852.7). Total num frames: 381794304. Throughput: 0: 9699.5. Samples: 763609216. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:33,992][27935] Avg episode reward: [(0, '0.660')] [2022-07-13 16:34:38,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4863.7, 300 sec: 4849.2). Total num frames: 381818880. Throughput: 0: 9691.8. Samples: 763638320. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:38,993][27935] Avg episode reward: [(0, '0.917')] [2022-07-13 16:34:43,989][27935] Fps is (10 sec: 5019.0, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 381844480. Throughput: 0: 9690.1. Samples: 763697476. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:43,989][27935] Avg episode reward: [(0, '-1.034')] [2022-07-13 16:34:48,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4864.0, 300 sec: 4849.3). Total num frames: 381868032. Throughput: 0: 9780.4. Samples: 763756012. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 16:34:48,989][27935] Avg episode reward: [(0, '-1.333')] [2022-07-13 16:34:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 381893632. Throughput: 0: 9788.4. Samples: 763785440. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:34:53,989][27935] Avg episode reward: [(0, '-1.568')] [2022-07-13 16:34:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 381917184. Throughput: 0: 9795.4. Samples: 763844332. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:34:58,989][27935] Avg episode reward: [(0, '-1.971')] [2022-07-13 16:35:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 381939712. Throughput: 0: 9705.8. Samples: 763899296. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:03,989][27935] Avg episode reward: [(0, '-1.425')] [2022-07-13 16:35:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 381964288. Throughput: 0: 9706.9. Samples: 763928804. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:08,989][27935] Avg episode reward: [(0, '-1.425')] [2022-07-13 16:35:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 381988864. Throughput: 0: 9716.5. Samples: 763987892. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:13,990][27935] Avg episode reward: [(0, '-1.133')] [2022-07-13 16:35:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4859.9). Total num frames: 382014464. Throughput: 0: 9714.0. Samples: 764046320. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:18,989][27935] Avg episode reward: [(0, '1.168')] [2022-07-13 16:35:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 382038016. Throughput: 0: 9726.2. Samples: 764075964. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:23,989][27935] Avg episode reward: [(0, '0.808')] [2022-07-13 16:35:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 382063616. Throughput: 0: 9719.3. Samples: 764134844. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:28,989][27935] Avg episode reward: [(0, '0.963')] [2022-07-13 16:35:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.3, 300 sec: 4852.7). Total num frames: 382087168. Throughput: 0: 9723.1. Samples: 764193552. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:33,989][27935] Avg episode reward: [(0, '1.203')] [2022-07-13 16:35:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.3, 300 sec: 4859.7). Total num frames: 382111744. Throughput: 0: 9718.8. Samples: 764222788. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:38,996][27935] Avg episode reward: [(0, '-0.148')] [2022-07-13 16:35:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.3). Total num frames: 382136320. Throughput: 0: 9720.2. Samples: 764281740. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:43,989][27935] Avg episode reward: [(0, '-0.845')] [2022-07-13 16:35:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 382159872. Throughput: 0: 9799.4. Samples: 764340268. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:48,989][27935] Avg episode reward: [(0, '-1.094')] [2022-07-13 16:35:53,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 382185472. Throughput: 0: 9798.3. Samples: 764369728. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:53,989][27935] Avg episode reward: [(0, '-0.956')] [2022-07-13 16:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382209024. Throughput: 0: 9795.7. Samples: 764428700. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:35:58,989][27935] Avg episode reward: [(0, '-0.937')] [2022-07-13 16:36:03,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 382231552. Throughput: 0: 9713.3. Samples: 764483420. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:03,989][27935] Avg episode reward: [(0, '-1.494')] [2022-07-13 16:36:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 382257152. Throughput: 0: 9702.9. Samples: 764512596. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:08,989][27935] Avg episode reward: [(0, '-1.539')] [2022-07-13 16:36:13,990][27935] Fps is (10 sec: 4914.4, 60 sec: 4863.9, 300 sec: 4859.6). Total num frames: 382280704. Throughput: 0: 9685.9. Samples: 764570724. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:13,993][27935] Avg episode reward: [(0, '-0.836')] [2022-07-13 16:36:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 382304256. Throughput: 0: 9687.6. Samples: 764629496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:18,989][27935] Avg episode reward: [(0, '-0.198')] [2022-07-13 16:36:23,989][27935] Fps is (10 sec: 4916.0, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 382329856. Throughput: 0: 9688.1. Samples: 764658752. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:23,989][27935] Avg episode reward: [(0, '-1.085')] [2022-07-13 16:36:28,990][27935] Fps is (10 sec: 4914.7, 60 sec: 4829.8, 300 sec: 4856.2). Total num frames: 382353408. Throughput: 0: 9681.9. Samples: 764717436. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:28,990][27935] Avg episode reward: [(0, '-0.979')] [2022-07-13 16:36:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 382377984. Throughput: 0: 9646.9. Samples: 764774380. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:33,990][27935] Avg episode reward: [(0, '-0.556')] [2022-07-13 16:36:38,989][27935] Fps is (10 sec: 4813.3, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 382401536. Throughput: 0: 9633.4. Samples: 764803228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:38,990][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 16:36:43,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4846.6, 300 sec: 4859.6). Total num frames: 382427136. Throughput: 0: 9635.9. Samples: 764862348. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:43,993][27935] Avg episode reward: [(0, '-1.121')] [2022-07-13 16:36:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 382451712. Throughput: 0: 9732.3. Samples: 764921372. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:48,989][27935] Avg episode reward: [(0, '-1.241')] [2022-07-13 16:36:53,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 382476288. Throughput: 0: 9739.3. Samples: 764950864. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:53,989][27935] Avg episode reward: [(0, '-1.017')] [2022-07-13 16:36:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 382499840. Throughput: 0: 9770.0. Samples: 765010356. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:36:58,989][27935] Avg episode reward: [(0, '-0.483')] [2022-07-13 16:37:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 382522368. Throughput: 0: 9690.5. Samples: 765065568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:37:03,989][27935] Avg episode reward: [(0, '-0.716')] [2022-07-13 16:37:08,993][27935] Fps is (10 sec: 4810.9, 60 sec: 4846.6, 300 sec: 4859.6). Total num frames: 382547968. Throughput: 0: 9701.5. Samples: 765095356. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:37:08,993][27935] Avg episode reward: [(0, '-2.137')] [2022-07-13 16:37:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.1, 300 sec: 4863.1). Total num frames: 382572544. Throughput: 0: 9705.3. Samples: 765154164. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:37:13,989][27935] Avg episode reward: [(0, '-1.244')] [2022-07-13 16:37:18,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 382597120. Throughput: 0: 9748.5. Samples: 765213064. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:37:18,989][27935] Avg episode reward: [(0, '-1.019')] [2022-07-13 16:37:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 382620672. Throughput: 0: 9764.0. Samples: 765242608. Policy #0 lag: (min: 0.0, avg: 9.7, max: 22.0) [2022-07-13 16:37:23,989][27935] Avg episode reward: [(0, '-1.300')] [2022-07-13 16:37:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 382646272. Throughput: 0: 9765.3. Samples: 765301752. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:28,989][27935] Avg episode reward: [(0, '-2.123')] [2022-07-13 16:37:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 382670848. Throughput: 0: 9758.1. Samples: 765360488. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:33,989][27935] Avg episode reward: [(0, '-1.186')] [2022-07-13 16:37:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 382694400. Throughput: 0: 9758.4. Samples: 765389992. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:38,989][27935] Avg episode reward: [(0, '-0.412')] [2022-07-13 16:37:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.3, 300 sec: 4863.1). Total num frames: 382718976. Throughput: 0: 9732.1. Samples: 765448300. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:43,989][27935] Avg episode reward: [(0, '0.377')] [2022-07-13 16:37:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382743552. Throughput: 0: 9809.7. Samples: 765507004. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:48,989][27935] Avg episode reward: [(0, '-1.501')] [2022-07-13 16:37:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382768128. Throughput: 0: 9804.9. Samples: 765536540. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:53,989][27935] Avg episode reward: [(0, '-1.601')] [2022-07-13 16:37:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 382791680. Throughput: 0: 9797.2. Samples: 765595036. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:37:58,990][27935] Avg episode reward: [(0, '-2.105')] [2022-07-13 16:38:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 382815232. Throughput: 0: 9710.9. Samples: 765650052. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:03,989][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 16:38:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.2, 300 sec: 4859.7). Total num frames: 382838784. Throughput: 0: 9703.5. Samples: 765679264. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:08,989][27935] Avg episode reward: [(0, '-1.832')] [2022-07-13 16:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 382865408. Throughput: 0: 9695.5. Samples: 765738048. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:13,989][27935] Avg episode reward: [(0, '-2.087')] [2022-07-13 16:38:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382888960. Throughput: 0: 9691.0. Samples: 765796584. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:18,990][27935] Avg episode reward: [(0, '-0.409')] [2022-07-13 16:38:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382912512. Throughput: 0: 9697.8. Samples: 765826392. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:23,990][27935] Avg episode reward: [(0, '-0.343')] [2022-07-13 16:38:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 382938112. Throughput: 0: 9714.2. Samples: 765885440. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:28,990][27935] Avg episode reward: [(0, '-0.333')] [2022-07-13 16:38:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 382962688. Throughput: 0: 9701.2. Samples: 765943560. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:33,990][27935] Avg episode reward: [(0, '1.157')] [2022-07-13 16:38:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 382987264. Throughput: 0: 9691.7. Samples: 765972668. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:38,989][27935] Avg episode reward: [(0, '-0.211')] [2022-07-13 16:38:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 383009792. Throughput: 0: 9676.8. Samples: 766030492. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:43,989][27935] Avg episode reward: [(0, '-0.540')] [2022-07-13 16:38:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 383034368. Throughput: 0: 9749.8. Samples: 766088792. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:48,990][27935] Avg episode reward: [(0, '-0.420')] [2022-07-13 16:38:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 383057920. Throughput: 0: 9744.0. Samples: 766117744. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:53,990][27935] Avg episode reward: [(0, '-1.296')] [2022-07-13 16:38:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 383083520. Throughput: 0: 9733.3. Samples: 766176044. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:38:58,989][27935] Avg episode reward: [(0, '-1.265')] [2022-07-13 16:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 383105024. Throughput: 0: 9637.3. Samples: 766230264. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:03,989][27935] Avg episode reward: [(0, '-1.440')] [2022-07-13 16:39:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 383129600. Throughput: 0: 9624.7. Samples: 766259504. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:08,989][27935] Avg episode reward: [(0, '-1.567')] [2022-07-13 16:39:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 383154176. Throughput: 0: 9604.3. Samples: 766317636. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:13,989][27935] Avg episode reward: [(0, '-0.383')] [2022-07-13 16:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 383177728. Throughput: 0: 9606.3. Samples: 766375844. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:18,989][27935] Avg episode reward: [(0, '-0.905')] [2022-07-13 16:39:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 383202304. Throughput: 0: 9605.9. Samples: 766404932. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:23,990][27935] Avg episode reward: [(0, '-1.449')] [2022-07-13 16:39:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 383227904. Throughput: 0: 9624.2. Samples: 766463580. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:28,989][27935] Avg episode reward: [(0, '-0.895')] [2022-07-13 16:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4856.2). Total num frames: 383251456. Throughput: 0: 9608.7. Samples: 766521184. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:33,989][27935] Avg episode reward: [(0, '-0.601')] [2022-07-13 16:39:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 383276032. Throughput: 0: 9619.0. Samples: 766550600. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:38,989][27935] Avg episode reward: [(0, '-0.660')] [2022-07-13 16:39:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 383299584. Throughput: 0: 9621.7. Samples: 766609020. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:43,990][27935] Avg episode reward: [(0, '0.331')] [2022-07-13 16:39:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 383323136. Throughput: 0: 9721.4. Samples: 766667728. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:48,991][27935] Avg episode reward: [(0, '-0.417')] [2022-07-13 16:39:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 383348736. Throughput: 0: 9714.7. Samples: 766696664. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:53,990][27935] Avg episode reward: [(0, '0.197')] [2022-07-13 16:39:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 383373312. Throughput: 0: 9722.6. Samples: 766755152. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 16:39:58,996][27935] Avg episode reward: [(0, '0.938')] [2022-07-13 16:40:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 383395840. Throughput: 0: 9644.2. Samples: 766809832. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:03,989][27935] Avg episode reward: [(0, '1.026')] [2022-07-13 16:40:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 383419392. Throughput: 0: 9656.7. Samples: 766839484. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:08,989][27935] Avg episode reward: [(0, '0.738')] [2022-07-13 16:40:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 383443968. Throughput: 0: 9662.8. Samples: 766898408. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:13,989][27935] Avg episode reward: [(0, '0.191')] [2022-07-13 16:40:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 383468544. Throughput: 0: 9685.7. Samples: 766957040. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:18,989][27935] Avg episode reward: [(0, '0.776')] [2022-07-13 16:40:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 383493120. Throughput: 0: 9683.9. Samples: 766986376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:23,990][27935] Avg episode reward: [(0, '0.475')] [2022-07-13 16:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 383516672. Throughput: 0: 9686.4. Samples: 767044908. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:28,989][27935] Avg episode reward: [(0, '0.359')] [2022-07-13 16:40:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 383542272. Throughput: 0: 9678.4. Samples: 767103256. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:33,989][27935] Avg episode reward: [(0, '-1.045')] [2022-07-13 16:40:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 383565824. Throughput: 0: 9684.6. Samples: 767132472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:38,989][27935] Avg episode reward: [(0, '-2.241')] [2022-07-13 16:40:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 383590400. Throughput: 0: 9686.5. Samples: 767191044. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:43,990][27935] Avg episode reward: [(0, '-2.778')] [2022-07-13 16:40:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 383614976. Throughput: 0: 9763.6. Samples: 767249192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:48,990][27935] Avg episode reward: [(0, '-1.923')] [2022-07-13 16:40:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 383638528. Throughput: 0: 9754.3. Samples: 767278428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:53,990][27935] Avg episode reward: [(0, '-2.769')] [2022-07-13 16:40:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 383664128. Throughput: 0: 9749.6. Samples: 767337140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:40:58,989][27935] Avg episode reward: [(0, '-2.989')] [2022-07-13 16:41:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 383685632. Throughput: 0: 9665.4. Samples: 767391984. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:03,989][27935] Avg episode reward: [(0, '-1.555')] [2022-07-13 16:41:09,012][27935] Fps is (10 sec: 4699.5, 60 sec: 4862.1, 300 sec: 4848.9). Total num frames: 383711232. Throughput: 0: 9661.2. Samples: 767421356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:09,013][27935] Avg episode reward: [(0, '-0.841')] [2022-07-13 16:41:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 383735808. Throughput: 0: 9671.8. Samples: 767480140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:13,989][27935] Avg episode reward: [(0, '-0.784')] [2022-07-13 16:41:18,989][27935] Fps is (10 sec: 4926.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 383760384. Throughput: 0: 9667.9. Samples: 767538312. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:18,989][27935] Avg episode reward: [(0, '-0.865')] [2022-07-13 16:41:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 383782912. Throughput: 0: 9661.7. Samples: 767567248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:23,989][27935] Avg episode reward: [(0, '-2.036')] [2022-07-13 16:41:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 383806464. Throughput: 0: 9669.2. Samples: 767626160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:28,989][27935] Avg episode reward: [(0, '-2.066')] [2022-07-13 16:41:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 383833088. Throughput: 0: 9659.2. Samples: 767683856. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:33,989][27935] Avg episode reward: [(0, '-3.200')] [2022-07-13 16:41:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4849.3). Total num frames: 383857664. Throughput: 0: 9651.3. Samples: 767712736. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:38,989][27935] Avg episode reward: [(0, '-3.194')] [2022-07-13 16:41:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 383881216. Throughput: 0: 9644.8. Samples: 767771156. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:43,989][27935] Avg episode reward: [(0, '-2.564')] [2022-07-13 16:41:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 383904768. Throughput: 0: 9718.9. Samples: 767829336. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:48,989][27935] Avg episode reward: [(0, '-3.989')] [2022-07-13 16:41:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 383929344. Throughput: 0: 9718.3. Samples: 767858456. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:53,991][27935] Avg episode reward: [(0, '-2.891')] [2022-07-13 16:41:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4845.8). Total num frames: 383951872. Throughput: 0: 9703.7. Samples: 767916804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:41:58,991][27935] Avg episode reward: [(0, '-3.463')] [2022-07-13 16:42:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4842.4). Total num frames: 383976448. Throughput: 0: 9618.6. Samples: 767971148. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:03,989][27935] Avg episode reward: [(0, '-2.015')] [2022-07-13 16:42:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4814.7, 300 sec: 4838.8). Total num frames: 384000000. Throughput: 0: 9624.7. Samples: 768000360. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:08,989][27935] Avg episode reward: [(0, '-1.803')] [2022-07-13 16:42:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 384023552. Throughput: 0: 9615.3. Samples: 768058848. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:13,989][27935] Avg episode reward: [(0, '-2.079')] [2022-07-13 16:42:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 384049152. Throughput: 0: 9626.0. Samples: 768117024. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:18,989][27935] Avg episode reward: [(0, '-2.361')] [2022-07-13 16:42:23,997][27935] Fps is (10 sec: 4911.4, 60 sec: 4829.2, 300 sec: 4835.2). Total num frames: 384072704. Throughput: 0: 9629.2. Samples: 768146124. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:23,998][27935] Avg episode reward: [(0, '-1.679')] [2022-07-13 16:42:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384097280. Throughput: 0: 9635.0. Samples: 768204732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:28,989][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 16:42:33,989][27935] Fps is (10 sec: 4919.1, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 384121856. Throughput: 0: 9615.2. Samples: 768262020. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:33,989][27935] Avg episode reward: [(0, '0.370')] [2022-07-13 16:42:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4835.4). Total num frames: 384145408. Throughput: 0: 9594.9. Samples: 768290224. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 16:42:38,989][27935] Avg episode reward: [(0, '-0.330')] [2022-07-13 16:42:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 384168960. Throughput: 0: 9569.0. Samples: 768347408. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:42:43,992][27935] Avg episode reward: [(0, '-0.319')] [2022-07-13 16:42:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 384193536. Throughput: 0: 9672.3. Samples: 768406400. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:42:48,989][27935] Avg episode reward: [(0, '0.084')] [2022-07-13 16:42:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 384217088. Throughput: 0: 9675.7. Samples: 768435768. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:42:53,989][27935] Avg episode reward: [(0, '-0.130')] [2022-07-13 16:42:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 384242688. Throughput: 0: 9678.7. Samples: 768494388. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:42:58,989][27935] Avg episode reward: [(0, '-0.325')] [2022-07-13 16:43:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4831.9). Total num frames: 384264192. Throughput: 0: 9599.7. Samples: 768549012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:03,989][27935] Avg episode reward: [(0, '0.181')] [2022-07-13 16:43:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 384289792. Throughput: 0: 9608.9. Samples: 768578452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:08,989][27935] Avg episode reward: [(0, '-0.849')] [2022-07-13 16:43:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 384313344. Throughput: 0: 9608.5. Samples: 768637116. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:13,993][27935] Avg episode reward: [(0, '-0.353')] [2022-07-13 16:43:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 384337920. Throughput: 0: 8988.1. Samples: 768666484. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:18,989][27935] Avg episode reward: [(0, '-0.470')] [2022-07-13 16:43:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4830.5, 300 sec: 4828.4). Total num frames: 384362496. Throughput: 0: 9662.0. Samples: 768725016. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:23,990][27935] Avg episode reward: [(0, '-1.391')] [2022-07-13 16:43:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 384387072. Throughput: 0: 9689.0. Samples: 768783412. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:28,989][27935] Avg episode reward: [(0, '-1.998')] [2022-07-13 16:43:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 384411648. Throughput: 0: 9674.1. Samples: 768841736. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:33,989][27935] Avg episode reward: [(0, '-1.739')] [2022-07-13 16:43:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 384435200. Throughput: 0: 9666.0. Samples: 768870736. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:38,989][27935] Avg episode reward: [(0, '-0.645')] [2022-07-13 16:43:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 384459776. Throughput: 0: 9666.6. Samples: 768929384. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:43,989][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 16:43:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 384483328. Throughput: 0: 9761.9. Samples: 768988296. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:48,989][27935] Avg episode reward: [(0, '-0.182')] [2022-07-13 16:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 384508928. Throughput: 0: 9756.7. Samples: 769017504. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:53,989][27935] Avg episode reward: [(0, '0.150')] [2022-07-13 16:43:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 384534528. Throughput: 0: 9750.6. Samples: 769075892. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:43:58,990][27935] Avg episode reward: [(0, '0.780')] [2022-07-13 16:44:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 384555008. Throughput: 0: 10310.0. Samples: 769130432. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:03,989][27935] Avg episode reward: [(0, '0.995')] [2022-07-13 16:44:08,989][27935] Fps is (10 sec: 4505.3, 60 sec: 4829.8, 300 sec: 4831.9). Total num frames: 384579584. Throughput: 0: 9657.6. Samples: 769159616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:08,990][27935] Avg episode reward: [(0, '0.339')] [2022-07-13 16:44:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384604160. Throughput: 0: 9659.5. Samples: 769218088. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:13,989][27935] Avg episode reward: [(0, '-0.620')] [2022-07-13 16:44:18,989][27935] Fps is (10 sec: 5017.9, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 384629760. Throughput: 0: 9658.3. Samples: 769276360. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:18,989][27935] Avg episode reward: [(0, '-0.381')] [2022-07-13 16:44:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 384653312. Throughput: 0: 9665.2. Samples: 769305672. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:23,989][27935] Avg episode reward: [(0, '-0.284')] [2022-07-13 16:44:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 384676864. Throughput: 0: 9662.4. Samples: 769364192. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:28,990][27935] Avg episode reward: [(0, '-0.392')] [2022-07-13 16:44:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384702464. Throughput: 0: 9647.9. Samples: 769422452. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:33,991][27935] Avg episode reward: [(0, '-0.597')] [2022-07-13 16:44:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 384724992. Throughput: 0: 9646.6. Samples: 769451600. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:38,990][27935] Avg episode reward: [(0, '-0.129')] [2022-07-13 16:44:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 384750592. Throughput: 0: 9643.3. Samples: 769509840. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:43,991][27935] Avg episode reward: [(0, '-0.308')] [2022-07-13 16:44:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 384774144. Throughput: 0: 9732.4. Samples: 769568392. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:48,991][27935] Avg episode reward: [(0, '1.138')] [2022-07-13 16:44:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384799744. Throughput: 0: 9734.9. Samples: 769597680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:53,990][27935] Avg episode reward: [(0, '0.659')] [2022-07-13 16:44:58,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4795.6, 300 sec: 4835.3). Total num frames: 384822272. Throughput: 0: 9739.5. Samples: 769656376. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:44:58,991][27935] Avg episode reward: [(0, '0.778')] [2022-07-13 16:45:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384845824. Throughput: 0: 9665.6. Samples: 769711312. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:45:03,989][27935] Avg episode reward: [(0, '0.974')] [2022-07-13 16:45:08,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4847.0, 300 sec: 4835.4). Total num frames: 384870400. Throughput: 0: 9662.4. Samples: 769740480. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:45:08,989][27935] Avg episode reward: [(0, '0.335')] [2022-07-13 16:45:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 384894976. Throughput: 0: 9651.4. Samples: 769798504. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 16:45:13,990][27935] Avg episode reward: [(0, '0.500')] [2022-07-13 16:45:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 384918528. Throughput: 0: 9650.4. Samples: 769856720. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:18,989][27935] Avg episode reward: [(0, '0.464')] [2022-07-13 16:45:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 384942080. Throughput: 0: 9648.3. Samples: 769885772. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:23,990][27935] Avg episode reward: [(0, '0.448')] [2022-07-13 16:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 384966656. Throughput: 0: 9642.2. Samples: 769943740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:28,989][27935] Avg episode reward: [(0, '0.098')] [2022-07-13 16:45:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 384991232. Throughput: 0: 9625.6. Samples: 770001544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:33,989][27935] Avg episode reward: [(0, '0.217')] [2022-07-13 16:45:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 385014784. Throughput: 0: 9614.5. Samples: 770030332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:38,990][27935] Avg episode reward: [(0, '0.037')] [2022-07-13 16:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 385039360. Throughput: 0: 9603.1. Samples: 770088504. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:43,990][27935] Avg episode reward: [(0, '0.954')] [2022-07-13 16:45:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 385063936. Throughput: 0: 9680.2. Samples: 770146920. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:48,990][27935] Avg episode reward: [(0, '0.925')] [2022-07-13 16:45:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 385088512. Throughput: 0: 9679.4. Samples: 770176052. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:53,989][27935] Avg episode reward: [(0, '1.308')] [2022-07-13 16:45:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.0, 300 sec: 4838.8). Total num frames: 385113088. Throughput: 0: 9683.8. Samples: 770234276. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:45:58,989][27935] Avg episode reward: [(0, '0.783')] [2022-07-13 16:46:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4821.9). Total num frames: 385133568. Throughput: 0: 9602.8. Samples: 770288844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:03,989][27935] Avg episode reward: [(0, '0.323')] [2022-07-13 16:46:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 385159168. Throughput: 0: 9608.6. Samples: 770318160. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:08,991][27935] Avg episode reward: [(0, '0.333')] [2022-07-13 16:46:13,991][27935] Fps is (10 sec: 5016.7, 60 sec: 4812.7, 300 sec: 4824.9). Total num frames: 385183744. Throughput: 0: 9614.6. Samples: 770376416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:13,994][27935] Avg episode reward: [(0, '-0.625')] [2022-07-13 16:46:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 385207296. Throughput: 0: 9618.7. Samples: 770434384. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:18,989][27935] Avg episode reward: [(0, '-0.542')] [2022-07-13 16:46:23,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 385231872. Throughput: 0: 9624.4. Samples: 770463428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:23,989][27935] Avg episode reward: [(0, '-1.489')] [2022-07-13 16:46:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 385255424. Throughput: 0: 9610.0. Samples: 770520952. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:28,989][27935] Avg episode reward: [(0, '-1.535')] [2022-07-13 16:46:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 385280000. Throughput: 0: 9603.1. Samples: 770579060. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:33,989][27935] Avg episode reward: [(0, '-0.354')] [2022-07-13 16:46:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 385303552. Throughput: 0: 9605.2. Samples: 770608288. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:38,989][27935] Avg episode reward: [(0, '-0.059')] [2022-07-13 16:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 385329152. Throughput: 0: 9615.3. Samples: 770666964. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:43,989][27935] Avg episode reward: [(0, '0.323')] [2022-07-13 16:46:48,996][27935] Fps is (10 sec: 4911.4, 60 sec: 4812.2, 300 sec: 4824.8). Total num frames: 385352704. Throughput: 0: 9707.1. Samples: 770725740. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:48,998][27935] Avg episode reward: [(0, '0.006')] [2022-07-13 16:46:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 385377280. Throughput: 0: 9715.0. Samples: 770755336. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:53,989][27935] Avg episode reward: [(0, '-0.112')] [2022-07-13 16:46:58,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4795.7, 300 sec: 4828.4). Total num frames: 385400832. Throughput: 0: 9726.0. Samples: 770814068. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:46:58,989][27935] Avg episode reward: [(0, '0.009')] [2022-07-13 16:47:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 385424384. Throughput: 0: 9656.8. Samples: 770868940. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:03,989][27935] Avg episode reward: [(0, '-1.241')] [2022-07-13 16:47:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 385448960. Throughput: 0: 9665.3. Samples: 770898368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:08,989][27935] Avg episode reward: [(0, '-1.958')] [2022-07-13 16:47:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.9, 300 sec: 4824.9). Total num frames: 385472512. Throughput: 0: 9685.3. Samples: 770956792. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:13,989][27935] Avg episode reward: [(0, '-1.999')] [2022-07-13 16:47:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.5). Total num frames: 385499136. Throughput: 0: 9695.8. Samples: 771015372. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:18,989][27935] Avg episode reward: [(0, '-1.511')] [2022-07-13 16:47:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 385522688. Throughput: 0: 9701.2. Samples: 771044844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:23,989][27935] Avg episode reward: [(0, '-2.538')] [2022-07-13 16:47:28,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4846.7, 300 sec: 4828.4). Total num frames: 385546240. Throughput: 0: 9697.0. Samples: 771103352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:28,993][27935] Avg episode reward: [(0, '-3.347')] [2022-07-13 16:47:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 385571840. Throughput: 0: 9686.5. Samples: 771161560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:33,990][27935] Avg episode reward: [(0, '-2.865')] [2022-07-13 16:47:38,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 385595392. Throughput: 0: 9679.5. Samples: 771190912. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:38,989][27935] Avg episode reward: [(0, '-2.360')] [2022-07-13 16:47:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 385619968. Throughput: 0: 9660.3. Samples: 771248784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:43,989][27935] Avg episode reward: [(0, '-2.957')] [2022-07-13 16:47:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.6, 300 sec: 4838.8). Total num frames: 385644544. Throughput: 0: 9742.8. Samples: 771307364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 19.0) [2022-07-13 16:47:48,996][27935] Avg episode reward: [(0, '-3.233')] [2022-07-13 16:47:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 385668096. Throughput: 0: 9744.5. Samples: 771336868. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:47:53,989][27935] Avg episode reward: [(0, '-2.477')] [2022-07-13 16:47:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 385692672. Throughput: 0: 9742.3. Samples: 771395196. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:47:58,989][27935] Avg episode reward: [(0, '-1.810')] [2022-07-13 16:48:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 385716224. Throughput: 0: 9652.4. Samples: 771449728. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:03,989][27935] Avg episode reward: [(0, '-0.246')] [2022-07-13 16:48:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 385738752. Throughput: 0: 9654.0. Samples: 771479276. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:08,989][27935] Avg episode reward: [(0, '0.270')] [2022-07-13 16:48:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 385764352. Throughput: 0: 9659.4. Samples: 771538004. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:13,989][27935] Avg episode reward: [(0, '0.002')] [2022-07-13 16:48:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 385787904. Throughput: 0: 9008.0. Samples: 771566920. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:18,989][27935] Avg episode reward: [(0, '-0.909')] [2022-07-13 16:48:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 385814528. Throughput: 0: 9658.4. Samples: 771625540. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:23,989][27935] Avg episode reward: [(0, '-1.488')] [2022-07-13 16:48:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.1, 300 sec: 4831.9). Total num frames: 385837056. Throughput: 0: 9674.1. Samples: 771684120. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:28,989][27935] Avg episode reward: [(0, '-1.964')] [2022-07-13 16:48:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 385861632. Throughput: 0: 9664.4. Samples: 771742260. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:33,990][27935] Avg episode reward: [(0, '-3.185')] [2022-07-13 16:48:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 385885184. Throughput: 0: 9657.6. Samples: 771771460. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:38,993][27935] Avg episode reward: [(0, '-4.176')] [2022-07-13 16:48:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 385909760. Throughput: 0: 9618.4. Samples: 771828024. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:43,989][27935] Avg episode reward: [(0, '-3.811')] [2022-07-13 16:48:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 385933312. Throughput: 0: 9706.3. Samples: 771886512. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:48,989][27935] Avg episode reward: [(0, '-3.233')] [2022-07-13 16:48:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 385957888. Throughput: 0: 9697.4. Samples: 771915660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:53,989][27935] Avg episode reward: [(0, '-2.672')] [2022-07-13 16:48:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 385981440. Throughput: 0: 9692.8. Samples: 771974180. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:48:58,989][27935] Avg episode reward: [(0, '-1.849')] [2022-07-13 16:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 386004992. Throughput: 0: 10259.6. Samples: 772028600. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:03,989][27935] Avg episode reward: [(0, '-1.188')] [2022-07-13 16:49:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 386028544. Throughput: 0: 9603.6. Samples: 772057704. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:08,989][27935] Avg episode reward: [(0, '-0.043')] [2022-07-13 16:49:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 386054144. Throughput: 0: 9604.3. Samples: 772116312. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:13,989][27935] Avg episode reward: [(0, '1.021')] [2022-07-13 16:49:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 386077696. Throughput: 0: 9605.6. Samples: 772174512. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:18,989][27935] Avg episode reward: [(0, '1.159')] [2022-07-13 16:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 386103296. Throughput: 0: 9610.0. Samples: 772203908. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:23,990][27935] Avg episode reward: [(0, '1.146')] [2022-07-13 16:49:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 386124800. Throughput: 0: 9653.2. Samples: 772262416. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:28,989][27935] Avg episode reward: [(0, '1.711')] [2022-07-13 16:49:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 386151424. Throughput: 0: 9646.8. Samples: 772320620. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:33,989][27935] Avg episode reward: [(0, '1.372')] [2022-07-13 16:49:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 386174976. Throughput: 0: 9656.4. Samples: 772350200. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:38,990][27935] Avg episode reward: [(0, '1.424')] [2022-07-13 16:49:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 386198528. Throughput: 0: 9655.6. Samples: 772408680. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:43,995][27935] Avg episode reward: [(0, '0.588')] [2022-07-13 16:49:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 386224128. Throughput: 0: 9752.3. Samples: 772467456. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:48,989][27935] Avg episode reward: [(0, '0.376')] [2022-07-13 16:49:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386247680. Throughput: 0: 9756.3. Samples: 772496736. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:53,989][27935] Avg episode reward: [(0, '0.139')] [2022-07-13 16:49:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 386274304. Throughput: 0: 9750.3. Samples: 772555076. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:49:58,989][27935] Avg episode reward: [(0, '0.239')] [2022-07-13 16:50:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 386294784. Throughput: 0: 9671.2. Samples: 772609716. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:03,989][27935] Avg episode reward: [(0, '-0.212')] [2022-07-13 16:50:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 386318336. Throughput: 0: 9659.6. Samples: 772638588. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:08,989][27935] Avg episode reward: [(0, '-1.470')] [2022-07-13 16:50:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386343936. Throughput: 0: 9665.1. Samples: 772697348. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:13,989][27935] Avg episode reward: [(0, '-1.685')] [2022-07-13 16:50:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 386368512. Throughput: 0: 9667.1. Samples: 772755640. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:18,989][27935] Avg episode reward: [(0, '-2.065')] [2022-07-13 16:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 386393088. Throughput: 0: 9655.8. Samples: 772784712. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:23,989][27935] Avg episode reward: [(0, '-1.746')] [2022-07-13 16:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4835.4). Total num frames: 386417664. Throughput: 0: 9663.0. Samples: 772843516. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:28,989][27935] Avg episode reward: [(0, '-2.344')] [2022-07-13 16:50:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 386440192. Throughput: 0: 9651.3. Samples: 772901764. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:33,989][27935] Avg episode reward: [(0, '-2.287')] [2022-07-13 16:50:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386464768. Throughput: 0: 9648.6. Samples: 772930924. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:38,989][27935] Avg episode reward: [(0, '-2.489')] [2022-07-13 16:50:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4831.9). Total num frames: 386489344. Throughput: 0: 9653.4. Samples: 772989480. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:43,989][27935] Avg episode reward: [(0, '-2.252')] [2022-07-13 16:50:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 386512896. Throughput: 0: 9743.8. Samples: 773048188. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:48,991][27935] Avg episode reward: [(0, '-1.511')] [2022-07-13 16:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 386539520. Throughput: 0: 9751.6. Samples: 773077408. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:53,989][27935] Avg episode reward: [(0, '-1.376')] [2022-07-13 16:50:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 386562048. Throughput: 0: 9743.0. Samples: 773135784. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:50:58,990][27935] Avg episode reward: [(0, '-1.170')] [2022-07-13 16:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386584576. Throughput: 0: 9657.1. Samples: 773190208. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:03,989][27935] Avg episode reward: [(0, '-1.037')] [2022-07-13 16:51:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 386610176. Throughput: 0: 9659.3. Samples: 773219380. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:08,990][27935] Avg episode reward: [(0, '-1.300')] [2022-07-13 16:51:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 386634752. Throughput: 0: 9650.6. Samples: 773277792. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:13,989][27935] Avg episode reward: [(0, '-1.092')] [2022-07-13 16:51:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 386658304. Throughput: 0: 9651.4. Samples: 773336080. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:18,989][27935] Avg episode reward: [(0, '0.018')] [2022-07-13 16:51:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 386681856. Throughput: 0: 9650.1. Samples: 773365180. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:23,989][27935] Avg episode reward: [(0, '-0.165')] [2022-07-13 16:51:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 386707456. Throughput: 0: 9635.9. Samples: 773423096. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:28,989][27935] Avg episode reward: [(0, '-0.157')] [2022-07-13 16:51:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 386731008. Throughput: 0: 9602.3. Samples: 773480292. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:33,989][27935] Avg episode reward: [(0, '0.001')] [2022-07-13 16:51:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386754560. Throughput: 0: 9597.0. Samples: 773509272. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:38,989][27935] Avg episode reward: [(0, '0.148')] [2022-07-13 16:51:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4832.0). Total num frames: 386778112. Throughput: 0: 9586.5. Samples: 773567176. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:43,989][27935] Avg episode reward: [(0, '0.919')] [2022-07-13 16:51:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 386801664. Throughput: 0: 9674.7. Samples: 773625568. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:48,989][27935] Avg episode reward: [(0, '0.910')] [2022-07-13 16:51:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 386828288. Throughput: 0: 9675.8. Samples: 773654792. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:53,989][27935] Avg episode reward: [(0, '1.010')] [2022-07-13 16:51:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 386852864. Throughput: 0: 9693.5. Samples: 773714000. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:51:58,989][27935] Avg episode reward: [(0, '0.546')] [2022-07-13 16:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386874368. Throughput: 0: 9615.1. Samples: 773768760. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:03,989][27935] Avg episode reward: [(0, '0.234')] [2022-07-13 16:52:08,991][27935] Fps is (10 sec: 4504.4, 60 sec: 4795.5, 300 sec: 4831.9). Total num frames: 386897920. Throughput: 0: 9613.0. Samples: 773797792. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:08,992][27935] Avg episode reward: [(0, '0.390')] [2022-07-13 16:52:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 386923520. Throughput: 0: 9635.2. Samples: 773856680. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:13,989][27935] Avg episode reward: [(0, '-0.647')] [2022-07-13 16:52:18,989][27935] Fps is (10 sec: 4916.5, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 386947072. Throughput: 0: 9682.1. Samples: 773915984. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:18,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 16:52:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 386972672. Throughput: 0: 9694.1. Samples: 773945508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:23,989][27935] Avg episode reward: [(0, '-0.258')] [2022-07-13 16:52:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 386997248. Throughput: 0: 9720.5. Samples: 774004600. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:28,989][27935] Avg episode reward: [(0, '-0.056')] [2022-07-13 16:52:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 387021824. Throughput: 0: 9718.0. Samples: 774062876. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:33,989][27935] Avg episode reward: [(0, '0.232')] [2022-07-13 16:52:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4835.4). Total num frames: 387046400. Throughput: 0: 9723.6. Samples: 774092352. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:38,989][27935] Avg episode reward: [(0, '-0.091')] [2022-07-13 16:52:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4831.9). Total num frames: 387069952. Throughput: 0: 9697.0. Samples: 774150364. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:43,990][27935] Avg episode reward: [(0, '-0.618')] [2022-07-13 16:52:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4838.8). Total num frames: 387095552. Throughput: 0: 9795.6. Samples: 774209564. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:48,989][27935] Avg episode reward: [(0, '-0.464')] [2022-07-13 16:52:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 387119104. Throughput: 0: 9815.1. Samples: 774239448. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:53,989][27935] Avg episode reward: [(0, '-0.411')] [2022-07-13 16:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 387144704. Throughput: 0: 9810.1. Samples: 774298136. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:52:58,989][27935] Avg episode reward: [(0, '-0.293')] [2022-07-13 16:53:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4835.4). Total num frames: 387165184. Throughput: 0: 9708.4. Samples: 774352860. Policy #0 lag: (min: 0.0, avg: 8.3, max: 19.0) [2022-07-13 16:53:03,989][27935] Avg episode reward: [(0, '-0.858')] [2022-07-13 16:53:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.3, 300 sec: 4838.8). Total num frames: 387191808. Throughput: 0: 9705.8. Samples: 774382268. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:08,989][27935] Avg episode reward: [(0, '-0.407')] [2022-07-13 16:53:13,989][27935] Fps is (10 sec: 5222.4, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 387217408. Throughput: 0: 9696.3. Samples: 774440936. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:13,989][27935] Avg episode reward: [(0, '0.993')] [2022-07-13 16:53:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4828.4). Total num frames: 387238912. Throughput: 0: 9705.6. Samples: 774499628. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:18,989][27935] Avg episode reward: [(0, '1.174')] [2022-07-13 16:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 387265536. Throughput: 0: 9704.4. Samples: 774529052. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:23,989][27935] Avg episode reward: [(0, '1.192')] [2022-07-13 16:53:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4838.8). Total num frames: 387289088. Throughput: 0: 9721.2. Samples: 774587820. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:28,990][27935] Avg episode reward: [(0, '1.108')] [2022-07-13 16:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 387312640. Throughput: 0: 9703.4. Samples: 774646216. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:33,990][27935] Avg episode reward: [(0, '0.857')] [2022-07-13 16:53:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 387338240. Throughput: 0: 9686.4. Samples: 774675336. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:38,989][27935] Avg episode reward: [(0, '0.722')] [2022-07-13 16:53:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 387362816. Throughput: 0: 9690.8. Samples: 774734224. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:43,989][27935] Avg episode reward: [(0, '-0.192')] [2022-07-13 16:53:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 387386368. Throughput: 0: 9776.4. Samples: 774792800. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:48,989][27935] Avg episode reward: [(0, '-0.732')] [2022-07-13 16:53:53,999][27935] Fps is (10 sec: 4705.4, 60 sec: 4846.1, 300 sec: 4842.1). Total num frames: 387409920. Throughput: 0: 9773.9. Samples: 774822196. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:54,000][27935] Avg episode reward: [(0, '-0.797')] [2022-07-13 16:53:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 387434496. Throughput: 0: 9777.3. Samples: 774880916. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:53:58,989][27935] Avg episode reward: [(0, '-1.074')] [2022-07-13 16:54:03,989][27935] Fps is (10 sec: 4920.4, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 387459072. Throughput: 0: 9120.6. Samples: 774910052. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:03,989][27935] Avg episode reward: [(0, '-1.316')] [2022-07-13 16:54:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 387482624. Throughput: 0: 9688.1. Samples: 774965016. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:08,989][27935] Avg episode reward: [(0, '-1.484')] [2022-07-13 16:54:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 387506176. Throughput: 0: 9690.8. Samples: 775023908. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:13,989][27935] Avg episode reward: [(0, '-0.658')] [2022-07-13 16:54:18,992][27935] Fps is (10 sec: 4913.6, 60 sec: 4880.8, 300 sec: 4842.3). Total num frames: 387531776. Throughput: 0: 9699.3. Samples: 775082716. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:18,993][27935] Avg episode reward: [(0, '-0.142')] [2022-07-13 16:54:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 387555328. Throughput: 0: 9709.7. Samples: 775112272. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:23,989][27935] Avg episode reward: [(0, '0.087')] [2022-07-13 16:54:28,989][27935] Fps is (10 sec: 4916.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 387580928. Throughput: 0: 9710.8. Samples: 775171208. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:28,989][27935] Avg episode reward: [(0, '-1.622')] [2022-07-13 16:54:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 387605504. Throughput: 0: 9712.4. Samples: 775229856. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:33,989][27935] Avg episode reward: [(0, '-1.298')] [2022-07-13 16:54:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 387630080. Throughput: 0: 9713.9. Samples: 775259220. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:38,989][27935] Avg episode reward: [(0, '-2.115')] [2022-07-13 16:54:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 387653632. Throughput: 0: 9700.4. Samples: 775317432. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:43,989][27935] Avg episode reward: [(0, '-1.443')] [2022-07-13 16:54:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 387678208. Throughput: 0: 9682.4. Samples: 775345760. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:48,989][27935] Avg episode reward: [(0, '-1.675')] [2022-07-13 16:54:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.9, 300 sec: 4838.8). Total num frames: 387701760. Throughput: 0: 9756.0. Samples: 775404036. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:53,989][27935] Avg episode reward: [(0, '-2.354')] [2022-07-13 16:54:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 387726336. Throughput: 0: 9756.2. Samples: 775462936. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:54:58,989][27935] Avg episode reward: [(0, '-1.166')] [2022-07-13 16:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 387748864. Throughput: 0: 9668.0. Samples: 775517744. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:03,989][27935] Avg episode reward: [(0, '-1.707')] [2022-07-13 16:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 387772416. Throughput: 0: 9654.0. Samples: 775546700. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:08,989][27935] Avg episode reward: [(0, '-1.159')] [2022-07-13 16:55:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 387799040. Throughput: 0: 9664.4. Samples: 775606108. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:13,989][27935] Avg episode reward: [(0, '-1.105')] [2022-07-13 16:55:18,995][27935] Fps is (10 sec: 5014.4, 60 sec: 4846.7, 300 sec: 4845.7). Total num frames: 387822592. Throughput: 0: 9662.6. Samples: 775664736. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:18,997][27935] Avg episode reward: [(0, '-1.237')] [2022-07-13 16:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 387847168. Throughput: 0: 9667.0. Samples: 775694236. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:23,989][27935] Avg episode reward: [(0, '-2.044')] [2022-07-13 16:55:28,989][27935] Fps is (10 sec: 4815.9, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 387870720. Throughput: 0: 9680.6. Samples: 775753060. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:28,989][27935] Avg episode reward: [(0, '-2.583')] [2022-07-13 16:55:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 387895296. Throughput: 0: 10348.9. Samples: 775811460. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:33,989][27935] Avg episode reward: [(0, '-1.678')] [2022-07-13 16:55:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 387920896. Throughput: 0: 9710.1. Samples: 775840992. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:38,989][27935] Avg episode reward: [(0, '-2.668')] [2022-07-13 16:55:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 387944448. Throughput: 0: 9708.8. Samples: 775899832. Policy #0 lag: (min: 0.0, avg: 7.4, max: 18.0) [2022-07-13 16:55:43,989][27935] Avg episode reward: [(0, '-3.163')] [2022-07-13 16:55:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 387970048. Throughput: 0: 9798.7. Samples: 775958684. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:55:48,989][27935] Avg episode reward: [(0, '-3.388')] [2022-07-13 16:55:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 387994624. Throughput: 0: 9808.6. Samples: 775988088. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:55:53,990][27935] Avg episode reward: [(0, '-3.726')] [2022-07-13 16:55:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 388019200. Throughput: 0: 9802.9. Samples: 776047240. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:55:58,990][27935] Avg episode reward: [(0, '-4.824')] [2022-07-13 16:56:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 388041728. Throughput: 0: 9737.0. Samples: 776102840. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:03,989][27935] Avg episode reward: [(0, '-3.552')] [2022-07-13 16:56:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4915.2, 300 sec: 4856.2). Total num frames: 388067328. Throughput: 0: 9735.3. Samples: 776132324. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:08,990][27935] Avg episode reward: [(0, '-1.923')] [2022-07-13 16:56:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 388090880. Throughput: 0: 9729.3. Samples: 776190880. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:13,989][27935] Avg episode reward: [(0, '-1.424')] [2022-07-13 16:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.5, 300 sec: 4856.2). Total num frames: 388114432. Throughput: 0: 9745.9. Samples: 776250024. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:18,990][27935] Avg episode reward: [(0, '-1.508')] [2022-07-13 16:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 388139008. Throughput: 0: 9741.4. Samples: 776279356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:23,989][27935] Avg episode reward: [(0, '-2.470')] [2022-07-13 16:56:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4859.7). Total num frames: 388164608. Throughput: 0: 9741.3. Samples: 776338192. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:28,990][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 16:56:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 388187136. Throughput: 0: 9730.4. Samples: 776396552. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:33,989][27935] Avg episode reward: [(0, '-0.862')] [2022-07-13 16:56:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 388212736. Throughput: 0: 9735.7. Samples: 776426196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:38,989][27935] Avg episode reward: [(0, '-1.005')] [2022-07-13 16:56:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 388237312. Throughput: 0: 9721.3. Samples: 776484700. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:43,989][27935] Avg episode reward: [(0, '-1.614')] [2022-07-13 16:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 388261888. Throughput: 0: 9779.3. Samples: 776542908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:48,989][27935] Avg episode reward: [(0, '-1.335')] [2022-07-13 16:56:53,997][27935] Fps is (10 sec: 4911.3, 60 sec: 4863.4, 300 sec: 4859.5). Total num frames: 388286464. Throughput: 0: 9777.5. Samples: 776572388. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:53,997][27935] Avg episode reward: [(0, '-0.155')] [2022-07-13 16:56:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 388311040. Throughput: 0: 9788.6. Samples: 776631364. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:56:58,989][27935] Avg episode reward: [(0, '0.738')] [2022-07-13 16:57:03,989][27935] Fps is (10 sec: 4714.1, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 388333568. Throughput: 0: 9687.3. Samples: 776685952. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:03,989][27935] Avg episode reward: [(0, '0.797')] [2022-07-13 16:57:08,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 388358144. Throughput: 0: 9691.8. Samples: 776715488. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:08,989][27935] Avg episode reward: [(0, '1.023')] [2022-07-13 16:57:13,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4846.8, 300 sec: 4863.1). Total num frames: 388381696. Throughput: 0: 9693.3. Samples: 776774408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:13,991][27935] Avg episode reward: [(0, '0.716')] [2022-07-13 16:57:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 388407296. Throughput: 0: 9708.3. Samples: 776833424. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:18,989][27935] Avg episode reward: [(0, '0.663')] [2022-07-13 16:57:23,989][27935] Fps is (10 sec: 5018.4, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 388431872. Throughput: 0: 9704.5. Samples: 776862900. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:23,989][27935] Avg episode reward: [(0, '0.734')] [2022-07-13 16:57:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 388456448. Throughput: 0: 9715.7. Samples: 776921908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:28,989][27935] Avg episode reward: [(0, '0.477')] [2022-07-13 16:57:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 388480000. Throughput: 0: 9718.8. Samples: 776980252. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:33,991][27935] Avg episode reward: [(0, '-0.631')] [2022-07-13 16:57:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 388503552. Throughput: 0: 9718.1. Samples: 777009628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:38,990][27935] Avg episode reward: [(0, '-0.576')] [2022-07-13 16:57:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 388529152. Throughput: 0: 9704.6. Samples: 777068072. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:43,990][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 16:57:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 388553728. Throughput: 0: 9796.7. Samples: 777126804. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:48,991][27935] Avg episode reward: [(0, '-0.993')] [2022-07-13 16:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.6, 300 sec: 4859.7). Total num frames: 388578304. Throughput: 0: 9795.5. Samples: 777156284. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:53,989][27935] Avg episode reward: [(0, '-1.035')] [2022-07-13 16:57:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4873.5). Total num frames: 388602880. Throughput: 0: 9795.6. Samples: 777215196. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:57:58,991][27935] Avg episode reward: [(0, '-0.910')] [2022-07-13 16:58:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 388624384. Throughput: 0: 9716.1. Samples: 777270648. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:58:03,991][27935] Avg episode reward: [(0, '-1.413')] [2022-07-13 16:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 388649984. Throughput: 0: 9706.9. Samples: 777299708. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:58:08,990][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 16:58:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.2, 300 sec: 4866.6). Total num frames: 388674560. Throughput: 0: 9704.3. Samples: 777358600. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:58:13,989][27935] Avg episode reward: [(0, '-1.534')] [2022-07-13 16:58:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 388699136. Throughput: 0: 9706.8. Samples: 777417056. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 16:58:18,989][27935] Avg episode reward: [(0, '-1.732')] [2022-07-13 16:58:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 388723712. Throughput: 0: 9707.1. Samples: 777446448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:23,990][27935] Avg episode reward: [(0, '-2.233')] [2022-07-13 16:58:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 388747264. Throughput: 0: 9718.8. Samples: 777505416. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:28,989][27935] Avg episode reward: [(0, '-3.089')] [2022-07-13 16:58:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 388772864. Throughput: 0: 9717.3. Samples: 777564080. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:33,989][27935] Avg episode reward: [(0, '-3.567')] [2022-07-13 16:58:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4863.1). Total num frames: 388797440. Throughput: 0: 9723.3. Samples: 777593832. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:38,989][27935] Avg episode reward: [(0, '-3.600')] [2022-07-13 16:58:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 388822016. Throughput: 0: 9718.7. Samples: 777652540. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:43,989][27935] Avg episode reward: [(0, '-4.197')] [2022-07-13 16:58:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.8). Total num frames: 388845568. Throughput: 0: 9801.4. Samples: 777711712. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:48,989][27935] Avg episode reward: [(0, '-3.423')] [2022-07-13 16:58:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 388870144. Throughput: 0: 9809.3. Samples: 777741124. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:53,989][27935] Avg episode reward: [(0, '-2.879')] [2022-07-13 16:58:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 388894720. Throughput: 0: 9811.0. Samples: 777800096. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:58:58,990][27935] Avg episode reward: [(0, '-2.650')] [2022-07-13 16:59:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4898.1, 300 sec: 4866.6). Total num frames: 388918272. Throughput: 0: 9723.7. Samples: 777854624. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:03,989][27935] Avg episode reward: [(0, '-1.095')] [2022-07-13 16:59:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 388942848. Throughput: 0: 9725.7. Samples: 777884104. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:08,989][27935] Avg episode reward: [(0, '-1.426')] [2022-07-13 16:59:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.2). Total num frames: 388966400. Throughput: 0: 9721.8. Samples: 777942896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:13,989][27935] Avg episode reward: [(0, '-0.205')] [2022-07-13 16:59:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 388990976. Throughput: 0: 9724.7. Samples: 778001692. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:18,991][27935] Avg episode reward: [(0, '-0.427')] [2022-07-13 16:59:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 389015552. Throughput: 0: 9723.2. Samples: 778031376. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:23,989][27935] Avg episode reward: [(0, '-0.587')] [2022-07-13 16:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 389040128. Throughput: 0: 9723.1. Samples: 778090080. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:28,989][27935] Avg episode reward: [(0, '-0.852')] [2022-07-13 16:59:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 389064704. Throughput: 0: 9708.6. Samples: 778148600. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:33,990][27935] Avg episode reward: [(0, '-0.716')] [2022-07-13 16:59:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 389088256. Throughput: 0: 9706.5. Samples: 778177916. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:38,989][27935] Avg episode reward: [(0, '0.208')] [2022-07-13 16:59:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 389112832. Throughput: 0: 9702.9. Samples: 778236728. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:43,990][27935] Avg episode reward: [(0, '0.372')] [2022-07-13 16:59:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 389138432. Throughput: 0: 9794.4. Samples: 778295372. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:48,989][27935] Avg episode reward: [(0, '0.554')] [2022-07-13 16:59:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 389161984. Throughput: 0: 9794.5. Samples: 778324856. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:53,990][27935] Avg episode reward: [(0, '0.855')] [2022-07-13 16:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4877.0). Total num frames: 389187584. Throughput: 0: 9797.5. Samples: 778383784. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 16:59:58,989][27935] Avg episode reward: [(0, '0.751')] [2022-07-13 17:00:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 389209088. Throughput: 0: 9705.8. Samples: 778438452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:03,989][27935] Avg episode reward: [(0, '-0.067')] [2022-07-13 17:00:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389232640. Throughput: 0: 9692.9. Samples: 778467556. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:08,990][27935] Avg episode reward: [(0, '-0.826')] [2022-07-13 17:00:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.2). Total num frames: 389259264. Throughput: 0: 9701.5. Samples: 778526648. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:13,989][27935] Avg episode reward: [(0, '-1.374')] [2022-07-13 17:00:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 389282816. Throughput: 0: 9704.4. Samples: 778585300. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:18,989][27935] Avg episode reward: [(0, '-1.292')] [2022-07-13 17:00:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4870.1). Total num frames: 389307392. Throughput: 0: 9705.4. Samples: 778614660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:23,989][27935] Avg episode reward: [(0, '-1.448')] [2022-07-13 17:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 389330944. Throughput: 0: 9712.3. Samples: 778673780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:28,990][27935] Avg episode reward: [(0, '-1.310')] [2022-07-13 17:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 389356544. Throughput: 0: 9704.1. Samples: 778732056. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:33,989][27935] Avg episode reward: [(0, '-0.842')] [2022-07-13 17:00:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4870.1). Total num frames: 389381120. Throughput: 0: 9694.6. Samples: 778761112. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:38,990][27935] Avg episode reward: [(0, '1.345')] [2022-07-13 17:00:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4866.6). Total num frames: 389405696. Throughput: 0: 9697.5. Samples: 778820172. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:43,989][27935] Avg episode reward: [(0, '1.589')] [2022-07-13 17:00:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389428224. Throughput: 0: 9773.0. Samples: 778878236. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:48,990][27935] Avg episode reward: [(0, '1.493')] [2022-07-13 17:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 389453824. Throughput: 0: 9762.1. Samples: 778906848. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:53,990][27935] Avg episode reward: [(0, '1.277')] [2022-07-13 17:00:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4870.1). Total num frames: 389478400. Throughput: 0: 9751.7. Samples: 778965476. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 17:00:58,989][27935] Avg episode reward: [(0, '-0.024')] [2022-07-13 17:01:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 389500928. Throughput: 0: 9669.5. Samples: 779020428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:03,989][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 17:01:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4863.1). Total num frames: 389525504. Throughput: 0: 9665.5. Samples: 779049608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:08,989][27935] Avg episode reward: [(0, '-0.294')] [2022-07-13 17:01:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 389549056. Throughput: 0: 9654.4. Samples: 779108228. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:13,989][27935] Avg episode reward: [(0, '-1.770')] [2022-07-13 17:01:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389572608. Throughput: 0: 9652.1. Samples: 779166400. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:18,989][27935] Avg episode reward: [(0, '-1.613')] [2022-07-13 17:01:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 389598208. Throughput: 0: 9655.1. Samples: 779195592. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:23,989][27935] Avg episode reward: [(0, '-1.639')] [2022-07-13 17:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4866.6). Total num frames: 389622784. Throughput: 0: 9639.7. Samples: 779253960. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:28,989][27935] Avg episode reward: [(0, '-0.674')] [2022-07-13 17:01:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389646336. Throughput: 0: 9640.9. Samples: 779312076. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:33,989][27935] Avg episode reward: [(0, '0.100')] [2022-07-13 17:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389670912. Throughput: 0: 9654.9. Samples: 779341320. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:38,989][27935] Avg episode reward: [(0, '0.196')] [2022-07-13 17:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4859.7). Total num frames: 389695488. Throughput: 0: 9659.9. Samples: 779400172. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:43,989][27935] Avg episode reward: [(0, '0.950')] [2022-07-13 17:01:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4863.3). Total num frames: 389721088. Throughput: 0: 9733.6. Samples: 779458440. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:48,989][27935] Avg episode reward: [(0, '0.919')] [2022-07-13 17:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 389743616. Throughput: 0: 9737.0. Samples: 779487772. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:53,989][27935] Avg episode reward: [(0, '0.669')] [2022-07-13 17:01:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4863.1). Total num frames: 389768192. Throughput: 0: 9729.8. Samples: 779546068. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:01:58,989][27935] Avg episode reward: [(0, '0.581')] [2022-07-13 17:02:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 389789696. Throughput: 0: 9647.9. Samples: 779600556. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:03,989][27935] Avg episode reward: [(0, '0.592')] [2022-07-13 17:02:08,989][27935] Fps is (10 sec: 4710.1, 60 sec: 4829.8, 300 sec: 4859.7). Total num frames: 389815296. Throughput: 0: 9646.3. Samples: 779629680. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:08,990][27935] Avg episode reward: [(0, '0.580')] [2022-07-13 17:02:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 389839872. Throughput: 0: 9652.2. Samples: 779688312. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:13,989][27935] Avg episode reward: [(0, '1.139')] [2022-07-13 17:02:18,989][27935] Fps is (10 sec: 4813.1, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 389863424. Throughput: 0: 9660.9. Samples: 779746816. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:18,989][27935] Avg episode reward: [(0, '1.032')] [2022-07-13 17:02:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 389888000. Throughput: 0: 9662.2. Samples: 779776120. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:23,989][27935] Avg episode reward: [(0, '0.394')] [2022-07-13 17:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 389911552. Throughput: 0: 9652.9. Samples: 779834552. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:28,990][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 17:02:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 389936128. Throughput: 0: 9656.2. Samples: 779892968. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:33,990][27935] Avg episode reward: [(0, '-0.354')] [2022-07-13 17:02:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 389960704. Throughput: 0: 9657.2. Samples: 779922348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:38,989][27935] Avg episode reward: [(0, '-0.251')] [2022-07-13 17:02:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 389985280. Throughput: 0: 9648.9. Samples: 779980268. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:43,990][27935] Avg episode reward: [(0, '-1.200')] [2022-07-13 17:02:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 390009856. Throughput: 0: 9736.8. Samples: 780038712. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:48,990][27935] Avg episode reward: [(0, '-1.354')] [2022-07-13 17:02:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 390033408. Throughput: 0: 9743.1. Samples: 780068116. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:53,989][27935] Avg episode reward: [(0, '-0.973')] [2022-07-13 17:02:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 390059008. Throughput: 0: 9751.0. Samples: 780127108. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:02:58,990][27935] Avg episode reward: [(0, '-0.794')] [2022-07-13 17:03:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 390081536. Throughput: 0: 9676.0. Samples: 780182236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:03,989][27935] Avg episode reward: [(0, '-1.334')] [2022-07-13 17:03:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4847.0, 300 sec: 4852.7). Total num frames: 390106112. Throughput: 0: 9676.3. Samples: 780211552. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:09,002][27935] Avg episode reward: [(0, '-1.587')] [2022-07-13 17:03:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 390129664. Throughput: 0: 9680.3. Samples: 780270168. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:13,989][27935] Avg episode reward: [(0, '-1.919')] [2022-07-13 17:03:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 390154240. Throughput: 0: 9679.9. Samples: 780328564. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:18,989][27935] Avg episode reward: [(0, '-1.910')] [2022-07-13 17:03:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 390178816. Throughput: 0: 9683.5. Samples: 780358104. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:23,989][27935] Avg episode reward: [(0, '-1.758')] [2022-07-13 17:03:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390203392. Throughput: 0: 9696.6. Samples: 780416616. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:28,989][27935] Avg episode reward: [(0, '-1.134')] [2022-07-13 17:03:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390226944. Throughput: 0: 9694.1. Samples: 780474944. Policy #0 lag: (min: 0.0, avg: 9.2, max: 21.0) [2022-07-13 17:03:33,989][27935] Avg episode reward: [(0, '-1.325')] [2022-07-13 17:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390252544. Throughput: 0: 9690.9. Samples: 780504208. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:03:38,989][27935] Avg episode reward: [(0, '-0.129')] [2022-07-13 17:03:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 390276096. Throughput: 0: 9679.2. Samples: 780562672. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:03:43,989][27935] Avg episode reward: [(0, '0.473')] [2022-07-13 17:03:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 390300672. Throughput: 0: 9761.6. Samples: 780621508. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:03:48,990][27935] Avg episode reward: [(0, '0.896')] [2022-07-13 17:03:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390325248. Throughput: 0: 9762.0. Samples: 780650840. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:03:53,989][27935] Avg episode reward: [(0, '0.763')] [2022-07-13 17:03:58,991][27935] Fps is (10 sec: 4913.9, 60 sec: 4846.7, 300 sec: 4852.7). Total num frames: 390349824. Throughput: 0: 9761.5. Samples: 780709460. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:03:58,992][27935] Avg episode reward: [(0, '0.876')] [2022-07-13 17:04:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390373376. Throughput: 0: 9680.8. Samples: 780764200. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:03,989][27935] Avg episode reward: [(0, '0.323')] [2022-07-13 17:04:08,989][27935] Fps is (10 sec: 4711.6, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 390396928. Throughput: 0: 9680.4. Samples: 780793724. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:08,989][27935] Avg episode reward: [(0, '0.237')] [2022-07-13 17:04:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390420480. Throughput: 0: 9677.8. Samples: 780852120. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:13,989][27935] Avg episode reward: [(0, '-0.904')] [2022-07-13 17:04:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390446080. Throughput: 0: 9682.3. Samples: 780910648. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:18,989][27935] Avg episode reward: [(0, '-0.915')] [2022-07-13 17:04:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390469632. Throughput: 0: 9692.3. Samples: 780940360. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:23,989][27935] Avg episode reward: [(0, '-1.168')] [2022-07-13 17:04:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390495232. Throughput: 0: 9700.9. Samples: 780999212. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:28,989][27935] Avg episode reward: [(0, '-1.537')] [2022-07-13 17:04:34,005][27935] Fps is (10 sec: 4907.4, 60 sec: 4862.7, 300 sec: 4849.0). Total num frames: 390518784. Throughput: 0: 9677.6. Samples: 781057152. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:34,005][27935] Avg episode reward: [(0, '-1.791')] [2022-07-13 17:04:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 390543360. Throughput: 0: 9681.5. Samples: 781086508. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:38,989][27935] Avg episode reward: [(0, '-1.744')] [2022-07-13 17:04:43,989][27935] Fps is (10 sec: 4820.4, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 390566912. Throughput: 0: 9673.9. Samples: 781144760. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:43,989][27935] Avg episode reward: [(0, '-0.475')] [2022-07-13 17:04:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 390592512. Throughput: 0: 9767.1. Samples: 781203720. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:48,989][27935] Avg episode reward: [(0, '-1.183')] [2022-07-13 17:04:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 390617088. Throughput: 0: 9754.9. Samples: 781232692. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:53,989][27935] Avg episode reward: [(0, '-1.145')] [2022-07-13 17:04:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.1, 300 sec: 4852.7). Total num frames: 390640640. Throughput: 0: 9755.2. Samples: 781291104. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:04:58,990][27935] Avg episode reward: [(0, '-0.741')] [2022-07-13 17:05:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 390662144. Throughput: 0: 9668.8. Samples: 781345744. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:03,989][27935] Avg episode reward: [(0, '-0.475')] [2022-07-13 17:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 390686720. Throughput: 0: 9654.6. Samples: 781374816. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:08,990][27935] Avg episode reward: [(0, '-0.357')] [2022-07-13 17:05:13,992][27935] Fps is (10 sec: 5016.1, 60 sec: 4863.8, 300 sec: 4845.7). Total num frames: 390712320. Throughput: 0: 9648.1. Samples: 781433404. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:13,992][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 17:05:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390736896. Throughput: 0: 9668.3. Samples: 781492072. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:18,989][27935] Avg episode reward: [(0, '-0.072')] [2022-07-13 17:05:23,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390760448. Throughput: 0: 9660.1. Samples: 781521212. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:23,989][27935] Avg episode reward: [(0, '0.765')] [2022-07-13 17:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390786048. Throughput: 0: 9673.7. Samples: 781580076. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:28,989][27935] Avg episode reward: [(0, '0.235')] [2022-07-13 17:05:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4831.1, 300 sec: 4838.8). Total num frames: 390808576. Throughput: 0: 9654.1. Samples: 781638156. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:33,989][27935] Avg episode reward: [(0, '-0.352')] [2022-07-13 17:05:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 390833152. Throughput: 0: 9657.3. Samples: 781667272. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:38,991][27935] Avg episode reward: [(0, '-0.877')] [2022-07-13 17:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390857728. Throughput: 0: 9665.0. Samples: 781726028. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:43,989][27935] Avg episode reward: [(0, '-0.915')] [2022-07-13 17:05:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 390883328. Throughput: 0: 9757.9. Samples: 781784848. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:48,989][27935] Avg episode reward: [(0, '-1.017')] [2022-07-13 17:05:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 390905856. Throughput: 0: 9762.3. Samples: 781814120. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:53,989][27935] Avg episode reward: [(0, '-0.316')] [2022-07-13 17:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 390932480. Throughput: 0: 9771.3. Samples: 781873084. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:05:58,989][27935] Avg episode reward: [(0, '-1.196')] [2022-07-13 17:06:03,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 390955008. Throughput: 0: 9681.8. Samples: 781927752. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:06:03,989][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 17:06:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 390979584. Throughput: 0: 9688.3. Samples: 781957184. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:06:08,989][27935] Avg episode reward: [(0, '-0.021')] [2022-07-13 17:06:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.2, 300 sec: 4849.2). Total num frames: 391003136. Throughput: 0: 9684.4. Samples: 782015876. Policy #0 lag: (min: 0.0, avg: 7.4, max: 19.0) [2022-07-13 17:06:13,990][27935] Avg episode reward: [(0, '0.360')] [2022-07-13 17:06:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 391026688. Throughput: 0: 9693.9. Samples: 782074380. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:18,989][27935] Avg episode reward: [(0, '0.196')] [2022-07-13 17:06:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 391051264. Throughput: 0: 9691.7. Samples: 782103400. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:23,989][27935] Avg episode reward: [(0, '-0.216')] [2022-07-13 17:06:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 391075840. Throughput: 0: 9678.8. Samples: 782161572. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:28,989][27935] Avg episode reward: [(0, '0.048')] [2022-07-13 17:06:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391100416. Throughput: 0: 9664.3. Samples: 782219740. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:33,989][27935] Avg episode reward: [(0, '0.769')] [2022-07-13 17:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391124992. Throughput: 0: 9659.8. Samples: 782248812. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:38,990][27935] Avg episode reward: [(0, '0.426')] [2022-07-13 17:06:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 391149568. Throughput: 0: 9656.3. Samples: 782307616. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:43,990][27935] Avg episode reward: [(0, '0.286')] [2022-07-13 17:06:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 391173120. Throughput: 0: 9746.1. Samples: 782366328. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:48,989][27935] Avg episode reward: [(0, '0.715')] [2022-07-13 17:06:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391197696. Throughput: 0: 9722.3. Samples: 782394688. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:53,989][27935] Avg episode reward: [(0, '-0.836')] [2022-07-13 17:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4852.7). Total num frames: 391221248. Throughput: 0: 9696.5. Samples: 782452220. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:06:58,989][27935] Avg episode reward: [(0, '-1.491')] [2022-07-13 17:07:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 391242752. Throughput: 0: 9614.1. Samples: 782507016. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:03,989][27935] Avg episode reward: [(0, '-1.702')] [2022-07-13 17:07:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 391268352. Throughput: 0: 9622.4. Samples: 782536408. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:08,992][27935] Avg episode reward: [(0, '-2.512')] [2022-07-13 17:07:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 391292928. Throughput: 0: 9638.7. Samples: 782595312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:13,989][27935] Avg episode reward: [(0, '-2.896')] [2022-07-13 17:07:19,001][27935] Fps is (10 sec: 4909.4, 60 sec: 4846.0, 300 sec: 4845.6). Total num frames: 391317504. Throughput: 0: 9647.8. Samples: 782654004. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:19,001][27935] Avg episode reward: [(0, '-3.514')] [2022-07-13 17:07:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 391342080. Throughput: 0: 9659.6. Samples: 782683496. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:23,989][27935] Avg episode reward: [(0, '-2.849')] [2022-07-13 17:07:28,989][27935] Fps is (10 sec: 4921.0, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 391366656. Throughput: 0: 9647.9. Samples: 782741772. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:28,989][27935] Avg episode reward: [(0, '-2.626')] [2022-07-13 17:07:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 391390208. Throughput: 0: 9644.7. Samples: 782800340. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:33,989][27935] Avg episode reward: [(0, '-1.640')] [2022-07-13 17:07:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 391416832. Throughput: 0: 9666.6. Samples: 782829684. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:38,989][27935] Avg episode reward: [(0, '-0.725')] [2022-07-13 17:07:43,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 391438336. Throughput: 0: 9685.5. Samples: 782888072. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:43,990][27935] Avg episode reward: [(0, '0.214')] [2022-07-13 17:07:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 391463936. Throughput: 0: 9775.9. Samples: 782946932. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:48,989][27935] Avg episode reward: [(0, '1.154')] [2022-07-13 17:07:53,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 391488512. Throughput: 0: 9779.7. Samples: 782976492. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:53,989][27935] Avg episode reward: [(0, '0.986')] [2022-07-13 17:07:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 391513088. Throughput: 0: 9777.6. Samples: 783035304. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:07:58,989][27935] Avg episode reward: [(0, '1.901')] [2022-07-13 17:08:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 391535616. Throughput: 0: 9698.3. Samples: 783090312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:03,989][27935] Avg episode reward: [(0, '1.864')] [2022-07-13 17:08:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 391560192. Throughput: 0: 9695.0. Samples: 783119772. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:08,990][27935] Avg episode reward: [(0, '2.006')] [2022-07-13 17:08:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 391583744. Throughput: 0: 9700.6. Samples: 783178300. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:13,989][27935] Avg episode reward: [(0, '1.286')] [2022-07-13 17:08:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.9, 300 sec: 4845.8). Total num frames: 391608320. Throughput: 0: 9705.0. Samples: 783237064. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:18,989][27935] Avg episode reward: [(0, '0.784')] [2022-07-13 17:08:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 391632896. Throughput: 0: 9711.0. Samples: 783266680. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:23,989][27935] Avg episode reward: [(0, '0.621')] [2022-07-13 17:08:28,996][27935] Fps is (10 sec: 4911.8, 60 sec: 4846.4, 300 sec: 4849.1). Total num frames: 391657472. Throughput: 0: 9717.3. Samples: 783325412. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:28,996][27935] Avg episode reward: [(0, '0.475')] [2022-07-13 17:08:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391682048. Throughput: 0: 9707.7. Samples: 783383780. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:33,989][27935] Avg episode reward: [(0, '0.081')] [2022-07-13 17:08:38,989][27935] Fps is (10 sec: 4918.5, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 391706624. Throughput: 0: 9697.3. Samples: 783412872. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:38,989][27935] Avg episode reward: [(0, '-0.989')] [2022-07-13 17:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 391731200. Throughput: 0: 9696.4. Samples: 783471644. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:43,989][27935] Avg episode reward: [(0, '-1.498')] [2022-07-13 17:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 391755776. Throughput: 0: 9780.8. Samples: 783530448. Policy #0 lag: (min: 0.0, avg: 9.1, max: 20.0) [2022-07-13 17:08:48,989][27935] Avg episode reward: [(0, '-1.261')] [2022-07-13 17:08:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4849.3). Total num frames: 391780352. Throughput: 0: 9789.0. Samples: 783560276. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:08:53,989][27935] Avg episode reward: [(0, '-0.921')] [2022-07-13 17:08:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4856.2). Total num frames: 391805952. Throughput: 0: 9796.2. Samples: 783619128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:08:58,989][27935] Avg episode reward: [(0, '-0.799')] [2022-07-13 17:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 391827456. Throughput: 0: 9708.5. Samples: 783673948. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:03,989][27935] Avg episode reward: [(0, '-1.088')] [2022-07-13 17:09:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 391852032. Throughput: 0: 9701.0. Samples: 783703224. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:08,990][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 17:09:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391875584. Throughput: 0: 9689.9. Samples: 783761392. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:13,989][27935] Avg episode reward: [(0, '0.270')] [2022-07-13 17:09:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 391900160. Throughput: 0: 9676.3. Samples: 783819216. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:18,989][27935] Avg episode reward: [(0, '0.900')] [2022-07-13 17:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 391924736. Throughput: 0: 9678.0. Samples: 783848380. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:23,989][27935] Avg episode reward: [(0, '1.013')] [2022-07-13 17:09:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4847.5, 300 sec: 4846.0). Total num frames: 391948288. Throughput: 0: 9666.6. Samples: 783906640. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:28,989][27935] Avg episode reward: [(0, '1.254')] [2022-07-13 17:09:33,992][27935] Fps is (10 sec: 4709.1, 60 sec: 4829.6, 300 sec: 4842.3). Total num frames: 391971840. Throughput: 0: 9642.9. Samples: 783964404. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:33,992][27935] Avg episode reward: [(0, '1.110')] [2022-07-13 17:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 391997440. Throughput: 0: 9625.2. Samples: 783993412. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:38,989][27935] Avg episode reward: [(0, '1.170')] [2022-07-13 17:09:43,989][27935] Fps is (10 sec: 4916.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 392020992. Throughput: 0: 9610.1. Samples: 784051584. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:43,989][27935] Avg episode reward: [(0, '-0.636')] [2022-07-13 17:09:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 392044544. Throughput: 0: 9682.4. Samples: 784109656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:48,989][27935] Avg episode reward: [(0, '-0.680')] [2022-07-13 17:09:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 392070144. Throughput: 0: 9680.4. Samples: 784138844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:53,989][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 17:09:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4852.7). Total num frames: 392093696. Throughput: 0: 9682.0. Samples: 784197084. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:09:58,989][27935] Avg episode reward: [(0, '-0.465')] [2022-07-13 17:10:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 392115200. Throughput: 0: 9618.1. Samples: 784252032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:03,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 17:10:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4842.4). Total num frames: 392140800. Throughput: 0: 9616.6. Samples: 784281128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:08,989][27935] Avg episode reward: [(0, '-1.085')] [2022-07-13 17:10:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 392165376. Throughput: 0: 9620.2. Samples: 784339548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:13,989][27935] Avg episode reward: [(0, '-1.136')] [2022-07-13 17:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 392188928. Throughput: 0: 9637.1. Samples: 784398048. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:18,990][27935] Avg episode reward: [(0, '-0.385')] [2022-07-13 17:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 392213504. Throughput: 0: 9651.0. Samples: 784427708. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:23,989][27935] Avg episode reward: [(0, '-0.558')] [2022-07-13 17:10:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 392238080. Throughput: 0: 9668.9. Samples: 784486684. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:28,989][27935] Avg episode reward: [(0, '-0.726')] [2022-07-13 17:10:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.2, 300 sec: 4849.2). Total num frames: 392263680. Throughput: 0: 9677.2. Samples: 784545128. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:33,989][27935] Avg episode reward: [(0, '-0.635')] [2022-07-13 17:10:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 392286208. Throughput: 0: 9690.8. Samples: 784574928. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:38,989][27935] Avg episode reward: [(0, '0.182')] [2022-07-13 17:10:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 392311808. Throughput: 0: 9708.2. Samples: 784633952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:43,990][27935] Avg episode reward: [(0, '-0.631')] [2022-07-13 17:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 392336384. Throughput: 0: 9807.1. Samples: 784693352. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:48,989][27935] Avg episode reward: [(0, '-1.159')] [2022-07-13 17:10:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 392361984. Throughput: 0: 9814.4. Samples: 784722776. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:53,992][27935] Avg episode reward: [(0, '-0.279')] [2022-07-13 17:10:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 392386560. Throughput: 0: 9820.4. Samples: 784781464. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:10:58,989][27935] Avg episode reward: [(0, '-0.226')] [2022-07-13 17:11:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4898.1, 300 sec: 4845.8). Total num frames: 392409088. Throughput: 0: 9738.1. Samples: 784836264. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:03,991][27935] Avg episode reward: [(0, '-0.402')] [2022-07-13 17:11:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 392432640. Throughput: 0: 9738.0. Samples: 784865920. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:08,989][27935] Avg episode reward: [(0, '-0.289')] [2022-07-13 17:11:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 392457216. Throughput: 0: 9735.3. Samples: 784924772. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:13,990][27935] Avg episode reward: [(0, '-0.221')] [2022-07-13 17:11:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 392480768. Throughput: 0: 9744.5. Samples: 784983628. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:18,989][27935] Avg episode reward: [(0, '0.381')] [2022-07-13 17:11:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 392506368. Throughput: 0: 9729.0. Samples: 785012732. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:23,989][27935] Avg episode reward: [(0, '0.693')] [2022-07-13 17:11:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4849.2). Total num frames: 392530944. Throughput: 0: 9724.8. Samples: 785071568. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 17:11:28,989][27935] Avg episode reward: [(0, '0.140')] [2022-07-13 17:11:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 392554496. Throughput: 0: 9694.5. Samples: 785129604. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:33,990][27935] Avg episode reward: [(0, '0.217')] [2022-07-13 17:11:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4849.2). Total num frames: 392580096. Throughput: 0: 9697.5. Samples: 785159164. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:38,989][27935] Avg episode reward: [(0, '0.235')] [2022-07-13 17:11:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 392604672. Throughput: 0: 9697.3. Samples: 785217844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:43,989][27935] Avg episode reward: [(0, '-0.075')] [2022-07-13 17:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 392629248. Throughput: 0: 9786.1. Samples: 785276640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:48,989][27935] Avg episode reward: [(0, '-1.022')] [2022-07-13 17:11:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 392652800. Throughput: 0: 9784.1. Samples: 785306204. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:53,989][27935] Avg episode reward: [(0, '-0.433')] [2022-07-13 17:11:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4863.1). Total num frames: 392677376. Throughput: 0: 9792.5. Samples: 785365432. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:11:58,989][27935] Avg episode reward: [(0, '-1.912')] [2022-07-13 17:12:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 392700928. Throughput: 0: 9696.2. Samples: 785419956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:03,989][27935] Avg episode reward: [(0, '-1.261')] [2022-07-13 17:12:08,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4863.8, 300 sec: 4852.7). Total num frames: 392724480. Throughput: 0: 9708.8. Samples: 785449648. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:09,003][27935] Avg episode reward: [(0, '-1.308')] [2022-07-13 17:12:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4852.9). Total num frames: 392749056. Throughput: 0: 9709.3. Samples: 785508488. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:13,989][27935] Avg episode reward: [(0, '-1.069')] [2022-07-13 17:12:18,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 392773632. Throughput: 0: 9726.7. Samples: 785567304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:18,989][27935] Avg episode reward: [(0, '-1.523')] [2022-07-13 17:12:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 392798208. Throughput: 0: 9717.0. Samples: 785596428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:23,989][27935] Avg episode reward: [(0, '-1.366')] [2022-07-13 17:12:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 392822784. Throughput: 0: 9720.4. Samples: 785655264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:28,990][27935] Avg episode reward: [(0, '-2.117')] [2022-07-13 17:12:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4898.1, 300 sec: 4852.7). Total num frames: 392848384. Throughput: 0: 9711.7. Samples: 785713668. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:33,990][27935] Avg episode reward: [(0, '-1.737')] [2022-07-13 17:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 392870912. Throughput: 0: 9707.3. Samples: 785743032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:38,990][27935] Avg episode reward: [(0, '-1.694')] [2022-07-13 17:12:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 392895488. Throughput: 0: 9690.3. Samples: 785801496. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:44,004][27935] Avg episode reward: [(0, '-1.694')] [2022-07-13 17:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 392919040. Throughput: 0: 9784.2. Samples: 785860244. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:48,989][27935] Avg episode reward: [(0, '-1.949')] [2022-07-13 17:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 392944640. Throughput: 0: 9773.3. Samples: 785889428. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:53,990][27935] Avg episode reward: [(0, '-1.587')] [2022-07-13 17:12:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 392969216. Throughput: 0: 9747.0. Samples: 785947100. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:12:58,989][27935] Avg episode reward: [(0, '-1.411')] [2022-07-13 17:13:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 392990720. Throughput: 0: 9633.9. Samples: 786000832. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:03,989][27935] Avg episode reward: [(0, '0.003')] [2022-07-13 17:13:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4847.1, 300 sec: 4852.7). Total num frames: 393015296. Throughput: 0: 9639.7. Samples: 786030216. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:08,989][27935] Avg episode reward: [(0, '-0.089')] [2022-07-13 17:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 393038848. Throughput: 0: 9645.9. Samples: 786089332. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:13,989][27935] Avg episode reward: [(0, '-0.174')] [2022-07-13 17:13:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393064448. Throughput: 0: 9651.0. Samples: 786147964. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:18,989][27935] Avg episode reward: [(0, '-0.127')] [2022-07-13 17:13:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.8). Total num frames: 393089024. Throughput: 0: 9655.2. Samples: 786177516. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:23,990][27935] Avg episode reward: [(0, '-0.686')] [2022-07-13 17:13:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 393114624. Throughput: 0: 9662.0. Samples: 786236288. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:28,989][27935] Avg episode reward: [(0, '-0.762')] [2022-07-13 17:13:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 393138176. Throughput: 0: 9640.3. Samples: 786294056. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:33,990][27935] Avg episode reward: [(0, '-2.531')] [2022-07-13 17:13:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 393159680. Throughput: 0: 9640.2. Samples: 786323236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:38,989][27935] Avg episode reward: [(0, '-2.801')] [2022-07-13 17:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4852.7). Total num frames: 393187328. Throughput: 0: 9674.7. Samples: 786382460. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:43,989][27935] Avg episode reward: [(0, '-4.367')] [2022-07-13 17:13:48,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 393210880. Throughput: 0: 9787.4. Samples: 786441264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:48,989][27935] Avg episode reward: [(0, '-4.231')] [2022-07-13 17:13:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 393235456. Throughput: 0: 9786.1. Samples: 786470592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:53,989][27935] Avg episode reward: [(0, '-4.078')] [2022-07-13 17:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 393260032. Throughput: 0: 9773.4. Samples: 786529136. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:13:58,989][27935] Avg episode reward: [(0, '-2.523')] [2022-07-13 17:14:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4849.2). Total num frames: 393282560. Throughput: 0: 9691.9. Samples: 786584100. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:14:03,991][27935] Avg episode reward: [(0, '-0.497')] [2022-07-13 17:14:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 393306112. Throughput: 0: 9687.9. Samples: 786613472. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:14:08,991][27935] Avg episode reward: [(0, '-0.533')] [2022-07-13 17:14:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4852.7). Total num frames: 393331712. Throughput: 0: 9695.4. Samples: 786672580. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:13,998][27935] Avg episode reward: [(0, '0.095')] [2022-07-13 17:14:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4849.2). Total num frames: 393355264. Throughput: 0: 9710.0. Samples: 786731004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:18,989][27935] Avg episode reward: [(0, '0.203')] [2022-07-13 17:14:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393379840. Throughput: 0: 9712.3. Samples: 786760288. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:23,989][27935] Avg episode reward: [(0, '-0.408')] [2022-07-13 17:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4856.2). Total num frames: 393404416. Throughput: 0: 9710.0. Samples: 786819408. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:28,989][27935] Avg episode reward: [(0, '-0.897')] [2022-07-13 17:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393428992. Throughput: 0: 9704.4. Samples: 786877964. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:33,989][27935] Avg episode reward: [(0, '-1.176')] [2022-07-13 17:14:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4898.1, 300 sec: 4856.2). Total num frames: 393453568. Throughput: 0: 9700.2. Samples: 786907100. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:38,990][27935] Avg episode reward: [(0, '-2.220')] [2022-07-13 17:14:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 393478144. Throughput: 0: 9712.8. Samples: 786966212. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:43,989][27935] Avg episode reward: [(0, '-2.330')] [2022-07-13 17:14:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4856.2). Total num frames: 393502720. Throughput: 0: 9794.9. Samples: 787024872. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:48,989][27935] Avg episode reward: [(0, '-1.297')] [2022-07-13 17:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 393527296. Throughput: 0: 9796.5. Samples: 787054316. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:53,989][27935] Avg episode reward: [(0, '-1.218')] [2022-07-13 17:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4866.6). Total num frames: 393550848. Throughput: 0: 9778.5. Samples: 787112612. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:14:58,991][27935] Avg episode reward: [(0, '-0.686')] [2022-07-13 17:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 393573376. Throughput: 0: 9685.5. Samples: 787166852. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:03,989][27935] Avg episode reward: [(0, '-0.664')] [2022-07-13 17:15:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4881.1, 300 sec: 4859.7). Total num frames: 393598976. Throughput: 0: 9687.4. Samples: 787196220. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:08,990][27935] Avg episode reward: [(0, '-1.263')] [2022-07-13 17:15:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4846.9, 300 sec: 4859.7). Total num frames: 393622528. Throughput: 0: 9684.2. Samples: 787255200. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:13,991][27935] Avg episode reward: [(0, '-0.159')] [2022-07-13 17:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 393647104. Throughput: 0: 9681.6. Samples: 787313636. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:18,989][27935] Avg episode reward: [(0, '-0.183')] [2022-07-13 17:15:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 393671680. Throughput: 0: 9683.2. Samples: 787342844. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:23,990][27935] Avg episode reward: [(0, '-1.305')] [2022-07-13 17:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393695232. Throughput: 0: 9673.8. Samples: 787401532. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:28,993][27935] Avg episode reward: [(0, '-2.538')] [2022-07-13 17:15:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4863.1). Total num frames: 393720832. Throughput: 0: 9675.6. Samples: 787460276. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:33,989][27935] Avg episode reward: [(0, '-2.919')] [2022-07-13 17:15:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4859.7). Total num frames: 393745408. Throughput: 0: 9664.7. Samples: 787489228. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:38,989][27935] Avg episode reward: [(0, '-2.368')] [2022-07-13 17:15:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 393768960. Throughput: 0: 9678.4. Samples: 787548140. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:43,989][27935] Avg episode reward: [(0, '-4.340')] [2022-07-13 17:15:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393793536. Throughput: 0: 9766.3. Samples: 787606336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:48,989][27935] Avg episode reward: [(0, '-4.331')] [2022-07-13 17:15:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393818112. Throughput: 0: 9765.0. Samples: 787635644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:53,989][27935] Avg episode reward: [(0, '-4.581')] [2022-07-13 17:15:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4856.2). Total num frames: 393841664. Throughput: 0: 9750.1. Samples: 787693956. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:15:58,989][27935] Avg episode reward: [(0, '-4.080')] [2022-07-13 17:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393864192. Throughput: 0: 9662.9. Samples: 787748468. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:03,989][27935] Avg episode reward: [(0, '-2.911')] [2022-07-13 17:16:08,993][27935] Fps is (10 sec: 4708.6, 60 sec: 4829.6, 300 sec: 4852.7). Total num frames: 393888768. Throughput: 0: 9655.4. Samples: 787777376. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:08,993][27935] Avg episode reward: [(0, '-2.751')] [2022-07-13 17:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4852.7). Total num frames: 393912320. Throughput: 0: 9652.8. Samples: 787835908. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:13,990][27935] Avg episode reward: [(0, '-1.163')] [2022-07-13 17:16:18,989][27935] Fps is (10 sec: 4917.1, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393937920. Throughput: 0: 9638.5. Samples: 787894008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:18,990][27935] Avg episode reward: [(0, '-0.621')] [2022-07-13 17:16:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 393961472. Throughput: 0: 9637.0. Samples: 787922892. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:23,989][27935] Avg episode reward: [(0, '-0.663')] [2022-07-13 17:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 393986048. Throughput: 0: 9614.7. Samples: 787980800. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:28,990][27935] Avg episode reward: [(0, '0.480')] [2022-07-13 17:16:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4842.3). Total num frames: 394008576. Throughput: 0: 9614.8. Samples: 788039004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:33,989][27935] Avg episode reward: [(0, '0.632')] [2022-07-13 17:16:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 394035200. Throughput: 0: 9614.8. Samples: 788068312. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:38,989][27935] Avg episode reward: [(0, '0.864')] [2022-07-13 17:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 394057728. Throughput: 0: 9612.0. Samples: 788126496. Policy #0 lag: (min: 0.0, avg: 9.3, max: 21.0) [2022-07-13 17:16:43,989][27935] Avg episode reward: [(0, '-1.304')] [2022-07-13 17:16:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 394083328. Throughput: 0: 9695.8. Samples: 788184780. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:16:48,989][27935] Avg episode reward: [(0, '-0.939')] [2022-07-13 17:16:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4845.8). Total num frames: 394106880. Throughput: 0: 9707.8. Samples: 788214192. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:16:53,989][27935] Avg episode reward: [(0, '-1.738')] [2022-07-13 17:16:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 394131456. Throughput: 0: 9706.9. Samples: 788272720. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:16:58,990][27935] Avg episode reward: [(0, '-1.715')] [2022-07-13 17:17:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 394153984. Throughput: 0: 9627.3. Samples: 788327236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:03,989][27935] Avg episode reward: [(0, '-1.819')] [2022-07-13 17:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4813.1, 300 sec: 4842.3). Total num frames: 394177536. Throughput: 0: 9631.4. Samples: 788356304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:08,990][27935] Avg episode reward: [(0, '-1.949')] [2022-07-13 17:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 394202112. Throughput: 0: 9648.9. Samples: 788415000. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:13,990][27935] Avg episode reward: [(0, '-1.811')] [2022-07-13 17:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4842.3). Total num frames: 394226688. Throughput: 0: 9652.4. Samples: 788473364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:18,991][27935] Avg episode reward: [(0, '-0.216')] [2022-07-13 17:17:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 394251264. Throughput: 0: 9653.8. Samples: 788502732. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:23,991][27935] Avg episode reward: [(0, '0.379')] [2022-07-13 17:17:28,991][27935] Fps is (10 sec: 4914.4, 60 sec: 4829.7, 300 sec: 4838.8). Total num frames: 394275840. Throughput: 0: 9648.5. Samples: 788560696. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:28,991][27935] Avg episode reward: [(0, '0.043')] [2022-07-13 17:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 394300416. Throughput: 0: 9645.4. Samples: 788618824. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:33,990][27935] Avg episode reward: [(0, '0.029')] [2022-07-13 17:17:38,989][27935] Fps is (10 sec: 4711.2, 60 sec: 4795.7, 300 sec: 4838.8). Total num frames: 394322944. Throughput: 0: 9635.5. Samples: 788647788. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:38,989][27935] Avg episode reward: [(0, '0.143')] [2022-07-13 17:17:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 394348544. Throughput: 0: 9615.5. Samples: 788705416. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:43,989][27935] Avg episode reward: [(0, '0.209')] [2022-07-13 17:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4838.8). Total num frames: 394372096. Throughput: 0: 9715.0. Samples: 788764412. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:48,991][27935] Avg episode reward: [(0, '0.295')] [2022-07-13 17:17:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 394396672. Throughput: 0: 9727.4. Samples: 788794036. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:53,989][27935] Avg episode reward: [(0, '-0.026')] [2022-07-13 17:17:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4852.7). Total num frames: 394422272. Throughput: 0: 9724.3. Samples: 788852592. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:17:58,989][27935] Avg episode reward: [(0, '0.046')] [2022-07-13 17:18:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4842.3). Total num frames: 394443776. Throughput: 0: 9644.8. Samples: 788907380. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:03,989][27935] Avg episode reward: [(0, '-0.034')] [2022-07-13 17:18:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4845.8). Total num frames: 394468352. Throughput: 0: 9645.2. Samples: 788936764. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:08,990][27935] Avg episode reward: [(0, '0.116')] [2022-07-13 17:18:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 394492928. Throughput: 0: 9655.4. Samples: 788995172. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:13,989][27935] Avg episode reward: [(0, '-0.079')] [2022-07-13 17:18:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 394516480. Throughput: 0: 9662.1. Samples: 789053616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:18,989][27935] Avg episode reward: [(0, '-0.191')] [2022-07-13 17:18:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 394541056. Throughput: 0: 9670.5. Samples: 789082960. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:23,989][27935] Avg episode reward: [(0, '-0.598')] [2022-07-13 17:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4838.8). Total num frames: 394565632. Throughput: 0: 9694.8. Samples: 789141680. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:28,989][27935] Avg episode reward: [(0, '-0.827')] [2022-07-13 17:18:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4849.2). Total num frames: 394590208. Throughput: 0: 9032.0. Samples: 789170852. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:33,989][27935] Avg episode reward: [(0, '-0.331')] [2022-07-13 17:18:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4842.3). Total num frames: 394615808. Throughput: 0: 9681.1. Samples: 789229688. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:38,989][27935] Avg episode reward: [(0, '-0.420')] [2022-07-13 17:18:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4838.8). Total num frames: 394638336. Throughput: 0: 9683.7. Samples: 789288356. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:43,992][27935] Avg episode reward: [(0, '-0.139')] [2022-07-13 17:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 394664960. Throughput: 0: 9768.4. Samples: 789346956. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:48,993][27935] Avg episode reward: [(0, '-0.306')] [2022-07-13 17:18:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 394688512. Throughput: 0: 9770.8. Samples: 789376452. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:53,989][27935] Avg episode reward: [(0, '-0.230')] [2022-07-13 17:18:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4845.8). Total num frames: 394712064. Throughput: 0: 9784.3. Samples: 789435464. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:18:58,989][27935] Avg episode reward: [(0, '1.314')] [2022-07-13 17:19:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4842.3). Total num frames: 394734592. Throughput: 0: 9658.8. Samples: 789488264. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:19:03,989][27935] Avg episode reward: [(0, '1.556')] [2022-07-13 17:19:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 394759168. Throughput: 0: 9659.0. Samples: 789517616. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:19:08,989][27935] Avg episode reward: [(0, '1.281')] [2022-07-13 17:19:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4845.8). Total num frames: 394784768. Throughput: 0: 9678.5. Samples: 789577212. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:19:13,990][27935] Avg episode reward: [(0, '1.233')] [2022-07-13 17:19:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4881.1, 300 sec: 4845.8). Total num frames: 394809344. Throughput: 0: 10382.4. Samples: 789638060. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:19:18,989][27935] Avg episode reward: [(0, '1.185')] [2022-07-13 17:19:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4842.3). Total num frames: 394832896. Throughput: 0: 9720.0. Samples: 789667088. Policy #0 lag: (min: 0.0, avg: 8.9, max: 20.0) [2022-07-13 17:19:23,989][27935] Avg episode reward: [(0, '0.678')] [2022-07-13 17:19:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4838.8). Total num frames: 394856448. Throughput: 0: 9660.9. Samples: 789723096. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:28,990][27935] Avg episode reward: [(0, '0.726')] [2022-07-13 17:19:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4835.4). Total num frames: 394880000. Throughput: 0: 8982.0. Samples: 789751144. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:33,990][27935] Avg episode reward: [(0, '0.891')] [2022-07-13 17:19:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4835.4). Total num frames: 394904576. Throughput: 0: 9586.1. Samples: 789807828. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:38,989][27935] Avg episode reward: [(0, '0.734')] [2022-07-13 17:19:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4831.9). Total num frames: 394928128. Throughput: 0: 9551.3. Samples: 789865272. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:43,989][27935] Avg episode reward: [(0, '0.400')] [2022-07-13 17:19:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 394951680. Throughput: 0: 9657.9. Samples: 789922872. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:48,990][27935] Avg episode reward: [(0, '0.026')] [2022-07-13 17:19:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4828.4). Total num frames: 394975232. Throughput: 0: 9650.0. Samples: 789951864. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:53,991][27935] Avg episode reward: [(0, '0.249')] [2022-07-13 17:19:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4831.9). Total num frames: 394998784. Throughput: 0: 9598.2. Samples: 790009132. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:19:58,989][27935] Avg episode reward: [(0, '-0.075')] [2022-07-13 17:20:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4821.5). Total num frames: 395021312. Throughput: 0: 9429.6. Samples: 790062392. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:03,991][27935] Avg episode reward: [(0, '-0.625')] [2022-07-13 17:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4825.0). Total num frames: 395045888. Throughput: 0: 9423.2. Samples: 790091132. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:08,990][27935] Avg episode reward: [(0, '-2.066')] [2022-07-13 17:20:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4821.5). Total num frames: 395069440. Throughput: 0: 9449.5. Samples: 790148324. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:13,989][27935] Avg episode reward: [(0, '-2.578')] [2022-07-13 17:20:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4821.5). Total num frames: 395094016. Throughput: 0: 10118.3. Samples: 790206468. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:18,989][27935] Avg episode reward: [(0, '-2.659')] [2022-07-13 17:20:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4818.0). Total num frames: 395116544. Throughput: 0: 9491.2. Samples: 790234932. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:23,992][27935] Avg episode reward: [(0, '-2.971')] [2022-07-13 17:20:28,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4659.2, 300 sec: 4797.2). Total num frames: 395136000. Throughput: 0: 9321.5. Samples: 790284740. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:28,989][27935] Avg episode reward: [(0, '-2.359')] [2022-07-13 17:20:33,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4608.0, 300 sec: 4783.3). Total num frames: 395156480. Throughput: 0: 8589.3. Samples: 790309388. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:33,989][27935] Avg episode reward: [(0, '-2.632')] [2022-07-13 17:20:38,989][27935] Fps is (10 sec: 3993.6, 60 sec: 4522.7, 300 sec: 4769.4). Total num frames: 395175936. Throughput: 0: 8981.8. Samples: 790356044. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:38,989][27935] Avg episode reward: [(0, '-2.497')] [2022-07-13 17:20:43,989][27935] Fps is (10 sec: 3584.0, 60 sec: 4403.2, 300 sec: 4741.6). Total num frames: 395192320. Throughput: 0: 8636.6. Samples: 790397780. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:43,989][27935] Avg episode reward: [(0, '-2.027')] [2022-07-13 17:20:48,991][27935] Fps is (10 sec: 3788.0, 60 sec: 4368.9, 300 sec: 4731.2). Total num frames: 395213824. Throughput: 0: 8512.7. Samples: 790445484. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:48,992][27935] Avg episode reward: [(0, '-1.458')] [2022-07-13 17:20:53,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4334.9, 300 sec: 4724.3). Total num frames: 395235328. Throughput: 0: 8505.1. Samples: 790473864. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:53,989][27935] Avg episode reward: [(0, '-1.358')] [2022-07-13 17:20:58,989][27935] Fps is (10 sec: 4609.0, 60 sec: 4352.0, 300 sec: 4731.2). Total num frames: 395259904. Throughput: 0: 8512.9. Samples: 790531404. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:20:58,989][27935] Avg episode reward: [(0, '-0.693')] [2022-07-13 17:21:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4334.9, 300 sec: 4720.9). Total num frames: 395281408. Throughput: 0: 8383.2. Samples: 790583712. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:03,989][27935] Avg episode reward: [(0, '-0.982')] [2022-07-13 17:21:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4352.0, 300 sec: 4727.8). Total num frames: 395307008. Throughput: 0: 8387.0. Samples: 790612348. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:08,989][27935] Avg episode reward: [(0, '-2.127')] [2022-07-13 17:21:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4369.1, 300 sec: 4724.3). Total num frames: 395331584. Throughput: 0: 8561.4. Samples: 790670004. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:13,989][27935] Avg episode reward: [(0, '-1.649')] [2022-07-13 17:21:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4317.9, 300 sec: 4717.3). Total num frames: 395353088. Throughput: 0: 9276.0. Samples: 790726808. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:18,989][27935] Avg episode reward: [(0, '-1.846')] [2022-07-13 17:21:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4334.9, 300 sec: 4713.9). Total num frames: 395376640. Throughput: 0: 8866.3. Samples: 790755028. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:23,997][27935] Avg episode reward: [(0, '-1.432')] [2022-07-13 17:21:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4403.2, 300 sec: 4717.3). Total num frames: 395400192. Throughput: 0: 9165.7. Samples: 790810236. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:28,989][27935] Avg episode reward: [(0, '-1.710')] [2022-07-13 17:21:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4420.3, 300 sec: 4700.0). Total num frames: 395421696. Throughput: 0: 9362.5. Samples: 790866776. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:33,989][27935] Avg episode reward: [(0, '-1.481')] [2022-07-13 17:21:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4539.7, 300 sec: 4713.9). Total num frames: 395448320. Throughput: 0: 9370.5. Samples: 790895536. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:38,989][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 17:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4703.5). Total num frames: 395470848. Throughput: 0: 9350.1. Samples: 790952160. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:43,989][27935] Avg episode reward: [(0, '0.030')] [2022-07-13 17:21:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.5, 300 sec: 4706.9). Total num frames: 395495424. Throughput: 0: 9465.7. Samples: 791009668. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:48,989][27935] Avg episode reward: [(0, '0.203')] [2022-07-13 17:21:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 395518976. Throughput: 0: 9451.0. Samples: 791037644. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:53,989][27935] Avg episode reward: [(0, '-0.527')] [2022-07-13 17:21:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4696.5). Total num frames: 395539456. Throughput: 0: 9395.9. Samples: 791092820. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:21:58,989][27935] Avg episode reward: [(0, '-1.116')] [2022-07-13 17:22:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 395563008. Throughput: 0: 9283.3. Samples: 791144556. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 17:22:03,989][27935] Avg episode reward: [(0, '-0.102')] [2022-07-13 17:22:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4693.0). Total num frames: 395586560. Throughput: 0: 9284.5. Samples: 791172832. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:08,989][27935] Avg episode reward: [(0, '-0.359')] [2022-07-13 17:22:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4686.1). Total num frames: 395609088. Throughput: 0: 9289.9. Samples: 791228280. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:13,989][27935] Avg episode reward: [(0, '-0.126')] [2022-07-13 17:22:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4679.2). Total num frames: 395631616. Throughput: 0: 9277.0. Samples: 791284240. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:18,989][27935] Avg episode reward: [(0, '-0.970')] [2022-07-13 17:22:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4679.2). Total num frames: 395656192. Throughput: 0: 9250.4. Samples: 791311804. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:23,990][27935] Avg episode reward: [(0, '-0.963')] [2022-07-13 17:22:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4672.2). Total num frames: 395678720. Throughput: 0: 9242.7. Samples: 791368080. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:28,989][27935] Avg episode reward: [(0, '0.058')] [2022-07-13 17:22:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4675.7). Total num frames: 395702272. Throughput: 0: 9205.3. Samples: 791423904. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:33,989][27935] Avg episode reward: [(0, '1.015')] [2022-07-13 17:22:38,991][27935] Fps is (10 sec: 4504.5, 60 sec: 4590.8, 300 sec: 4661.8). Total num frames: 395723776. Throughput: 0: 9194.7. Samples: 791451428. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:38,992][27935] Avg episode reward: [(0, '0.830')] [2022-07-13 17:22:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4665.3). Total num frames: 395748352. Throughput: 0: 9187.8. Samples: 791506272. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:43,989][27935] Avg episode reward: [(0, '1.120')] [2022-07-13 17:22:48,989][27935] Fps is (10 sec: 4711.5, 60 sec: 4590.9, 300 sec: 4658.3). Total num frames: 395770880. Throughput: 0: 9278.0. Samples: 791562068. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:48,989][27935] Avg episode reward: [(0, '0.793')] [2022-07-13 17:22:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4651.4). Total num frames: 395794432. Throughput: 0: 9268.6. Samples: 791589920. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:53,989][27935] Avg episode reward: [(0, '1.253')] [2022-07-13 17:22:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4658.3). Total num frames: 395817984. Throughput: 0: 9274.1. Samples: 791645616. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:22:58,989][27935] Avg episode reward: [(0, '1.535')] [2022-07-13 17:23:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4647.9). Total num frames: 395839488. Throughput: 0: 9192.4. Samples: 791697900. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:03,989][27935] Avg episode reward: [(0, '0.895')] [2022-07-13 17:23:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4647.9). Total num frames: 395864064. Throughput: 0: 9202.2. Samples: 791725904. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:08,989][27935] Avg episode reward: [(0, '0.822')] [2022-07-13 17:23:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 395885568. Throughput: 0: 9204.0. Samples: 791782260. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:13,990][27935] Avg episode reward: [(0, '0.953')] [2022-07-13 17:23:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 395909120. Throughput: 0: 9222.6. Samples: 791838920. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:18,989][27935] Avg episode reward: [(0, '0.604')] [2022-07-13 17:23:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 395934720. Throughput: 0: 9248.9. Samples: 791867604. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:23,989][27935] Avg episode reward: [(0, '0.686')] [2022-07-13 17:23:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 395958272. Throughput: 0: 9309.3. Samples: 791925192. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:28,989][27935] Avg episode reward: [(0, '0.844')] [2022-07-13 17:23:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4630.6). Total num frames: 395981824. Throughput: 0: 9333.3. Samples: 791982064. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:33,989][27935] Avg episode reward: [(0, '0.191')] [2022-07-13 17:23:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.5, 300 sec: 4634.0). Total num frames: 396005376. Throughput: 0: 9361.0. Samples: 792011164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:38,989][27935] Avg episode reward: [(0, '0.231')] [2022-07-13 17:23:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4623.6). Total num frames: 396028928. Throughput: 0: 9394.8. Samples: 792068380. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:43,989][27935] Avg episode reward: [(0, '-0.126')] [2022-07-13 17:23:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4623.6). Total num frames: 396052480. Throughput: 0: 9490.6. Samples: 792124976. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:48,989][27935] Avg episode reward: [(0, '-0.149')] [2022-07-13 17:23:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4623.6). Total num frames: 396076032. Throughput: 0: 9507.8. Samples: 792153756. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:53,989][27935] Avg episode reward: [(0, '-0.116')] [2022-07-13 17:23:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4634.0). Total num frames: 396101632. Throughput: 0: 9541.8. Samples: 792211640. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:23:58,989][27935] Avg episode reward: [(0, '-0.205')] [2022-07-13 17:24:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4620.1). Total num frames: 396122112. Throughput: 0: 9458.9. Samples: 792264572. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:03,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 17:24:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4616.7). Total num frames: 396146688. Throughput: 0: 9441.5. Samples: 792292472. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:08,990][27935] Avg episode reward: [(0, '-0.224')] [2022-07-13 17:24:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4609.7). Total num frames: 396169216. Throughput: 0: 9414.8. Samples: 792348860. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:13,989][27935] Avg episode reward: [(0, '0.445')] [2022-07-13 17:24:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4606.3). Total num frames: 396191744. Throughput: 0: 8768.2. Samples: 792376632. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:18,989][27935] Avg episode reward: [(0, '-0.145')] [2022-07-13 17:24:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4606.3). Total num frames: 396215296. Throughput: 0: 9353.2. Samples: 792432060. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:23,989][27935] Avg episode reward: [(0, '-0.782')] [2022-07-13 17:24:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4602.8). Total num frames: 396237824. Throughput: 0: 9307.2. Samples: 792487204. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:28,989][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 17:24:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4599.3). Total num frames: 396261376. Throughput: 0: 9276.4. Samples: 792542416. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:33,989][27935] Avg episode reward: [(0, '-0.571')] [2022-07-13 17:24:39,000][27935] Fps is (10 sec: 4705.0, 60 sec: 4658.3, 300 sec: 4599.1). Total num frames: 396284928. Throughput: 0: 9255.5. Samples: 792570360. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 17:24:39,001][27935] Avg episode reward: [(0, '-0.336')] [2022-07-13 17:24:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4595.9). Total num frames: 396307456. Throughput: 0: 9207.9. Samples: 792625996. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:24:43,989][27935] Avg episode reward: [(0, '-0.232')] [2022-07-13 17:24:48,989][27935] Fps is (10 sec: 4613.3, 60 sec: 4642.1, 300 sec: 4595.9). Total num frames: 396331008. Throughput: 0: 9259.6. Samples: 792681256. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:24:48,990][27935] Avg episode reward: [(0, '-0.569')] [2022-07-13 17:24:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4592.4). Total num frames: 396353536. Throughput: 0: 9255.7. Samples: 792708980. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:24:53,989][27935] Avg episode reward: [(0, '-0.613')] [2022-07-13 17:24:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4595.9). Total num frames: 396377088. Throughput: 0: 9237.4. Samples: 792764544. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:24:58,989][27935] Avg episode reward: [(0, '0.289')] [2022-07-13 17:25:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4585.4). Total num frames: 396398592. Throughput: 0: 9773.1. Samples: 792816420. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:03,989][27935] Avg episode reward: [(0, '0.654')] [2022-07-13 17:25:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4573.9, 300 sec: 4582.0). Total num frames: 396421120. Throughput: 0: 9139.5. Samples: 792843336. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:08,989][27935] Avg episode reward: [(0, '0.614')] [2022-07-13 17:25:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4578.5). Total num frames: 396444672. Throughput: 0: 9147.0. Samples: 792898820. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:13,989][27935] Avg episode reward: [(0, '0.389')] [2022-07-13 17:25:18,996][27935] Fps is (10 sec: 4706.8, 60 sec: 4607.4, 300 sec: 4581.8). Total num frames: 396468224. Throughput: 0: 9153.6. Samples: 792954396. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:18,997][27935] Avg episode reward: [(0, '0.536')] [2022-07-13 17:25:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4592.4). Total num frames: 396490752. Throughput: 0: 9161.4. Samples: 792982516. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:23,989][27935] Avg episode reward: [(0, '-0.512')] [2022-07-13 17:25:28,989][27935] Fps is (10 sec: 4509.0, 60 sec: 4590.9, 300 sec: 4599.3). Total num frames: 396513280. Throughput: 0: 9154.4. Samples: 793037944. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:28,989][27935] Avg episode reward: [(0, '-0.742')] [2022-07-13 17:25:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 396537856. Throughput: 0: 9163.7. Samples: 793093624. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:33,989][27935] Avg episode reward: [(0, '-0.338')] [2022-07-13 17:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4591.8, 300 sec: 4637.5). Total num frames: 396560384. Throughput: 0: 9173.2. Samples: 793121772. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:38,989][27935] Avg episode reward: [(0, '-0.351')] [2022-07-13 17:25:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4641.0). Total num frames: 396582912. Throughput: 0: 9177.5. Samples: 793177532. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:43,989][27935] Avg episode reward: [(0, '-0.917')] [2022-07-13 17:25:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4654.9). Total num frames: 396608512. Throughput: 0: 9258.3. Samples: 793233044. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:48,989][27935] Avg episode reward: [(0, '-1.061')] [2022-07-13 17:25:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4644.4). Total num frames: 396630016. Throughput: 0: 9282.7. Samples: 793261056. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:53,989][27935] Avg episode reward: [(0, '-1.827')] [2022-07-13 17:25:58,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 4647.9). Total num frames: 396652544. Throughput: 0: 9291.9. Samples: 793316956. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:25:58,989][27935] Avg episode reward: [(0, '-0.805')] [2022-07-13 17:26:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4637.5). Total num frames: 396675072. Throughput: 0: 9216.0. Samples: 793369044. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:03,989][27935] Avg episode reward: [(0, '-1.249')] [2022-07-13 17:26:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 396697600. Throughput: 0: 9212.4. Samples: 793397076. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:08,989][27935] Avg episode reward: [(0, '-1.757')] [2022-07-13 17:26:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4637.5). Total num frames: 396721152. Throughput: 0: 9217.3. Samples: 793452724. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:13,989][27935] Avg episode reward: [(0, '-2.216')] [2022-07-13 17:26:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.6, 300 sec: 4637.5). Total num frames: 396744704. Throughput: 0: 9210.7. Samples: 793508108. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:18,991][27935] Avg episode reward: [(0, '-2.903')] [2022-07-13 17:26:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4634.0). Total num frames: 396767232. Throughput: 0: 9209.5. Samples: 793536200. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:23,989][27935] Avg episode reward: [(0, '-3.144')] [2022-07-13 17:26:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4641.0). Total num frames: 396790784. Throughput: 0: 9202.8. Samples: 793591656. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:28,990][27935] Avg episode reward: [(0, '-2.064')] [2022-07-13 17:26:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4627.1). Total num frames: 396813312. Throughput: 0: 9190.5. Samples: 793646616. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:33,990][27935] Avg episode reward: [(0, '-1.888')] [2022-07-13 17:26:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 396836864. Throughput: 0: 9186.8. Samples: 793674464. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:38,989][27935] Avg episode reward: [(0, '-1.350')] [2022-07-13 17:26:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 396859392. Throughput: 0: 9192.8. Samples: 793730632. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:43,990][27935] Avg episode reward: [(0, '-1.389')] [2022-07-13 17:26:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4623.6). Total num frames: 396882944. Throughput: 0: 9266.2. Samples: 793786024. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:48,990][27935] Avg episode reward: [(0, '-0.533')] [2022-07-13 17:26:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4634.0). Total num frames: 396906496. Throughput: 0: 9264.0. Samples: 793813956. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:53,989][27935] Avg episode reward: [(0, '0.081')] [2022-07-13 17:26:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 396929024. Throughput: 0: 9262.9. Samples: 793869556. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:26:58,989][27935] Avg episode reward: [(0, '-0.170')] [2022-07-13 17:27:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4627.1). Total num frames: 396951552. Throughput: 0: 9182.3. Samples: 793921312. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:27:03,989][27935] Avg episode reward: [(0, '-0.155')] [2022-07-13 17:27:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4627.1). Total num frames: 396974080. Throughput: 0: 9176.4. Samples: 793949136. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:27:08,989][27935] Avg episode reward: [(0, '-0.027')] [2022-07-13 17:27:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4627.1). Total num frames: 396996608. Throughput: 0: 9188.8. Samples: 794005152. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:27:13,989][27935] Avg episode reward: [(0, '-0.093')] [2022-07-13 17:27:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 397022208. Throughput: 0: 9201.8. Samples: 794060696. Policy #0 lag: (min: 0.0, avg: 9.1, max: 18.0) [2022-07-13 17:27:18,989][27935] Avg episode reward: [(0, '0.433')] [2022-07-13 17:27:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 397044736. Throughput: 0: 9215.5. Samples: 794089160. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:23,989][27935] Avg episode reward: [(0, '0.748')] [2022-07-13 17:27:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4627.1). Total num frames: 397067264. Throughput: 0: 9202.2. Samples: 794144732. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:28,989][27935] Avg episode reward: [(0, '1.195')] [2022-07-13 17:27:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 397089792. Throughput: 0: 9214.8. Samples: 794200688. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:33,989][27935] Avg episode reward: [(0, '1.834')] [2022-07-13 17:27:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 397114368. Throughput: 0: 9213.6. Samples: 794228568. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:38,989][27935] Avg episode reward: [(0, '1.607')] [2022-07-13 17:27:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 397136896. Throughput: 0: 9209.8. Samples: 794283996. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:43,989][27935] Avg episode reward: [(0, '1.534')] [2022-07-13 17:27:48,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 397160448. Throughput: 0: 9278.6. Samples: 794338848. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:48,990][27935] Avg episode reward: [(0, '1.583')] [2022-07-13 17:27:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4623.6). Total num frames: 397181952. Throughput: 0: 9264.9. Samples: 794366056. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:53,989][27935] Avg episode reward: [(0, '1.371')] [2022-07-13 17:27:58,992][27935] Fps is (10 sec: 4504.1, 60 sec: 4607.7, 300 sec: 4630.5). Total num frames: 397205504. Throughput: 0: 9255.5. Samples: 794421680. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:27:58,993][27935] Avg episode reward: [(0, '0.713')] [2022-07-13 17:28:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4620.1). Total num frames: 397227008. Throughput: 0: 9165.7. Samples: 794473152. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:03,989][27935] Avg episode reward: [(0, '0.423')] [2022-07-13 17:28:08,989][27935] Fps is (10 sec: 4404.7, 60 sec: 4590.9, 300 sec: 4623.6). Total num frames: 397249536. Throughput: 0: 9143.5. Samples: 794500616. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:08,989][27935] Avg episode reward: [(0, '0.540')] [2022-07-13 17:28:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 397273088. Throughput: 0: 9153.7. Samples: 794556648. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:13,989][27935] Avg episode reward: [(0, '0.561')] [2022-07-13 17:28:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4556.8, 300 sec: 4613.2). Total num frames: 397295616. Throughput: 0: 9141.6. Samples: 794612060. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:18,989][27935] Avg episode reward: [(0, '0.467')] [2022-07-13 17:28:23,991][27935] Fps is (10 sec: 4504.6, 60 sec: 4556.6, 300 sec: 4609.7). Total num frames: 397318144. Throughput: 0: 9139.8. Samples: 794639880. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:23,992][27935] Avg episode reward: [(0, '0.222')] [2022-07-13 17:28:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 397343744. Throughput: 0: 9157.1. Samples: 794696064. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:28,989][27935] Avg episode reward: [(0, '-0.406')] [2022-07-13 17:28:33,989][27935] Fps is (10 sec: 4916.3, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 397367296. Throughput: 0: 9170.0. Samples: 794751496. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:33,989][27935] Avg episode reward: [(0, '0.279')] [2022-07-13 17:28:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4609.7). Total num frames: 397388800. Throughput: 0: 9188.7. Samples: 794779548. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:38,989][27935] Avg episode reward: [(0, '0.475')] [2022-07-13 17:28:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 397413376. Throughput: 0: 9196.6. Samples: 794835496. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:43,989][27935] Avg episode reward: [(0, '0.126')] [2022-07-13 17:28:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4609.7). Total num frames: 397435904. Throughput: 0: 9285.8. Samples: 794891012. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:48,989][27935] Avg episode reward: [(0, '-0.486')] [2022-07-13 17:28:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4599.3). Total num frames: 397458432. Throughput: 0: 9288.6. Samples: 794918604. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:53,989][27935] Avg episode reward: [(0, '-0.259')] [2022-07-13 17:28:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.3, 300 sec: 4609.7). Total num frames: 397481984. Throughput: 0: 9277.5. Samples: 794974136. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:28:58,989][27935] Avg episode reward: [(0, '-0.476')] [2022-07-13 17:29:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4599.3). Total num frames: 397503488. Throughput: 0: 9202.1. Samples: 795026156. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:03,989][27935] Avg episode reward: [(0, '-0.391')] [2022-07-13 17:29:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4602.8). Total num frames: 397527040. Throughput: 0: 9201.1. Samples: 795053908. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:08,989][27935] Avg episode reward: [(0, '-0.544')] [2022-07-13 17:29:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4602.8). Total num frames: 397549568. Throughput: 0: 9194.2. Samples: 795109804. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:13,989][27935] Avg episode reward: [(0, '-0.880')] [2022-07-13 17:29:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4599.3). Total num frames: 397572096. Throughput: 0: 9213.9. Samples: 795166120. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:18,990][27935] Avg episode reward: [(0, '-0.702')] [2022-07-13 17:29:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.3, 300 sec: 4606.3). Total num frames: 397596672. Throughput: 0: 9215.2. Samples: 795194232. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:23,989][27935] Avg episode reward: [(0, '-0.059')] [2022-07-13 17:29:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4602.8). Total num frames: 397619200. Throughput: 0: 9213.6. Samples: 795250108. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:28,990][27935] Avg episode reward: [(0, '0.004')] [2022-07-13 17:29:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4606.4). Total num frames: 397643776. Throughput: 0: 8597.3. Samples: 795277888. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:33,989][27935] Avg episode reward: [(0, '-0.284')] [2022-07-13 17:29:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4609.7). Total num frames: 397667328. Throughput: 0: 9219.1. Samples: 795333464. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:38,989][27935] Avg episode reward: [(0, '0.166')] [2022-07-13 17:29:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4606.3). Total num frames: 397689856. Throughput: 0: 9230.0. Samples: 795389488. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:43,989][27935] Avg episode reward: [(0, '-0.739')] [2022-07-13 17:29:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4609.7). Total num frames: 397713408. Throughput: 0: 9316.6. Samples: 795445404. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:48,989][27935] Avg episode reward: [(0, '-0.948')] [2022-07-13 17:29:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4606.3). Total num frames: 397735936. Throughput: 0: 9326.1. Samples: 795473584. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:53,989][27935] Avg episode reward: [(0, '-0.702')] [2022-07-13 17:29:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 397758464. Throughput: 0: 9321.4. Samples: 795529268. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:29:58,989][27935] Avg episode reward: [(0, '-0.731')] [2022-07-13 17:30:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4609.7). Total num frames: 397780992. Throughput: 0: 9235.0. Samples: 795581696. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:03,989][27935] Avg episode reward: [(0, '-1.531')] [2022-07-13 17:30:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4613.2). Total num frames: 397805568. Throughput: 0: 9229.0. Samples: 795609536. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:08,989][27935] Avg episode reward: [(0, '-2.674')] [2022-07-13 17:30:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4606.4). Total num frames: 397827072. Throughput: 0: 9225.8. Samples: 795665268. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:13,989][27935] Avg episode reward: [(0, '-2.285')] [2022-07-13 17:30:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4606.3). Total num frames: 397849600. Throughput: 0: 9840.5. Samples: 795720712. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:18,990][27935] Avg episode reward: [(0, '-1.486')] [2022-07-13 17:30:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 397873152. Throughput: 0: 9227.4. Samples: 795748696. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:23,990][27935] Avg episode reward: [(0, '-1.178')] [2022-07-13 17:30:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4606.3). Total num frames: 397896704. Throughput: 0: 9219.8. Samples: 795804380. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:28,989][27935] Avg episode reward: [(0, '-1.200')] [2022-07-13 17:30:33,999][27935] Fps is (10 sec: 4603.3, 60 sec: 4590.1, 300 sec: 4606.1). Total num frames: 397919232. Throughput: 0: 9205.0. Samples: 795859724. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:34,000][27935] Avg episode reward: [(0, '-1.455')] [2022-07-13 17:30:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 397943808. Throughput: 0: 9199.6. Samples: 795887568. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:38,989][27935] Avg episode reward: [(0, '-1.531')] [2022-07-13 17:30:43,989][27935] Fps is (10 sec: 4817.7, 60 sec: 4625.1, 300 sec: 4606.3). Total num frames: 397967360. Throughput: 0: 9217.9. Samples: 795944072. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:43,990][27935] Avg episode reward: [(0, '-0.772')] [2022-07-13 17:30:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 397990912. Throughput: 0: 9283.6. Samples: 795999456. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:48,989][27935] Avg episode reward: [(0, '-0.074')] [2022-07-13 17:30:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 398013440. Throughput: 0: 9286.4. Samples: 796027424. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:53,989][27935] Avg episode reward: [(0, '0.104')] [2022-07-13 17:30:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 398035968. Throughput: 0: 9281.5. Samples: 796082936. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:30:58,989][27935] Avg episode reward: [(0, '-0.378')] [2022-07-13 17:31:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 398058496. Throughput: 0: 9209.6. Samples: 796135144. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:03,989][27935] Avg episode reward: [(0, '-0.220')] [2022-07-13 17:31:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4609.7). Total num frames: 398081024. Throughput: 0: 9201.6. Samples: 796162768. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:08,990][27935] Avg episode reward: [(0, '0.564')] [2022-07-13 17:31:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 4602.8). Total num frames: 398102528. Throughput: 0: 9182.9. Samples: 796217612. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:13,990][27935] Avg episode reward: [(0, '0.305')] [2022-07-13 17:31:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4606.3). Total num frames: 398126080. Throughput: 0: 9199.7. Samples: 796273616. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:18,989][27935] Avg episode reward: [(0, '0.066')] [2022-07-13 17:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4609.7). Total num frames: 398150656. Throughput: 0: 9196.3. Samples: 796301400. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:23,989][27935] Avg episode reward: [(0, '0.152')] [2022-07-13 17:31:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 398173184. Throughput: 0: 9181.2. Samples: 796357228. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:28,989][27935] Avg episode reward: [(0, '-0.833')] [2022-07-13 17:31:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.9, 300 sec: 4613.2). Total num frames: 398197760. Throughput: 0: 9190.7. Samples: 796413036. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:33,989][27935] Avg episode reward: [(0, '-0.874')] [2022-07-13 17:31:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4609.7). Total num frames: 398219264. Throughput: 0: 9189.0. Samples: 796440928. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:38,989][27935] Avg episode reward: [(0, '-2.621')] [2022-07-13 17:31:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 398243840. Throughput: 0: 9196.5. Samples: 796496780. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:43,989][27935] Avg episode reward: [(0, '-3.169')] [2022-07-13 17:31:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4609.7). Total num frames: 398266368. Throughput: 0: 9269.4. Samples: 796552268. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:48,989][27935] Avg episode reward: [(0, '-3.193')] [2022-07-13 17:31:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 398289920. Throughput: 0: 9271.1. Samples: 796579968. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:53,989][27935] Avg episode reward: [(0, '-3.008')] [2022-07-13 17:31:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 398313472. Throughput: 0: 9286.4. Samples: 796635500. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:31:58,989][27935] Avg episode reward: [(0, '-3.260')] [2022-07-13 17:32:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 398334976. Throughput: 0: 9206.5. Samples: 796687908. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:03,989][27935] Avg episode reward: [(0, '-2.544')] [2022-07-13 17:32:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 398357504. Throughput: 0: 9210.5. Samples: 796715872. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:08,989][27935] Avg episode reward: [(0, '-2.844')] [2022-07-13 17:32:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4606.3). Total num frames: 398381056. Throughput: 0: 9219.1. Samples: 796772088. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:13,989][27935] Avg episode reward: [(0, '-0.999')] [2022-07-13 17:32:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4609.7). Total num frames: 398404608. Throughput: 0: 9224.7. Samples: 796828148. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:18,989][27935] Avg episode reward: [(0, '0.108')] [2022-07-13 17:32:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 398427136. Throughput: 0: 9230.0. Samples: 796856276. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:23,989][27935] Avg episode reward: [(0, '0.051')] [2022-07-13 17:32:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 398450688. Throughput: 0: 9234.6. Samples: 796912336. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:28,989][27935] Avg episode reward: [(0, '0.307')] [2022-07-13 17:32:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 398474240. Throughput: 0: 9236.4. Samples: 796967904. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:32:33,989][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 17:32:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4613.2). Total num frames: 398497792. Throughput: 0: 9242.3. Samples: 796995872. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:32:38,989][27935] Avg episode reward: [(0, '0.705')] [2022-07-13 17:32:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4609.7). Total num frames: 398520320. Throughput: 0: 9239.1. Samples: 797051260. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:32:43,989][27935] Avg episode reward: [(0, '0.671')] [2022-07-13 17:32:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 398543872. Throughput: 0: 9313.9. Samples: 797107032. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:32:48,989][27935] Avg episode reward: [(0, '0.015')] [2022-07-13 17:32:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 398567424. Throughput: 0: 9306.7. Samples: 797134672. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:32:53,989][27935] Avg episode reward: [(0, '-0.076')] [2022-07-13 17:32:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 398590976. Throughput: 0: 9300.2. Samples: 797190596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:32:58,989][27935] Avg episode reward: [(0, '-0.013')] [2022-07-13 17:33:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 398611456. Throughput: 0: 8667.8. Samples: 797218200. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:03,989][27935] Avg episode reward: [(0, '-0.276')] [2022-07-13 17:33:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 398633984. Throughput: 0: 9203.6. Samples: 797270436. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:08,989][27935] Avg episode reward: [(0, '-0.140')] [2022-07-13 17:33:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 398658560. Throughput: 0: 9206.4. Samples: 797326624. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:13,989][27935] Avg episode reward: [(0, '0.342')] [2022-07-13 17:33:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4616.7). Total num frames: 398680064. Throughput: 0: 9207.5. Samples: 797382244. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:18,989][27935] Avg episode reward: [(0, '0.548')] [2022-07-13 17:33:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4616.7). Total num frames: 398705664. Throughput: 0: 9212.4. Samples: 797410428. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:23,989][27935] Avg episode reward: [(0, '0.278')] [2022-07-13 17:33:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 398728192. Throughput: 0: 9223.7. Samples: 797466328. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:28,989][27935] Avg episode reward: [(0, '-0.110')] [2022-07-13 17:33:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 398750720. Throughput: 0: 9234.7. Samples: 797522596. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:33,989][27935] Avg episode reward: [(0, '-0.135')] [2022-07-13 17:33:38,992][27935] Fps is (10 sec: 4811.3, 60 sec: 4641.9, 300 sec: 4620.1). Total num frames: 398776320. Throughput: 0: 9239.6. Samples: 797550484. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:38,993][27935] Avg episode reward: [(0, '-0.033')] [2022-07-13 17:33:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 398797824. Throughput: 0: 9245.6. Samples: 797606648. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:43,989][27935] Avg episode reward: [(0, '-0.029')] [2022-07-13 17:33:48,989][27935] Fps is (10 sec: 4507.0, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 398821376. Throughput: 0: 9872.4. Samples: 797662460. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:48,989][27935] Avg episode reward: [(0, '0.548')] [2022-07-13 17:33:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 398844928. Throughput: 0: 9334.6. Samples: 797690492. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:53,989][27935] Avg episode reward: [(0, '-0.066')] [2022-07-13 17:33:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 398867456. Throughput: 0: 9323.3. Samples: 797746172. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:33:58,989][27935] Avg episode reward: [(0, '0.953')] [2022-07-13 17:34:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 398889984. Throughput: 0: 9253.8. Samples: 797798664. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:03,989][27935] Avg episode reward: [(0, '0.985')] [2022-07-13 17:34:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4620.2). Total num frames: 398912512. Throughput: 0: 9247.4. Samples: 797826560. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:08,989][27935] Avg episode reward: [(0, '1.045')] [2022-07-13 17:34:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 398936064. Throughput: 0: 9247.5. Samples: 797882464. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:13,989][27935] Avg episode reward: [(0, '0.990')] [2022-07-13 17:34:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4623.6). Total num frames: 398960640. Throughput: 0: 9237.2. Samples: 797938268. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:18,989][27935] Avg episode reward: [(0, '0.806')] [2022-07-13 17:34:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 398982144. Throughput: 0: 9239.3. Samples: 797966224. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:23,989][27935] Avg episode reward: [(0, '-0.005')] [2022-07-13 17:34:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 399005696. Throughput: 0: 9233.5. Samples: 798022156. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:28,990][27935] Avg episode reward: [(0, '0.438')] [2022-07-13 17:34:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4620.1). Total num frames: 399030272. Throughput: 0: 9234.4. Samples: 798078008. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:33,989][27935] Avg episode reward: [(0, '0.013')] [2022-07-13 17:34:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4591.2, 300 sec: 4616.7). Total num frames: 399051776. Throughput: 0: 9229.8. Samples: 798105832. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:38,989][27935] Avg episode reward: [(0, '0.046')] [2022-07-13 17:34:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 399076352. Throughput: 0: 9243.4. Samples: 798162124. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:43,989][27935] Avg episode reward: [(0, '0.178')] [2022-07-13 17:34:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 399099904. Throughput: 0: 9314.8. Samples: 798217828. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:48,989][27935] Avg episode reward: [(0, '0.208')] [2022-07-13 17:34:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 399121408. Throughput: 0: 9308.2. Samples: 798245428. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:53,989][27935] Avg episode reward: [(0, '0.027')] [2022-07-13 17:34:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 399144960. Throughput: 0: 9314.7. Samples: 798301628. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:34:58,991][27935] Avg episode reward: [(0, '0.043')] [2022-07-13 17:35:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 399166464. Throughput: 0: 9237.2. Samples: 798353940. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:35:03,989][27935] Avg episode reward: [(0, '0.623')] [2022-07-13 17:35:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 399191040. Throughput: 0: 9229.6. Samples: 798381556. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:35:08,989][27935] Avg episode reward: [(0, '0.491')] [2022-07-13 17:35:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 399213568. Throughput: 0: 9228.9. Samples: 798437456. Policy #0 lag: (min: 0.0, avg: 10.1, max: 21.0) [2022-07-13 17:35:13,989][27935] Avg episode reward: [(0, '0.583')] [2022-07-13 17:35:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 399237120. Throughput: 0: 9231.3. Samples: 798493416. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:18,990][27935] Avg episode reward: [(0, '-0.336')] [2022-07-13 17:35:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 399260672. Throughput: 0: 9240.9. Samples: 798521672. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:23,989][27935] Avg episode reward: [(0, '-0.569')] [2022-07-13 17:35:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4623.8). Total num frames: 399283200. Throughput: 0: 9227.1. Samples: 798577344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:28,989][27935] Avg episode reward: [(0, '-1.767')] [2022-07-13 17:35:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4616.7). Total num frames: 399305728. Throughput: 0: 9220.9. Samples: 798632768. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:33,989][27935] Avg episode reward: [(0, '-1.759')] [2022-07-13 17:35:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 399329280. Throughput: 0: 9228.3. Samples: 798660700. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:38,996][27935] Avg episode reward: [(0, '-2.616')] [2022-07-13 17:35:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399353856. Throughput: 0: 9214.2. Samples: 798716268. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:43,989][27935] Avg episode reward: [(0, '-3.774')] [2022-07-13 17:35:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4616.7). Total num frames: 399375360. Throughput: 0: 9290.4. Samples: 798772008. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:48,989][27935] Avg episode reward: [(0, '-3.165')] [2022-07-13 17:35:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399398912. Throughput: 0: 9288.8. Samples: 798799552. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:53,989][27935] Avg episode reward: [(0, '-3.178')] [2022-07-13 17:35:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 399421440. Throughput: 0: 9281.3. Samples: 798855116. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:35:58,989][27935] Avg episode reward: [(0, '-2.631')] [2022-07-13 17:36:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 399442944. Throughput: 0: 8657.3. Samples: 798882992. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:03,990][27935] Avg episode reward: [(0, '-1.840')] [2022-07-13 17:36:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4623.6). Total num frames: 399466496. Throughput: 0: 9185.4. Samples: 798935016. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:08,990][27935] Avg episode reward: [(0, '-1.769')] [2022-07-13 17:36:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 399490048. Throughput: 0: 9180.4. Samples: 798990464. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:13,989][27935] Avg episode reward: [(0, '-2.307')] [2022-07-13 17:36:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 399513600. Throughput: 0: 9179.8. Samples: 799045860. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:18,989][27935] Avg episode reward: [(0, '-1.986')] [2022-07-13 17:36:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 399537152. Throughput: 0: 9178.8. Samples: 799073744. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:23,989][27935] Avg episode reward: [(0, '-1.420')] [2022-07-13 17:36:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4613.2). Total num frames: 399558656. Throughput: 0: 9170.2. Samples: 799128928. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:28,990][27935] Avg episode reward: [(0, '-1.752')] [2022-07-13 17:36:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 399583232. Throughput: 0: 9169.2. Samples: 799184620. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:33,989][27935] Avg episode reward: [(0, '-2.172')] [2022-07-13 17:36:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 399605760. Throughput: 0: 9176.8. Samples: 799212508. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:38,989][27935] Avg episode reward: [(0, '-1.224')] [2022-07-13 17:36:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4616.7). Total num frames: 399628288. Throughput: 0: 9188.7. Samples: 799268608. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:43,989][27935] Avg episode reward: [(0, '-1.412')] [2022-07-13 17:36:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 399651840. Throughput: 0: 9817.1. Samples: 799324760. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:48,989][27935] Avg episode reward: [(0, '-1.388')] [2022-07-13 17:36:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399676416. Throughput: 0: 9280.3. Samples: 799352628. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:53,989][27935] Avg episode reward: [(0, '-1.092')] [2022-07-13 17:36:58,997][27935] Fps is (10 sec: 4809.0, 60 sec: 4641.5, 300 sec: 4627.0). Total num frames: 399699968. Throughput: 0: 9302.3. Samples: 799409140. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:36:58,997][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 17:37:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399720448. Throughput: 0: 9234.7. Samples: 799461420. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:03,989][27935] Avg episode reward: [(0, '-0.393')] [2022-07-13 17:37:08,989][27935] Fps is (10 sec: 4304.2, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 399742976. Throughput: 0: 9243.0. Samples: 799489680. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:08,990][27935] Avg episode reward: [(0, '-0.474')] [2022-07-13 17:37:13,993][27935] Fps is (10 sec: 4708.4, 60 sec: 4624.7, 300 sec: 4620.1). Total num frames: 399767552. Throughput: 0: 9238.1. Samples: 799544680. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:13,995][27935] Avg episode reward: [(0, '0.481')] [2022-07-13 17:37:18,995][27935] Fps is (10 sec: 4809.8, 60 sec: 4624.6, 300 sec: 4623.5). Total num frames: 399791104. Throughput: 0: 9220.3. Samples: 799599592. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:18,997][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 17:37:23,989][27935] Fps is (10 sec: 4610.0, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 399813632. Throughput: 0: 9234.1. Samples: 799628044. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:23,989][27935] Avg episode reward: [(0, '-1.155')] [2022-07-13 17:37:28,989][27935] Fps is (10 sec: 4610.9, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 399837184. Throughput: 0: 9229.4. Samples: 799683932. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:28,989][27935] Avg episode reward: [(0, '-1.128')] [2022-07-13 17:37:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399860736. Throughput: 0: 9219.0. Samples: 799739616. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:33,989][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 17:37:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 399883264. Throughput: 0: 9229.2. Samples: 799767940. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:38,989][27935] Avg episode reward: [(0, '-1.216')] [2022-07-13 17:37:43,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4613.2). Total num frames: 399904768. Throughput: 0: 9198.2. Samples: 799822988. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:43,989][27935] Avg episode reward: [(0, '-2.596')] [2022-07-13 17:37:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 399930368. Throughput: 0: 9271.6. Samples: 799878644. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:48,989][27935] Avg episode reward: [(0, '-3.646')] [2022-07-13 17:37:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 399952896. Throughput: 0: 9264.8. Samples: 799906596. Policy #0 lag: (min: 0.0, avg: 9.3, max: 19.0) [2022-07-13 17:37:53,989][27935] Avg episode reward: [(0, '-3.753')] [2022-07-13 17:37:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.6, 300 sec: 4627.1). Total num frames: 399976448. Throughput: 0: 9288.3. Samples: 799962612. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:37:58,989][27935] Avg episode reward: [(0, '-2.099')] [2022-07-13 17:38:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4620.1). Total num frames: 399996928. Throughput: 0: 9232.7. Samples: 800015008. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:03,989][27935] Avg episode reward: [(0, '-2.803')] [2022-07-13 17:38:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 400021504. Throughput: 0: 9225.2. Samples: 800043180. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:08,992][27935] Avg episode reward: [(0, '-2.775')] [2022-07-13 17:38:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.3, 300 sec: 4623.6). Total num frames: 400044032. Throughput: 0: 9223.3. Samples: 800098980. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:13,989][27935] Avg episode reward: [(0, '-2.447')] [2022-07-13 17:38:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.5, 300 sec: 4616.7). Total num frames: 400067584. Throughput: 0: 9241.1. Samples: 800155464. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:18,989][27935] Avg episode reward: [(0, '-1.372')] [2022-07-13 17:38:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 400091136. Throughput: 0: 9239.6. Samples: 800183720. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:23,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 17:38:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4627.1). Total num frames: 400115712. Throughput: 0: 9265.2. Samples: 800239920. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:28,989][27935] Avg episode reward: [(0, '0.251')] [2022-07-13 17:38:33,992][27935] Fps is (10 sec: 4606.5, 60 sec: 4607.7, 300 sec: 4613.2). Total num frames: 400137216. Throughput: 0: 9281.9. Samples: 800296360. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:33,993][27935] Avg episode reward: [(0, '0.162')] [2022-07-13 17:38:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400161792. Throughput: 0: 9284.4. Samples: 800324396. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:38,989][27935] Avg episode reward: [(0, '0.254')] [2022-07-13 17:38:43,989][27935] Fps is (10 sec: 4814.4, 60 sec: 4676.3, 300 sec: 4623.6). Total num frames: 400185344. Throughput: 0: 9288.7. Samples: 800380604. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:43,989][27935] Avg episode reward: [(0, '0.196')] [2022-07-13 17:38:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400208896. Throughput: 0: 9374.5. Samples: 800436860. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:48,989][27935] Avg episode reward: [(0, '0.932')] [2022-07-13 17:38:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4627.1). Total num frames: 400232448. Throughput: 0: 9372.3. Samples: 800464932. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:53,989][27935] Avg episode reward: [(0, '1.140')] [2022-07-13 17:38:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4627.1). Total num frames: 400254976. Throughput: 0: 9377.0. Samples: 800520944. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:38:58,989][27935] Avg episode reward: [(0, '1.190')] [2022-07-13 17:39:03,997][27935] Fps is (10 sec: 4399.4, 60 sec: 4658.5, 300 sec: 4623.5). Total num frames: 400276480. Throughput: 0: 9284.4. Samples: 800573344. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:03,998][27935] Avg episode reward: [(0, '0.575')] [2022-07-13 17:39:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400300032. Throughput: 0: 9286.3. Samples: 800601604. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:08,989][27935] Avg episode reward: [(0, '0.570')] [2022-07-13 17:39:13,989][27935] Fps is (10 sec: 4816.9, 60 sec: 4676.3, 300 sec: 4623.6). Total num frames: 400324608. Throughput: 0: 9287.4. Samples: 800657852. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:13,989][27935] Avg episode reward: [(0, '0.842')] [2022-07-13 17:39:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4630.6). Total num frames: 400348160. Throughput: 0: 9286.9. Samples: 800714240. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:18,989][27935] Avg episode reward: [(0, '0.920')] [2022-07-13 17:39:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4627.1). Total num frames: 400370688. Throughput: 0: 9291.8. Samples: 800742528. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:23,989][27935] Avg episode reward: [(0, '0.450')] [2022-07-13 17:39:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400394240. Throughput: 0: 9296.6. Samples: 800798952. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:28,989][27935] Avg episode reward: [(0, '-0.050')] [2022-07-13 17:39:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.6, 300 sec: 4634.0). Total num frames: 400418816. Throughput: 0: 9293.4. Samples: 800855064. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:33,991][27935] Avg episode reward: [(0, '-0.384')] [2022-07-13 17:39:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400440320. Throughput: 0: 9298.3. Samples: 800883356. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:38,991][27935] Avg episode reward: [(0, '-0.199')] [2022-07-13 17:39:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 400463872. Throughput: 0: 9303.5. Samples: 800939600. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:43,990][27935] Avg episode reward: [(0, '-0.494')] [2022-07-13 17:39:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4634.0). Total num frames: 400488448. Throughput: 0: 9386.2. Samples: 800995640. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:48,989][27935] Avg episode reward: [(0, '-0.421')] [2022-07-13 17:39:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4634.0). Total num frames: 400512000. Throughput: 0: 9381.6. Samples: 801023776. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:53,989][27935] Avg episode reward: [(0, '-0.348')] [2022-07-13 17:39:58,989][27935] Fps is (10 sec: 4607.8, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 400534528. Throughput: 0: 9378.1. Samples: 801079872. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:39:58,990][27935] Avg episode reward: [(0, '-0.446')] [2022-07-13 17:40:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.9, 300 sec: 4627.1). Total num frames: 400556032. Throughput: 0: 9296.3. Samples: 801132572. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:03,989][27935] Avg episode reward: [(0, '0.278')] [2022-07-13 17:40:08,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4676.3, 300 sec: 4634.0). Total num frames: 400580608. Throughput: 0: 9290.2. Samples: 801160588. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:08,989][27935] Avg episode reward: [(0, '0.717')] [2022-07-13 17:40:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4634.0). Total num frames: 400604160. Throughput: 0: 9282.0. Samples: 801216644. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:13,989][27935] Avg episode reward: [(0, '0.105')] [2022-07-13 17:40:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4627.1). Total num frames: 400625664. Throughput: 0: 9279.5. Samples: 801272640. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:18,989][27935] Avg episode reward: [(0, '-0.147')] [2022-07-13 17:40:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4630.6). Total num frames: 400649216. Throughput: 0: 9276.8. Samples: 801300812. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:23,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 17:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 400673792. Throughput: 0: 9286.6. Samples: 801357496. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:28,989][27935] Avg episode reward: [(0, '-0.054')] [2022-07-13 17:40:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 400698368. Throughput: 0: 9283.6. Samples: 801413400. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 17:40:33,989][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 17:40:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4634.0). Total num frames: 400720896. Throughput: 0: 9300.0. Samples: 801442276. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:40:38,989][27935] Avg episode reward: [(0, '-0.282')] [2022-07-13 17:40:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4644.4). Total num frames: 400745472. Throughput: 0: 9344.5. Samples: 801500368. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:40:43,989][27935] Avg episode reward: [(0, '-0.734')] [2022-07-13 17:40:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4644.4). Total num frames: 400769024. Throughput: 0: 9493.4. Samples: 801559776. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:40:48,989][27935] Avg episode reward: [(0, '-0.629')] [2022-07-13 17:40:53,991][27935] Fps is (10 sec: 5118.7, 60 sec: 4744.3, 300 sec: 4661.8). Total num frames: 400796672. Throughput: 0: 9552.1. Samples: 801590456. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:40:53,992][27935] Avg episode reward: [(0, '0.282')] [2022-07-13 17:40:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.6, 300 sec: 4665.3). Total num frames: 400819200. Throughput: 0: 9618.3. Samples: 801649468. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:40:58,992][27935] Avg episode reward: [(0, '0.184')] [2022-07-13 17:41:03,989][27935] Fps is (10 sec: 4404.3, 60 sec: 4744.5, 300 sec: 4658.3). Total num frames: 400840704. Throughput: 0: 9519.7. Samples: 801701028. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:03,989][27935] Avg episode reward: [(0, '0.362')] [2022-07-13 17:41:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4658.3). Total num frames: 400864256. Throughput: 0: 9509.0. Samples: 801728716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:08,989][27935] Avg episode reward: [(0, '0.276')] [2022-07-13 17:41:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4654.9). Total num frames: 400886784. Throughput: 0: 9479.2. Samples: 801784060. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:13,989][27935] Avg episode reward: [(0, '0.758')] [2022-07-13 17:41:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4654.9). Total num frames: 400910336. Throughput: 0: 9497.1. Samples: 801840772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:18,989][27935] Avg episode reward: [(0, '1.109')] [2022-07-13 17:41:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4658.3). Total num frames: 400932864. Throughput: 0: 9472.0. Samples: 801868516. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:23,989][27935] Avg episode reward: [(0, '1.088')] [2022-07-13 17:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4661.8). Total num frames: 400958464. Throughput: 0: 9429.8. Samples: 801924708. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:28,989][27935] Avg episode reward: [(0, '0.098')] [2022-07-13 17:41:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4658.3). Total num frames: 400979968. Throughput: 0: 9338.8. Samples: 801980020. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:33,989][27935] Avg episode reward: [(0, '0.124')] [2022-07-13 17:41:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4661.8). Total num frames: 401003520. Throughput: 0: 9276.4. Samples: 802007872. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:38,989][27935] Avg episode reward: [(0, '0.301')] [2022-07-13 17:41:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4658.3). Total num frames: 401026048. Throughput: 0: 9197.7. Samples: 802063364. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:43,989][27935] Avg episode reward: [(0, '0.416')] [2022-07-13 17:41:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4658.3). Total num frames: 401050624. Throughput: 0: 9308.8. Samples: 802119924. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:48,989][27935] Avg episode reward: [(0, '0.236')] [2022-07-13 17:41:53,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4625.1, 300 sec: 4658.4). Total num frames: 401074176. Throughput: 0: 9313.7. Samples: 802147848. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:53,991][27935] Avg episode reward: [(0, '-0.275')] [2022-07-13 17:41:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4668.7). Total num frames: 401097728. Throughput: 0: 9330.9. Samples: 802203952. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:41:58,989][27935] Avg episode reward: [(0, '-0.202')] [2022-07-13 17:42:03,989][27935] Fps is (10 sec: 4403.9, 60 sec: 4625.1, 300 sec: 4661.8). Total num frames: 401118208. Throughput: 0: 9232.9. Samples: 802256252. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:03,989][27935] Avg episode reward: [(0, '-0.172')] [2022-07-13 17:42:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4658.4). Total num frames: 401141760. Throughput: 0: 9246.6. Samples: 802284612. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:08,989][27935] Avg episode reward: [(0, '-1.847')] [2022-07-13 17:42:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4658.4). Total num frames: 401165312. Throughput: 0: 9244.0. Samples: 802340688. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:13,989][27935] Avg episode reward: [(0, '-2.595')] [2022-07-13 17:42:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 401189888. Throughput: 0: 9258.8. Samples: 802396664. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:18,989][27935] Avg episode reward: [(0, '-3.277')] [2022-07-13 17:42:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 401212416. Throughput: 0: 9269.4. Samples: 802424996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:23,989][27935] Avg episode reward: [(0, '-2.583')] [2022-07-13 17:42:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 401234944. Throughput: 0: 9277.2. Samples: 802480840. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:28,989][27935] Avg episode reward: [(0, '-2.560')] [2022-07-13 17:42:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 401258496. Throughput: 0: 9259.8. Samples: 802536616. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:33,989][27935] Avg episode reward: [(0, '-2.537')] [2022-07-13 17:42:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4668.7). Total num frames: 401282048. Throughput: 0: 9258.5. Samples: 802564464. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:38,989][27935] Avg episode reward: [(0, '-2.076')] [2022-07-13 17:42:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4654.9). Total num frames: 401303552. Throughput: 0: 9244.4. Samples: 802619952. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:43,989][27935] Avg episode reward: [(0, '-1.678')] [2022-07-13 17:42:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4661.8). Total num frames: 401328128. Throughput: 0: 9328.8. Samples: 802676048. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:48,989][27935] Avg episode reward: [(0, '-0.275')] [2022-07-13 17:42:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.2, 300 sec: 4661.8). Total num frames: 401351680. Throughput: 0: 9323.0. Samples: 802704148. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:53,990][27935] Avg episode reward: [(0, '0.525')] [2022-07-13 17:42:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4672.2). Total num frames: 401375232. Throughput: 0: 9321.1. Samples: 802760136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:42:58,989][27935] Avg episode reward: [(0, '0.384')] [2022-07-13 17:43:03,991][27935] Fps is (10 sec: 4402.2, 60 sec: 4624.9, 300 sec: 4658.3). Total num frames: 401395712. Throughput: 0: 9222.2. Samples: 802811684. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:43:03,992][27935] Avg episode reward: [(0, '0.069')] [2022-07-13 17:43:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4661.8). Total num frames: 401419264. Throughput: 0: 9218.1. Samples: 802839812. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:43:08,989][27935] Avg episode reward: [(0, '0.227')] [2022-07-13 17:43:13,989][27935] Fps is (10 sec: 4711.4, 60 sec: 4625.1, 300 sec: 4661.8). Total num frames: 401442816. Throughput: 0: 9208.9. Samples: 802895240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 20.0) [2022-07-13 17:43:13,990][27935] Avg episode reward: [(0, '-0.258')] [2022-07-13 17:43:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4658.3). Total num frames: 401465344. Throughput: 0: 9182.0. Samples: 802949808. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:18,989][27935] Avg episode reward: [(0, '-0.121')] [2022-07-13 17:43:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4651.4). Total num frames: 401487872. Throughput: 0: 9172.8. Samples: 802977240. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:23,990][27935] Avg episode reward: [(0, '-0.178')] [2022-07-13 17:43:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4658.4). Total num frames: 401511424. Throughput: 0: 9170.1. Samples: 803032608. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:28,989][27935] Avg episode reward: [(0, '-0.760')] [2022-07-13 17:43:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 401534976. Throughput: 0: 9136.9. Samples: 803087208. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:33,989][27935] Avg episode reward: [(0, '-1.576')] [2022-07-13 17:43:38,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4556.8, 300 sec: 4644.4). Total num frames: 401555456. Throughput: 0: 9123.6. Samples: 803114708. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:38,989][27935] Avg episode reward: [(0, '-2.260')] [2022-07-13 17:43:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4647.9). Total num frames: 401580032. Throughput: 0: 9098.5. Samples: 803169568. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:43,990][27935] Avg episode reward: [(0, '-1.879')] [2022-07-13 17:43:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4573.9, 300 sec: 4644.4). Total num frames: 401602560. Throughput: 0: 9157.5. Samples: 803223752. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:48,989][27935] Avg episode reward: [(0, '-2.370')] [2022-07-13 17:43:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4539.7, 300 sec: 4641.0). Total num frames: 401624064. Throughput: 0: 9145.8. Samples: 803251372. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:53,989][27935] Avg episode reward: [(0, '-2.318')] [2022-07-13 17:43:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4556.8, 300 sec: 4651.5). Total num frames: 401648640. Throughput: 0: 9153.5. Samples: 803307148. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:43:58,990][27935] Avg episode reward: [(0, '-1.582')] [2022-07-13 17:44:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4574.0, 300 sec: 4644.4). Total num frames: 401670144. Throughput: 0: 9096.3. Samples: 803359140. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:03,991][27935] Avg episode reward: [(0, '-0.877')] [2022-07-13 17:44:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4539.7, 300 sec: 4634.0). Total num frames: 401691648. Throughput: 0: 9112.1. Samples: 803387284. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:08,991][27935] Avg episode reward: [(0, '-0.848')] [2022-07-13 17:44:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4573.9, 300 sec: 4641.0). Total num frames: 401717248. Throughput: 0: 9122.2. Samples: 803443108. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:13,989][27935] Avg episode reward: [(0, '-1.052')] [2022-07-13 17:44:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4573.9, 300 sec: 4641.0). Total num frames: 401739776. Throughput: 0: 9154.8. Samples: 803499172. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:18,991][27935] Avg episode reward: [(0, '-1.803')] [2022-07-13 17:44:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4637.5). Total num frames: 401762304. Throughput: 0: 9164.8. Samples: 803527124. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:23,989][27935] Avg episode reward: [(0, '-1.588')] [2022-07-13 17:44:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4637.5). Total num frames: 401786880. Throughput: 0: 9194.4. Samples: 803583316. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:28,989][27935] Avg episode reward: [(0, '-0.665')] [2022-07-13 17:44:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4573.9, 300 sec: 4641.0). Total num frames: 401809408. Throughput: 0: 9238.9. Samples: 803639504. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:33,989][27935] Avg episode reward: [(0, '-0.590')] [2022-07-13 17:44:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 401833984. Throughput: 0: 9265.6. Samples: 803668324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:38,989][27935] Avg episode reward: [(0, '-0.142')] [2022-07-13 17:44:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4659.2, 300 sec: 4647.9). Total num frames: 401859584. Throughput: 0: 9377.2. Samples: 803729120. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:43,990][27935] Avg episode reward: [(0, '0.247')] [2022-07-13 17:44:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4651.4). Total num frames: 401884160. Throughput: 0: 9532.8. Samples: 803788116. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:48,990][27935] Avg episode reward: [(0, '-0.425')] [2022-07-13 17:44:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4661.8). Total num frames: 401909760. Throughput: 0: 9590.2. Samples: 803818844. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:53,990][27935] Avg episode reward: [(0, '0.261')] [2022-07-13 17:44:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4668.7). Total num frames: 401933312. Throughput: 0: 9637.2. Samples: 803876780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:44:58,989][27935] Avg episode reward: [(0, '-0.394')] [2022-07-13 17:45:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4658.3). Total num frames: 401954816. Throughput: 0: 9547.4. Samples: 803928804. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:03,989][27935] Avg episode reward: [(0, '-0.216')] [2022-07-13 17:45:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4658.3). Total num frames: 401978368. Throughput: 0: 9547.9. Samples: 803956780. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:08,990][27935] Avg episode reward: [(0, '-0.164')] [2022-07-13 17:45:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4661.8). Total num frames: 402000896. Throughput: 0: 9529.7. Samples: 804012152. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:13,989][27935] Avg episode reward: [(0, '-0.171')] [2022-07-13 17:45:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4661.8). Total num frames: 402024448. Throughput: 0: 9523.2. Samples: 804068048. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:18,989][27935] Avg episode reward: [(0, '-0.828')] [2022-07-13 17:45:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4654.9). Total num frames: 402046976. Throughput: 0: 9510.2. Samples: 804096284. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:23,989][27935] Avg episode reward: [(0, '-0.016')] [2022-07-13 17:45:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4651.4). Total num frames: 402070528. Throughput: 0: 9404.5. Samples: 804152324. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:28,989][27935] Avg episode reward: [(0, '0.052')] [2022-07-13 17:45:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4654.9). Total num frames: 402094080. Throughput: 0: 9332.5. Samples: 804208080. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:33,989][27935] Avg episode reward: [(0, '-0.219')] [2022-07-13 17:45:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4651.4). Total num frames: 402117632. Throughput: 0: 9273.8. Samples: 804236164. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:38,990][27935] Avg episode reward: [(0, '-0.109')] [2022-07-13 17:45:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4651.4). Total num frames: 402141184. Throughput: 0: 9246.0. Samples: 804292852. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:43,989][27935] Avg episode reward: [(0, '-0.412')] [2022-07-13 17:45:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4637.5). Total num frames: 402164736. Throughput: 0: 9330.8. Samples: 804348688. Policy #0 lag: (min: 0.0, avg: 8.8, max: 20.0) [2022-07-13 17:45:48,989][27935] Avg episode reward: [(0, '0.496')] [2022-07-13 17:45:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402188288. Throughput: 0: 9339.1. Samples: 804377040. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:45:53,989][27935] Avg episode reward: [(0, '0.372')] [2022-07-13 17:45:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4644.4). Total num frames: 402210816. Throughput: 0: 9354.7. Samples: 804433112. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:45:58,989][27935] Avg episode reward: [(0, '0.261')] [2022-07-13 17:46:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 402232320. Throughput: 0: 9282.8. Samples: 804485772. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:03,990][27935] Avg episode reward: [(0, '0.975')] [2022-07-13 17:46:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 402256896. Throughput: 0: 9275.3. Samples: 804513672. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:08,989][27935] Avg episode reward: [(0, '0.542')] [2022-07-13 17:46:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402279424. Throughput: 0: 9276.5. Samples: 804569768. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:13,989][27935] Avg episode reward: [(0, '0.022')] [2022-07-13 17:46:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 402302976. Throughput: 0: 9274.0. Samples: 804625408. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:18,990][27935] Avg episode reward: [(0, '0.091')] [2022-07-13 17:46:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 402325504. Throughput: 0: 9271.0. Samples: 804653356. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:23,989][27935] Avg episode reward: [(0, '-0.959')] [2022-07-13 17:46:28,996][27935] Fps is (10 sec: 4604.5, 60 sec: 4641.5, 300 sec: 4640.9). Total num frames: 402349056. Throughput: 0: 9250.7. Samples: 804709204. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:28,998][27935] Avg episode reward: [(0, '-0.845')] [2022-07-13 17:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402372608. Throughput: 0: 9256.0. Samples: 804765208. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:33,989][27935] Avg episode reward: [(0, '-0.892')] [2022-07-13 17:46:38,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 402396160. Throughput: 0: 9251.9. Samples: 804793376. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:38,989][27935] Avg episode reward: [(0, '-1.018')] [2022-07-13 17:46:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4644.4). Total num frames: 402420736. Throughput: 0: 9257.3. Samples: 804849692. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:43,989][27935] Avg episode reward: [(0, '-0.452')] [2022-07-13 17:46:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402443264. Throughput: 0: 9354.1. Samples: 804906708. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:48,989][27935] Avg episode reward: [(0, '-0.446')] [2022-07-13 17:46:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402466816. Throughput: 0: 9365.2. Samples: 804935104. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:53,989][27935] Avg episode reward: [(0, '0.311')] [2022-07-13 17:46:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4654.9). Total num frames: 402491392. Throughput: 0: 9366.8. Samples: 804991272. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:46:58,989][27935] Avg episode reward: [(0, '0.641')] [2022-07-13 17:47:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4644.4). Total num frames: 402511872. Throughput: 0: 9286.0. Samples: 805043276. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:03,989][27935] Avg episode reward: [(0, '0.534')] [2022-07-13 17:47:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 402535424. Throughput: 0: 9290.9. Samples: 805071448. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:08,989][27935] Avg episode reward: [(0, '0.789')] [2022-07-13 17:47:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 402558976. Throughput: 0: 9291.9. Samples: 805127272. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:13,989][27935] Avg episode reward: [(0, '1.364')] [2022-07-13 17:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4647.9). Total num frames: 402583552. Throughput: 0: 9292.3. Samples: 805183364. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:18,989][27935] Avg episode reward: [(0, '0.132')] [2022-07-13 17:47:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4644.4). Total num frames: 402605056. Throughput: 0: 9286.2. Samples: 805211256. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:23,989][27935] Avg episode reward: [(0, '-0.468')] [2022-07-13 17:47:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.8, 300 sec: 4644.4). Total num frames: 402628608. Throughput: 0: 9287.3. Samples: 805267620. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:28,989][27935] Avg episode reward: [(0, '-0.961')] [2022-07-13 17:47:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 402651136. Throughput: 0: 9249.5. Samples: 805322936. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:33,989][27935] Avg episode reward: [(0, '-1.177')] [2022-07-13 17:47:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4647.9). Total num frames: 402674688. Throughput: 0: 9228.4. Samples: 805350384. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:38,989][27935] Avg episode reward: [(0, '-0.931')] [2022-07-13 17:47:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4644.4). Total num frames: 402698240. Throughput: 0: 9195.8. Samples: 805405084. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:43,989][27935] Avg episode reward: [(0, '-1.117')] [2022-07-13 17:47:48,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4590.9, 300 sec: 4634.0). Total num frames: 402718720. Throughput: 0: 9276.4. Samples: 805460716. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:48,989][27935] Avg episode reward: [(0, '-0.872')] [2022-07-13 17:47:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4641.0). Total num frames: 402744320. Throughput: 0: 9271.9. Samples: 805488684. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:53,990][27935] Avg episode reward: [(0, '-0.241')] [2022-07-13 17:47:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4608.0, 300 sec: 4651.4). Total num frames: 402767872. Throughput: 0: 9276.4. Samples: 805544708. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:47:58,989][27935] Avg episode reward: [(0, '-0.169')] [2022-07-13 17:48:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4644.4). Total num frames: 402789376. Throughput: 0: 9195.6. Samples: 805597164. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:03,989][27935] Avg episode reward: [(0, '-0.220')] [2022-07-13 17:48:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4647.9). Total num frames: 402813952. Throughput: 0: 9200.7. Samples: 805625288. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:08,989][27935] Avg episode reward: [(0, '-0.190')] [2022-07-13 17:48:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4641.0). Total num frames: 402834432. Throughput: 0: 9196.3. Samples: 805681452. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:13,989][27935] Avg episode reward: [(0, '-0.121')] [2022-07-13 17:48:18,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4556.8, 300 sec: 4641.0). Total num frames: 402856960. Throughput: 0: 9210.6. Samples: 805737412. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:18,989][27935] Avg episode reward: [(0, '-0.234')] [2022-07-13 17:48:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4651.4). Total num frames: 402883584. Throughput: 0: 9216.1. Samples: 805765108. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:23,993][27935] Avg episode reward: [(0, '-0.059')] [2022-07-13 17:48:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4625.1, 300 sec: 4647.9). Total num frames: 402906112. Throughput: 0: 9247.3. Samples: 805821212. Policy #0 lag: (min: 1.0, avg: 8.8, max: 18.0) [2022-07-13 17:48:28,989][27935] Avg episode reward: [(0, '-0.892')] [2022-07-13 17:48:33,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4651.4). Total num frames: 402927616. Throughput: 0: 9230.6. Samples: 805876092. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:33,989][27935] Avg episode reward: [(0, '-0.590')] [2022-07-13 17:48:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4651.4). Total num frames: 402952192. Throughput: 0: 9224.3. Samples: 805903776. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:38,989][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 17:48:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4651.4). Total num frames: 402974720. Throughput: 0: 9233.2. Samples: 805960200. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:43,989][27935] Avg episode reward: [(0, '0.105')] [2022-07-13 17:48:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4658.3). Total num frames: 402998272. Throughput: 0: 9322.2. Samples: 806016664. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:48,989][27935] Avg episode reward: [(0, '0.072')] [2022-07-13 17:48:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4658.3). Total num frames: 403022848. Throughput: 0: 9322.5. Samples: 806044800. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:53,989][27935] Avg episode reward: [(0, '0.445')] [2022-07-13 17:48:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4665.3). Total num frames: 403046400. Throughput: 0: 9321.3. Samples: 806100912. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:48:58,989][27935] Avg episode reward: [(0, '0.354')] [2022-07-13 17:49:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4661.8). Total num frames: 403066880. Throughput: 0: 9246.8. Samples: 806153520. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:03,989][27935] Avg episode reward: [(0, '0.958')] [2022-07-13 17:49:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4658.3). Total num frames: 403091456. Throughput: 0: 9258.5. Samples: 806181740. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:08,990][27935] Avg episode reward: [(0, '0.076')] [2022-07-13 17:49:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4658.3). Total num frames: 403113984. Throughput: 0: 9261.3. Samples: 806237972. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:13,989][27935] Avg episode reward: [(0, '0.006')] [2022-07-13 17:49:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4661.8). Total num frames: 403137536. Throughput: 0: 9281.0. Samples: 806293736. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:18,989][27935] Avg episode reward: [(0, '-0.303')] [2022-07-13 17:49:23,992][27935] Fps is (10 sec: 4504.1, 60 sec: 4590.7, 300 sec: 4651.3). Total num frames: 403159040. Throughput: 0: 9266.1. Samples: 806320784. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:23,996][27935] Avg episode reward: [(0, '-0.314')] [2022-07-13 17:49:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4658.3). Total num frames: 403183616. Throughput: 0: 9249.1. Samples: 806376408. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:28,989][27935] Avg episode reward: [(0, '-0.326')] [2022-07-13 17:49:33,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4659.2, 300 sec: 4654.9). Total num frames: 403207168. Throughput: 0: 9238.0. Samples: 806432372. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:33,992][27935] Avg episode reward: [(0, '-0.183')] [2022-07-13 17:49:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4644.4). Total num frames: 403229696. Throughput: 0: 9226.4. Samples: 806459988. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:38,989][27935] Avg episode reward: [(0, '-0.308')] [2022-07-13 17:49:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 403253248. Throughput: 0: 9217.3. Samples: 806515688. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:43,989][27935] Avg episode reward: [(0, '1.036')] [2022-07-13 17:49:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 403276800. Throughput: 0: 9298.3. Samples: 806571944. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:48,989][27935] Avg episode reward: [(0, '0.425')] [2022-07-13 17:49:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 403299328. Throughput: 0: 9299.3. Samples: 806600208. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:53,989][27935] Avg episode reward: [(0, '0.355')] [2022-07-13 17:49:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4634.0). Total num frames: 403321856. Throughput: 0: 9296.3. Samples: 806656304. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:49:58,989][27935] Avg episode reward: [(0, '-0.262')] [2022-07-13 17:50:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 403345408. Throughput: 0: 9214.8. Samples: 806708400. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:03,989][27935] Avg episode reward: [(0, '-0.320')] [2022-07-13 17:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4634.0). Total num frames: 403367936. Throughput: 0: 9239.9. Samples: 806736548. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:08,989][27935] Avg episode reward: [(0, '-1.125')] [2022-07-13 17:50:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4637.5). Total num frames: 403392512. Throughput: 0: 9259.5. Samples: 806793084. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:13,989][27935] Avg episode reward: [(0, '-0.920')] [2022-07-13 17:50:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 403415040. Throughput: 0: 9270.6. Samples: 806849548. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:18,989][27935] Avg episode reward: [(0, '-1.723')] [2022-07-13 17:50:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.5, 300 sec: 4637.5). Total num frames: 403438592. Throughput: 0: 9287.0. Samples: 806877904. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:23,989][27935] Avg episode reward: [(0, '-1.030')] [2022-07-13 17:50:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 403463168. Throughput: 0: 9327.2. Samples: 806935412. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:28,989][27935] Avg episode reward: [(0, '-1.013')] [2022-07-13 17:50:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4637.5). Total num frames: 403485696. Throughput: 0: 9302.0. Samples: 806990536. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:33,989][27935] Avg episode reward: [(0, '-0.518')] [2022-07-13 17:50:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 403509248. Throughput: 0: 9290.5. Samples: 807018280. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:38,989][27935] Avg episode reward: [(0, '-0.247')] [2022-07-13 17:50:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 403532800. Throughput: 0: 9280.3. Samples: 807073916. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:43,989][27935] Avg episode reward: [(0, '0.903')] [2022-07-13 17:50:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 403554304. Throughput: 0: 9351.5. Samples: 807129216. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:48,989][27935] Avg episode reward: [(0, '0.534')] [2022-07-13 17:50:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 403577856. Throughput: 0: 9336.7. Samples: 807156700. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:53,989][27935] Avg episode reward: [(0, '0.529')] [2022-07-13 17:50:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 403601408. Throughput: 0: 9307.1. Samples: 807211904. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:50:58,989][27935] Avg episode reward: [(0, '0.640')] [2022-07-13 17:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 403622912. Throughput: 0: 9218.2. Samples: 807264368. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:51:03,989][27935] Avg episode reward: [(0, '0.531')] [2022-07-13 17:51:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 403646464. Throughput: 0: 9218.6. Samples: 807292740. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 17:51:08,990][27935] Avg episode reward: [(0, '-0.062')] [2022-07-13 17:51:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4637.5). Total num frames: 403671040. Throughput: 0: 9246.1. Samples: 807351488. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:13,989][27935] Avg episode reward: [(0, '0.001')] [2022-07-13 17:51:18,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4676.2, 300 sec: 4644.4). Total num frames: 403695616. Throughput: 0: 9349.0. Samples: 807411244. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:18,990][27935] Avg episode reward: [(0, '-0.344')] [2022-07-13 17:51:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4648.0). Total num frames: 403720192. Throughput: 0: 9364.0. Samples: 807439660. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:23,989][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 17:51:28,992][27935] Fps is (10 sec: 4913.6, 60 sec: 4693.1, 300 sec: 4651.3). Total num frames: 403744768. Throughput: 0: 9450.8. Samples: 807499236. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:28,993][27935] Avg episode reward: [(0, '-1.194')] [2022-07-13 17:51:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4647.9). Total num frames: 403767296. Throughput: 0: 9467.5. Samples: 807555252. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:33,989][27935] Avg episode reward: [(0, '-1.262')] [2022-07-13 17:51:38,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4693.3, 300 sec: 4644.4). Total num frames: 403790848. Throughput: 0: 9472.4. Samples: 807582956. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:38,989][27935] Avg episode reward: [(0, '-1.466')] [2022-07-13 17:51:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4647.9). Total num frames: 403814400. Throughput: 0: 9475.4. Samples: 807638296. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:43,989][27935] Avg episode reward: [(0, '-0.877')] [2022-07-13 17:51:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4647.9). Total num frames: 403837952. Throughput: 0: 9552.8. Samples: 807694244. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:48,989][27935] Avg episode reward: [(0, '-1.802')] [2022-07-13 17:51:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4644.4). Total num frames: 403861504. Throughput: 0: 9545.9. Samples: 807722304. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:53,989][27935] Avg episode reward: [(0, '-1.359')] [2022-07-13 17:51:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4651.4). Total num frames: 403884032. Throughput: 0: 9493.9. Samples: 807778712. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:51:58,989][27935] Avg episode reward: [(0, '-1.174')] [2022-07-13 17:52:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 4644.4). Total num frames: 403905536. Throughput: 0: 9324.4. Samples: 807830840. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:03,989][27935] Avg episode reward: [(0, '-1.668')] [2022-07-13 17:52:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4644.4). Total num frames: 403929088. Throughput: 0: 9309.6. Samples: 807858592. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:08,989][27935] Avg episode reward: [(0, '-0.482')] [2022-07-13 17:52:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4641.0). Total num frames: 403952640. Throughput: 0: 9249.4. Samples: 807915428. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:13,990][27935] Avg episode reward: [(0, '-0.323')] [2022-07-13 17:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.4, 300 sec: 4651.4). Total num frames: 403977216. Throughput: 0: 9276.6. Samples: 807972700. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:18,989][27935] Avg episode reward: [(0, '-0.652')] [2022-07-13 17:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4651.4). Total num frames: 404000768. Throughput: 0: 9303.6. Samples: 808001616. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:23,989][27935] Avg episode reward: [(0, '-0.225')] [2022-07-13 17:52:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.5, 300 sec: 4654.9). Total num frames: 404024320. Throughput: 0: 9362.4. Samples: 808059604. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:28,989][27935] Avg episode reward: [(0, '-0.304')] [2022-07-13 17:52:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4654.9). Total num frames: 404047872. Throughput: 0: 9371.3. Samples: 808115952. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:33,989][27935] Avg episode reward: [(0, '0.037')] [2022-07-13 17:52:38,989][27935] Fps is (10 sec: 4710.1, 60 sec: 4676.2, 300 sec: 4654.9). Total num frames: 404071424. Throughput: 0: 9376.2. Samples: 808144240. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:38,990][27935] Avg episode reward: [(0, '0.649')] [2022-07-13 17:52:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 404093952. Throughput: 0: 9353.0. Samples: 808199596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:43,989][27935] Avg episode reward: [(0, '-1.588')] [2022-07-13 17:52:48,989][27935] Fps is (10 sec: 4608.3, 60 sec: 4659.2, 300 sec: 4654.9). Total num frames: 404117504. Throughput: 0: 9444.1. Samples: 808255824. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:48,989][27935] Avg episode reward: [(0, '-1.721')] [2022-07-13 17:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4658.3). Total num frames: 404142080. Throughput: 0: 9461.3. Samples: 808284352. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:53,989][27935] Avg episode reward: [(0, '-1.268')] [2022-07-13 17:52:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 404165632. Throughput: 0: 9451.8. Samples: 808340760. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:52:58,989][27935] Avg episode reward: [(0, '-1.242')] [2022-07-13 17:53:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4654.9). Total num frames: 404187136. Throughput: 0: 9341.2. Samples: 808393052. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:03,989][27935] Avg episode reward: [(0, '-1.256')] [2022-07-13 17:53:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4661.8). Total num frames: 404209664. Throughput: 0: 9329.2. Samples: 808421428. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:08,989][27935] Avg episode reward: [(0, '-0.670')] [2022-07-13 17:53:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 404233216. Throughput: 0: 9314.2. Samples: 808478744. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:13,989][27935] Avg episode reward: [(0, '-0.494')] [2022-07-13 17:53:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4665.3). Total num frames: 404259840. Throughput: 0: 9339.7. Samples: 808536240. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:18,989][27935] Avg episode reward: [(0, '0.451')] [2022-07-13 17:53:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 404282368. Throughput: 0: 9351.0. Samples: 808565028. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:23,989][27935] Avg episode reward: [(0, '1.379')] [2022-07-13 17:53:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4672.2). Total num frames: 404305920. Throughput: 0: 9404.3. Samples: 808622788. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:28,990][27935] Avg episode reward: [(0, '1.621')] [2022-07-13 17:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 404329472. Throughput: 0: 9413.6. Samples: 808679436. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:33,989][27935] Avg episode reward: [(0, '1.760')] [2022-07-13 17:53:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.4, 300 sec: 4672.2). Total num frames: 404353024. Throughput: 0: 9397.2. Samples: 808707224. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:38,989][27935] Avg episode reward: [(0, '-0.035')] [2022-07-13 17:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4675.7). Total num frames: 404377600. Throughput: 0: 9389.9. Samples: 808763304. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:43,989][27935] Avg episode reward: [(0, '-0.062')] [2022-07-13 17:53:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4668.7). Total num frames: 404400128. Throughput: 0: 9475.3. Samples: 808819440. Policy #0 lag: (min: 0.0, avg: 10.0, max: 20.0) [2022-07-13 17:53:48,989][27935] Avg episode reward: [(0, '-0.689')] [2022-07-13 17:53:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 404423680. Throughput: 0: 9469.9. Samples: 808847572. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:53:53,989][27935] Avg episode reward: [(0, '-1.189')] [2022-07-13 17:53:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4679.2). Total num frames: 404447232. Throughput: 0: 9440.2. Samples: 808903552. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:53:58,989][27935] Avg episode reward: [(0, '-1.357')] [2022-07-13 17:54:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 404466688. Throughput: 0: 9324.3. Samples: 808955832. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:03,989][27935] Avg episode reward: [(0, '-1.464')] [2022-07-13 17:54:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 404490240. Throughput: 0: 9306.7. Samples: 808983828. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:08,989][27935] Avg episode reward: [(0, '-1.478')] [2022-07-13 17:54:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4672.2). Total num frames: 404515840. Throughput: 0: 9274.2. Samples: 809040128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:13,989][27935] Avg episode reward: [(0, '0.125')] [2022-07-13 17:54:18,989][27935] Fps is (10 sec: 4812.6, 60 sec: 4642.1, 300 sec: 4675.7). Total num frames: 404538368. Throughput: 0: 9263.4. Samples: 809096292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:18,990][27935] Avg episode reward: [(0, '0.321')] [2022-07-13 17:54:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4675.7). Total num frames: 404562944. Throughput: 0: 9268.7. Samples: 809124316. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:23,990][27935] Avg episode reward: [(0, '-0.564')] [2022-07-13 17:54:28,989][27935] Fps is (10 sec: 4710.6, 60 sec: 4659.2, 300 sec: 4672.2). Total num frames: 404585472. Throughput: 0: 9281.6. Samples: 809180976. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:28,996][27935] Avg episode reward: [(0, '-0.486')] [2022-07-13 17:54:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4672.2). Total num frames: 404608000. Throughput: 0: 9282.7. Samples: 809237160. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:33,989][27935] Avg episode reward: [(0, '-1.194')] [2022-07-13 17:54:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4675.7). Total num frames: 404632576. Throughput: 0: 9287.5. Samples: 809265508. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:38,990][27935] Avg episode reward: [(0, '-1.159')] [2022-07-13 17:54:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4675.7). Total num frames: 404656128. Throughput: 0: 9315.8. Samples: 809322764. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:43,989][27935] Avg episode reward: [(0, '-1.356')] [2022-07-13 17:54:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4682.6). Total num frames: 404680704. Throughput: 0: 9416.5. Samples: 809379572. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:48,989][27935] Avg episode reward: [(0, '-1.454')] [2022-07-13 17:54:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4682.6). Total num frames: 404703232. Throughput: 0: 9418.5. Samples: 809407660. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:53,989][27935] Avg episode reward: [(0, '-1.730')] [2022-07-13 17:54:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4682.6). Total num frames: 404726784. Throughput: 0: 9430.5. Samples: 809464500. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:54:58,989][27935] Avg episode reward: [(0, '-1.346')] [2022-07-13 17:55:03,991][27935] Fps is (10 sec: 4607.2, 60 sec: 4710.3, 300 sec: 4682.6). Total num frames: 404749312. Throughput: 0: 9351.6. Samples: 809517128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:03,991][27935] Avg episode reward: [(0, '-0.933')] [2022-07-13 17:55:08,992][27935] Fps is (10 sec: 4504.2, 60 sec: 4693.1, 300 sec: 4675.6). Total num frames: 404771840. Throughput: 0: 9355.9. Samples: 809545360. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:08,992][27935] Avg episode reward: [(0, '-0.291')] [2022-07-13 17:55:13,989][27935] Fps is (10 sec: 4608.8, 60 sec: 4659.2, 300 sec: 4679.2). Total num frames: 404795392. Throughput: 0: 9340.4. Samples: 809601296. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:13,996][27935] Avg episode reward: [(0, '-1.384')] [2022-07-13 17:55:18,989][27935] Fps is (10 sec: 4814.3, 60 sec: 4693.4, 300 sec: 4682.6). Total num frames: 404819968. Throughput: 0: 9346.4. Samples: 809657748. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:18,989][27935] Avg episode reward: [(0, '-2.050')] [2022-07-13 17:55:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4675.7). Total num frames: 404842496. Throughput: 0: 9349.3. Samples: 809686224. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:23,989][27935] Avg episode reward: [(0, '-2.559')] [2022-07-13 17:55:28,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4642.1, 300 sec: 4672.2). Total num frames: 404864000. Throughput: 0: 9299.2. Samples: 809741228. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:28,989][27935] Avg episode reward: [(0, '-2.095')] [2022-07-13 17:55:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4679.2). Total num frames: 404889600. Throughput: 0: 9263.4. Samples: 809796424. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:33,989][27935] Avg episode reward: [(0, '-1.502')] [2022-07-13 17:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4675.7). Total num frames: 404912128. Throughput: 0: 9259.3. Samples: 809824328. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:38,989][27935] Avg episode reward: [(0, '-1.553')] [2022-07-13 17:55:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4679.2). Total num frames: 404934656. Throughput: 0: 9231.8. Samples: 809879932. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:43,989][27935] Avg episode reward: [(0, '-1.174')] [2022-07-13 17:55:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4682.6). Total num frames: 404959232. Throughput: 0: 9311.4. Samples: 809936124. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:48,989][27935] Avg episode reward: [(0, '-0.523')] [2022-07-13 17:55:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4679.2). Total num frames: 404981760. Throughput: 0: 9314.3. Samples: 809964476. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:53,989][27935] Avg episode reward: [(0, '0.123')] [2022-07-13 17:55:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4686.1). Total num frames: 405005312. Throughput: 0: 9319.4. Samples: 810020668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:55:58,989][27935] Avg episode reward: [(0, '0.886')] [2022-07-13 17:56:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.1, 300 sec: 4675.7). Total num frames: 405025792. Throughput: 0: 9203.5. Samples: 810071904. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:03,989][27935] Avg episode reward: [(0, '0.989')] [2022-07-13 17:56:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.3, 300 sec: 4672.2). Total num frames: 405049344. Throughput: 0: 9186.6. Samples: 810099620. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:08,989][27935] Avg episode reward: [(0, '0.875')] [2022-07-13 17:56:13,997][27935] Fps is (10 sec: 4706.7, 60 sec: 4624.5, 300 sec: 4668.6). Total num frames: 405072896. Throughput: 0: 9198.7. Samples: 810155240. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:13,997][27935] Avg episode reward: [(0, '0.799')] [2022-07-13 17:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4665.3). Total num frames: 405096448. Throughput: 0: 9218.8. Samples: 810211272. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:18,989][27935] Avg episode reward: [(0, '0.353')] [2022-07-13 17:56:23,989][27935] Fps is (10 sec: 4611.6, 60 sec: 4608.0, 300 sec: 4658.4). Total num frames: 405118976. Throughput: 0: 9216.3. Samples: 810239060. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:23,990][27935] Avg episode reward: [(0, '-0.002')] [2022-07-13 17:56:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 405142528. Throughput: 0: 9208.9. Samples: 810294332. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 17:56:28,989][27935] Avg episode reward: [(0, '-0.039')] [2022-07-13 17:56:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4658.3). Total num frames: 405165056. Throughput: 0: 9198.2. Samples: 810350044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:33,989][27935] Avg episode reward: [(0, '-0.025')] [2022-07-13 17:56:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 405188608. Throughput: 0: 9181.1. Samples: 810377624. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:38,989][27935] Avg episode reward: [(0, '-0.133')] [2022-07-13 17:56:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 405213184. Throughput: 0: 9186.8. Samples: 810434072. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:43,989][27935] Avg episode reward: [(0, '-0.024')] [2022-07-13 17:56:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 405235712. Throughput: 0: 9287.6. Samples: 810489844. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:48,989][27935] Avg episode reward: [(0, '0.001')] [2022-07-13 17:56:53,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 405258240. Throughput: 0: 9297.1. Samples: 810517988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:53,989][27935] Avg episode reward: [(0, '1.233')] [2022-07-13 17:56:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4665.3). Total num frames: 405281792. Throughput: 0: 9307.1. Samples: 810573988. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:56:58,989][27935] Avg episode reward: [(0, '1.115')] [2022-07-13 17:57:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 405302272. Throughput: 0: 9208.9. Samples: 810625672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:03,989][27935] Avg episode reward: [(0, '1.023')] [2022-07-13 17:57:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 405325824. Throughput: 0: 9205.7. Samples: 810653316. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:08,989][27935] Avg episode reward: [(0, '1.169')] [2022-07-13 17:57:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.6, 300 sec: 4651.4). Total num frames: 405349376. Throughput: 0: 9190.0. Samples: 810707884. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:13,989][27935] Avg episode reward: [(0, '1.114')] [2022-07-13 17:57:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4647.9). Total num frames: 405371904. Throughput: 0: 9162.9. Samples: 810762376. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:18,990][27935] Avg episode reward: [(0, '0.472')] [2022-07-13 17:57:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4644.4). Total num frames: 405394432. Throughput: 0: 9168.2. Samples: 810790192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:23,989][27935] Avg episode reward: [(0, '0.493')] [2022-07-13 17:57:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4641.0). Total num frames: 405416960. Throughput: 0: 9150.9. Samples: 810845864. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:28,989][27935] Avg episode reward: [(0, '-0.152')] [2022-07-13 17:57:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4644.5). Total num frames: 405441536. Throughput: 0: 9151.0. Samples: 810901640. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:33,989][27935] Avg episode reward: [(0, '-0.074')] [2022-07-13 17:57:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4608.0, 300 sec: 4647.9). Total num frames: 405465088. Throughput: 0: 9147.5. Samples: 810929624. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:38,989][27935] Avg episode reward: [(0, '-0.555')] [2022-07-13 17:57:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4556.8, 300 sec: 4641.0). Total num frames: 405486592. Throughput: 0: 9123.0. Samples: 810984524. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:43,989][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 17:57:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4641.0). Total num frames: 405511168. Throughput: 0: 9218.1. Samples: 811040484. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:48,989][27935] Avg episode reward: [(0, '-1.300')] [2022-07-13 17:57:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4637.5). Total num frames: 405533696. Throughput: 0: 9225.3. Samples: 811068456. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:53,989][27935] Avg episode reward: [(0, '-0.685')] [2022-07-13 17:57:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4641.0). Total num frames: 405556224. Throughput: 0: 9243.0. Samples: 811123820. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:57:58,990][27935] Avg episode reward: [(0, '-0.638')] [2022-07-13 17:58:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 405578752. Throughput: 0: 9186.4. Samples: 811175764. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:03,991][27935] Avg episode reward: [(0, '-0.698')] [2022-07-13 17:58:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4637.5). Total num frames: 405601280. Throughput: 0: 9190.3. Samples: 811203756. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:08,999][27935] Avg episode reward: [(0, '-0.573')] [2022-07-13 17:58:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4623.6). Total num frames: 405623808. Throughput: 0: 9209.1. Samples: 811260272. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:13,989][27935] Avg episode reward: [(0, '0.057')] [2022-07-13 17:58:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 405648384. Throughput: 0: 9212.6. Samples: 811316208. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:18,989][27935] Avg episode reward: [(0, '-0.040')] [2022-07-13 17:58:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4634.0). Total num frames: 405672960. Throughput: 0: 9217.7. Samples: 811344420. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:23,989][27935] Avg episode reward: [(0, '0.634')] [2022-07-13 17:58:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4627.1). Total num frames: 405694464. Throughput: 0: 9243.7. Samples: 811400492. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:28,989][27935] Avg episode reward: [(0, '0.567')] [2022-07-13 17:58:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4627.1). Total num frames: 405718016. Throughput: 0: 9227.6. Samples: 811455728. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:33,989][27935] Avg episode reward: [(0, '0.506')] [2022-07-13 17:58:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 405741568. Throughput: 0: 9232.7. Samples: 811483928. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:38,989][27935] Avg episode reward: [(0, '0.065')] [2022-07-13 17:58:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4630.6). Total num frames: 405766144. Throughput: 0: 9252.7. Samples: 811540192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:43,989][27935] Avg episode reward: [(0, '0.306')] [2022-07-13 17:58:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4623.6). Total num frames: 405787648. Throughput: 0: 9340.6. Samples: 811596092. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:48,989][27935] Avg episode reward: [(0, '0.353')] [2022-07-13 17:58:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4627.1). Total num frames: 405812224. Throughput: 0: 9341.4. Samples: 811624120. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:53,989][27935] Avg episode reward: [(0, '-0.013')] [2022-07-13 17:58:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4637.5). Total num frames: 405834752. Throughput: 0: 9319.9. Samples: 811679668. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:58:58,989][27935] Avg episode reward: [(0, '0.054')] [2022-07-13 17:59:03,989][27935] Fps is (10 sec: 4198.4, 60 sec: 4590.9, 300 sec: 4623.6). Total num frames: 405854208. Throughput: 0: 9233.3. Samples: 811731708. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:59:03,989][27935] Avg episode reward: [(0, '0.260')] [2022-07-13 17:59:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 405878784. Throughput: 0: 9221.9. Samples: 811759404. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 17:59:08,989][27935] Avg episode reward: [(0, '0.282')] [2022-07-13 17:59:13,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4659.2, 300 sec: 4627.1). Total num frames: 405903360. Throughput: 0: 9218.6. Samples: 811815328. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:13,992][27935] Avg episode reward: [(0, '1.119')] [2022-07-13 17:59:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4616.7). Total num frames: 405924864. Throughput: 0: 9222.9. Samples: 811870760. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:18,989][27935] Avg episode reward: [(0, '1.232')] [2022-07-13 17:59:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4620.1). Total num frames: 405948416. Throughput: 0: 9208.3. Samples: 811898300. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:23,989][27935] Avg episode reward: [(0, '1.122')] [2022-07-13 17:59:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4623.6). Total num frames: 405971968. Throughput: 0: 9197.5. Samples: 811954080. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:28,989][27935] Avg episode reward: [(0, '1.133')] [2022-07-13 17:59:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4623.6). Total num frames: 405996544. Throughput: 0: 9195.4. Samples: 812009884. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:33,989][27935] Avg episode reward: [(0, '1.612')] [2022-07-13 17:59:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 406019072. Throughput: 0: 9200.4. Samples: 812038140. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:38,989][27935] Avg episode reward: [(0, '0.927')] [2022-07-13 17:59:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4613.2). Total num frames: 406041600. Throughput: 0: 9216.9. Samples: 812094428. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:43,989][27935] Avg episode reward: [(0, '0.919')] [2022-07-13 17:59:48,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4642.1, 300 sec: 4620.1). Total num frames: 406066176. Throughput: 0: 9320.6. Samples: 812151136. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:48,989][27935] Avg episode reward: [(0, '0.789')] [2022-07-13 17:59:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4620.1). Total num frames: 406089728. Throughput: 0: 9332.4. Samples: 812179364. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:53,989][27935] Avg episode reward: [(0, '-0.012')] [2022-07-13 17:59:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4620.2). Total num frames: 406112256. Throughput: 0: 9322.6. Samples: 812234844. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 17:59:58,989][27935] Avg episode reward: [(0, '-0.198')] [2022-07-13 18:00:03,996][27935] Fps is (10 sec: 4399.9, 60 sec: 4658.6, 300 sec: 4616.6). Total num frames: 406133760. Throughput: 0: 9244.5. Samples: 812286832. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:03,997][27935] Avg episode reward: [(0, '-0.159')] [2022-07-13 18:00:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4616.7). Total num frames: 406157312. Throughput: 0: 9257.3. Samples: 812314880. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:08,989][27935] Avg episode reward: [(0, '-0.487')] [2022-07-13 18:00:13,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4625.1, 300 sec: 4613.2). Total num frames: 406180864. Throughput: 0: 9272.3. Samples: 812371336. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:13,990][27935] Avg episode reward: [(0, '-0.063')] [2022-07-13 18:00:18,992][27935] Fps is (10 sec: 4708.7, 60 sec: 4658.9, 300 sec: 4616.6). Total num frames: 406204416. Throughput: 0: 9284.0. Samples: 812427696. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:18,993][27935] Avg episode reward: [(0, '-0.324')] [2022-07-13 18:00:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4623.6). Total num frames: 406227968. Throughput: 0: 9280.8. Samples: 812455776. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:23,989][27935] Avg episode reward: [(0, '-0.505')] [2022-07-13 18:00:28,989][27935] Fps is (10 sec: 4609.6, 60 sec: 4642.1, 300 sec: 4613.2). Total num frames: 406250496. Throughput: 0: 9290.6. Samples: 812512504. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:28,989][27935] Avg episode reward: [(0, '-0.409')] [2022-07-13 18:00:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4616.7). Total num frames: 406274048. Throughput: 0: 9282.3. Samples: 812568840. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:33,989][27935] Avg episode reward: [(0, '0.747')] [2022-07-13 18:00:38,997][27935] Fps is (10 sec: 4809.0, 60 sec: 4658.6, 300 sec: 4623.5). Total num frames: 406298624. Throughput: 0: 9280.3. Samples: 812597048. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:38,997][27935] Avg episode reward: [(0, '0.827')] [2022-07-13 18:00:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4616.7). Total num frames: 406321152. Throughput: 0: 9311.8. Samples: 812653876. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:43,989][27935] Avg episode reward: [(0, '1.026')] [2022-07-13 18:00:48,989][27935] Fps is (10 sec: 4714.1, 60 sec: 4659.2, 300 sec: 4623.6). Total num frames: 406345728. Throughput: 0: 9419.5. Samples: 812710636. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:48,989][27935] Avg episode reward: [(0, '0.499')] [2022-07-13 18:00:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4623.6). Total num frames: 406369280. Throughput: 0: 9424.4. Samples: 812738980. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:53,989][27935] Avg episode reward: [(0, '0.672')] [2022-07-13 18:00:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4637.5). Total num frames: 406393856. Throughput: 0: 9444.9. Samples: 812796356. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:00:58,989][27935] Avg episode reward: [(0, '0.511')] [2022-07-13 18:01:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.8, 300 sec: 4623.6). Total num frames: 406413312. Throughput: 0: 9388.9. Samples: 812850164. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:03,989][27935] Avg episode reward: [(0, '0.168')] [2022-07-13 18:01:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4627.2). Total num frames: 406437888. Throughput: 0: 9387.6. Samples: 812878220. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:08,989][27935] Avg episode reward: [(0, '0.127')] [2022-07-13 18:01:13,989][27935] Fps is (10 sec: 5017.5, 60 sec: 4710.4, 300 sec: 4634.0). Total num frames: 406463488. Throughput: 0: 9393.8. Samples: 812935224. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:13,989][27935] Avg episode reward: [(0, '0.073')] [2022-07-13 18:01:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.6, 300 sec: 4634.0). Total num frames: 406486016. Throughput: 0: 9389.0. Samples: 812991344. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:18,989][27935] Avg episode reward: [(0, '-0.350')] [2022-07-13 18:01:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4634.0). Total num frames: 406509568. Throughput: 0: 9394.4. Samples: 813019720. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:23,989][27935] Avg episode reward: [(0, '-0.454')] [2022-07-13 18:01:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4634.0). Total num frames: 406532096. Throughput: 0: 9367.6. Samples: 813075416. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:28,989][27935] Avg episode reward: [(0, '-0.652')] [2022-07-13 18:01:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4634.0). Total num frames: 406555648. Throughput: 0: 9328.8. Samples: 813130432. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:33,989][27935] Avg episode reward: [(0, '-0.324')] [2022-07-13 18:01:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.8, 300 sec: 4627.1). Total num frames: 406578176. Throughput: 0: 9320.1. Samples: 813158384. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:38,989][27935] Avg episode reward: [(0, '-0.043')] [2022-07-13 18:01:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4630.6). Total num frames: 406601728. Throughput: 0: 9284.5. Samples: 813214160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:43,989][27935] Avg episode reward: [(0, '-0.783')] [2022-07-13 18:01:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4634.0). Total num frames: 406625280. Throughput: 0: 9324.4. Samples: 813269764. Policy #0 lag: (min: 0.0, avg: 9.6, max: 19.0) [2022-07-13 18:01:48,990][27935] Avg episode reward: [(0, '-0.550')] [2022-07-13 18:01:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4634.0). Total num frames: 406648832. Throughput: 0: 9316.4. Samples: 813297460. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:01:53,990][27935] Avg episode reward: [(0, '-0.446')] [2022-07-13 18:01:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4637.5). Total num frames: 406670336. Throughput: 0: 9285.3. Samples: 813353060. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:01:58,989][27935] Avg episode reward: [(0, '0.029')] [2022-07-13 18:02:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4642.1, 300 sec: 4630.6). Total num frames: 406691840. Throughput: 0: 9195.6. Samples: 813405144. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:03,989][27935] Avg episode reward: [(0, '0.268')] [2022-07-13 18:02:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4630.6). Total num frames: 406715392. Throughput: 0: 9180.3. Samples: 813432832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:08,989][27935] Avg episode reward: [(0, '0.322')] [2022-07-13 18:02:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4634.0). Total num frames: 406738944. Throughput: 0: 9177.9. Samples: 813488420. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:13,989][27935] Avg episode reward: [(0, '-1.057')] [2022-07-13 18:02:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4637.5). Total num frames: 406762496. Throughput: 0: 9189.6. Samples: 813543964. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:18,989][27935] Avg episode reward: [(0, '-0.215')] [2022-07-13 18:02:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 406786048. Throughput: 0: 9187.7. Samples: 813571832. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:23,989][27935] Avg episode reward: [(0, '-0.459')] [2022-07-13 18:02:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4634.0). Total num frames: 406808576. Throughput: 0: 9186.2. Samples: 813627540. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:28,989][27935] Avg episode reward: [(0, '-0.091')] [2022-07-13 18:02:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4630.6). Total num frames: 406831104. Throughput: 0: 9181.7. Samples: 813682940. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:33,990][27935] Avg episode reward: [(0, '-0.071')] [2022-07-13 18:02:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4641.0). Total num frames: 406855680. Throughput: 0: 9185.8. Samples: 813710820. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:38,989][27935] Avg episode reward: [(0, '-0.265')] [2022-07-13 18:02:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 406879232. Throughput: 0: 9180.3. Samples: 813766172. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:43,989][27935] Avg episode reward: [(0, '0.178')] [2022-07-13 18:02:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4634.0). Total num frames: 406900736. Throughput: 0: 9278.7. Samples: 813822684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:48,989][27935] Avg episode reward: [(0, '0.635')] [2022-07-13 18:02:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 406925312. Throughput: 0: 9285.7. Samples: 813850688. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:53,989][27935] Avg episode reward: [(0, '-0.264')] [2022-07-13 18:02:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4641.0). Total num frames: 406947840. Throughput: 0: 9303.1. Samples: 813907060. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:02:58,989][27935] Avg episode reward: [(0, '-0.225')] [2022-07-13 18:03:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 406970368. Throughput: 0: 9234.6. Samples: 813959520. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:03,989][27935] Avg episode reward: [(0, '-0.808')] [2022-07-13 18:03:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 406993920. Throughput: 0: 9242.8. Samples: 813987760. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:08,997][27935] Avg episode reward: [(0, '-0.317')] [2022-07-13 18:03:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4637.5). Total num frames: 407016448. Throughput: 0: 9243.1. Samples: 814043480. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:13,989][27935] Avg episode reward: [(0, '-0.192')] [2022-07-13 18:03:18,994][27935] Fps is (10 sec: 4503.4, 60 sec: 4607.6, 300 sec: 4630.5). Total num frames: 407038976. Throughput: 0: 9256.7. Samples: 814099536. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:18,994][27935] Avg episode reward: [(0, '-0.512')] [2022-07-13 18:03:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4641.0). Total num frames: 407063552. Throughput: 0: 9262.4. Samples: 814127628. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:23,989][27935] Avg episode reward: [(0, '-0.684')] [2022-07-13 18:03:28,989][27935] Fps is (10 sec: 4815.2, 60 sec: 4642.1, 300 sec: 4641.0). Total num frames: 407087104. Throughput: 0: 9297.0. Samples: 814184536. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:28,989][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 18:03:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 407110656. Throughput: 0: 9289.7. Samples: 814240720. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:33,989][27935] Avg episode reward: [(0, '-0.675')] [2022-07-13 18:03:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4641.0). Total num frames: 407135232. Throughput: 0: 9297.6. Samples: 814269080. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:38,989][27935] Avg episode reward: [(0, '-0.891')] [2022-07-13 18:03:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 407157760. Throughput: 0: 9309.9. Samples: 814326004. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:43,989][27935] Avg episode reward: [(0, '-1.142')] [2022-07-13 18:03:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4637.5). Total num frames: 407180288. Throughput: 0: 9407.9. Samples: 814382876. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:48,989][27935] Avg episode reward: [(0, '-1.393')] [2022-07-13 18:03:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4644.4). Total num frames: 407204864. Throughput: 0: 9408.4. Samples: 814411140. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:53,989][27935] Avg episode reward: [(0, '-0.685')] [2022-07-13 18:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4658.3). Total num frames: 407228416. Throughput: 0: 9421.3. Samples: 814467436. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:03:58,989][27935] Avg episode reward: [(0, '-1.050')] [2022-07-13 18:04:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4647.9). Total num frames: 407249920. Throughput: 0: 9340.2. Samples: 814519800. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:03,989][27935] Avg episode reward: [(0, '-1.053')] [2022-07-13 18:04:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4644.4). Total num frames: 407273472. Throughput: 0: 9335.5. Samples: 814547724. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:08,989][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 18:04:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4647.9). Total num frames: 407296000. Throughput: 0: 9327.7. Samples: 814604284. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:13,990][27935] Avg episode reward: [(0, '-0.786')] [2022-07-13 18:04:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.8, 300 sec: 4654.9). Total num frames: 407321600. Throughput: 0: 8705.4. Samples: 814632464. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:18,989][27935] Avg episode reward: [(0, '-1.126')] [2022-07-13 18:04:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4654.9). Total num frames: 407345152. Throughput: 0: 9346.8. Samples: 814689684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:23,989][27935] Avg episode reward: [(0, '-1.167')] [2022-07-13 18:04:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4651.4). Total num frames: 407368704. Throughput: 0: 9346.8. Samples: 814746608. Policy #0 lag: (min: 0.0, avg: 8.0, max: 19.0) [2022-07-13 18:04:28,990][27935] Avg episode reward: [(0, '-1.373')] [2022-07-13 18:04:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4651.4). Total num frames: 407391232. Throughput: 0: 9345.3. Samples: 814803416. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:33,989][27935] Avg episode reward: [(0, '-0.336')] [2022-07-13 18:04:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4658.3). Total num frames: 407415808. Throughput: 0: 9349.3. Samples: 814831860. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:38,989][27935] Avg episode reward: [(0, '0.065')] [2022-07-13 18:04:44,001][27935] Fps is (10 sec: 4909.4, 60 sec: 4709.5, 300 sec: 4658.1). Total num frames: 407440384. Throughput: 0: 9359.5. Samples: 814888724. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:44,001][27935] Avg episode reward: [(0, '-0.013')] [2022-07-13 18:04:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4651.4). Total num frames: 407461888. Throughput: 0: 9467.9. Samples: 814945856. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:48,989][27935] Avg episode reward: [(0, '0.108')] [2022-07-13 18:04:53,989][27935] Fps is (10 sec: 4613.4, 60 sec: 4693.3, 300 sec: 4658.3). Total num frames: 407486464. Throughput: 0: 9475.8. Samples: 814974136. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:53,989][27935] Avg episode reward: [(0, '-0.155')] [2022-07-13 18:04:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4665.4). Total num frames: 407510016. Throughput: 0: 9474.5. Samples: 815030636. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:04:58,989][27935] Avg episode reward: [(0, '-0.210')] [2022-07-13 18:05:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4661.8). Total num frames: 407532544. Throughput: 0: 9472.3. Samples: 815058716. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:03,989][27935] Avg episode reward: [(0, '0.056')] [2022-07-13 18:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4661.8). Total num frames: 407556096. Throughput: 0: 9358.9. Samples: 815110836. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:08,989][27935] Avg episode reward: [(0, '-0.162')] [2022-07-13 18:05:13,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4710.4, 300 sec: 4658.4). Total num frames: 407578624. Throughput: 0: 9343.1. Samples: 815167048. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:13,989][27935] Avg episode reward: [(0, '-0.994')] [2022-07-13 18:05:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4658.3). Total num frames: 407602176. Throughput: 0: 9345.1. Samples: 815223944. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:18,989][27935] Avg episode reward: [(0, '-0.759')] [2022-07-13 18:05:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 407626752. Throughput: 0: 9346.8. Samples: 815252468. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:23,989][27935] Avg episode reward: [(0, '-0.815')] [2022-07-13 18:05:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4661.8). Total num frames: 407649280. Throughput: 0: 9349.7. Samples: 815309348. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:28,989][27935] Avg episode reward: [(0, '0.167')] [2022-07-13 18:05:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4658.5). Total num frames: 407672832. Throughput: 0: 9320.3. Samples: 815365268. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:33,989][27935] Avg episode reward: [(0, '0.234')] [2022-07-13 18:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 407697408. Throughput: 0: 9307.6. Samples: 815392980. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:38,989][27935] Avg episode reward: [(0, '0.415')] [2022-07-13 18:05:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4660.1, 300 sec: 4658.3). Total num frames: 407719936. Throughput: 0: 9298.2. Samples: 815449056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:43,990][27935] Avg episode reward: [(0, '0.821')] [2022-07-13 18:05:48,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4651.4). Total num frames: 407741440. Throughput: 0: 9941.2. Samples: 815506072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:48,989][27935] Avg episode reward: [(0, '1.533')] [2022-07-13 18:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4654.9). Total num frames: 407767040. Throughput: 0: 9411.6. Samples: 815534360. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:53,990][27935] Avg episode reward: [(0, '1.539')] [2022-07-13 18:05:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 407788544. Throughput: 0: 9409.3. Samples: 815590464. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:05:58,989][27935] Avg episode reward: [(0, '0.899')] [2022-07-13 18:06:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4642.1, 300 sec: 4654.9). Total num frames: 407811072. Throughput: 0: 9297.0. Samples: 815642308. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:03,990][27935] Avg episode reward: [(0, '-0.088')] [2022-07-13 18:06:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4651.4). Total num frames: 407835648. Throughput: 0: 9286.3. Samples: 815670352. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:08,989][27935] Avg episode reward: [(0, '-0.019')] [2022-07-13 18:06:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4651.4). Total num frames: 407858176. Throughput: 0: 9264.5. Samples: 815726252. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:13,989][27935] Avg episode reward: [(0, '0.230')] [2022-07-13 18:06:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4647.9). Total num frames: 407880704. Throughput: 0: 9275.1. Samples: 815782648. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:18,989][27935] Avg episode reward: [(0, '0.037')] [2022-07-13 18:06:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4654.9). Total num frames: 407905280. Throughput: 0: 9281.0. Samples: 815810624. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:23,990][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 18:06:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4654.9). Total num frames: 407928832. Throughput: 0: 9276.8. Samples: 815866512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:28,990][27935] Avg episode reward: [(0, '-0.452')] [2022-07-13 18:06:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4654.9). Total num frames: 407951360. Throughput: 0: 9253.3. Samples: 815922472. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:33,991][27935] Avg episode reward: [(0, '-1.290')] [2022-07-13 18:06:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4654.9). Total num frames: 407974912. Throughput: 0: 9248.5. Samples: 815950540. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:38,990][27935] Avg episode reward: [(0, '-1.225')] [2022-07-13 18:06:43,992][27935] Fps is (10 sec: 4708.7, 60 sec: 4641.9, 300 sec: 4654.8). Total num frames: 407998464. Throughput: 0: 9244.1. Samples: 816006480. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:43,993][27935] Avg episode reward: [(0, '-0.773')] [2022-07-13 18:06:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4651.4). Total num frames: 408020992. Throughput: 0: 8715.7. Samples: 816034512. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:48,989][27935] Avg episode reward: [(0, '-0.759')] [2022-07-13 18:06:53,989][27935] Fps is (10 sec: 4712.1, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 408045568. Throughput: 0: 9352.7. Samples: 816091224. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:53,989][27935] Avg episode reward: [(0, '-0.673')] [2022-07-13 18:06:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 408068096. Throughput: 0: 9371.3. Samples: 816147960. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:06:58,989][27935] Avg episode reward: [(0, '-0.456')] [2022-07-13 18:07:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 408090624. Throughput: 0: 9302.0. Samples: 816201240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:07:03,989][27935] Avg episode reward: [(0, '-0.151')] [2022-07-13 18:07:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 408114176. Throughput: 0: 9311.8. Samples: 816229656. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 18:07:08,989][27935] Avg episode reward: [(0, '-0.276')] [2022-07-13 18:07:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 408137728. Throughput: 0: 9322.2. Samples: 816286012. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:13,990][27935] Avg episode reward: [(0, '-0.171')] [2022-07-13 18:07:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 408162304. Throughput: 0: 9333.8. Samples: 816342492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:18,989][27935] Avg episode reward: [(0, '0.120')] [2022-07-13 18:07:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 408184832. Throughput: 0: 9345.4. Samples: 816371084. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:23,989][27935] Avg episode reward: [(0, '0.413')] [2022-07-13 18:07:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 408209408. Throughput: 0: 9366.1. Samples: 816427920. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:28,990][27935] Avg episode reward: [(0, '0.291')] [2022-07-13 18:07:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 408231936. Throughput: 0: 9978.1. Samples: 816483528. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:33,989][27935] Avg episode reward: [(0, '0.224')] [2022-07-13 18:07:38,989][27935] Fps is (10 sec: 4505.5, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 408254464. Throughput: 0: 9336.8. Samples: 816511384. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:38,990][27935] Avg episode reward: [(0, '0.674')] [2022-07-13 18:07:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.5, 300 sec: 4672.2). Total num frames: 408279040. Throughput: 0: 9327.8. Samples: 816567712. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:43,989][27935] Avg episode reward: [(0, '1.480')] [2022-07-13 18:07:48,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 408302592. Throughput: 0: 9410.0. Samples: 816624692. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:48,989][27935] Avg episode reward: [(0, '1.488')] [2022-07-13 18:07:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 408326144. Throughput: 0: 9407.0. Samples: 816652972. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:53,989][27935] Avg episode reward: [(0, '0.784')] [2022-07-13 18:07:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4675.7). Total num frames: 408349696. Throughput: 0: 9414.4. Samples: 816709660. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:07:58,989][27935] Avg episode reward: [(0, '0.370')] [2022-07-13 18:08:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4672.2). Total num frames: 408372224. Throughput: 0: 9320.2. Samples: 816761900. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:03,989][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 18:08:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 408394752. Throughput: 0: 9309.4. Samples: 816790008. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:08,990][27935] Avg episode reward: [(0, '0.570')] [2022-07-13 18:08:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4675.8). Total num frames: 408418304. Throughput: 0: 9305.9. Samples: 816846684. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:13,989][27935] Avg episode reward: [(0, '0.428')] [2022-07-13 18:08:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4668.7). Total num frames: 408440832. Throughput: 0: 9294.2. Samples: 816901768. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:18,989][27935] Avg episode reward: [(0, '-1.012')] [2022-07-13 18:08:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 408465408. Throughput: 0: 9304.8. Samples: 816930096. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:23,989][27935] Avg episode reward: [(0, '-0.419')] [2022-07-13 18:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4672.2). Total num frames: 408488960. Throughput: 0: 9320.0. Samples: 816987112. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:28,989][27935] Avg episode reward: [(0, '-0.896')] [2022-07-13 18:08:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4668.7). Total num frames: 408512512. Throughput: 0: 9293.1. Samples: 817042880. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:33,989][27935] Avg episode reward: [(0, '-0.805')] [2022-07-13 18:08:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.4, 300 sec: 4672.2). Total num frames: 408536064. Throughput: 0: 9288.9. Samples: 817070972. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:38,989][27935] Avg episode reward: [(0, '-0.972')] [2022-07-13 18:08:43,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4665.3). Total num frames: 408556544. Throughput: 0: 9270.4. Samples: 817126828. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:43,989][27935] Avg episode reward: [(0, '-1.163')] [2022-07-13 18:08:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4668.7). Total num frames: 408582144. Throughput: 0: 9335.2. Samples: 817181984. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:48,989][27935] Avg episode reward: [(0, '-1.417')] [2022-07-13 18:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4665.3). Total num frames: 408604672. Throughput: 0: 9325.4. Samples: 817209652. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:53,989][27935] Avg episode reward: [(0, '-0.703')] [2022-07-13 18:08:58,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4668.7). Total num frames: 408627200. Throughput: 0: 9291.7. Samples: 817264812. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:08:58,989][27935] Avg episode reward: [(0, '-0.705')] [2022-07-13 18:09:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4665.3). Total num frames: 408649728. Throughput: 0: 9224.7. Samples: 817316880. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:03,989][27935] Avg episode reward: [(0, '-0.338')] [2022-07-13 18:09:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4665.3). Total num frames: 408672256. Throughput: 0: 9214.8. Samples: 817344760. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:08,989][27935] Avg episode reward: [(0, '0.254')] [2022-07-13 18:09:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 408694784. Throughput: 0: 9180.3. Samples: 817400228. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:13,989][27935] Avg episode reward: [(0, '-0.448')] [2022-07-13 18:09:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4654.9). Total num frames: 408718336. Throughput: 0: 9191.1. Samples: 817456480. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:18,989][27935] Avg episode reward: [(0, '-0.486')] [2022-07-13 18:09:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4654.9). Total num frames: 408741888. Throughput: 0: 9199.9. Samples: 817484968. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:23,989][27935] Avg episode reward: [(0, '-0.464')] [2022-07-13 18:09:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 408765440. Throughput: 0: 9220.6. Samples: 817541756. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:28,989][27935] Avg episode reward: [(0, '0.140')] [2022-07-13 18:09:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4658.3). Total num frames: 408790016. Throughput: 0: 9233.6. Samples: 817597496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:33,989][27935] Avg episode reward: [(0, '-1.244')] [2022-07-13 18:09:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4651.6). Total num frames: 408812544. Throughput: 0: 9245.7. Samples: 817625708. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:38,989][27935] Avg episode reward: [(0, '-1.155')] [2022-07-13 18:09:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4654.9). Total num frames: 408835072. Throughput: 0: 9256.2. Samples: 817681340. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:43,990][27935] Avg episode reward: [(0, '-1.188')] [2022-07-13 18:09:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4651.4). Total num frames: 408858624. Throughput: 0: 9334.1. Samples: 817736916. Policy #0 lag: (min: 0.0, avg: 8.8, max: 22.0) [2022-07-13 18:09:48,989][27935] Avg episode reward: [(0, '-0.685')] [2022-07-13 18:09:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4651.4). Total num frames: 408882176. Throughput: 0: 9333.9. Samples: 817764784. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:09:53,989][27935] Avg episode reward: [(0, '-0.607')] [2022-07-13 18:09:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4651.4). Total num frames: 408904704. Throughput: 0: 9335.7. Samples: 817820336. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:09:58,989][27935] Avg episode reward: [(0, '-0.376')] [2022-07-13 18:10:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4608.0, 300 sec: 4644.4). Total num frames: 408926208. Throughput: 0: 9237.4. Samples: 817872164. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:03,989][27935] Avg episode reward: [(0, '1.115')] [2022-07-13 18:10:08,992][27935] Fps is (10 sec: 4504.4, 60 sec: 4624.9, 300 sec: 4647.9). Total num frames: 408949760. Throughput: 0: 9225.0. Samples: 817900120. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:08,993][27935] Avg episode reward: [(0, '1.082')] [2022-07-13 18:10:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4647.9). Total num frames: 408973312. Throughput: 0: 9200.5. Samples: 817955780. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:13,989][27935] Avg episode reward: [(0, '0.999')] [2022-07-13 18:10:18,989][27935] Fps is (10 sec: 4506.8, 60 sec: 4608.0, 300 sec: 4637.5). Total num frames: 408994816. Throughput: 0: 9199.1. Samples: 818011456. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:18,989][27935] Avg episode reward: [(0, '0.958')] [2022-07-13 18:10:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 409018368. Throughput: 0: 9196.9. Samples: 818039568. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:23,989][27935] Avg episode reward: [(0, '1.039')] [2022-07-13 18:10:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4641.0). Total num frames: 409041920. Throughput: 0: 9195.3. Samples: 818095128. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:28,989][27935] Avg episode reward: [(0, '1.353')] [2022-07-13 18:10:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4590.9, 300 sec: 4637.5). Total num frames: 409065472. Throughput: 0: 9174.5. Samples: 818149768. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:33,989][27935] Avg episode reward: [(0, '1.191')] [2022-07-13 18:10:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4637.5). Total num frames: 409088000. Throughput: 0: 9171.4. Samples: 818177496. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:38,989][27935] Avg episode reward: [(0, '0.105')] [2022-07-13 18:10:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4647.9). Total num frames: 409112576. Throughput: 0: 9165.1. Samples: 818232768. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:43,989][27935] Avg episode reward: [(0, '0.118')] [2022-07-13 18:10:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4634.0). Total num frames: 409134080. Throughput: 0: 9233.8. Samples: 818287688. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:48,989][27935] Avg episode reward: [(0, '-0.219')] [2022-07-13 18:10:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4573.9, 300 sec: 4637.5). Total num frames: 409156608. Throughput: 0: 9231.1. Samples: 818315496. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:53,989][27935] Avg episode reward: [(0, '-0.256')] [2022-07-13 18:10:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4641.0). Total num frames: 409180160. Throughput: 0: 9238.4. Samples: 818371508. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:10:58,989][27935] Avg episode reward: [(0, '-0.922')] [2022-07-13 18:11:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4590.9, 300 sec: 4630.6). Total num frames: 409201664. Throughput: 0: 9147.9. Samples: 818423112. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:03,989][27935] Avg episode reward: [(0, '-0.929')] [2022-07-13 18:11:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4574.1, 300 sec: 4630.6). Total num frames: 409224192. Throughput: 0: 9135.9. Samples: 818450684. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:08,989][27935] Avg episode reward: [(0, '-1.295')] [2022-07-13 18:11:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4573.9, 300 sec: 4634.0). Total num frames: 409247744. Throughput: 0: 9124.9. Samples: 818505748. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:13,989][27935] Avg episode reward: [(0, '-0.389')] [2022-07-13 18:11:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4608.0, 300 sec: 4630.6). Total num frames: 409271296. Throughput: 0: 9131.1. Samples: 818560668. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:18,989][27935] Avg episode reward: [(0, '0.941')] [2022-07-13 18:11:23,997][27935] Fps is (10 sec: 4502.1, 60 sec: 4573.3, 300 sec: 4623.5). Total num frames: 409292800. Throughput: 0: 9128.0. Samples: 818588328. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:23,997][27935] Avg episode reward: [(0, '1.218')] [2022-07-13 18:11:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4590.9, 300 sec: 4630.6). Total num frames: 409317376. Throughput: 0: 9137.6. Samples: 818643960. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:28,989][27935] Avg episode reward: [(0, '1.806')] [2022-07-13 18:11:33,989][27935] Fps is (10 sec: 4611.6, 60 sec: 4556.8, 300 sec: 4623.6). Total num frames: 409338880. Throughput: 0: 9131.5. Samples: 818698604. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:33,989][27935] Avg episode reward: [(0, '-1.055')] [2022-07-13 18:11:38,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4556.8, 300 sec: 4620.2). Total num frames: 409361408. Throughput: 0: 9125.4. Samples: 818726140. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:38,989][27935] Avg episode reward: [(0, '-0.800')] [2022-07-13 18:11:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4573.9, 300 sec: 4630.6). Total num frames: 409387008. Throughput: 0: 9119.7. Samples: 818781892. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:43,989][27935] Avg episode reward: [(0, '-1.047')] [2022-07-13 18:11:48,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4573.9, 300 sec: 4620.1). Total num frames: 409408512. Throughput: 0: 9196.0. Samples: 818836932. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:48,990][27935] Avg episode reward: [(0, '-1.351')] [2022-07-13 18:11:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4573.9, 300 sec: 4620.1). Total num frames: 409431040. Throughput: 0: 9184.6. Samples: 818863992. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:53,989][27935] Avg episode reward: [(0, '-1.531')] [2022-07-13 18:11:58,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4590.9, 300 sec: 4627.1). Total num frames: 409455616. Throughput: 0: 9190.1. Samples: 818919304. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:11:58,989][27935] Avg episode reward: [(0, '-1.785')] [2022-07-13 18:12:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4573.9, 300 sec: 4616.7). Total num frames: 409476096. Throughput: 0: 9085.3. Samples: 818969504. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:03,989][27935] Avg episode reward: [(0, '-1.669')] [2022-07-13 18:12:08,989][27935] Fps is (10 sec: 4096.0, 60 sec: 4539.7, 300 sec: 4606.3). Total num frames: 409496576. Throughput: 0: 9075.7. Samples: 818996664. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:08,989][27935] Avg episode reward: [(0, '-1.593')] [2022-07-13 18:12:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4539.7, 300 sec: 4602.8). Total num frames: 409520128. Throughput: 0: 9051.7. Samples: 819051288. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:13,989][27935] Avg episode reward: [(0, '0.639')] [2022-07-13 18:12:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4505.6, 300 sec: 4599.3). Total num frames: 409541632. Throughput: 0: 9036.5. Samples: 819105248. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:18,989][27935] Avg episode reward: [(0, '0.866')] [2022-07-13 18:12:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4557.4, 300 sec: 4599.3). Total num frames: 409566208. Throughput: 0: 9022.3. Samples: 819132144. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:23,989][27935] Avg episode reward: [(0, '0.519')] [2022-07-13 18:12:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4505.6, 300 sec: 4595.9). Total num frames: 409587712. Throughput: 0: 8995.4. Samples: 819186684. Policy #0 lag: (min: 0.0, avg: 10.3, max: 22.0) [2022-07-13 18:12:28,990][27935] Avg episode reward: [(0, '0.390')] [2022-07-13 18:12:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4539.7, 300 sec: 4599.3). Total num frames: 409611264. Throughput: 0: 8982.4. Samples: 819241140. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:33,989][27935] Avg episode reward: [(0, '0.575')] [2022-07-13 18:12:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4556.8, 300 sec: 4595.9). Total num frames: 409634816. Throughput: 0: 8985.5. Samples: 819268340. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:38,989][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 18:12:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4488.5, 300 sec: 4588.9). Total num frames: 409656320. Throughput: 0: 8958.6. Samples: 819322440. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:43,989][27935] Avg episode reward: [(0, '-0.559')] [2022-07-13 18:12:48,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4488.5, 300 sec: 4582.0). Total num frames: 409677824. Throughput: 0: 9077.7. Samples: 819378000. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:48,989][27935] Avg episode reward: [(0, '-0.502')] [2022-07-13 18:12:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4522.7, 300 sec: 4585.4). Total num frames: 409702400. Throughput: 0: 9082.2. Samples: 819405364. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:53,989][27935] Avg episode reward: [(0, '-1.847')] [2022-07-13 18:12:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4471.5, 300 sec: 4582.0). Total num frames: 409723904. Throughput: 0: 9078.6. Samples: 819459824. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:12:58,989][27935] Avg episode reward: [(0, '-1.838')] [2022-07-13 18:13:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4488.5, 300 sec: 4578.5). Total num frames: 409745408. Throughput: 0: 9006.0. Samples: 819510516. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:03,989][27935] Avg episode reward: [(0, '-1.663')] [2022-07-13 18:13:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4539.7, 300 sec: 4578.5). Total num frames: 409768960. Throughput: 0: 9012.6. Samples: 819537712. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:08,989][27935] Avg episode reward: [(0, '-1.597')] [2022-07-13 18:13:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4522.7, 300 sec: 4578.5). Total num frames: 409791488. Throughput: 0: 9002.6. Samples: 819591800. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:13,989][27935] Avg episode reward: [(0, '-0.772')] [2022-07-13 18:13:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4522.7, 300 sec: 4568.1). Total num frames: 409812992. Throughput: 0: 8985.9. Samples: 819645508. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:18,989][27935] Avg episode reward: [(0, '-0.548')] [2022-07-13 18:13:23,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4488.5, 300 sec: 4564.6). Total num frames: 409835520. Throughput: 0: 8986.6. Samples: 819672736. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:23,989][27935] Avg episode reward: [(0, '-0.302')] [2022-07-13 18:13:28,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4522.7, 300 sec: 4564.6). Total num frames: 409859072. Throughput: 0: 8988.4. Samples: 819726916. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:28,989][27935] Avg episode reward: [(0, '0.425')] [2022-07-13 18:13:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4488.5, 300 sec: 4557.7). Total num frames: 409880576. Throughput: 0: 8957.5. Samples: 819781088. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:33,989][27935] Avg episode reward: [(0, '1.045')] [2022-07-13 18:13:38,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4471.5, 300 sec: 4564.6). Total num frames: 409903104. Throughput: 0: 8946.3. Samples: 819807948. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:38,989][27935] Avg episode reward: [(0, '1.264')] [2022-07-13 18:13:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4505.6, 300 sec: 4557.7). Total num frames: 409926656. Throughput: 0: 8925.2. Samples: 819861456. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:43,989][27935] Avg episode reward: [(0, '1.423')] [2022-07-13 18:13:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4505.6, 300 sec: 4554.2). Total num frames: 409948160. Throughput: 0: 9011.5. Samples: 819916032. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:48,989][27935] Avg episode reward: [(0, '1.240')] [2022-07-13 18:13:53,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4471.5, 300 sec: 4554.2). Total num frames: 409970688. Throughput: 0: 9024.3. Samples: 819943804. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:53,989][27935] Avg episode reward: [(0, '1.226')] [2022-07-13 18:13:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4505.6, 300 sec: 4557.7). Total num frames: 409994240. Throughput: 0: 9065.9. Samples: 819999764. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:13:58,989][27935] Avg episode reward: [(0, '1.114')] [2022-07-13 18:14:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4505.6, 300 sec: 4554.2). Total num frames: 410015744. Throughput: 0: 9022.3. Samples: 820051512. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:03,989][27935] Avg episode reward: [(0, '1.016')] [2022-07-13 18:14:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4505.6, 300 sec: 4557.7). Total num frames: 410039296. Throughput: 0: 9040.8. Samples: 820079572. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:08,989][27935] Avg episode reward: [(0, '0.949')] [2022-07-13 18:14:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4505.6, 300 sec: 4554.2). Total num frames: 410061824. Throughput: 0: 9067.3. Samples: 820134944. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:13,989][27935] Avg episode reward: [(0, '1.227')] [2022-07-13 18:14:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4539.7, 300 sec: 4554.2). Total num frames: 410085376. Throughput: 0: 9098.1. Samples: 820190504. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:18,989][27935] Avg episode reward: [(0, '0.998')] [2022-07-13 18:14:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4556.8, 300 sec: 4554.2). Total num frames: 410108928. Throughput: 0: 9113.2. Samples: 820218040. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:23,989][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 18:14:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4522.7, 300 sec: 4543.8). Total num frames: 410130432. Throughput: 0: 9160.1. Samples: 820273660. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:28,989][27935] Avg episode reward: [(0, '-0.404')] [2022-07-13 18:14:33,989][27935] Fps is (10 sec: 4607.8, 60 sec: 4573.8, 300 sec: 4550.7). Total num frames: 410155008. Throughput: 0: 9178.2. Samples: 820329056. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:33,990][27935] Avg episode reward: [(0, '-0.691')] [2022-07-13 18:14:38,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4590.7, 300 sec: 4554.2). Total num frames: 410178560. Throughput: 0: 9179.0. Samples: 820356884. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:38,993][27935] Avg episode reward: [(0, '-0.680')] [2022-07-13 18:14:43,989][27935] Fps is (10 sec: 4608.2, 60 sec: 4573.9, 300 sec: 4550.7). Total num frames: 410201088. Throughput: 0: 9194.2. Samples: 820413504. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:43,989][27935] Avg episode reward: [(0, '-0.700')] [2022-07-13 18:14:48,989][27935] Fps is (10 sec: 4711.7, 60 sec: 4625.1, 300 sec: 4554.2). Total num frames: 410225664. Throughput: 0: 9304.5. Samples: 820470216. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:48,990][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 18:14:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4625.1, 300 sec: 4554.2). Total num frames: 410248192. Throughput: 0: 9315.6. Samples: 820498772. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:53,989][27935] Avg episode reward: [(0, '-0.579')] [2022-07-13 18:14:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4625.1, 300 sec: 4561.1). Total num frames: 410271744. Throughput: 0: 9338.2. Samples: 820555164. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:14:58,989][27935] Avg episode reward: [(0, '-0.419')] [2022-07-13 18:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4557.7). Total num frames: 410294272. Throughput: 0: 9253.2. Samples: 820606896. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:15:03,989][27935] Avg episode reward: [(0, '-0.313')] [2022-07-13 18:15:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4554.2). Total num frames: 410316800. Throughput: 0: 9268.5. Samples: 820635124. Policy #0 lag: (min: 0.0, avg: 8.3, max: 20.0) [2022-07-13 18:15:08,989][27935] Avg episode reward: [(0, '0.501')] [2022-07-13 18:15:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4561.1). Total num frames: 410340352. Throughput: 0: 9286.6. Samples: 820691556. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:13,989][27935] Avg episode reward: [(0, '-0.603')] [2022-07-13 18:15:18,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4659.2, 300 sec: 4564.6). Total num frames: 410364928. Throughput: 0: 9319.9. Samples: 820748448. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:18,989][27935] Avg episode reward: [(0, '-0.243')] [2022-07-13 18:15:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4564.6). Total num frames: 410388480. Throughput: 0: 9329.9. Samples: 820776704. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:23,989][27935] Avg episode reward: [(0, '-0.546')] [2022-07-13 18:15:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4564.6). Total num frames: 410412032. Throughput: 0: 9341.1. Samples: 820833856. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:28,989][27935] Avg episode reward: [(0, '-1.410')] [2022-07-13 18:15:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4564.6). Total num frames: 410434560. Throughput: 0: 9336.3. Samples: 820890348. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:33,989][27935] Avg episode reward: [(0, '-1.478')] [2022-07-13 18:15:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.5, 300 sec: 4564.6). Total num frames: 410459136. Throughput: 0: 9333.5. Samples: 820918780. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:38,989][27935] Avg episode reward: [(0, '-1.015')] [2022-07-13 18:15:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4568.1). Total num frames: 410481664. Throughput: 0: 9323.8. Samples: 820974736. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:43,989][27935] Avg episode reward: [(0, '-0.851')] [2022-07-13 18:15:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4575.0). Total num frames: 410506240. Throughput: 0: 9433.9. Samples: 821031420. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:48,989][27935] Avg episode reward: [(0, '-1.496')] [2022-07-13 18:15:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4571.6). Total num frames: 410528768. Throughput: 0: 9440.8. Samples: 821059960. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:53,989][27935] Avg episode reward: [(0, '-0.268')] [2022-07-13 18:15:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4582.0). Total num frames: 410553344. Throughput: 0: 9433.7. Samples: 821116072. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:15:58,990][27935] Avg episode reward: [(0, '-0.020')] [2022-07-13 18:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4578.5). Total num frames: 410574848. Throughput: 0: 9339.0. Samples: 821168704. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:03,989][27935] Avg episode reward: [(0, '0.988')] [2022-07-13 18:16:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4578.5). Total num frames: 410598400. Throughput: 0: 9335.6. Samples: 821196804. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:08,989][27935] Avg episode reward: [(0, '0.974')] [2022-07-13 18:16:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4578.5). Total num frames: 410621952. Throughput: 0: 9321.2. Samples: 821253312. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:13,990][27935] Avg episode reward: [(0, '0.808')] [2022-07-13 18:16:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4582.1). Total num frames: 410644480. Throughput: 0: 9331.3. Samples: 821310256. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:18,989][27935] Avg episode reward: [(0, '0.885')] [2022-07-13 18:16:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4582.0). Total num frames: 410669056. Throughput: 0: 9329.9. Samples: 821338624. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:23,989][27935] Avg episode reward: [(0, '0.894')] [2022-07-13 18:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4588.9). Total num frames: 410692608. Throughput: 0: 9336.0. Samples: 821394856. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:28,989][27935] Avg episode reward: [(0, '0.774')] [2022-07-13 18:16:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4588.9). Total num frames: 410715136. Throughput: 0: 9324.7. Samples: 821451032. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:33,989][27935] Avg episode reward: [(0, '0.173')] [2022-07-13 18:16:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4585.4). Total num frames: 410739712. Throughput: 0: 9308.2. Samples: 821478828. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:38,989][27935] Avg episode reward: [(0, '-0.804')] [2022-07-13 18:16:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4592.4). Total num frames: 410763264. Throughput: 0: 9321.2. Samples: 821535524. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:43,989][27935] Avg episode reward: [(0, '-0.628')] [2022-07-13 18:16:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4592.4). Total num frames: 410785792. Throughput: 0: 9422.7. Samples: 821592724. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:48,991][27935] Avg episode reward: [(0, '-1.242')] [2022-07-13 18:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4595.9). Total num frames: 410811392. Throughput: 0: 9421.0. Samples: 821620748. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:53,992][27935] Avg episode reward: [(0, '-0.481')] [2022-07-13 18:16:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4599.3). Total num frames: 410832896. Throughput: 0: 9436.8. Samples: 821677968. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:16:58,989][27935] Avg episode reward: [(0, '-0.368')] [2022-07-13 18:17:03,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4659.2, 300 sec: 4602.8). Total num frames: 410854400. Throughput: 0: 9343.7. Samples: 821730724. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:03,989][27935] Avg episode reward: [(0, '0.096')] [2022-07-13 18:17:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4606.3). Total num frames: 410878976. Throughput: 0: 9347.3. Samples: 821759252. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:08,989][27935] Avg episode reward: [(0, '0.829')] [2022-07-13 18:17:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4710.4, 300 sec: 4620.1). Total num frames: 410904576. Throughput: 0: 9355.6. Samples: 821815856. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:13,989][27935] Avg episode reward: [(0, '0.097')] [2022-07-13 18:17:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4606.3). Total num frames: 410925056. Throughput: 0: 9271.7. Samples: 821868260. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:18,989][27935] Avg episode reward: [(0, '0.449')] [2022-07-13 18:17:23,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4613.2). Total num frames: 410948608. Throughput: 0: 9285.8. Samples: 821896688. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:23,989][27935] Avg episode reward: [(0, '0.570')] [2022-07-13 18:17:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4613.2). Total num frames: 410972160. Throughput: 0: 9282.0. Samples: 821953216. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:28,989][27935] Avg episode reward: [(0, '-0.171')] [2022-07-13 18:17:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4609.7). Total num frames: 410994688. Throughput: 0: 9273.4. Samples: 822010028. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:33,989][27935] Avg episode reward: [(0, '-0.286')] [2022-07-13 18:17:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4620.1). Total num frames: 411019264. Throughput: 0: 9281.4. Samples: 822038412. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:38,990][27935] Avg episode reward: [(0, '-0.173')] [2022-07-13 18:17:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4630.6). Total num frames: 411043840. Throughput: 0: 9257.2. Samples: 822094544. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:43,989][27935] Avg episode reward: [(0, '0.627')] [2022-07-13 18:17:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4620.1). Total num frames: 411065344. Throughput: 0: 9347.1. Samples: 822151344. Policy #0 lag: (min: 0.0, avg: 9.2, max: 18.0) [2022-07-13 18:17:48,996][27935] Avg episode reward: [(0, '0.234')] [2022-07-13 18:17:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4630.6). Total num frames: 411089920. Throughput: 0: 9341.4. Samples: 822179616. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:17:53,989][27935] Avg episode reward: [(0, '0.671')] [2022-07-13 18:17:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4637.5). Total num frames: 411113472. Throughput: 0: 9346.6. Samples: 822236452. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:17:58,990][27935] Avg episode reward: [(0, '0.856')] [2022-07-13 18:18:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4627.1). Total num frames: 411133952. Throughput: 0: 9356.0. Samples: 822289280. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:03,989][27935] Avg episode reward: [(0, '0.897')] [2022-07-13 18:18:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4642.1, 300 sec: 4630.6). Total num frames: 411157504. Throughput: 0: 9351.4. Samples: 822317500. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:08,989][27935] Avg episode reward: [(0, '1.058')] [2022-07-13 18:18:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 411183104. Throughput: 0: 9357.6. Samples: 822374308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:13,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 18:18:18,993][27935] Fps is (10 sec: 4810.9, 60 sec: 4676.0, 300 sec: 4644.4). Total num frames: 411205632. Throughput: 0: 9355.5. Samples: 822431060. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:18,993][27935] Avg episode reward: [(0, '0.145')] [2022-07-13 18:18:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4647.9). Total num frames: 411230208. Throughput: 0: 9356.9. Samples: 822459472. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:23,989][27935] Avg episode reward: [(0, '0.588')] [2022-07-13 18:18:28,989][27935] Fps is (10 sec: 4507.4, 60 sec: 4642.1, 300 sec: 4644.4). Total num frames: 411250688. Throughput: 0: 9350.1. Samples: 822515300. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:28,989][27935] Avg episode reward: [(0, '-0.173')] [2022-07-13 18:18:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4654.9). Total num frames: 411276288. Throughput: 0: 9333.1. Samples: 822571332. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:33,989][27935] Avg episode reward: [(0, '0.702')] [2022-07-13 18:18:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4647.9). Total num frames: 411297792. Throughput: 0: 9326.6. Samples: 822599312. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:38,989][27935] Avg episode reward: [(0, '0.488')] [2022-07-13 18:18:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 411323392. Throughput: 0: 9292.3. Samples: 822654604. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:43,996][27935] Avg episode reward: [(0, '0.676')] [2022-07-13 18:18:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4661.8). Total num frames: 411345920. Throughput: 0: 8746.7. Samples: 822682880. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:48,989][27935] Avg episode reward: [(0, '1.444')] [2022-07-13 18:18:53,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 411369472. Throughput: 0: 9382.6. Samples: 822739720. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:53,990][27935] Avg episode reward: [(0, '0.883')] [2022-07-13 18:18:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4668.7). Total num frames: 411393024. Throughput: 0: 9369.4. Samples: 822795932. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:18:58,989][27935] Avg episode reward: [(0, '0.694')] [2022-07-13 18:19:03,989][27935] Fps is (10 sec: 4403.3, 60 sec: 4659.2, 300 sec: 4658.3). Total num frames: 411413504. Throughput: 0: 9268.0. Samples: 822848084. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:03,990][27935] Avg episode reward: [(0, '1.007')] [2022-07-13 18:19:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 411437056. Throughput: 0: 9266.5. Samples: 822876464. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:08,990][27935] Avg episode reward: [(0, '1.492')] [2022-07-13 18:19:13,991][27935] Fps is (10 sec: 4709.4, 60 sec: 4624.9, 300 sec: 4661.8). Total num frames: 411460608. Throughput: 0: 9289.5. Samples: 822933348. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:13,991][27935] Avg episode reward: [(0, '1.302')] [2022-07-13 18:19:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.6, 300 sec: 4668.7). Total num frames: 411486208. Throughput: 0: 8672.4. Samples: 822961592. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:18,989][27935] Avg episode reward: [(0, '0.717')] [2022-07-13 18:19:23,989][27935] Fps is (10 sec: 4916.2, 60 sec: 4659.2, 300 sec: 4675.7). Total num frames: 411509760. Throughput: 0: 9310.5. Samples: 823018284. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:23,989][27935] Avg episode reward: [(0, '1.062')] [2022-07-13 18:19:28,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 411531264. Throughput: 0: 9322.4. Samples: 823074112. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:28,989][27935] Avg episode reward: [(0, '1.165')] [2022-07-13 18:19:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4665.3). Total num frames: 411554816. Throughput: 0: 9949.5. Samples: 823130608. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:33,990][27935] Avg episode reward: [(0, '0.592')] [2022-07-13 18:19:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4668.7). Total num frames: 411578368. Throughput: 0: 9302.2. Samples: 823158316. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:38,991][27935] Avg episode reward: [(0, '0.288')] [2022-07-13 18:19:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4665.3). Total num frames: 411601920. Throughput: 0: 9285.9. Samples: 823213796. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:43,990][27935] Avg episode reward: [(0, '-0.563')] [2022-07-13 18:19:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4668.7). Total num frames: 411625472. Throughput: 0: 9361.0. Samples: 823269328. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:48,991][27935] Avg episode reward: [(0, '-0.828')] [2022-07-13 18:19:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4668.7). Total num frames: 411649024. Throughput: 0: 9356.2. Samples: 823297492. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:53,990][27935] Avg episode reward: [(0, '-0.844')] [2022-07-13 18:19:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4668.7). Total num frames: 411671552. Throughput: 0: 9339.1. Samples: 823353588. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:19:58,991][27935] Avg episode reward: [(0, '-0.222')] [2022-07-13 18:20:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 411693056. Throughput: 0: 9867.1. Samples: 823405612. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:03,991][27935] Avg episode reward: [(0, '-0.962')] [2022-07-13 18:20:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4668.7). Total num frames: 411717632. Throughput: 0: 9237.6. Samples: 823433976. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:08,990][27935] Avg episode reward: [(0, '-0.875')] [2022-07-13 18:20:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.4, 300 sec: 4661.8). Total num frames: 411740160. Throughput: 0: 9253.9. Samples: 823490540. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:13,989][27935] Avg episode reward: [(0, '-0.002')] [2022-07-13 18:20:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4608.0, 300 sec: 4658.3). Total num frames: 411762688. Throughput: 0: 9244.5. Samples: 823546612. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:18,989][27935] Avg episode reward: [(0, '0.018')] [2022-07-13 18:20:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4642.1, 300 sec: 4665.3). Total num frames: 411788288. Throughput: 0: 9255.5. Samples: 823574812. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:23,989][27935] Avg episode reward: [(0, '-1.283')] [2022-07-13 18:20:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 411810816. Throughput: 0: 9279.8. Samples: 823631388. Policy #0 lag: (min: 0.0, avg: 10.0, max: 21.0) [2022-07-13 18:20:28,989][27935] Avg episode reward: [(0, '-1.407')] [2022-07-13 18:20:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4658.3). Total num frames: 411833344. Throughput: 0: 9292.3. Samples: 823687480. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:33,989][27935] Avg episode reward: [(0, '-2.190')] [2022-07-13 18:20:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4661.8). Total num frames: 411856896. Throughput: 0: 9288.6. Samples: 823715480. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:38,989][27935] Avg episode reward: [(0, '-1.809')] [2022-07-13 18:20:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4658.3). Total num frames: 411880448. Throughput: 0: 9305.4. Samples: 823772332. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:43,990][27935] Avg episode reward: [(0, '-1.763')] [2022-07-13 18:20:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4665.3). Total num frames: 411905024. Throughput: 0: 9403.7. Samples: 823828776. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:48,989][27935] Avg episode reward: [(0, '-1.878')] [2022-07-13 18:20:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4661.8). Total num frames: 411928576. Throughput: 0: 9408.9. Samples: 823857376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:53,989][27935] Avg episode reward: [(0, '-1.835')] [2022-07-13 18:20:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4668.7). Total num frames: 411952128. Throughput: 0: 9417.7. Samples: 823914336. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:20:58,989][27935] Avg episode reward: [(0, '-1.657')] [2022-07-13 18:21:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4665.3). Total num frames: 411974656. Throughput: 0: 9350.1. Samples: 823967368. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:03,989][27935] Avg episode reward: [(0, '-0.869')] [2022-07-13 18:21:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 411998208. Throughput: 0: 9352.4. Samples: 823995668. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:08,989][27935] Avg episode reward: [(0, '-0.881')] [2022-07-13 18:21:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 412020736. Throughput: 0: 9349.6. Samples: 824052120. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:13,989][27935] Avg episode reward: [(0, '-1.165')] [2022-07-13 18:21:18,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4654.9). Total num frames: 412042240. Throughput: 0: 9351.8. Samples: 824108312. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:18,989][27935] Avg episode reward: [(0, '-1.509')] [2022-07-13 18:21:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 412068864. Throughput: 0: 9351.3. Samples: 824136288. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:23,989][27935] Avg episode reward: [(0, '-0.591')] [2022-07-13 18:21:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 412091392. Throughput: 0: 9332.8. Samples: 824192308. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:28,989][27935] Avg episode reward: [(0, '0.414')] [2022-07-13 18:21:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4661.8). Total num frames: 412114944. Throughput: 0: 9319.4. Samples: 824248148. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:33,989][27935] Avg episode reward: [(0, '0.876')] [2022-07-13 18:21:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4661.8). Total num frames: 412138496. Throughput: 0: 9312.2. Samples: 824276424. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:38,989][27935] Avg episode reward: [(0, '0.257')] [2022-07-13 18:21:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4661.8). Total num frames: 412161024. Throughput: 0: 9317.9. Samples: 824333640. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:43,989][27935] Avg episode reward: [(0, '0.484')] [2022-07-13 18:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4661.8). Total num frames: 412186624. Throughput: 0: 9398.6. Samples: 824390304. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:48,989][27935] Avg episode reward: [(0, '0.871')] [2022-07-13 18:21:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 412209152. Throughput: 0: 9396.1. Samples: 824418492. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:53,989][27935] Avg episode reward: [(0, '0.973')] [2022-07-13 18:21:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 412232704. Throughput: 0: 9400.3. Samples: 824475132. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:21:58,990][27935] Avg episode reward: [(0, '1.097')] [2022-07-13 18:22:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4665.3). Total num frames: 412255232. Throughput: 0: 9346.9. Samples: 824528924. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:03,989][27935] Avg episode reward: [(0, '1.132')] [2022-07-13 18:22:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4654.9). Total num frames: 412277760. Throughput: 0: 9373.5. Samples: 824558096. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:08,989][27935] Avg episode reward: [(0, '1.201')] [2022-07-13 18:22:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 412302336. Throughput: 0: 9411.6. Samples: 824615828. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:13,989][27935] Avg episode reward: [(0, '1.526')] [2022-07-13 18:22:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4668.7). Total num frames: 412325888. Throughput: 0: 9437.4. Samples: 824672832. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:18,999][27935] Avg episode reward: [(0, '0.565')] [2022-07-13 18:22:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4675.7). Total num frames: 412351488. Throughput: 0: 9448.7. Samples: 824701616. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:23,989][27935] Avg episode reward: [(0, '-0.188')] [2022-07-13 18:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4679.2). Total num frames: 412375040. Throughput: 0: 9441.6. Samples: 824758512. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:28,989][27935] Avg episode reward: [(0, '-0.175')] [2022-07-13 18:22:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 412396544. Throughput: 0: 9446.0. Samples: 824815376. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:33,989][27935] Avg episode reward: [(0, '-0.045')] [2022-07-13 18:22:38,990][27935] Fps is (10 sec: 4709.7, 60 sec: 4727.4, 300 sec: 4672.2). Total num frames: 412422144. Throughput: 0: 9453.2. Samples: 824843900. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:38,991][27935] Avg episode reward: [(0, '-0.121')] [2022-07-13 18:22:43,989][27935] Fps is (10 sec: 5119.9, 60 sec: 4778.7, 300 sec: 4686.1). Total num frames: 412447744. Throughput: 0: 9489.0. Samples: 824902140. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:43,990][27935] Avg episode reward: [(0, '0.122')] [2022-07-13 18:22:48,989][27935] Fps is (10 sec: 5018.4, 60 sec: 4761.6, 300 sec: 4686.1). Total num frames: 412472320. Throughput: 0: 9614.2. Samples: 824961560. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:48,990][27935] Avg episode reward: [(0, '-0.131')] [2022-07-13 18:22:53,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4761.6, 300 sec: 4682.6). Total num frames: 412494848. Throughput: 0: 9647.7. Samples: 824992244. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:53,989][27935] Avg episode reward: [(0, '0.259')] [2022-07-13 18:22:58,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4795.7, 300 sec: 4700.0). Total num frames: 412520448. Throughput: 0: 9666.8. Samples: 825050832. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:22:58,989][27935] Avg episode reward: [(0, '0.898')] [2022-07-13 18:23:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4693.0). Total num frames: 412541952. Throughput: 0: 9624.0. Samples: 825105912. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:23:03,989][27935] Avg episode reward: [(0, '1.036')] [2022-07-13 18:23:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4689.6). Total num frames: 412566528. Throughput: 0: 9600.8. Samples: 825133652. Policy #0 lag: (min: 0.0, avg: 10.0, max: 22.0) [2022-07-13 18:23:08,989][27935] Avg episode reward: [(0, '0.661')] [2022-07-13 18:23:14,003][27935] Fps is (10 sec: 4908.5, 60 sec: 4811.7, 300 sec: 4696.4). Total num frames: 412591104. Throughput: 0: 9542.6. Samples: 825188060. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:14,003][27935] Avg episode reward: [(0, '0.248')] [2022-07-13 18:23:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4686.1). Total num frames: 412612608. Throughput: 0: 9488.8. Samples: 825242372. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:18,989][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 18:23:23,989][27935] Fps is (10 sec: 4409.3, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 412635136. Throughput: 0: 9468.2. Samples: 825269956. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:23,989][27935] Avg episode reward: [(0, '0.869')] [2022-07-13 18:23:28,992][27935] Fps is (10 sec: 4401.9, 60 sec: 4693.1, 300 sec: 4679.1). Total num frames: 412656640. Throughput: 0: 9392.7. Samples: 825324836. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:29,000][27935] Avg episode reward: [(0, '0.748')] [2022-07-13 18:23:33,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 4682.6). Total num frames: 412679168. Throughput: 0: 9292.9. Samples: 825379740. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:33,989][27935] Avg episode reward: [(0, '0.825')] [2022-07-13 18:23:38,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4710.5, 300 sec: 4682.6). Total num frames: 412704768. Throughput: 0: 9241.0. Samples: 825408088. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:38,989][27935] Avg episode reward: [(0, '0.770')] [2022-07-13 18:23:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4686.1). Total num frames: 412728320. Throughput: 0: 9229.5. Samples: 825466160. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:43,989][27935] Avg episode reward: [(0, '0.905')] [2022-07-13 18:23:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4689.6). Total num frames: 412752896. Throughput: 0: 9276.2. Samples: 825523340. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:48,989][27935] Avg episode reward: [(0, '-0.193')] [2022-07-13 18:23:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4686.1). Total num frames: 412775424. Throughput: 0: 9304.9. Samples: 825552372. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:53,989][27935] Avg episode reward: [(0, '0.113')] [2022-07-13 18:23:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4696.5). Total num frames: 412798976. Throughput: 0: 9347.6. Samples: 825608572. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:23:58,989][27935] Avg episode reward: [(0, '-0.167')] [2022-07-13 18:24:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4693.0). Total num frames: 412821504. Throughput: 0: 9313.8. Samples: 825661492. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:03,989][27935] Avg episode reward: [(0, '-0.710')] [2022-07-13 18:24:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4689.6). Total num frames: 412844032. Throughput: 0: 9318.1. Samples: 825689272. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:08,989][27935] Avg episode reward: [(0, '-1.081')] [2022-07-13 18:24:13,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4592.0, 300 sec: 4679.2). Total num frames: 412866560. Throughput: 0: 9338.6. Samples: 825745044. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:13,989][27935] Avg episode reward: [(0, '-1.097')] [2022-07-13 18:24:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4682.6). Total num frames: 412891136. Throughput: 0: 9358.8. Samples: 825800884. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:18,990][27935] Avg episode reward: [(0, '-1.014')] [2022-07-13 18:24:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4689.6). Total num frames: 412914688. Throughput: 0: 9353.2. Samples: 825828980. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:23,996][27935] Avg episode reward: [(0, '0.154')] [2022-07-13 18:24:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.5, 300 sec: 4686.1). Total num frames: 412937216. Throughput: 0: 9314.0. Samples: 825885288. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:28,989][27935] Avg episode reward: [(0, '0.255')] [2022-07-13 18:24:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4689.6). Total num frames: 412961792. Throughput: 0: 9298.0. Samples: 825941748. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:33,989][27935] Avg episode reward: [(0, '1.050')] [2022-07-13 18:24:38,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4659.0, 300 sec: 4686.1). Total num frames: 412984320. Throughput: 0: 9275.5. Samples: 825969792. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:38,992][27935] Avg episode reward: [(0, '0.498')] [2022-07-13 18:24:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4689.6). Total num frames: 413008896. Throughput: 0: 9286.0. Samples: 826026440. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:43,989][27935] Avg episode reward: [(0, '-0.218')] [2022-07-13 18:24:49,000][27935] Fps is (10 sec: 4706.4, 60 sec: 4641.3, 300 sec: 4685.9). Total num frames: 413031424. Throughput: 0: 9361.0. Samples: 826082840. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:49,000][27935] Avg episode reward: [(0, '-0.763')] [2022-07-13 18:24:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4689.6). Total num frames: 413054976. Throughput: 0: 9375.6. Samples: 826111172. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:53,989][27935] Avg episode reward: [(0, '-0.687')] [2022-07-13 18:24:58,989][27935] Fps is (10 sec: 4818.0, 60 sec: 4676.3, 300 sec: 4700.0). Total num frames: 413079552. Throughput: 0: 9393.9. Samples: 826167768. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:24:58,989][27935] Avg episode reward: [(0, '-1.347')] [2022-07-13 18:25:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4686.1). Total num frames: 413100032. Throughput: 0: 9315.4. Samples: 826220076. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:03,989][27935] Avg episode reward: [(0, '-1.878')] [2022-07-13 18:25:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4693.0). Total num frames: 413124608. Throughput: 0: 9325.2. Samples: 826248612. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:08,990][27935] Avg episode reward: [(0, '-2.470')] [2022-07-13 18:25:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 413148160. Throughput: 0: 9318.1. Samples: 826304604. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:13,990][27935] Avg episode reward: [(0, '-1.062')] [2022-07-13 18:25:18,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4659.2, 300 sec: 4686.1). Total num frames: 413170688. Throughput: 0: 9320.7. Samples: 826361180. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:18,989][27935] Avg episode reward: [(0, '-0.744')] [2022-07-13 18:25:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4689.6). Total num frames: 413194240. Throughput: 0: 9326.7. Samples: 826389472. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:23,989][27935] Avg episode reward: [(0, '-0.553')] [2022-07-13 18:25:28,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4676.3, 300 sec: 4693.0). Total num frames: 413217792. Throughput: 0: 9325.2. Samples: 826446076. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:28,989][27935] Avg episode reward: [(0, '-0.860')] [2022-07-13 18:25:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4642.1, 300 sec: 4689.6). Total num frames: 413240320. Throughput: 0: 9314.8. Samples: 826501904. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:33,989][27935] Avg episode reward: [(0, '-0.762')] [2022-07-13 18:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.4, 300 sec: 4693.0). Total num frames: 413264896. Throughput: 0: 9309.2. Samples: 826530084. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:38,989][27935] Avg episode reward: [(0, '-0.363')] [2022-07-13 18:25:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4686.1). Total num frames: 413287424. Throughput: 0: 9315.9. Samples: 826586984. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:43,989][27935] Avg episode reward: [(0, '-0.030')] [2022-07-13 18:25:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4660.0, 300 sec: 4686.1). Total num frames: 413310976. Throughput: 0: 9373.2. Samples: 826641872. Policy #0 lag: (min: 0.0, avg: 6.8, max: 19.0) [2022-07-13 18:25:48,989][27935] Avg episode reward: [(0, '0.154')] [2022-07-13 18:25:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4686.1). Total num frames: 413334528. Throughput: 0: 9359.9. Samples: 826669808. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:25:53,989][27935] Avg episode reward: [(0, '0.004')] [2022-07-13 18:25:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4689.6). Total num frames: 413358080. Throughput: 0: 9368.4. Samples: 826726180. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:25:58,989][27935] Avg episode reward: [(0, '0.772')] [2022-07-13 18:26:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.2, 300 sec: 4682.6). Total num frames: 413379584. Throughput: 0: 9274.1. Samples: 826778512. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:03,989][27935] Avg episode reward: [(0, '0.615')] [2022-07-13 18:26:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4625.1, 300 sec: 4682.6). Total num frames: 413402112. Throughput: 0: 9269.2. Samples: 826806584. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:08,989][27935] Avg episode reward: [(0, '0.724')] [2022-07-13 18:26:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4693.0). Total num frames: 413426688. Throughput: 0: 9255.5. Samples: 826862572. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:13,989][27935] Avg episode reward: [(0, '1.001')] [2022-07-13 18:26:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4679.2). Total num frames: 413449216. Throughput: 0: 9257.4. Samples: 826918488. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:18,989][27935] Avg episode reward: [(0, '0.572')] [2022-07-13 18:26:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4686.1). Total num frames: 413473792. Throughput: 0: 9263.5. Samples: 826946940. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:24,000][27935] Avg episode reward: [(0, '0.675')] [2022-07-13 18:26:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4642.1, 300 sec: 4682.6). Total num frames: 413496320. Throughput: 0: 9259.6. Samples: 827003664. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:28,989][27935] Avg episode reward: [(0, '0.812')] [2022-07-13 18:26:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4682.6). Total num frames: 413519872. Throughput: 0: 9297.9. Samples: 827060276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:33,989][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 18:26:38,990][27935] Fps is (10 sec: 4812.3, 60 sec: 4659.1, 300 sec: 4689.6). Total num frames: 413544448. Throughput: 0: 9309.3. Samples: 827088736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:38,990][27935] Avg episode reward: [(0, '0.535')] [2022-07-13 18:26:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 413569024. Throughput: 0: 9315.9. Samples: 827145396. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:43,989][27935] Avg episode reward: [(0, '-0.410')] [2022-07-13 18:26:48,990][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.2, 300 sec: 4686.1). Total num frames: 413591552. Throughput: 0: 9412.8. Samples: 827202096. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:48,990][27935] Avg episode reward: [(0, '0.041')] [2022-07-13 18:26:54,001][27935] Fps is (10 sec: 4602.6, 60 sec: 4675.3, 300 sec: 4685.9). Total num frames: 413615104. Throughput: 0: 9421.6. Samples: 827230668. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:54,001][27935] Avg episode reward: [(0, '0.215')] [2022-07-13 18:26:58,989][27935] Fps is (10 sec: 4710.9, 60 sec: 4676.3, 300 sec: 4689.6). Total num frames: 413638656. Throughput: 0: 9452.0. Samples: 827287912. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:26:58,989][27935] Avg episode reward: [(0, '-0.346')] [2022-07-13 18:27:03,989][27935] Fps is (10 sec: 4716.0, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 413662208. Throughput: 0: 8844.0. Samples: 827316468. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:03,989][27935] Avg episode reward: [(0, '-0.440')] [2022-07-13 18:27:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4689.6). Total num frames: 413685760. Throughput: 0: 9396.4. Samples: 827369776. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:08,989][27935] Avg episode reward: [(0, '-0.774')] [2022-07-13 18:27:13,991][27935] Fps is (10 sec: 4504.5, 60 sec: 4676.1, 300 sec: 4682.6). Total num frames: 413707264. Throughput: 0: 9403.4. Samples: 827426840. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:13,992][27935] Avg episode reward: [(0, '-1.990')] [2022-07-13 18:27:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4682.6). Total num frames: 413732864. Throughput: 0: 9413.2. Samples: 827483872. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:18,990][27935] Avg episode reward: [(0, '-0.613')] [2022-07-13 18:27:23,989][27935] Fps is (10 sec: 4814.0, 60 sec: 4693.3, 300 sec: 4679.2). Total num frames: 413755392. Throughput: 0: 9419.7. Samples: 827512612. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:23,989][27935] Avg episode reward: [(0, '-1.046')] [2022-07-13 18:27:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4689.6). Total num frames: 413779968. Throughput: 0: 9432.5. Samples: 827569860. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:28,993][27935] Avg episode reward: [(0, '-1.362')] [2022-07-13 18:27:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4682.7). Total num frames: 413803520. Throughput: 0: 9420.7. Samples: 827626016. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:33,989][27935] Avg episode reward: [(0, '-1.641')] [2022-07-13 18:27:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.5, 300 sec: 4675.7). Total num frames: 413827072. Throughput: 0: 9412.6. Samples: 827654124. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:38,989][27935] Avg episode reward: [(0, '-1.403')] [2022-07-13 18:27:43,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4693.2, 300 sec: 4672.2). Total num frames: 413850624. Throughput: 0: 9384.7. Samples: 827710244. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:43,992][27935] Avg episode reward: [(0, '-0.230')] [2022-07-13 18:27:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.5, 300 sec: 4675.7). Total num frames: 413874176. Throughput: 0: 10004.6. Samples: 827766676. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:48,989][27935] Avg episode reward: [(0, '0.044')] [2022-07-13 18:27:53,989][27935] Fps is (10 sec: 4506.6, 60 sec: 4677.2, 300 sec: 4661.8). Total num frames: 413895680. Throughput: 0: 9454.7. Samples: 827795236. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:53,989][27935] Avg episode reward: [(0, '0.320')] [2022-07-13 18:27:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4679.2). Total num frames: 413922304. Throughput: 0: 9456.0. Samples: 827852336. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:27:58,989][27935] Avg episode reward: [(0, '0.484')] [2022-07-13 18:28:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4668.7). Total num frames: 413943808. Throughput: 0: 9372.9. Samples: 827905652. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:03,989][27935] Avg episode reward: [(0, '1.522')] [2022-07-13 18:28:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4669.0). Total num frames: 413968384. Throughput: 0: 9362.0. Samples: 827933900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:08,989][27935] Avg episode reward: [(0, '1.799')] [2022-07-13 18:28:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4727.6, 300 sec: 4672.2). Total num frames: 413990912. Throughput: 0: 9346.7. Samples: 827990464. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:13,989][27935] Avg episode reward: [(0, '1.872')] [2022-07-13 18:28:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4672.2). Total num frames: 414013440. Throughput: 0: 9354.1. Samples: 828046952. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:18,990][27935] Avg episode reward: [(0, '1.723')] [2022-07-13 18:28:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4679.2). Total num frames: 414036992. Throughput: 0: 9358.8. Samples: 828075272. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:23,989][27935] Avg episode reward: [(0, '1.263')] [2022-07-13 18:28:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 414061568. Throughput: 0: 9381.0. Samples: 828132368. Policy #0 lag: (min: 0.0, avg: 8.7, max: 22.0) [2022-07-13 18:28:28,989][27935] Avg episode reward: [(0, '0.086')] [2022-07-13 18:28:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4675.7). Total num frames: 414084096. Throughput: 0: 8757.4. Samples: 828160760. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:33,989][27935] Avg episode reward: [(0, '-0.426')] [2022-07-13 18:28:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4686.1). Total num frames: 414110720. Throughput: 0: 9398.0. Samples: 828218144. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:38,989][27935] Avg episode reward: [(0, '-1.514')] [2022-07-13 18:28:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.5, 300 sec: 4675.7). Total num frames: 414132224. Throughput: 0: 9391.5. Samples: 828274952. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:43,989][27935] Avg episode reward: [(0, '-1.351')] [2022-07-13 18:28:48,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4675.7). Total num frames: 414154752. Throughput: 0: 9469.6. Samples: 828331784. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:48,989][27935] Avg episode reward: [(0, '-1.563')] [2022-07-13 18:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4682.6). Total num frames: 414180352. Throughput: 0: 9478.0. Samples: 828360408. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:53,989][27935] Avg episode reward: [(0, '-1.415')] [2022-07-13 18:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4682.6). Total num frames: 414202880. Throughput: 0: 9478.0. Samples: 828416972. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:28:58,989][27935] Avg episode reward: [(0, '-1.504')] [2022-07-13 18:29:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4682.6). Total num frames: 414225408. Throughput: 0: 9396.6. Samples: 828469800. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:03,991][27935] Avg episode reward: [(0, '-0.356')] [2022-07-13 18:29:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4686.1). Total num frames: 414248960. Throughput: 0: 9402.7. Samples: 828498396. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:08,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 18:29:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4682.6). Total num frames: 414272512. Throughput: 0: 9395.5. Samples: 828555164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:13,989][27935] Avg episode reward: [(0, '1.197')] [2022-07-13 18:29:18,989][27935] Fps is (10 sec: 4607.7, 60 sec: 4693.3, 300 sec: 4679.1). Total num frames: 414295040. Throughput: 0: 10033.6. Samples: 828612280. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:18,991][27935] Avg episode reward: [(0, '1.001')] [2022-07-13 18:29:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4686.1). Total num frames: 414319616. Throughput: 0: 9390.9. Samples: 828640736. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:23,989][27935] Avg episode reward: [(0, '0.423')] [2022-07-13 18:29:28,989][27935] Fps is (10 sec: 4813.1, 60 sec: 4693.3, 300 sec: 4682.6). Total num frames: 414343168. Throughput: 0: 9387.4. Samples: 828697384. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:28,989][27935] Avg episode reward: [(0, '0.172')] [2022-07-13 18:29:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4686.1). Total num frames: 414366720. Throughput: 0: 9369.0. Samples: 828753388. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:33,990][27935] Avg episode reward: [(0, '0.607')] [2022-07-13 18:29:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4682.6). Total num frames: 414390272. Throughput: 0: 9358.3. Samples: 828781532. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:38,989][27935] Avg episode reward: [(0, '0.693')] [2022-07-13 18:29:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4686.3). Total num frames: 414413824. Throughput: 0: 9363.6. Samples: 828838332. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:43,990][27935] Avg episode reward: [(0, '0.911')] [2022-07-13 18:29:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4686.1). Total num frames: 414437376. Throughput: 0: 9443.5. Samples: 828894756. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:48,989][27935] Avg episode reward: [(0, '0.678')] [2022-07-13 18:29:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 414461952. Throughput: 0: 9441.5. Samples: 828923264. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:53,989][27935] Avg episode reward: [(0, '0.488')] [2022-07-13 18:29:58,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4693.3, 300 sec: 4693.0). Total num frames: 414484480. Throughput: 0: 9447.6. Samples: 828980308. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:29:58,990][27935] Avg episode reward: [(0, '0.593')] [2022-07-13 18:30:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 414507008. Throughput: 0: 9358.0. Samples: 829033384. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:03,989][27935] Avg episode reward: [(0, '0.675')] [2022-07-13 18:30:08,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 414530560. Throughput: 0: 9362.7. Samples: 829062056. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:08,989][27935] Avg episode reward: [(0, '0.920')] [2022-07-13 18:30:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4686.1). Total num frames: 414553088. Throughput: 0: 9363.2. Samples: 829118728. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:13,989][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 18:30:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 414578688. Throughput: 0: 9381.7. Samples: 829175564. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:18,989][27935] Avg episode reward: [(0, '-0.689')] [2022-07-13 18:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 414602240. Throughput: 0: 9391.8. Samples: 829204164. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:23,989][27935] Avg episode reward: [(0, '-1.369')] [2022-07-13 18:30:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 414625792. Throughput: 0: 9391.8. Samples: 829260964. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:28,989][27935] Avg episode reward: [(0, '-1.189')] [2022-07-13 18:30:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 414649344. Throughput: 0: 9405.7. Samples: 829318012. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:33,989][27935] Avg episode reward: [(0, '-1.192')] [2022-07-13 18:30:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 414672896. Throughput: 0: 9410.7. Samples: 829346744. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:38,989][27935] Avg episode reward: [(0, '-1.148')] [2022-07-13 18:30:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 414696448. Throughput: 0: 9420.9. Samples: 829404244. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:43,989][27935] Avg episode reward: [(0, '-1.407')] [2022-07-13 18:30:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 414721024. Throughput: 0: 9512.1. Samples: 829461428. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:48,989][27935] Avg episode reward: [(0, '-0.952')] [2022-07-13 18:30:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 414745600. Throughput: 0: 9515.9. Samples: 829490272. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:53,989][27935] Avg episode reward: [(0, '-1.933')] [2022-07-13 18:30:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 414768128. Throughput: 0: 9515.4. Samples: 829546920. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:30:58,989][27935] Avg episode reward: [(0, '-1.229')] [2022-07-13 18:31:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 414789632. Throughput: 0: 9422.8. Samples: 829599588. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:31:03,992][27935] Avg episode reward: [(0, '-0.345')] [2022-07-13 18:31:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 414814208. Throughput: 0: 9420.0. Samples: 829628064. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:31:08,989][27935] Avg episode reward: [(0, '-1.059')] [2022-07-13 18:31:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 414836736. Throughput: 0: 9412.3. Samples: 829684516. Policy #0 lag: (min: 0.0, avg: 9.5, max: 21.0) [2022-07-13 18:31:13,989][27935] Avg episode reward: [(0, '-2.083')] [2022-07-13 18:31:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 414860288. Throughput: 0: 9410.5. Samples: 829741484. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:18,989][27935] Avg episode reward: [(0, '-1.673')] [2022-07-13 18:31:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 414884864. Throughput: 0: 9406.3. Samples: 829770028. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:23,989][27935] Avg episode reward: [(0, '-0.854')] [2022-07-13 18:31:28,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 414910464. Throughput: 0: 9395.9. Samples: 829827060. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:28,989][27935] Avg episode reward: [(0, '-0.218')] [2022-07-13 18:31:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 414931968. Throughput: 0: 9395.5. Samples: 829884224. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:33,989][27935] Avg episode reward: [(0, '-0.179')] [2022-07-13 18:31:38,991][27935] Fps is (10 sec: 4402.1, 60 sec: 4693.1, 300 sec: 4696.5). Total num frames: 414954496. Throughput: 0: 9380.2. Samples: 829912404. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:38,992][27935] Avg episode reward: [(0, '-0.769')] [2022-07-13 18:31:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 414979072. Throughput: 0: 9386.3. Samples: 829969304. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:43,990][27935] Avg episode reward: [(0, '-1.174')] [2022-07-13 18:31:48,989][27935] Fps is (10 sec: 4916.4, 60 sec: 4710.4, 300 sec: 4707.1). Total num frames: 415003648. Throughput: 0: 9466.7. Samples: 830025588. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:48,989][27935] Avg episode reward: [(0, '-0.383')] [2022-07-13 18:31:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 415026176. Throughput: 0: 9453.3. Samples: 830053460. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:53,989][27935] Avg episode reward: [(0, '-0.403')] [2022-07-13 18:31:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 415050752. Throughput: 0: 9457.5. Samples: 830110104. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:31:58,989][27935] Avg episode reward: [(0, '-0.365')] [2022-07-13 18:32:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 415073280. Throughput: 0: 9375.3. Samples: 830163372. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:03,989][27935] Avg episode reward: [(0, '-0.846')] [2022-07-13 18:32:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 415094784. Throughput: 0: 9369.5. Samples: 830191656. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:08,989][27935] Avg episode reward: [(0, '-0.791')] [2022-07-13 18:32:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 415119360. Throughput: 0: 9370.6. Samples: 830248736. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:13,989][27935] Avg episode reward: [(0, '-0.322')] [2022-07-13 18:32:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 415141888. Throughput: 0: 9367.2. Samples: 830305748. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:18,989][27935] Avg episode reward: [(0, '0.382')] [2022-07-13 18:32:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4696.5). Total num frames: 415165440. Throughput: 0: 9380.2. Samples: 830334488. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:23,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 18:32:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 415192064. Throughput: 0: 9390.2. Samples: 830391864. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:28,990][27935] Avg episode reward: [(0, '-0.957')] [2022-07-13 18:32:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 415214592. Throughput: 0: 8780.3. Samples: 830420700. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:33,989][27935] Avg episode reward: [(0, '-0.985')] [2022-07-13 18:32:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.7, 300 sec: 4703.5). Total num frames: 415238144. Throughput: 0: 9422.3. Samples: 830477464. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:38,992][27935] Avg episode reward: [(0, '-0.454')] [2022-07-13 18:32:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 415261696. Throughput: 0: 9425.5. Samples: 830534252. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:43,989][27935] Avg episode reward: [(0, '-0.568')] [2022-07-13 18:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 415286272. Throughput: 0: 9520.0. Samples: 830591772. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:48,989][27935] Avg episode reward: [(0, '-0.449')] [2022-07-13 18:32:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 415309824. Throughput: 0: 9528.2. Samples: 830620424. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:53,989][27935] Avg episode reward: [(0, '-0.572')] [2022-07-13 18:32:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 415333376. Throughput: 0: 9536.6. Samples: 830677884. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:32:58,989][27935] Avg episode reward: [(0, '0.780')] [2022-07-13 18:33:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 415355904. Throughput: 0: 9451.6. Samples: 830731072. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:03,989][27935] Avg episode reward: [(0, '0.734')] [2022-07-13 18:33:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 415378432. Throughput: 0: 9433.2. Samples: 830758980. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:08,990][27935] Avg episode reward: [(0, '-0.213')] [2022-07-13 18:33:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 415401984. Throughput: 0: 9417.9. Samples: 830815668. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:13,989][27935] Avg episode reward: [(0, '-0.176')] [2022-07-13 18:33:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 415426560. Throughput: 0: 10033.5. Samples: 830872208. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:18,990][27935] Avg episode reward: [(0, '-0.745')] [2022-07-13 18:33:23,996][27935] Fps is (10 sec: 4706.9, 60 sec: 4726.9, 300 sec: 4703.3). Total num frames: 415449088. Throughput: 0: 9399.8. Samples: 830900524. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:23,997][27935] Avg episode reward: [(0, '-1.547')] [2022-07-13 18:33:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 415473664. Throughput: 0: 9401.1. Samples: 830957300. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:28,989][27935] Avg episode reward: [(0, '-1.634')] [2022-07-13 18:33:33,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4727.5, 300 sec: 4703.5). Total num frames: 415498240. Throughput: 0: 9399.6. Samples: 831014752. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:33,990][27935] Avg episode reward: [(0, '-1.714')] [2022-07-13 18:33:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 415521792. Throughput: 0: 9402.1. Samples: 831043516. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:38,989][27935] Avg episode reward: [(0, '-0.955')] [2022-07-13 18:33:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 415544320. Throughput: 0: 9394.7. Samples: 831100644. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:43,989][27935] Avg episode reward: [(0, '-1.150')] [2022-07-13 18:33:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 415568896. Throughput: 0: 9502.9. Samples: 831158704. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:48,989][27935] Avg episode reward: [(0, '-0.939')] [2022-07-13 18:33:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 415593472. Throughput: 0: 9518.9. Samples: 831187332. Policy #0 lag: (min: 0.0, avg: 8.5, max: 19.0) [2022-07-13 18:33:53,989][27935] Avg episode reward: [(0, '-0.886')] [2022-07-13 18:33:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 415617024. Throughput: 0: 9538.1. Samples: 831244880. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:33:58,989][27935] Avg episode reward: [(0, '-0.189')] [2022-07-13 18:34:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 415641600. Throughput: 0: 9479.0. Samples: 831298760. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:03,989][27935] Avg episode reward: [(0, '0.115')] [2022-07-13 18:34:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 415663104. Throughput: 0: 9484.1. Samples: 831327236. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:08,990][27935] Avg episode reward: [(0, '-0.001')] [2022-07-13 18:34:13,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 415685632. Throughput: 0: 9472.7. Samples: 831383572. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:13,989][27935] Avg episode reward: [(0, '-0.666')] [2022-07-13 18:34:18,992][27935] Fps is (10 sec: 4606.7, 60 sec: 4710.2, 300 sec: 4710.4). Total num frames: 415709184. Throughput: 0: 9441.2. Samples: 831439632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:18,992][27935] Avg episode reward: [(0, '-0.314')] [2022-07-13 18:34:23,993][27935] Fps is (10 sec: 4913.4, 60 sec: 4761.9, 300 sec: 4717.3). Total num frames: 415734784. Throughput: 0: 9436.7. Samples: 831468204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:23,993][27935] Avg episode reward: [(0, '-0.328')] [2022-07-13 18:34:28,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 415757312. Throughput: 0: 9430.8. Samples: 831525032. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:28,989][27935] Avg episode reward: [(0, '-0.316')] [2022-07-13 18:34:33,989][27935] Fps is (10 sec: 4712.2, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 415781888. Throughput: 0: 9403.3. Samples: 831581852. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:33,989][27935] Avg episode reward: [(0, '-0.621')] [2022-07-13 18:34:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 415804416. Throughput: 0: 9397.9. Samples: 831610240. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:38,989][27935] Avg episode reward: [(0, '-0.510')] [2022-07-13 18:34:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 415828992. Throughput: 0: 9387.4. Samples: 831667312. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:43,989][27935] Avg episode reward: [(0, '-0.046')] [2022-07-13 18:34:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 415851520. Throughput: 0: 9441.3. Samples: 831723620. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:48,989][27935] Avg episode reward: [(0, '-0.153')] [2022-07-13 18:34:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4717.3). Total num frames: 415876096. Throughput: 0: 9428.4. Samples: 831751512. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:53,989][27935] Avg episode reward: [(0, '0.516')] [2022-07-13 18:34:58,991][27935] Fps is (10 sec: 4607.2, 60 sec: 4676.1, 300 sec: 4713.8). Total num frames: 415897600. Throughput: 0: 9428.8. Samples: 831807884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:34:58,991][27935] Avg episode reward: [(0, '0.351')] [2022-07-13 18:35:03,992][27935] Fps is (10 sec: 4299.5, 60 sec: 4624.8, 300 sec: 4706.9). Total num frames: 415919104. Throughput: 0: 9346.0. Samples: 831860204. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:03,992][27935] Avg episode reward: [(0, '0.505')] [2022-07-13 18:35:08,989][27935] Fps is (10 sec: 4608.8, 60 sec: 4676.3, 300 sec: 4713.9). Total num frames: 415943680. Throughput: 0: 9322.5. Samples: 831887680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:08,989][27935] Avg episode reward: [(0, '0.906')] [2022-07-13 18:35:13,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 415967232. Throughput: 0: 9290.8. Samples: 831943116. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:13,989][27935] Avg episode reward: [(0, '0.738')] [2022-07-13 18:35:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4659.4, 300 sec: 4700.0). Total num frames: 415988736. Throughput: 0: 9272.9. Samples: 831999132. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:18,989][27935] Avg episode reward: [(0, '1.320')] [2022-07-13 18:35:23,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.4, 300 sec: 4700.0). Total num frames: 416012288. Throughput: 0: 9271.2. Samples: 832027444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:23,993][27935] Avg episode reward: [(0, '1.369')] [2022-07-13 18:35:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4676.3, 300 sec: 4706.9). Total num frames: 416037888. Throughput: 0: 9239.8. Samples: 832083104. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:28,989][27935] Avg episode reward: [(0, '0.929')] [2022-07-13 18:35:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4608.0, 300 sec: 4696.5). Total num frames: 416058368. Throughput: 0: 9221.7. Samples: 832138596. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:33,989][27935] Avg episode reward: [(0, '0.857')] [2022-07-13 18:35:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4659.2, 300 sec: 4703.5). Total num frames: 416083968. Throughput: 0: 9229.7. Samples: 832166848. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:38,989][27935] Avg episode reward: [(0, '0.594')] [2022-07-13 18:35:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4625.1, 300 sec: 4696.5). Total num frames: 416106496. Throughput: 0: 9229.4. Samples: 832223192. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:43,989][27935] Avg episode reward: [(0, '0.659')] [2022-07-13 18:35:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4625.1, 300 sec: 4689.6). Total num frames: 416129024. Throughput: 0: 9315.2. Samples: 832279360. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:48,989][27935] Avg episode reward: [(0, '0.829')] [2022-07-13 18:35:53,989][27935] Fps is (10 sec: 4710.1, 60 sec: 4625.0, 300 sec: 4696.5). Total num frames: 416153600. Throughput: 0: 9331.9. Samples: 832307620. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:53,990][27935] Avg episode reward: [(0, '1.183')] [2022-07-13 18:35:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.3, 300 sec: 4703.5). Total num frames: 416177152. Throughput: 0: 9354.3. Samples: 832364060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:35:58,999][27935] Avg episode reward: [(0, '0.688')] [2022-07-13 18:36:03,989][27935] Fps is (10 sec: 4505.9, 60 sec: 4659.4, 300 sec: 4693.0). Total num frames: 416198656. Throughput: 0: 9295.7. Samples: 832417436. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:03,989][27935] Avg episode reward: [(0, '1.526')] [2022-07-13 18:36:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4642.1, 300 sec: 4696.5). Total num frames: 416222208. Throughput: 0: 9300.2. Samples: 832445952. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:08,989][27935] Avg episode reward: [(0, '1.593')] [2022-07-13 18:36:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4659.2, 300 sec: 4700.0). Total num frames: 416246784. Throughput: 0: 9328.4. Samples: 832502884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:13,990][27935] Avg episode reward: [(0, '1.096')] [2022-07-13 18:36:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 416270336. Throughput: 0: 9367.9. Samples: 832560152. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:18,989][27935] Avg episode reward: [(0, '1.334')] [2022-07-13 18:36:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 416294912. Throughput: 0: 9365.1. Samples: 832588276. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:23,989][27935] Avg episode reward: [(0, '1.046')] [2022-07-13 18:36:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4659.2, 300 sec: 4696.5). Total num frames: 416317440. Throughput: 0: 9372.8. Samples: 832644968. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:28,989][27935] Avg episode reward: [(0, '0.390')] [2022-07-13 18:36:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4696.6). Total num frames: 416339968. Throughput: 0: 9384.0. Samples: 832701640. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:36:33,989][27935] Avg episode reward: [(0, '-0.618')] [2022-07-13 18:36:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4696.5). Total num frames: 416364544. Throughput: 0: 9390.5. Samples: 832730188. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:36:38,989][27935] Avg episode reward: [(0, '-0.675')] [2022-07-13 18:36:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4689.6). Total num frames: 416387072. Throughput: 0: 9392.6. Samples: 832786728. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:36:43,989][27935] Avg episode reward: [(0, '-0.663')] [2022-07-13 18:36:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 416412672. Throughput: 0: 9470.7. Samples: 832843620. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:36:48,989][27935] Avg episode reward: [(0, '-1.010')] [2022-07-13 18:36:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 416436224. Throughput: 0: 9467.9. Samples: 832872008. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:36:53,989][27935] Avg episode reward: [(0, '-0.921')] [2022-07-13 18:36:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 416459776. Throughput: 0: 9478.9. Samples: 832929436. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:36:58,989][27935] Avg episode reward: [(0, '-0.928')] [2022-07-13 18:37:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 416481280. Throughput: 0: 9393.1. Samples: 832982840. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:03,989][27935] Avg episode reward: [(0, '-0.587')] [2022-07-13 18:37:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 416505856. Throughput: 0: 9398.1. Samples: 833011192. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:08,989][27935] Avg episode reward: [(0, '-0.549')] [2022-07-13 18:37:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 416528384. Throughput: 0: 9400.7. Samples: 833068000. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:13,990][27935] Avg episode reward: [(0, '-0.762')] [2022-07-13 18:37:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 416552960. Throughput: 0: 9401.5. Samples: 833124708. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:18,989][27935] Avg episode reward: [(0, '-1.517')] [2022-07-13 18:37:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4689.6). Total num frames: 416575488. Throughput: 0: 9404.6. Samples: 833153396. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:23,989][27935] Avg episode reward: [(0, '-1.160')] [2022-07-13 18:37:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4693.0). Total num frames: 416599040. Throughput: 0: 9409.5. Samples: 833210156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:28,989][27935] Avg episode reward: [(0, '-1.965')] [2022-07-13 18:37:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4700.0). Total num frames: 416624640. Throughput: 0: 9409.4. Samples: 833267044. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:33,989][27935] Avg episode reward: [(0, '-1.445')] [2022-07-13 18:37:38,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4744.5, 300 sec: 4703.5). Total num frames: 416649216. Throughput: 0: 9413.1. Samples: 833295596. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:38,989][27935] Avg episode reward: [(0, '-1.145')] [2022-07-13 18:37:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 416670720. Throughput: 0: 9382.7. Samples: 833351656. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:43,989][27935] Avg episode reward: [(0, '-0.879')] [2022-07-13 18:37:48,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 416695296. Throughput: 0: 9467.4. Samples: 833408872. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:48,989][27935] Avg episode reward: [(0, '-0.926')] [2022-07-13 18:37:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4693.0). Total num frames: 416717824. Throughput: 0: 9461.9. Samples: 833436976. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:53,989][27935] Avg episode reward: [(0, '-0.774')] [2022-07-13 18:37:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 416742400. Throughput: 0: 9446.6. Samples: 833493096. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:37:58,989][27935] Avg episode reward: [(0, '-0.885')] [2022-07-13 18:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 416763904. Throughput: 0: 9366.6. Samples: 833546204. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:03,990][27935] Avg episode reward: [(0, '-0.206')] [2022-07-13 18:38:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4696.5). Total num frames: 416787456. Throughput: 0: 9361.7. Samples: 833574672. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:08,990][27935] Avg episode reward: [(0, '-1.200')] [2022-07-13 18:38:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4689.6). Total num frames: 416809984. Throughput: 0: 9360.3. Samples: 833631368. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:13,989][27935] Avg episode reward: [(0, '-1.417')] [2022-07-13 18:38:18,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4676.3, 300 sec: 4693.2). Total num frames: 416833536. Throughput: 0: 9358.0. Samples: 833688156. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:18,989][27935] Avg episode reward: [(0, '-1.235')] [2022-07-13 18:38:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 416858112. Throughput: 0: 9353.1. Samples: 833716488. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:23,989][27935] Avg episode reward: [(0, '-1.172')] [2022-07-13 18:38:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 416882688. Throughput: 0: 9365.5. Samples: 833773104. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:28,989][27935] Avg episode reward: [(0, '-1.481')] [2022-07-13 18:38:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4693.0). Total num frames: 416906240. Throughput: 0: 9355.3. Samples: 833829860. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:33,989][27935] Avg episode reward: [(0, '-1.154')] [2022-07-13 18:38:38,990][27935] Fps is (10 sec: 4607.4, 60 sec: 4659.1, 300 sec: 4693.0). Total num frames: 416928768. Throughput: 0: 9363.7. Samples: 833858356. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:38,991][27935] Avg episode reward: [(0, '-0.513')] [2022-07-13 18:38:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 416953344. Throughput: 0: 9389.8. Samples: 833915636. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:43,989][27935] Avg episode reward: [(0, '-0.201')] [2022-07-13 18:38:48,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4676.3, 300 sec: 4686.1). Total num frames: 416975872. Throughput: 0: 9482.8. Samples: 833972928. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:48,989][27935] Avg episode reward: [(0, '-0.831')] [2022-07-13 18:38:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 416999424. Throughput: 0: 9478.0. Samples: 834001184. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:53,989][27935] Avg episode reward: [(0, '-0.436')] [2022-07-13 18:38:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4686.1). Total num frames: 417024000. Throughput: 0: 9490.5. Samples: 834058440. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:38:58,989][27935] Avg episode reward: [(0, '-0.171')] [2022-07-13 18:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4689.6). Total num frames: 417046528. Throughput: 0: 9408.8. Samples: 834111552. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:39:03,989][27935] Avg episode reward: [(0, '0.225')] [2022-07-13 18:39:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 417070080. Throughput: 0: 9418.1. Samples: 834140304. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:39:08,989][27935] Avg episode reward: [(0, '0.637')] [2022-07-13 18:39:13,996][27935] Fps is (10 sec: 4707.2, 60 sec: 4726.9, 300 sec: 4693.0). Total num frames: 417093632. Throughput: 0: 9434.8. Samples: 834197732. Policy #0 lag: (min: 0.0, avg: 9.8, max: 21.0) [2022-07-13 18:39:13,996][27935] Avg episode reward: [(0, '-0.677')] [2022-07-13 18:39:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4686.2). Total num frames: 417117184. Throughput: 0: 9446.0. Samples: 834254932. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:18,989][27935] Avg episode reward: [(0, '-0.294')] [2022-07-13 18:39:23,989][27935] Fps is (10 sec: 4816.0, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 417141760. Throughput: 0: 9451.6. Samples: 834283664. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:23,989][27935] Avg episode reward: [(0, '0.395')] [2022-07-13 18:39:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4693.0). Total num frames: 417166336. Throughput: 0: 9447.9. Samples: 834340792. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:28,989][27935] Avg episode reward: [(0, '0.423')] [2022-07-13 18:39:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 417188864. Throughput: 0: 9446.4. Samples: 834398016. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:33,989][27935] Avg episode reward: [(0, '-0.523')] [2022-07-13 18:39:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.6, 300 sec: 4693.0). Total num frames: 417213440. Throughput: 0: 9454.4. Samples: 834426632. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:38,990][27935] Avg episode reward: [(0, '-0.741')] [2022-07-13 18:39:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4693.0). Total num frames: 417235968. Throughput: 0: 9458.0. Samples: 834484052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:43,989][27935] Avg episode reward: [(0, '0.714')] [2022-07-13 18:39:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4693.0). Total num frames: 417260544. Throughput: 0: 9545.2. Samples: 834541084. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:48,989][27935] Avg episode reward: [(0, '0.463')] [2022-07-13 18:39:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4703.5). Total num frames: 417285120. Throughput: 0: 9535.8. Samples: 834569416. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:53,989][27935] Avg episode reward: [(0, '0.228')] [2022-07-13 18:39:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 417308672. Throughput: 0: 9532.1. Samples: 834626612. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:39:58,989][27935] Avg episode reward: [(0, '-0.501')] [2022-07-13 18:40:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 417330176. Throughput: 0: 9440.7. Samples: 834679764. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:03,989][27935] Avg episode reward: [(0, '-1.131')] [2022-07-13 18:40:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 417353728. Throughput: 0: 9431.3. Samples: 834708072. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:08,990][27935] Avg episode reward: [(0, '-0.632')] [2022-07-13 18:40:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4728.0, 300 sec: 4706.9). Total num frames: 417377280. Throughput: 0: 9414.9. Samples: 834764464. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:13,990][27935] Avg episode reward: [(0, '-0.553')] [2022-07-13 18:40:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 417399808. Throughput: 0: 9388.0. Samples: 834820476. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:18,990][27935] Avg episode reward: [(0, '-0.514')] [2022-07-13 18:40:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 417424384. Throughput: 0: 9380.1. Samples: 834848736. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:23,992][27935] Avg episode reward: [(0, '-1.136')] [2022-07-13 18:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 417447936. Throughput: 0: 9366.2. Samples: 834905532. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:28,989][27935] Avg episode reward: [(0, '-1.099')] [2022-07-13 18:40:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 417470464. Throughput: 0: 9358.1. Samples: 834962200. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:33,989][27935] Avg episode reward: [(0, '-1.018')] [2022-07-13 18:40:38,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 417496064. Throughput: 0: 9364.0. Samples: 834990796. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:38,990][27935] Avg episode reward: [(0, '-0.291')] [2022-07-13 18:40:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 417517568. Throughput: 0: 9350.1. Samples: 835047368. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:43,990][27935] Avg episode reward: [(0, '-0.076')] [2022-07-13 18:40:48,993][27935] Fps is (10 sec: 4606.3, 60 sec: 4693.0, 300 sec: 4706.9). Total num frames: 417542144. Throughput: 0: 9433.1. Samples: 835104288. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:48,993][27935] Avg episode reward: [(0, '-1.060')] [2022-07-13 18:40:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4676.3, 300 sec: 4706.9). Total num frames: 417565696. Throughput: 0: 9437.1. Samples: 835132744. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:53,989][27935] Avg episode reward: [(0, '-1.221')] [2022-07-13 18:40:58,989][27935] Fps is (10 sec: 4814.7, 60 sec: 4693.3, 300 sec: 4717.3). Total num frames: 417590272. Throughput: 0: 9438.3. Samples: 835189188. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:40:58,989][27935] Avg episode reward: [(0, '-1.177')] [2022-07-13 18:41:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 417611776. Throughput: 0: 9367.9. Samples: 835242032. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:03,989][27935] Avg episode reward: [(0, '-0.931')] [2022-07-13 18:41:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 417634304. Throughput: 0: 9370.2. Samples: 835270396. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:08,990][27935] Avg episode reward: [(0, '-0.668')] [2022-07-13 18:41:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 417657856. Throughput: 0: 9360.0. Samples: 835326732. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:13,989][27935] Avg episode reward: [(0, '-0.662')] [2022-07-13 18:41:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 417681408. Throughput: 0: 9351.2. Samples: 835383004. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:18,989][27935] Avg episode reward: [(0, '-0.272')] [2022-07-13 18:41:23,991][27935] Fps is (10 sec: 4607.1, 60 sec: 4659.1, 300 sec: 4700.0). Total num frames: 417703936. Throughput: 0: 9348.4. Samples: 835411492. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:23,991][27935] Avg episode reward: [(0, '0.512')] [2022-07-13 18:41:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 417729536. Throughput: 0: 9354.5. Samples: 835468320. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:28,989][27935] Avg episode reward: [(0, '0.753')] [2022-07-13 18:41:33,989][27935] Fps is (10 sec: 4813.7, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 417752064. Throughput: 0: 9351.4. Samples: 835525064. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:33,989][27935] Avg episode reward: [(0, '1.162')] [2022-07-13 18:41:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4710.4). Total num frames: 417776640. Throughput: 0: 9354.8. Samples: 835553708. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:38,990][27935] Avg episode reward: [(0, '0.661')] [2022-07-13 18:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 417801216. Throughput: 0: 9359.5. Samples: 835610368. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:43,989][27935] Avg episode reward: [(0, '1.050')] [2022-07-13 18:41:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.6, 300 sec: 4703.5). Total num frames: 417823744. Throughput: 0: 9453.1. Samples: 835667420. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:48,989][27935] Avg episode reward: [(0, '1.008')] [2022-07-13 18:41:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 417847296. Throughput: 0: 9450.8. Samples: 835695684. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 18:41:53,989][27935] Avg episode reward: [(0, '-0.410')] [2022-07-13 18:41:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 417871872. Throughput: 0: 9460.5. Samples: 835752456. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:41:58,996][27935] Avg episode reward: [(0, '-0.866')] [2022-07-13 18:42:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4700.0). Total num frames: 417892352. Throughput: 0: 9381.1. Samples: 835805152. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:03,989][27935] Avg episode reward: [(0, '-1.354')] [2022-07-13 18:42:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 417915904. Throughput: 0: 9386.1. Samples: 835833848. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:08,989][27935] Avg episode reward: [(0, '-1.226')] [2022-07-13 18:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 417940480. Throughput: 0: 9388.9. Samples: 835890820. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:13,989][27935] Avg episode reward: [(0, '-1.186')] [2022-07-13 18:42:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 417964032. Throughput: 0: 9391.0. Samples: 835947660. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:18,989][27935] Avg episode reward: [(0, '-1.364')] [2022-07-13 18:42:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.6, 300 sec: 4706.9). Total num frames: 417987584. Throughput: 0: 9387.8. Samples: 835976160. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:23,990][27935] Avg episode reward: [(0, '-1.868')] [2022-07-13 18:42:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 418011136. Throughput: 0: 9395.2. Samples: 836033152. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:28,989][27935] Avg episode reward: [(0, '-0.725')] [2022-07-13 18:42:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 418035712. Throughput: 0: 9392.1. Samples: 836090064. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:33,989][27935] Avg episode reward: [(0, '-1.365')] [2022-07-13 18:42:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 418058240. Throughput: 0: 9397.0. Samples: 836118548. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:38,989][27935] Avg episode reward: [(0, '-0.395')] [2022-07-13 18:42:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4700.0). Total num frames: 418081792. Throughput: 0: 9381.1. Samples: 836174604. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:43,989][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 18:42:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 418105344. Throughput: 0: 9476.4. Samples: 836231592. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:48,989][27935] Avg episode reward: [(0, '0.132')] [2022-07-13 18:42:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 418128896. Throughput: 0: 9468.0. Samples: 836259908. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:53,989][27935] Avg episode reward: [(0, '0.272')] [2022-07-13 18:42:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4706.9). Total num frames: 418152448. Throughput: 0: 9456.1. Samples: 836316344. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:42:58,989][27935] Avg episode reward: [(0, '0.048')] [2022-07-13 18:43:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418174976. Throughput: 0: 9376.3. Samples: 836369592. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:03,990][27935] Avg episode reward: [(0, '0.577')] [2022-07-13 18:43:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4703.5). Total num frames: 418197504. Throughput: 0: 9375.0. Samples: 836398036. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:08,989][27935] Avg episode reward: [(0, '1.313')] [2022-07-13 18:43:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 418222080. Throughput: 0: 9373.5. Samples: 836454960. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:13,990][27935] Avg episode reward: [(0, '1.350')] [2022-07-13 18:43:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 418246656. Throughput: 0: 9373.3. Samples: 836511864. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:18,989][27935] Avg episode reward: [(0, '1.152')] [2022-07-13 18:43:23,991][27935] Fps is (10 sec: 4811.9, 60 sec: 4710.2, 300 sec: 4703.4). Total num frames: 418270208. Throughput: 0: 9379.3. Samples: 836540636. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:23,992][27935] Avg episode reward: [(0, '1.039')] [2022-07-13 18:43:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418293760. Throughput: 0: 9403.1. Samples: 836597744. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:28,990][27935] Avg episode reward: [(0, '1.141')] [2022-07-13 18:43:33,989][27935] Fps is (10 sec: 4711.4, 60 sec: 4693.3, 300 sec: 4707.0). Total num frames: 418317312. Throughput: 0: 9397.5. Samples: 836654480. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:33,990][27935] Avg episode reward: [(0, '0.920')] [2022-07-13 18:43:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 418342912. Throughput: 0: 9409.3. Samples: 836683328. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:38,990][27935] Avg episode reward: [(0, '0.786')] [2022-07-13 18:43:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 418365440. Throughput: 0: 9418.5. Samples: 836740176. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:43,991][27935] Avg episode reward: [(0, '0.798')] [2022-07-13 18:43:48,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 418387968. Throughput: 0: 9496.3. Samples: 836796928. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:48,996][27935] Avg episode reward: [(0, '1.036')] [2022-07-13 18:43:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 418412544. Throughput: 0: 9502.1. Samples: 836825632. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:53,989][27935] Avg episode reward: [(0, '1.233')] [2022-07-13 18:43:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 418436096. Throughput: 0: 9484.7. Samples: 836881772. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:43:58,989][27935] Avg episode reward: [(0, '0.562')] [2022-07-13 18:44:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418457600. Throughput: 0: 9359.4. Samples: 836933036. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:03,989][27935] Avg episode reward: [(0, '0.581')] [2022-07-13 18:44:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4710.4, 300 sec: 4700.1). Total num frames: 418480128. Throughput: 0: 9354.7. Samples: 836961580. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:08,990][27935] Avg episode reward: [(0, '1.400')] [2022-07-13 18:44:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418504704. Throughput: 0: 9342.3. Samples: 837018148. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:13,989][27935] Avg episode reward: [(0, '0.440')] [2022-07-13 18:44:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418529280. Throughput: 0: 9367.5. Samples: 837076016. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:18,989][27935] Avg episode reward: [(0, '0.359')] [2022-07-13 18:44:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.4, 300 sec: 4693.0). Total num frames: 418550784. Throughput: 0: 9369.8. Samples: 837104968. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:23,989][27935] Avg episode reward: [(0, '0.008')] [2022-07-13 18:44:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418576384. Throughput: 0: 9372.8. Samples: 837161952. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:28,989][27935] Avg episode reward: [(0, '0.566')] [2022-07-13 18:44:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 418599936. Throughput: 0: 9381.8. Samples: 837219108. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:33,989][27935] Avg episode reward: [(0, '0.406')] [2022-07-13 18:44:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 418624512. Throughput: 0: 9379.9. Samples: 837247728. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 18:44:38,989][27935] Avg episode reward: [(0, '0.237')] [2022-07-13 18:44:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418648064. Throughput: 0: 9401.0. Samples: 837304816. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:44:43,990][27935] Avg episode reward: [(0, '0.090')] [2022-07-13 18:44:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 418670592. Throughput: 0: 9541.6. Samples: 837362408. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:44:48,989][27935] Avg episode reward: [(0, '1.097')] [2022-07-13 18:44:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 418695168. Throughput: 0: 9539.0. Samples: 837390836. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:44:53,989][27935] Avg episode reward: [(0, '0.829')] [2022-07-13 18:44:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 418718720. Throughput: 0: 9554.4. Samples: 837448096. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:44:58,989][27935] Avg episode reward: [(0, '0.909')] [2022-07-13 18:45:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 418740224. Throughput: 0: 9450.7. Samples: 837501296. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:03,989][27935] Avg episode reward: [(0, '0.804')] [2022-07-13 18:45:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4700.0). Total num frames: 418763776. Throughput: 0: 9437.7. Samples: 837529664. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:08,989][27935] Avg episode reward: [(0, '0.336')] [2022-07-13 18:45:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418787328. Throughput: 0: 9445.4. Samples: 837586996. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:13,989][27935] Avg episode reward: [(0, '0.313')] [2022-07-13 18:45:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 418811904. Throughput: 0: 9438.4. Samples: 837643836. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:18,989][27935] Avg episode reward: [(0, '0.472')] [2022-07-13 18:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4703.5). Total num frames: 418835456. Throughput: 0: 9437.3. Samples: 837672408. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:23,989][27935] Avg episode reward: [(0, '0.246')] [2022-07-13 18:45:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 418860032. Throughput: 0: 9433.9. Samples: 837729340. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:28,989][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 18:45:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 418882560. Throughput: 0: 8781.2. Samples: 837757564. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:33,989][27935] Avg episode reward: [(0, '0.306')] [2022-07-13 18:45:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 418906112. Throughput: 0: 9407.9. Samples: 837814192. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:38,989][27935] Avg episode reward: [(0, '-0.398')] [2022-07-13 18:45:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4707.0). Total num frames: 418930688. Throughput: 0: 9407.8. Samples: 837871448. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:43,989][27935] Avg episode reward: [(0, '-0.384')] [2022-07-13 18:45:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 418954240. Throughput: 0: 9495.0. Samples: 837928572. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:48,989][27935] Avg episode reward: [(0, '-1.100')] [2022-07-13 18:45:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 418978816. Throughput: 0: 9503.6. Samples: 837957328. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:53,989][27935] Avg episode reward: [(0, '-1.157')] [2022-07-13 18:45:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 419002368. Throughput: 0: 9512.0. Samples: 838015036. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:45:58,990][27935] Avg episode reward: [(0, '-1.175')] [2022-07-13 18:46:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 419023872. Throughput: 0: 9440.7. Samples: 838068668. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:03,989][27935] Avg episode reward: [(0, '-1.726')] [2022-07-13 18:46:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4717.3). Total num frames: 419049472. Throughput: 0: 9442.6. Samples: 838097324. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:08,989][27935] Avg episode reward: [(0, '-2.083')] [2022-07-13 18:46:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4713.9). Total num frames: 419072000. Throughput: 0: 9447.0. Samples: 838154456. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:13,995][27935] Avg episode reward: [(0, '-1.919')] [2022-07-13 18:46:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.4). Total num frames: 419095552. Throughput: 0: 9443.3. Samples: 838182512. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:18,989][27935] Avg episode reward: [(0, '-0.926')] [2022-07-13 18:46:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4717.3). Total num frames: 419121152. Throughput: 0: 9456.2. Samples: 838239720. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:23,989][27935] Avg episode reward: [(0, '-0.407')] [2022-07-13 18:46:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 419143680. Throughput: 0: 9437.9. Samples: 838296152. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:28,990][27935] Avg episode reward: [(0, '-0.477')] [2022-07-13 18:46:33,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 419166208. Throughput: 0: 9421.3. Samples: 838352528. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:33,990][27935] Avg episode reward: [(0, '-0.283')] [2022-07-13 18:46:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 419189760. Throughput: 0: 9407.9. Samples: 838380684. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:38,989][27935] Avg episode reward: [(0, '-0.331')] [2022-07-13 18:46:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 419214336. Throughput: 0: 9389.1. Samples: 838437544. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:43,989][27935] Avg episode reward: [(0, '0.371')] [2022-07-13 18:46:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 419237888. Throughput: 0: 9455.6. Samples: 838494168. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:48,989][27935] Avg episode reward: [(0, '-0.056')] [2022-07-13 18:46:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 419261440. Throughput: 0: 9450.7. Samples: 838522604. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:53,989][27935] Avg episode reward: [(0, '-1.121')] [2022-07-13 18:46:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4720.8). Total num frames: 419284992. Throughput: 0: 9449.0. Samples: 838579660. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:46:58,989][27935] Avg episode reward: [(0, '-1.067')] [2022-07-13 18:47:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 419306496. Throughput: 0: 10010.0. Samples: 838632960. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:47:03,989][27935] Avg episode reward: [(0, '-0.399')] [2022-07-13 18:47:08,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4659.2, 300 sec: 4706.9). Total num frames: 419329024. Throughput: 0: 9369.0. Samples: 838661324. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:47:08,989][27935] Avg episode reward: [(0, '-0.531')] [2022-07-13 18:47:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 419354624. Throughput: 0: 9365.4. Samples: 838717596. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:47:13,989][27935] Avg episode reward: [(0, '-0.551')] [2022-07-13 18:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 419377152. Throughput: 0: 9386.8. Samples: 838774936. Policy #0 lag: (min: 0.0, avg: 8.0, max: 18.0) [2022-07-13 18:47:18,989][27935] Avg episode reward: [(0, '-0.266')] [2022-07-13 18:47:23,995][27935] Fps is (10 sec: 4707.7, 60 sec: 4675.8, 300 sec: 4713.8). Total num frames: 419401728. Throughput: 0: 9389.7. Samples: 838803276. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:23,995][27935] Avg episode reward: [(0, '1.132')] [2022-07-13 18:47:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 419425280. Throughput: 0: 9396.7. Samples: 838860396. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:28,990][27935] Avg episode reward: [(0, '1.407')] [2022-07-13 18:47:33,989][27935] Fps is (10 sec: 4713.1, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 419448832. Throughput: 0: 9382.8. Samples: 838916392. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:33,989][27935] Avg episode reward: [(0, '1.559')] [2022-07-13 18:47:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 419472384. Throughput: 0: 9374.6. Samples: 838944460. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:38,989][27935] Avg episode reward: [(0, '1.775')] [2022-07-13 18:47:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4710.4). Total num frames: 419494912. Throughput: 0: 9358.8. Samples: 839000808. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:43,992][27935] Avg episode reward: [(0, '1.522')] [2022-07-13 18:47:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4717.3). Total num frames: 419520512. Throughput: 0: 9438.2. Samples: 839057680. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:48,989][27935] Avg episode reward: [(0, '1.077')] [2022-07-13 18:47:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 419543040. Throughput: 0: 9446.0. Samples: 839086396. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:53,989][27935] Avg episode reward: [(0, '1.115')] [2022-07-13 18:47:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4717.3). Total num frames: 419566592. Throughput: 0: 9467.8. Samples: 839143648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:47:58,989][27935] Avg episode reward: [(0, '0.992')] [2022-07-13 18:48:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 419588096. Throughput: 0: 9365.6. Samples: 839196388. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:03,989][27935] Avg episode reward: [(0, '0.772')] [2022-07-13 18:48:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 419611648. Throughput: 0: 9367.9. Samples: 839224776. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:08,989][27935] Avg episode reward: [(0, '0.668')] [2022-07-13 18:48:13,995][27935] Fps is (10 sec: 4707.3, 60 sec: 4675.8, 300 sec: 4706.8). Total num frames: 419635200. Throughput: 0: 9348.0. Samples: 839281120. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:13,996][27935] Avg episode reward: [(0, '1.030')] [2022-07-13 18:48:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 419660800. Throughput: 0: 9358.1. Samples: 839337508. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:18,989][27935] Avg episode reward: [(0, '-0.559')] [2022-07-13 18:48:23,990][27935] Fps is (10 sec: 4713.0, 60 sec: 4676.6, 300 sec: 4706.9). Total num frames: 419682304. Throughput: 0: 9369.5. Samples: 839366096. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:23,990][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 18:48:28,992][27935] Fps is (10 sec: 4606.7, 60 sec: 4693.1, 300 sec: 4710.4). Total num frames: 419706880. Throughput: 0: 9385.7. Samples: 839423192. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:28,992][27935] Avg episode reward: [(0, '-0.589')] [2022-07-13 18:48:33,989][27935] Fps is (10 sec: 4710.9, 60 sec: 4676.3, 300 sec: 4700.0). Total num frames: 419729408. Throughput: 0: 9395.9. Samples: 839480496. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:33,989][27935] Avg episode reward: [(0, '-0.740')] [2022-07-13 18:48:38,989][27935] Fps is (10 sec: 4814.1, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 419755008. Throughput: 0: 9390.4. Samples: 839508964. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:38,989][27935] Avg episode reward: [(0, '-0.490')] [2022-07-13 18:48:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 419778560. Throughput: 0: 9396.4. Samples: 839566484. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:43,989][27935] Avg episode reward: [(0, '-1.010')] [2022-07-13 18:48:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 419802112. Throughput: 0: 9494.0. Samples: 839623616. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:48,989][27935] Avg episode reward: [(0, '-1.065')] [2022-07-13 18:48:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 419825664. Throughput: 0: 9504.6. Samples: 839652484. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:53,989][27935] Avg episode reward: [(0, '0.976')] [2022-07-13 18:48:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4720.8). Total num frames: 419850240. Throughput: 0: 9526.1. Samples: 839709728. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:48:58,989][27935] Avg episode reward: [(0, '1.263')] [2022-07-13 18:49:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 419871744. Throughput: 0: 9458.9. Samples: 839763160. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:03,989][27935] Avg episode reward: [(0, '1.373')] [2022-07-13 18:49:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4720.8). Total num frames: 419897344. Throughput: 0: 9453.8. Samples: 839791508. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:08,989][27935] Avg episode reward: [(0, '0.682')] [2022-07-13 18:49:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4728.0, 300 sec: 4710.4). Total num frames: 419918848. Throughput: 0: 9442.8. Samples: 839848092. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:13,989][27935] Avg episode reward: [(0, '0.122')] [2022-07-13 18:49:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4717.3). Total num frames: 419942400. Throughput: 0: 9431.5. Samples: 839904912. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:18,989][27935] Avg episode reward: [(0, '0.244')] [2022-07-13 18:49:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.6, 300 sec: 4713.9). Total num frames: 419966976. Throughput: 0: 9440.9. Samples: 839933804. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:23,990][27935] Avg episode reward: [(0, '0.791')] [2022-07-13 18:49:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.6, 300 sec: 4710.4). Total num frames: 419989504. Throughput: 0: 9427.1. Samples: 839990704. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:28,996][27935] Avg episode reward: [(0, '-0.008')] [2022-07-13 18:49:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4706.9). Total num frames: 420013056. Throughput: 0: 9416.2. Samples: 840047344. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:33,989][27935] Avg episode reward: [(0, '-0.368')] [2022-07-13 18:49:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 420037632. Throughput: 0: 9400.4. Samples: 840075504. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:38,989][27935] Avg episode reward: [(0, '-0.377')] [2022-07-13 18:49:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4713.9). Total num frames: 420061184. Throughput: 0: 9391.4. Samples: 840132340. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:43,990][27935] Avg episode reward: [(0, '0.365')] [2022-07-13 18:49:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420083712. Throughput: 0: 9468.3. Samples: 840189236. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:48,989][27935] Avg episode reward: [(0, '-0.025')] [2022-07-13 18:49:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 420109312. Throughput: 0: 9469.8. Samples: 840217648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:53,989][27935] Avg episode reward: [(0, '-0.485')] [2022-07-13 18:49:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4720.8). Total num frames: 420132864. Throughput: 0: 9488.1. Samples: 840275056. Policy #0 lag: (min: 0.0, avg: 9.7, max: 20.0) [2022-07-13 18:49:58,989][27935] Avg episode reward: [(0, '-0.391')] [2022-07-13 18:50:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4693.3, 300 sec: 4710.4). Total num frames: 420153344. Throughput: 0: 9381.0. Samples: 840327056. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:03,989][27935] Avg episode reward: [(0, '0.216')] [2022-07-13 18:50:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4717.3). Total num frames: 420178944. Throughput: 0: 9367.8. Samples: 840355356. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:08,990][27935] Avg episode reward: [(0, '0.605')] [2022-07-13 18:50:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 420201472. Throughput: 0: 9374.3. Samples: 840412548. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:13,989][27935] Avg episode reward: [(0, '-0.003')] [2022-07-13 18:50:18,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420224000. Throughput: 0: 9382.7. Samples: 840469564. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:18,989][27935] Avg episode reward: [(0, '0.240')] [2022-07-13 18:50:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420248576. Throughput: 0: 9386.8. Samples: 840497908. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:23,989][27935] Avg episode reward: [(0, '0.263')] [2022-07-13 18:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4713.9). Total num frames: 420273152. Throughput: 0: 9400.4. Samples: 840555356. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:28,989][27935] Avg episode reward: [(0, '0.205')] [2022-07-13 18:50:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4710.4). Total num frames: 420295680. Throughput: 0: 9373.6. Samples: 840611048. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:33,989][27935] Avg episode reward: [(0, '-0.900')] [2022-07-13 18:50:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420319232. Throughput: 0: 9364.2. Samples: 840639036. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:38,990][27935] Avg episode reward: [(0, '-1.238')] [2022-07-13 18:50:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420342784. Throughput: 0: 9359.3. Samples: 840696224. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:43,989][27935] Avg episode reward: [(0, '-1.406')] [2022-07-13 18:50:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 420366336. Throughput: 0: 9471.7. Samples: 840753284. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:48,990][27935] Avg episode reward: [(0, '-1.153')] [2022-07-13 18:50:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4706.9). Total num frames: 420390912. Throughput: 0: 9474.5. Samples: 840781708. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:53,989][27935] Avg episode reward: [(0, '-1.935')] [2022-07-13 18:50:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4713.9). Total num frames: 420414464. Throughput: 0: 9464.5. Samples: 840838452. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:50:58,989][27935] Avg episode reward: [(0, '-1.329')] [2022-07-13 18:51:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4700.0). Total num frames: 420435968. Throughput: 0: 8832.4. Samples: 840867024. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:03,989][27935] Avg episode reward: [(0, '-1.537')] [2022-07-13 18:51:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 420459520. Throughput: 0: 9370.7. Samples: 840919588. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:08,989][27935] Avg episode reward: [(0, '-0.566')] [2022-07-13 18:51:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4676.3, 300 sec: 4700.0). Total num frames: 420482048. Throughput: 0: 9347.5. Samples: 840975992. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:13,990][27935] Avg episode reward: [(0, '0.280')] [2022-07-13 18:51:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4696.5). Total num frames: 420506624. Throughput: 0: 9369.0. Samples: 841032652. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:18,989][27935] Avg episode reward: [(0, '-0.486')] [2022-07-13 18:51:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4710.4, 300 sec: 4703.5). Total num frames: 420531200. Throughput: 0: 9376.5. Samples: 841060976. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:23,989][27935] Avg episode reward: [(0, '-0.011')] [2022-07-13 18:51:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4676.3, 300 sec: 4703.5). Total num frames: 420553728. Throughput: 0: 9367.2. Samples: 841117748. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:29,002][27935] Avg episode reward: [(0, '-0.189')] [2022-07-13 18:51:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4706.9). Total num frames: 420578304. Throughput: 0: 9372.5. Samples: 841175048. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:33,989][27935] Avg episode reward: [(0, '-0.351')] [2022-07-13 18:51:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 420600832. Throughput: 0: 9365.9. Samples: 841203172. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:38,989][27935] Avg episode reward: [(0, '-0.374')] [2022-07-13 18:51:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4700.0). Total num frames: 420624384. Throughput: 0: 9396.3. Samples: 841261284. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:43,989][27935] Avg episode reward: [(0, '-0.749')] [2022-07-13 18:51:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4710.4). Total num frames: 420651008. Throughput: 0: 10056.8. Samples: 841319580. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:48,989][27935] Avg episode reward: [(0, '-0.830')] [2022-07-13 18:51:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4727.5, 300 sec: 4710.4). Total num frames: 420674560. Throughput: 0: 9536.0. Samples: 841348708. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:53,989][27935] Avg episode reward: [(0, '0.213')] [2022-07-13 18:51:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4717.3). Total num frames: 420698112. Throughput: 0: 9585.4. Samples: 841407336. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:51:58,989][27935] Avg episode reward: [(0, '0.865')] [2022-07-13 18:52:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4717.3). Total num frames: 420720640. Throughput: 0: 9533.5. Samples: 841461660. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:03,989][27935] Avg episode reward: [(0, '1.130')] [2022-07-13 18:52:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4713.9). Total num frames: 420745216. Throughput: 0: 9541.6. Samples: 841490348. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:08,989][27935] Avg episode reward: [(0, '0.501')] [2022-07-13 18:52:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4717.3). Total num frames: 420768768. Throughput: 0: 9564.7. Samples: 841548160. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:13,989][27935] Avg episode reward: [(0, '0.182')] [2022-07-13 18:52:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4717.4). Total num frames: 420793344. Throughput: 0: 9576.6. Samples: 841605996. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:18,989][27935] Avg episode reward: [(0, '0.351')] [2022-07-13 18:52:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4717.3). Total num frames: 420816896. Throughput: 0: 9602.0. Samples: 841635260. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:23,989][27935] Avg episode reward: [(0, '0.415')] [2022-07-13 18:52:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4720.8). Total num frames: 420841472. Throughput: 0: 9599.5. Samples: 841693264. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:28,989][27935] Avg episode reward: [(0, '-0.161')] [2022-07-13 18:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4720.8). Total num frames: 420865024. Throughput: 0: 9595.3. Samples: 841751368. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:33,990][27935] Avg episode reward: [(0, '-0.018')] [2022-07-13 18:52:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4731.2). Total num frames: 420890624. Throughput: 0: 9590.8. Samples: 841780292. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:38,989][27935] Avg episode reward: [(0, '-0.145')] [2022-07-13 18:52:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4724.3). Total num frames: 420914176. Throughput: 0: 9560.5. Samples: 841837560. Policy #0 lag: (min: 0.0, avg: 9.6, max: 20.0) [2022-07-13 18:52:43,989][27935] Avg episode reward: [(0, '0.824')] [2022-07-13 18:52:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4731.2). Total num frames: 420938752. Throughput: 0: 9646.3. Samples: 841895744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:52:48,989][27935] Avg episode reward: [(0, '1.492')] [2022-07-13 18:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4731.2). Total num frames: 420962304. Throughput: 0: 9653.0. Samples: 841924732. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:52:53,989][27935] Avg episode reward: [(0, '1.417')] [2022-07-13 18:52:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4738.2). Total num frames: 420985856. Throughput: 0: 9663.3. Samples: 841983008. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:52:58,990][27935] Avg episode reward: [(0, '1.205')] [2022-07-13 18:53:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4734.7). Total num frames: 421008384. Throughput: 0: 9578.0. Samples: 842037008. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:03,990][27935] Avg episode reward: [(0, '1.064')] [2022-07-13 18:53:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4741.7). Total num frames: 421033984. Throughput: 0: 9572.0. Samples: 842066000. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:08,989][27935] Avg episode reward: [(0, '0.732')] [2022-07-13 18:53:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4731.2). Total num frames: 421056512. Throughput: 0: 9563.1. Samples: 842123604. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:13,990][27935] Avg episode reward: [(0, '0.596')] [2022-07-13 18:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4745.1). Total num frames: 421082112. Throughput: 0: 9565.6. Samples: 842181820. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:18,989][27935] Avg episode reward: [(0, '-0.273')] [2022-07-13 18:53:23,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4812.8, 300 sec: 4741.7). Total num frames: 421105664. Throughput: 0: 9570.1. Samples: 842210944. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:23,989][27935] Avg episode reward: [(0, '-0.143')] [2022-07-13 18:53:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 421129216. Throughput: 0: 9602.4. Samples: 842269668. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:28,989][27935] Avg episode reward: [(0, '-0.077')] [2022-07-13 18:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4738.2). Total num frames: 421152768. Throughput: 0: 9602.6. Samples: 842327860. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:33,990][27935] Avg episode reward: [(0, '0.315')] [2022-07-13 18:53:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4748.6). Total num frames: 421179392. Throughput: 0: 9605.4. Samples: 842356976. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:38,989][27935] Avg episode reward: [(0, '0.069')] [2022-07-13 18:53:43,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4752.1). Total num frames: 421203968. Throughput: 0: 9609.7. Samples: 842415444. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:43,989][27935] Avg episode reward: [(0, '0.254')] [2022-07-13 18:53:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4748.6). Total num frames: 421226496. Throughput: 0: 9712.0. Samples: 842474048. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:48,989][27935] Avg episode reward: [(0, '0.028')] [2022-07-13 18:53:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4748.6). Total num frames: 421251072. Throughput: 0: 9706.5. Samples: 842502792. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:53,989][27935] Avg episode reward: [(0, '0.945')] [2022-07-13 18:53:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4759.0). Total num frames: 421275648. Throughput: 0: 9720.9. Samples: 842561044. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:53:58,989][27935] Avg episode reward: [(0, '0.635')] [2022-07-13 18:54:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4748.6). Total num frames: 421298176. Throughput: 0: 9638.9. Samples: 842615572. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:03,989][27935] Avg episode reward: [(0, '0.247')] [2022-07-13 18:54:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4759.0). Total num frames: 421322752. Throughput: 0: 9643.0. Samples: 842644880. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:08,989][27935] Avg episode reward: [(0, '0.369')] [2022-07-13 18:54:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4762.5). Total num frames: 421347328. Throughput: 0: 9636.0. Samples: 842703288. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:13,989][27935] Avg episode reward: [(0, '0.366')] [2022-07-13 18:54:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 421369856. Throughput: 0: 9630.6. Samples: 842761236. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:18,989][27935] Avg episode reward: [(0, '-0.340')] [2022-07-13 18:54:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4762.5). Total num frames: 421394432. Throughput: 0: 9619.5. Samples: 842789852. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:23,989][27935] Avg episode reward: [(0, '-0.755')] [2022-07-13 18:54:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4765.9). Total num frames: 421419008. Throughput: 0: 9595.6. Samples: 842847244. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:28,989][27935] Avg episode reward: [(0, '-1.585')] [2022-07-13 18:54:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4762.5). Total num frames: 421442560. Throughput: 0: 9569.2. Samples: 842904660. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:33,989][27935] Avg episode reward: [(0, '-1.234')] [2022-07-13 18:54:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 421466112. Throughput: 0: 9564.4. Samples: 842933192. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:38,989][27935] Avg episode reward: [(0, '-2.530')] [2022-07-13 18:54:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4769.4). Total num frames: 421490688. Throughput: 0: 9553.4. Samples: 842990948. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:43,989][27935] Avg episode reward: [(0, '-2.348')] [2022-07-13 18:54:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 421513216. Throughput: 0: 9640.9. Samples: 843049412. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:48,989][27935] Avg episode reward: [(0, '-2.867')] [2022-07-13 18:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 421539840. Throughput: 0: 9631.1. Samples: 843078280. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:53,989][27935] Avg episode reward: [(0, '-2.652')] [2022-07-13 18:54:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 421563392. Throughput: 0: 9629.3. Samples: 843136608. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:54:58,995][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 18:55:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4769.4). Total num frames: 421585920. Throughput: 0: 9544.6. Samples: 843190744. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:55:03,989][27935] Avg episode reward: [(0, '-1.459')] [2022-07-13 18:55:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 421609472. Throughput: 0: 9560.2. Samples: 843220060. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:55:08,989][27935] Avg episode reward: [(0, '-1.136')] [2022-07-13 18:55:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 421634048. Throughput: 0: 9564.8. Samples: 843277660. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:55:13,989][27935] Avg episode reward: [(0, '-0.662')] [2022-07-13 18:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 421657600. Throughput: 0: 9581.2. Samples: 843335816. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:55:18,989][27935] Avg episode reward: [(0, '-0.600')] [2022-07-13 18:55:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 421682176. Throughput: 0: 9588.4. Samples: 843364672. Policy #0 lag: (min: 0.0, avg: 9.4, max: 20.0) [2022-07-13 18:55:23,989][27935] Avg episode reward: [(0, '0.325')] [2022-07-13 18:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 421706752. Throughput: 0: 9600.9. Samples: 843422988. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:28,989][27935] Avg episode reward: [(0, '0.182')] [2022-07-13 18:55:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 421730304. Throughput: 0: 9585.9. Samples: 843480776. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:33,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 18:55:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 421753856. Throughput: 0: 9590.0. Samples: 843509828. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:38,989][27935] Avg episode reward: [(0, '-0.240')] [2022-07-13 18:55:43,999][27935] Fps is (10 sec: 4910.3, 60 sec: 4812.0, 300 sec: 4790.1). Total num frames: 421779456. Throughput: 0: 9586.0. Samples: 843568072. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:43,999][27935] Avg episode reward: [(0, '0.455')] [2022-07-13 18:55:48,992][27935] Fps is (10 sec: 5015.8, 60 sec: 4846.6, 300 sec: 4790.2). Total num frames: 421804032. Throughput: 0: 9671.6. Samples: 843626000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:48,993][27935] Avg episode reward: [(0, '0.276')] [2022-07-13 18:55:53,989][27935] Fps is (10 sec: 4920.1, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 421828608. Throughput: 0: 9669.7. Samples: 843655196. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:53,990][27935] Avg episode reward: [(0, '0.347')] [2022-07-13 18:55:58,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 421852160. Throughput: 0: 9669.1. Samples: 843712768. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:55:58,989][27935] Avg episode reward: [(0, '-0.739')] [2022-07-13 18:56:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 421873664. Throughput: 0: 9575.2. Samples: 843766700. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:03,990][27935] Avg episode reward: [(0, '-0.626')] [2022-07-13 18:56:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 421897216. Throughput: 0: 9557.0. Samples: 843794736. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:08,989][27935] Avg episode reward: [(0, '-0.953')] [2022-07-13 18:56:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 421920768. Throughput: 0: 9520.9. Samples: 843851428. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:13,989][27935] Avg episode reward: [(0, '-0.996')] [2022-07-13 18:56:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 421944320. Throughput: 0: 9535.8. Samples: 843909888. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:18,989][27935] Avg episode reward: [(0, '-1.133')] [2022-07-13 18:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 421968896. Throughput: 0: 9533.7. Samples: 843938844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:23,989][27935] Avg episode reward: [(0, '-0.657')] [2022-07-13 18:56:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 421994496. Throughput: 0: 9535.3. Samples: 843997064. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:28,989][27935] Avg episode reward: [(0, '-0.139')] [2022-07-13 18:56:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 422018048. Throughput: 0: 9530.0. Samples: 844054816. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:33,990][27935] Avg episode reward: [(0, '0.639')] [2022-07-13 18:56:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 422041600. Throughput: 0: 9523.0. Samples: 844083732. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:38,989][27935] Avg episode reward: [(0, '0.502')] [2022-07-13 18:56:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4779.5, 300 sec: 4797.2). Total num frames: 422066176. Throughput: 0: 9540.1. Samples: 844142072. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:43,989][27935] Avg episode reward: [(0, '1.488')] [2022-07-13 18:56:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.9, 300 sec: 4800.7). Total num frames: 422090752. Throughput: 0: 9640.4. Samples: 844200516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:48,989][27935] Avg episode reward: [(0, '1.542')] [2022-07-13 18:56:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 422114304. Throughput: 0: 9663.2. Samples: 844229580. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:53,989][27935] Avg episode reward: [(0, '0.859')] [2022-07-13 18:56:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 422138880. Throughput: 0: 9702.9. Samples: 844288056. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:56:58,990][27935] Avg episode reward: [(0, '1.015')] [2022-07-13 18:57:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 422161408. Throughput: 0: 9599.9. Samples: 844341884. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:03,989][27935] Avg episode reward: [(0, '0.960')] [2022-07-13 18:57:08,990][27935] Fps is (10 sec: 4710.0, 60 sec: 4812.7, 300 sec: 4804.1). Total num frames: 422185984. Throughput: 0: 9611.5. Samples: 844371368. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:08,990][27935] Avg episode reward: [(0, '0.921')] [2022-07-13 18:57:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4800.6). Total num frames: 422209536. Throughput: 0: 9606.3. Samples: 844429348. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:13,989][27935] Avg episode reward: [(0, '0.651')] [2022-07-13 18:57:18,989][27935] Fps is (10 sec: 4813.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 422234112. Throughput: 0: 9618.1. Samples: 844487632. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:18,989][27935] Avg episode reward: [(0, '0.649')] [2022-07-13 18:57:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 422257664. Throughput: 0: 9627.7. Samples: 844516980. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:23,989][27935] Avg episode reward: [(0, '0.612')] [2022-07-13 18:57:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 422283264. Throughput: 0: 9619.6. Samples: 844574956. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:28,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 18:57:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 422306816. Throughput: 0: 9615.9. Samples: 844633232. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:33,989][27935] Avg episode reward: [(0, '0.611')] [2022-07-13 18:57:38,996][27935] Fps is (10 sec: 4911.5, 60 sec: 4846.3, 300 sec: 4807.5). Total num frames: 422332416. Throughput: 0: 9619.3. Samples: 844662520. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:38,997][27935] Avg episode reward: [(0, '0.436')] [2022-07-13 18:57:43,992][27935] Fps is (10 sec: 4811.1, 60 sec: 4812.5, 300 sec: 4800.6). Total num frames: 422354944. Throughput: 0: 9594.8. Samples: 844719856. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:43,993][27935] Avg episode reward: [(0, '-0.105')] [2022-07-13 18:57:48,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 422379520. Throughput: 0: 9706.5. Samples: 844778676. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:48,989][27935] Avg episode reward: [(0, '-0.030')] [2022-07-13 18:57:53,989][27935] Fps is (10 sec: 4916.9, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 422404096. Throughput: 0: 9704.1. Samples: 844808044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:53,989][27935] Avg episode reward: [(0, '0.062')] [2022-07-13 18:57:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 422427648. Throughput: 0: 9707.3. Samples: 844866176. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:57:58,989][27935] Avg episode reward: [(0, '-0.563')] [2022-07-13 18:58:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 422450176. Throughput: 0: 9628.8. Samples: 844920928. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 18:58:03,990][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 18:58:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.9, 300 sec: 4807.6). Total num frames: 422474752. Throughput: 0: 9620.4. Samples: 844949900. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:08,989][27935] Avg episode reward: [(0, '-1.284')] [2022-07-13 18:58:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 422499328. Throughput: 0: 9624.7. Samples: 845008068. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:13,989][27935] Avg episode reward: [(0, '-1.876')] [2022-07-13 18:58:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 422523904. Throughput: 0: 9606.7. Samples: 845065532. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:18,989][27935] Avg episode reward: [(0, '-1.094')] [2022-07-13 18:58:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 422547456. Throughput: 0: 9600.7. Samples: 845094480. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:23,989][27935] Avg episode reward: [(0, '-1.485')] [2022-07-13 18:58:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 422571008. Throughput: 0: 9619.0. Samples: 845152676. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:28,990][27935] Avg episode reward: [(0, '-1.869')] [2022-07-13 18:58:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 422595584. Throughput: 0: 9604.3. Samples: 845210868. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:33,989][27935] Avg episode reward: [(0, '-1.254')] [2022-07-13 18:58:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4779.3, 300 sec: 4797.2). Total num frames: 422619136. Throughput: 0: 9599.5. Samples: 845240020. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:38,989][27935] Avg episode reward: [(0, '-1.231')] [2022-07-13 18:58:43,992][27935] Fps is (10 sec: 4913.5, 60 sec: 4829.9, 300 sec: 4807.5). Total num frames: 422644736. Throughput: 0: 9604.8. Samples: 845298428. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:43,993][27935] Avg episode reward: [(0, '-0.514')] [2022-07-13 18:58:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 422669312. Throughput: 0: 9685.2. Samples: 845356760. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:48,989][27935] Avg episode reward: [(0, '-0.434')] [2022-07-13 18:58:53,989][27935] Fps is (10 sec: 4814.5, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 422692864. Throughput: 0: 9695.2. Samples: 845386184. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:53,989][27935] Avg episode reward: [(0, '-1.026')] [2022-07-13 18:58:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 422716416. Throughput: 0: 9691.7. Samples: 845444196. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:58:58,989][27935] Avg episode reward: [(0, '-0.782')] [2022-07-13 18:59:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 422738944. Throughput: 0: 9618.9. Samples: 845498384. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:03,989][27935] Avg episode reward: [(0, '-0.864')] [2022-07-13 18:59:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 422764544. Throughput: 0: 9619.9. Samples: 845527376. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:08,989][27935] Avg episode reward: [(0, '-1.285')] [2022-07-13 18:59:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 422788096. Throughput: 0: 9608.6. Samples: 845585064. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:13,990][27935] Avg episode reward: [(0, '-0.478')] [2022-07-13 18:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 422811648. Throughput: 0: 9595.4. Samples: 845642660. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:18,989][27935] Avg episode reward: [(0, '-0.597')] [2022-07-13 18:59:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 422835200. Throughput: 0: 9595.0. Samples: 845671796. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:23,990][27935] Avg episode reward: [(0, '-0.078')] [2022-07-13 18:59:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 422860800. Throughput: 0: 9591.7. Samples: 845730020. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:28,989][27935] Avg episode reward: [(0, '-0.642')] [2022-07-13 18:59:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 422884352. Throughput: 0: 9582.3. Samples: 845787964. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:33,989][27935] Avg episode reward: [(0, '-0.365')] [2022-07-13 18:59:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 422907904. Throughput: 0: 9579.7. Samples: 845817272. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:38,989][27935] Avg episode reward: [(0, '-0.411')] [2022-07-13 18:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.1, 300 sec: 4814.5). Total num frames: 422933504. Throughput: 0: 9585.4. Samples: 845875540. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:43,990][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 18:59:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 422957056. Throughput: 0: 9679.8. Samples: 845933976. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:48,989][27935] Avg episode reward: [(0, '-0.654')] [2022-07-13 18:59:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 422982656. Throughput: 0: 9693.0. Samples: 845963560. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:53,989][27935] Avg episode reward: [(0, '-0.683')] [2022-07-13 18:59:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 423005184. Throughput: 0: 9694.3. Samples: 846021308. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 18:59:58,989][27935] Avg episode reward: [(0, '-0.069')] [2022-07-13 19:00:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 423028736. Throughput: 0: 9612.3. Samples: 846075212. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:03,989][27935] Avg episode reward: [(0, '0.239')] [2022-07-13 19:00:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423052288. Throughput: 0: 9599.3. Samples: 846103764. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:08,989][27935] Avg episode reward: [(0, '0.410')] [2022-07-13 19:00:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423075840. Throughput: 0: 9594.2. Samples: 846161760. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:13,989][27935] Avg episode reward: [(0, '0.755')] [2022-07-13 19:00:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 423101440. Throughput: 0: 9594.4. Samples: 846219712. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:18,989][27935] Avg episode reward: [(0, '0.597')] [2022-07-13 19:00:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 423122944. Throughput: 0: 9598.4. Samples: 846249200. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:23,989][27935] Avg episode reward: [(0, '0.634')] [2022-07-13 19:00:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 423150592. Throughput: 0: 9589.3. Samples: 846307060. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:28,989][27935] Avg episode reward: [(0, '0.019')] [2022-07-13 19:00:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423172096. Throughput: 0: 9582.9. Samples: 846365208. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:33,989][27935] Avg episode reward: [(0, '0.253')] [2022-07-13 19:00:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.3). Total num frames: 423196672. Throughput: 0: 9575.6. Samples: 846394460. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:38,989][27935] Avg episode reward: [(0, '-0.273')] [2022-07-13 19:00:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.2). Total num frames: 423221248. Throughput: 0: 9588.8. Samples: 846452804. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:43,990][27935] Avg episode reward: [(0, '-0.365')] [2022-07-13 19:00:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 423245824. Throughput: 0: 9688.9. Samples: 846511212. Policy #0 lag: (min: 0.0, avg: 8.1, max: 17.0) [2022-07-13 19:00:48,989][27935] Avg episode reward: [(0, '-0.718')] [2022-07-13 19:00:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423270400. Throughput: 0: 9709.0. Samples: 846540668. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:00:53,990][27935] Avg episode reward: [(0, '-0.335')] [2022-07-13 19:00:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 423293952. Throughput: 0: 9712.1. Samples: 846598804. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:00:58,989][27935] Avg episode reward: [(0, '-0.458')] [2022-07-13 19:01:03,992][27935] Fps is (10 sec: 4504.1, 60 sec: 4778.4, 300 sec: 4807.5). Total num frames: 423315456. Throughput: 0: 9625.4. Samples: 846652888. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:03,993][27935] Avg episode reward: [(0, '-0.150')] [2022-07-13 19:01:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 423342080. Throughput: 0: 9618.6. Samples: 846682036. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:08,989][27935] Avg episode reward: [(0, '-0.207')] [2022-07-13 19:01:13,989][27935] Fps is (10 sec: 5019.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 423365632. Throughput: 0: 9628.2. Samples: 846740328. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:13,989][27935] Avg episode reward: [(0, '0.524')] [2022-07-13 19:01:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 423388160. Throughput: 0: 9635.1. Samples: 846798788. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:18,989][27935] Avg episode reward: [(0, '0.801')] [2022-07-13 19:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 423413760. Throughput: 0: 9632.3. Samples: 846827912. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:23,989][27935] Avg episode reward: [(0, '0.764')] [2022-07-13 19:01:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 423438336. Throughput: 0: 9629.9. Samples: 846886148. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:28,989][27935] Avg episode reward: [(0, '0.807')] [2022-07-13 19:01:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 423461888. Throughput: 0: 9625.9. Samples: 846944380. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:33,989][27935] Avg episode reward: [(0, '0.902')] [2022-07-13 19:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 423486464. Throughput: 0: 9617.6. Samples: 846973460. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:38,990][27935] Avg episode reward: [(0, '0.435')] [2022-07-13 19:01:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 423511040. Throughput: 0: 9622.0. Samples: 847031792. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:43,989][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 19:01:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 423535616. Throughput: 0: 9722.3. Samples: 847090360. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:48,989][27935] Avg episode reward: [(0, '-0.209')] [2022-07-13 19:01:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 423559168. Throughput: 0: 9725.6. Samples: 847119688. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:53,989][27935] Avg episode reward: [(0, '0.251')] [2022-07-13 19:01:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 423583744. Throughput: 0: 9721.1. Samples: 847177776. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:01:58,989][27935] Avg episode reward: [(0, '0.170')] [2022-07-13 19:02:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.3, 300 sec: 4818.0). Total num frames: 423607296. Throughput: 0: 9628.0. Samples: 847232048. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:03,989][27935] Avg episode reward: [(0, '0.343')] [2022-07-13 19:02:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 423629824. Throughput: 0: 9625.6. Samples: 847261064. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:08,989][27935] Avg episode reward: [(0, '0.744')] [2022-07-13 19:02:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 423653376. Throughput: 0: 9572.1. Samples: 847316892. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:13,989][27935] Avg episode reward: [(0, '1.569')] [2022-07-13 19:02:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 423677952. Throughput: 0: 9559.7. Samples: 847374568. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:18,989][27935] Avg episode reward: [(0, '1.629')] [2022-07-13 19:02:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423701504. Throughput: 0: 9566.8. Samples: 847403968. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:23,989][27935] Avg episode reward: [(0, '1.676')] [2022-07-13 19:02:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 423725056. Throughput: 0: 9565.8. Samples: 847462252. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:28,989][27935] Avg episode reward: [(0, '1.810')] [2022-07-13 19:02:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.2). Total num frames: 423751680. Throughput: 0: 9553.5. Samples: 847520268. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:33,989][27935] Avg episode reward: [(0, '1.564')] [2022-07-13 19:02:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4814.6). Total num frames: 423775232. Throughput: 0: 9552.4. Samples: 847549544. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:38,989][27935] Avg episode reward: [(0, '0.463')] [2022-07-13 19:02:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 423798784. Throughput: 0: 9531.9. Samples: 847606712. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:43,989][27935] Avg episode reward: [(0, '-0.818')] [2022-07-13 19:02:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 423822336. Throughput: 0: 9620.6. Samples: 847664976. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:48,989][27935] Avg episode reward: [(0, '-1.221')] [2022-07-13 19:02:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 423846912. Throughput: 0: 9620.8. Samples: 847694000. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:53,989][27935] Avg episode reward: [(0, '-1.545')] [2022-07-13 19:02:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 423870464. Throughput: 0: 9682.3. Samples: 847752596. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:02:58,989][27935] Avg episode reward: [(0, '-1.659')] [2022-07-13 19:03:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 423895040. Throughput: 0: 9038.8. Samples: 847781312. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:03,989][27935] Avg episode reward: [(0, '-1.963')] [2022-07-13 19:03:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423917568. Throughput: 0: 9591.9. Samples: 847835604. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:08,989][27935] Avg episode reward: [(0, '-1.892')] [2022-07-13 19:03:13,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 423942144. Throughput: 0: 9583.5. Samples: 847893508. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:13,989][27935] Avg episode reward: [(0, '-0.955')] [2022-07-13 19:03:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423965696. Throughput: 0: 9573.9. Samples: 847951092. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:18,989][27935] Avg episode reward: [(0, '-0.828')] [2022-07-13 19:03:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 423989248. Throughput: 0: 9567.3. Samples: 847980072. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:23,990][27935] Avg episode reward: [(0, '0.345')] [2022-07-13 19:03:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 424014848. Throughput: 0: 9597.2. Samples: 848038588. Policy #0 lag: (min: 0.0, avg: 9.6, max: 21.0) [2022-07-13 19:03:28,990][27935] Avg episode reward: [(0, '0.115')] [2022-07-13 19:03:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 424039424. Throughput: 0: 9592.1. Samples: 848096620. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:33,989][27935] Avg episode reward: [(0, '0.164')] [2022-07-13 19:03:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.2). Total num frames: 424061952. Throughput: 0: 9592.3. Samples: 848125652. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:38,989][27935] Avg episode reward: [(0, '-0.701')] [2022-07-13 19:03:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 424086528. Throughput: 0: 9590.8. Samples: 848184180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:43,989][27935] Avg episode reward: [(0, '-0.669')] [2022-07-13 19:03:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 424112128. Throughput: 0: 10233.2. Samples: 848241808. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:48,989][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 19:03:53,990][27935] Fps is (10 sec: 4914.8, 60 sec: 4812.7, 300 sec: 4811.1). Total num frames: 424135680. Throughput: 0: 9671.7. Samples: 848270836. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:53,990][27935] Avg episode reward: [(0, '-0.006')] [2022-07-13 19:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 424160256. Throughput: 0: 9674.9. Samples: 848328876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:03:58,989][27935] Avg episode reward: [(0, '0.148')] [2022-07-13 19:04:03,989][27935] Fps is (10 sec: 4608.3, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 424181760. Throughput: 0: 9599.1. Samples: 848383052. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:03,989][27935] Avg episode reward: [(0, '0.623')] [2022-07-13 19:04:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 424205312. Throughput: 0: 9593.7. Samples: 848411788. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:08,989][27935] Avg episode reward: [(0, '0.054')] [2022-07-13 19:04:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 424229888. Throughput: 0: 9582.1. Samples: 848469784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:13,990][27935] Avg episode reward: [(0, '1.094')] [2022-07-13 19:04:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 424255488. Throughput: 0: 9578.8. Samples: 848527664. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:18,989][27935] Avg episode reward: [(0, '0.448')] [2022-07-13 19:04:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 424278016. Throughput: 0: 9573.2. Samples: 848556448. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:23,989][27935] Avg episode reward: [(0, '-0.093')] [2022-07-13 19:04:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 424301568. Throughput: 0: 9564.2. Samples: 848614568. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:28,990][27935] Avg episode reward: [(0, '-0.086')] [2022-07-13 19:04:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 424326144. Throughput: 0: 9542.7. Samples: 848671228. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:33,989][27935] Avg episode reward: [(0, '-0.447')] [2022-07-13 19:04:38,990][27935] Fps is (10 sec: 4812.1, 60 sec: 4795.6, 300 sec: 4800.6). Total num frames: 424349696. Throughput: 0: 9538.0. Samples: 848700052. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:38,991][27935] Avg episode reward: [(0, '-0.733')] [2022-07-13 19:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 424375296. Throughput: 0: 9535.9. Samples: 848757992. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:43,989][27935] Avg episode reward: [(0, '-1.122')] [2022-07-13 19:04:48,989][27935] Fps is (10 sec: 4915.9, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 424398848. Throughput: 0: 9610.8. Samples: 848815540. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:48,990][27935] Avg episode reward: [(0, '-1.233')] [2022-07-13 19:04:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 424422400. Throughput: 0: 9622.1. Samples: 848844784. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:53,989][27935] Avg episode reward: [(0, '-0.345')] [2022-07-13 19:04:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 424445952. Throughput: 0: 9611.2. Samples: 848902288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:04:58,989][27935] Avg episode reward: [(0, '0.262')] [2022-07-13 19:05:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 424467456. Throughput: 0: 9515.8. Samples: 848955876. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:03,989][27935] Avg episode reward: [(0, '0.517')] [2022-07-13 19:05:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 424493056. Throughput: 0: 9506.1. Samples: 848984224. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:08,989][27935] Avg episode reward: [(0, '0.825')] [2022-07-13 19:05:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 424516608. Throughput: 0: 9474.5. Samples: 849040920. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:13,989][27935] Avg episode reward: [(0, '1.543')] [2022-07-13 19:05:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4800.7). Total num frames: 424539136. Throughput: 0: 9505.3. Samples: 849098968. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:18,989][27935] Avg episode reward: [(0, '2.249')] [2022-07-13 19:05:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 424563712. Throughput: 0: 9505.1. Samples: 849127768. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:23,989][27935] Avg episode reward: [(0, '2.294')] [2022-07-13 19:05:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 424587264. Throughput: 0: 9506.0. Samples: 849185760. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:28,989][27935] Avg episode reward: [(0, '1.796')] [2022-07-13 19:05:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 424612864. Throughput: 0: 9504.0. Samples: 849243220. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:33,989][27935] Avg episode reward: [(0, '1.352')] [2022-07-13 19:05:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.8, 300 sec: 4797.2). Total num frames: 424636416. Throughput: 0: 9487.9. Samples: 849271740. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:38,989][27935] Avg episode reward: [(0, '1.258')] [2022-07-13 19:05:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 424659968. Throughput: 0: 9497.7. Samples: 849329684. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:43,989][27935] Avg episode reward: [(0, '1.528')] [2022-07-13 19:05:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 424683520. Throughput: 0: 9590.0. Samples: 849387428. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:48,989][27935] Avg episode reward: [(0, '1.409')] [2022-07-13 19:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 424707072. Throughput: 0: 9599.0. Samples: 849416180. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:53,989][27935] Avg episode reward: [(0, '0.365')] [2022-07-13 19:05:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 424731648. Throughput: 0: 9625.5. Samples: 849474068. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:05:58,990][27935] Avg episode reward: [(0, '-0.410')] [2022-07-13 19:06:03,992][27935] Fps is (10 sec: 4708.7, 60 sec: 4778.4, 300 sec: 4786.7). Total num frames: 424754176. Throughput: 0: 9527.6. Samples: 849527744. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:06:03,993][27935] Avg episode reward: [(0, '-0.860')] [2022-07-13 19:06:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 424778752. Throughput: 0: 9521.9. Samples: 849556252. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:06:08,989][27935] Avg episode reward: [(0, '-1.469')] [2022-07-13 19:06:13,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4761.6, 300 sec: 4793.7). Total num frames: 424802304. Throughput: 0: 9516.3. Samples: 849613992. Policy #0 lag: (min: 0.0, avg: 8.5, max: 20.0) [2022-07-13 19:06:13,989][27935] Avg episode reward: [(0, '-2.123')] [2022-07-13 19:06:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 424825856. Throughput: 0: 9514.3. Samples: 849671364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:18,990][27935] Avg episode reward: [(0, '-2.123')] [2022-07-13 19:06:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 424849408. Throughput: 0: 9516.6. Samples: 849699984. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:23,989][27935] Avg episode reward: [(0, '-1.408')] [2022-07-13 19:06:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 424873984. Throughput: 0: 9508.4. Samples: 849757560. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:28,989][27935] Avg episode reward: [(0, '-0.681')] [2022-07-13 19:06:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 424897536. Throughput: 0: 9502.3. Samples: 849815032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:33,989][27935] Avg episode reward: [(0, '-0.611')] [2022-07-13 19:06:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 424923136. Throughput: 0: 9506.7. Samples: 849843980. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:38,989][27935] Avg episode reward: [(0, '-0.065')] [2022-07-13 19:06:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 424945664. Throughput: 0: 9506.9. Samples: 849901880. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:43,989][27935] Avg episode reward: [(0, '0.456')] [2022-07-13 19:06:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 424970240. Throughput: 0: 9596.2. Samples: 849959540. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:48,989][27935] Avg episode reward: [(0, '0.958')] [2022-07-13 19:06:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4783.3). Total num frames: 424994816. Throughput: 0: 9608.3. Samples: 849988624. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:53,989][27935] Avg episode reward: [(0, '0.041')] [2022-07-13 19:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 425018368. Throughput: 0: 9606.2. Samples: 850046272. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:06:58,991][27935] Avg episode reward: [(0, '-0.111')] [2022-07-13 19:07:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.9, 300 sec: 4779.8). Total num frames: 425039872. Throughput: 0: 8972.9. Samples: 850075144. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:03,991][27935] Avg episode reward: [(0, '0.440')] [2022-07-13 19:07:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 425064448. Throughput: 0: 9529.1. Samples: 850128792. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:08,989][27935] Avg episode reward: [(0, '0.184')] [2022-07-13 19:07:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 425089024. Throughput: 0: 9535.1. Samples: 850186640. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:13,989][27935] Avg episode reward: [(0, '0.257')] [2022-07-13 19:07:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 425111552. Throughput: 0: 9544.0. Samples: 850244512. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:18,989][27935] Avg episode reward: [(0, '-0.682')] [2022-07-13 19:07:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 425136128. Throughput: 0: 9542.0. Samples: 850273368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:23,989][27935] Avg episode reward: [(0, '-0.089')] [2022-07-13 19:07:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 425160704. Throughput: 0: 9549.6. Samples: 850331612. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:28,989][27935] Avg episode reward: [(0, '-0.680')] [2022-07-13 19:07:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 425186304. Throughput: 0: 9548.5. Samples: 850389224. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:33,989][27935] Avg episode reward: [(0, '-0.581')] [2022-07-13 19:07:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 425208832. Throughput: 0: 9550.4. Samples: 850418392. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:38,989][27935] Avg episode reward: [(0, '-0.229')] [2022-07-13 19:07:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 425232384. Throughput: 0: 9548.8. Samples: 850475968. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:43,989][27935] Avg episode reward: [(0, '0.069')] [2022-07-13 19:07:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 425256960. Throughput: 0: 10199.4. Samples: 850534116. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:48,989][27935] Avg episode reward: [(0, '0.572')] [2022-07-13 19:07:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4783.3). Total num frames: 425281536. Throughput: 0: 9654.0. Samples: 850563220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:53,990][27935] Avg episode reward: [(0, '1.182')] [2022-07-13 19:07:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 425305088. Throughput: 0: 9653.1. Samples: 850621028. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:07:58,989][27935] Avg episode reward: [(0, '0.863')] [2022-07-13 19:08:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 425327616. Throughput: 0: 9581.1. Samples: 850675660. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:03,991][27935] Avg episode reward: [(0, '1.807')] [2022-07-13 19:08:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 425352192. Throughput: 0: 9590.4. Samples: 850704936. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:08,990][27935] Avg episode reward: [(0, '1.004')] [2022-07-13 19:08:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4779.8). Total num frames: 425375744. Throughput: 0: 9576.3. Samples: 850762544. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:13,989][27935] Avg episode reward: [(0, '0.545')] [2022-07-13 19:08:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 425399296. Throughput: 0: 9549.4. Samples: 850818948. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:18,989][27935] Avg episode reward: [(0, '0.474')] [2022-07-13 19:08:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 425423872. Throughput: 0: 9546.9. Samples: 850848004. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:23,989][27935] Avg episode reward: [(0, '0.023')] [2022-07-13 19:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 425447424. Throughput: 0: 9561.2. Samples: 850906220. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:28,993][27935] Avg episode reward: [(0, '0.075')] [2022-07-13 19:08:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4779.8). Total num frames: 425472000. Throughput: 0: 9548.6. Samples: 850963804. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:33,989][27935] Avg episode reward: [(0, '-0.205')] [2022-07-13 19:08:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4779.8). Total num frames: 425496576. Throughput: 0: 9547.2. Samples: 850992844. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:38,989][27935] Avg episode reward: [(0, '0.145')] [2022-07-13 19:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4776.4). Total num frames: 425521152. Throughput: 0: 9564.4. Samples: 851051424. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:43,989][27935] Avg episode reward: [(0, '-0.143')] [2022-07-13 19:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 425545728. Throughput: 0: 9638.1. Samples: 851109376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:48,989][27935] Avg episode reward: [(0, '-0.457')] [2022-07-13 19:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 425569280. Throughput: 0: 9640.2. Samples: 851138744. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:08:53,989][27935] Avg episode reward: [(0, '-0.661')] [2022-07-13 19:08:58,990][27935] Fps is (10 sec: 4812.1, 60 sec: 4812.7, 300 sec: 4786.7). Total num frames: 425593856. Throughput: 0: 9664.8. Samples: 851197476. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:08:58,991][27935] Avg episode reward: [(0, '-0.331')] [2022-07-13 19:09:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 425616384. Throughput: 0: 9619.6. Samples: 851251832. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:03,989][27935] Avg episode reward: [(0, '-0.108')] [2022-07-13 19:09:08,989][27935] Fps is (10 sec: 4711.1, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 425640960. Throughput: 0: 9625.3. Samples: 851281144. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:08,989][27935] Avg episode reward: [(0, '0.227')] [2022-07-13 19:09:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4779.8). Total num frames: 425665536. Throughput: 0: 9633.1. Samples: 851339712. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:13,990][27935] Avg episode reward: [(0, '0.737')] [2022-07-13 19:09:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 425689088. Throughput: 0: 9640.9. Samples: 851397644. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:18,989][27935] Avg episode reward: [(0, '1.439')] [2022-07-13 19:09:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4790.2). Total num frames: 425714688. Throughput: 0: 9648.4. Samples: 851427024. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:23,989][27935] Avg episode reward: [(0, '1.373')] [2022-07-13 19:09:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4786.8). Total num frames: 425738240. Throughput: 0: 9638.7. Samples: 851485164. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:28,989][27935] Avg episode reward: [(0, '0.793')] [2022-07-13 19:09:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 425761792. Throughput: 0: 9645.5. Samples: 851543424. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:33,989][27935] Avg episode reward: [(0, '0.706')] [2022-07-13 19:09:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4779.8). Total num frames: 425785344. Throughput: 0: 9645.4. Samples: 851572788. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:38,989][27935] Avg episode reward: [(0, '0.804')] [2022-07-13 19:09:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4790.2). Total num frames: 425811968. Throughput: 0: 9638.3. Samples: 851631184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:43,989][27935] Avg episode reward: [(0, '-0.175')] [2022-07-13 19:09:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 425835520. Throughput: 0: 9722.5. Samples: 851689344. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:48,989][27935] Avg episode reward: [(0, '-0.862')] [2022-07-13 19:09:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4786.8). Total num frames: 425858048. Throughput: 0: 9724.0. Samples: 851718724. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:53,990][27935] Avg episode reward: [(0, '-0.456')] [2022-07-13 19:09:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.0, 300 sec: 4800.7). Total num frames: 425883648. Throughput: 0: 9718.6. Samples: 851777048. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:09:58,989][27935] Avg episode reward: [(0, '-0.571')] [2022-07-13 19:10:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4790.2). Total num frames: 425906176. Throughput: 0: 9628.5. Samples: 851830924. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:03,989][27935] Avg episode reward: [(0, '-0.179')] [2022-07-13 19:10:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 425930752. Throughput: 0: 9629.6. Samples: 851860356. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:08,989][27935] Avg episode reward: [(0, '-0.177')] [2022-07-13 19:10:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 425954304. Throughput: 0: 9627.5. Samples: 851918400. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:13,989][27935] Avg episode reward: [(0, '0.008')] [2022-07-13 19:10:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 425978880. Throughput: 0: 9616.6. Samples: 851976172. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:18,989][27935] Avg episode reward: [(0, '0.773')] [2022-07-13 19:10:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 426002432. Throughput: 0: 9616.8. Samples: 852005544. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:23,989][27935] Avg episode reward: [(0, '1.489')] [2022-07-13 19:10:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 426027008. Throughput: 0: 9610.0. Samples: 852063636. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:28,989][27935] Avg episode reward: [(0, '0.662')] [2022-07-13 19:10:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 426050560. Throughput: 0: 8960.7. Samples: 852092576. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:33,989][27935] Avg episode reward: [(0, '-0.640')] [2022-07-13 19:10:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 426074112. Throughput: 0: 9600.5. Samples: 852150748. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:38,989][27935] Avg episode reward: [(0, '-0.174')] [2022-07-13 19:10:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 426100736. Throughput: 0: 9606.0. Samples: 852209316. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:43,989][27935] Avg episode reward: [(0, '-0.159')] [2022-07-13 19:10:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 426124288. Throughput: 0: 9706.3. Samples: 852267708. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:48,989][27935] Avg episode reward: [(0, '-0.080')] [2022-07-13 19:10:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 426147840. Throughput: 0: 9702.0. Samples: 852296948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:53,990][27935] Avg episode reward: [(0, '-0.206')] [2022-07-13 19:10:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 426173440. Throughput: 0: 9706.3. Samples: 852355184. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:10:58,989][27935] Avg episode reward: [(0, '0.442')] [2022-07-13 19:11:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 426193920. Throughput: 0: 9639.7. Samples: 852409960. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:03,989][27935] Avg episode reward: [(0, '0.783')] [2022-07-13 19:11:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 426219520. Throughput: 0: 9622.0. Samples: 852438536. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:08,989][27935] Avg episode reward: [(0, '2.269')] [2022-07-13 19:11:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 426244096. Throughput: 0: 9618.2. Samples: 852496456. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:13,990][27935] Avg episode reward: [(0, '2.033')] [2022-07-13 19:11:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 426266624. Throughput: 0: 10252.7. Samples: 852553948. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:18,989][27935] Avg episode reward: [(0, '1.877')] [2022-07-13 19:11:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 426291200. Throughput: 0: 9592.0. Samples: 852582388. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:23,989][27935] Avg episode reward: [(0, '1.694')] [2022-07-13 19:11:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 426314752. Throughput: 0: 9573.6. Samples: 852640128. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:28,989][27935] Avg episode reward: [(0, '0.674')] [2022-07-13 19:11:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 426339328. Throughput: 0: 9552.5. Samples: 852697568. Policy #0 lag: (min: 0.0, avg: 9.7, max: 21.0) [2022-07-13 19:11:33,989][27935] Avg episode reward: [(0, '0.096')] [2022-07-13 19:11:38,994][27935] Fps is (10 sec: 4810.5, 60 sec: 4812.4, 300 sec: 4804.0). Total num frames: 426362880. Throughput: 0: 9546.6. Samples: 852726592. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:11:38,994][27935] Avg episode reward: [(0, '0.034')] [2022-07-13 19:11:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 426387456. Throughput: 0: 9545.2. Samples: 852784720. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:11:43,989][27935] Avg episode reward: [(0, '-0.340')] [2022-07-13 19:11:48,989][27935] Fps is (10 sec: 4917.5, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 426412032. Throughput: 0: 9634.2. Samples: 852843500. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:11:48,989][27935] Avg episode reward: [(0, '-0.204')] [2022-07-13 19:11:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 426436608. Throughput: 0: 9648.2. Samples: 852872704. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:11:53,989][27935] Avg episode reward: [(0, '-0.109')] [2022-07-13 19:11:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 426461184. Throughput: 0: 9663.1. Samples: 852931296. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:11:58,989][27935] Avg episode reward: [(0, '0.950')] [2022-07-13 19:12:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 426482688. Throughput: 0: 9584.6. Samples: 852985256. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:03,989][27935] Avg episode reward: [(0, '0.637')] [2022-07-13 19:12:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 426507264. Throughput: 0: 9597.6. Samples: 853014280. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:08,989][27935] Avg episode reward: [(0, '1.235')] [2022-07-13 19:12:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 426530816. Throughput: 0: 9602.0. Samples: 853072216. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:13,989][27935] Avg episode reward: [(0, '1.290')] [2022-07-13 19:12:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 426555392. Throughput: 0: 9626.7. Samples: 853130768. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:18,989][27935] Avg episode reward: [(0, '0.791')] [2022-07-13 19:12:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 426579968. Throughput: 0: 9630.6. Samples: 853159924. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:23,989][27935] Avg episode reward: [(0, '0.621')] [2022-07-13 19:12:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 426604544. Throughput: 0: 9636.6. Samples: 853218368. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:28,989][27935] Avg episode reward: [(0, '0.701')] [2022-07-13 19:12:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 426628096. Throughput: 0: 9623.2. Samples: 853276544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:33,989][27935] Avg episode reward: [(0, '0.024')] [2022-07-13 19:12:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.3, 300 sec: 4814.5). Total num frames: 426652672. Throughput: 0: 9626.3. Samples: 853305888. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:38,989][27935] Avg episode reward: [(0, '0.333')] [2022-07-13 19:12:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 426676224. Throughput: 0: 9627.5. Samples: 853364536. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:43,989][27935] Avg episode reward: [(0, '0.726')] [2022-07-13 19:12:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 426701824. Throughput: 0: 9715.3. Samples: 853422444. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:48,989][27935] Avg episode reward: [(0, '0.932')] [2022-07-13 19:12:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 426725376. Throughput: 0: 9711.8. Samples: 853451312. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:53,989][27935] Avg episode reward: [(0, '1.443')] [2022-07-13 19:12:58,990][27935] Fps is (10 sec: 4812.2, 60 sec: 4812.7, 300 sec: 4821.5). Total num frames: 426749952. Throughput: 0: 9717.3. Samples: 853509504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:12:58,991][27935] Avg episode reward: [(0, '1.355')] [2022-07-13 19:13:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 426772480. Throughput: 0: 9629.1. Samples: 853564076. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:03,989][27935] Avg episode reward: [(0, '1.698')] [2022-07-13 19:13:08,989][27935] Fps is (10 sec: 4608.5, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 426796032. Throughput: 0: 9623.7. Samples: 853592992. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:08,989][27935] Avg episode reward: [(0, '0.486')] [2022-07-13 19:13:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 426820608. Throughput: 0: 9619.2. Samples: 853651232. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:13,989][27935] Avg episode reward: [(0, '0.439')] [2022-07-13 19:13:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 426845184. Throughput: 0: 9621.6. Samples: 853709516. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:18,989][27935] Avg episode reward: [(0, '-0.010')] [2022-07-13 19:13:23,995][27935] Fps is (10 sec: 4912.2, 60 sec: 4829.4, 300 sec: 4821.4). Total num frames: 426869760. Throughput: 0: 9608.7. Samples: 853738340. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:23,996][27935] Avg episode reward: [(0, '0.060')] [2022-07-13 19:13:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 426893312. Throughput: 0: 9592.1. Samples: 853796180. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:28,989][27935] Avg episode reward: [(0, '-0.060')] [2022-07-13 19:13:33,989][27935] Fps is (10 sec: 4815.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 426917888. Throughput: 0: 9599.9. Samples: 853854440. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:33,989][27935] Avg episode reward: [(0, '-0.393')] [2022-07-13 19:13:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 426942464. Throughput: 0: 9609.7. Samples: 853883748. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:38,989][27935] Avg episode reward: [(0, '0.851')] [2022-07-13 19:13:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 426966016. Throughput: 0: 9623.1. Samples: 853942532. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:43,989][27935] Avg episode reward: [(0, '0.530')] [2022-07-13 19:13:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 426990592. Throughput: 0: 9703.3. Samples: 854000724. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:48,990][27935] Avg episode reward: [(0, '0.786')] [2022-07-13 19:13:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 427015168. Throughput: 0: 9710.4. Samples: 854029960. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:53,989][27935] Avg episode reward: [(0, '0.602')] [2022-07-13 19:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4830.0, 300 sec: 4824.9). Total num frames: 427039744. Throughput: 0: 9718.1. Samples: 854088544. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:13:58,989][27935] Avg episode reward: [(0, '0.773')] [2022-07-13 19:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 427061248. Throughput: 0: 9633.2. Samples: 854143008. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:14:03,990][27935] Avg episode reward: [(0, '1.227')] [2022-07-13 19:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 427086848. Throughput: 0: 9637.9. Samples: 854171988. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:14:08,989][27935] Avg episode reward: [(0, '1.352')] [2022-07-13 19:14:13,992][27935] Fps is (10 sec: 4811.4, 60 sec: 4812.6, 300 sec: 4814.5). Total num frames: 427109376. Throughput: 0: 9643.0. Samples: 854230140. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:14:13,992][27935] Avg episode reward: [(0, '1.001')] [2022-07-13 19:14:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427133952. Throughput: 0: 9607.3. Samples: 854286768. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:14:18,989][27935] Avg episode reward: [(0, '1.291')] [2022-07-13 19:14:23,989][27935] Fps is (10 sec: 4814.2, 60 sec: 4796.2, 300 sec: 4811.1). Total num frames: 427157504. Throughput: 0: 9584.3. Samples: 854315044. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:23,989][27935] Avg episode reward: [(0, '-0.042')] [2022-07-13 19:14:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 427182080. Throughput: 0: 9570.2. Samples: 854373192. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:28,989][27935] Avg episode reward: [(0, '-0.120')] [2022-07-13 19:14:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 427206656. Throughput: 0: 9572.1. Samples: 854431468. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:33,989][27935] Avg episode reward: [(0, '-0.360')] [2022-07-13 19:14:39,000][27935] Fps is (10 sec: 4807.6, 60 sec: 4794.9, 300 sec: 4807.4). Total num frames: 427230208. Throughput: 0: 9567.5. Samples: 854460600. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:39,000][27935] Avg episode reward: [(0, '-0.372')] [2022-07-13 19:14:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427254784. Throughput: 0: 9564.3. Samples: 854518936. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:43,989][27935] Avg episode reward: [(0, '0.155')] [2022-07-13 19:14:48,989][27935] Fps is (10 sec: 4920.5, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 427279360. Throughput: 0: 9645.9. Samples: 854577072. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:48,989][27935] Avg episode reward: [(0, '-0.552')] [2022-07-13 19:14:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 427302912. Throughput: 0: 9649.1. Samples: 854606196. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:53,989][27935] Avg episode reward: [(0, '-0.794')] [2022-07-13 19:14:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 427327488. Throughput: 0: 9657.8. Samples: 854664712. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:14:59,000][27935] Avg episode reward: [(0, '0.516')] [2022-07-13 19:15:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427350016. Throughput: 0: 9591.3. Samples: 854718376. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:03,989][27935] Avg episode reward: [(0, '0.768')] [2022-07-13 19:15:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 427373568. Throughput: 0: 9597.3. Samples: 854746924. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:08,989][27935] Avg episode reward: [(0, '0.597')] [2022-07-13 19:15:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4796.0, 300 sec: 4807.6). Total num frames: 427397120. Throughput: 0: 9596.4. Samples: 854805032. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:13,989][27935] Avg episode reward: [(0, '0.701')] [2022-07-13 19:15:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 427421696. Throughput: 0: 9596.2. Samples: 854863296. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:18,989][27935] Avg episode reward: [(0, '0.451')] [2022-07-13 19:15:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427446272. Throughput: 0: 9599.3. Samples: 854892464. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:23,989][27935] Avg episode reward: [(0, '1.368')] [2022-07-13 19:15:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 427469824. Throughput: 0: 9582.9. Samples: 854950168. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:28,989][27935] Avg episode reward: [(0, '0.433')] [2022-07-13 19:15:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 427494400. Throughput: 0: 9577.4. Samples: 855008056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:33,989][27935] Avg episode reward: [(0, '0.076')] [2022-07-13 19:15:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.7, 300 sec: 4807.6). Total num frames: 427518976. Throughput: 0: 9569.3. Samples: 855036816. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:38,989][27935] Avg episode reward: [(0, '-0.134')] [2022-07-13 19:15:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427543552. Throughput: 0: 9562.7. Samples: 855095032. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:43,989][27935] Avg episode reward: [(0, '-0.081')] [2022-07-13 19:15:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 427566080. Throughput: 0: 9668.9. Samples: 855153476. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:48,989][27935] Avg episode reward: [(0, '0.027')] [2022-07-13 19:15:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 427591680. Throughput: 0: 9678.3. Samples: 855182448. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:53,989][27935] Avg episode reward: [(0, '0.237')] [2022-07-13 19:15:58,989][27935] Fps is (10 sec: 4915.1, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 427615232. Throughput: 0: 9674.3. Samples: 855240376. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:15:58,989][27935] Avg episode reward: [(0, '0.943')] [2022-07-13 19:16:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 427637760. Throughput: 0: 9581.3. Samples: 855294452. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:03,989][27935] Avg episode reward: [(0, '1.690')] [2022-07-13 19:16:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 427662336. Throughput: 0: 9576.9. Samples: 855323424. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:08,989][27935] Avg episode reward: [(0, '1.851')] [2022-07-13 19:16:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427685888. Throughput: 0: 9589.6. Samples: 855381700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:13,989][27935] Avg episode reward: [(0, '1.524')] [2022-07-13 19:16:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427710464. Throughput: 0: 9603.3. Samples: 855440204. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:18,989][27935] Avg episode reward: [(0, '0.758')] [2022-07-13 19:16:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 427735040. Throughput: 0: 9609.4. Samples: 855469240. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:23,989][27935] Avg episode reward: [(0, '0.451')] [2022-07-13 19:16:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 427757568. Throughput: 0: 9600.5. Samples: 855527056. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:28,989][27935] Avg episode reward: [(0, '-0.011')] [2022-07-13 19:16:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 427782144. Throughput: 0: 9586.2. Samples: 855584856. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:33,989][27935] Avg episode reward: [(0, '-0.899')] [2022-07-13 19:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 427807744. Throughput: 0: 9585.6. Samples: 855613800. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:38,989][27935] Avg episode reward: [(0, '-1.312')] [2022-07-13 19:16:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 427830272. Throughput: 0: 9594.2. Samples: 855672116. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:43,989][27935] Avg episode reward: [(0, '-1.104')] [2022-07-13 19:16:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 427855872. Throughput: 0: 9687.5. Samples: 855730392. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:48,989][27935] Avg episode reward: [(0, '-1.116')] [2022-07-13 19:16:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427880448. Throughput: 0: 9689.2. Samples: 855759440. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:53,989][27935] Avg episode reward: [(0, '-0.037')] [2022-07-13 19:16:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 427904000. Throughput: 0: 9678.2. Samples: 855817220. Policy #0 lag: (min: 0.0, avg: 9.0, max: 21.0) [2022-07-13 19:16:58,989][27935] Avg episode reward: [(0, '0.031')] [2022-07-13 19:17:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 427925504. Throughput: 0: 9569.8. Samples: 855870844. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:03,989][27935] Avg episode reward: [(0, '0.219')] [2022-07-13 19:17:08,989][27935] Fps is (10 sec: 4505.5, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 427949056. Throughput: 0: 9566.6. Samples: 855899740. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:08,990][27935] Avg episode reward: [(0, '0.607')] [2022-07-13 19:17:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 427974656. Throughput: 0: 9569.3. Samples: 855957676. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:13,989][27935] Avg episode reward: [(0, '0.685')] [2022-07-13 19:17:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 427998208. Throughput: 0: 9566.3. Samples: 856015340. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:18,989][27935] Avg episode reward: [(0, '0.896')] [2022-07-13 19:17:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 428021760. Throughput: 0: 9565.2. Samples: 856044232. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:23,989][27935] Avg episode reward: [(0, '0.146')] [2022-07-13 19:17:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 428045312. Throughput: 0: 9564.5. Samples: 856102520. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:28,989][27935] Avg episode reward: [(0, '-1.396')] [2022-07-13 19:17:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 428070912. Throughput: 0: 9551.2. Samples: 856160196. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:33,989][27935] Avg episode reward: [(0, '-1.056')] [2022-07-13 19:17:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 428093440. Throughput: 0: 9552.3. Samples: 856189292. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:38,989][27935] Avg episode reward: [(0, '-0.770')] [2022-07-13 19:17:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 428119040. Throughput: 0: 9550.5. Samples: 856246992. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:43,995][27935] Avg episode reward: [(0, '-0.496')] [2022-07-13 19:17:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 428142592. Throughput: 0: 9646.7. Samples: 856304944. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:48,992][27935] Avg episode reward: [(0, '-1.260')] [2022-07-13 19:17:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 428167168. Throughput: 0: 9652.1. Samples: 856334084. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:53,989][27935] Avg episode reward: [(0, '-0.734')] [2022-07-13 19:17:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 428191744. Throughput: 0: 9658.3. Samples: 856392300. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:17:58,989][27935] Avg episode reward: [(0, '-0.735')] [2022-07-13 19:18:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 428212224. Throughput: 0: 9587.4. Samples: 856446772. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:03,989][27935] Avg episode reward: [(0, '-0.006')] [2022-07-13 19:18:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 428238848. Throughput: 0: 9594.5. Samples: 856475984. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:08,989][27935] Avg episode reward: [(0, '-0.116')] [2022-07-13 19:18:13,991][27935] Fps is (10 sec: 4914.1, 60 sec: 4778.5, 300 sec: 4800.6). Total num frames: 428261376. Throughput: 0: 9578.8. Samples: 856533588. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:13,992][27935] Avg episode reward: [(0, '-0.186')] [2022-07-13 19:18:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.8). Total num frames: 428285952. Throughput: 0: 9590.2. Samples: 856591756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:18,990][27935] Avg episode reward: [(0, '-0.578')] [2022-07-13 19:18:23,989][27935] Fps is (10 sec: 5018.7, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 428311552. Throughput: 0: 9591.6. Samples: 856620916. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:23,989][27935] Avg episode reward: [(0, '0.349')] [2022-07-13 19:18:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 428335104. Throughput: 0: 9602.9. Samples: 856679124. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:28,989][27935] Avg episode reward: [(0, '-0.581')] [2022-07-13 19:18:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 428358656. Throughput: 0: 9601.2. Samples: 856736996. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:33,989][27935] Avg episode reward: [(0, '0.080')] [2022-07-13 19:18:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 428383232. Throughput: 0: 9604.5. Samples: 856766288. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:38,989][27935] Avg episode reward: [(0, '0.085')] [2022-07-13 19:18:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 428406784. Throughput: 0: 9602.1. Samples: 856824396. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:43,990][27935] Avg episode reward: [(0, '-0.894')] [2022-07-13 19:18:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 428432384. Throughput: 0: 9683.7. Samples: 856882540. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:48,989][27935] Avg episode reward: [(0, '-1.005')] [2022-07-13 19:18:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 428456960. Throughput: 0: 9683.8. Samples: 856911756. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:53,989][27935] Avg episode reward: [(0, '-2.402')] [2022-07-13 19:18:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 428479488. Throughput: 0: 9691.5. Samples: 856969684. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:18:58,989][27935] Avg episode reward: [(0, '-1.548')] [2022-07-13 19:19:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 428500992. Throughput: 0: 9616.4. Samples: 857024492. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:03,989][27935] Avg episode reward: [(0, '-1.627')] [2022-07-13 19:19:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 428527616. Throughput: 0: 9617.4. Samples: 857053700. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:08,989][27935] Avg episode reward: [(0, '-2.032')] [2022-07-13 19:19:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4830.0, 300 sec: 4804.1). Total num frames: 428551168. Throughput: 0: 9618.2. Samples: 857111944. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:13,989][27935] Avg episode reward: [(0, '-1.786')] [2022-07-13 19:19:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 428575744. Throughput: 0: 9623.8. Samples: 857170068. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:18,989][27935] Avg episode reward: [(0, '-0.861')] [2022-07-13 19:19:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 428599296. Throughput: 0: 9618.9. Samples: 857199140. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:23,989][27935] Avg episode reward: [(0, '-0.591')] [2022-07-13 19:19:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 428622848. Throughput: 0: 9625.7. Samples: 857257552. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:28,990][27935] Avg episode reward: [(0, '0.030')] [2022-07-13 19:19:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.8). Total num frames: 428648448. Throughput: 0: 9618.4. Samples: 857315368. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:33,989][27935] Avg episode reward: [(0, '0.182')] [2022-07-13 19:19:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 428672000. Throughput: 0: 9613.9. Samples: 857344380. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:38,996][27935] Avg episode reward: [(0, '0.902')] [2022-07-13 19:19:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 428696576. Throughput: 0: 9612.0. Samples: 857402224. Policy #0 lag: (min: 0.0, avg: 9.0, max: 19.0) [2022-07-13 19:19:43,989][27935] Avg episode reward: [(0, '0.824')] [2022-07-13 19:19:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 428720128. Throughput: 0: 9686.5. Samples: 857460384. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:19:48,989][27935] Avg episode reward: [(0, '0.587')] [2022-07-13 19:19:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 428744704. Throughput: 0: 9688.5. Samples: 857489684. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:19:53,989][27935] Avg episode reward: [(0, '0.389')] [2022-07-13 19:19:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 428769280. Throughput: 0: 9698.1. Samples: 857548356. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:19:58,989][27935] Avg episode reward: [(0, '1.584')] [2022-07-13 19:20:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4811.1). Total num frames: 428792832. Throughput: 0: 9623.2. Samples: 857603112. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:03,989][27935] Avg episode reward: [(0, '1.730')] [2022-07-13 19:20:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 428816384. Throughput: 0: 9629.0. Samples: 857632444. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:08,989][27935] Avg episode reward: [(0, '1.581')] [2022-07-13 19:20:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 428839936. Throughput: 0: 9624.7. Samples: 857690664. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:13,989][27935] Avg episode reward: [(0, '1.345')] [2022-07-13 19:20:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 428864512. Throughput: 0: 9639.4. Samples: 857749140. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:18,989][27935] Avg episode reward: [(0, '0.305')] [2022-07-13 19:20:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 428889088. Throughput: 0: 9619.1. Samples: 857777240. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:23,989][27935] Avg episode reward: [(0, '0.482')] [2022-07-13 19:20:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 428911616. Throughput: 0: 9598.4. Samples: 857834152. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:28,989][27935] Avg episode reward: [(0, '-0.201')] [2022-07-13 19:20:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 428935168. Throughput: 0: 9596.9. Samples: 857892244. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:33,989][27935] Avg episode reward: [(0, '-0.447')] [2022-07-13 19:20:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 428960768. Throughput: 0: 9586.4. Samples: 857921072. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:38,989][27935] Avg episode reward: [(0, '-1.034')] [2022-07-13 19:20:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 428984320. Throughput: 0: 9581.1. Samples: 857979504. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:43,989][27935] Avg episode reward: [(0, '-0.882')] [2022-07-13 19:20:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 429008896. Throughput: 0: 9652.4. Samples: 858037468. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:48,989][27935] Avg episode reward: [(0, '-0.027')] [2022-07-13 19:20:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 429033472. Throughput: 0: 9649.8. Samples: 858066684. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:53,989][27935] Avg episode reward: [(0, '0.024')] [2022-07-13 19:20:58,990][27935] Fps is (10 sec: 5016.9, 60 sec: 4829.8, 300 sec: 4818.0). Total num frames: 429059072. Throughput: 0: 9652.2. Samples: 858125024. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:20:58,991][27935] Avg episode reward: [(0, '-0.374')] [2022-07-13 19:21:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429080576. Throughput: 0: 9559.7. Samples: 858179328. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:03,989][27935] Avg episode reward: [(0, '0.368')] [2022-07-13 19:21:08,989][27935] Fps is (10 sec: 4506.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429104128. Throughput: 0: 9583.6. Samples: 858208500. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:08,989][27935] Avg episode reward: [(0, '1.222')] [2022-07-13 19:21:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 429128704. Throughput: 0: 9605.7. Samples: 858266408. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:13,990][27935] Avg episode reward: [(0, '1.053')] [2022-07-13 19:21:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 429152256. Throughput: 0: 9607.2. Samples: 858324568. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:18,989][27935] Avg episode reward: [(0, '0.280')] [2022-07-13 19:21:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 429176832. Throughput: 0: 9613.7. Samples: 858353688. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:23,989][27935] Avg episode reward: [(0, '0.477')] [2022-07-13 19:21:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 429201408. Throughput: 0: 9612.6. Samples: 858412072. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:28,989][27935] Avg episode reward: [(0, '0.249')] [2022-07-13 19:21:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 429224960. Throughput: 0: 9608.4. Samples: 858469844. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:33,989][27935] Avg episode reward: [(0, '-0.023')] [2022-07-13 19:21:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 429249536. Throughput: 0: 9602.4. Samples: 858498792. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:38,989][27935] Avg episode reward: [(0, '-0.086')] [2022-07-13 19:21:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 429274112. Throughput: 0: 9595.9. Samples: 858556828. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:43,989][27935] Avg episode reward: [(0, '0.024')] [2022-07-13 19:21:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 429297664. Throughput: 0: 9677.8. Samples: 858614828. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:48,989][27935] Avg episode reward: [(0, '-0.360')] [2022-07-13 19:21:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 429322240. Throughput: 0: 9675.0. Samples: 858643876. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:53,989][27935] Avg episode reward: [(0, '-1.028')] [2022-07-13 19:21:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.7, 300 sec: 4811.1). Total num frames: 429344768. Throughput: 0: 9680.9. Samples: 858702048. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:21:58,989][27935] Avg episode reward: [(0, '-0.869')] [2022-07-13 19:22:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 429368320. Throughput: 0: 9595.8. Samples: 858756380. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:03,989][27935] Avg episode reward: [(0, '-0.397')] [2022-07-13 19:22:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 429392896. Throughput: 0: 9595.6. Samples: 858785492. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:08,989][27935] Avg episode reward: [(0, '0.099')] [2022-07-13 19:22:13,990][27935] Fps is (10 sec: 5017.1, 60 sec: 4829.8, 300 sec: 4814.5). Total num frames: 429418496. Throughput: 0: 9583.3. Samples: 858843328. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:13,990][27935] Avg episode reward: [(0, '-0.246')] [2022-07-13 19:22:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429440000. Throughput: 0: 9588.4. Samples: 858901320. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:18,989][27935] Avg episode reward: [(0, '-0.387')] [2022-07-13 19:22:23,989][27935] Fps is (10 sec: 4710.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 429465600. Throughput: 0: 9587.0. Samples: 858930208. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:23,989][27935] Avg episode reward: [(0, '0.703')] [2022-07-13 19:22:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429489152. Throughput: 0: 9592.3. Samples: 858988480. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:22:28,989][27935] Avg episode reward: [(0, '0.847')] [2022-07-13 19:22:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 429512704. Throughput: 0: 9589.9. Samples: 859046372. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:33,989][27935] Avg episode reward: [(0, '0.895')] [2022-07-13 19:22:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 429538304. Throughput: 0: 9590.2. Samples: 859075436. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:38,989][27935] Avg episode reward: [(0, '0.838')] [2022-07-13 19:22:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 429560832. Throughput: 0: 9587.6. Samples: 859133488. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:43,989][27935] Avg episode reward: [(0, '0.763')] [2022-07-13 19:22:48,996][27935] Fps is (10 sec: 4706.9, 60 sec: 4795.1, 300 sec: 4807.5). Total num frames: 429585408. Throughput: 0: 9670.0. Samples: 859191604. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:48,997][27935] Avg episode reward: [(0, '0.890')] [2022-07-13 19:22:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429609984. Throughput: 0: 9665.6. Samples: 859220444. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:53,989][27935] Avg episode reward: [(0, '1.275')] [2022-07-13 19:22:58,989][27935] Fps is (10 sec: 4918.9, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 429634560. Throughput: 0: 9667.8. Samples: 859278368. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:22:58,989][27935] Avg episode reward: [(0, '1.318')] [2022-07-13 19:23:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 429657088. Throughput: 0: 9582.1. Samples: 859332516. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:03,989][27935] Avg episode reward: [(0, '1.361')] [2022-07-13 19:23:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 429680640. Throughput: 0: 9589.5. Samples: 859361736. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:08,989][27935] Avg episode reward: [(0, '1.188')] [2022-07-13 19:23:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.7, 300 sec: 4807.6). Total num frames: 429704192. Throughput: 0: 9579.6. Samples: 859419564. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:13,990][27935] Avg episode reward: [(0, '1.246')] [2022-07-13 19:23:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 429728768. Throughput: 0: 9573.8. Samples: 859477192. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:18,989][27935] Avg episode reward: [(0, '1.752')] [2022-07-13 19:23:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 429752320. Throughput: 0: 9570.4. Samples: 859506104. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:23,989][27935] Avg episode reward: [(0, '1.924')] [2022-07-13 19:23:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 429776896. Throughput: 0: 9554.6. Samples: 859563444. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:28,989][27935] Avg episode reward: [(0, '1.864')] [2022-07-13 19:23:34,005][27935] Fps is (10 sec: 4907.3, 60 sec: 4811.5, 300 sec: 4807.3). Total num frames: 429801472. Throughput: 0: 9537.8. Samples: 859620884. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:34,005][27935] Avg episode reward: [(0, '1.582')] [2022-07-13 19:23:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 429825024. Throughput: 0: 9539.1. Samples: 859649704. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:38,989][27935] Avg episode reward: [(0, '1.572')] [2022-07-13 19:23:43,989][27935] Fps is (10 sec: 4820.5, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 429849600. Throughput: 0: 9534.1. Samples: 859707404. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:43,989][27935] Avg episode reward: [(0, '1.300')] [2022-07-13 19:23:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.3, 300 sec: 4800.7). Total num frames: 429873152. Throughput: 0: 9630.3. Samples: 859765880. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:48,989][27935] Avg episode reward: [(0, '1.206')] [2022-07-13 19:23:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 429896704. Throughput: 0: 9628.0. Samples: 859794996. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:53,989][27935] Avg episode reward: [(0, '1.298')] [2022-07-13 19:23:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 429923328. Throughput: 0: 9636.7. Samples: 859853216. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:23:58,989][27935] Avg episode reward: [(0, '0.990')] [2022-07-13 19:24:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 429943808. Throughput: 0: 9565.8. Samples: 859907652. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:03,989][27935] Avg episode reward: [(0, '1.392')] [2022-07-13 19:24:08,989][27935] Fps is (10 sec: 4300.8, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 429966336. Throughput: 0: 9573.9. Samples: 859936932. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:08,989][27935] Avg episode reward: [(0, '1.235')] [2022-07-13 19:24:14,000][27935] Fps is (10 sec: 4909.5, 60 sec: 4811.9, 300 sec: 4803.9). Total num frames: 429992960. Throughput: 0: 9595.8. Samples: 859995368. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:14,004][27935] Avg episode reward: [(0, '1.039')] [2022-07-13 19:24:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 430016512. Throughput: 0: 9612.6. Samples: 860053296. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:18,989][27935] Avg episode reward: [(0, '1.973')] [2022-07-13 19:24:23,989][27935] Fps is (10 sec: 4818.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430041088. Throughput: 0: 9616.3. Samples: 860082436. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:23,989][27935] Avg episode reward: [(0, '2.050')] [2022-07-13 19:24:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 430064640. Throughput: 0: 9627.5. Samples: 860140640. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:28,989][27935] Avg episode reward: [(0, '1.833')] [2022-07-13 19:24:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4814.1, 300 sec: 4807.6). Total num frames: 430090240. Throughput: 0: 9621.8. Samples: 860198860. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:33,989][27935] Avg episode reward: [(0, '1.679')] [2022-07-13 19:24:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430113792. Throughput: 0: 9625.4. Samples: 860228140. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:38,989][27935] Avg episode reward: [(0, '1.792')] [2022-07-13 19:24:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430138368. Throughput: 0: 9629.3. Samples: 860286536. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:43,989][27935] Avg episode reward: [(0, '1.874')] [2022-07-13 19:24:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 430162944. Throughput: 0: 9705.9. Samples: 860344416. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:48,989][27935] Avg episode reward: [(0, '1.704')] [2022-07-13 19:24:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 430187520. Throughput: 0: 9702.5. Samples: 860373544. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:53,990][27935] Avg episode reward: [(0, '1.257')] [2022-07-13 19:24:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 430210048. Throughput: 0: 9693.4. Samples: 860431460. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:24:58,989][27935] Avg episode reward: [(0, '1.269')] [2022-07-13 19:25:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 430231552. Throughput: 0: 9611.3. Samples: 860485804. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:25:03,989][27935] Avg episode reward: [(0, '1.154')] [2022-07-13 19:25:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4807.6). Total num frames: 430258176. Throughput: 0: 9604.0. Samples: 860514616. Policy #0 lag: (min: 0.0, avg: 7.9, max: 18.0) [2022-07-13 19:25:08,989][27935] Avg episode reward: [(0, '0.875')] [2022-07-13 19:25:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4830.8, 300 sec: 4807.6). Total num frames: 430282752. Throughput: 0: 9607.6. Samples: 860572984. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:13,989][27935] Avg episode reward: [(0, '0.867')] [2022-07-13 19:25:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 430305280. Throughput: 0: 9599.9. Samples: 860630856. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:18,989][27935] Avg episode reward: [(0, '0.538')] [2022-07-13 19:25:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430329856. Throughput: 0: 9597.9. Samples: 860660044. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:23,989][27935] Avg episode reward: [(0, '0.356')] [2022-07-13 19:25:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 430355456. Throughput: 0: 9592.7. Samples: 860718208. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:28,989][27935] Avg episode reward: [(0, '0.549')] [2022-07-13 19:25:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 430377984. Throughput: 0: 9597.2. Samples: 860776288. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:33,989][27935] Avg episode reward: [(0, '-0.490')] [2022-07-13 19:25:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430402560. Throughput: 0: 9591.3. Samples: 860805152. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:38,990][27935] Avg episode reward: [(0, '-1.648')] [2022-07-13 19:25:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 430428160. Throughput: 0: 9603.8. Samples: 860863632. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:43,989][27935] Avg episode reward: [(0, '-0.971')] [2022-07-13 19:25:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430451712. Throughput: 0: 9683.1. Samples: 860921544. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:48,989][27935] Avg episode reward: [(0, '-0.957')] [2022-07-13 19:25:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 430474240. Throughput: 0: 9681.4. Samples: 860950280. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:53,989][27935] Avg episode reward: [(0, '-0.412')] [2022-07-13 19:25:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 430499840. Throughput: 0: 9681.7. Samples: 861008660. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:25:58,989][27935] Avg episode reward: [(0, '-0.255')] [2022-07-13 19:26:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 430522368. Throughput: 0: 9600.2. Samples: 861062864. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:03,989][27935] Avg episode reward: [(0, '0.421')] [2022-07-13 19:26:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430546944. Throughput: 0: 9603.9. Samples: 861092220. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:08,989][27935] Avg episode reward: [(0, '0.679')] [2022-07-13 19:26:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 430570496. Throughput: 0: 9604.1. Samples: 861150392. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:13,989][27935] Avg episode reward: [(0, '1.880')] [2022-07-13 19:26:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430594048. Throughput: 0: 9605.6. Samples: 861208540. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:18,989][27935] Avg episode reward: [(0, '1.711')] [2022-07-13 19:26:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430618624. Throughput: 0: 9607.9. Samples: 861237508. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:23,989][27935] Avg episode reward: [(0, '1.844')] [2022-07-13 19:26:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 430642176. Throughput: 0: 9576.1. Samples: 861294556. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:28,990][27935] Avg episode reward: [(0, '1.572')] [2022-07-13 19:26:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430666752. Throughput: 0: 9569.2. Samples: 861352160. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:33,989][27935] Avg episode reward: [(0, '1.740')] [2022-07-13 19:26:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430691328. Throughput: 0: 9580.5. Samples: 861381404. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:38,990][27935] Avg episode reward: [(0, '1.182')] [2022-07-13 19:26:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 430714880. Throughput: 0: 9577.7. Samples: 861439656. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:43,996][27935] Avg episode reward: [(0, '1.239')] [2022-07-13 19:26:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 430738432. Throughput: 0: 9661.9. Samples: 861497648. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:48,989][27935] Avg episode reward: [(0, '1.216')] [2022-07-13 19:26:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430763008. Throughput: 0: 9657.8. Samples: 861526820. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:53,989][27935] Avg episode reward: [(0, '0.959')] [2022-07-13 19:26:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 430788608. Throughput: 0: 9657.5. Samples: 861584980. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:26:58,989][27935] Avg episode reward: [(0, '1.279')] [2022-07-13 19:27:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 430810112. Throughput: 0: 9574.5. Samples: 861639392. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:03,989][27935] Avg episode reward: [(0, '0.947')] [2022-07-13 19:27:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 430834688. Throughput: 0: 9584.5. Samples: 861668812. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:08,989][27935] Avg episode reward: [(0, '1.104')] [2022-07-13 19:27:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 430859264. Throughput: 0: 9612.3. Samples: 861727112. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:13,990][27935] Avg episode reward: [(0, '1.491')] [2022-07-13 19:27:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 430881792. Throughput: 0: 9623.3. Samples: 861785208. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:18,989][27935] Avg episode reward: [(0, '1.380')] [2022-07-13 19:27:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 430907392. Throughput: 0: 9621.6. Samples: 861814376. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:23,989][27935] Avg episode reward: [(0, '1.542')] [2022-07-13 19:27:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 430931968. Throughput: 0: 9630.1. Samples: 861873012. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:28,989][27935] Avg episode reward: [(0, '1.405')] [2022-07-13 19:27:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 430955520. Throughput: 0: 9638.0. Samples: 861931360. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:33,989][27935] Avg episode reward: [(0, '1.755')] [2022-07-13 19:27:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 430980096. Throughput: 0: 9632.4. Samples: 861960276. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:38,989][27935] Avg episode reward: [(0, '1.751')] [2022-07-13 19:27:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.7). Total num frames: 431003648. Throughput: 0: 9625.5. Samples: 862018128. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:43,989][27935] Avg episode reward: [(0, '1.928')] [2022-07-13 19:27:48,992][27935] Fps is (10 sec: 4913.8, 60 sec: 4846.7, 300 sec: 4811.0). Total num frames: 431029248. Throughput: 0: 9688.7. Samples: 862075412. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:48,992][27935] Avg episode reward: [(0, '1.116')] [2022-07-13 19:27:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 431051776. Throughput: 0: 9676.4. Samples: 862104248. Policy #0 lag: (min: 0.0, avg: 7.8, max: 21.0) [2022-07-13 19:27:53,989][27935] Avg episode reward: [(0, '1.188')] [2022-07-13 19:27:58,989][27935] Fps is (10 sec: 4609.3, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 431075328. Throughput: 0: 9662.7. Samples: 862161932. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:27:58,989][27935] Avg episode reward: [(0, '1.379')] [2022-07-13 19:28:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 431097856. Throughput: 0: 9559.3. Samples: 862215376. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:03,989][27935] Avg episode reward: [(0, '1.379')] [2022-07-13 19:28:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 431122432. Throughput: 0: 9554.8. Samples: 862244340. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:08,989][27935] Avg episode reward: [(0, '0.921')] [2022-07-13 19:28:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 431145984. Throughput: 0: 9544.5. Samples: 862302516. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:13,989][27935] Avg episode reward: [(0, '1.306')] [2022-07-13 19:28:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 431170560. Throughput: 0: 9540.0. Samples: 862360660. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:18,989][27935] Avg episode reward: [(0, '1.264')] [2022-07-13 19:28:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 431194112. Throughput: 0: 9540.4. Samples: 862389596. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:23,989][27935] Avg episode reward: [(0, '1.828')] [2022-07-13 19:28:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.4). Total num frames: 431218688. Throughput: 0: 9546.0. Samples: 862447700. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:28,989][27935] Avg episode reward: [(0, '1.868')] [2022-07-13 19:28:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 431243264. Throughput: 0: 9564.4. Samples: 862505784. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:33,989][27935] Avg episode reward: [(0, '1.291')] [2022-07-13 19:28:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 431268864. Throughput: 0: 9571.9. Samples: 862534984. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:38,989][27935] Avg episode reward: [(0, '1.236')] [2022-07-13 19:28:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 431291392. Throughput: 0: 9586.0. Samples: 862593304. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:43,989][27935] Avg episode reward: [(0, '1.076')] [2022-07-13 19:28:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.0, 300 sec: 4814.5). Total num frames: 431316992. Throughput: 0: 9698.6. Samples: 862651812. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:48,989][27935] Avg episode reward: [(0, '0.889')] [2022-07-13 19:28:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 431339520. Throughput: 0: 9701.8. Samples: 862680920. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:53,989][27935] Avg episode reward: [(0, '0.447')] [2022-07-13 19:28:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 431365120. Throughput: 0: 9703.6. Samples: 862739176. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:28:58,989][27935] Avg episode reward: [(0, '-0.566')] [2022-07-13 19:29:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 431386624. Throughput: 0: 9619.7. Samples: 862793548. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:03,989][27935] Avg episode reward: [(0, '-1.006')] [2022-07-13 19:29:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.8). Total num frames: 431411200. Throughput: 0: 9626.8. Samples: 862822800. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:08,989][27935] Avg episode reward: [(0, '-0.668')] [2022-07-13 19:29:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 431435776. Throughput: 0: 9634.8. Samples: 862881268. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:13,990][27935] Avg episode reward: [(0, '-0.708')] [2022-07-13 19:29:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 431459328. Throughput: 0: 9639.5. Samples: 862939560. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:18,989][27935] Avg episode reward: [(0, '-0.624')] [2022-07-13 19:29:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 431484928. Throughput: 0: 9644.4. Samples: 862968980. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:23,989][27935] Avg episode reward: [(0, '-0.583')] [2022-07-13 19:29:28,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 431508480. Throughput: 0: 9635.8. Samples: 863026912. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:28,989][27935] Avg episode reward: [(0, '0.723')] [2022-07-13 19:29:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 431533056. Throughput: 0: 9623.6. Samples: 863084876. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:33,989][27935] Avg episode reward: [(0, '0.559')] [2022-07-13 19:29:38,997][27935] Fps is (10 sec: 4808.7, 60 sec: 4795.1, 300 sec: 4807.5). Total num frames: 431556608. Throughput: 0: 9622.2. Samples: 863114000. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:38,998][27935] Avg episode reward: [(0, '0.527')] [2022-07-13 19:29:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 431581184. Throughput: 0: 9631.1. Samples: 863172576. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:43,989][27935] Avg episode reward: [(0, '0.150')] [2022-07-13 19:29:48,989][27935] Fps is (10 sec: 4919.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 431605760. Throughput: 0: 9725.0. Samples: 863231172. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:48,989][27935] Avg episode reward: [(0, '0.221')] [2022-07-13 19:29:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 431630336. Throughput: 0: 9725.6. Samples: 863260452. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:53,989][27935] Avg episode reward: [(0, '0.280')] [2022-07-13 19:29:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 431654912. Throughput: 0: 9715.0. Samples: 863318444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:29:58,989][27935] Avg episode reward: [(0, '0.453')] [2022-07-13 19:30:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 431676416. Throughput: 0: 9625.9. Samples: 863372724. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:03,989][27935] Avg episode reward: [(0, '0.357')] [2022-07-13 19:30:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 431699968. Throughput: 0: 9617.8. Samples: 863401780. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:08,989][27935] Avg episode reward: [(0, '0.352')] [2022-07-13 19:30:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 431724544. Throughput: 0: 9617.1. Samples: 863459684. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:13,989][27935] Avg episode reward: [(0, '0.444')] [2022-07-13 19:30:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 431750144. Throughput: 0: 9618.8. Samples: 863517720. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:18,989][27935] Avg episode reward: [(0, '0.402')] [2022-07-13 19:30:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 431773696. Throughput: 0: 9619.8. Samples: 863546808. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:23,989][27935] Avg episode reward: [(0, '0.554')] [2022-07-13 19:30:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 431798272. Throughput: 0: 9594.9. Samples: 863604344. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:28,989][27935] Avg episode reward: [(0, '0.665')] [2022-07-13 19:30:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 431820800. Throughput: 0: 9578.6. Samples: 863662208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 19:30:33,989][27935] Avg episode reward: [(0, '0.725')] [2022-07-13 19:30:38,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4830.6, 300 sec: 4807.6). Total num frames: 431846400. Throughput: 0: 9570.0. Samples: 863691100. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:30:38,989][27935] Avg episode reward: [(0, '0.850')] [2022-07-13 19:30:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 431868928. Throughput: 0: 9569.0. Samples: 863749048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:30:43,989][27935] Avg episode reward: [(0, '1.131')] [2022-07-13 19:30:48,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 431894528. Throughput: 0: 9651.6. Samples: 863807048. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:30:48,989][27935] Avg episode reward: [(0, '2.030')] [2022-07-13 19:30:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 431918080. Throughput: 0: 9655.8. Samples: 863836292. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:30:53,989][27935] Avg episode reward: [(0, '1.957')] [2022-07-13 19:30:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 431942656. Throughput: 0: 9649.3. Samples: 863893900. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:30:58,989][27935] Avg episode reward: [(0, '2.055')] [2022-07-13 19:31:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 431964160. Throughput: 0: 9558.9. Samples: 863947868. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:03,989][27935] Avg episode reward: [(0, '1.717')] [2022-07-13 19:31:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 431988736. Throughput: 0: 9552.4. Samples: 863976668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:08,989][27935] Avg episode reward: [(0, '1.595')] [2022-07-13 19:31:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 432012288. Throughput: 0: 9546.6. Samples: 864033940. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:13,989][27935] Avg episode reward: [(0, '1.028')] [2022-07-13 19:31:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 432036864. Throughput: 0: 9534.3. Samples: 864091252. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:18,989][27935] Avg episode reward: [(0, '0.936')] [2022-07-13 19:31:23,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 432060416. Throughput: 0: 9537.3. Samples: 864120280. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:23,989][27935] Avg episode reward: [(0, '0.910')] [2022-07-13 19:31:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 432083968. Throughput: 0: 9523.5. Samples: 864177604. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:28,990][27935] Avg episode reward: [(0, '1.075')] [2022-07-13 19:31:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 432107520. Throughput: 0: 9510.4. Samples: 864235016. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:33,989][27935] Avg episode reward: [(0, '-0.640')] [2022-07-13 19:31:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 432132096. Throughput: 0: 9495.9. Samples: 864263608. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:38,990][27935] Avg episode reward: [(0, '-0.546')] [2022-07-13 19:31:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 432155648. Throughput: 0: 9491.9. Samples: 864321036. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:43,989][27935] Avg episode reward: [(0, '-0.569')] [2022-07-13 19:31:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4800.7). Total num frames: 432179200. Throughput: 0: 9580.7. Samples: 864379000. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:48,989][27935] Avg episode reward: [(0, '-0.011')] [2022-07-13 19:31:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 432204800. Throughput: 0: 9588.3. Samples: 864408140. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:53,990][27935] Avg episode reward: [(0, '-0.004')] [2022-07-13 19:31:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4804.1). Total num frames: 432227328. Throughput: 0: 9591.0. Samples: 864465532. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:31:58,989][27935] Avg episode reward: [(0, '-0.169')] [2022-07-13 19:32:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 432248832. Throughput: 0: 9508.0. Samples: 864519112. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:03,991][27935] Avg episode reward: [(0, '-0.301')] [2022-07-13 19:32:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 432274432. Throughput: 0: 9512.7. Samples: 864548352. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:08,989][27935] Avg episode reward: [(0, '1.614')] [2022-07-13 19:32:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 432299008. Throughput: 0: 9511.6. Samples: 864605624. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:13,989][27935] Avg episode reward: [(0, '1.862')] [2022-07-13 19:32:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 432321536. Throughput: 0: 9521.1. Samples: 864663464. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:18,989][27935] Avg episode reward: [(0, '1.698')] [2022-07-13 19:32:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 432347136. Throughput: 0: 9528.7. Samples: 864692400. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:23,989][27935] Avg episode reward: [(0, '1.020')] [2022-07-13 19:32:28,996][27935] Fps is (10 sec: 4809.2, 60 sec: 4761.0, 300 sec: 4793.6). Total num frames: 432369664. Throughput: 0: 9512.5. Samples: 864749172. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:28,997][27935] Avg episode reward: [(0, '0.662')] [2022-07-13 19:32:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 432393216. Throughput: 0: 9468.3. Samples: 864805072. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:33,989][27935] Avg episode reward: [(0, '0.319')] [2022-07-13 19:32:38,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 432416768. Throughput: 0: 9457.1. Samples: 864833708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:38,989][27935] Avg episode reward: [(0, '0.564')] [2022-07-13 19:32:43,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4779.9). Total num frames: 432439296. Throughput: 0: 9446.7. Samples: 864890632. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:43,989][27935] Avg episode reward: [(0, '0.321')] [2022-07-13 19:32:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 432464896. Throughput: 0: 9546.6. Samples: 864948708. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:48,989][27935] Avg episode reward: [(0, '0.356')] [2022-07-13 19:32:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 432489472. Throughput: 0: 9544.0. Samples: 864977832. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:53,989][27935] Avg episode reward: [(0, '0.250')] [2022-07-13 19:32:58,990][27935] Fps is (10 sec: 4709.9, 60 sec: 4744.4, 300 sec: 4793.7). Total num frames: 432512000. Throughput: 0: 9547.5. Samples: 865035272. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:32:58,990][27935] Avg episode reward: [(0, '0.535')] [2022-07-13 19:33:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4744.5, 300 sec: 4783.3). Total num frames: 432533504. Throughput: 0: 9449.0. Samples: 865088668. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:33:03,989][27935] Avg episode reward: [(0, '0.908')] [2022-07-13 19:33:08,989][27935] Fps is (10 sec: 4710.9, 60 sec: 4744.5, 300 sec: 4790.2). Total num frames: 432559104. Throughput: 0: 9432.9. Samples: 865116880. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:33:08,989][27935] Avg episode reward: [(0, '-0.467')] [2022-07-13 19:33:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4783.3). Total num frames: 432581632. Throughput: 0: 9445.0. Samples: 865174128. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:33:13,989][27935] Avg episode reward: [(0, '-0.685')] [2022-07-13 19:33:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4783.3). Total num frames: 432605184. Throughput: 0: 9469.1. Samples: 865231180. Policy #0 lag: (min: 0.0, avg: 9.9, max: 22.0) [2022-07-13 19:33:18,989][27935] Avg episode reward: [(0, '-0.870')] [2022-07-13 19:33:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4727.5, 300 sec: 4786.8). Total num frames: 432630784. Throughput: 0: 9473.5. Samples: 865260016. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:23,989][27935] Avg episode reward: [(0, '-0.973')] [2022-07-13 19:33:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4745.1, 300 sec: 4783.3). Total num frames: 432654336. Throughput: 0: 9485.1. Samples: 865317460. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:28,990][27935] Avg episode reward: [(0, '-1.347')] [2022-07-13 19:33:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4772.9). Total num frames: 432676864. Throughput: 0: 9474.1. Samples: 865375044. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:33,989][27935] Avg episode reward: [(0, '-2.691')] [2022-07-13 19:33:38,989][27935] Fps is (10 sec: 4608.1, 60 sec: 4727.5, 300 sec: 4776.4). Total num frames: 432700416. Throughput: 0: 9457.9. Samples: 865403436. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:38,989][27935] Avg episode reward: [(0, '-1.147')] [2022-07-13 19:33:43,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 432724992. Throughput: 0: 9468.1. Samples: 865461328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:43,990][27935] Avg episode reward: [(0, '-1.040')] [2022-07-13 19:33:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4783.3). Total num frames: 432750592. Throughput: 0: 9561.3. Samples: 865518928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:48,989][27935] Avg episode reward: [(0, '-2.525')] [2022-07-13 19:33:53,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4744.5, 300 sec: 4776.4). Total num frames: 432774144. Throughput: 0: 9578.8. Samples: 865547928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:53,989][27935] Avg episode reward: [(0, '-2.150')] [2022-07-13 19:33:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.7, 300 sec: 4783.3). Total num frames: 432797696. Throughput: 0: 9580.0. Samples: 865605228. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:33:58,989][27935] Avg episode reward: [(0, '-3.006')] [2022-07-13 19:34:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4776.4). Total num frames: 432820224. Throughput: 0: 9492.8. Samples: 865658356. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:03,989][27935] Avg episode reward: [(0, '-1.910')] [2022-07-13 19:34:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4769.4). Total num frames: 432842752. Throughput: 0: 9484.7. Samples: 865686828. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:08,989][27935] Avg episode reward: [(0, '-1.472')] [2022-07-13 19:34:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4772.9). Total num frames: 432867328. Throughput: 0: 9474.8. Samples: 865743828. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:13,989][27935] Avg episode reward: [(0, '-3.483')] [2022-07-13 19:34:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4765.9). Total num frames: 432890880. Throughput: 0: 9463.7. Samples: 865800912. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:18,989][27935] Avg episode reward: [(0, '-2.405')] [2022-07-13 19:34:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4727.5, 300 sec: 4765.9). Total num frames: 432914432. Throughput: 0: 9466.5. Samples: 865829428. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:23,989][27935] Avg episode reward: [(0, '-2.373')] [2022-07-13 19:34:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4765.9). Total num frames: 432939008. Throughput: 0: 9461.9. Samples: 865887112. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:28,989][27935] Avg episode reward: [(0, '-2.471')] [2022-07-13 19:34:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4762.6). Total num frames: 432961536. Throughput: 0: 9443.9. Samples: 865943904. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:33,989][27935] Avg episode reward: [(0, '-1.735')] [2022-07-13 19:34:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4762.5). Total num frames: 432986112. Throughput: 0: 9442.0. Samples: 865972820. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:38,989][27935] Avg episode reward: [(0, '-1.697')] [2022-07-13 19:34:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.6, 300 sec: 4759.0). Total num frames: 433009664. Throughput: 0: 9453.3. Samples: 866030628. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:43,990][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 19:34:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4762.5). Total num frames: 433035264. Throughput: 0: 9539.2. Samples: 866087620. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:48,989][27935] Avg episode reward: [(0, '0.497')] [2022-07-13 19:34:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4755.5). Total num frames: 433057792. Throughput: 0: 9535.2. Samples: 866115912. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:53,989][27935] Avg episode reward: [(0, '1.305')] [2022-07-13 19:34:58,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4727.5, 300 sec: 4762.5). Total num frames: 433081344. Throughput: 0: 9520.9. Samples: 866172268. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:34:58,989][27935] Avg episode reward: [(0, '0.501')] [2022-07-13 19:35:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4710.4, 300 sec: 4755.5). Total num frames: 433102848. Throughput: 0: 9420.8. Samples: 866224848. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:03,990][27935] Avg episode reward: [(0, '-0.090')] [2022-07-13 19:35:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4727.5, 300 sec: 4752.1). Total num frames: 433126400. Throughput: 0: 9412.8. Samples: 866253004. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:08,989][27935] Avg episode reward: [(0, '-0.343')] [2022-07-13 19:35:13,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 433148928. Throughput: 0: 9380.5. Samples: 866309236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:13,989][27935] Avg episode reward: [(0, '-0.099')] [2022-07-13 19:35:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 433172480. Throughput: 0: 9387.2. Samples: 866366328. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:18,989][27935] Avg episode reward: [(0, '-0.063')] [2022-07-13 19:35:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4741.6). Total num frames: 433197056. Throughput: 0: 9380.4. Samples: 866394936. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:23,989][27935] Avg episode reward: [(0, '0.274')] [2022-07-13 19:35:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4745.1). Total num frames: 433220608. Throughput: 0: 9362.5. Samples: 866451940. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:28,989][27935] Avg episode reward: [(0, '0.001')] [2022-07-13 19:35:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 433245184. Throughput: 0: 9362.4. Samples: 866508928. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:33,989][27935] Avg episode reward: [(0, '1.007')] [2022-07-13 19:35:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4710.4, 300 sec: 4745.1). Total num frames: 433268736. Throughput: 0: 9375.7. Samples: 866537820. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:38,989][27935] Avg episode reward: [(0, '1.575')] [2022-07-13 19:35:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4727.5, 300 sec: 4741.6). Total num frames: 433293312. Throughput: 0: 9415.0. Samples: 866595944. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:43,989][27935] Avg episode reward: [(0, '1.618')] [2022-07-13 19:35:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4693.3, 300 sec: 4741.6). Total num frames: 433316864. Throughput: 0: 9526.4. Samples: 866653536. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:48,989][27935] Avg episode reward: [(0, '0.300')] [2022-07-13 19:35:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4710.4, 300 sec: 4738.2). Total num frames: 433340416. Throughput: 0: 9545.1. Samples: 866682536. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:53,989][27935] Avg episode reward: [(0, '-0.004')] [2022-07-13 19:35:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4744.5, 300 sec: 4752.1). Total num frames: 433366016. Throughput: 0: 9580.6. Samples: 866740364. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:35:58,989][27935] Avg episode reward: [(0, '-0.040')] [2022-07-13 19:36:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 433387520. Throughput: 0: 9509.8. Samples: 866794268. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:36:03,989][27935] Avg episode reward: [(0, '-0.164')] [2022-07-13 19:36:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4741.6). Total num frames: 433411072. Throughput: 0: 9517.8. Samples: 866823236. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:08,990][27935] Avg episode reward: [(0, '-0.406')] [2022-07-13 19:36:13,990][27935] Fps is (10 sec: 4812.0, 60 sec: 4778.5, 300 sec: 4741.6). Total num frames: 433435648. Throughput: 0: 9533.2. Samples: 866880948. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:13,991][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 19:36:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4741.6). Total num frames: 433459200. Throughput: 0: 9544.1. Samples: 866938412. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:18,989][27935] Avg episode reward: [(0, '-0.528')] [2022-07-13 19:36:23,989][27935] Fps is (10 sec: 4813.5, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 433483776. Throughput: 0: 9543.5. Samples: 866967276. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:23,990][27935] Avg episode reward: [(0, '0.619')] [2022-07-13 19:36:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 433507328. Throughput: 0: 9536.1. Samples: 867025068. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:28,989][27935] Avg episode reward: [(0, '0.226')] [2022-07-13 19:36:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4744.5, 300 sec: 4738.2). Total num frames: 433529856. Throughput: 0: 9523.2. Samples: 867082080. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:33,989][27935] Avg episode reward: [(0, '0.596')] [2022-07-13 19:36:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 433555456. Throughput: 0: 9520.8. Samples: 867110972. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:38,989][27935] Avg episode reward: [(0, '0.484')] [2022-07-13 19:36:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4778.7, 300 sec: 4748.6). Total num frames: 433580032. Throughput: 0: 9519.4. Samples: 867168736. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:43,990][27935] Avg episode reward: [(0, '0.816')] [2022-07-13 19:36:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 433604608. Throughput: 0: 9611.4. Samples: 867226780. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:48,989][27935] Avg episode reward: [(0, '0.754')] [2022-07-13 19:36:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4748.6). Total num frames: 433628160. Throughput: 0: 9615.3. Samples: 867255924. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:53,989][27935] Avg episode reward: [(0, '0.850')] [2022-07-13 19:36:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4759.0). Total num frames: 433652736. Throughput: 0: 9631.1. Samples: 867314332. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:36:58,989][27935] Avg episode reward: [(0, '0.765')] [2022-07-13 19:37:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4745.1). Total num frames: 433674240. Throughput: 0: 9550.8. Samples: 867368196. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:03,989][27935] Avg episode reward: [(0, '1.358')] [2022-07-13 19:37:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 433698816. Throughput: 0: 9558.9. Samples: 867397428. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:08,989][27935] Avg episode reward: [(0, '1.260')] [2022-07-13 19:37:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.9, 300 sec: 4752.1). Total num frames: 433723392. Throughput: 0: 9559.2. Samples: 867455232. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:13,990][27935] Avg episode reward: [(0, '0.935')] [2022-07-13 19:37:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4745.1). Total num frames: 433746944. Throughput: 0: 9585.5. Samples: 867513428. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:18,989][27935] Avg episode reward: [(0, '0.900')] [2022-07-13 19:37:23,991][27935] Fps is (10 sec: 4709.3, 60 sec: 4778.5, 300 sec: 4748.7). Total num frames: 433770496. Throughput: 0: 9590.7. Samples: 867542576. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:23,992][27935] Avg episode reward: [(0, '1.015')] [2022-07-13 19:37:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4752.1). Total num frames: 433795072. Throughput: 0: 9603.6. Samples: 867600900. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:28,989][27935] Avg episode reward: [(0, '0.603')] [2022-07-13 19:37:33,989][27935] Fps is (10 sec: 5018.8, 60 sec: 4846.9, 300 sec: 4759.0). Total num frames: 433820672. Throughput: 0: 9593.4. Samples: 867658484. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:33,989][27935] Avg episode reward: [(0, '0.986')] [2022-07-13 19:37:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 433843200. Throughput: 0: 9589.7. Samples: 867687460. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:38,989][27935] Avg episode reward: [(0, '0.973')] [2022-07-13 19:37:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 433867776. Throughput: 0: 9568.3. Samples: 867744908. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:43,989][27935] Avg episode reward: [(0, '1.204')] [2022-07-13 19:37:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 433892352. Throughput: 0: 9671.6. Samples: 867803420. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:48,989][27935] Avg episode reward: [(0, '1.223')] [2022-07-13 19:37:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 433915904. Throughput: 0: 9670.2. Samples: 867832588. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:53,989][27935] Avg episode reward: [(0, '0.784')] [2022-07-13 19:37:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4769.4). Total num frames: 433940480. Throughput: 0: 9693.2. Samples: 867891424. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:37:58,989][27935] Avg episode reward: [(0, '1.170')] [2022-07-13 19:38:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4755.5). Total num frames: 433961984. Throughput: 0: 9601.6. Samples: 867945500. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:03,989][27935] Avg episode reward: [(0, '1.010')] [2022-07-13 19:38:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4765.9). Total num frames: 433987584. Throughput: 0: 9595.6. Samples: 867974356. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:08,989][27935] Avg episode reward: [(0, '0.579')] [2022-07-13 19:38:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 434012160. Throughput: 0: 9589.1. Samples: 868032408. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:13,989][27935] Avg episode reward: [(0, '0.552')] [2022-07-13 19:38:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4759.0). Total num frames: 434034688. Throughput: 0: 9597.5. Samples: 868090372. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:18,989][27935] Avg episode reward: [(0, '0.720')] [2022-07-13 19:38:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.9, 300 sec: 4759.0). Total num frames: 434058240. Throughput: 0: 9597.4. Samples: 868119344. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:23,989][27935] Avg episode reward: [(0, '0.093')] [2022-07-13 19:38:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4769.4). Total num frames: 434083840. Throughput: 0: 9617.6. Samples: 868177700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:28,990][27935] Avg episode reward: [(0, '-0.053')] [2022-07-13 19:38:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4772.9). Total num frames: 434108416. Throughput: 0: 9584.0. Samples: 868234700. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:33,992][27935] Avg episode reward: [(0, '-0.383')] [2022-07-13 19:38:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4765.9). Total num frames: 434130944. Throughput: 0: 9563.6. Samples: 868262948. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:38,989][27935] Avg episode reward: [(0, '-1.513')] [2022-07-13 19:38:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4765.9). Total num frames: 434156544. Throughput: 0: 9545.8. Samples: 868320984. Policy #0 lag: (min: 0.0, avg: 8.7, max: 20.0) [2022-07-13 19:38:43,989][27935] Avg episode reward: [(0, '-1.080')] [2022-07-13 19:38:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4762.5). Total num frames: 434179072. Throughput: 0: 9642.0. Samples: 868379392. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:38:48,989][27935] Avg episode reward: [(0, '-1.279')] [2022-07-13 19:38:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4765.9). Total num frames: 434203648. Throughput: 0: 9644.5. Samples: 868408360. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:38:53,989][27935] Avg episode reward: [(0, '-1.134')] [2022-07-13 19:38:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4772.9). Total num frames: 434228224. Throughput: 0: 9658.0. Samples: 868467016. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:38:58,989][27935] Avg episode reward: [(0, '-0.351')] [2022-07-13 19:39:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4772.9). Total num frames: 434250752. Throughput: 0: 9572.8. Samples: 868521148. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:03,989][27935] Avg episode reward: [(0, '-0.157')] [2022-07-13 19:39:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4772.9). Total num frames: 434275328. Throughput: 0: 9574.8. Samples: 868550212. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:08,989][27935] Avg episode reward: [(0, '0.953')] [2022-07-13 19:39:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4772.9). Total num frames: 434298880. Throughput: 0: 9572.4. Samples: 868608460. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:13,989][27935] Avg episode reward: [(0, '1.921')] [2022-07-13 19:39:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4772.9). Total num frames: 434322432. Throughput: 0: 9599.7. Samples: 868666688. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:18,989][27935] Avg episode reward: [(0, '1.845')] [2022-07-13 19:39:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4776.4). Total num frames: 434348032. Throughput: 0: 9619.2. Samples: 868695812. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:23,989][27935] Avg episode reward: [(0, '1.645')] [2022-07-13 19:39:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 434373632. Throughput: 0: 9622.1. Samples: 868753980. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:28,989][27935] Avg episode reward: [(0, '1.743')] [2022-07-13 19:39:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4783.3). Total num frames: 434397184. Throughput: 0: 9613.0. Samples: 868811976. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:33,989][27935] Avg episode reward: [(0, '2.199')] [2022-07-13 19:39:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4783.3). Total num frames: 434420736. Throughput: 0: 9610.4. Samples: 868840828. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:38,989][27935] Avg episode reward: [(0, '1.923')] [2022-07-13 19:39:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4776.4). Total num frames: 434444288. Throughput: 0: 9608.2. Samples: 868899384. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:43,989][27935] Avg episode reward: [(0, '1.659')] [2022-07-13 19:39:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4786.8). Total num frames: 434469888. Throughput: 0: 9707.6. Samples: 868957988. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:48,989][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 19:39:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4786.8). Total num frames: 434493440. Throughput: 0: 9716.4. Samples: 868987448. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:53,989][27935] Avg episode reward: [(0, '0.581')] [2022-07-13 19:39:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 434516992. Throughput: 0: 9715.3. Samples: 869045648. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:39:58,989][27935] Avg episode reward: [(0, '-0.598')] [2022-07-13 19:40:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 434539520. Throughput: 0: 9628.9. Samples: 869099988. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:03,989][27935] Avg episode reward: [(0, '-0.528')] [2022-07-13 19:40:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 434564096. Throughput: 0: 9623.2. Samples: 869128856. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:08,989][27935] Avg episode reward: [(0, '-1.995')] [2022-07-13 19:40:13,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4807.6). Total num frames: 434590720. Throughput: 0: 9628.4. Samples: 869187256. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:13,989][27935] Avg episode reward: [(0, '-2.398')] [2022-07-13 19:40:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 434612224. Throughput: 0: 9627.8. Samples: 869245228. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:18,989][27935] Avg episode reward: [(0, '-1.861')] [2022-07-13 19:40:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 434636800. Throughput: 0: 9627.0. Samples: 869274044. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:23,989][27935] Avg episode reward: [(0, '-1.052')] [2022-07-13 19:40:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 434660352. Throughput: 0: 9610.8. Samples: 869331868. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:28,989][27935] Avg episode reward: [(0, '-1.341')] [2022-07-13 19:40:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 434684928. Throughput: 0: 9601.0. Samples: 869390032. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:33,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 19:40:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4804.1). Total num frames: 434710528. Throughput: 0: 9584.5. Samples: 869418752. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:38,989][27935] Avg episode reward: [(0, '0.533')] [2022-07-13 19:40:43,991][27935] Fps is (10 sec: 5016.5, 60 sec: 4846.8, 300 sec: 4807.6). Total num frames: 434735104. Throughput: 0: 9588.5. Samples: 869477152. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:43,991][27935] Avg episode reward: [(0, '2.041')] [2022-07-13 19:40:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 434758656. Throughput: 0: 9679.8. Samples: 869535580. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:48,989][27935] Avg episode reward: [(0, '1.555')] [2022-07-13 19:40:53,989][27935] Fps is (10 sec: 4609.0, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 434781184. Throughput: 0: 9685.2. Samples: 869564688. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:53,989][27935] Avg episode reward: [(0, '0.428')] [2022-07-13 19:40:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 434805760. Throughput: 0: 9679.7. Samples: 869622844. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:40:58,991][27935] Avg episode reward: [(0, '0.123')] [2022-07-13 19:41:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 434829312. Throughput: 0: 9599.7. Samples: 869677216. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:03,989][27935] Avg episode reward: [(0, '0.272')] [2022-07-13 19:41:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 434854912. Throughput: 0: 9604.2. Samples: 869706232. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:08,990][27935] Avg episode reward: [(0, '0.210')] [2022-07-13 19:41:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 434877440. Throughput: 0: 9614.0. Samples: 869764500. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:13,990][27935] Avg episode reward: [(0, '-0.221')] [2022-07-13 19:41:18,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 434900992. Throughput: 0: 9615.6. Samples: 869822736. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:18,991][27935] Avg episode reward: [(0, '-0.531')] [2022-07-13 19:41:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 434925568. Throughput: 0: 9617.0. Samples: 869851516. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:23,989][27935] Avg episode reward: [(0, '0.676')] [2022-07-13 19:41:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 434950144. Throughput: 0: 9604.4. Samples: 869909328. Policy #0 lag: (min: 0.0, avg: 9.7, max: 19.0) [2022-07-13 19:41:28,989][27935] Avg episode reward: [(0, '0.664')] [2022-07-13 19:41:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 434972672. Throughput: 0: 9590.8. Samples: 869967164. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:33,990][27935] Avg episode reward: [(0, '0.083')] [2022-07-13 19:41:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 434999296. Throughput: 0: 9590.7. Samples: 869996268. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:38,991][27935] Avg episode reward: [(0, '0.007')] [2022-07-13 19:41:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.8, 300 sec: 4804.1). Total num frames: 435021824. Throughput: 0: 9588.8. Samples: 870054340. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:43,989][27935] Avg episode reward: [(0, '-0.078')] [2022-07-13 19:41:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 435045376. Throughput: 0: 9680.7. Samples: 870112848. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:48,989][27935] Avg episode reward: [(0, '-0.689')] [2022-07-13 19:41:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4811.1). Total num frames: 435072000. Throughput: 0: 9684.9. Samples: 870142052. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:53,992][27935] Avg episode reward: [(0, '-0.442')] [2022-07-13 19:41:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 435095552. Throughput: 0: 9684.5. Samples: 870200304. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:41:58,989][27935] Avg episode reward: [(0, '-1.705')] [2022-07-13 19:42:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 435118080. Throughput: 0: 9596.5. Samples: 870254580. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:03,989][27935] Avg episode reward: [(0, '-2.559')] [2022-07-13 19:42:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 435141632. Throughput: 0: 9600.3. Samples: 870283528. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:08,989][27935] Avg episode reward: [(0, '-3.216')] [2022-07-13 19:42:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 435166208. Throughput: 0: 9607.4. Samples: 870341660. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:13,989][27935] Avg episode reward: [(0, '-2.975')] [2022-07-13 19:42:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.6). Total num frames: 435190784. Throughput: 0: 9610.8. Samples: 870399652. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:18,989][27935] Avg episode reward: [(0, '-3.048')] [2022-07-13 19:42:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 435214336. Throughput: 0: 9609.5. Samples: 870428696. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:23,989][27935] Avg episode reward: [(0, '-3.170')] [2022-07-13 19:42:28,990][27935] Fps is (10 sec: 4710.0, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 435237888. Throughput: 0: 9609.6. Samples: 870486780. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:28,990][27935] Avg episode reward: [(0, '-2.834')] [2022-07-13 19:42:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 435262464. Throughput: 0: 9605.8. Samples: 870545108. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:33,989][27935] Avg episode reward: [(0, '-2.449')] [2022-07-13 19:42:38,989][27935] Fps is (10 sec: 5018.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 435288064. Throughput: 0: 9599.3. Samples: 870574020. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:38,989][27935] Avg episode reward: [(0, '-1.651')] [2022-07-13 19:42:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 435310592. Throughput: 0: 9579.5. Samples: 870631380. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:43,989][27935] Avg episode reward: [(0, '-0.366')] [2022-07-13 19:42:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 435335168. Throughput: 0: 9661.9. Samples: 870689364. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:48,989][27935] Avg episode reward: [(0, '0.088')] [2022-07-13 19:42:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435359744. Throughput: 0: 9664.3. Samples: 870718420. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:53,989][27935] Avg episode reward: [(0, '-0.002')] [2022-07-13 19:42:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 435383296. Throughput: 0: 9653.6. Samples: 870776072. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:42:58,989][27935] Avg episode reward: [(0, '-0.357')] [2022-07-13 19:43:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 435404800. Throughput: 0: 9575.2. Samples: 870830536. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:03,989][27935] Avg episode reward: [(0, '0.472')] [2022-07-13 19:43:09,001][27935] Fps is (10 sec: 4602.5, 60 sec: 4794.8, 300 sec: 4803.9). Total num frames: 435429376. Throughput: 0: 9570.5. Samples: 870859484. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:09,001][27935] Avg episode reward: [(0, '0.401')] [2022-07-13 19:43:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435453952. Throughput: 0: 9569.5. Samples: 870917400. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:13,989][27935] Avg episode reward: [(0, '0.504')] [2022-07-13 19:43:18,989][27935] Fps is (10 sec: 4921.0, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 435478528. Throughput: 0: 9563.2. Samples: 870975452. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:18,989][27935] Avg episode reward: [(0, '-0.587')] [2022-07-13 19:43:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 435502080. Throughput: 0: 9562.7. Samples: 871004340. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:23,990][27935] Avg episode reward: [(0, '-1.024')] [2022-07-13 19:43:28,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 435524608. Throughput: 0: 9562.6. Samples: 871061696. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:28,990][27935] Avg episode reward: [(0, '-0.613')] [2022-07-13 19:43:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435550208. Throughput: 0: 9569.9. Samples: 871120008. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:33,989][27935] Avg episode reward: [(0, '-0.873')] [2022-07-13 19:43:38,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435575808. Throughput: 0: 9574.0. Samples: 871149248. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:38,989][27935] Avg episode reward: [(0, '-0.802')] [2022-07-13 19:43:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435598336. Throughput: 0: 9583.5. Samples: 871207328. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:43,989][27935] Avg episode reward: [(0, '-0.895')] [2022-07-13 19:43:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 435621888. Throughput: 0: 9675.7. Samples: 871265944. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:48,989][27935] Avg episode reward: [(0, '0.269')] [2022-07-13 19:43:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 435647488. Throughput: 0: 9687.9. Samples: 871295324. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:53,989][27935] Avg episode reward: [(0, '-0.190')] [2022-07-13 19:43:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 435672064. Throughput: 0: 9691.5. Samples: 871353516. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:43:58,989][27935] Avg episode reward: [(0, '0.616')] [2022-07-13 19:44:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 435693568. Throughput: 0: 9620.0. Samples: 871408352. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:44:03,989][27935] Avg episode reward: [(0, '0.750')] [2022-07-13 19:44:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.8, 300 sec: 4814.5). Total num frames: 435719168. Throughput: 0: 9625.5. Samples: 871437488. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:44:08,990][27935] Avg episode reward: [(0, '0.306')] [2022-07-13 19:44:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 435743744. Throughput: 0: 9639.4. Samples: 871495468. Policy #0 lag: (min: 0.0, avg: 7.8, max: 19.0) [2022-07-13 19:44:13,989][27935] Avg episode reward: [(0, '0.473')] [2022-07-13 19:44:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 435766272. Throughput: 0: 9640.2. Samples: 871553816. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:18,989][27935] Avg episode reward: [(0, '-0.352')] [2022-07-13 19:44:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 435789824. Throughput: 0: 9642.1. Samples: 871583144. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:23,990][27935] Avg episode reward: [(0, '0.093')] [2022-07-13 19:44:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4881.1, 300 sec: 4814.5). Total num frames: 435817472. Throughput: 0: 9650.0. Samples: 871641580. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:28,989][27935] Avg episode reward: [(0, '0.118')] [2022-07-13 19:44:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 435841024. Throughput: 0: 9640.3. Samples: 871699756. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:33,989][27935] Avg episode reward: [(0, '-0.982')] [2022-07-13 19:44:38,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 435862528. Throughput: 0: 9619.0. Samples: 871728180. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:38,989][27935] Avg episode reward: [(0, '-0.464')] [2022-07-13 19:44:44,000][27935] Fps is (10 sec: 4705.0, 60 sec: 4828.9, 300 sec: 4807.4). Total num frames: 435888128. Throughput: 0: 9585.4. Samples: 871784968. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:44,001][27935] Avg episode reward: [(0, '-0.485')] [2022-07-13 19:44:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 435911680. Throughput: 0: 9666.8. Samples: 871843360. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:48,989][27935] Avg episode reward: [(0, '-0.956')] [2022-07-13 19:44:53,989][27935] Fps is (10 sec: 4818.4, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 435936256. Throughput: 0: 9670.7. Samples: 871872668. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:53,989][27935] Avg episode reward: [(0, '-1.048')] [2022-07-13 19:44:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 435959808. Throughput: 0: 9670.5. Samples: 871930640. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:44:58,989][27935] Avg episode reward: [(0, '-1.605')] [2022-07-13 19:45:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 435982336. Throughput: 0: 9572.3. Samples: 871984568. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:03,989][27935] Avg episode reward: [(0, '-2.165')] [2022-07-13 19:45:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 436006912. Throughput: 0: 9559.6. Samples: 872013324. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:08,989][27935] Avg episode reward: [(0, '-1.408')] [2022-07-13 19:45:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 436031488. Throughput: 0: 9550.1. Samples: 872071336. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:13,989][27935] Avg episode reward: [(0, '-1.715')] [2022-07-13 19:45:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 436056064. Throughput: 0: 9546.7. Samples: 872129356. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:18,989][27935] Avg episode reward: [(0, '-1.182')] [2022-07-13 19:45:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 436079616. Throughput: 0: 9568.0. Samples: 872158740. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:23,990][27935] Avg episode reward: [(0, '-0.278')] [2022-07-13 19:45:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4807.6). Total num frames: 436103168. Throughput: 0: 9590.6. Samples: 872216436. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:28,989][27935] Avg episode reward: [(0, '-0.575')] [2022-07-13 19:45:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 436127744. Throughput: 0: 9582.0. Samples: 872274548. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:33,989][27935] Avg episode reward: [(0, '-0.144')] [2022-07-13 19:45:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 436151296. Throughput: 0: 9577.6. Samples: 872303660. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:38,989][27935] Avg episode reward: [(0, '0.014')] [2022-07-13 19:45:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.7, 300 sec: 4807.6). Total num frames: 436176896. Throughput: 0: 9587.2. Samples: 872362064. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:43,989][27935] Avg episode reward: [(0, '0.321')] [2022-07-13 19:45:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 436200448. Throughput: 0: 9034.6. Samples: 872391124. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:48,989][27935] Avg episode reward: [(0, '0.350')] [2022-07-13 19:45:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 436224000. Throughput: 0: 9704.4. Samples: 872450020. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:53,989][27935] Avg episode reward: [(0, '0.312')] [2022-07-13 19:45:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 436249600. Throughput: 0: 9714.3. Samples: 872508480. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:45:58,989][27935] Avg episode reward: [(0, '0.589')] [2022-07-13 19:46:03,991][27935] Fps is (10 sec: 4811.5, 60 sec: 4829.7, 300 sec: 4804.1). Total num frames: 436272128. Throughput: 0: 9630.1. Samples: 872562736. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:03,992][27935] Avg episode reward: [(0, '0.546')] [2022-07-13 19:46:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 436295680. Throughput: 0: 9624.3. Samples: 872591832. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:08,990][27935] Avg episode reward: [(0, '0.792')] [2022-07-13 19:46:13,998][27935] Fps is (10 sec: 4707.5, 60 sec: 4795.0, 300 sec: 4807.4). Total num frames: 436319232. Throughput: 0: 9630.8. Samples: 872649908. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:13,998][27935] Avg episode reward: [(0, '0.523')] [2022-07-13 19:46:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 436343808. Throughput: 0: 9622.9. Samples: 872707580. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:18,989][27935] Avg episode reward: [(0, '0.694')] [2022-07-13 19:46:23,989][27935] Fps is (10 sec: 4919.6, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 436368384. Throughput: 0: 9622.0. Samples: 872736648. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:23,989][27935] Avg episode reward: [(0, '0.869')] [2022-07-13 19:46:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 436392960. Throughput: 0: 9608.2. Samples: 872794432. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:28,989][27935] Avg episode reward: [(0, '0.292')] [2022-07-13 19:46:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 436415488. Throughput: 0: 10242.8. Samples: 872852048. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:33,989][27935] Avg episode reward: [(0, '0.549')] [2022-07-13 19:46:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 436440064. Throughput: 0: 9568.1. Samples: 872880584. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:38,989][27935] Avg episode reward: [(0, '0.474')] [2022-07-13 19:46:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 436464640. Throughput: 0: 9554.1. Samples: 872938416. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:43,989][27935] Avg episode reward: [(0, '0.630')] [2022-07-13 19:46:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 436488192. Throughput: 0: 9638.2. Samples: 872996428. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:48,989][27935] Avg episode reward: [(0, '0.212')] [2022-07-13 19:46:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 436512768. Throughput: 0: 9636.8. Samples: 873025488. Policy #0 lag: (min: 0.0, avg: 8.1, max: 19.0) [2022-07-13 19:46:53,989][27935] Avg episode reward: [(0, '0.057')] [2022-07-13 19:46:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 436536320. Throughput: 0: 9642.3. Samples: 873083724. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:46:58,990][27935] Avg episode reward: [(0, '-0.573')] [2022-07-13 19:47:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.0, 300 sec: 4811.1). Total num frames: 436560896. Throughput: 0: 9565.9. Samples: 873138044. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:03,989][27935] Avg episode reward: [(0, '0.025')] [2022-07-13 19:47:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436583424. Throughput: 0: 9564.5. Samples: 873167052. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:08,989][27935] Avg episode reward: [(0, '-0.436')] [2022-07-13 19:47:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4813.5, 300 sec: 4804.1). Total num frames: 436608000. Throughput: 0: 9570.8. Samples: 873225120. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:13,989][27935] Avg episode reward: [(0, '-0.653')] [2022-07-13 19:47:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436631552. Throughput: 0: 9569.1. Samples: 873282660. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:18,989][27935] Avg episode reward: [(0, '-0.239')] [2022-07-13 19:47:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 436656128. Throughput: 0: 9580.5. Samples: 873311704. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:23,989][27935] Avg episode reward: [(0, '-0.812')] [2022-07-13 19:47:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 436680704. Throughput: 0: 9589.2. Samples: 873369932. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:28,989][27935] Avg episode reward: [(0, '-0.169')] [2022-07-13 19:47:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 436703232. Throughput: 0: 9589.2. Samples: 873427940. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:33,989][27935] Avg episode reward: [(0, '-0.082')] [2022-07-13 19:47:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 436728832. Throughput: 0: 9589.1. Samples: 873456996. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:38,989][27935] Avg episode reward: [(0, '-0.239')] [2022-07-13 19:47:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436752384. Throughput: 0: 9564.2. Samples: 873514112. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:43,989][27935] Avg episode reward: [(0, '0.602')] [2022-07-13 19:47:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 436776960. Throughput: 0: 9643.6. Samples: 873572008. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:48,989][27935] Avg episode reward: [(0, '1.114')] [2022-07-13 19:47:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436800512. Throughput: 0: 9643.3. Samples: 873601000. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:53,996][27935] Avg episode reward: [(0, '1.204')] [2022-07-13 19:47:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 436824064. Throughput: 0: 9649.7. Samples: 873659356. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:47:58,989][27935] Avg episode reward: [(0, '1.578')] [2022-07-13 19:48:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.8). Total num frames: 436847616. Throughput: 0: 9013.8. Samples: 873688280. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:03,989][27935] Avg episode reward: [(0, '0.845')] [2022-07-13 19:48:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 436870144. Throughput: 0: 9576.1. Samples: 873742628. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:08,989][27935] Avg episode reward: [(0, '1.005')] [2022-07-13 19:48:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436895744. Throughput: 0: 9562.0. Samples: 873800220. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:13,989][27935] Avg episode reward: [(0, '1.039')] [2022-07-13 19:48:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 436919296. Throughput: 0: 9558.8. Samples: 873858084. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:18,989][27935] Avg episode reward: [(0, '0.977')] [2022-07-13 19:48:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 436942848. Throughput: 0: 9567.5. Samples: 873887532. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:23,989][27935] Avg episode reward: [(0, '0.998')] [2022-07-13 19:48:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 436969472. Throughput: 0: 9597.9. Samples: 873946016. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:28,989][27935] Avg episode reward: [(0, '0.680')] [2022-07-13 19:48:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 436992000. Throughput: 0: 8960.4. Samples: 873975228. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:33,989][27935] Avg episode reward: [(0, '-0.313')] [2022-07-13 19:48:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 437017600. Throughput: 0: 9615.2. Samples: 874033684. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:38,989][27935] Avg episode reward: [(0, '0.241')] [2022-07-13 19:48:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 437042176. Throughput: 0: 9612.9. Samples: 874091936. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:43,990][27935] Avg episode reward: [(0, '0.320')] [2022-07-13 19:48:48,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 437063680. Throughput: 0: 10265.6. Samples: 874150232. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:48,989][27935] Avg episode reward: [(0, '-0.201')] [2022-07-13 19:48:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 437089280. Throughput: 0: 9705.6. Samples: 874179380. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:53,990][27935] Avg episode reward: [(0, '-0.073')] [2022-07-13 19:48:58,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 437114880. Throughput: 0: 9722.0. Samples: 874237708. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:48:58,989][27935] Avg episode reward: [(0, '0.409')] [2022-07-13 19:49:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 437136384. Throughput: 0: 9649.2. Samples: 874292296. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:03,989][27935] Avg episode reward: [(0, '0.859')] [2022-07-13 19:49:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4846.9, 300 sec: 4804.1). Total num frames: 437160960. Throughput: 0: 9650.7. Samples: 874321812. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:08,989][27935] Avg episode reward: [(0, '0.994')] [2022-07-13 19:49:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 437185536. Throughput: 0: 9643.0. Samples: 874379952. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:13,989][27935] Avg episode reward: [(0, '1.082')] [2022-07-13 19:49:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 437209088. Throughput: 0: 10292.3. Samples: 874438384. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:18,989][27935] Avg episode reward: [(0, '0.739')] [2022-07-13 19:49:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4804.1). Total num frames: 437234688. Throughput: 0: 9642.8. Samples: 874467608. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:23,992][27935] Avg episode reward: [(0, '0.096')] [2022-07-13 19:49:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 437258240. Throughput: 0: 9632.4. Samples: 874525396. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:28,989][27935] Avg episode reward: [(0, '0.188')] [2022-07-13 19:49:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 437281792. Throughput: 0: 9637.7. Samples: 874583928. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:33,989][27935] Avg episode reward: [(0, '-0.753')] [2022-07-13 19:49:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.3). Total num frames: 437307392. Throughput: 0: 9637.8. Samples: 874613080. Policy #0 lag: (min: 0.0, avg: 8.1, max: 20.0) [2022-07-13 19:49:38,989][27935] Avg episode reward: [(0, '-1.607')] [2022-07-13 19:49:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 437330944. Throughput: 0: 9629.0. Samples: 874671012. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:49:43,989][27935] Avg episode reward: [(0, '-1.565')] [2022-07-13 19:49:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4807.6). Total num frames: 437354496. Throughput: 0: 9706.3. Samples: 874729080. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:49:48,989][27935] Avg episode reward: [(0, '-1.560')] [2022-07-13 19:49:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 437380096. Throughput: 0: 9690.5. Samples: 874757884. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:49:53,989][27935] Avg episode reward: [(0, '-0.203')] [2022-07-13 19:49:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 437402624. Throughput: 0: 9688.8. Samples: 874815948. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:49:58,989][27935] Avg episode reward: [(0, '-0.948')] [2022-07-13 19:50:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 437426176. Throughput: 0: 9599.0. Samples: 874870340. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:03,989][27935] Avg episode reward: [(0, '-0.688')] [2022-07-13 19:50:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 437449728. Throughput: 0: 9600.0. Samples: 874899608. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:08,989][27935] Avg episode reward: [(0, '-0.040')] [2022-07-13 19:50:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 437473280. Throughput: 0: 9598.6. Samples: 874957332. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:13,989][27935] Avg episode reward: [(0, '0.602')] [2022-07-13 19:50:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 437496832. Throughput: 0: 9581.2. Samples: 875015084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:18,989][27935] Avg episode reward: [(0, '0.468')] [2022-07-13 19:50:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 437522432. Throughput: 0: 9582.4. Samples: 875044288. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:23,989][27935] Avg episode reward: [(0, '0.730')] [2022-07-13 19:50:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 437545984. Throughput: 0: 9572.6. Samples: 875101780. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:28,989][27935] Avg episode reward: [(0, '0.755')] [2022-07-13 19:50:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 437570560. Throughput: 0: 9555.6. Samples: 875159084. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:33,990][27935] Avg episode reward: [(0, '1.281')] [2022-07-13 19:50:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 437594112. Throughput: 0: 9561.4. Samples: 875188148. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:38,991][27935] Avg episode reward: [(0, '0.536')] [2022-07-13 19:50:43,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4744.5, 300 sec: 4797.2). Total num frames: 437615616. Throughput: 0: 9529.0. Samples: 875244752. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:43,989][27935] Avg episode reward: [(0, '0.430')] [2022-07-13 19:50:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 437642240. Throughput: 0: 9598.5. Samples: 875302272. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:48,990][27935] Avg episode reward: [(0, '0.240')] [2022-07-13 19:50:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 437665792. Throughput: 0: 9586.7. Samples: 875331008. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:53,989][27935] Avg episode reward: [(0, '0.115')] [2022-07-13 19:50:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.2). Total num frames: 437689344. Throughput: 0: 9592.8. Samples: 875389008. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:50:58,990][27935] Avg episode reward: [(0, '-0.205')] [2022-07-13 19:51:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 437711872. Throughput: 0: 9510.3. Samples: 875443048. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:03,991][27935] Avg episode reward: [(0, '-1.075')] [2022-07-13 19:51:08,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4761.6, 300 sec: 4800.8). Total num frames: 437735424. Throughput: 0: 9506.2. Samples: 875472068. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:08,989][27935] Avg episode reward: [(0, '-0.949')] [2022-07-13 19:51:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 437758976. Throughput: 0: 9511.6. Samples: 875529804. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:13,989][27935] Avg episode reward: [(0, '-0.613')] [2022-07-13 19:51:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 437784576. Throughput: 0: 9503.3. Samples: 875586732. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:18,989][27935] Avg episode reward: [(0, '0.257')] [2022-07-13 19:51:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4744.5, 300 sec: 4793.7). Total num frames: 437807104. Throughput: 0: 9496.3. Samples: 875615480. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:23,990][27935] Avg episode reward: [(0, '0.196')] [2022-07-13 19:51:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 437831680. Throughput: 0: 9530.2. Samples: 875673612. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:28,989][27935] Avg episode reward: [(0, '0.632')] [2022-07-13 19:51:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4761.6, 300 sec: 4800.7). Total num frames: 437856256. Throughput: 0: 9532.5. Samples: 875731236. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:33,989][27935] Avg episode reward: [(0, '1.688')] [2022-07-13 19:51:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 437880832. Throughput: 0: 9541.8. Samples: 875760388. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:38,989][27935] Avg episode reward: [(0, '1.705')] [2022-07-13 19:51:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 437904384. Throughput: 0: 9555.7. Samples: 875819016. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:43,989][27935] Avg episode reward: [(0, '1.727')] [2022-07-13 19:51:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4797.2). Total num frames: 437927936. Throughput: 0: 9641.1. Samples: 875876896. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:48,989][27935] Avg episode reward: [(0, '1.724')] [2022-07-13 19:51:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 437953536. Throughput: 0: 9640.5. Samples: 875905888. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:53,989][27935] Avg episode reward: [(0, '1.865')] [2022-07-13 19:51:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 437977088. Throughput: 0: 9655.1. Samples: 875964284. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:51:58,992][27935] Avg episode reward: [(0, '1.867')] [2022-07-13 19:52:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 438000640. Throughput: 0: 9598.1. Samples: 876018644. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:52:03,989][27935] Avg episode reward: [(0, '1.473')] [2022-07-13 19:52:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 438022144. Throughput: 0: 9606.3. Samples: 876047764. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:52:08,989][27935] Avg episode reward: [(0, '0.541')] [2022-07-13 19:52:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 438047744. Throughput: 0: 9610.2. Samples: 876106072. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:52:13,989][27935] Avg episode reward: [(0, '0.641')] [2022-07-13 19:52:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 438072320. Throughput: 0: 9617.3. Samples: 876164016. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:52:18,989][27935] Avg episode reward: [(0, '-0.650')] [2022-07-13 19:52:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 438096896. Throughput: 0: 9613.5. Samples: 876192996. Policy #0 lag: (min: 0.0, avg: 9.2, max: 19.0) [2022-07-13 19:52:23,989][27935] Avg episode reward: [(0, '-0.495')] [2022-07-13 19:52:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 438120448. Throughput: 0: 9587.2. Samples: 876250440. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:28,989][27935] Avg episode reward: [(0, '-0.524')] [2022-07-13 19:52:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4800.7). Total num frames: 438145024. Throughput: 0: 9591.7. Samples: 876308520. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:33,989][27935] Avg episode reward: [(0, '-0.503')] [2022-07-13 19:52:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 438168576. Throughput: 0: 9585.5. Samples: 876337236. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:38,989][27935] Avg episode reward: [(0, '-0.270')] [2022-07-13 19:52:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 438192128. Throughput: 0: 9557.6. Samples: 876394376. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:43,989][27935] Avg episode reward: [(0, '-0.698')] [2022-07-13 19:52:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4797.2). Total num frames: 438215680. Throughput: 0: 9640.5. Samples: 876452468. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:48,989][27935] Avg episode reward: [(0, '-0.904')] [2022-07-13 19:52:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 438240256. Throughput: 0: 9635.2. Samples: 876481348. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:53,989][27935] Avg episode reward: [(0, '0.336')] [2022-07-13 19:52:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 438264832. Throughput: 0: 9626.6. Samples: 876539268. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:52:58,989][27935] Avg episode reward: [(0, '0.294')] [2022-07-13 19:53:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4804.1). Total num frames: 438287360. Throughput: 0: 9527.6. Samples: 876592756. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:03,989][27935] Avg episode reward: [(0, '-0.423')] [2022-07-13 19:53:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 438310912. Throughput: 0: 9530.0. Samples: 876621848. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:08,989][27935] Avg episode reward: [(0, '-1.128')] [2022-07-13 19:53:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 438335488. Throughput: 0: 9541.0. Samples: 876679784. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:13,989][27935] Avg episode reward: [(0, '-0.732')] [2022-07-13 19:53:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4800.7). Total num frames: 438359040. Throughput: 0: 9535.3. Samples: 876737608. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:18,989][27935] Avg episode reward: [(0, '-0.128')] [2022-07-13 19:53:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4793.7). Total num frames: 438383616. Throughput: 0: 9548.0. Samples: 876766896. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:23,989][27935] Avg episode reward: [(0, '-0.192')] [2022-07-13 19:53:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 438407168. Throughput: 0: 9563.0. Samples: 876824712. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:28,989][27935] Avg episode reward: [(0, '0.035')] [2022-07-13 19:53:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4790.2). Total num frames: 438430720. Throughput: 0: 9561.8. Samples: 876882748. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:33,989][27935] Avg episode reward: [(0, '-0.747')] [2022-07-13 19:53:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4790.2). Total num frames: 438455296. Throughput: 0: 9556.0. Samples: 876911368. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:38,989][27935] Avg episode reward: [(0, '-0.215')] [2022-07-13 19:53:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4797.2). Total num frames: 438478848. Throughput: 0: 9550.8. Samples: 876969052. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:43,989][27935] Avg episode reward: [(0, '0.131')] [2022-07-13 19:53:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 438503424. Throughput: 0: 9006.1. Samples: 876998032. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:48,989][27935] Avg episode reward: [(0, '-0.728')] [2022-07-13 19:53:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 438529024. Throughput: 0: 9654.8. Samples: 877056316. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:53,989][27935] Avg episode reward: [(0, '-0.990')] [2022-07-13 19:53:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4800.6). Total num frames: 438552576. Throughput: 0: 9663.6. Samples: 877114644. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:53:58,989][27935] Avg episode reward: [(0, '-0.984')] [2022-07-13 19:54:03,992][27935] Fps is (10 sec: 4606.3, 60 sec: 4795.4, 300 sec: 4793.6). Total num frames: 438575104. Throughput: 0: 9590.9. Samples: 877169232. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:03,993][27935] Avg episode reward: [(0, '-1.163')] [2022-07-13 19:54:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4778.7, 300 sec: 4786.8). Total num frames: 438597632. Throughput: 0: 9582.6. Samples: 877198112. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:08,989][27935] Avg episode reward: [(0, '-0.404')] [2022-07-13 19:54:13,989][27935] Fps is (10 sec: 4814.6, 60 sec: 4795.7, 300 sec: 4793.7). Total num frames: 438623232. Throughput: 0: 9592.0. Samples: 877256352. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:13,989][27935] Avg episode reward: [(0, '-0.493')] [2022-07-13 19:54:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4790.2). Total num frames: 438647808. Throughput: 0: 9601.1. Samples: 877314796. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:18,989][27935] Avg episode reward: [(0, '0.814')] [2022-07-13 19:54:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 438672384. Throughput: 0: 9613.8. Samples: 877343988. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:23,989][27935] Avg episode reward: [(0, '0.881')] [2022-07-13 19:54:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4793.7). Total num frames: 438695936. Throughput: 0: 9619.6. Samples: 877401932. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:28,989][27935] Avg episode reward: [(0, '0.686')] [2022-07-13 19:54:33,996][27935] Fps is (10 sec: 4911.5, 60 sec: 4846.3, 300 sec: 4793.6). Total num frames: 438721536. Throughput: 0: 10269.7. Samples: 877460248. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:33,997][27935] Avg episode reward: [(0, '0.666')] [2022-07-13 19:54:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4797.2). Total num frames: 438746112. Throughput: 0: 9622.0. Samples: 877489304. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:38,989][27935] Avg episode reward: [(0, '0.007')] [2022-07-13 19:54:43,989][27935] Fps is (10 sec: 4714.0, 60 sec: 4829.9, 300 sec: 4793.7). Total num frames: 438768640. Throughput: 0: 9628.8. Samples: 877547940. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:43,989][27935] Avg episode reward: [(0, '0.247')] [2022-07-13 19:54:48,992][27935] Fps is (10 sec: 4708.8, 60 sec: 4829.6, 300 sec: 4790.2). Total num frames: 438793216. Throughput: 0: 9725.7. Samples: 877606884. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:48,993][27935] Avg episode reward: [(0, '-0.149')] [2022-07-13 19:54:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 438817792. Throughput: 0: 9727.8. Samples: 877635864. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:53,990][27935] Avg episode reward: [(0, '-1.389')] [2022-07-13 19:54:58,989][27935] Fps is (10 sec: 4814.4, 60 sec: 4812.8, 300 sec: 4797.2). Total num frames: 438841344. Throughput: 0: 9733.6. Samples: 877694364. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:54:58,989][27935] Avg episode reward: [(0, '-0.913')] [2022-07-13 19:55:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4830.2, 300 sec: 4797.2). Total num frames: 438864896. Throughput: 0: 9648.2. Samples: 877748964. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:55:03,989][27935] Avg episode reward: [(0, '-0.850')] [2022-07-13 19:55:08,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4864.0, 300 sec: 4800.7). Total num frames: 438889472. Throughput: 0: 9647.8. Samples: 877778140. Policy #0 lag: (min: 0.0, avg: 8.9, max: 21.0) [2022-07-13 19:55:08,989][27935] Avg episode reward: [(0, '0.068')] [2022-07-13 19:55:13,990][27935] Fps is (10 sec: 4812.4, 60 sec: 4829.8, 300 sec: 4800.6). Total num frames: 438913024. Throughput: 0: 9652.5. Samples: 877836304. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:13,990][27935] Avg episode reward: [(0, '0.009')] [2022-07-13 19:55:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4797.2). Total num frames: 438937600. Throughput: 0: 9647.6. Samples: 877894316. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:18,989][27935] Avg episode reward: [(0, '0.519')] [2022-07-13 19:55:23,989][27935] Fps is (10 sec: 4915.6, 60 sec: 4829.9, 300 sec: 4800.7). Total num frames: 438962176. Throughput: 0: 9644.3. Samples: 877923296. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:23,989][27935] Avg episode reward: [(0, '0.615')] [2022-07-13 19:55:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4800.7). Total num frames: 438986752. Throughput: 0: 9639.8. Samples: 877981732. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:28,989][27935] Avg episode reward: [(0, '1.184')] [2022-07-13 19:55:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4796.3, 300 sec: 4797.2). Total num frames: 439009280. Throughput: 0: 9616.7. Samples: 878039604. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:33,990][27935] Avg episode reward: [(0, '1.168')] [2022-07-13 19:55:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 439034880. Throughput: 0: 9614.7. Samples: 878068524. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:38,989][27935] Avg episode reward: [(0, '1.560')] [2022-07-13 19:55:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4804.1). Total num frames: 439059456. Throughput: 0: 9627.6. Samples: 878127608. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:43,989][27935] Avg episode reward: [(0, '1.375')] [2022-07-13 19:55:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4830.1, 300 sec: 4804.1). Total num frames: 439083008. Throughput: 0: 9712.9. Samples: 878186044. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:48,989][27935] Avg episode reward: [(0, '1.357')] [2022-07-13 19:55:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 439107584. Throughput: 0: 9712.0. Samples: 878215180. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:53,989][27935] Avg episode reward: [(0, '1.548')] [2022-07-13 19:55:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 439132160. Throughput: 0: 9710.6. Samples: 878273272. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:55:58,989][27935] Avg episode reward: [(0, '1.527')] [2022-07-13 19:56:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 439153664. Throughput: 0: 9645.3. Samples: 878328356. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:03,989][27935] Avg episode reward: [(0, '-0.237')] [2022-07-13 19:56:08,989][27935] Fps is (10 sec: 4710.5, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 439179264. Throughput: 0: 9649.7. Samples: 878357532. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:08,989][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 19:56:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4847.0, 300 sec: 4811.1). Total num frames: 439203840. Throughput: 0: 9656.3. Samples: 878416264. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:13,989][27935] Avg episode reward: [(0, '-0.880')] [2022-07-13 19:56:18,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 439226368. Throughput: 0: 9670.0. Samples: 878474752. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:18,989][27935] Avg episode reward: [(0, '-1.271')] [2022-07-13 19:56:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 439251968. Throughput: 0: 9678.5. Samples: 878504056. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:23,989][27935] Avg episode reward: [(0, '-1.175')] [2022-07-13 19:56:28,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 439276544. Throughput: 0: 9652.4. Samples: 878561968. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:28,989][27935] Avg episode reward: [(0, '-1.187')] [2022-07-13 19:56:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4814.5). Total num frames: 439301120. Throughput: 0: 9655.2. Samples: 878620528. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:33,989][27935] Avg episode reward: [(0, '-1.708')] [2022-07-13 19:56:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 439324672. Throughput: 0: 9650.4. Samples: 878649448. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:38,989][27935] Avg episode reward: [(0, '0.307')] [2022-07-13 19:56:43,992][27935] Fps is (10 sec: 4811.5, 60 sec: 4829.6, 300 sec: 4818.0). Total num frames: 439349248. Throughput: 0: 9660.3. Samples: 878708012. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:43,992][27935] Avg episode reward: [(0, '-0.427')] [2022-07-13 19:56:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 439371776. Throughput: 0: 9687.5. Samples: 878764292. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:48,989][27935] Avg episode reward: [(0, '-0.467')] [2022-07-13 19:56:53,989][27935] Fps is (10 sec: 4711.7, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 439396352. Throughput: 0: 9688.6. Samples: 878793520. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:53,989][27935] Avg episode reward: [(0, '-0.616')] [2022-07-13 19:56:58,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 439421952. Throughput: 0: 9667.4. Samples: 878851296. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:56:58,989][27935] Avg episode reward: [(0, '-0.645')] [2022-07-13 19:57:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 439442432. Throughput: 0: 9570.5. Samples: 878905424. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:03,989][27935] Avg episode reward: [(0, '-0.751')] [2022-07-13 19:57:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 439467008. Throughput: 0: 9570.0. Samples: 878934708. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:08,989][27935] Avg episode reward: [(0, '-0.188')] [2022-07-13 19:57:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 439491584. Throughput: 0: 9576.8. Samples: 878992924. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:13,989][27935] Avg episode reward: [(0, '-0.896')] [2022-07-13 19:57:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 439515136. Throughput: 0: 9570.1. Samples: 879051184. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:18,989][27935] Avg episode reward: [(0, '0.038')] [2022-07-13 19:57:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 439540736. Throughput: 0: 9575.2. Samples: 879080332. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:23,989][27935] Avg episode reward: [(0, '0.457')] [2022-07-13 19:57:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 439563264. Throughput: 0: 9556.6. Samples: 879138032. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:28,989][27935] Avg episode reward: [(0, '0.535')] [2022-07-13 19:57:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 439588864. Throughput: 0: 9598.9. Samples: 879196244. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:33,989][27935] Avg episode reward: [(0, '0.866')] [2022-07-13 19:57:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 439612416. Throughput: 0: 9595.6. Samples: 879225324. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:38,989][27935] Avg episode reward: [(0, '0.922')] [2022-07-13 19:57:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.9, 300 sec: 4814.5). Total num frames: 439635968. Throughput: 0: 9595.5. Samples: 879283096. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:43,992][27935] Avg episode reward: [(0, '1.046')] [2022-07-13 19:57:48,991][27935] Fps is (10 sec: 4914.2, 60 sec: 4829.7, 300 sec: 4818.0). Total num frames: 439661568. Throughput: 0: 9691.3. Samples: 879341552. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:48,992][27935] Avg episode reward: [(0, '1.626')] [2022-07-13 19:57:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 439685120. Throughput: 0: 9686.0. Samples: 879370580. Policy #0 lag: (min: 0.0, avg: 8.4, max: 20.0) [2022-07-13 19:57:53,989][27935] Avg episode reward: [(0, '1.455')] [2022-07-13 19:57:58,989][27935] Fps is (10 sec: 4813.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 439709696. Throughput: 0: 9683.7. Samples: 879428688. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:57:58,989][27935] Avg episode reward: [(0, '1.249')] [2022-07-13 19:58:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 439732224. Throughput: 0: 9602.3. Samples: 879483288. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:03,989][27935] Avg episode reward: [(0, '0.582')] [2022-07-13 19:58:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 439755776. Throughput: 0: 9597.6. Samples: 879512224. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:08,989][27935] Avg episode reward: [(0, '0.305')] [2022-07-13 19:58:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 439781376. Throughput: 0: 9605.2. Samples: 879570268. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:13,989][27935] Avg episode reward: [(0, '-0.029')] [2022-07-13 19:58:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 439803904. Throughput: 0: 9606.6. Samples: 879628540. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:18,992][27935] Avg episode reward: [(0, '-0.194')] [2022-07-13 19:58:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 439827456. Throughput: 0: 9609.9. Samples: 879657768. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:23,989][27935] Avg episode reward: [(0, '-0.231')] [2022-07-13 19:58:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 439853056. Throughput: 0: 9624.4. Samples: 879716192. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:28,989][27935] Avg episode reward: [(0, '-0.230')] [2022-07-13 19:58:33,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 439878656. Throughput: 0: 9612.4. Samples: 879774088. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:33,989][27935] Avg episode reward: [(0, '-0.284')] [2022-07-13 19:58:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 439901184. Throughput: 0: 9616.2. Samples: 879803308. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:38,989][27935] Avg episode reward: [(0, '0.357')] [2022-07-13 19:58:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 439926784. Throughput: 0: 9631.3. Samples: 879862096. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:43,990][27935] Avg episode reward: [(0, '0.594')] [2022-07-13 19:58:48,996][27935] Fps is (10 sec: 5014.1, 60 sec: 4829.5, 300 sec: 4821.4). Total num frames: 439951360. Throughput: 0: 9723.7. Samples: 879920924. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:48,996][27935] Avg episode reward: [(0, '1.000')] [2022-07-13 19:58:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 439974912. Throughput: 0: 9733.7. Samples: 879950240. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:53,989][27935] Avg episode reward: [(0, '1.444')] [2022-07-13 19:58:58,989][27935] Fps is (10 sec: 4816.1, 60 sec: 4829.9, 300 sec: 4828.5). Total num frames: 439999488. Throughput: 0: 9746.6. Samples: 880008864. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:58:58,989][27935] Avg episode reward: [(0, '1.276')] [2022-07-13 19:59:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 440020992. Throughput: 0: 9659.3. Samples: 880063208. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:03,989][27935] Avg episode reward: [(0, '1.466')] [2022-07-13 19:59:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 440046592. Throughput: 0: 9659.5. Samples: 880092444. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:08,989][27935] Avg episode reward: [(0, '1.672')] [2022-07-13 19:59:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 440071168. Throughput: 0: 9653.9. Samples: 880150616. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:13,990][27935] Avg episode reward: [(0, '1.584')] [2022-07-13 19:59:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 440093696. Throughput: 0: 9665.2. Samples: 880209020. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:18,989][27935] Avg episode reward: [(0, '1.752')] [2022-07-13 19:59:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 440118272. Throughput: 0: 9669.1. Samples: 880238416. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:23,991][27935] Avg episode reward: [(0, '1.911')] [2022-07-13 19:59:28,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4864.0, 300 sec: 4825.1). Total num frames: 440144896. Throughput: 0: 9657.6. Samples: 880296688. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:28,990][27935] Avg episode reward: [(0, '1.773')] [2022-07-13 19:59:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 440167424. Throughput: 0: 9638.6. Samples: 880354592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:33,990][27935] Avg episode reward: [(0, '1.095')] [2022-07-13 19:59:38,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 440190976. Throughput: 0: 9629.0. Samples: 880383544. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:38,989][27935] Avg episode reward: [(0, '1.061')] [2022-07-13 19:59:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 440216576. Throughput: 0: 9619.7. Samples: 880441752. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:43,990][27935] Avg episode reward: [(0, '1.196')] [2022-07-13 19:59:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4796.3, 300 sec: 4818.0). Total num frames: 440239104. Throughput: 0: 9054.0. Samples: 880470640. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:48,989][27935] Avg episode reward: [(0, '-0.054')] [2022-07-13 19:59:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 440265728. Throughput: 0: 9693.5. Samples: 880528652. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:53,990][27935] Avg episode reward: [(0, '-0.904')] [2022-07-13 19:59:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 440288256. Throughput: 0: 9680.1. Samples: 880586220. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 19:59:58,990][27935] Avg episode reward: [(0, '-1.744')] [2022-07-13 20:00:03,989][27935] Fps is (10 sec: 4403.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 440309760. Throughput: 0: 9590.5. Samples: 880640592. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:03,989][27935] Avg episode reward: [(0, '-1.833')] [2022-07-13 20:00:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 440334336. Throughput: 0: 9585.5. Samples: 880669764. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:08,989][27935] Avg episode reward: [(0, '-0.953')] [2022-07-13 20:00:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 440357888. Throughput: 0: 9577.6. Samples: 880727680. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:13,989][27935] Avg episode reward: [(0, '-2.553')] [2022-07-13 20:00:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 440382464. Throughput: 0: 9567.2. Samples: 880785116. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:18,990][27935] Avg episode reward: [(0, '-2.636')] [2022-07-13 20:00:23,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 440407040. Throughput: 0: 9569.8. Samples: 880814184. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:23,989][27935] Avg episode reward: [(0, '-1.338')] [2022-07-13 20:00:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4761.6, 300 sec: 4818.0). Total num frames: 440430592. Throughput: 0: 9557.6. Samples: 880871844. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:28,989][27935] Avg episode reward: [(0, '-0.254')] [2022-07-13 20:00:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 440455168. Throughput: 0: 10199.7. Samples: 880929628. Policy #0 lag: (min: 0.0, avg: 8.6, max: 19.0) [2022-07-13 20:00:33,989][27935] Avg episode reward: [(0, '0.177')] [2022-07-13 20:00:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 440478720. Throughput: 0: 9541.8. Samples: 880958032. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:00:38,989][27935] Avg episode reward: [(0, '0.233')] [2022-07-13 20:00:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 440503296. Throughput: 0: 9552.7. Samples: 881016092. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:00:43,989][27935] Avg episode reward: [(0, '0.236')] [2022-07-13 20:00:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 440527872. Throughput: 0: 9656.8. Samples: 881075148. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:00:48,989][27935] Avg episode reward: [(0, '1.348')] [2022-07-13 20:00:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 440552448. Throughput: 0: 9658.7. Samples: 881104404. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:00:53,989][27935] Avg episode reward: [(0, '1.533')] [2022-07-13 20:00:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 440577024. Throughput: 0: 9668.4. Samples: 881162756. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:00:58,989][27935] Avg episode reward: [(0, '1.407')] [2022-07-13 20:01:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 440598528. Throughput: 0: 9597.5. Samples: 881217004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:03,989][27935] Avg episode reward: [(0, '1.620')] [2022-07-13 20:01:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 440623104. Throughput: 0: 9598.5. Samples: 881246116. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:08,989][27935] Avg episode reward: [(0, '1.492')] [2022-07-13 20:01:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 440647680. Throughput: 0: 9606.4. Samples: 881304132. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:13,990][27935] Avg episode reward: [(0, '1.626')] [2022-07-13 20:01:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 440671232. Throughput: 0: 9616.1. Samples: 881362352. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:18,989][27935] Avg episode reward: [(0, '0.387')] [2022-07-13 20:01:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 440695808. Throughput: 0: 9641.0. Samples: 881391876. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:23,990][27935] Avg episode reward: [(0, '0.104')] [2022-07-13 20:01:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 440720384. Throughput: 0: 9642.3. Samples: 881449996. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:28,989][27935] Avg episode reward: [(0, '0.243')] [2022-07-13 20:01:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 440742912. Throughput: 0: 9626.6. Samples: 881508344. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:33,989][27935] Avg episode reward: [(0, '0.005')] [2022-07-13 20:01:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 440768512. Throughput: 0: 9616.4. Samples: 881537144. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:38,989][27935] Avg episode reward: [(0, '0.203')] [2022-07-13 20:01:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 440793088. Throughput: 0: 9619.5. Samples: 881595632. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:43,989][27935] Avg episode reward: [(0, '-0.376')] [2022-07-13 20:01:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 440816640. Throughput: 0: 9718.9. Samples: 881654356. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:48,990][27935] Avg episode reward: [(0, '-0.984')] [2022-07-13 20:01:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 440842240. Throughput: 0: 9725.0. Samples: 881683740. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:53,989][27935] Avg episode reward: [(0, '0.031')] [2022-07-13 20:01:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 440865792. Throughput: 0: 9734.0. Samples: 881742160. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:01:58,989][27935] Avg episode reward: [(0, '0.922')] [2022-07-13 20:02:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 440888320. Throughput: 0: 9654.1. Samples: 881796788. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:03,989][27935] Avg episode reward: [(0, '0.142')] [2022-07-13 20:02:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 440912896. Throughput: 0: 9646.6. Samples: 881825972. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:08,996][27935] Avg episode reward: [(0, '-0.008')] [2022-07-13 20:02:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 440937472. Throughput: 0: 9649.5. Samples: 881884224. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:13,989][27935] Avg episode reward: [(0, '0.265')] [2022-07-13 20:02:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 440962048. Throughput: 0: 9000.3. Samples: 881913360. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:18,989][27935] Avg episode reward: [(0, '0.402')] [2022-07-13 20:02:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 440985600. Throughput: 0: 9663.6. Samples: 881972004. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:23,989][27935] Avg episode reward: [(0, '-1.246')] [2022-07-13 20:02:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 441010176. Throughput: 0: 9666.2. Samples: 882030612. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:28,989][27935] Avg episode reward: [(0, '-1.140')] [2022-07-13 20:02:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4864.0, 300 sec: 4821.5). Total num frames: 441034752. Throughput: 0: 9652.8. Samples: 882088732. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:33,989][27935] Avg episode reward: [(0, '-1.242')] [2022-07-13 20:02:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 441059328. Throughput: 0: 9643.4. Samples: 882117692. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:38,989][27935] Avg episode reward: [(0, '-0.872')] [2022-07-13 20:02:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 441082880. Throughput: 0: 9624.1. Samples: 882175244. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:43,989][27935] Avg episode reward: [(0, '-0.761')] [2022-07-13 20:02:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 441106432. Throughput: 0: 9683.7. Samples: 882232556. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:48,989][27935] Avg episode reward: [(0, '-0.784')] [2022-07-13 20:02:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441131008. Throughput: 0: 9663.1. Samples: 882260812. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:53,989][27935] Avg episode reward: [(0, '0.617')] [2022-07-13 20:02:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4818.0). Total num frames: 441153536. Throughput: 0: 9646.9. Samples: 882318336. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:02:58,989][27935] Avg episode reward: [(0, '0.889')] [2022-07-13 20:03:03,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 441176064. Throughput: 0: 10194.1. Samples: 882372092. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:03:03,989][27935] Avg episode reward: [(0, '0.543')] [2022-07-13 20:03:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 441200640. Throughput: 0: 9537.2. Samples: 882401180. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:03:08,989][27935] Avg episode reward: [(0, '0.855')] [2022-07-13 20:03:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4761.6, 300 sec: 4811.1). Total num frames: 441223168. Throughput: 0: 9522.4. Samples: 882459120. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:03:13,989][27935] Avg episode reward: [(0, '1.335')] [2022-07-13 20:03:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 441248768. Throughput: 0: 9527.0. Samples: 882517448. Policy #0 lag: (min: 0.0, avg: 9.3, max: 20.0) [2022-07-13 20:03:18,989][27935] Avg episode reward: [(0, '0.862')] [2022-07-13 20:03:23,989][27935] Fps is (10 sec: 5120.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441274368. Throughput: 0: 9529.7. Samples: 882546528. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:23,989][27935] Avg episode reward: [(0, '0.693')] [2022-07-13 20:03:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 441296896. Throughput: 0: 9544.6. Samples: 882604752. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:28,989][27935] Avg episode reward: [(0, '0.848')] [2022-07-13 20:03:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 441321472. Throughput: 0: 9566.8. Samples: 882663060. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:33,989][27935] Avg episode reward: [(0, '0.553')] [2022-07-13 20:03:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 441346048. Throughput: 0: 9577.7. Samples: 882691808. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:38,989][27935] Avg episode reward: [(0, '0.991')] [2022-07-13 20:03:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4807.7). Total num frames: 441369600. Throughput: 0: 9592.7. Samples: 882750008. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:43,989][27935] Avg episode reward: [(0, '0.869')] [2022-07-13 20:03:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 441395200. Throughput: 0: 9700.1. Samples: 882808596. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:48,989][27935] Avg episode reward: [(0, '0.919')] [2022-07-13 20:03:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 441418752. Throughput: 0: 9709.6. Samples: 882838112. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:53,989][27935] Avg episode reward: [(0, '0.881')] [2022-07-13 20:03:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 441443328. Throughput: 0: 9717.4. Samples: 882896404. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:03:58,989][27935] Avg episode reward: [(0, '1.049')] [2022-07-13 20:04:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 441464832. Throughput: 0: 9634.3. Samples: 882950992. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:03,989][27935] Avg episode reward: [(0, '1.100')] [2022-07-13 20:04:08,989][27935] Fps is (10 sec: 4710.3, 60 sec: 4829.8, 300 sec: 4811.1). Total num frames: 441490432. Throughput: 0: 9641.1. Samples: 882980380. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:08,990][27935] Avg episode reward: [(0, '1.063')] [2022-07-13 20:04:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 441515008. Throughput: 0: 9641.9. Samples: 883038636. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:13,989][27935] Avg episode reward: [(0, '1.165')] [2022-07-13 20:04:18,989][27935] Fps is (10 sec: 4812.9, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 441538560. Throughput: 0: 9644.1. Samples: 883097044. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:18,989][27935] Avg episode reward: [(0, '0.808')] [2022-07-13 20:04:23,994][27935] Fps is (10 sec: 4707.9, 60 sec: 4795.3, 300 sec: 4804.0). Total num frames: 441562112. Throughput: 0: 9650.8. Samples: 883126148. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:23,995][27935] Avg episode reward: [(0, '1.433')] [2022-07-13 20:04:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 441587712. Throughput: 0: 9656.2. Samples: 883184536. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:28,989][27935] Avg episode reward: [(0, '1.335')] [2022-07-13 20:04:33,989][27935] Fps is (10 sec: 4917.9, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 441611264. Throughput: 0: 9644.6. Samples: 883242604. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:33,989][27935] Avg episode reward: [(0, '1.073')] [2022-07-13 20:04:38,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 441634816. Throughput: 0: 9636.0. Samples: 883271732. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:38,989][27935] Avg episode reward: [(0, '1.352')] [2022-07-13 20:04:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 441660416. Throughput: 0: 9641.7. Samples: 883330280. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:43,989][27935] Avg episode reward: [(0, '1.458')] [2022-07-13 20:04:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 441684992. Throughput: 0: 9724.7. Samples: 883388604. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:48,989][27935] Avg episode reward: [(0, '0.728')] [2022-07-13 20:04:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 441708544. Throughput: 0: 9724.0. Samples: 883417960. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:53,989][27935] Avg episode reward: [(0, '1.048')] [2022-07-13 20:04:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 441733120. Throughput: 0: 9719.4. Samples: 883476008. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:04:58,989][27935] Avg episode reward: [(0, '0.417')] [2022-07-13 20:05:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 441755648. Throughput: 0: 9613.5. Samples: 883529652. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:03,989][27935] Avg episode reward: [(0, '0.346')] [2022-07-13 20:05:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441779200. Throughput: 0: 9607.2. Samples: 883558420. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:08,989][27935] Avg episode reward: [(0, '0.830')] [2022-07-13 20:05:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441803776. Throughput: 0: 9591.1. Samples: 883616136. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:13,989][27935] Avg episode reward: [(0, '0.576')] [2022-07-13 20:05:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 441826304. Throughput: 0: 9586.5. Samples: 883673996. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:18,990][27935] Avg episode reward: [(0, '0.398')] [2022-07-13 20:05:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4813.2, 300 sec: 4814.5). Total num frames: 441850880. Throughput: 0: 9584.7. Samples: 883703044. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:23,989][27935] Avg episode reward: [(0, '1.027')] [2022-07-13 20:05:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 441875456. Throughput: 0: 9576.6. Samples: 883761228. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:28,989][27935] Avg episode reward: [(0, '0.931')] [2022-07-13 20:05:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441900032. Throughput: 0: 9568.2. Samples: 883819172. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:33,989][27935] Avg episode reward: [(0, '1.696')] [2022-07-13 20:05:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 441923584. Throughput: 0: 9562.7. Samples: 883848280. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:38,990][27935] Avg episode reward: [(0, '1.935')] [2022-07-13 20:05:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 441949184. Throughput: 0: 9563.4. Samples: 883906360. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:43,989][27935] Avg episode reward: [(0, '1.970')] [2022-07-13 20:05:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 441972736. Throughput: 0: 9671.9. Samples: 883964888. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:48,989][27935] Avg episode reward: [(0, '2.161')] [2022-07-13 20:05:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 441996288. Throughput: 0: 9678.8. Samples: 883993964. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:53,989][27935] Avg episode reward: [(0, '2.072')] [2022-07-13 20:05:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 442021888. Throughput: 0: 9702.1. Samples: 884052728. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:05:58,989][27935] Avg episode reward: [(0, '1.934')] [2022-07-13 20:06:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 442043392. Throughput: 0: 9628.9. Samples: 884107296. Policy #0 lag: (min: 0.0, avg: 10.0, max: 24.0) [2022-07-13 20:06:03,989][27935] Avg episode reward: [(0, '1.431')] [2022-07-13 20:06:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 442067968. Throughput: 0: 9630.1. Samples: 884136400. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:08,989][27935] Avg episode reward: [(0, '0.670')] [2022-07-13 20:06:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 442090496. Throughput: 0: 9625.0. Samples: 884194352. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:13,989][27935] Avg episode reward: [(0, '-0.690')] [2022-07-13 20:06:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 442117120. Throughput: 0: 9622.8. Samples: 884252196. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:18,989][27935] Avg episode reward: [(0, '-0.612')] [2022-07-13 20:06:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 442140672. Throughput: 0: 9619.8. Samples: 884281172. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:23,989][27935] Avg episode reward: [(0, '-0.807')] [2022-07-13 20:06:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 442164224. Throughput: 0: 9603.8. Samples: 884338532. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:28,989][27935] Avg episode reward: [(0, '-0.686')] [2022-07-13 20:06:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 442187776. Throughput: 0: 9573.5. Samples: 884395696. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:33,989][27935] Avg episode reward: [(0, '-0.808')] [2022-07-13 20:06:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 442212352. Throughput: 0: 9564.4. Samples: 884424364. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:38,989][27935] Avg episode reward: [(0, '-0.336')] [2022-07-13 20:06:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4811.1). Total num frames: 442235904. Throughput: 0: 9550.3. Samples: 884482492. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:43,989][27935] Avg episode reward: [(0, '-0.039')] [2022-07-13 20:06:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 442260480. Throughput: 0: 9619.0. Samples: 884540152. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:48,989][27935] Avg episode reward: [(0, '1.066')] [2022-07-13 20:06:53,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4812.7, 300 sec: 4811.0). Total num frames: 442285056. Throughput: 0: 9624.3. Samples: 884569504. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:53,990][27935] Avg episode reward: [(0, '1.373')] [2022-07-13 20:06:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4814.5). Total num frames: 442308608. Throughput: 0: 9635.1. Samples: 884627932. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:06:58,989][27935] Avg episode reward: [(0, '1.062')] [2022-07-13 20:07:03,989][27935] Fps is (10 sec: 4711.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 442332160. Throughput: 0: 9552.5. Samples: 884682060. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:03,989][27935] Avg episode reward: [(0, '1.403')] [2022-07-13 20:07:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 442355712. Throughput: 0: 9549.9. Samples: 884710916. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:08,989][27935] Avg episode reward: [(0, '1.744')] [2022-07-13 20:07:13,989][27935] Fps is (10 sec: 4607.9, 60 sec: 4795.7, 300 sec: 4800.7). Total num frames: 442378240. Throughput: 0: 9558.3. Samples: 884768656. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:13,989][27935] Avg episode reward: [(0, '1.300')] [2022-07-13 20:07:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 442404864. Throughput: 0: 9576.5. Samples: 884826640. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:18,989][27935] Avg episode reward: [(0, '1.167')] [2022-07-13 20:07:23,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 442428416. Throughput: 0: 9590.9. Samples: 884855956. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:23,989][27935] Avg episode reward: [(0, '0.634')] [2022-07-13 20:07:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4804.1). Total num frames: 442451968. Throughput: 0: 9599.0. Samples: 884914448. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:28,989][27935] Avg episode reward: [(0, '0.680')] [2022-07-13 20:07:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4804.1). Total num frames: 442476544. Throughput: 0: 9607.4. Samples: 884972484. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:33,990][27935] Avg episode reward: [(0, '0.952')] [2022-07-13 20:07:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 442501120. Throughput: 0: 9605.0. Samples: 885001720. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:38,989][27935] Avg episode reward: [(0, '0.522')] [2022-07-13 20:07:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 442524672. Throughput: 0: 9584.7. Samples: 885059244. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:43,989][27935] Avg episode reward: [(0, '0.313')] [2022-07-13 20:07:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 442550272. Throughput: 0: 9678.0. Samples: 885117572. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:48,989][27935] Avg episode reward: [(0, '0.544')] [2022-07-13 20:07:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.8, 300 sec: 4811.1). Total num frames: 442572800. Throughput: 0: 9686.8. Samples: 885146824. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:53,989][27935] Avg episode reward: [(0, '1.181')] [2022-07-13 20:07:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 442597376. Throughput: 0: 9703.9. Samples: 885205332. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:07:58,989][27935] Avg episode reward: [(0, '0.768')] [2022-07-13 20:08:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 442619904. Throughput: 0: 9630.6. Samples: 885260016. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:03,989][27935] Avg episode reward: [(0, '0.802')] [2022-07-13 20:08:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 442643456. Throughput: 0: 9626.9. Samples: 885289168. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:08,989][27935] Avg episode reward: [(0, '0.065')] [2022-07-13 20:08:13,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 442670080. Throughput: 0: 9623.5. Samples: 885347504. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:13,989][27935] Avg episode reward: [(0, '0.447')] [2022-07-13 20:08:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 442693632. Throughput: 0: 9630.3. Samples: 885405848. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:18,989][27935] Avg episode reward: [(0, '0.548')] [2022-07-13 20:08:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 442718208. Throughput: 0: 9630.1. Samples: 885435076. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:23,989][27935] Avg episode reward: [(0, '0.410')] [2022-07-13 20:08:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 442741760. Throughput: 0: 9653.5. Samples: 885493652. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:28,989][27935] Avg episode reward: [(0, '-1.173')] [2022-07-13 20:08:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 442766336. Throughput: 0: 9658.7. Samples: 885552212. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:33,990][27935] Avg episode reward: [(0, '-1.954')] [2022-07-13 20:08:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 442789888. Throughput: 0: 9658.8. Samples: 885581468. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:38,989][27935] Avg episode reward: [(0, '-1.820')] [2022-07-13 20:08:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 442815488. Throughput: 0: 9660.3. Samples: 885640044. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:43,989][27935] Avg episode reward: [(0, '-1.179')] [2022-07-13 20:08:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 442839040. Throughput: 0: 9752.9. Samples: 885698896. Policy #0 lag: (min: 0.0, avg: 8.6, max: 20.0) [2022-07-13 20:08:48,990][27935] Avg episode reward: [(0, '-1.348')] [2022-07-13 20:08:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 442863616. Throughput: 0: 9738.4. Samples: 885727396. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:08:53,989][27935] Avg episode reward: [(0, '-1.267')] [2022-07-13 20:08:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 442887168. Throughput: 0: 9708.4. Samples: 885784380. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:08:58,989][27935] Avg episode reward: [(0, '-1.081')] [2022-07-13 20:09:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 442909696. Throughput: 0: 9608.4. Samples: 885838224. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:03,989][27935] Avg episode reward: [(0, '0.247')] [2022-07-13 20:09:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4807.6). Total num frames: 442933248. Throughput: 0: 9607.7. Samples: 885867424. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:08,992][27935] Avg episode reward: [(0, '1.229')] [2022-07-13 20:09:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 442956800. Throughput: 0: 9597.5. Samples: 885925540. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:13,990][27935] Avg episode reward: [(0, '1.139')] [2022-07-13 20:09:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.2). Total num frames: 442981376. Throughput: 0: 9586.0. Samples: 885983584. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:18,991][27935] Avg episode reward: [(0, '1.060')] [2022-07-13 20:09:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443006976. Throughput: 0: 9585.4. Samples: 886012812. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:23,990][27935] Avg episode reward: [(0, '0.458')] [2022-07-13 20:09:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443030528. Throughput: 0: 9575.2. Samples: 886070928. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:28,990][27935] Avg episode reward: [(0, '0.271')] [2022-07-13 20:09:33,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 443053056. Throughput: 0: 9558.8. Samples: 886129040. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:33,991][27935] Avg episode reward: [(0, '0.530')] [2022-07-13 20:09:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 443079680. Throughput: 0: 9571.0. Samples: 886158092. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:38,996][27935] Avg episode reward: [(0, '0.696')] [2022-07-13 20:09:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 443103232. Throughput: 0: 9604.2. Samples: 886216568. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:43,990][27935] Avg episode reward: [(0, '0.537')] [2022-07-13 20:09:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 443128832. Throughput: 0: 9701.7. Samples: 886274800. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:48,989][27935] Avg episode reward: [(0, '0.258')] [2022-07-13 20:09:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443152384. Throughput: 0: 9703.6. Samples: 886304088. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:53,989][27935] Avg episode reward: [(0, '0.095')] [2022-07-13 20:09:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 443175936. Throughput: 0: 9712.1. Samples: 886362584. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:09:58,989][27935] Avg episode reward: [(0, '0.892')] [2022-07-13 20:10:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443198464. Throughput: 0: 9628.8. Samples: 886416880. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:03,989][27935] Avg episode reward: [(0, '1.001')] [2022-07-13 20:10:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 443222016. Throughput: 0: 9618.1. Samples: 886445628. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:08,989][27935] Avg episode reward: [(0, '0.886')] [2022-07-13 20:10:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 443247616. Throughput: 0: 9622.1. Samples: 886503924. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:13,989][27935] Avg episode reward: [(0, '0.580')] [2022-07-13 20:10:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 443271168. Throughput: 0: 9614.0. Samples: 886561668. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:18,989][27935] Avg episode reward: [(0, '1.063')] [2022-07-13 20:10:23,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4807.6). Total num frames: 443293696. Throughput: 0: 9613.9. Samples: 886590720. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:23,989][27935] Avg episode reward: [(0, '1.040')] [2022-07-13 20:10:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443319296. Throughput: 0: 9616.5. Samples: 886649312. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:28,989][27935] Avg episode reward: [(0, '1.561')] [2022-07-13 20:10:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 443343872. Throughput: 0: 9601.1. Samples: 886706852. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:33,989][27935] Avg episode reward: [(0, '1.368')] [2022-07-13 20:10:38,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443368448. Throughput: 0: 9600.1. Samples: 886736092. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:38,989][27935] Avg episode reward: [(0, '0.561')] [2022-07-13 20:10:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 443393024. Throughput: 0: 9581.4. Samples: 886793748. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:43,989][27935] Avg episode reward: [(0, '0.873')] [2022-07-13 20:10:48,992][27935] Fps is (10 sec: 4606.8, 60 sec: 4761.4, 300 sec: 4807.5). Total num frames: 443414528. Throughput: 0: 9668.7. Samples: 886852000. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:48,992][27935] Avg episode reward: [(0, '0.701')] [2022-07-13 20:10:53,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 443440128. Throughput: 0: 9669.7. Samples: 886880764. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:53,989][27935] Avg episode reward: [(0, '-0.078')] [2022-07-13 20:10:58,989][27935] Fps is (10 sec: 5019.0, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 443464704. Throughput: 0: 9675.3. Samples: 886939312. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:10:58,989][27935] Avg episode reward: [(0, '0.032')] [2022-07-13 20:11:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 443486208. Throughput: 0: 9596.5. Samples: 886993512. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:03,990][27935] Avg episode reward: [(0, '0.255')] [2022-07-13 20:11:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 443511808. Throughput: 0: 9588.0. Samples: 887022180. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:08,989][27935] Avg episode reward: [(0, '-0.907')] [2022-07-13 20:11:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 443535360. Throughput: 0: 9578.7. Samples: 887080352. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:13,989][27935] Avg episode reward: [(0, '-0.292')] [2022-07-13 20:11:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 443559936. Throughput: 0: 9586.5. Samples: 887138244. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:18,990][27935] Avg episode reward: [(0, '-0.076')] [2022-07-13 20:11:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4807.6). Total num frames: 443582464. Throughput: 0: 9572.4. Samples: 887166852. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:23,989][27935] Avg episode reward: [(0, '-0.334')] [2022-07-13 20:11:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 443608064. Throughput: 0: 9578.3. Samples: 887224772. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:28,989][27935] Avg episode reward: [(0, '-0.539')] [2022-07-13 20:11:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 443631616. Throughput: 0: 9576.0. Samples: 887282892. Policy #0 lag: (min: 0.0, avg: 10.4, max: 21.0) [2022-07-13 20:11:33,989][27935] Avg episode reward: [(0, '-0.784')] [2022-07-13 20:11:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 443656192. Throughput: 0: 9585.0. Samples: 887312088. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:11:38,989][27935] Avg episode reward: [(0, '-1.521')] [2022-07-13 20:11:43,993][27935] Fps is (10 sec: 4913.3, 60 sec: 4795.4, 300 sec: 4814.5). Total num frames: 443680768. Throughput: 0: 9576.7. Samples: 887370300. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:11:43,993][27935] Avg episode reward: [(0, '-0.608')] [2022-07-13 20:11:48,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.2, 300 sec: 4814.6). Total num frames: 443705344. Throughput: 0: 9669.8. Samples: 887428652. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:11:48,989][27935] Avg episode reward: [(0, '-0.731')] [2022-07-13 20:11:53,989][27935] Fps is (10 sec: 4712.2, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 443727872. Throughput: 0: 9683.2. Samples: 887457924. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:11:53,990][27935] Avg episode reward: [(0, '-0.156')] [2022-07-13 20:11:58,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4814.5). Total num frames: 443752448. Throughput: 0: 9684.2. Samples: 887516140. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:11:58,989][27935] Avg episode reward: [(0, '-0.147')] [2022-07-13 20:12:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 443776000. Throughput: 0: 9604.9. Samples: 887570464. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:03,989][27935] Avg episode reward: [(0, '0.133')] [2022-07-13 20:12:08,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 443801600. Throughput: 0: 9618.1. Samples: 887599668. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:08,989][27935] Avg episode reward: [(0, '1.053')] [2022-07-13 20:12:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4807.6). Total num frames: 443823104. Throughput: 0: 9617.4. Samples: 887657556. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:13,989][27935] Avg episode reward: [(0, '1.317')] [2022-07-13 20:12:18,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 443848704. Throughput: 0: 9620.1. Samples: 887715796. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:18,989][27935] Avg episode reward: [(0, '1.086')] [2022-07-13 20:12:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 443873280. Throughput: 0: 9621.5. Samples: 887745056. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:23,989][27935] Avg episode reward: [(0, '1.049')] [2022-07-13 20:12:28,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 443895808. Throughput: 0: 9631.4. Samples: 887803676. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:28,989][27935] Avg episode reward: [(0, '1.146')] [2022-07-13 20:12:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 443921408. Throughput: 0: 9629.6. Samples: 887861984. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:33,989][27935] Avg episode reward: [(0, '1.190')] [2022-07-13 20:12:38,989][27935] Fps is (10 sec: 5017.7, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 443945984. Throughput: 0: 9629.9. Samples: 887891268. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:38,989][27935] Avg episode reward: [(0, '1.566')] [2022-07-13 20:12:43,996][27935] Fps is (10 sec: 4809.1, 60 sec: 4812.5, 300 sec: 4810.9). Total num frames: 443969536. Throughput: 0: 9614.3. Samples: 887948856. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:43,997][27935] Avg episode reward: [(0, '1.191')] [2022-07-13 20:12:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 443994112. Throughput: 0: 9702.9. Samples: 888007096. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:48,989][27935] Avg episode reward: [(0, '1.598')] [2022-07-13 20:12:53,989][27935] Fps is (10 sec: 4816.5, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 444017664. Throughput: 0: 9698.8. Samples: 888036116. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:53,989][27935] Avg episode reward: [(0, '1.135')] [2022-07-13 20:12:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444042240. Throughput: 0: 9703.3. Samples: 888094204. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:12:58,989][27935] Avg episode reward: [(0, '1.345')] [2022-07-13 20:13:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 444064768. Throughput: 0: 9607.2. Samples: 888148120. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:03,989][27935] Avg episode reward: [(0, '1.169')] [2022-07-13 20:13:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4761.6, 300 sec: 4804.1). Total num frames: 444087296. Throughput: 0: 9606.1. Samples: 888177332. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:08,989][27935] Avg episode reward: [(0, '0.711')] [2022-07-13 20:13:13,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4829.9, 300 sec: 4811.1). Total num frames: 444112896. Throughput: 0: 9593.5. Samples: 888235384. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:13,989][27935] Avg episode reward: [(0, '1.147')] [2022-07-13 20:13:18,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 444137472. Throughput: 0: 9579.5. Samples: 888293064. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:18,989][27935] Avg episode reward: [(0, '1.379')] [2022-07-13 20:13:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 444161024. Throughput: 0: 9578.2. Samples: 888322288. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:23,989][27935] Avg episode reward: [(0, '1.840')] [2022-07-13 20:13:28,996][27935] Fps is (10 sec: 4809.5, 60 sec: 4829.3, 300 sec: 4811.0). Total num frames: 444185600. Throughput: 0: 9590.2. Samples: 888380408. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:28,996][27935] Avg episode reward: [(0, '2.132')] [2022-07-13 20:13:33,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4811.1). Total num frames: 444209152. Throughput: 0: 9583.5. Samples: 888438352. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:33,989][27935] Avg episode reward: [(0, '1.773')] [2022-07-13 20:13:38,989][27935] Fps is (10 sec: 4918.6, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 444234752. Throughput: 0: 9592.1. Samples: 888467760. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:38,989][27935] Avg episode reward: [(0, '2.295')] [2022-07-13 20:13:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4813.4, 300 sec: 4811.1). Total num frames: 444258304. Throughput: 0: 9605.6. Samples: 888526456. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:43,989][27935] Avg episode reward: [(0, '2.121')] [2022-07-13 20:13:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4811.1). Total num frames: 444282880. Throughput: 0: 9708.6. Samples: 888585008. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:48,989][27935] Avg episode reward: [(0, '1.063')] [2022-07-13 20:13:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 444308480. Throughput: 0: 9716.7. Samples: 888614584. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:53,989][27935] Avg episode reward: [(0, '0.978')] [2022-07-13 20:13:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444332032. Throughput: 0: 9730.2. Samples: 888673244. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:13:58,989][27935] Avg episode reward: [(0, '0.597')] [2022-07-13 20:14:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 444354560. Throughput: 0: 9672.5. Samples: 888728328. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:14:03,989][27935] Avg episode reward: [(0, '0.231')] [2022-07-13 20:14:08,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4864.0, 300 sec: 4821.5). Total num frames: 444379136. Throughput: 0: 9666.9. Samples: 888757300. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:14:08,989][27935] Avg episode reward: [(0, '-1.036')] [2022-07-13 20:14:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 444403712. Throughput: 0: 9680.5. Samples: 888815964. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:14:13,989][27935] Avg episode reward: [(0, '-1.364')] [2022-07-13 20:14:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 444427264. Throughput: 0: 9691.4. Samples: 888874464. Policy #0 lag: (min: 0.0, avg: 8.5, max: 18.0) [2022-07-13 20:14:18,989][27935] Avg episode reward: [(0, '-1.176')] [2022-07-13 20:14:23,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4814.5). Total num frames: 444450816. Throughput: 0: 9686.0. Samples: 888903628. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:23,989][27935] Avg episode reward: [(0, '-0.427')] [2022-07-13 20:14:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4847.5, 300 sec: 4824.9). Total num frames: 444476416. Throughput: 0: 9678.7. Samples: 888961996. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:28,989][27935] Avg episode reward: [(0, '-0.266')] [2022-07-13 20:14:33,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4864.0, 300 sec: 4818.0). Total num frames: 444500992. Throughput: 0: 9676.3. Samples: 889020440. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:33,989][27935] Avg episode reward: [(0, '0.372')] [2022-07-13 20:14:38,990][27935] Fps is (10 sec: 4914.6, 60 sec: 4846.8, 300 sec: 4821.5). Total num frames: 444525568. Throughput: 0: 9671.6. Samples: 889049820. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:38,991][27935] Avg episode reward: [(0, '0.524')] [2022-07-13 20:14:43,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4814.5). Total num frames: 444549120. Throughput: 0: 9672.3. Samples: 889108500. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:43,989][27935] Avg episode reward: [(0, '1.532')] [2022-07-13 20:14:48,989][27935] Fps is (10 sec: 4813.4, 60 sec: 4846.9, 300 sec: 4818.0). Total num frames: 444573696. Throughput: 0: 9759.2. Samples: 889167492. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:48,989][27935] Avg episode reward: [(0, '1.479')] [2022-07-13 20:14:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444598272. Throughput: 0: 9752.0. Samples: 889196140. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:53,989][27935] Avg episode reward: [(0, '1.430')] [2022-07-13 20:14:59,008][27935] Fps is (10 sec: 4701.3, 60 sec: 4811.3, 300 sec: 4821.2). Total num frames: 444620800. Throughput: 0: 9718.4. Samples: 889253480. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:14:59,009][27935] Avg episode reward: [(0, '1.326')] [2022-07-13 20:15:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444644352. Throughput: 0: 9600.5. Samples: 889306488. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:03,989][27935] Avg episode reward: [(0, '1.283')] [2022-07-13 20:15:08,989][27935] Fps is (10 sec: 4719.5, 60 sec: 4812.8, 300 sec: 4814.5). Total num frames: 444667904. Throughput: 0: 9600.6. Samples: 889335656. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:08,989][27935] Avg episode reward: [(0, '0.623')] [2022-07-13 20:15:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 444692480. Throughput: 0: 9608.7. Samples: 889394388. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:13,990][27935] Avg episode reward: [(0, '1.174')] [2022-07-13 20:15:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 444717056. Throughput: 0: 9603.6. Samples: 889452604. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:18,991][27935] Avg episode reward: [(0, '0.989')] [2022-07-13 20:15:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4818.0). Total num frames: 444740608. Throughput: 0: 9602.9. Samples: 889481936. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:23,990][27935] Avg episode reward: [(0, '1.020')] [2022-07-13 20:15:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444766208. Throughput: 0: 9595.9. Samples: 889540316. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:28,992][27935] Avg episode reward: [(0, '1.141')] [2022-07-13 20:15:33,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 444789760. Throughput: 0: 9578.2. Samples: 889598512. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:33,989][27935] Avg episode reward: [(0, '1.137')] [2022-07-13 20:15:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.9, 300 sec: 4818.0). Total num frames: 444814336. Throughput: 0: 9590.7. Samples: 889627720. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:38,989][27935] Avg episode reward: [(0, '1.222')] [2022-07-13 20:15:43,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 444836864. Throughput: 0: 9618.0. Samples: 889686104. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:43,989][27935] Avg episode reward: [(0, '0.402')] [2022-07-13 20:15:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 444862464. Throughput: 0: 9736.1. Samples: 889744612. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:48,989][27935] Avg episode reward: [(0, '-0.119')] [2022-07-13 20:15:53,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 444887040. Throughput: 0: 9740.7. Samples: 889773988. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:53,989][27935] Avg episode reward: [(0, '-0.322')] [2022-07-13 20:15:58,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4848.5, 300 sec: 4831.9). Total num frames: 444911616. Throughput: 0: 9726.2. Samples: 889832068. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:15:58,989][27935] Avg episode reward: [(0, '-0.302')] [2022-07-13 20:16:03,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 444934144. Throughput: 0: 9640.5. Samples: 889886428. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:03,989][27935] Avg episode reward: [(0, '-0.194')] [2022-07-13 20:16:08,989][27935] Fps is (10 sec: 4505.6, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 444956672. Throughput: 0: 9627.9. Samples: 889915192. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:08,989][27935] Avg episode reward: [(0, '-0.286')] [2022-07-13 20:16:13,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 444981248. Throughput: 0: 9635.7. Samples: 889973924. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:13,989][27935] Avg episode reward: [(0, '-0.898')] [2022-07-13 20:16:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 445005824. Throughput: 0: 9644.6. Samples: 890032520. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:18,989][27935] Avg episode reward: [(0, '0.123')] [2022-07-13 20:16:23,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 445031424. Throughput: 0: 9636.7. Samples: 890061372. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:23,989][27935] Avg episode reward: [(0, '-0.150')] [2022-07-13 20:16:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4795.7, 300 sec: 4821.5). Total num frames: 445053952. Throughput: 0: 9630.9. Samples: 890119496. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:28,989][27935] Avg episode reward: [(0, '-0.397')] [2022-07-13 20:16:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4821.5). Total num frames: 445078528. Throughput: 0: 9625.7. Samples: 890177768. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:33,989][27935] Avg episode reward: [(0, '-0.527')] [2022-07-13 20:16:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4825.0). Total num frames: 445104128. Throughput: 0: 9623.3. Samples: 890207036. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:38,990][27935] Avg episode reward: [(0, '-0.806')] [2022-07-13 20:16:43,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4821.5). Total num frames: 445127680. Throughput: 0: 9637.0. Samples: 890265732. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:43,989][27935] Avg episode reward: [(0, '0.210')] [2022-07-13 20:16:48,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 445152256. Throughput: 0: 9728.8. Samples: 890324224. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:48,989][27935] Avg episode reward: [(0, '0.483')] [2022-07-13 20:16:53,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 445175808. Throughput: 0: 9742.8. Samples: 890353616. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:53,989][27935] Avg episode reward: [(0, '0.060')] [2022-07-13 20:16:58,996][27935] Fps is (10 sec: 4911.8, 60 sec: 4829.3, 300 sec: 4831.8). Total num frames: 445201408. Throughput: 0: 9736.7. Samples: 890412140. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:16:58,996][27935] Avg episode reward: [(0, '-0.629')] [2022-07-13 20:17:03,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 445223936. Throughput: 0: 9638.7. Samples: 890466260. Policy #0 lag: (min: 0.0, avg: 8.8, max: 21.0) [2022-07-13 20:17:03,989][27935] Avg episode reward: [(0, '-0.416')] [2022-07-13 20:17:08,989][27935] Fps is (10 sec: 4611.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 445247488. Throughput: 0: 9640.2. Samples: 890495180. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:08,989][27935] Avg episode reward: [(0, '-0.854')] [2022-07-13 20:17:13,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 445272064. Throughput: 0: 9646.0. Samples: 890553568. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:13,989][27935] Avg episode reward: [(0, '-0.560')] [2022-07-13 20:17:18,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4821.5). Total num frames: 445295616. Throughput: 0: 9644.3. Samples: 890611764. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:18,990][27935] Avg episode reward: [(0, '-0.626')] [2022-07-13 20:17:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 445320192. Throughput: 0: 9642.9. Samples: 890640968. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:23,989][27935] Avg episode reward: [(0, '-0.149')] [2022-07-13 20:17:28,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 445344768. Throughput: 0: 9639.4. Samples: 890699504. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:28,989][27935] Avg episode reward: [(0, '-0.104')] [2022-07-13 20:17:33,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4812.8, 300 sec: 4818.0). Total num frames: 445367296. Throughput: 0: 9631.2. Samples: 890757628. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:33,989][27935] Avg episode reward: [(0, '0.291')] [2022-07-13 20:17:38,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4846.9, 300 sec: 4832.0). Total num frames: 445394944. Throughput: 0: 9626.8. Samples: 890786820. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:38,989][27935] Avg episode reward: [(0, '-0.137')] [2022-07-13 20:17:43,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 445417472. Throughput: 0: 9608.3. Samples: 890844448. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:43,990][27935] Avg episode reward: [(0, '0.281')] [2022-07-13 20:17:48,989][27935] Fps is (10 sec: 4710.4, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 445442048. Throughput: 0: 9701.0. Samples: 890902804. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:48,989][27935] Avg episode reward: [(0, '0.407')] [2022-07-13 20:17:53,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4846.9, 300 sec: 4828.4). Total num frames: 445466624. Throughput: 0: 9709.0. Samples: 890932084. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:53,989][27935] Avg episode reward: [(0, '0.195')] [2022-07-13 20:17:58,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4813.3, 300 sec: 4831.9). Total num frames: 445490176. Throughput: 0: 9694.4. Samples: 890989816. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:17:58,989][27935] Avg episode reward: [(0, '-0.289')] [2022-07-13 20:18:03,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4831.9). Total num frames: 445512704. Throughput: 0: 9613.9. Samples: 891044388. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:03,989][27935] Avg episode reward: [(0, '0.607')] [2022-07-13 20:18:08,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4812.8, 300 sec: 4824.9). Total num frames: 445536256. Throughput: 0: 9615.2. Samples: 891073652. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:08,989][27935] Avg episode reward: [(0, '1.436')] [2022-07-13 20:18:13,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 445561856. Throughput: 0: 9611.6. Samples: 891132028. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:13,989][27935] Avg episode reward: [(0, '0.691')] [2022-07-13 20:18:18,989][27935] Fps is (10 sec: 4915.2, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 445585408. Throughput: 0: 9619.8. Samples: 891190520. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:18,989][27935] Avg episode reward: [(0, '0.720')] [2022-07-13 20:18:23,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4829.9, 300 sec: 4828.5). Total num frames: 445609984. Throughput: 0: 9630.3. Samples: 891220184. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:23,990][27935] Avg episode reward: [(0, '0.638')] [2022-07-13 20:18:28,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4812.8, 300 sec: 4828.4). Total num frames: 445633536. Throughput: 0: 9632.8. Samples: 891277924. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:28,989][27935] Avg episode reward: [(0, '0.761')] [2022-07-13 20:18:33,989][27935] Fps is (10 sec: 4812.7, 60 sec: 4846.9, 300 sec: 4824.9). Total num frames: 445658112. Throughput: 0: 9613.0. Samples: 891335392. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:33,990][27935] Avg episode reward: [(0, '0.224')] [2022-07-13 20:18:38,989][27935] Fps is (10 sec: 4812.8, 60 sec: 4778.7, 300 sec: 4824.9). Total num frames: 445681664. Throughput: 0: 9616.2. Samples: 891364812. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:38,989][27935] Avg episode reward: [(0, '-0.456')] [2022-07-13 20:18:43,989][27935] Fps is (10 sec: 4915.3, 60 sec: 4829.9, 300 sec: 4828.4). Total num frames: 445707264. Throughput: 0: 9633.2. Samples: 891423308. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:43,989][27935] Avg episode reward: [(0, '-1.106')] [2022-07-13 20:18:48,989][27935] Fps is (10 sec: 5017.6, 60 sec: 4829.9, 300 sec: 4824.9). Total num frames: 445731840. Throughput: 0: 9716.3. Samples: 891481620. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:48,989][27935] Avg episode reward: [(0, '-1.301')] [2022-07-13 20:18:53,989][27935] Fps is (10 sec: 4608.0, 60 sec: 4778.7, 300 sec: 4818.0). Total num frames: 445753344. Throughput: 0: 9658.1. Samples: 891508264. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:53,989][27935] Avg episode reward: [(0, '-1.128')] [2022-07-13 20:18:58,991][27935] Fps is (10 sec: 4606.9, 60 sec: 4795.5, 300 sec: 4824.9). Total num frames: 445777920. Throughput: 0: 9643.5. Samples: 891566008. Policy #0 lag: (min: 0.0, avg: 9.9, max: 21.0) [2022-07-13 20:18:58,992][27935] Avg episode reward: [(0, '-1.129')] [2022-07-13 20:19:00,257][27935] Keyboard interrupt detected in the event loop EvtLoop [Runner_EvtLoop, process=main process 27935], exiting... [2022-07-13 20:19:00,258][27935] Runner profile tree view: main_loop: 90102.8156 [2022-07-13 20:19:00,264][27935] Collected {0: 445784064}, FPS: 4947.5 [2022-07-13 21:33:25,804][07061] Experiment dir ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0 already exists! [2022-07-13 21:33:25,804][07061] Resuming existing experiment from ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0... [2022-07-13 21:33:25,804][07061] Saving configuration to ./train_dir/quad_single_baseline/baseline_/00_baseline_see_0/cfg.json... [2022-07-13 21:33:25,820][07061] Environment var CUDA_VISIBLE_DEVICES is 0 [2022-07-13 21:33:25,822][07061] Rollout worker 0 uses device cpu [2022-07-13 21:33:25,822][07061] Rollout worker 1 uses device cpu [2022-07-13 21:33:25,822][07061] Rollout worker 2 uses device cpu [2022-07-13 21:33:25,822][07061] Rollout worker 3 uses device cpu [2022-07-13 21:33:25,823][07061] Rollout worker 4 uses device cpu [2022-07-13 21:33:25,823][07061] Rollout worker 5 uses device cpu [2022-07-13 21:33:25,823][07061] Rollout worker 6 uses device cpu [2022-07-13 21:33:25,823][07061] Rollout worker 7 uses device cpu [2022-07-13 21:33:25,824][07061] Rollout worker 8 uses device cpu [2022-07-13 21:33:25,824][07061] Rollout worker 9 uses device cpu [2022-07-13 21:33:25,824][07061] Rollout worker 10 uses device cpu [2022-07-13 21:33:25,824][07061] Rollout worker 11 uses device cpu [2022-07-13 21:33:25,824][07061] Rollout worker 12 uses device cpu [2022-07-13 21:33:25,825][07061] Rollout worker 13 uses device cpu [2022-07-13 21:33:25,825][07061] Rollout worker 14 uses device cpu [2022-07-13 21:33:25,825][07061] Rollout worker 15 uses device cpu [2022-07-13 21:33:25,825][07061] Rollout worker 16 uses device cpu [2022-07-13 21:33:25,826][07061] Rollout worker 17 uses device cpu [2022-07-13 21:33:25,826][07061] Rollout worker 18 uses device cpu [2022-07-13 21:33:25,826][07061] Rollout worker 19 uses device cpu [2022-07-13 21:33:25,826][07061] Rollout worker 20 uses device cpu [2022-07-13 21:33:25,826][07061] Rollout worker 21 uses device cpu [2022-07-13 21:33:25,827][07061] Rollout worker 22 uses device cpu [2022-07-13 21:33:25,827][07061] Rollout worker 23 uses device cpu [2022-07-13 21:33:25,827][07061] Rollout worker 24 uses device cpu [2022-07-13 21:33:25,827][07061] Rollout worker 25 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 26 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 27 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 28 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 29 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 30 uses device cpu [2022-07-13 21:33:25,828][07061] Rollout worker 31 uses device cpu [2022-07-13 21:33:25,829][07061] Rollout worker 32 uses device cpu [2022-07-13 21:33:25,829][07061] Rollout worker 33 uses device cpu [2022-07-13 21:33:25,829][07061] Rollout worker 34 uses device cpu [2022-07-13 21:33:25,829][07061] Rollout worker 35 uses device cpu [2022-07-13 21:33:25,868][07061] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2022-07-13 21:33:25,869][07061] InferenceWorker_p0-w0: min num requests: 12 [2022-07-13 21:33:26,053][07061] Starting all processes... [2022-07-13 21:33:26,054][07061] Starting process learner_proc0 [2022-07-13 21:33:26,104][07061] Starting process inference_proc0-0 [2022-07-13 21:33:26,153][07061] Starting process rollout_proc0 [2022-07-13 21:33:26,207][07061] Starting process rollout_proc1 [2022-07-13 21:33:26,254][07061] Starting process rollout_proc2 [2022-07-13 21:33:26,309][07061] Starting process rollout_proc3 [2022-07-13 21:33:26,359][07061] Starting process rollout_proc4 [2022-07-13 21:33:26,414][07061] Starting process rollout_proc5 [2022-07-13 21:33:26,454][07061] Starting process rollout_proc6 [2022-07-13 21:33:26,504][07061] Starting process rollout_proc7 [2022-07-13 21:33:26,554][07061] Starting process rollout_proc8 [2022-07-13 21:33:26,604][07061] Starting process rollout_proc9 [2022-07-13 21:33:26,654][07061] Starting process rollout_proc10 [2022-07-13 21:33:26,704][07061] Starting process rollout_proc11 [2022-07-13 21:33:26,754][07061] Starting process rollout_proc12 [2022-07-13 21:33:26,804][07061] Starting process rollout_proc13 [2022-07-13 21:33:26,854][07061] Starting process rollout_proc14 [2022-07-13 21:33:26,903][07061] Starting process rollout_proc15 [2022-07-13 21:33:26,954][07061] Starting process rollout_proc16 [2022-07-13 21:33:27,004][07061] Starting process rollout_proc17 [2022-07-13 21:33:27,054][07061] Starting process rollout_proc18 [2022-07-13 21:33:27,104][07061] Starting process rollout_proc19 [2022-07-13 21:33:27,154][07061] Starting process rollout_proc20 [2022-07-13 21:33:27,204][07061] Starting process rollout_proc21 [2022-07-13 21:33:27,254][07061] Starting process rollout_proc22 [2022-07-13 21:33:27,304][07061] Starting process rollout_proc23 [2022-07-13 21:33:27,354][07061] Starting process rollout_proc24 [2022-07-13 21:33:27,404][07061] Starting process rollout_proc25 [2022-07-13 21:33:27,453][07061] Starting process rollout_proc26 [2022-07-13 21:33:27,504][07061] Starting process rollout_proc27 [2022-07-13 21:33:27,554][07061] Starting process rollout_proc28 [2022-07-13 21:33:27,604][07061] Starting process rollout_proc29 [2022-07-13 21:33:27,654][07061] Starting process rollout_proc30 [2022-07-13 21:33:27,704][07061] Starting process rollout_proc31 [2022-07-13 21:33:27,754][07061] Starting process rollout_proc32 [2022-07-13 21:33:27,813][07061] Starting process rollout_proc33 [2022-07-13 21:33:27,869][07061] Starting process rollout_proc34 [2022-07-13 21:33:27,915][07061] Starting process rollout_proc35 [2022-07-13 21:33:37,430][07061] Inference worker 0-0 is ready! [2022-07-13 21:33:37,431][07061] All inference workers are ready! Signal rollout workers to start! [2022-07-13 21:33:39,553][07061] Keyboard interrupt detected in the event loop EvtLoop [Runner_EvtLoop, process=main process 7061], exiting... [2022-07-13 21:33:39,555][07061] Runner profile tree view: main_loop: 13.5015 [2022-07-13 21:33:39,556][07061] Collected {}, FPS: 0.0