diff --git "a/sf_log.txt" "b/sf_log.txt" deleted file mode 100644--- "a/sf_log.txt" +++ /dev/null @@ -1,1321 +0,0 @@ -[2022-07-07 07:45:42,641][09926] Weights and Biases integration enabled. Project: sample_factory, user: None, group: None, unique_id: 17_mujoco_all_envs_see_4444_env_mujoco_halfcheetah_20220707_074542_640954 -[2022-07-07 07:45:43,579][09926] Initializing WandB... -[2022-07-07 07:45:44,712][09926] Environment var CUDA_VISIBLE_DEVICES is 0 -[2022-07-07 07:45:46,739][09926] Rollout worker 0 uses device cpu -[2022-07-07 07:45:46,740][09926] Rollout worker 1 uses device cpu -[2022-07-07 07:45:46,740][09926] Rollout worker 2 uses device cpu -[2022-07-07 07:45:46,741][09926] Rollout worker 3 uses device cpu -[2022-07-07 07:45:46,741][09926] Rollout worker 4 uses device cpu -[2022-07-07 07:45:46,741][09926] Rollout worker 5 uses device cpu -[2022-07-07 07:45:46,742][09926] Rollout worker 6 uses device cpu -[2022-07-07 07:45:46,742][09926] Rollout worker 7 uses device cpu -[2022-07-07 07:45:46,742][09926] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 -[2022-07-07 07:45:46,783][09926] Using GPUs [0] for process 0 (actually maps to GPUs [0]) -[2022-07-07 07:45:46,791][09926] InferenceWorker_p0-w0: min num requests: 2 -[2022-07-07 07:45:46,856][09926] Starting all processes... -[2022-07-07 07:45:46,856][09926] Starting process learner_proc0 -[2022-07-07 07:45:46,906][09926] Starting process inference_proc0-0 -[2022-07-07 07:45:46,956][09926] Starting process rollout_proc0 -[2022-07-07 07:45:47,006][09926] Starting process rollout_proc1 -[2022-07-07 07:45:47,056][09926] Starting process rollout_proc2 -[2022-07-07 07:45:47,106][09926] Starting process rollout_proc3 -[2022-07-07 07:45:47,156][09926] Starting process rollout_proc4 -[2022-07-07 07:45:47,206][09926] Starting process rollout_proc5 -[2022-07-07 07:45:47,256][09926] Starting process rollout_proc6 -[2022-07-07 07:45:47,306][09926] Starting process rollout_proc7 -[2022-07-07 07:45:58,543][09926] Inference worker 0-0 is ready! -[2022-07-07 07:45:58,543][09926] All inference workers are ready! Signal rollout workers to start! -[2022-07-07 07:46:14,712][09926] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 4096. Throughput: 0: nan. Samples: 8192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:46:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 20480. Throughput: 0: 6587.2. Samples: 41128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:46:19,712][09926] Avg episode reward: [(0, '-127.159')] -[2022-07-07 07:46:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 36864. Throughput: 0: 5348.0. Samples: 61672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:46:24,712][09926] Avg episode reward: [(0, '-270.262')] -[2022-07-07 07:46:29,714][09926] Fps is (10 sec: 2866.4, 60 sec: 3003.2, 300 sec: 3003.2). Total num frames: 49152. Throughput: 0: 5995.2. Samples: 98136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:46:29,715][09926] Avg episode reward: [(0, '-341.062')] -[2022-07-07 07:46:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3072.0). Total num frames: 65536. Throughput: 0: 6525.6. Samples: 138704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:46:34,712][09926] Avg episode reward: [(0, '-376.974')] -[2022-07-07 07:46:39,712][09926] Fps is (10 sec: 3687.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 86016. Throughput: 0: 6063.4. Samples: 159776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:46:39,712][09926] Avg episode reward: [(0, '-379.278')] -[2022-07-07 07:46:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3140.3). Total num frames: 98304. Throughput: 0: 6323.2. Samples: 197888. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:46:44,712][09926] Avg episode reward: [(0, '-398.004')] -[2022-07-07 07:46:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3159.8, 300 sec: 3159.8). Total num frames: 114688. Throughput: 0: 6531.7. Samples: 236800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:46:49,712][09926] Avg episode reward: [(0, '-419.883')] -[2022-07-07 07:46:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3174.4, 300 sec: 3174.4). Total num frames: 131072. Throughput: 0: 6145.8. Samples: 254024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:46:54,712][09926] Avg episode reward: [(0, '-423.209')] -[2022-07-07 07:46:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3185.8, 300 sec: 3185.8). Total num frames: 147456. Throughput: 0: 6371.6. Samples: 294912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:46:59,712][09926] Avg episode reward: [(0, '-414.904')] -[2022-07-07 07:47:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3194.9, 300 sec: 3194.9). Total num frames: 163840. Throughput: 0: 6542.6. Samples: 335544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:47:04,712][09926] Avg episode reward: [(0, '-357.034')] -[2022-07-07 07:47:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3202.3, 300 sec: 3202.3). Total num frames: 180224. Throughput: 0: 6473.6. Samples: 352984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:47:09,712][09926] Avg episode reward: [(0, '-294.691')] -[2022-07-07 07:47:14,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3208.4). Total num frames: 196608. Throughput: 0: 6445.8. Samples: 388200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:47:14,715][09926] Avg episode reward: [(0, '-252.005')] -[2022-07-07 07:47:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3213.8). Total num frames: 212992. Throughput: 0: 6392.9. Samples: 426384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:47:19,712][09926] Avg episode reward: [(0, '-248.863')] -[2022-07-07 07:47:24,712][09926] Fps is (10 sec: 3277.9, 60 sec: 3208.5, 300 sec: 3218.3). Total num frames: 229376. Throughput: 0: 6437.3. Samples: 449456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:47:24,712][09926] Avg episode reward: [(0, '-141.782')] -[2022-07-07 07:47:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.7, 300 sec: 3167.6). Total num frames: 241664. Throughput: 0: 6342.4. Samples: 483296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:47:29,712][09926] Avg episode reward: [(0, '-41.590')] -[2022-07-07 07:47:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 258048. Throughput: 0: 6271.5. Samples: 519016. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:47:34,712][09926] Avg episode reward: [(0, '8.861')] -[2022-07-07 07:47:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3180.4). Total num frames: 274432. Throughput: 0: 6368.7. Samples: 540616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:47:39,712][09926] Avg episode reward: [(0, '13.480')] -[2022-07-07 07:47:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3185.8). Total num frames: 290816. Throughput: 0: 6321.4. Samples: 579376. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:47:44,712][09926] Avg episode reward: [(0, '149.242')] -[2022-07-07 07:47:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3190.6). Total num frames: 307200. Throughput: 0: 6253.2. Samples: 616936. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:47:49,712][09926] Avg episode reward: [(0, '271.321')] -[2022-07-07 07:47:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3194.9). Total num frames: 323584. Throughput: 0: 6285.9. Samples: 635848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:47:54,712][09926] Avg episode reward: [(0, '328.816')] -[2022-07-07 07:47:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 335872. Throughput: 0: 6329.2. Samples: 672992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:47:59,712][09926] Avg episode reward: [(0, '334.679')] -[2022-07-07 07:48:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.1). Total num frames: 352256. Throughput: 0: 6347.2. Samples: 712008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:48:04,712][09926] Avg episode reward: [(0, '486.524')] -[2022-07-07 07:48:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3169.9). Total num frames: 368640. Throughput: 0: 6214.0. Samples: 729088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:48:09,712][09926] Avg episode reward: [(0, '615.272')] -[2022-07-07 07:48:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3174.4). Total num frames: 385024. Throughput: 0: 6374.4. Samples: 770144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:48:14,712][09926] Avg episode reward: [(0, '670.666')] -[2022-07-07 07:48:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3178.5). Total num frames: 401408. Throughput: 0: 6385.1. Samples: 806344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:48:19,712][09926] Avg episode reward: [(0, '674.751')] -[2022-07-07 07:48:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3182.3). Total num frames: 417792. Throughput: 0: 6372.3. Samples: 827368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:48:24,712][09926] Avg episode reward: [(0, '794.584')] -[2022-07-07 07:48:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3185.8). Total num frames: 434176. Throughput: 0: 6377.4. Samples: 866360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:48:29,712][09926] Avg episode reward: [(0, '866.700')] -[2022-07-07 07:48:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3189.0). Total num frames: 450560. Throughput: 0: 6317.3. Samples: 901216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:48:34,712][09926] Avg episode reward: [(0, '891.522')] -[2022-07-07 07:48:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3192.1). Total num frames: 466944. Throughput: 0: 6338.1. Samples: 921064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:48:39,712][09926] Avg episode reward: [(0, '894.191')] -[2022-07-07 07:48:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3167.6). Total num frames: 479232. Throughput: 0: 6346.8. Samples: 958600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:48:44,714][09926] Avg episode reward: [(0, '942.307')] -[2022-07-07 07:48:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3171.1). Total num frames: 495616. Throughput: 0: 6344.2. Samples: 997496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:48:49,714][09926] Avg episode reward: [(0, '972.617')] -[2022-07-07 07:48:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3174.4). Total num frames: 512000. Throughput: 0: 6357.2. Samples: 1015160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:48:54,712][09926] Avg episode reward: [(0, '986.080')] -[2022-07-07 07:48:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3177.5). Total num frames: 528384. Throughput: 0: 6262.0. Samples: 1051936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:48:59,712][09926] Avg episode reward: [(0, '986.080')] -[2022-07-07 07:49:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3156.3). Total num frames: 540672. Throughput: 0: 6251.4. Samples: 1087656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:49:04,712][09926] Avg episode reward: [(0, '1012.481')] -[2022-07-07 07:49:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 557056. Throughput: 0: 6186.0. Samples: 1105736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:09,712][09926] Avg episode reward: [(0, '1035.365')] -[2022-07-07 07:49:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3163.0). Total num frames: 573440. Throughput: 0: 6180.3. Samples: 1144472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:14,712][09926] Avg episode reward: [(0, '1045.016')] -[2022-07-07 07:49:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3166.1). Total num frames: 589824. Throughput: 0: 6242.8. Samples: 1182144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:49:19,712][09926] Avg episode reward: [(0, '1045.016')] -[2022-07-07 07:49:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3169.0). Total num frames: 606208. Throughput: 0: 6267.0. Samples: 1203080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:49:24,712][09926] Avg episode reward: [(0, '1053.155')] -[2022-07-07 07:49:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3171.8). Total num frames: 622592. Throughput: 0: 6256.0. Samples: 1240120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:29,712][09926] Avg episode reward: [(0, '1089.228')] -[2022-07-07 07:49:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3174.4). Total num frames: 638976. Throughput: 0: 6232.9. Samples: 1277976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:49:34,712][09926] Avg episode reward: [(0, '1112.224')] -[2022-07-07 07:49:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3176.9). Total num frames: 655360. Throughput: 0: 6315.9. Samples: 1299376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:49:39,712][09926] Avg episode reward: [(0, '1112.224')] -[2022-07-07 07:49:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 667648. Throughput: 0: 6305.2. Samples: 1335672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:49:44,712][09926] Avg episode reward: [(0, '1141.626')] -[2022-07-07 07:49:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3162.5). Total num frames: 684032. Throughput: 0: 6380.8. Samples: 1374792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:49,712][09926] Avg episode reward: [(0, '1185.958')] -[2022-07-07 07:49:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.1). Total num frames: 700416. Throughput: 0: 6384.4. Samples: 1393032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:54,712][09926] Avg episode reward: [(0, '1192.505')] -[2022-07-07 07:49:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3167.6). Total num frames: 716800. Throughput: 0: 6375.3. Samples: 1431360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:49:59,712][09926] Avg episode reward: [(0, '1192.505')] -[2022-07-07 07:50:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3169.9). Total num frames: 733184. Throughput: 0: 6365.3. Samples: 1468584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:50:04,712][09926] Avg episode reward: [(0, '1206.900')] -[2022-07-07 07:50:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3172.2). Total num frames: 749568. Throughput: 0: 6368.2. Samples: 1489648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:50:09,712][09926] Avg episode reward: [(0, '1223.751')] -[2022-07-07 07:50:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 765952. Throughput: 0: 6394.1. Samples: 1527856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:50:14,712][09926] Avg episode reward: [(0, '1233.115')] -[2022-07-07 07:50:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3159.8). Total num frames: 778240. Throughput: 0: 6369.6. Samples: 1564608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:50:19,712][09926] Avg episode reward: [(0, '1233.115')] -[2022-07-07 07:50:24,716][09926] Fps is (10 sec: 2866.0, 60 sec: 3140.0, 300 sec: 3162.1). Total num frames: 794624. Throughput: 0: 6328.5. Samples: 1584184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:50:24,716][09926] Avg episode reward: [(0, '1242.114')] -[2022-07-07 07:50:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3180.4). Total num frames: 815104. Throughput: 0: 6437.7. Samples: 1625368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:50:29,712][09926] Avg episode reward: [(0, '1261.049')] -[2022-07-07 07:50:34,712][09926] Fps is (10 sec: 3688.0, 60 sec: 3208.5, 300 sec: 3182.3). Total num frames: 831488. Throughput: 0: 6404.1. Samples: 1662976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:50:34,712][09926] Avg episode reward: [(0, '1258.980')] -[2022-07-07 07:50:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3168.6). Total num frames: 843776. Throughput: 0: 6419.0. Samples: 1681888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:50:39,712][09926] Avg episode reward: [(0, '1258.980')] -[2022-07-07 07:50:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3170.6). Total num frames: 860160. Throughput: 0: 6421.0. Samples: 1720304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:50:44,712][09926] Avg episode reward: [(0, '1248.485')] -[2022-07-07 07:50:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3172.5). Total num frames: 876544. Throughput: 0: 6416.0. Samples: 1757304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:50:49,712][09926] Avg episode reward: [(0, '1226.883')] -[2022-07-07 07:50:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3174.4). Total num frames: 892928. Throughput: 0: 6388.8. Samples: 1777144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:50:54,712][09926] Avg episode reward: [(0, '1228.290')] -[2022-07-07 07:50:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3176.2). Total num frames: 909312. Throughput: 0: 6405.7. Samples: 1816112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:50:59,712][09926] Avg episode reward: [(0, '1228.290')] -[2022-07-07 07:51:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3177.9). Total num frames: 925696. Throughput: 0: 6379.4. Samples: 1851680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:51:04,712][09926] Avg episode reward: [(0, '1221.969')] -[2022-07-07 07:51:09,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3179.6). Total num frames: 942080. Throughput: 0: 6442.6. Samples: 1874096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:51:09,716][09926] Avg episode reward: [(0, '1181.091')] -[2022-07-07 07:51:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 958464. Throughput: 0: 6395.0. Samples: 1913144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:14,712][09926] Avg episode reward: [(0, '1159.573')] -[2022-07-07 07:51:19,712][09926] Fps is (10 sec: 2868.1, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 970752. Throughput: 0: 6370.8. Samples: 1949664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:19,712][09926] Avg episode reward: [(0, '1159.573')] -[2022-07-07 07:51:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.8, 300 sec: 3179.6). Total num frames: 987136. Throughput: 0: 6318.6. Samples: 1966224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:24,712][09926] Avg episode reward: [(0, '1167.085')] -[2022-07-07 07:51:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1003520. Throughput: 0: 6369.6. Samples: 2006936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:29,713][09926] Avg episode reward: [(0, '1145.262')] -[2022-07-07 07:51:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1019904. Throughput: 0: 6318.8. Samples: 2041648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:34,712][09926] Avg episode reward: [(0, '1190.733')] -[2022-07-07 07:51:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1036288. Throughput: 0: 6355.0. Samples: 2063120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:39,712][09926] Avg episode reward: [(0, '1190.733')] -[2022-07-07 07:51:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1052672. Throughput: 0: 6319.6. Samples: 2100496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:44,712][09926] Avg episode reward: [(0, '1207.811')] -[2022-07-07 07:51:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1064960. Throughput: 0: 6365.1. Samples: 2138112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:49,712][09926] Avg episode reward: [(0, '1243.228')] -[2022-07-07 07:51:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1081344. Throughput: 0: 6270.5. Samples: 2156248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:54,712][09926] Avg episode reward: [(0, '1274.231')] -[2022-07-07 07:51:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1097728. Throughput: 0: 6268.3. Samples: 2195216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:51:59,712][09926] Avg episode reward: [(0, '1274.231')] -[2022-07-07 07:52:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1114112. Throughput: 0: 6234.5. Samples: 2230216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:52:04,712][09926] Avg episode reward: [(0, '1282.859')] -[2022-07-07 07:52:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3165.8). Total num frames: 1130496. Throughput: 0: 6338.5. Samples: 2251456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:52:09,712][09926] Avg episode reward: [(0, '1309.095')] -[2022-07-07 07:52:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3151.8). Total num frames: 1142784. Throughput: 0: 6191.8. Samples: 2285568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:52:14,712][09926] Avg episode reward: [(0, '1319.554')] -[2022-07-07 07:52:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3151.8). Total num frames: 1159168. Throughput: 0: 6298.5. Samples: 2325080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:52:19,712][09926] Avg episode reward: [(0, '1339.892')] -[2022-07-07 07:52:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1175552. Throughput: 0: 6217.6. Samples: 2342912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:52:24,712][09926] Avg episode reward: [(0, '1328.359')] -[2022-07-07 07:52:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1191936. Throughput: 0: 6258.1. Samples: 2382112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:52:29,712][09926] Avg episode reward: [(0, '1312.318')] -[2022-07-07 07:52:34,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3140.1, 300 sec: 3165.7). Total num frames: 1208320. Throughput: 0: 6291.5. Samples: 2421248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:52:34,715][09926] Avg episode reward: [(0, '1325.930')] -[2022-07-07 07:52:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1224704. Throughput: 0: 6332.6. Samples: 2441216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:52:39,714][09926] Avg episode reward: [(0, '1304.338')] -[2022-07-07 07:52:44,712][09926] Fps is (10 sec: 3277.8, 60 sec: 3140.3, 300 sec: 3165.7). Total num frames: 1241088. Throughput: 0: 6326.8. Samples: 2479920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:52:44,712][09926] Avg episode reward: [(0, '1304.485')] -[2022-07-07 07:52:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 1257472. Throughput: 0: 6468.3. Samples: 2521288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:52:49,712][09926] Avg episode reward: [(0, '1284.700')] -[2022-07-07 07:52:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1273856. Throughput: 0: 6401.4. Samples: 2539520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:52:54,712][09926] Avg episode reward: [(0, '1259.888')] -[2022-07-07 07:52:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1290240. Throughput: 0: 6538.8. Samples: 2579816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:52:59,712][09926] Avg episode reward: [(0, '1259.888')] -[2022-07-07 07:53:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1306624. Throughput: 0: 6446.2. Samples: 2615160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:53:04,712][09926] Avg episode reward: [(0, '1256.839')] -[2022-07-07 07:53:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1323008. Throughput: 0: 6504.5. Samples: 2635616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:53:09,712][09926] Avg episode reward: [(0, '1288.256')] -[2022-07-07 07:53:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1339392. Throughput: 0: 6509.7. Samples: 2675048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:53:14,712][09926] Avg episode reward: [(0, '1277.011')] -[2022-07-07 07:53:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1355776. Throughput: 0: 6476.2. Samples: 2712656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:19,712][09926] Avg episode reward: [(0, '1277.011')] -[2022-07-07 07:53:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3179.6). Total num frames: 1372160. Throughput: 0: 6491.0. Samples: 2733312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:24,712][09926] Avg episode reward: [(0, '1316.851')] -[2022-07-07 07:53:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3165.7). Total num frames: 1384448. Throughput: 0: 6421.3. Samples: 2768880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:29,712][09926] Avg episode reward: [(0, '1365.248')] -[2022-07-07 07:53:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.7, 300 sec: 3165.7). Total num frames: 1400832. Throughput: 0: 6411.7. Samples: 2809816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:34,712][09926] Avg episode reward: [(0, '1364.404')] -[2022-07-07 07:53:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1417216. Throughput: 0: 6371.6. Samples: 2826240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:39,712][09926] Avg episode reward: [(0, '1364.404')] -[2022-07-07 07:53:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1433600. Throughput: 0: 6386.3. Samples: 2867200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:44,712][09926] Avg episode reward: [(0, '1366.581')] -[2022-07-07 07:53:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1449984. Throughput: 0: 6440.4. Samples: 2904976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:53:49,712][09926] Avg episode reward: [(0, '1384.536')] -[2022-07-07 07:53:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1466368. Throughput: 0: 6387.7. Samples: 2923064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:54,712][09926] Avg episode reward: [(0, '1399.773')] -[2022-07-07 07:53:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1482752. Throughput: 0: 6440.9. Samples: 2964888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:53:59,712][09926] Avg episode reward: [(0, '1399.773')] -[2022-07-07 07:54:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1495040. Throughput: 0: 6342.2. Samples: 2998056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:04,712][09926] Avg episode reward: [(0, '1403.267')] -[2022-07-07 07:54:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1515520. Throughput: 0: 6298.7. Samples: 3016752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:09,712][09926] Avg episode reward: [(0, '1407.229')] -[2022-07-07 07:54:14,712][09926] Fps is (10 sec: 3686.3, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1531904. Throughput: 0: 6376.7. Samples: 3055832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:14,712][09926] Avg episode reward: [(0, '1409.399')] -[2022-07-07 07:54:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1544192. Throughput: 0: 6372.4. Samples: 3096576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:19,712][09926] Avg episode reward: [(0, '1409.399')] -[2022-07-07 07:54:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1560576. Throughput: 0: 6376.5. Samples: 3113184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:24,712][09926] Avg episode reward: [(0, '1406.963')] -[2022-07-07 07:54:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1576960. Throughput: 0: 6365.3. Samples: 3153640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:29,712][09926] Avg episode reward: [(0, '1400.681')] -[2022-07-07 07:54:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1593344. Throughput: 0: 6334.6. Samples: 3190032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:34,712][09926] Avg episode reward: [(0, '1407.442')] -[2022-07-07 07:54:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1609728. Throughput: 0: 6325.5. Samples: 3207712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:39,712][09926] Avg episode reward: [(0, '1409.298')] -[2022-07-07 07:54:44,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1626112. Throughput: 0: 6286.4. Samples: 3247784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:44,713][09926] Avg episode reward: [(0, '1421.487')] -[2022-07-07 07:54:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1642496. Throughput: 0: 6458.8. Samples: 3288704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:49,717][09926] Avg episode reward: [(0, '1482.391')] -[2022-07-07 07:54:54,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1658880. Throughput: 0: 6507.0. Samples: 3309568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:54:54,712][09926] Avg episode reward: [(0, '1553.495')] -[2022-07-07 07:54:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1675264. Throughput: 0: 6523.7. Samples: 3349400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:54:59,712][09926] Avg episode reward: [(0, '1553.495')] -[2022-07-07 07:55:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1687552. Throughput: 0: 6366.0. Samples: 3383048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:55:04,712][09926] Avg episode reward: [(0, '1614.307')] -[2022-07-07 07:55:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3179.6). Total num frames: 1703936. Throughput: 0: 6366.6. Samples: 3399680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:55:09,712][09926] Avg episode reward: [(0, '1733.226')] -[2022-07-07 07:55:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3193.5). Total num frames: 1720320. Throughput: 0: 6377.8. Samples: 3440640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:55:14,712][09926] Avg episode reward: [(0, '1826.627')] -[2022-07-07 07:55:19,714][09926] Fps is (10 sec: 3276.0, 60 sec: 3208.4, 300 sec: 3193.5). Total num frames: 1736704. Throughput: 0: 6461.9. Samples: 3480832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:19,715][09926] Avg episode reward: [(0, '1826.627')] -[2022-07-07 07:55:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1753088. Throughput: 0: 6450.5. Samples: 3497984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:24,712][09926] Avg episode reward: [(0, '1865.951')] -[2022-07-07 07:55:29,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3179.6). Total num frames: 1769472. Throughput: 0: 6490.4. Samples: 3539848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:29,713][09926] Avg episode reward: [(0, '1893.893')] -[2022-07-07 07:55:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1785856. Throughput: 0: 6456.0. Samples: 3579224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:34,712][09926] Avg episode reward: [(0, '1921.158')] -[2022-07-07 07:55:39,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1802240. Throughput: 0: 6394.3. Samples: 3597312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:39,712][09926] Avg episode reward: [(0, '1921.158')] -[2022-07-07 07:55:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3193.5). Total num frames: 1818624. Throughput: 0: 6411.6. Samples: 3637920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:44,712][09926] Avg episode reward: [(0, '1917.912')] -[2022-07-07 07:55:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1835008. Throughput: 0: 6533.0. Samples: 3677032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:55:49,712][09926] Avg episode reward: [(0, '1896.086')] -[2022-07-07 07:55:54,712][09926] Fps is (10 sec: 3276.6, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1851392. Throughput: 0: 6549.1. Samples: 3694392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 07:55:54,713][09926] Avg episode reward: [(0, '1918.603')] -[2022-07-07 07:55:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1867776. Throughput: 0: 6477.5. Samples: 3732128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:55:59,712][09926] Avg episode reward: [(0, '1918.603')] -[2022-07-07 07:56:04,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 1884160. Throughput: 0: 6416.9. Samples: 3769576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:56:04,712][09926] Avg episode reward: [(0, '1979.654')] -[2022-07-07 07:56:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 1900544. Throughput: 0: 6555.6. Samples: 3792984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:56:09,712][09926] Avg episode reward: [(0, '2052.129')] -[2022-07-07 07:56:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 1916928. Throughput: 0: 6422.7. Samples: 3828864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:56:14,712][09926] Avg episode reward: [(0, '2109.561')] -[2022-07-07 07:56:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3207.4). Total num frames: 1933312. Throughput: 0: 6453.0. Samples: 3869608. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:56:19,712][09926] Avg episode reward: [(0, '2109.561')] -[2022-07-07 07:56:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 1949696. Throughput: 0: 6493.9. Samples: 3889536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 07:56:24,712][09926] Avg episode reward: [(0, '2189.108')] -[2022-07-07 07:56:29,712][09926] Fps is (10 sec: 2867.0, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1961984. Throughput: 0: 6393.5. Samples: 3925632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:56:29,713][09926] Avg episode reward: [(0, '2169.786')] -[2022-07-07 07:56:34,714][09926] Fps is (10 sec: 3276.2, 60 sec: 3276.7, 300 sec: 3207.4). Total num frames: 1982464. Throughput: 0: 6397.4. Samples: 3964928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:56:34,714][09926] Avg episode reward: [(0, '2185.426')] -[2022-07-07 07:56:39,712][09926] Fps is (10 sec: 3277.1, 60 sec: 3208.5, 300 sec: 3193.5). Total num frames: 1994752. Throughput: 0: 6421.6. Samples: 3983360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:56:39,712][09926] Avg episode reward: [(0, '2185.426')] -[2022-07-07 07:56:44,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2011136. Throughput: 0: 6428.4. Samples: 4021408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:56:44,715][09926] Avg episode reward: [(0, '2166.232')] -[2022-07-07 07:56:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2027520. Throughput: 0: 6457.6. Samples: 4060168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:56:49,712][09926] Avg episode reward: [(0, '2152.587')] -[2022-07-07 07:56:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 2043904. Throughput: 0: 6368.0. Samples: 4079544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:56:54,712][09926] Avg episode reward: [(0, '2222.259')] -[2022-07-07 07:56:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2060288. Throughput: 0: 6399.6. Samples: 4116848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:56:59,712][09926] Avg episode reward: [(0, '2222.259')] -[2022-07-07 07:57:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3193.5). Total num frames: 2072576. Throughput: 0: 6261.2. Samples: 4151360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 07:57:04,712][09926] Avg episode reward: [(0, '2273.575')] -[2022-07-07 07:57:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 2088960. Throughput: 0: 6239.3. Samples: 4170304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:57:09,712][09926] Avg episode reward: [(0, '2384.982')] -[2022-07-07 07:57:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 2105344. Throughput: 0: 6329.7. Samples: 4210464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 07:57:14,712][09926] Avg episode reward: [(0, '2527.387')] -[2022-07-07 07:57:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2125824. Throughput: 0: 6372.2. Samples: 4251664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:19,712][09926] Avg episode reward: [(0, '2527.387')] -[2022-07-07 07:57:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2142208. Throughput: 0: 6405.9. Samples: 4271624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:24,712][09926] Avg episode reward: [(0, '2542.666')] -[2022-07-07 07:57:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 2154496. Throughput: 0: 6398.4. Samples: 4309336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:29,712][09926] Avg episode reward: [(0, '2571.030')] -[2022-07-07 07:57:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3221.3). Total num frames: 2174976. Throughput: 0: 6443.2. Samples: 4350112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:34,712][09926] Avg episode reward: [(0, '2629.861')] -[2022-07-07 07:57:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2191360. Throughput: 0: 6530.3. Samples: 4373408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:57:39,712][09926] Avg episode reward: [(0, '2629.861')] -[2022-07-07 07:57:44,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2207744. Throughput: 0: 6557.0. Samples: 4411912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 07:57:44,712][09926] Avg episode reward: [(0, '2674.727')] -[2022-07-07 07:57:49,714][09926] Fps is (10 sec: 3276.0, 60 sec: 3276.7, 300 sec: 3221.2). Total num frames: 2224128. Throughput: 0: 6615.1. Samples: 4449056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:49,715][09926] Avg episode reward: [(0, '2768.788')] -[2022-07-07 07:57:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2236416. Throughput: 0: 6570.7. Samples: 4465984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:54,712][09926] Avg episode reward: [(0, '2777.952')] -[2022-07-07 07:57:59,712][09926] Fps is (10 sec: 2867.9, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2252800. Throughput: 0: 6557.2. Samples: 4505536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:57:59,712][09926] Avg episode reward: [(0, '2777.952')] -[2022-07-07 07:58:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2269184. Throughput: 0: 6473.1. Samples: 4542952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:58:04,712][09926] Avg episode reward: [(0, '2884.286')] -[2022-07-07 07:58:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2285568. Throughput: 0: 6462.1. Samples: 4562416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 07:58:09,712][09926] Avg episode reward: [(0, '2917.984')] -[2022-07-07 07:58:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 2301952. Throughput: 0: 6475.9. Samples: 4600752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:14,712][09926] Avg episode reward: [(0, '2940.701')] -[2022-07-07 07:58:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 2318336. Throughput: 0: 6453.9. Samples: 4640536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:19,712][09926] Avg episode reward: [(0, '2940.701')] -[2022-07-07 07:58:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2334720. Throughput: 0: 6389.3. Samples: 4660928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:24,712][09926] Avg episode reward: [(0, '2905.895')] -[2022-07-07 07:58:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2351104. Throughput: 0: 6413.5. Samples: 4700520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:29,712][09926] Avg episode reward: [(0, '2985.320')] -[2022-07-07 07:58:34,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2367488. Throughput: 0: 6433.7. Samples: 4738560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:34,713][09926] Avg episode reward: [(0, '3036.966')] -[2022-07-07 07:58:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2383872. Throughput: 0: 6568.4. Samples: 4761560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:39,712][09926] Avg episode reward: [(0, '3025.838')] -[2022-07-07 07:58:44,712][09926] Fps is (10 sec: 3686.5, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2404352. Throughput: 0: 6652.3. Samples: 4804888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:58:44,712][09926] Avg episode reward: [(0, '3052.658')] -[2022-07-07 07:58:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.9, 300 sec: 3235.1). Total num frames: 2420736. Throughput: 0: 6680.9. Samples: 4843592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:58:49,712][09926] Avg episode reward: [(0, '3111.968')] -[2022-07-07 07:58:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 2437120. Throughput: 0: 6696.5. Samples: 4863760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 07:58:54,712][09926] Avg episode reward: [(0, '3071.508')] -[2022-07-07 07:58:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2449408. Throughput: 0: 6623.3. Samples: 4898800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:58:59,712][09926] Avg episode reward: [(0, '3053.973')] -[2022-07-07 07:59:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2465792. Throughput: 0: 6602.1. Samples: 4937632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:04,712][09926] Avg episode reward: [(0, '3037.092')] -[2022-07-07 07:59:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 2482176. Throughput: 0: 6542.8. Samples: 4955352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:09,712][09926] Avg episode reward: [(0, '2951.886')] -[2022-07-07 07:59:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2498560. Throughput: 0: 6507.9. Samples: 4993376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:14,712][09926] Avg episode reward: [(0, '2821.094')] -[2022-07-07 07:59:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2514944. Throughput: 0: 6557.0. Samples: 5033624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:19,712][09926] Avg episode reward: [(0, '2804.327')] -[2022-07-07 07:59:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2531328. Throughput: 0: 6511.8. Samples: 5054592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:24,712][09926] Avg episode reward: [(0, '2797.090')] -[2022-07-07 07:59:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2547712. Throughput: 0: 6452.8. Samples: 5095264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:29,712][09926] Avg episode reward: [(0, '2807.660')] -[2022-07-07 07:59:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 2564096. Throughput: 0: 6500.1. Samples: 5136096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:34,712][09926] Avg episode reward: [(0, '2805.146')] -[2022-07-07 07:59:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 2580480. Throughput: 0: 6422.4. Samples: 5152768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:39,712][09926] Avg episode reward: [(0, '2793.289')] -[2022-07-07 07:59:44,712][09926] Fps is (10 sec: 3686.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2600960. Throughput: 0: 6555.8. Samples: 5193816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:44,713][09926] Avg episode reward: [(0, '2798.242')] -[2022-07-07 07:59:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2613248. Throughput: 0: 6594.3. Samples: 5234376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:49,712][09926] Avg episode reward: [(0, '2837.579')] -[2022-07-07 07:59:54,712][09926] Fps is (10 sec: 2867.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2629632. Throughput: 0: 6676.6. Samples: 5255800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:54,712][09926] Avg episode reward: [(0, '2856.917')] -[2022-07-07 07:59:59,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 2650112. Throughput: 0: 6636.8. Samples: 5292032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 07:59:59,712][09926] Avg episode reward: [(0, '2856.083')] -[2022-07-07 08:00:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2662400. Throughput: 0: 6522.3. Samples: 5327128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:04,712][09926] Avg episode reward: [(0, '2912.815')] -[2022-07-07 08:00:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2678784. Throughput: 0: 6549.0. Samples: 5349296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:00:09,712][09926] Avg episode reward: [(0, '3009.434')] -[2022-07-07 08:00:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.1). Total num frames: 2695168. Throughput: 0: 6476.4. Samples: 5386704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:00:14,712][09926] Avg episode reward: [(0, '3028.752')] -[2022-07-07 08:00:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2711552. Throughput: 0: 6452.3. Samples: 5426448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:00:19,712][09926] Avg episode reward: [(0, '3019.864')] -[2022-07-07 08:00:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 2727936. Throughput: 0: 6492.8. Samples: 5444944. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:00:24,712][09926] Avg episode reward: [(0, '3012.728')] -[2022-07-07 08:00:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2740224. Throughput: 0: 6388.3. Samples: 5481288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:29,712][09926] Avg episode reward: [(0, '3073.894')] -[2022-07-07 08:00:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2756608. Throughput: 0: 6313.2. Samples: 5518472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:34,712][09926] Avg episode reward: [(0, '3010.053')] -[2022-07-07 08:00:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2772992. Throughput: 0: 6265.1. Samples: 5537728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:39,712][09926] Avg episode reward: [(0, '3040.293')] -[2022-07-07 08:00:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 2789376. Throughput: 0: 6280.7. Samples: 5574664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:44,712][09926] Avg episode reward: [(0, '3206.639')] -[2022-07-07 08:00:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 2805760. Throughput: 0: 6398.2. Samples: 5615048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:49,712][09926] Avg episode reward: [(0, '3169.442')] -[2022-07-07 08:00:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2822144. Throughput: 0: 6366.9. Samples: 5635808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:54,712][09926] Avg episode reward: [(0, '3162.519')] -[2022-07-07 08:00:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 2838528. Throughput: 0: 6440.9. Samples: 5676544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:00:59,712][09926] Avg episode reward: [(0, '3160.732')] -[2022-07-07 08:01:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2854912. Throughput: 0: 6412.4. Samples: 5715008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:04,712][09926] Avg episode reward: [(0, '3082.625')] -[2022-07-07 08:01:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2871296. Throughput: 0: 6413.3. Samples: 5733544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:01:09,712][09926] Avg episode reward: [(0, '2935.539')] -[2022-07-07 08:01:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2887680. Throughput: 0: 6463.3. Samples: 5772136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:01:14,712][09926] Avg episode reward: [(0, '2958.615')] -[2022-07-07 08:01:19,715][09926] Fps is (10 sec: 3275.8, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 2904064. Throughput: 0: 6436.4. Samples: 5808128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:01:19,715][09926] Avg episode reward: [(0, '2925.511')] -[2022-07-07 08:01:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3235.2). Total num frames: 2916352. Throughput: 0: 6403.2. Samples: 5825872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:01:24,712][09926] Avg episode reward: [(0, '3061.791')] -[2022-07-07 08:01:29,712][09926] Fps is (10 sec: 2868.1, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 2932736. Throughput: 0: 6461.3. Samples: 5865424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:29,712][09926] Avg episode reward: [(0, '3185.954')] -[2022-07-07 08:01:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2949120. Throughput: 0: 6452.5. Samples: 5905408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:34,712][09926] Avg episode reward: [(0, '3283.296')] -[2022-07-07 08:01:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2965504. Throughput: 0: 6380.8. Samples: 5922944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:39,712][09926] Avg episode reward: [(0, '3355.551')] -[2022-07-07 08:01:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2981888. Throughput: 0: 6384.0. Samples: 5963824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:44,712][09926] Avg episode reward: [(0, '3428.324')] -[2022-07-07 08:01:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 2998272. Throughput: 0: 6334.2. Samples: 6000048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:01:49,712][09926] Avg episode reward: [(0, '3410.071')] -[2022-07-07 08:01:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3014656. Throughput: 0: 6385.1. Samples: 6020872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:01:54,712][09926] Avg episode reward: [(0, '3448.130')] -[2022-07-07 08:01:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3031040. Throughput: 0: 6391.5. Samples: 6059752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:01:59,712][09926] Avg episode reward: [(0, '3434.415')] -[2022-07-07 08:02:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3047424. Throughput: 0: 6388.2. Samples: 6095576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:02:04,712][09926] Avg episode reward: [(0, '3444.490')] -[2022-07-07 08:02:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3063808. Throughput: 0: 6502.0. Samples: 6118464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:09,712][09926] Avg episode reward: [(0, '3426.665')] -[2022-07-07 08:02:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3080192. Throughput: 0: 6501.0. Samples: 6157968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:14,712][09926] Avg episode reward: [(0, '3454.908')] -[2022-07-07 08:02:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3235.1). Total num frames: 3096576. Throughput: 0: 6556.4. Samples: 6200448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:19,712][09926] Avg episode reward: [(0, '3421.213')] -[2022-07-07 08:02:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3112960. Throughput: 0: 6541.7. Samples: 6217320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:02:24,712][09926] Avg episode reward: [(0, '3388.544')] -[2022-07-07 08:02:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3129344. Throughput: 0: 6520.0. Samples: 6257224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:02:29,712][09926] Avg episode reward: [(0, '3481.270')] -[2022-07-07 08:02:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3145728. Throughput: 0: 6571.2. Samples: 6295752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:34,712][09926] Avg episode reward: [(0, '3488.326')] -[2022-07-07 08:02:39,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3235.1). Total num frames: 3162112. Throughput: 0: 6544.5. Samples: 6315384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:39,714][09926] Avg episode reward: [(0, '3420.230')] -[2022-07-07 08:02:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 3178496. Throughput: 0: 6523.2. Samples: 6353296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:02:44,712][09926] Avg episode reward: [(0, '3391.266')] -[2022-07-07 08:02:49,719][09926] Fps is (10 sec: 3275.0, 60 sec: 3276.4, 300 sec: 3249.0). Total num frames: 3194880. Throughput: 0: 6541.9. Samples: 6390008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:02:49,719][09926] Avg episode reward: [(0, '3324.977')] -[2022-07-07 08:02:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3211264. Throughput: 0: 6479.6. Samples: 6410048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:02:54,712][09926] Avg episode reward: [(0, '3341.757')] -[2022-07-07 08:02:59,712][09926] Fps is (10 sec: 2869.3, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3223552. Throughput: 0: 6423.1. Samples: 6447008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:02:59,712][09926] Avg episode reward: [(0, '3315.896')] -[2022-07-07 08:03:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3239936. Throughput: 0: 6304.2. Samples: 6484136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:03:04,712][09926] Avg episode reward: [(0, '3187.343')] -[2022-07-07 08:03:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3256320. Throughput: 0: 6380.1. Samples: 6504424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:03:09,712][09926] Avg episode reward: [(0, '3058.505')] -[2022-07-07 08:03:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3272704. Throughput: 0: 6402.8. Samples: 6545352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:14,712][09926] Avg episode reward: [(0, '3101.345')] -[2022-07-07 08:03:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3289088. Throughput: 0: 6415.5. Samples: 6584448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:19,712][09926] Avg episode reward: [(0, '3143.766')] -[2022-07-07 08:03:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3309568. Throughput: 0: 6463.0. Samples: 6606208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:03:24,712][09926] Avg episode reward: [(0, '3229.067')] -[2022-07-07 08:03:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3325952. Throughput: 0: 6549.0. Samples: 6648000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:03:29,712][09926] Avg episode reward: [(0, '3360.153')] -[2022-07-07 08:03:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3342336. Throughput: 0: 6604.4. Samples: 6687160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:03:34,712][09926] Avg episode reward: [(0, '3360.153')] -[2022-07-07 08:03:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3235.1). Total num frames: 3358720. Throughput: 0: 6597.2. Samples: 6706920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:39,712][09926] Avg episode reward: [(0, '3464.986')] -[2022-07-07 08:03:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3375104. Throughput: 0: 6654.0. Samples: 6746440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:44,712][09926] Avg episode reward: [(0, '3453.302')] -[2022-07-07 08:03:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.2, 300 sec: 3235.1). Total num frames: 3391488. Throughput: 0: 6640.9. Samples: 6782976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:49,712][09926] Avg episode reward: [(0, '3508.677')] -[2022-07-07 08:03:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3407872. Throughput: 0: 6731.0. Samples: 6807320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:54,715][09926] Avg episode reward: [(0, '3508.677')] -[2022-07-07 08:03:59,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3345.0, 300 sec: 3249.0). Total num frames: 3424256. Throughput: 0: 6609.3. Samples: 6842784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:03:59,714][09926] Avg episode reward: [(0, '3379.095')] -[2022-07-07 08:04:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 3440640. Throughput: 0: 6596.3. Samples: 6881280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:04:04,712][09926] Avg episode reward: [(0, '3357.317')] -[2022-07-07 08:04:09,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3452928. Throughput: 0: 6488.2. Samples: 6898176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:09,712][09926] Avg episode reward: [(0, '3317.019')] -[2022-07-07 08:04:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3469312. Throughput: 0: 6462.1. Samples: 6938792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:14,712][09926] Avg episode reward: [(0, '3317.019')] -[2022-07-07 08:04:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3485696. Throughput: 0: 6487.5. Samples: 6979096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:19,712][09926] Avg episode reward: [(0, '3387.132')] -[2022-07-07 08:04:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3506176. Throughput: 0: 6490.8. Samples: 6999008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:04:24,712][09926] Avg episode reward: [(0, '3335.014')] -[2022-07-07 08:04:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3518464. Throughput: 0: 6453.3. Samples: 7036840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:04:29,712][09926] Avg episode reward: [(0, '3383.555')] -[2022-07-07 08:04:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3534848. Throughput: 0: 6552.9. Samples: 7077856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:04:34,712][09926] Avg episode reward: [(0, '3379.497')] -[2022-07-07 08:04:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 3555328. Throughput: 0: 6390.8. Samples: 7094904. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:04:39,712][09926] Avg episode reward: [(0, '3133.689')] -[2022-07-07 08:04:44,713][09926] Fps is (10 sec: 3685.9, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 3571712. Throughput: 0: 6535.7. Samples: 7136888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:04:44,714][09926] Avg episode reward: [(0, '2997.437')] -[2022-07-07 08:04:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3588096. Throughput: 0: 6554.0. Samples: 7176208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:49,712][09926] Avg episode reward: [(0, '2929.782')] -[2022-07-07 08:04:54,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3604480. Throughput: 0: 6643.0. Samples: 7197112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:54,712][09926] Avg episode reward: [(0, '2940.727')] -[2022-07-07 08:04:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3249.0). Total num frames: 3620864. Throughput: 0: 6618.1. Samples: 7236608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:04:59,712][09926] Avg episode reward: [(0, '2772.626')] -[2022-07-07 08:05:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3633152. Throughput: 0: 6564.1. Samples: 7274480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:04,712][09926] Avg episode reward: [(0, '2727.437')] -[2022-07-07 08:05:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3649536. Throughput: 0: 6486.0. Samples: 7290880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:09,712][09926] Avg episode reward: [(0, '2651.717')] -[2022-07-07 08:05:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 3665920. Throughput: 0: 6555.4. Samples: 7331832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:14,712][09926] Avg episode reward: [(0, '2658.327')] -[2022-07-07 08:05:19,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3276.7, 300 sec: 3235.1). Total num frames: 3682304. Throughput: 0: 6539.8. Samples: 7372160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:05:19,715][09926] Avg episode reward: [(0, '2619.302')] -[2022-07-07 08:05:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3698688. Throughput: 0: 6541.7. Samples: 7389280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:05:24,712][09926] Avg episode reward: [(0, '2588.950')] -[2022-07-07 08:05:29,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3715072. Throughput: 0: 6467.2. Samples: 7427904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:05:29,714][09926] Avg episode reward: [(0, '2665.252')] -[2022-07-07 08:05:34,714][09926] Fps is (10 sec: 3275.9, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 3731456. Throughput: 0: 6460.6. Samples: 7466952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:05:34,717][09926] Avg episode reward: [(0, '2677.917')] -[2022-07-07 08:05:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3747840. Throughput: 0: 6448.9. Samples: 7487312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:05:39,712][09926] Avg episode reward: [(0, '2756.583')] -[2022-07-07 08:05:44,712][09926] Fps is (10 sec: 3277.6, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 3764224. Throughput: 0: 6404.3. Samples: 7524800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:44,712][09926] Avg episode reward: [(0, '2885.510')] -[2022-07-07 08:05:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3780608. Throughput: 0: 6401.2. Samples: 7562536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:49,712][09926] Avg episode reward: [(0, '3046.476')] -[2022-07-07 08:05:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3796992. Throughput: 0: 6532.1. Samples: 7584824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:54,712][09926] Avg episode reward: [(0, '3092.953')] -[2022-07-07 08:05:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3813376. Throughput: 0: 6550.4. Samples: 7626600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:05:59,712][09926] Avg episode reward: [(0, '3155.357')] -[2022-07-07 08:06:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 3829760. Throughput: 0: 6394.0. Samples: 7659880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:06:04,712][09926] Avg episode reward: [(0, '3278.021')] -[2022-07-07 08:06:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 3842048. Throughput: 0: 6456.0. Samples: 7679800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:06:09,712][09926] Avg episode reward: [(0, '3361.209')] -[2022-07-07 08:06:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 3858432. Throughput: 0: 6421.3. Samples: 7716864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:14,712][09926] Avg episode reward: [(0, '3360.855')] -[2022-07-07 08:06:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.9, 300 sec: 3262.9). Total num frames: 3878912. Throughput: 0: 6477.2. Samples: 7758408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:19,712][09926] Avg episode reward: [(0, '3411.856')] -[2022-07-07 08:06:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3891200. Throughput: 0: 6469.3. Samples: 7778432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:24,712][09926] Avg episode reward: [(0, '3553.605')] -[2022-07-07 08:06:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3907584. Throughput: 0: 6444.1. Samples: 7814784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:29,712][09926] Avg episode reward: [(0, '3665.413')] -[2022-07-07 08:06:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3249.0). Total num frames: 3923968. Throughput: 0: 6515.4. Samples: 7855728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:34,712][09926] Avg episode reward: [(0, '3696.698')] -[2022-07-07 08:06:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3940352. Throughput: 0: 6470.2. Samples: 7875984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:39,712][09926] Avg episode reward: [(0, '3818.343')] -[2022-07-07 08:06:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 3956736. Throughput: 0: 6374.0. Samples: 7913432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:44,712][09926] Avg episode reward: [(0, '3789.959')] -[2022-07-07 08:06:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 3977216. Throughput: 0: 6545.6. Samples: 7954432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:06:49,712][09926] Avg episode reward: [(0, '3798.467')] -[2022-07-07 08:06:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 3993600. Throughput: 0: 6603.0. Samples: 7976936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:06:54,712][09926] Avg episode reward: [(0, '3849.691')] -[2022-07-07 08:06:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 4009984. Throughput: 0: 6665.8. Samples: 8016824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:06:59,712][09926] Avg episode reward: [(0, '3902.609')] -[2022-07-07 08:07:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4022272. Throughput: 0: 6515.2. Samples: 8051592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:07:04,712][09926] Avg episode reward: [(0, '4037.559')] -[2022-07-07 08:07:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4038656. Throughput: 0: 6497.4. Samples: 8070816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:07:09,712][09926] Avg episode reward: [(0, '4076.505')] -[2022-07-07 08:07:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4055040. Throughput: 0: 6557.2. Samples: 8109856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:07:14,712][09926] Avg episode reward: [(0, '4072.742')] -[2022-07-07 08:07:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4071424. Throughput: 0: 6483.9. Samples: 8147504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:07:19,715][09926] Avg episode reward: [(0, '4115.044')] -[2022-07-07 08:07:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4087808. Throughput: 0: 6463.1. Samples: 8166824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:07:24,712][09926] Avg episode reward: [(0, '4198.754')] -[2022-07-07 08:07:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4104192. Throughput: 0: 6450.7. Samples: 8203712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:07:29,712][09926] Avg episode reward: [(0, '4109.580')] -[2022-07-07 08:07:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4120576. Throughput: 0: 6371.6. Samples: 8241152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:07:34,712][09926] Avg episode reward: [(0, '4044.156')] -[2022-07-07 08:07:39,724][09926] Fps is (10 sec: 3272.9, 60 sec: 3276.2, 300 sec: 3248.9). Total num frames: 4136960. Throughput: 0: 6324.2. Samples: 8261600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:07:39,724][09926] Avg episode reward: [(0, '3994.249')] -[2022-07-07 08:07:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.1). Total num frames: 4153344. Throughput: 0: 6290.8. Samples: 8299912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:07:44,712][09926] Avg episode reward: [(0, '4005.152')] -[2022-07-07 08:07:49,713][09926] Fps is (10 sec: 3280.3, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4169728. Throughput: 0: 6431.7. Samples: 8341024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:07:49,713][09926] Avg episode reward: [(0, '3993.523')] -[2022-07-07 08:07:54,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3208.4, 300 sec: 3262.9). Total num frames: 4186112. Throughput: 0: 6460.0. Samples: 8361528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:07:54,714][09926] Avg episode reward: [(0, '4011.995')] -[2022-07-07 08:07:59,712][09926] Fps is (10 sec: 2867.5, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 4198400. Throughput: 0: 6360.7. Samples: 8396088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:07:59,712][09926] Avg episode reward: [(0, '3809.234')] -[2022-07-07 08:08:04,712][09926] Fps is (10 sec: 2867.7, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4214784. Throughput: 0: 6423.5. Samples: 8436560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:04,712][09926] Avg episode reward: [(0, '3841.221')] -[2022-07-07 08:08:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4231168. Throughput: 0: 6387.0. Samples: 8454240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:09,712][09926] Avg episode reward: [(0, '3839.237')] -[2022-07-07 08:08:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 4247552. Throughput: 0: 6452.1. Samples: 8494056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:14,712][09926] Avg episode reward: [(0, '3781.191')] -[2022-07-07 08:08:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4263936. Throughput: 0: 6463.5. Samples: 8532008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:19,712][09926] Avg episode reward: [(0, '3753.913')] -[2022-07-07 08:08:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4280320. Throughput: 0: 6455.4. Samples: 8552016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:24,712][09926] Avg episode reward: [(0, '3635.079')] -[2022-07-07 08:08:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4296704. Throughput: 0: 6443.4. Samples: 8589864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:29,712][09926] Avg episode reward: [(0, '3702.552')] -[2022-07-07 08:08:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4313088. Throughput: 0: 6339.7. Samples: 8626304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:34,712][09926] Avg episode reward: [(0, '3685.377')] -[2022-07-07 08:08:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.9, 300 sec: 3221.3). Total num frames: 4325376. Throughput: 0: 6281.0. Samples: 8644160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:39,712][09926] Avg episode reward: [(0, '3659.527')] -[2022-07-07 08:08:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4341760. Throughput: 0: 6384.2. Samples: 8683376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:44,712][09926] Avg episode reward: [(0, '3635.638')] -[2022-07-07 08:08:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4358144. Throughput: 0: 6396.6. Samples: 8724408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:49,712][09926] Avg episode reward: [(0, '3619.276')] -[2022-07-07 08:08:54,712][09926] Fps is (10 sec: 3686.2, 60 sec: 3208.6, 300 sec: 3235.2). Total num frames: 4378624. Throughput: 0: 6453.1. Samples: 8744632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:54,713][09926] Avg episode reward: [(0, '3626.780')] -[2022-07-07 08:08:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4390912. Throughput: 0: 6420.8. Samples: 8782992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:08:59,712][09926] Avg episode reward: [(0, '3599.012')] -[2022-07-07 08:09:04,712][09926] Fps is (10 sec: 2867.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4407296. Throughput: 0: 6402.1. Samples: 8820104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:04,712][09926] Avg episode reward: [(0, '3592.507')] -[2022-07-07 08:09:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4423680. Throughput: 0: 6381.5. Samples: 8839184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:09,712][09926] Avg episode reward: [(0, '3611.379')] -[2022-07-07 08:09:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4440064. Throughput: 0: 6450.3. Samples: 8880128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:09:14,712][09926] Avg episode reward: [(0, '3701.991')] -[2022-07-07 08:09:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4456448. Throughput: 0: 6506.8. Samples: 8919112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:09:19,712][09926] Avg episode reward: [(0, '3746.121')] -[2022-07-07 08:09:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4476928. Throughput: 0: 6572.4. Samples: 8939920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:09:24,712][09926] Avg episode reward: [(0, '3995.305')] -[2022-07-07 08:09:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 4493312. Throughput: 0: 6556.8. Samples: 8978432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:29,712][09926] Avg episode reward: [(0, '3995.305')] -[2022-07-07 08:09:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4505600. Throughput: 0: 6553.9. Samples: 9019336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:34,712][09926] Avg episode reward: [(0, '4084.525')] -[2022-07-07 08:09:39,712][09926] Fps is (10 sec: 2867.0, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4521984. Throughput: 0: 6522.6. Samples: 9038152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:39,713][09926] Avg episode reward: [(0, '4270.550')] -[2022-07-07 08:09:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4538368. Throughput: 0: 6527.3. Samples: 9076720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:44,712][09926] Avg episode reward: [(0, '4296.666')] -[2022-07-07 08:09:49,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4554752. Throughput: 0: 6589.9. Samples: 9116648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:49,712][09926] Avg episode reward: [(0, '4296.666')] -[2022-07-07 08:09:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4575232. Throughput: 0: 6555.6. Samples: 9134184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:54,712][09926] Avg episode reward: [(0, '4316.270')] -[2022-07-07 08:09:59,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 4591616. Throughput: 0: 6556.5. Samples: 9175168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:09:59,712][09926] Avg episode reward: [(0, '4250.031')] -[2022-07-07 08:10:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4603904. Throughput: 0: 6499.2. Samples: 9211576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:04,712][09926] Avg episode reward: [(0, '4324.836')] -[2022-07-07 08:10:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4620288. Throughput: 0: 6439.3. Samples: 9229688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:09,712][09926] Avg episode reward: [(0, '4324.836')] -[2022-07-07 08:10:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 4636672. Throughput: 0: 6465.4. Samples: 9269376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:14,712][09926] Avg episode reward: [(0, '4294.059')] -[2022-07-07 08:10:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4653056. Throughput: 0: 6409.4. Samples: 9307760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:10:19,712][09926] Avg episode reward: [(0, '4396.046')] -[2022-07-07 08:10:24,714][09926] Fps is (10 sec: 3275.9, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 4669440. Throughput: 0: 6441.5. Samples: 9328032. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:10:24,715][09926] Avg episode reward: [(0, '4328.177')] -[2022-07-07 08:10:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 4685824. Throughput: 0: 6410.5. Samples: 9365192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:10:29,712][09926] Avg episode reward: [(0, '4328.177')] -[2022-07-07 08:10:34,712][09926] Fps is (10 sec: 2868.0, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4698112. Throughput: 0: 6378.7. Samples: 9403688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:34,715][09926] Avg episode reward: [(0, '4260.898')] -[2022-07-07 08:10:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3221.3). Total num frames: 4714496. Throughput: 0: 6364.4. Samples: 9420584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:39,712][09926] Avg episode reward: [(0, '4086.247')] -[2022-07-07 08:10:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4730880. Throughput: 0: 6319.1. Samples: 9459528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:44,712][09926] Avg episode reward: [(0, '4005.048')] -[2022-07-07 08:10:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4747264. Throughput: 0: 6366.2. Samples: 9498056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:10:49,712][09926] Avg episode reward: [(0, '4056.226')] -[2022-07-07 08:10:54,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3140.2, 300 sec: 3221.2). Total num frames: 4763648. Throughput: 0: 6421.8. Samples: 9518680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:10:54,714][09926] Avg episode reward: [(0, '4024.050')] -[2022-07-07 08:10:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4780032. Throughput: 0: 6358.8. Samples: 9555520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:10:59,712][09926] Avg episode reward: [(0, '4041.981')] -[2022-07-07 08:11:04,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 4796416. Throughput: 0: 6335.3. Samples: 9592848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:11:04,712][09926] Avg episode reward: [(0, '4214.688')] -[2022-07-07 08:11:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4808704. Throughput: 0: 6289.5. Samples: 9611040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:11:09,712][09926] Avg episode reward: [(0, '4214.688')] -[2022-07-07 08:11:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 4825088. Throughput: 0: 6368.4. Samples: 9651768. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:11:14,712][09926] Avg episode reward: [(0, '4211.070')] -[2022-07-07 08:11:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4841472. Throughput: 0: 6387.0. Samples: 9691104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:11:19,712][09926] Avg episode reward: [(0, '4419.044')] -[2022-07-07 08:11:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3221.3). Total num frames: 4857856. Throughput: 0: 6452.8. Samples: 9710960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:24,712][09926] Avg episode reward: [(0, '4531.451')] -[2022-07-07 08:11:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 4874240. Throughput: 0: 6424.0. Samples: 9748608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:29,712][09926] Avg episode reward: [(0, '4531.451')] -[2022-07-07 08:11:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4894720. Throughput: 0: 6493.7. Samples: 9790272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:34,712][09926] Avg episode reward: [(0, '4513.376')] -[2022-07-07 08:11:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 4911104. Throughput: 0: 6508.0. Samples: 9811528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:39,712][09926] Avg episode reward: [(0, '4647.389')] -[2022-07-07 08:11:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4927488. Throughput: 0: 6647.3. Samples: 9854648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:44,712][09926] Avg episode reward: [(0, '4728.263')] -[2022-07-07 08:11:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 4943872. Throughput: 0: 6583.6. Samples: 9889112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:49,712][09926] Avg episode reward: [(0, '4728.263')] -[2022-07-07 08:11:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3207.4). Total num frames: 4956160. Throughput: 0: 6608.7. Samples: 9908432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:11:54,712][09926] Avg episode reward: [(0, '4563.064')] -[2022-07-07 08:11:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4972544. Throughput: 0: 6547.4. Samples: 9946400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:11:59,712][09926] Avg episode reward: [(0, '4636.918')] -[2022-07-07 08:12:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 4988928. Throughput: 0: 6494.2. Samples: 9983344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:12:04,712][09926] Avg episode reward: [(0, '4550.645')] -[2022-07-07 08:12:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 5005312. Throughput: 0: 6507.6. Samples: 10003800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:12:09,712][09926] Avg episode reward: [(0, '4550.645')] -[2022-07-07 08:12:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5025792. Throughput: 0: 6550.7. Samples: 10043392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:14,712][09926] Avg episode reward: [(0, '4525.030')] -[2022-07-07 08:12:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5042176. Throughput: 0: 6545.4. Samples: 10084816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:19,712][09926] Avg episode reward: [(0, '4446.263')] -[2022-07-07 08:12:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5058560. Throughput: 0: 6564.4. Samples: 10106928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:24,712][09926] Avg episode reward: [(0, '4480.940')] -[2022-07-07 08:12:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 5074944. Throughput: 0: 6441.4. Samples: 10144512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:29,712][09926] Avg episode reward: [(0, '4515.700')] -[2022-07-07 08:12:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.3). Total num frames: 5091328. Throughput: 0: 6567.6. Samples: 10184656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:34,712][09926] Avg episode reward: [(0, '4575.983')] -[2022-07-07 08:12:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 5107712. Throughput: 0: 6582.7. Samples: 10204656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:39,712][09926] Avg episode reward: [(0, '4685.050')] -[2022-07-07 08:12:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 5124096. Throughput: 0: 6605.7. Samples: 10243656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:44,712][09926] Avg episode reward: [(0, '4661.412')] -[2022-07-07 08:12:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.2). Total num frames: 5140480. Throughput: 0: 6693.5. Samples: 10284552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:49,712][09926] Avg episode reward: [(0, '4655.472')] -[2022-07-07 08:12:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5156864. Throughput: 0: 6664.7. Samples: 10303712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:54,712][09926] Avg episode reward: [(0, '4541.417')] -[2022-07-07 08:12:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5173248. Throughput: 0: 6667.6. Samples: 10343432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:12:59,712][09926] Avg episode reward: [(0, '4350.814')] -[2022-07-07 08:13:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5189632. Throughput: 0: 6598.6. Samples: 10381752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:04,712][09926] Avg episode reward: [(0, '4368.936')] -[2022-07-07 08:13:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 5206016. Throughput: 0: 6553.2. Samples: 10401824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:09,712][09926] Avg episode reward: [(0, '4325.053')] -[2022-07-07 08:13:14,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 5222400. Throughput: 0: 6560.1. Samples: 10439728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:14,714][09926] Avg episode reward: [(0, '4216.850')] -[2022-07-07 08:13:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5238784. Throughput: 0: 6600.9. Samples: 10481696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:19,712][09926] Avg episode reward: [(0, '4379.386')] -[2022-07-07 08:13:24,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5255168. Throughput: 0: 6577.8. Samples: 10500656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:24,712][09926] Avg episode reward: [(0, '4350.081')] -[2022-07-07 08:13:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5271552. Throughput: 0: 6582.0. Samples: 10539848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:29,712][09926] Avg episode reward: [(0, '4355.058')] -[2022-07-07 08:13:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5287936. Throughput: 0: 6486.2. Samples: 10576432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:34,712][09926] Avg episode reward: [(0, '4503.853')] -[2022-07-07 08:13:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5304320. Throughput: 0: 6549.9. Samples: 10598456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:39,712][09926] Avg episode reward: [(0, '4538.290')] -[2022-07-07 08:13:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5320704. Throughput: 0: 6552.4. Samples: 10638288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:44,712][09926] Avg episode reward: [(0, '4594.152')] -[2022-07-07 08:13:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5337088. Throughput: 0: 6593.6. Samples: 10678464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:49,712][09926] Avg episode reward: [(0, '4600.127')] -[2022-07-07 08:13:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5353472. Throughput: 0: 6597.3. Samples: 10698704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:13:54,712][09926] Avg episode reward: [(0, '4520.980')] -[2022-07-07 08:13:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 5369856. Throughput: 0: 6664.6. Samples: 10739624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:13:59,712][09926] Avg episode reward: [(0, '4585.778')] -[2022-07-07 08:14:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 5382144. Throughput: 0: 6461.5. Samples: 10772464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:14:04,715][09926] Avg episode reward: [(0, '4585.778')] -[2022-07-07 08:14:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 5398528. Throughput: 0: 6435.9. Samples: 10790272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:14:09,712][09926] Avg episode reward: [(0, '4469.712')] -[2022-07-07 08:14:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 5414912. Throughput: 0: 6522.0. Samples: 10833336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:14:14,712][09926] Avg episode reward: [(0, '4457.107')] -[2022-07-07 08:14:19,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 5435392. Throughput: 0: 6703.1. Samples: 10878072. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:14:19,712][09926] Avg episode reward: [(0, '4275.853')] -[2022-07-07 08:14:24,712][09926] Fps is (10 sec: 4096.0, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 5455872. Throughput: 0: 6779.9. Samples: 10903552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:14:24,712][09926] Avg episode reward: [(0, '4262.772')] -[2022-07-07 08:14:29,712][09926] Fps is (10 sec: 4096.0, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5476352. Throughput: 0: 6941.2. Samples: 10950640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:14:29,712][09926] Avg episode reward: [(0, '4402.264')] -[2022-07-07 08:14:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5492736. Throughput: 0: 7003.7. Samples: 10993632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:14:34,712][09926] Avg episode reward: [(0, '4362.426')] -[2022-07-07 08:14:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 5505024. Throughput: 0: 6918.8. Samples: 11010048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:14:39,712][09926] Avg episode reward: [(0, '4399.322')] -[2022-07-07 08:14:44,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5525504. Throughput: 0: 6740.8. Samples: 11042960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:14:44,712][09926] Avg episode reward: [(0, '4399.672')] -[2022-07-07 08:14:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3276.8). Total num frames: 5541888. Throughput: 0: 6939.4. Samples: 11084736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:14:49,712][09926] Avg episode reward: [(0, '4464.543')] -[2022-07-07 08:14:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 5554176. Throughput: 0: 6947.7. Samples: 11102920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:14:54,712][09926] Avg episode reward: [(0, '4491.925')] -[2022-07-07 08:14:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 5570560. Throughput: 0: 6839.6. Samples: 11141120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:14:59,712][09926] Avg episode reward: [(0, '4404.198')] -[2022-07-07 08:15:04,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5591040. Throughput: 0: 6756.6. Samples: 11182120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:15:04,712][09926] Avg episode reward: [(0, '4410.222')] -[2022-07-07 08:15:09,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5607424. Throughput: 0: 6736.7. Samples: 11206704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:15:09,712][09926] Avg episode reward: [(0, '4682.402')] -[2022-07-07 08:15:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3481.6, 300 sec: 3290.7). Total num frames: 5623808. Throughput: 0: 6596.4. Samples: 11247480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:14,712][09926] Avg episode reward: [(0, '4772.848')] -[2022-07-07 08:15:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3290.7). Total num frames: 5640192. Throughput: 0: 6539.7. Samples: 11287920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:19,712][09926] Avg episode reward: [(0, '4767.889')] -[2022-07-07 08:15:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3304.6). Total num frames: 5660672. Throughput: 0: 6632.0. Samples: 11308488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:24,712][09926] Avg episode reward: [(0, '4820.096')] -[2022-07-07 08:15:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 5672960. Throughput: 0: 6796.3. Samples: 11348792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:29,712][09926] Avg episode reward: [(0, '4938.170')] -[2022-07-07 08:15:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 5689344. Throughput: 0: 6712.9. Samples: 11386816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:34,712][09926] Avg episode reward: [(0, '4870.900')] -[2022-07-07 08:15:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3304.6). Total num frames: 5705728. Throughput: 0: 6725.7. Samples: 11405576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:39,712][09926] Avg episode reward: [(0, '4870.900')] -[2022-07-07 08:15:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5726208. Throughput: 0: 6755.6. Samples: 11445120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:15:44,714][09926] Avg episode reward: [(0, '4837.010')] -[2022-07-07 08:15:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5742592. Throughput: 0: 6747.9. Samples: 11485776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:15:49,712][09926] Avg episode reward: [(0, '4779.043')] -[2022-07-07 08:15:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3318.5). Total num frames: 5758976. Throughput: 0: 6680.0. Samples: 11507304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:15:54,712][09926] Avg episode reward: [(0, '4681.414')] -[2022-07-07 08:15:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3318.5). Total num frames: 5775360. Throughput: 0: 6623.8. Samples: 11545552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:15:59,712][09926] Avg episode reward: [(0, '4681.414')] -[2022-07-07 08:16:04,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 5791744. Throughput: 0: 6568.2. Samples: 11583488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:16:04,712][09926] Avg episode reward: [(0, '4609.665')] -[2022-07-07 08:16:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5804032. Throughput: 0: 6553.2. Samples: 11603384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:16:09,712][09926] Avg episode reward: [(0, '4663.717')] -[2022-07-07 08:16:14,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5820416. Throughput: 0: 6483.7. Samples: 11640560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:16:14,712][09926] Avg episode reward: [(0, '4799.127')] -[2022-07-07 08:16:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3318.5). Total num frames: 5836800. Throughput: 0: 6550.6. Samples: 11681592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:16:19,712][09926] Avg episode reward: [(0, '4799.127')] -[2022-07-07 08:16:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 5857280. Throughput: 0: 6664.7. Samples: 11705488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:16:24,712][09926] Avg episode reward: [(0, '4892.102')] -[2022-07-07 08:16:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3318.5). Total num frames: 5873664. Throughput: 0: 6718.2. Samples: 11747440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:29,712][09926] Avg episode reward: [(0, '4918.404')] -[2022-07-07 08:16:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 5894144. Throughput: 0: 6722.5. Samples: 11788288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:34,712][09926] Avg episode reward: [(0, '5020.928')] -[2022-07-07 08:16:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 5910528. Throughput: 0: 6722.7. Samples: 11809824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:39,712][09926] Avg episode reward: [(0, '4982.167')] -[2022-07-07 08:16:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 5926912. Throughput: 0: 6767.1. Samples: 11850072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:44,712][09926] Avg episode reward: [(0, '5153.414')] -[2022-07-07 08:16:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5943296. Throughput: 0: 6746.3. Samples: 11887072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:49,712][09926] Avg episode reward: [(0, '5240.180')] -[2022-07-07 08:16:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5959680. Throughput: 0: 6737.8. Samples: 11906584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:54,712][09926] Avg episode reward: [(0, '5245.406')] -[2022-07-07 08:16:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5976064. Throughput: 0: 6858.5. Samples: 11949192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:16:59,712][09926] Avg episode reward: [(0, '5278.699')] -[2022-07-07 08:17:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3346.2). Total num frames: 5992448. Throughput: 0: 6833.8. Samples: 11989112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:04,712][09926] Avg episode reward: [(0, '5384.660')] -[2022-07-07 08:17:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6008832. Throughput: 0: 6755.2. Samples: 12009472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:09,712][09926] Avg episode reward: [(0, '5402.009')] -[2022-07-07 08:17:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6025216. Throughput: 0: 6649.8. Samples: 12046680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:14,715][09926] Avg episode reward: [(0, '5406.629')] -[2022-07-07 08:17:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3332.3). Total num frames: 6041600. Throughput: 0: 6581.5. Samples: 12084456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:19,712][09926] Avg episode reward: [(0, '5375.478')] -[2022-07-07 08:17:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 6057984. Throughput: 0: 6560.9. Samples: 12105064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:24,712][09926] Avg episode reward: [(0, '5350.613')] -[2022-07-07 08:17:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3332.3). Total num frames: 6074368. Throughput: 0: 6533.3. Samples: 12144072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:29,712][09926] Avg episode reward: [(0, '5274.295')] -[2022-07-07 08:17:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6090752. Throughput: 0: 6542.9. Samples: 12181504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:34,712][09926] Avg episode reward: [(0, '5321.073')] -[2022-07-07 08:17:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6107136. Throughput: 0: 6648.9. Samples: 12205784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:17:39,712][09926] Avg episode reward: [(0, '5246.399')] -[2022-07-07 08:17:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6123520. Throughput: 0: 6574.2. Samples: 12245032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:17:44,712][09926] Avg episode reward: [(0, '5137.116')] -[2022-07-07 08:17:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6139904. Throughput: 0: 6459.9. Samples: 12279808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:17:49,712][09926] Avg episode reward: [(0, '4934.078')] -[2022-07-07 08:17:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6156288. Throughput: 0: 6490.8. Samples: 12301560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:17:54,712][09926] Avg episode reward: [(0, '4934.078')] -[2022-07-07 08:17:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6172672. Throughput: 0: 6559.5. Samples: 12341856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:17:59,712][09926] Avg episode reward: [(0, '4972.252')] -[2022-07-07 08:18:04,717][09926] Fps is (10 sec: 3275.2, 60 sec: 3276.5, 300 sec: 3332.3). Total num frames: 6189056. Throughput: 0: 6601.4. Samples: 12381552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:18:04,717][09926] Avg episode reward: [(0, '4985.714')] -[2022-07-07 08:18:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.4). Total num frames: 6205440. Throughput: 0: 6572.8. Samples: 12400840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:18:09,712][09926] Avg episode reward: [(0, '4922.434')] -[2022-07-07 08:18:14,712][09926] Fps is (10 sec: 3278.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6221824. Throughput: 0: 6523.9. Samples: 12437648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:18:14,712][09926] Avg episode reward: [(0, '4922.434')] -[2022-07-07 08:18:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3318.5). Total num frames: 6234112. Throughput: 0: 6553.1. Samples: 12476392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:18:19,712][09926] Avg episode reward: [(0, '4990.713')] -[2022-07-07 08:18:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3318.5). Total num frames: 6250496. Throughput: 0: 6447.3. Samples: 12495912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:18:24,712][09926] Avg episode reward: [(0, '5112.321')] -[2022-07-07 08:18:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6270976. Throughput: 0: 6495.7. Samples: 12537336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:18:29,712][09926] Avg episode reward: [(0, '4947.511')] -[2022-07-07 08:18:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6287360. Throughput: 0: 6616.0. Samples: 12577528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:18:34,712][09926] Avg episode reward: [(0, '4947.511')] -[2022-07-07 08:18:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6303744. Throughput: 0: 6613.9. Samples: 12599184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:18:39,712][09926] Avg episode reward: [(0, '5079.767')] -[2022-07-07 08:18:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6320128. Throughput: 0: 6625.6. Samples: 12640008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:18:44,712][09926] Avg episode reward: [(0, '5178.897')] -[2022-07-07 08:18:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6336512. Throughput: 0: 6544.9. Samples: 12676040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:18:49,712][09926] Avg episode reward: [(0, '5176.244')] -[2022-07-07 08:18:54,714][09926] Fps is (10 sec: 3276.1, 60 sec: 3276.7, 300 sec: 3332.3). Total num frames: 6352896. Throughput: 0: 6516.3. Samples: 12694088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:18:54,714][09926] Avg episode reward: [(0, '5176.244')] -[2022-07-07 08:18:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3346.2). Total num frames: 6369280. Throughput: 0: 6571.9. Samples: 12733384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:18:59,712][09926] Avg episode reward: [(0, '5390.871')] -[2022-07-07 08:19:04,712][09926] Fps is (10 sec: 3277.5, 60 sec: 3277.1, 300 sec: 3346.2). Total num frames: 6385664. Throughput: 0: 6566.9. Samples: 12771904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:19:04,712][09926] Avg episode reward: [(0, '5474.272')] -[2022-07-07 08:19:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3346.2). Total num frames: 6402048. Throughput: 0: 6599.5. Samples: 12792888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:19:09,712][09926] Avg episode reward: [(0, '5428.833')] -[2022-07-07 08:19:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3332.3). Total num frames: 6418432. Throughput: 0: 6525.0. Samples: 12830960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:19:14,714][09926] Avg episode reward: [(0, '5429.033')] -[2022-07-07 08:19:19,715][09926] Fps is (10 sec: 2866.3, 60 sec: 3276.6, 300 sec: 3304.5). Total num frames: 6430720. Throughput: 0: 6487.5. Samples: 12869488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:19:19,715][09926] Avg episode reward: [(0, '5421.081')] -[2022-07-07 08:19:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3304.6). Total num frames: 6451200. Throughput: 0: 6437.5. Samples: 12888872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:19:24,712][09926] Avg episode reward: [(0, '5194.798')] -[2022-07-07 08:19:29,712][09926] Fps is (10 sec: 3687.6, 60 sec: 3276.8, 300 sec: 3304.6). Total num frames: 6467584. Throughput: 0: 6450.0. Samples: 12930256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:19:29,712][09926] Avg episode reward: [(0, '5139.795')] -[2022-07-07 08:19:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3304.6). Total num frames: 6479872. Throughput: 0: 6483.0. Samples: 12967776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:19:34,712][09926] Avg episode reward: [(0, '5138.720')] -[2022-07-07 08:19:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6496256. Throughput: 0: 6448.8. Samples: 12984272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:19:39,712][09926] Avg episode reward: [(0, '5093.593')] -[2022-07-07 08:19:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6512640. Throughput: 0: 6482.8. Samples: 13025112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:19:44,712][09926] Avg episode reward: [(0, '5183.822')] -[2022-07-07 08:19:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3304.6). Total num frames: 6529024. Throughput: 0: 6456.9. Samples: 13062464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:19:49,712][09926] Avg episode reward: [(0, '5254.607')] -[2022-07-07 08:19:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3304.6). Total num frames: 6545408. Throughput: 0: 6424.9. Samples: 13082008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:19:54,712][09926] Avg episode reward: [(0, '5254.922')] -[2022-07-07 08:19:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6561792. Throughput: 0: 6402.1. Samples: 13119056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:19:59,712][09926] Avg episode reward: [(0, '5410.360')] -[2022-07-07 08:20:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6578176. Throughput: 0: 6375.6. Samples: 13156368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:20:04,712][09926] Avg episode reward: [(0, '5489.617')] -[2022-07-07 08:20:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6594560. Throughput: 0: 6427.4. Samples: 13178104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:20:09,712][09926] Avg episode reward: [(0, '5542.617')] -[2022-07-07 08:20:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6610944. Throughput: 0: 6438.4. Samples: 13219984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:20:14,712][09926] Avg episode reward: [(0, '5542.427')] -[2022-07-07 08:20:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3276.8). Total num frames: 6627328. Throughput: 0: 6549.5. Samples: 13262504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:20:19,712][09926] Avg episode reward: [(0, '5539.875')] -[2022-07-07 08:20:24,712][09926] Fps is (10 sec: 3276.6, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6643712. Throughput: 0: 6554.6. Samples: 13279232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:20:24,713][09926] Avg episode reward: [(0, '5541.668')] -[2022-07-07 08:20:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3290.7). Total num frames: 6660096. Throughput: 0: 6523.2. Samples: 13318656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:20:29,712][09926] Avg episode reward: [(0, '5543.332')] -[2022-07-07 08:20:34,712][09926] Fps is (10 sec: 3277.0, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6676480. Throughput: 0: 6470.2. Samples: 13353624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:20:34,712][09926] Avg episode reward: [(0, '5543.544')] -[2022-07-07 08:20:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6692864. Throughput: 0: 6532.8. Samples: 13375984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:20:39,712][09926] Avg episode reward: [(0, '5545.918')] -[2022-07-07 08:20:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6709248. Throughput: 0: 6546.3. Samples: 13413640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) -[2022-07-07 08:20:44,712][09926] Avg episode reward: [(0, '5503.828')] -[2022-07-07 08:20:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6725632. Throughput: 0: 6632.4. Samples: 13454824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:20:49,712][09926] Avg episode reward: [(0, '5475.180')] -[2022-07-07 08:20:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6742016. Throughput: 0: 6597.9. Samples: 13475008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:20:54,712][09926] Avg episode reward: [(0, '5477.279')] -[2022-07-07 08:20:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 6754304. Throughput: 0: 6463.3. Samples: 13510832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:20:59,712][09926] Avg episode reward: [(0, '5448.098')] -[2022-07-07 08:21:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3276.8). Total num frames: 6770688. Throughput: 0: 6378.8. Samples: 13549552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:04,712][09926] Avg episode reward: [(0, '5573.733')] -[2022-07-07 08:21:09,712][09926] Fps is (10 sec: 3686.5, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6791168. Throughput: 0: 6490.1. Samples: 13571280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:21:09,712][09926] Avg episode reward: [(0, '5511.897')] -[2022-07-07 08:21:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3290.7). Total num frames: 6807552. Throughput: 0: 6522.5. Samples: 13612168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:21:14,712][09926] Avg episode reward: [(0, '5499.097')] -[2022-07-07 08:21:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6823936. Throughput: 0: 6635.6. Samples: 13652224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:21:19,712][09926] Avg episode reward: [(0, '5565.567')] -[2022-07-07 08:21:24,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 6840320. Throughput: 0: 6587.9. Samples: 13672448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:21:24,714][09926] Avg episode reward: [(0, '5594.050')] -[2022-07-07 08:21:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6860800. Throughput: 0: 6635.9. Samples: 13712256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:29,714][09926] Avg episode reward: [(0, '5568.279')] -[2022-07-07 08:21:34,712][09926] Fps is (10 sec: 3686.9, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6877184. Throughput: 0: 6686.0. Samples: 13755696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:34,714][09926] Avg episode reward: [(0, '5518.223')] -[2022-07-07 08:21:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6893568. Throughput: 0: 6744.0. Samples: 13778488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:39,712][09926] Avg episode reward: [(0, '5549.734')] -[2022-07-07 08:21:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6909952. Throughput: 0: 6862.2. Samples: 13819632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:44,714][09926] Avg episode reward: [(0, '5482.649')] -[2022-07-07 08:21:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6926336. Throughput: 0: 6786.1. Samples: 13854928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:21:49,712][09926] Avg episode reward: [(0, '5482.649')] -[2022-07-07 08:21:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3276.8). Total num frames: 6942720. Throughput: 0: 6797.1. Samples: 13877152. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:21:54,712][09926] Avg episode reward: [(0, '5484.157')] -[2022-07-07 08:21:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3413.3, 300 sec: 3276.8). Total num frames: 6959104. Throughput: 0: 6737.2. Samples: 13915344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:21:59,712][09926] Avg episode reward: [(0, '5515.102')] -[2022-07-07 08:22:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 6971392. Throughput: 0: 6603.6. Samples: 13949384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:04,712][09926] Avg episode reward: [(0, '5490.652')] -[2022-07-07 08:22:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 6987776. Throughput: 0: 6553.3. Samples: 13967336. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:09,712][09926] Avg episode reward: [(0, '5490.652')] -[2022-07-07 08:22:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 7004160. Throughput: 0: 6469.3. Samples: 14003376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:14,712][09926] Avg episode reward: [(0, '5473.009')] -[2022-07-07 08:22:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 7020544. Throughput: 0: 6389.5. Samples: 14043224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:19,712][09926] Avg episode reward: [(0, '5336.644')] -[2022-07-07 08:22:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 7032832. Throughput: 0: 6321.8. Samples: 14062968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:24,712][09926] Avg episode reward: [(0, '5144.918')] -[2022-07-07 08:22:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 7053312. Throughput: 0: 6275.7. Samples: 14102040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:22:29,712][09926] Avg episode reward: [(0, '5144.918')] -[2022-07-07 08:22:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7065600. Throughput: 0: 6299.0. Samples: 14138384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:22:34,712][09926] Avg episode reward: [(0, '5145.353')] -[2022-07-07 08:22:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7081984. Throughput: 0: 6189.3. Samples: 14155672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:22:39,712][09926] Avg episode reward: [(0, '5145.023')] -[2022-07-07 08:22:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7098368. Throughput: 0: 6120.2. Samples: 14190752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:22:44,712][09926] Avg episode reward: [(0, '5092.698')] -[2022-07-07 08:22:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3235.1). Total num frames: 7110656. Throughput: 0: 6223.8. Samples: 14229456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:22:49,712][09926] Avg episode reward: [(0, '5133.702')] -[2022-07-07 08:22:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3235.1). Total num frames: 7127040. Throughput: 0: 6280.2. Samples: 14249944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:22:54,712][09926] Avg episode reward: [(0, '5182.806')] -[2022-07-07 08:22:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3072.0, 300 sec: 3235.2). Total num frames: 7143424. Throughput: 0: 6304.7. Samples: 14287088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:22:59,712][09926] Avg episode reward: [(0, '5250.231')] -[2022-07-07 08:23:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 7159808. Throughput: 0: 6249.1. Samples: 14324432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:04,712][09926] Avg episode reward: [(0, '5313.267')] -[2022-07-07 08:23:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 7176192. Throughput: 0: 6239.1. Samples: 14343728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:09,712][09926] Avg episode reward: [(0, '5284.820')] -[2022-07-07 08:23:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7192576. Throughput: 0: 6284.6. Samples: 14384848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:14,712][09926] Avg episode reward: [(0, '5254.021')] -[2022-07-07 08:23:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3249.0). Total num frames: 7208960. Throughput: 0: 6274.3. Samples: 14420728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:19,715][09926] Avg episode reward: [(0, '5322.423')] -[2022-07-07 08:23:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 7225344. Throughput: 0: 6322.3. Samples: 14440176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:24,712][09926] Avg episode reward: [(0, '5303.798')] -[2022-07-07 08:23:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3221.3). Total num frames: 7237632. Throughput: 0: 6344.5. Samples: 14476256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:29,712][09926] Avg episode reward: [(0, '5273.702')] -[2022-07-07 08:23:34,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7254016. Throughput: 0: 6371.9. Samples: 14516192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:23:34,712][09926] Avg episode reward: [(0, '5210.949')] -[2022-07-07 08:23:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7270400. Throughput: 0: 6313.1. Samples: 14534032. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:23:39,712][09926] Avg episode reward: [(0, '5193.604')] -[2022-07-07 08:23:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 7286784. Throughput: 0: 6358.2. Samples: 14573208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:23:44,712][09926] Avg episode reward: [(0, '5097.680')] -[2022-07-07 08:23:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7303168. Throughput: 0: 6320.4. Samples: 14608848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:23:49,712][09926] Avg episode reward: [(0, '5118.979')] -[2022-07-07 08:23:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7319552. Throughput: 0: 6371.9. Samples: 14630464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:23:54,712][09926] Avg episode reward: [(0, '5153.335')] -[2022-07-07 08:23:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7335936. Throughput: 0: 6331.6. Samples: 14669768. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:23:59,712][09926] Avg episode reward: [(0, '5380.703')] -[2022-07-07 08:24:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7352320. Throughput: 0: 6337.6. Samples: 14705920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:24:04,712][09926] Avg episode reward: [(0, '5384.505')] -[2022-07-07 08:24:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7368704. Throughput: 0: 6396.8. Samples: 14728032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:24:09,712][09926] Avg episode reward: [(0, '5386.182')] -[2022-07-07 08:24:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 7385088. Throughput: 0: 6431.3. Samples: 14765664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:24:14,712][09926] Avg episode reward: [(0, '5447.930')] -[2022-07-07 08:24:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7397376. Throughput: 0: 6334.0. Samples: 14801224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:24:19,712][09926] Avg episode reward: [(0, '5487.977')] -[2022-07-07 08:24:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7413760. Throughput: 0: 6342.8. Samples: 14819456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:24:24,712][09926] Avg episode reward: [(0, '5479.134')] -[2022-07-07 08:24:29,715][09926] Fps is (10 sec: 3275.8, 60 sec: 3208.4, 300 sec: 3221.2). Total num frames: 7430144. Throughput: 0: 6380.4. Samples: 14860344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:24:29,715][09926] Avg episode reward: [(0, '5480.152')] -[2022-07-07 08:24:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7450624. Throughput: 0: 6497.8. Samples: 14901248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:24:34,712][09926] Avg episode reward: [(0, '5516.816')] -[2022-07-07 08:24:39,712][09926] Fps is (10 sec: 3687.6, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7467008. Throughput: 0: 6515.4. Samples: 14923656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:24:39,712][09926] Avg episode reward: [(0, '5642.032')] -[2022-07-07 08:24:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7483392. Throughput: 0: 6451.7. Samples: 14960096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:24:44,712][09926] Avg episode reward: [(0, '5546.328')] -[2022-07-07 08:24:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 7499776. Throughput: 0: 6527.6. Samples: 14999664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:24:49,712][09926] Avg episode reward: [(0, '5585.497')] -[2022-07-07 08:24:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7512064. Throughput: 0: 6400.9. Samples: 15016072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:24:54,712][09926] Avg episode reward: [(0, '5487.867')] -[2022-07-07 08:24:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7528448. Throughput: 0: 6470.2. Samples: 15056824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:24:59,712][09926] Avg episode reward: [(0, '5466.086')] -[2022-07-07 08:25:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7544832. Throughput: 0: 6434.5. Samples: 15090776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:04,712][09926] Avg episode reward: [(0, '5431.697')] -[2022-07-07 08:25:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7561216. Throughput: 0: 6489.1. Samples: 15111464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:09,712][09926] Avg episode reward: [(0, '5336.177')] -[2022-07-07 08:25:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7577600. Throughput: 0: 6416.4. Samples: 15149064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:14,712][09926] Avg episode reward: [(0, '5389.591')] -[2022-07-07 08:25:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7589888. Throughput: 0: 6332.4. Samples: 15186208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:19,713][09926] Avg episode reward: [(0, '5573.668')] -[2022-07-07 08:25:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7606272. Throughput: 0: 6236.8. Samples: 15204312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:24,712][09926] Avg episode reward: [(0, '5610.152')] -[2022-07-07 08:25:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.7, 300 sec: 3207.4). Total num frames: 7622656. Throughput: 0: 6327.7. Samples: 15244840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) -[2022-07-07 08:25:29,712][09926] Avg episode reward: [(0, '5579.085')] -[2022-07-07 08:25:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7639040. Throughput: 0: 6291.7. Samples: 15282792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:34,712][09926] Avg episode reward: [(0, '5625.018')] -[2022-07-07 08:25:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7655424. Throughput: 0: 6368.5. Samples: 15302656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:39,712][09926] Avg episode reward: [(0, '5519.252')] -[2022-07-07 08:25:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7671808. Throughput: 0: 6336.7. Samples: 15341976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:44,712][09926] Avg episode reward: [(0, '5528.194')] -[2022-07-07 08:25:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3207.4). Total num frames: 7688192. Throughput: 0: 6519.6. Samples: 15384160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:49,712][09926] Avg episode reward: [(0, '5467.119')] -[2022-07-07 08:25:54,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7704576. Throughput: 0: 6503.8. Samples: 15404136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:54,712][09926] Avg episode reward: [(0, '5480.270')] -[2022-07-07 08:25:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 7720960. Throughput: 0: 6507.4. Samples: 15441896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:25:59,712][09926] Avg episode reward: [(0, '5548.300')] -[2022-07-07 08:26:04,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7737344. Throughput: 0: 6438.0. Samples: 15475920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:04,712][09926] Avg episode reward: [(0, '5608.922')] -[2022-07-07 08:26:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7753728. Throughput: 0: 6554.5. Samples: 15499264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:09,712][09926] Avg episode reward: [(0, '5603.177')] -[2022-07-07 08:26:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 7770112. Throughput: 0: 6549.2. Samples: 15539552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:14,712][09926] Avg episode reward: [(0, '5685.042')] -[2022-07-07 08:26:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 7786496. Throughput: 0: 6568.9. Samples: 15578392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:19,712][09926] Avg episode reward: [(0, '5780.894')] -[2022-07-07 08:26:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7802880. Throughput: 0: 6553.3. Samples: 15597552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:24,712][09926] Avg episode reward: [(0, '5792.325')] -[2022-07-07 08:26:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7819264. Throughput: 0: 6578.0. Samples: 15637984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:29,712][09926] Avg episode reward: [(0, '5792.325')] -[2022-07-07 08:26:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7835648. Throughput: 0: 6497.6. Samples: 15676552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:34,712][09926] Avg episode reward: [(0, '5739.823')] -[2022-07-07 08:26:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7852032. Throughput: 0: 6506.2. Samples: 15696912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:26:39,712][09926] Avg episode reward: [(0, '5704.547')] -[2022-07-07 08:26:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3193.5). Total num frames: 7868416. Throughput: 0: 6554.1. Samples: 15736832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:26:44,712][09926] Avg episode reward: [(0, '5752.712')] -[2022-07-07 08:26:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3207.4). Total num frames: 7888896. Throughput: 0: 6708.3. Samples: 15777792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:26:49,712][09926] Avg episode reward: [(0, '5752.712')] -[2022-07-07 08:26:54,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3207.4). Total num frames: 7905280. Throughput: 0: 6677.5. Samples: 15799752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:26:54,712][09926] Avg episode reward: [(0, '5755.926')] -[2022-07-07 08:26:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7921664. Throughput: 0: 6677.0. Samples: 15840016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:26:59,712][09926] Avg episode reward: [(0, '5666.064')] -[2022-07-07 08:27:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3207.4). Total num frames: 7933952. Throughput: 0: 6610.5. Samples: 15875864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:04,712][09926] Avg episode reward: [(0, '5667.846')] -[2022-07-07 08:27:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7954432. Throughput: 0: 6650.7. Samples: 15896832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:09,719][09926] Avg episode reward: [(0, '5668.290')] -[2022-07-07 08:27:14,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 7970816. Throughput: 0: 6661.9. Samples: 15937768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:14,712][09926] Avg episode reward: [(0, '5696.744')] -[2022-07-07 08:27:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 7987200. Throughput: 0: 6656.2. Samples: 15976080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:19,712][09926] Avg episode reward: [(0, '5534.176')] -[2022-07-07 08:27:24,714][09926] Fps is (10 sec: 3276.2, 60 sec: 3345.0, 300 sec: 3221.2). Total num frames: 8003584. Throughput: 0: 6665.5. Samples: 15996872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:24,714][09926] Avg episode reward: [(0, '5583.482')] -[2022-07-07 08:27:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8019968. Throughput: 0: 6667.2. Samples: 16036856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:29,712][09926] Avg episode reward: [(0, '5577.031')] -[2022-07-07 08:27:34,712][09926] Fps is (10 sec: 3277.5, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8036352. Throughput: 0: 6632.7. Samples: 16076264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:34,712][09926] Avg episode reward: [(0, '5592.434')] -[2022-07-07 08:27:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 8052736. Throughput: 0: 6579.5. Samples: 16095832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:39,712][09926] Avg episode reward: [(0, '5577.089')] -[2022-07-07 08:27:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8065024. Throughput: 0: 6496.0. Samples: 16132336. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:44,712][09926] Avg episode reward: [(0, '5558.183')] -[2022-07-07 08:27:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8081408. Throughput: 0: 6546.7. Samples: 16170464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:27:49,712][09926] Avg episode reward: [(0, '5559.440')] -[2022-07-07 08:27:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8097792. Throughput: 0: 6453.2. Samples: 16187224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:54,712][09926] Avg episode reward: [(0, '5705.335')] -[2022-07-07 08:27:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8114176. Throughput: 0: 6381.5. Samples: 16224936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:27:59,712][09926] Avg episode reward: [(0, '5740.944')] -[2022-07-07 08:28:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8126464. Throughput: 0: 6249.8. Samples: 16257320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:28:04,712][09926] Avg episode reward: [(0, '5836.524')] -[2022-07-07 08:28:09,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8142848. Throughput: 0: 6230.0. Samples: 16277208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:28:09,712][09926] Avg episode reward: [(0, '5833.988')] -[2022-07-07 08:28:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8159232. Throughput: 0: 6253.3. Samples: 16318256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) -[2022-07-07 08:28:14,712][09926] Avg episode reward: [(0, '5829.804')] -[2022-07-07 08:28:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8175616. Throughput: 0: 6216.0. Samples: 16355984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:19,712][09926] Avg episode reward: [(0, '5864.477')] -[2022-07-07 08:28:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.4, 300 sec: 3235.1). Total num frames: 8192000. Throughput: 0: 6213.3. Samples: 16375432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:24,712][09926] Avg episode reward: [(0, '5893.803')] -[2022-07-07 08:28:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 8208384. Throughput: 0: 6269.0. Samples: 16414440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:29,712][09926] Avg episode reward: [(0, '5893.705')] -[2022-07-07 08:28:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3235.1). Total num frames: 8224768. Throughput: 0: 6273.1. Samples: 16452752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:34,712][09926] Avg episode reward: [(0, '5853.362')] -[2022-07-07 08:28:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3072.0, 300 sec: 3221.3). Total num frames: 8237056. Throughput: 0: 6315.4. Samples: 16471416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:39,712][09926] Avg episode reward: [(0, '5851.959')] -[2022-07-07 08:28:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8253440. Throughput: 0: 6322.3. Samples: 16509440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:44,712][09926] Avg episode reward: [(0, '5860.634')] -[2022-07-07 08:28:49,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8273920. Throughput: 0: 6459.6. Samples: 16548000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:49,712][09926] Avg episode reward: [(0, '5860.634')] -[2022-07-07 08:28:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8286208. Throughput: 0: 6450.0. Samples: 16567456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:54,712][09926] Avg episode reward: [(0, '5844.976')] -[2022-07-07 08:28:59,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8302592. Throughput: 0: 6372.8. Samples: 16605032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:28:59,712][09926] Avg episode reward: [(0, '5778.327')] -[2022-07-07 08:29:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8318976. Throughput: 0: 6357.9. Samples: 16642088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:29:04,712][09926] Avg episode reward: [(0, '5720.864')] -[2022-07-07 08:29:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8335360. Throughput: 0: 6364.8. Samples: 16661848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:29:09,712][09926] Avg episode reward: [(0, '5725.263')] -[2022-07-07 08:29:14,715][09926] Fps is (10 sec: 3275.7, 60 sec: 3208.4, 300 sec: 3235.1). Total num frames: 8351744. Throughput: 0: 6418.5. Samples: 16703296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:29:14,715][09926] Avg episode reward: [(0, '5730.212')] -[2022-07-07 08:29:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8368128. Throughput: 0: 6376.5. Samples: 16739696. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:29:19,712][09926] Avg episode reward: [(0, '5693.876')] -[2022-07-07 08:29:24,712][09926] Fps is (10 sec: 3277.9, 60 sec: 3208.5, 300 sec: 3235.2). Total num frames: 8384512. Throughput: 0: 6431.3. Samples: 16760824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:29:24,712][09926] Avg episode reward: [(0, '5647.552')] -[2022-07-07 08:29:29,717][09926] Fps is (10 sec: 3275.0, 60 sec: 3208.2, 300 sec: 3221.2). Total num frames: 8400896. Throughput: 0: 6452.6. Samples: 16799840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:29:29,718][09926] Avg episode reward: [(0, '5647.552')] -[2022-07-07 08:29:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8417280. Throughput: 0: 6452.1. Samples: 16838344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:29:34,712][09926] Avg episode reward: [(0, '5669.736')] -[2022-07-07 08:29:39,714][09926] Fps is (10 sec: 3278.0, 60 sec: 3276.7, 300 sec: 3221.2). Total num frames: 8433664. Throughput: 0: 6474.4. Samples: 16858816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:29:39,714][09926] Avg episode reward: [(0, '5658.146')] -[2022-07-07 08:29:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8450048. Throughput: 0: 6519.3. Samples: 16898400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:29:44,712][09926] Avg episode reward: [(0, '5675.084')] -[2022-07-07 08:29:49,712][09926] Fps is (10 sec: 3277.4, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8466432. Throughput: 0: 6594.1. Samples: 16938824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:29:49,712][09926] Avg episode reward: [(0, '5675.375')] -[2022-07-07 08:29:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8482816. Throughput: 0: 6568.4. Samples: 16957424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:29:54,712][09926] Avg episode reward: [(0, '5655.915')] -[2022-07-07 08:29:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8499200. Throughput: 0: 6522.8. Samples: 16996800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:29:59,715][09926] Avg episode reward: [(0, '5575.669')] -[2022-07-07 08:30:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8515584. Throughput: 0: 6478.9. Samples: 17031248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:04,712][09926] Avg episode reward: [(0, '5551.926')] -[2022-07-07 08:30:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8531968. Throughput: 0: 6464.9. Samples: 17051744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:09,712][09926] Avg episode reward: [(0, '5550.923')] -[2022-07-07 08:30:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3249.0). Total num frames: 8548352. Throughput: 0: 6494.1. Samples: 17092040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:14,712][09926] Avg episode reward: [(0, '5532.759')] -[2022-07-07 08:30:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8560640. Throughput: 0: 6469.5. Samples: 17129472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:19,712][09926] Avg episode reward: [(0, '5615.170')] -[2022-07-07 08:30:24,713][09926] Fps is (10 sec: 3276.3, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 8581120. Throughput: 0: 6539.4. Samples: 17153088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:24,714][09926] Avg episode reward: [(0, '5630.480')] -[2022-07-07 08:30:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3277.1, 300 sec: 3249.0). Total num frames: 8597504. Throughput: 0: 6513.4. Samples: 17191504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:29,712][09926] Avg episode reward: [(0, '5631.780')] -[2022-07-07 08:30:34,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 8613888. Throughput: 0: 6442.8. Samples: 17228752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:34,712][09926] Avg episode reward: [(0, '5830.791')] -[2022-07-07 08:30:39,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3235.1). Total num frames: 8626176. Throughput: 0: 6482.7. Samples: 17249144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:39,715][09926] Avg episode reward: [(0, '5779.051')] -[2022-07-07 08:30:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8642560. Throughput: 0: 6444.8. Samples: 17286816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:30:44,712][09926] Avg episode reward: [(0, '5889.387')] -[2022-07-07 08:30:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8658944. Throughput: 0: 6544.9. Samples: 17325768. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:30:49,712][09926] Avg episode reward: [(0, '5892.444')] -[2022-07-07 08:30:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8675328. Throughput: 0: 6448.2. Samples: 17341912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:30:54,712][09926] Avg episode reward: [(0, '5872.142')] -[2022-07-07 08:30:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8691712. Throughput: 0: 6338.0. Samples: 17377248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:30:59,712][09926] Avg episode reward: [(0, '5886.956')] -[2022-07-07 08:31:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8708096. Throughput: 0: 6411.2. Samples: 17417976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:31:04,712][09926] Avg episode reward: [(0, '5719.173')] -[2022-07-07 08:31:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8724480. Throughput: 0: 6376.2. Samples: 17440008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) -[2022-07-07 08:31:09,712][09926] Avg episode reward: [(0, '5719.813')] -[2022-07-07 08:31:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 8740864. Throughput: 0: 6378.1. Samples: 17478520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:14,712][09926] Avg episode reward: [(0, '5773.799')] -[2022-07-07 08:31:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8757248. Throughput: 0: 6352.7. Samples: 17514624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:19,712][09926] Avg episode reward: [(0, '5611.008')] -[2022-07-07 08:31:24,712][09926] Fps is (10 sec: 3276.7, 60 sec: 3208.6, 300 sec: 3235.1). Total num frames: 8773632. Throughput: 0: 6336.7. Samples: 17534296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:24,713][09926] Avg episode reward: [(0, '5668.219')] -[2022-07-07 08:31:29,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8785920. Throughput: 0: 6327.5. Samples: 17571552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:29,712][09926] Avg episode reward: [(0, '5618.855')] -[2022-07-07 08:31:34,712][09926] Fps is (10 sec: 2867.3, 60 sec: 3140.3, 300 sec: 3221.3). Total num frames: 8802304. Throughput: 0: 6370.1. Samples: 17612424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:34,712][09926] Avg episode reward: [(0, '5658.962')] -[2022-07-07 08:31:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3221.3). Total num frames: 8818688. Throughput: 0: 6458.1. Samples: 17632528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:39,712][09926] Avg episode reward: [(0, '5696.034')] -[2022-07-07 08:31:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8839168. Throughput: 0: 6570.5. Samples: 17672920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:44,712][09926] Avg episode reward: [(0, '5715.286')] -[2022-07-07 08:31:49,715][09926] Fps is (10 sec: 3685.3, 60 sec: 3276.6, 300 sec: 3221.2). Total num frames: 8855552. Throughput: 0: 6586.8. Samples: 17714400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:49,715][09926] Avg episode reward: [(0, '5746.859')] -[2022-07-07 08:31:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8871936. Throughput: 0: 6550.4. Samples: 17734776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:54,712][09926] Avg episode reward: [(0, '5746.828')] -[2022-07-07 08:31:59,712][09926] Fps is (10 sec: 3277.7, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 8888320. Throughput: 0: 6555.0. Samples: 17773496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:31:59,712][09926] Avg episode reward: [(0, '5790.703')] -[2022-07-07 08:32:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 8900608. Throughput: 0: 6550.0. Samples: 17809376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:04,712][09926] Avg episode reward: [(0, '5828.521')] -[2022-07-07 08:32:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8921088. Throughput: 0: 6512.2. Samples: 17827344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:09,712][09926] Avg episode reward: [(0, '5858.527')] -[2022-07-07 08:32:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3207.4). Total num frames: 8933376. Throughput: 0: 6591.8. Samples: 17868184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:14,712][09926] Avg episode reward: [(0, '5926.363')] -[2022-07-07 08:32:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8953856. Throughput: 0: 6564.4. Samples: 17907824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:19,712][09926] Avg episode reward: [(0, '5910.041')] -[2022-07-07 08:32:24,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3221.3). Total num frames: 8970240. Throughput: 0: 6592.0. Samples: 17929168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:24,712][09926] Avg episode reward: [(0, '5885.680')] -[2022-07-07 08:32:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 8986624. Throughput: 0: 6634.7. Samples: 17971480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:29,712][09926] Avg episode reward: [(0, '5892.236')] -[2022-07-07 08:32:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3221.3). Total num frames: 9003008. Throughput: 0: 6535.2. Samples: 18008464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:34,712][09926] Avg episode reward: [(0, '5863.082')] -[2022-07-07 08:32:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3235.1). Total num frames: 9019392. Throughput: 0: 6565.5. Samples: 18030224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:39,712][09926] Avg episode reward: [(0, '5725.642')] -[2022-07-07 08:32:44,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9039872. Throughput: 0: 6620.6. Samples: 18071424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:44,712][09926] Avg episode reward: [(0, '5725.642')] -[2022-07-07 08:32:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3277.0, 300 sec: 3235.1). Total num frames: 9052160. Throughput: 0: 6716.6. Samples: 18111624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:49,712][09926] Avg episode reward: [(0, '5864.695')] -[2022-07-07 08:32:54,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3235.1). Total num frames: 9068544. Throughput: 0: 6701.2. Samples: 18128896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:54,712][09926] Avg episode reward: [(0, '5738.466')] -[2022-07-07 08:32:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9084928. Throughput: 0: 6687.8. Samples: 18169136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:32:59,712][09926] Avg episode reward: [(0, '5697.003')] -[2022-07-07 08:33:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9101312. Throughput: 0: 6647.8. Samples: 18206976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:04,713][09926] Avg episode reward: [(0, '5697.003')] -[2022-07-07 08:33:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9117696. Throughput: 0: 6600.4. Samples: 18226184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:09,712][09926] Avg episode reward: [(0, '5673.019')] -[2022-07-07 08:33:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3249.0). Total num frames: 9134080. Throughput: 0: 6498.3. Samples: 18263904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:14,712][09926] Avg episode reward: [(0, '5701.241')] -[2022-07-07 08:33:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3235.1). Total num frames: 9146368. Throughput: 0: 6498.8. Samples: 18300912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:19,712][09926] Avg episode reward: [(0, '5790.718')] -[2022-07-07 08:33:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9166848. Throughput: 0: 6533.9. Samples: 18324248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:24,712][09926] Avg episode reward: [(0, '5790.718')] -[2022-07-07 08:33:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9183232. Throughput: 0: 6493.9. Samples: 18363648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:29,712][09926] Avg episode reward: [(0, '5837.434')] -[2022-07-07 08:33:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9199616. Throughput: 0: 6470.9. Samples: 18402816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:34,712][09926] Avg episode reward: [(0, '5906.398')] -[2022-07-07 08:33:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9216000. Throughput: 0: 6506.7. Samples: 18421696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:39,712][09926] Avg episode reward: [(0, '5913.469')] -[2022-07-07 08:33:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9232384. Throughput: 0: 6536.5. Samples: 18463280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:44,712][09926] Avg episode reward: [(0, '5911.455')] -[2022-07-07 08:33:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9248768. Throughput: 0: 6618.5. Samples: 18504808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:49,712][09926] Avg episode reward: [(0, '6005.076')] -[2022-07-07 08:33:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9265152. Throughput: 0: 6622.9. Samples: 18524216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:54,712][09926] Avg episode reward: [(0, '6002.119')] -[2022-07-07 08:33:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9281536. Throughput: 0: 6661.2. Samples: 18563656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:33:59,712][09926] Avg episode reward: [(0, '6029.592')] -[2022-07-07 08:34:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9297920. Throughput: 0: 6585.3. Samples: 18597248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:04,712][09926] Avg episode reward: [(0, '6029.592')] -[2022-07-07 08:34:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3263.0). Total num frames: 9314304. Throughput: 0: 6551.3. Samples: 18619056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:09,712][09926] Avg episode reward: [(0, '6076.824')] -[2022-07-07 08:34:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9330688. Throughput: 0: 6470.6. Samples: 18654824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:14,712][09926] Avg episode reward: [(0, '5943.694')] -[2022-07-07 08:34:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9342976. Throughput: 0: 6471.1. Samples: 18694016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:19,712][09926] Avg episode reward: [(0, '5956.729')] -[2022-07-07 08:34:24,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.1). Total num frames: 9359360. Throughput: 0: 6421.3. Samples: 18710656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:24,712][09926] Avg episode reward: [(0, '5956.889')] -[2022-07-07 08:34:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9375744. Throughput: 0: 6399.8. Samples: 18751272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:29,714][09926] Avg episode reward: [(0, '5915.920')] -[2022-07-07 08:34:34,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9396224. Throughput: 0: 6392.0. Samples: 18792448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:34,715][09926] Avg episode reward: [(0, '5725.132')] -[2022-07-07 08:34:39,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9412608. Throughput: 0: 6398.6. Samples: 18812152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:34:39,712][09926] Avg episode reward: [(0, '5746.072')] -[2022-07-07 08:34:44,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9424896. Throughput: 0: 6361.1. Samples: 18849904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:34:44,712][09926] Avg episode reward: [(0, '5748.285')] -[2022-07-07 08:34:49,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9441280. Throughput: 0: 6520.5. Samples: 18890672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:34:49,712][09926] Avg episode reward: [(0, '5829.449')] -[2022-07-07 08:34:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9457664. Throughput: 0: 6401.8. Samples: 18907136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:34:54,712][09926] Avg episode reward: [(0, '5847.761')] -[2022-07-07 08:34:59,713][09926] Fps is (10 sec: 3276.2, 60 sec: 3208.4, 300 sec: 3249.0). Total num frames: 9474048. Throughput: 0: 6516.9. Samples: 18948096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:34:59,714][09926] Avg episode reward: [(0, '5787.644')] -[2022-07-07 08:35:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9490432. Throughput: 0: 6488.7. Samples: 18986008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) -[2022-07-07 08:35:04,712][09926] Avg episode reward: [(0, '5787.949')] -[2022-07-07 08:35:09,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9506816. Throughput: 0: 6550.8. Samples: 19005440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:09,712][09926] Avg episode reward: [(0, '5930.898')] -[2022-07-07 08:35:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9523200. Throughput: 0: 6547.0. Samples: 19045888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:14,712][09926] Avg episode reward: [(0, '5893.661')] -[2022-07-07 08:35:19,713][09926] Fps is (10 sec: 3276.4, 60 sec: 3276.7, 300 sec: 3249.0). Total num frames: 9539584. Throughput: 0: 6453.5. Samples: 19082864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:19,713][09926] Avg episode reward: [(0, '5926.553')] -[2022-07-07 08:35:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9555968. Throughput: 0: 6416.2. Samples: 19100880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:24,712][09926] Avg episode reward: [(0, '5923.880')] -[2022-07-07 08:35:29,712][09926] Fps is (10 sec: 3277.2, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9572352. Throughput: 0: 6494.8. Samples: 19142168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:29,712][09926] Avg episode reward: [(0, '5975.496')] -[2022-07-07 08:35:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9588736. Throughput: 0: 6397.1. Samples: 19178544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:34,712][09926] Avg episode reward: [(0, '5929.268')] -[2022-07-07 08:35:39,712][09926] Fps is (10 sec: 3276.9, 60 sec: 3208.5, 300 sec: 3262.9). Total num frames: 9605120. Throughput: 0: 6506.2. Samples: 19199912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:39,712][09926] Avg episode reward: [(0, '5930.736')] -[2022-07-07 08:35:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9621504. Throughput: 0: 6401.8. Samples: 19236168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:44,712][09926] Avg episode reward: [(0, '5957.472')] -[2022-07-07 08:35:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9637888. Throughput: 0: 6447.5. Samples: 19276144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:49,712][09926] Avg episode reward: [(0, '6007.605')] -[2022-07-07 08:35:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9654272. Throughput: 0: 6468.5. Samples: 19296520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:54,712][09926] Avg episode reward: [(0, '6003.675')] -[2022-07-07 08:35:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.9, 300 sec: 3262.9). Total num frames: 9670656. Throughput: 0: 6467.2. Samples: 19336912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:35:59,712][09926] Avg episode reward: [(0, '6014.228')] -[2022-07-07 08:36:04,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9687040. Throughput: 0: 6535.6. Samples: 19376960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:36:04,712][09926] Avg episode reward: [(0, '5924.446')] -[2022-07-07 08:36:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9703424. Throughput: 0: 6603.7. Samples: 19398048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:36:09,712][09926] Avg episode reward: [(0, '5990.068')] -[2022-07-07 08:36:14,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9719808. Throughput: 0: 6527.5. Samples: 19435904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:36:14,712][09926] Avg episode reward: [(0, '6016.031')] -[2022-07-07 08:36:19,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.6, 300 sec: 3249.0). Total num frames: 9732096. Throughput: 0: 6529.6. Samples: 19472376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:36:19,712][09926] Avg episode reward: [(0, '5991.390')] -[2022-07-07 08:36:24,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9752576. Throughput: 0: 6472.3. Samples: 19491168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) -[2022-07-07 08:36:24,712][09926] Avg episode reward: [(0, '5949.410')] -[2022-07-07 08:36:29,712][09926] Fps is (10 sec: 3686.4, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9768960. Throughput: 0: 6545.6. Samples: 19530720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:29,712][09926] Avg episode reward: [(0, '5971.792')] -[2022-07-07 08:36:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9785344. Throughput: 0: 6573.9. Samples: 19571968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:34,718][09926] Avg episode reward: [(0, '6037.084')] -[2022-07-07 08:36:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9801728. Throughput: 0: 6531.2. Samples: 19590424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:39,712][09926] Avg episode reward: [(0, '6017.995')] -[2022-07-07 08:36:44,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9818112. Throughput: 0: 6549.9. Samples: 19631656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:44,712][09926] Avg episode reward: [(0, '5946.382')] -[2022-07-07 08:36:49,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9834496. Throughput: 0: 6552.5. Samples: 19671824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:49,712][09926] Avg episode reward: [(0, '5970.500')] -[2022-07-07 08:36:54,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9850880. Throughput: 0: 6545.8. Samples: 19692608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:36:54,712][09926] Avg episode reward: [(0, '5934.800')] -[2022-07-07 08:36:59,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9867264. Throughput: 0: 6629.7. Samples: 19734240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:36:59,712][09926] Avg episode reward: [(0, '5934.800')] -[2022-07-07 08:37:04,712][09926] Fps is (10 sec: 2867.2, 60 sec: 3208.5, 300 sec: 3249.0). Total num frames: 9879552. Throughput: 0: 6553.4. Samples: 19767280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:37:04,712][09926] Avg episode reward: [(0, '5979.973')] -[2022-07-07 08:37:09,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3276.8). Total num frames: 9900032. Throughput: 0: 6526.9. Samples: 19784880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:37:09,712][09926] Avg episode reward: [(0, '5874.054')] -[2022-07-07 08:37:14,713][09926] Fps is (10 sec: 3685.8, 60 sec: 3276.7, 300 sec: 3262.9). Total num frames: 9916416. Throughput: 0: 6588.9. Samples: 19827232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:37:14,714][09926] Avg episode reward: [(0, '5905.978')] -[2022-07-07 08:37:19,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3345.1, 300 sec: 3262.9). Total num frames: 9932800. Throughput: 0: 6525.2. Samples: 19865600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:37:19,712][09926] Avg episode reward: [(0, '5905.978')] -[2022-07-07 08:37:24,712][09926] Fps is (10 sec: 3277.3, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9949184. Throughput: 0: 6620.3. Samples: 19888336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) -[2022-07-07 08:37:24,712][09926] Avg episode reward: [(0, '5946.287')] -[2022-07-07 08:37:29,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9965568. Throughput: 0: 6633.1. Samples: 19930144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:37:29,712][09926] Avg episode reward: [(0, '5913.977')] -[2022-07-07 08:37:34,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3262.9). Total num frames: 9981952. Throughput: 0: 6529.9. Samples: 19965672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:37:34,712][09926] Avg episode reward: [(0, '6048.760')] -[2022-07-07 08:37:39,712][09926] Fps is (10 sec: 3276.8, 60 sec: 3276.8, 300 sec: 3249.0). Total num frames: 9998336. Throughput: 0: 6541.0. Samples: 19986952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) -[2022-07-07 08:37:39,712][09926] Avg episode reward: [(0, '6048.760')] -[2022-07-07 08:37:40,765][09926] Component Batcher_0 stopped! -[2022-07-07 08:37:40,765][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w1', 'RolloutWorker_w2', 'RolloutWorker_w3', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... -[2022-07-07 08:37:40,766][09926] Component RolloutWorker_w1 stopped! -[2022-07-07 08:37:40,766][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w3', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... -[2022-07-07 08:37:40,767][09926] Component RolloutWorker_w3 stopped! -[2022-07-07 08:37:40,767][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w6', 'RolloutWorker_w7'] to stop... -[2022-07-07 08:37:40,767][09926] Component RolloutWorker_w6 stopped! -[2022-07-07 08:37:40,767][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5', 'RolloutWorker_w7'] to stop... -[2022-07-07 08:37:40,768][09926] Component RolloutWorker_w7 stopped! -[2022-07-07 08:37:40,768][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w2', 'RolloutWorker_w4', 'RolloutWorker_w5'] to stop... -[2022-07-07 08:37:40,768][09926] Component RolloutWorker_w2 stopped! -[2022-07-07 08:37:40,768][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w4', 'RolloutWorker_w5'] to stop... -[2022-07-07 08:37:40,771][09926] Component RolloutWorker_w4 stopped! -[2022-07-07 08:37:40,771][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0', 'RolloutWorker_w5'] to stop... -[2022-07-07 08:37:40,773][09926] Component RolloutWorker_w5 stopped! -[2022-07-07 08:37:40,773][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0', 'RolloutWorker_w0'] to stop... -[2022-07-07 08:37:40,774][09926] Component RolloutWorker_w0 stopped! -[2022-07-07 08:37:40,774][09926] Waiting for ['Learner_p0', 'InferenceWorker_p0-w0'] to stop... -[2022-07-07 08:37:40,785][09926] Component Learner_p0 stopped! -[2022-07-07 08:37:40,785][09926] Waiting for ['InferenceWorker_p0-w0'] to stop... -[2022-07-07 08:37:40,840][09926] Component InferenceWorker_p0-w0 stopped! -[2022-07-07 08:37:40,840][09926] Waiting for process learner_proc0 to stop... -[2022-07-07 08:37:41,309][09926] Waiting for process inference_proc0-0 to stop... -[2022-07-07 08:37:41,504][09926] Waiting for process rollout_proc0 to stop... -[2022-07-07 08:37:42,137][09926] Waiting for process rollout_proc1 to stop... -[2022-07-07 08:37:42,336][09926] Waiting for process rollout_proc2 to stop... -[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc3 to stop... -[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc4 to stop... -[2022-07-07 08:37:42,337][09926] Waiting for process rollout_proc5 to stop... -[2022-07-07 08:37:42,338][09926] Waiting for process rollout_proc6 to stop... -[2022-07-07 08:37:42,338][09926] Waiting for process rollout_proc7 to stop... -[2022-07-07 08:37:42,339][09926] Batcher 0 profile tree view: -batching: 5.6629, releasing_batches: 3.0198 -[2022-07-07 08:37:42,339][09926] InferenceWorker_p0-w0 profile tree view: -wait_policy: 0.0052 - wait_policy_total: 1370.0671 -update_model: 19.3319 - weight_update: 0.0008 -one_step: 0.0067 - handle_policy_step: 1592.2322 - deserialize: 44.3551, stack: 9.6641, obs_to_device: 208.1748, norm: 175.3950, forward: 741.5097, to_cpu: 125.9954, save_outputs: 71.2638, send_messages: 101.6876 -[2022-07-07 08:37:42,339][09926] Learner 0 profile tree view: -prepare_batch: 23.5796 -train: 170.3950 - prepare_train: 0.1885, epoch_init: 0.0618, minibatch_init: 1.6663, forward_head: 4.7848, bptt_initial: 0.2375, bptt: 0.2844, tail: 15.9802, losses: 33.6072, kl_divergence: 2.5301, after_optimizer: 1.3443 - update: 99.7968 - clip: 15.0648 -[2022-07-07 08:37:42,340][09926] RolloutWorker_w0 profile tree view: -wait_for_trajectories: 0.7546, prepare_next_step: 30.3510, env_step: 351.6721, overhead: 136.5336, complete_rollouts: 8.3264, enqueue_policy_requests: 143.6231 -save_policy_outputs: 114.2924 - split_output_tensors: 54.7227 -[2022-07-07 08:37:42,340][09926] RolloutWorker_w7 profile tree view: -wait_for_trajectories: 0.7355, prepare_next_step: 29.9659, env_step: 352.9863, overhead: 137.1090, complete_rollouts: 18.5435, enqueue_policy_requests: 137.2353 -save_policy_outputs: 115.8173 - split_output_tensors: 54.2440 -[2022-07-07 08:37:42,341][09926] Loop Runner_EvtLoop terminating... -[2022-07-07 08:37:42,341][09926] Runner profile tree view: -main_loop: 3115.4860 -[2022-07-07 08:37:42,342][09926] Collected {0: 10002432}, FPS: 3209.2