[2023-03-10 16:42:20,678][1054527] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/config.json... [2023-03-10 16:42:20,695][1054527] Rollout worker 0 uses device cpu [2023-03-10 16:42:20,695][1054527] Rollout worker 1 uses device cpu [2023-03-10 16:42:20,695][1054527] Rollout worker 2 uses device cpu [2023-03-10 16:42:20,695][1054527] Rollout worker 3 uses device cpu [2023-03-10 16:42:20,695][1054527] Rollout worker 4 uses device cpu [2023-03-10 16:42:20,696][1054527] Rollout worker 5 uses device cpu [2023-03-10 16:42:20,696][1054527] Rollout worker 6 uses device cpu [2023-03-10 16:42:20,696][1054527] Rollout worker 7 uses device cpu [2023-03-10 16:42:20,696][1054527] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-10 16:42:20,708][1054527] InferenceWorker_p0-w0: min num requests: 2 [2023-03-10 16:42:20,727][1054527] Starting all processes... [2023-03-10 16:42:20,728][1054527] Starting process learner_proc0 [2023-03-10 16:42:20,777][1054527] Starting all processes... [2023-03-10 16:42:20,808][1054527] Starting process inference_proc0-0 [2023-03-10 16:42:20,818][1054527] Starting process rollout_proc0 [2023-03-10 16:42:20,818][1054527] Starting process rollout_proc1 [2023-03-10 16:42:20,818][1054527] Starting process rollout_proc2 [2023-03-10 16:42:20,819][1054527] Starting process rollout_proc3 [2023-03-10 16:42:20,819][1054527] Starting process rollout_proc4 [2023-03-10 16:42:20,819][1054527] Starting process rollout_proc5 [2023-03-10 16:42:20,822][1054527] Starting process rollout_proc6 [2023-03-10 16:42:20,830][1054527] Starting process rollout_proc7 [2023-03-10 16:42:22,208][1054771] Starting seed is not provided [2023-03-10 16:42:22,208][1054771] Initializing actor-critic model on device cpu [2023-03-10 16:42:22,208][1054771] RunningMeanStd input shape: (39,) [2023-03-10 16:42:22,208][1054771] RunningMeanStd input shape: (1,) [2023-03-10 16:42:22,269][1054771] Created Actor Critic model with architecture: [2023-03-10 16:42:22,269][1054771] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-10 16:42:22,404][1054816] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-10 16:42:22,577][1054819] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-10 16:42:22,677][1054771] Using optimizer [2023-03-10 16:42:22,679][1054771] No checkpoints found [2023-03-10 16:42:22,679][1054771] Did not load from checkpoint, starting from scratch! [2023-03-10 16:42:22,679][1054771] Initialized policy 0 weights for model version 0 [2023-03-10 16:42:22,680][1054771] LearnerWorker_p0 finished initialization! [2023-03-10 16:42:22,681][1054815] RunningMeanStd input shape: (39,) [2023-03-10 16:42:22,682][1054815] RunningMeanStd input shape: (1,) [2023-03-10 16:42:22,712][1054821] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-10 16:42:22,775][1054527] Inference worker 0-0 is ready! [2023-03-10 16:42:22,776][1054527] All inference workers are ready! Signal rollout workers to start! [2023-03-10 16:42:22,844][1054817] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-10 16:42:23,022][1054916] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-10 16:42:23,025][1054884] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-10 16:42:23,231][1054820] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-10 16:42:23,265][1054818] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-10 16:42:23,348][1054527] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 16:42:26,690][1054821] Decorrelating experience for 0 frames... [2023-03-10 16:42:26,702][1054821] Decorrelating experience for 64 frames... [2023-03-10 16:42:26,743][1054821] Decorrelating experience for 128 frames... [2023-03-10 16:42:26,812][1054821] Decorrelating experience for 192 frames... [2023-03-10 16:42:26,855][1054817] Decorrelating experience for 0 frames... [2023-03-10 16:42:26,867][1054817] Decorrelating experience for 64 frames... [2023-03-10 16:42:26,908][1054817] Decorrelating experience for 128 frames... [2023-03-10 16:42:26,975][1054817] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,015][1054819] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,028][1054819] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,032][1054884] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,044][1054884] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,046][1054916] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,058][1054916] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,069][1054819] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,085][1054884] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,099][1054916] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,139][1054819] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,153][1054884] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,167][1054916] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,218][1054820] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,230][1054820] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,239][1054818] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,251][1054818] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,271][1054820] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,291][1054818] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,339][1054820] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,360][1054818] Decorrelating experience for 192 frames... [2023-03-10 16:42:27,601][1054816] Decorrelating experience for 0 frames... [2023-03-10 16:42:27,621][1054816] Decorrelating experience for 64 frames... [2023-03-10 16:42:27,685][1054816] Decorrelating experience for 128 frames... [2023-03-10 16:42:27,795][1054816] Decorrelating experience for 192 frames... [2023-03-10 16:42:28,348][1054527] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 16:42:30,758][1054821] Decorrelating experience for 256 frames... [2023-03-10 16:42:30,882][1054821] Decorrelating experience for 320 frames... [2023-03-10 16:42:30,898][1054817] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,021][1054817] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,035][1054821] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,055][1054884] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,079][1054916] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,097][1054819] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,180][1054884] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,181][1054817] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,202][1054916] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,218][1054821] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,221][1054819] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,239][1054820] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,262][1054818] Decorrelating experience for 256 frames... [2023-03-10 16:42:31,332][1054884] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,353][1054916] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,360][1054817] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,369][1054820] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,375][1054819] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,386][1054818] Decorrelating experience for 320 frames... [2023-03-10 16:42:31,510][1054884] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,520][1054820] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,533][1054916] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,541][1054818] Decorrelating experience for 384 frames... [2023-03-10 16:42:31,557][1054819] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,696][1054820] Decorrelating experience for 448 frames... [2023-03-10 16:42:31,721][1054818] Decorrelating experience for 448 frames... [2023-03-10 16:42:32,646][1054816] Decorrelating experience for 256 frames... [2023-03-10 16:42:32,768][1054816] Decorrelating experience for 320 frames... [2023-03-10 16:42:32,930][1054816] Decorrelating experience for 384 frames... [2023-03-10 16:42:33,107][1054816] Decorrelating experience for 448 frames... [2023-03-10 16:42:33,348][1054527] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 90.8. Samples: 908. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 16:42:33,348][1054527] Avg episode reward: [(0, '5.676')] [2023-03-10 16:42:33,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000000_0.pth... [2023-03-10 16:42:37,757][1054815] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-10 16:42:38,348][1054527] Fps is (10 sec: 4505.6, 60 sec: 3003.7, 300 sec: 3003.7). Total num frames: 45056. Throughput: 0: 2749.6. Samples: 41244. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:42:38,348][1054527] Avg episode reward: [(0, '23.341')] [2023-03-10 16:42:40,703][1054527] Heartbeat connected on Batcher_0 [2023-03-10 16:42:40,706][1054527] Heartbeat connected on LearnerWorker_p0 [2023-03-10 16:42:40,711][1054527] Heartbeat connected on RolloutWorker_w0 [2023-03-10 16:42:40,714][1054527] Heartbeat connected on RolloutWorker_w1 [2023-03-10 16:42:40,716][1054527] Heartbeat connected on RolloutWorker_w2 [2023-03-10 16:42:40,718][1054527] Heartbeat connected on RolloutWorker_w3 [2023-03-10 16:42:40,722][1054527] Heartbeat connected on RolloutWorker_w5 [2023-03-10 16:42:40,723][1054527] Heartbeat connected on RolloutWorker_w4 [2023-03-10 16:42:40,724][1054527] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-10 16:42:40,725][1054527] Heartbeat connected on RolloutWorker_w6 [2023-03-10 16:42:40,727][1054527] Heartbeat connected on RolloutWorker_w7 [2023-03-10 16:42:42,173][1054815] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-10 16:42:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 4505.6, 300 sec: 4505.6). Total num frames: 90112. Throughput: 0: 3484.8. Samples: 69696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:42:43,349][1054527] Avg episode reward: [(0, '109.222')] [2023-03-10 16:42:46,890][1054815] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-10 16:42:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 5406.7, 300 sec: 5406.7). Total num frames: 135168. Throughput: 0: 4912.8. Samples: 122820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:42:48,348][1054527] Avg episode reward: [(0, '172.450')] [2023-03-10 16:42:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000264_135168.pth... [2023-03-10 16:42:48,354][1054771] Saving new best policy, reward=172.450! [2023-03-10 16:42:51,571][1054815] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-10 16:42:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 5870.9, 300 sec: 5870.9). Total num frames: 176128. Throughput: 0: 5854.7. Samples: 175640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:42:53,348][1054527] Avg episode reward: [(0, '195.271')] [2023-03-10 16:42:53,350][1054771] Saving new best policy, reward=195.271! [2023-03-10 16:42:56,192][1054815] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-10 16:42:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 6319.5, 300 sec: 6319.5). Total num frames: 221184. Throughput: 0: 5739.5. Samples: 200884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:42:58,348][1054527] Avg episode reward: [(0, '231.875')] [2023-03-10 16:42:58,349][1054771] Saving new best policy, reward=231.875! [2023-03-10 16:43:00,656][1054815] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-10 16:43:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 6656.0, 300 sec: 6656.0). Total num frames: 266240. Throughput: 0: 6402.6. Samples: 256104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:03,349][1054527] Avg episode reward: [(0, '253.380')] [2023-03-10 16:43:03,375][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000528_270336.pth... [2023-03-10 16:43:03,376][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000000_0.pth [2023-03-10 16:43:03,377][1054771] Saving new best policy, reward=253.380! [2023-03-10 16:43:05,273][1054815] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-10 16:43:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 6917.7, 300 sec: 6917.7). Total num frames: 311296. Throughput: 0: 6875.6. Samples: 309404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:08,359][1054527] Avg episode reward: [(0, '326.354')] [2023-03-10 16:43:08,359][1054771] Saving new best policy, reward=326.354! [2023-03-10 16:43:09,743][1054815] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-10 16:43:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 7127.1, 300 sec: 7127.1). Total num frames: 356352. Throughput: 0: 7479.8. Samples: 336588. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:43:13,359][1054527] Avg episode reward: [(0, '333.016')] [2023-03-10 16:43:13,359][1054771] Saving new best policy, reward=333.016! [2023-03-10 16:43:14,395][1054815] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-10 16:43:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 7298.3, 300 sec: 7298.3). Total num frames: 401408. Throughput: 0: 8646.6. Samples: 390004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:18,359][1054527] Avg episode reward: [(0, '332.343')] [2023-03-10 16:43:18,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000784_401408.pth... [2023-03-10 16:43:18,366][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000264_135168.pth [2023-03-10 16:43:18,902][1054815] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-10 16:43:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 7441.1, 300 sec: 7441.1). Total num frames: 446464. Throughput: 0: 8915.3. Samples: 442432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:23,349][1054527] Avg episode reward: [(0, '376.904')] [2023-03-10 16:43:23,349][1054771] Saving new best policy, reward=376.904! [2023-03-10 16:43:23,743][1054815] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-10 16:43:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8123.7, 300 sec: 7498.8). Total num frames: 487424. Throughput: 0: 8850.0. Samples: 467944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:28,348][1054527] Avg episode reward: [(0, '513.427')] [2023-03-10 16:43:28,349][1054771] Saving new best policy, reward=513.427! [2023-03-10 16:43:28,640][1054815] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-10 16:43:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8806.4, 300 sec: 7548.4). Total num frames: 528384. Throughput: 0: 8810.3. Samples: 519284. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:43:33,348][1054527] Avg episode reward: [(0, '480.417')] [2023-03-10 16:43:33,380][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001040_532480.pth... [2023-03-10 16:43:33,380][1054815] Updated weights for policy 0, policy_version 1040 (0.0004) [2023-03-10 16:43:33,382][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000528_270336.pth [2023-03-10 16:43:38,124][1054815] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-10 16:43:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 7645.9). Total num frames: 573440. Throughput: 0: 8793.9. Samples: 571364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:38,348][1054527] Avg episode reward: [(0, '367.157')] [2023-03-10 16:43:42,632][1054815] Updated weights for policy 0, policy_version 1200 (0.0006) [2023-03-10 16:43:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 7731.2). Total num frames: 618496. Throughput: 0: 8825.2. Samples: 598016. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:43:43,348][1054527] Avg episode reward: [(0, '281.128')] [2023-03-10 16:43:46,954][1054815] Updated weights for policy 0, policy_version 1280 (0.0006) [2023-03-10 16:43:48,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 7854.7). Total num frames: 667648. Throughput: 0: 8847.6. Samples: 654244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:48,348][1054527] Avg episode reward: [(0, '279.536')] [2023-03-10 16:43:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001304_667648.pth... [2023-03-10 16:43:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000000784_401408.pth [2023-03-10 16:43:51,478][1054815] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-10 16:43:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 7873.4). Total num frames: 708608. Throughput: 0: 8869.6. Samples: 708536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:43:53,348][1054527] Avg episode reward: [(0, '348.262')] [2023-03-10 16:43:56,129][1054815] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-10 16:43:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 7976.4). Total num frames: 757760. Throughput: 0: 8852.5. Samples: 734952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:43:58,348][1054527] Avg episode reward: [(0, '372.906')] [2023-03-10 16:44:00,571][1054815] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-10 16:44:03,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 8028.2). Total num frames: 802816. Throughput: 0: 8898.7. Samples: 790444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:03,349][1054527] Avg episode reward: [(0, '391.276')] [2023-03-10 16:44:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001568_802816.pth... [2023-03-10 16:44:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001040_532480.pth [2023-03-10 16:44:05,225][1054815] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-10 16:44:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8036.0). Total num frames: 843776. Throughput: 0: 8914.0. Samples: 843560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:08,348][1054527] Avg episode reward: [(0, '370.391')] [2023-03-10 16:44:10,026][1054815] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-10 16:44:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8806.4, 300 sec: 8043.1). Total num frames: 884736. Throughput: 0: 8874.8. Samples: 867312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:13,359][1054527] Avg episode reward: [(0, '265.689')] [2023-03-10 16:44:14,797][1054815] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-10 16:44:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8085.1). Total num frames: 929792. Throughput: 0: 8857.8. Samples: 917884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:44:18,359][1054527] Avg episode reward: [(0, '330.210')] [2023-03-10 16:44:18,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001816_929792.pth... [2023-03-10 16:44:18,365][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001304_667648.pth [2023-03-10 16:44:19,545][1054815] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-10 16:44:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8123.7). Total num frames: 974848. Throughput: 0: 8875.3. Samples: 970752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:44:23,348][1054527] Avg episode reward: [(0, '528.643')] [2023-03-10 16:44:23,349][1054771] Saving new best policy, reward=528.643! [2023-03-10 16:44:24,259][1054815] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-10 16:44:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8126.5). Total num frames: 1015808. Throughput: 0: 8874.0. Samples: 997344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:44:28,349][1054527] Avg episode reward: [(0, '719.333')] [2023-03-10 16:44:28,352][1054771] Saving new best policy, reward=719.333! [2023-03-10 16:44:28,828][1054815] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-10 16:44:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8160.5). Total num frames: 1060864. Throughput: 0: 8789.6. Samples: 1049776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:33,348][1054527] Avg episode reward: [(0, '512.787')] [2023-03-10 16:44:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002072_1060864.pth... [2023-03-10 16:44:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001568_802816.pth [2023-03-10 16:44:33,469][1054815] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-10 16:44:38,287][1054815] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-10 16:44:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8192.0). Total num frames: 1105920. Throughput: 0: 8747.7. Samples: 1102184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:38,359][1054527] Avg episode reward: [(0, '852.671')] [2023-03-10 16:44:38,360][1054771] Saving new best policy, reward=852.671! [2023-03-10 16:44:43,081][1054815] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-10 16:44:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8192.0). Total num frames: 1146880. Throughput: 0: 8704.2. Samples: 1126640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:43,348][1054527] Avg episode reward: [(0, '548.219')] [2023-03-10 16:44:47,854][1054815] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-10 16:44:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8192.0). Total num frames: 1187840. Throughput: 0: 8631.2. Samples: 1178848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:48,348][1054527] Avg episode reward: [(0, '760.688')] [2023-03-10 16:44:48,383][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002328_1191936.pth... [2023-03-10 16:44:48,385][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000001816_929792.pth [2023-03-10 16:44:52,843][1054815] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-10 16:44:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8219.3). Total num frames: 1232896. Throughput: 0: 8560.5. Samples: 1228784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:44:53,349][1054527] Avg episode reward: [(0, '1252.327')] [2023-03-10 16:44:53,349][1054771] Saving new best policy, reward=1252.327! [2023-03-10 16:44:57,334][1054815] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-10 16:44:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8244.9). Total num frames: 1277952. Throughput: 0: 8602.8. Samples: 1254436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:44:58,348][1054527] Avg episode reward: [(0, '1057.034')] [2023-03-10 16:45:02,105][1054815] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-10 16:45:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8243.2). Total num frames: 1318912. Throughput: 0: 8678.3. Samples: 1308408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:03,349][1054527] Avg episode reward: [(0, '1080.560')] [2023-03-10 16:45:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002576_1318912.pth... [2023-03-10 16:45:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002072_1060864.pth [2023-03-10 16:45:06,794][1054815] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-10 16:45:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8266.5). Total num frames: 1363968. Throughput: 0: 8651.8. Samples: 1360084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:08,348][1054527] Avg episode reward: [(0, '1128.740')] [2023-03-10 16:45:11,205][1054815] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-10 16:45:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8288.4). Total num frames: 1409024. Throughput: 0: 8695.0. Samples: 1388616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:13,348][1054527] Avg episode reward: [(0, '1560.924')] [2023-03-10 16:45:13,349][1054771] Saving new best policy, reward=1560.924! [2023-03-10 16:45:15,982][1054815] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-10 16:45:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8309.0). Total num frames: 1454080. Throughput: 0: 8695.9. Samples: 1441092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:45:18,348][1054527] Avg episode reward: [(0, '1773.045')] [2023-03-10 16:45:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002840_1454080.pth... [2023-03-10 16:45:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002328_1191936.pth [2023-03-10 16:45:18,355][1054771] Saving new best policy, reward=1773.045! [2023-03-10 16:45:20,521][1054815] Updated weights for policy 0, policy_version 2880 (0.0005) [2023-03-10 16:45:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8305.8). Total num frames: 1495040. Throughput: 0: 8723.4. Samples: 1494736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:23,348][1054527] Avg episode reward: [(0, '1804.497')] [2023-03-10 16:45:23,358][1054771] Saving new best policy, reward=1804.497! [2023-03-10 16:45:25,040][1054815] Updated weights for policy 0, policy_version 2960 (0.0006) [2023-03-10 16:45:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8347.0). Total num frames: 1544192. Throughput: 0: 8804.5. Samples: 1522844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:28,348][1054527] Avg episode reward: [(0, '1991.266')] [2023-03-10 16:45:28,349][1054771] Saving new best policy, reward=1991.266! [2023-03-10 16:45:29,778][1054815] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-10 16:45:33,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8342.9). Total num frames: 1585152. Throughput: 0: 8816.5. Samples: 1575588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:33,348][1054527] Avg episode reward: [(0, '2311.626')] [2023-03-10 16:45:33,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003096_1585152.pth... [2023-03-10 16:45:33,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002576_1318912.pth [2023-03-10 16:45:33,352][1054771] Saving new best policy, reward=2311.626! [2023-03-10 16:45:34,272][1054815] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-10 16:45:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8360.0). Total num frames: 1630208. Throughput: 0: 8878.3. Samples: 1628308. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:45:38,348][1054527] Avg episode reward: [(0, '2420.985')] [2023-03-10 16:45:38,349][1054771] Saving new best policy, reward=2420.985! [2023-03-10 16:45:38,875][1054815] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-10 16:45:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8376.3). Total num frames: 1675264. Throughput: 0: 8944.1. Samples: 1656920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:43,348][1054527] Avg episode reward: [(0, '3207.881')] [2023-03-10 16:45:43,349][1054771] Saving new best policy, reward=3207.881! [2023-03-10 16:45:43,403][1054815] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-10 16:45:48,012][1054815] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-10 16:45:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8391.8). Total num frames: 1720320. Throughput: 0: 8930.7. Samples: 1710288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:48,348][1054527] Avg episode reward: [(0, '3133.228')] [2023-03-10 16:45:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003360_1720320.pth... [2023-03-10 16:45:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000002840_1454080.pth [2023-03-10 16:45:52,846][1054815] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-10 16:45:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8387.1). Total num frames: 1761280. Throughput: 0: 8915.5. Samples: 1761280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:53,348][1054527] Avg episode reward: [(0, '2978.030')] [2023-03-10 16:45:57,547][1054815] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-10 16:45:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8401.6). Total num frames: 1806336. Throughput: 0: 8840.6. Samples: 1786444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:45:58,348][1054527] Avg episode reward: [(0, '2709.816')] [2023-03-10 16:46:02,309][1054815] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-10 16:46:03,348][1054527] Fps is (10 sec: 9010.9, 60 sec: 8874.6, 300 sec: 8415.4). Total num frames: 1851392. Throughput: 0: 8844.7. Samples: 1839104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:46:03,349][1054527] Avg episode reward: [(0, '3435.291')] [2023-03-10 16:46:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003616_1851392.pth... [2023-03-10 16:46:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003096_1585152.pth [2023-03-10 16:46:03,356][1054771] Saving new best policy, reward=3435.291! [2023-03-10 16:46:07,066][1054815] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-10 16:46:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8410.5). Total num frames: 1892352. Throughput: 0: 8806.3. Samples: 1891020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:08,348][1054527] Avg episode reward: [(0, '2535.113')] [2023-03-10 16:46:11,780][1054815] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-10 16:46:13,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8806.4, 300 sec: 8423.5). Total num frames: 1937408. Throughput: 0: 8750.4. Samples: 1916612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:13,348][1054527] Avg episode reward: [(0, '2869.970')] [2023-03-10 16:46:16,514][1054815] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-10 16:46:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8436.0). Total num frames: 1982464. Throughput: 0: 8745.1. Samples: 1969120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:18,348][1054527] Avg episode reward: [(0, '3032.924')] [2023-03-10 16:46:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003872_1982464.pth... [2023-03-10 16:46:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003360_1720320.pth [2023-03-10 16:46:21,193][1054815] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-10 16:46:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8430.9). Total num frames: 2023424. Throughput: 0: 8690.9. Samples: 2019400. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:46:23,348][1054527] Avg episode reward: [(0, '3369.252')] [2023-03-10 16:46:26,072][1054815] Updated weights for policy 0, policy_version 4000 (0.0006) [2023-03-10 16:46:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8669.9, 300 sec: 8426.1). Total num frames: 2064384. Throughput: 0: 8642.5. Samples: 2045832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:28,348][1054527] Avg episode reward: [(0, '3304.888')] [2023-03-10 16:46:30,810][1054815] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-10 16:46:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8437.8). Total num frames: 2109440. Throughput: 0: 8598.9. Samples: 2097240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:33,348][1054527] Avg episode reward: [(0, '3376.662')] [2023-03-10 16:46:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004120_2109440.pth... [2023-03-10 16:46:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003616_1851392.pth [2023-03-10 16:46:35,746][1054815] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-10 16:46:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8432.9). Total num frames: 2150400. Throughput: 0: 8556.3. Samples: 2146312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:46:38,348][1054527] Avg episode reward: [(0, '3354.788')] [2023-03-10 16:46:40,443][1054815] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-10 16:46:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8428.3). Total num frames: 2191360. Throughput: 0: 8632.1. Samples: 2174888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:46:43,348][1054527] Avg episode reward: [(0, '3521.083')] [2023-03-10 16:46:43,368][1054771] Saving new best policy, reward=3521.083! [2023-03-10 16:46:45,296][1054815] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-10 16:46:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8601.6, 300 sec: 8439.3). Total num frames: 2236416. Throughput: 0: 8556.1. Samples: 2224128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:48,349][1054527] Avg episode reward: [(0, '3941.582')] [2023-03-10 16:46:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004368_2236416.pth... [2023-03-10 16:46:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000003872_1982464.pth [2023-03-10 16:46:48,356][1054771] Saving new best policy, reward=3941.582! [2023-03-10 16:46:49,977][1054815] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-10 16:46:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8434.7). Total num frames: 2277376. Throughput: 0: 8585.0. Samples: 2277344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:53,348][1054527] Avg episode reward: [(0, '3173.770')] [2023-03-10 16:46:54,979][1054815] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-10 16:46:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8430.3). Total num frames: 2318336. Throughput: 0: 8526.3. Samples: 2300296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:46:58,348][1054527] Avg episode reward: [(0, '3184.465')] [2023-03-10 16:46:59,861][1054815] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-10 16:47:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.4, 300 sec: 8440.7). Total num frames: 2363392. Throughput: 0: 8549.3. Samples: 2353840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:47:03,348][1054527] Avg episode reward: [(0, '3573.268')] [2023-03-10 16:47:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004616_2363392.pth... [2023-03-10 16:47:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004120_2109440.pth [2023-03-10 16:47:04,444][1054815] Updated weights for policy 0, policy_version 4640 (0.0004) [2023-03-10 16:47:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8450.7). Total num frames: 2408448. Throughput: 0: 8590.8. Samples: 2405988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:08,348][1054527] Avg episode reward: [(0, '3436.541')] [2023-03-10 16:47:09,082][1054815] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-10 16:47:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8460.4). Total num frames: 2453504. Throughput: 0: 8601.5. Samples: 2432900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:13,348][1054527] Avg episode reward: [(0, '3582.944')] [2023-03-10 16:47:13,859][1054815] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-10 16:47:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 2490368. Throughput: 0: 8555.6. Samples: 2482240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:18,348][1054527] Avg episode reward: [(0, '3581.967')] [2023-03-10 16:47:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004864_2490368.pth... [2023-03-10 16:47:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004368_2236416.pth [2023-03-10 16:47:18,931][1054815] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-10 16:47:23,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 2531328. Throughput: 0: 8555.2. Samples: 2531296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:23,348][1054527] Avg episode reward: [(0, '3792.703')] [2023-03-10 16:47:23,885][1054815] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-10 16:47:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8733.5). Total num frames: 2576384. Throughput: 0: 8467.1. Samples: 2555908. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:47:28,348][1054527] Avg episode reward: [(0, '3807.548')] [2023-03-10 16:47:28,763][1054815] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-10 16:47:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8719.6). Total num frames: 2617344. Throughput: 0: 8479.1. Samples: 2605688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:33,348][1054527] Avg episode reward: [(0, '3738.466')] [2023-03-10 16:47:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005112_2617344.pth... [2023-03-10 16:47:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004616_2363392.pth [2023-03-10 16:47:33,424][1054815] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-10 16:47:38,095][1054815] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-10 16:47:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8719.6). Total num frames: 2662400. Throughput: 0: 8498.9. Samples: 2659796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:38,348][1054527] Avg episode reward: [(0, '3804.862')] [2023-03-10 16:47:42,810][1054815] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-10 16:47:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8719.6). Total num frames: 2707456. Throughput: 0: 8560.4. Samples: 2685512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:47:43,348][1054527] Avg episode reward: [(0, '3756.761')] [2023-03-10 16:47:47,230][1054815] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-10 16:47:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 2752512. Throughput: 0: 8587.7. Samples: 2740288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:48,348][1054527] Avg episode reward: [(0, '3486.522')] [2023-03-10 16:47:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005376_2752512.pth... [2023-03-10 16:47:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000004864_2490368.pth [2023-03-10 16:47:51,837][1054815] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-10 16:47:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 2797568. Throughput: 0: 8610.2. Samples: 2793448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:53,348][1054527] Avg episode reward: [(0, '3541.792')] [2023-03-10 16:47:56,524][1054815] Updated weights for policy 0, policy_version 5520 (0.0004) [2023-03-10 16:47:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 2838528. Throughput: 0: 8605.0. Samples: 2820124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:47:58,348][1054527] Avg episode reward: [(0, '3596.397')] [2023-03-10 16:48:01,397][1054815] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-10 16:48:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 2883584. Throughput: 0: 8646.0. Samples: 2871308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:48:03,348][1054527] Avg episode reward: [(0, '4091.143')] [2023-03-10 16:48:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005632_2883584.pth... [2023-03-10 16:48:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005112_2617344.pth [2023-03-10 16:48:03,355][1054771] Saving new best policy, reward=4091.143! [2023-03-10 16:48:06,261][1054815] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-10 16:48:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.4, 300 sec: 8691.9). Total num frames: 2920448. Throughput: 0: 8648.0. Samples: 2920456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:48:08,348][1054527] Avg episode reward: [(0, '3751.526')] [2023-03-10 16:48:11,406][1054815] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-10 16:48:13,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8465.0, 300 sec: 8678.0). Total num frames: 2961408. Throughput: 0: 8645.7. Samples: 2944964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:13,349][1054527] Avg episode reward: [(0, '3725.085')] [2023-03-10 16:48:16,174][1054815] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-10 16:48:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 3006464. Throughput: 0: 8655.3. Samples: 2995176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:48:18,348][1054527] Avg episode reward: [(0, '3837.946')] [2023-03-10 16:48:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005872_3006464.pth... [2023-03-10 16:48:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005376_2752512.pth [2023-03-10 16:48:20,972][1054815] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-10 16:48:23,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 3051520. Throughput: 0: 8614.0. Samples: 3047424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:23,348][1054527] Avg episode reward: [(0, '4014.288')] [2023-03-10 16:48:25,869][1054815] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-10 16:48:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8678.0). Total num frames: 3088384. Throughput: 0: 8588.6. Samples: 3072000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:48:28,348][1054527] Avg episode reward: [(0, '4113.111')] [2023-03-10 16:48:28,349][1054771] Saving new best policy, reward=4113.111! [2023-03-10 16:48:31,040][1054815] Updated weights for policy 0, policy_version 6080 (0.0004) [2023-03-10 16:48:33,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8533.3, 300 sec: 8664.1). Total num frames: 3129344. Throughput: 0: 8454.7. Samples: 3120748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:33,348][1054527] Avg episode reward: [(0, '4295.115')] [2023-03-10 16:48:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006112_3129344.pth... [2023-03-10 16:48:33,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005632_2883584.pth [2023-03-10 16:48:33,357][1054771] Saving new best policy, reward=4295.115! [2023-03-10 16:48:35,901][1054815] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-10 16:48:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8664.1). Total num frames: 3174400. Throughput: 0: 8378.3. Samples: 3170472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:38,349][1054527] Avg episode reward: [(0, '4100.246')] [2023-03-10 16:48:40,591][1054815] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-10 16:48:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 3215360. Throughput: 0: 8375.8. Samples: 3197036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:43,348][1054527] Avg episode reward: [(0, '3968.091')] [2023-03-10 16:48:45,566][1054815] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-10 16:48:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8636.3). Total num frames: 3256320. Throughput: 0: 8329.6. Samples: 3246140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:48:48,348][1054527] Avg episode reward: [(0, '4209.746')] [2023-03-10 16:48:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006360_3256320.pth... [2023-03-10 16:48:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000005872_3006464.pth [2023-03-10 16:48:50,744][1054815] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-10 16:48:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8608.5). Total num frames: 3297280. Throughput: 0: 8284.4. Samples: 3293256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:48:53,348][1054527] Avg episode reward: [(0, '4174.448')] [2023-03-10 16:48:55,936][1054815] Updated weights for policy 0, policy_version 6480 (0.0006) [2023-03-10 16:48:58,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8260.3, 300 sec: 8580.8). Total num frames: 3334144. Throughput: 0: 8280.5. Samples: 3317584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:48:58,348][1054527] Avg episode reward: [(0, '3788.067')] [2023-03-10 16:49:00,932][1054815] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-10 16:49:03,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8580.8). Total num frames: 3375104. Throughput: 0: 8246.7. Samples: 3366276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:49:03,348][1054527] Avg episode reward: [(0, '3761.227')] [2023-03-10 16:49:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006592_3375104.pth... [2023-03-10 16:49:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006112_3129344.pth [2023-03-10 16:49:06,046][1054815] Updated weights for policy 0, policy_version 6640 (0.0006) [2023-03-10 16:49:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8580.8). Total num frames: 3416064. Throughput: 0: 8179.1. Samples: 3415484. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:49:08,348][1054527] Avg episode reward: [(0, '4115.167')] [2023-03-10 16:49:10,783][1054815] Updated weights for policy 0, policy_version 6720 (0.0006) [2023-03-10 16:49:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8580.8). Total num frames: 3461120. Throughput: 0: 8193.6. Samples: 3440712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:49:13,348][1054527] Avg episode reward: [(0, '4193.248')] [2023-03-10 16:49:15,795][1054815] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-10 16:49:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8566.9). Total num frames: 3502080. Throughput: 0: 8202.8. Samples: 3489872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:49:18,348][1054527] Avg episode reward: [(0, '4395.015')] [2023-03-10 16:49:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006840_3502080.pth... [2023-03-10 16:49:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006360_3256320.pth [2023-03-10 16:49:18,354][1054771] Saving new best policy, reward=4395.015! [2023-03-10 16:49:20,604][1054815] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-10 16:49:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8566.9). Total num frames: 3543040. Throughput: 0: 8261.3. Samples: 3542232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:49:23,348][1054527] Avg episode reward: [(0, '4296.809')] [2023-03-10 16:49:25,589][1054815] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-10 16:49:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8553.0). Total num frames: 3584000. Throughput: 0: 8197.0. Samples: 3565900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:49:28,348][1054527] Avg episode reward: [(0, '4145.931')] [2023-03-10 16:49:30,298][1054815] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-10 16:49:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 3629056. Throughput: 0: 8242.5. Samples: 3617052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:49:33,349][1054527] Avg episode reward: [(0, '4017.803')] [2023-03-10 16:49:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007088_3629056.pth... [2023-03-10 16:49:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006592_3375104.pth [2023-03-10 16:49:35,036][1054815] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-10 16:49:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 3674112. Throughput: 0: 8374.0. Samples: 3670088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:49:38,348][1054527] Avg episode reward: [(0, '4230.392')] [2023-03-10 16:49:39,708][1054815] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-10 16:49:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 3715072. Throughput: 0: 8399.9. Samples: 3695580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:49:43,348][1054527] Avg episode reward: [(0, '4176.386')] [2023-03-10 16:49:44,634][1054815] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-10 16:49:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 3756032. Throughput: 0: 8397.4. Samples: 3744160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:49:48,348][1054527] Avg episode reward: [(0, '3796.901')] [2023-03-10 16:49:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007336_3756032.pth... [2023-03-10 16:49:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000006840_3502080.pth [2023-03-10 16:49:49,632][1054815] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-10 16:49:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 3796992. Throughput: 0: 8435.5. Samples: 3795084. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:49:53,349][1054527] Avg episode reward: [(0, '3947.485')] [2023-03-10 16:49:54,487][1054815] Updated weights for policy 0, policy_version 7440 (0.0006) [2023-03-10 16:49:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 3842048. Throughput: 0: 8455.2. Samples: 3821196. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:49:58,348][1054527] Avg episode reward: [(0, '4116.900')] [2023-03-10 16:49:59,226][1054815] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-10 16:50:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 3883008. Throughput: 0: 8532.6. Samples: 3873840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:50:03,348][1054527] Avg episode reward: [(0, '4124.382')] [2023-03-10 16:50:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007584_3883008.pth... [2023-03-10 16:50:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007088_3629056.pth [2023-03-10 16:50:03,846][1054815] Updated weights for policy 0, policy_version 7600 (0.0006) [2023-03-10 16:50:08,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 3928064. Throughput: 0: 8484.4. Samples: 3924032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:08,349][1054527] Avg episode reward: [(0, '4215.320')] [2023-03-10 16:50:08,871][1054815] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-10 16:50:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 3969024. Throughput: 0: 8503.4. Samples: 3948552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:13,348][1054527] Avg episode reward: [(0, '4219.235')] [2023-03-10 16:50:13,734][1054815] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-10 16:50:18,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 4009984. Throughput: 0: 8515.1. Samples: 4000232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:18,348][1054527] Avg episode reward: [(0, '4392.774')] [2023-03-10 16:50:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007832_4009984.pth... [2023-03-10 16:50:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007336_3756032.pth [2023-03-10 16:50:18,514][1054815] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-10 16:50:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 4050944. Throughput: 0: 8456.0. Samples: 4050608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:23,348][1054527] Avg episode reward: [(0, '4316.323')] [2023-03-10 16:50:23,393][1054815] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-10 16:50:28,142][1054815] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-10 16:50:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 4096000. Throughput: 0: 8444.7. Samples: 4075592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:50:28,348][1054527] Avg episode reward: [(0, '4154.995')] [2023-03-10 16:50:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 4132864. Throughput: 0: 8457.4. Samples: 4124744. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:50:33,348][1054527] Avg episode reward: [(0, '4211.403')] [2023-03-10 16:50:33,359][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008080_4136960.pth... [2023-03-10 16:50:33,359][1054815] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-10 16:50:33,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007584_3883008.pth [2023-03-10 16:50:38,244][1054815] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-10 16:50:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 4177920. Throughput: 0: 8420.5. Samples: 4174008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:38,348][1054527] Avg episode reward: [(0, '4362.636')] [2023-03-10 16:50:42,947][1054815] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-10 16:50:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 4218880. Throughput: 0: 8437.2. Samples: 4200872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:50:43,348][1054527] Avg episode reward: [(0, '4541.326')] [2023-03-10 16:50:43,349][1054771] Saving new best policy, reward=4541.326! [2023-03-10 16:50:47,818][1054815] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-10 16:50:48,349][1054527] Fps is (10 sec: 8600.3, 60 sec: 8464.9, 300 sec: 8483.5). Total num frames: 4263936. Throughput: 0: 8396.9. Samples: 4251712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:48,350][1054527] Avg episode reward: [(0, '4479.520')] [2023-03-10 16:50:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008328_4263936.pth... [2023-03-10 16:50:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000007832_4009984.pth [2023-03-10 16:50:52,693][1054815] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-10 16:50:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 4304896. Throughput: 0: 8395.6. Samples: 4301832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:53,348][1054527] Avg episode reward: [(0, '4361.471')] [2023-03-10 16:50:57,303][1054815] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-10 16:50:58,348][1054527] Fps is (10 sec: 8602.8, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 4349952. Throughput: 0: 8421.4. Samples: 4327516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:50:58,348][1054527] Avg episode reward: [(0, '4310.499')] [2023-03-10 16:51:02,075][1054815] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-10 16:51:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 4390912. Throughput: 0: 8463.7. Samples: 4381100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:51:03,348][1054527] Avg episode reward: [(0, '4445.695')] [2023-03-10 16:51:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008576_4390912.pth... [2023-03-10 16:51:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008080_4136960.pth [2023-03-10 16:51:06,785][1054815] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-10 16:51:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 4435968. Throughput: 0: 8494.9. Samples: 4432880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:51:08,348][1054527] Avg episode reward: [(0, '4392.083')] [2023-03-10 16:51:11,375][1054815] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-10 16:51:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 4481024. Throughput: 0: 8550.1. Samples: 4460344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:51:13,348][1054527] Avg episode reward: [(0, '4091.108')] [2023-03-10 16:51:16,023][1054815] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-10 16:51:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 4521984. Throughput: 0: 8634.1. Samples: 4513280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:51:18,348][1054527] Avg episode reward: [(0, '4055.771')] [2023-03-10 16:51:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008832_4521984.pth... [2023-03-10 16:51:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008328_4263936.pth [2023-03-10 16:51:20,680][1054815] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-10 16:51:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 4567040. Throughput: 0: 8667.6. Samples: 4564048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:51:23,348][1054527] Avg episode reward: [(0, '3929.605')] [2023-03-10 16:51:25,497][1054815] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-10 16:51:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 4612096. Throughput: 0: 8678.5. Samples: 4591404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:51:28,348][1054527] Avg episode reward: [(0, '4122.948')] [2023-03-10 16:51:30,059][1054815] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-10 16:51:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 4653056. Throughput: 0: 8699.8. Samples: 4643192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:51:33,348][1054527] Avg episode reward: [(0, '3930.400')] [2023-03-10 16:51:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009088_4653056.pth... [2023-03-10 16:51:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008576_4390912.pth [2023-03-10 16:51:35,104][1054815] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-10 16:51:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 4698112. Throughput: 0: 8713.8. Samples: 4693952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 16:51:38,349][1054527] Avg episode reward: [(0, '3872.326')] [2023-03-10 16:51:39,831][1054815] Updated weights for policy 0, policy_version 9200 (0.0004) [2023-03-10 16:51:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 4739072. Throughput: 0: 8692.0. Samples: 4718656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:51:43,348][1054527] Avg episode reward: [(0, '3751.805')] [2023-03-10 16:51:44,738][1054815] Updated weights for policy 0, policy_version 9280 (0.0004) [2023-03-10 16:51:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.8, 300 sec: 8483.6). Total num frames: 4780032. Throughput: 0: 8643.6. Samples: 4770064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:51:48,348][1054527] Avg episode reward: [(0, '3543.098')] [2023-03-10 16:51:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009336_4780032.pth... [2023-03-10 16:51:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000008832_4521984.pth [2023-03-10 16:51:49,563][1054815] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-10 16:51:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 4825088. Throughput: 0: 8648.1. Samples: 4822044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:51:53,348][1054527] Avg episode reward: [(0, '3556.258')] [2023-03-10 16:51:53,907][1054815] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-10 16:51:58,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 4870144. Throughput: 0: 8687.4. Samples: 4851276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:51:58,348][1054527] Avg episode reward: [(0, '3110.561')] [2023-03-10 16:51:58,507][1054815] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-10 16:52:03,239][1054815] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-10 16:52:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8497.5). Total num frames: 4915200. Throughput: 0: 8658.6. Samples: 4902920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:52:03,348][1054527] Avg episode reward: [(0, '4446.801')] [2023-03-10 16:52:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009600_4915200.pth... [2023-03-10 16:52:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009088_4653056.pth [2023-03-10 16:52:07,953][1054815] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-10 16:52:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 4956160. Throughput: 0: 8701.9. Samples: 4955632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:52:08,348][1054527] Avg episode reward: [(0, '4260.291')] [2023-03-10 16:52:12,600][1054815] Updated weights for policy 0, policy_version 9760 (0.0004) [2023-03-10 16:52:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8511.4). Total num frames: 5001216. Throughput: 0: 8666.0. Samples: 4981372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:52:13,348][1054527] Avg episode reward: [(0, '4563.367')] [2023-03-10 16:52:13,349][1054771] Saving new best policy, reward=4563.367! [2023-03-10 16:52:17,422][1054815] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-10 16:52:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 5046272. Throughput: 0: 8683.0. Samples: 5033928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:52:18,348][1054527] Avg episode reward: [(0, '4262.889')] [2023-03-10 16:52:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009856_5046272.pth... [2023-03-10 16:52:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009336_4780032.pth [2023-03-10 16:52:22,188][1054815] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-10 16:52:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8511.4). Total num frames: 5087232. Throughput: 0: 8666.1. Samples: 5083924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:52:23,348][1054527] Avg episode reward: [(0, '4481.625')] [2023-03-10 16:52:27,138][1054815] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-10 16:52:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8511.3). Total num frames: 5128192. Throughput: 0: 8697.8. Samples: 5110056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:52:28,348][1054527] Avg episode reward: [(0, '4460.884')] [2023-03-10 16:52:31,797][1054815] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-10 16:52:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8511.3). Total num frames: 5173248. Throughput: 0: 8688.0. Samples: 5161024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:52:33,349][1054527] Avg episode reward: [(0, '4476.574')] [2023-03-10 16:52:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010104_5173248.pth... [2023-03-10 16:52:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009600_4915200.pth [2023-03-10 16:52:36,561][1054815] Updated weights for policy 0, policy_version 10160 (0.0005) [2023-03-10 16:52:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 5214208. Throughput: 0: 8673.6. Samples: 5212356. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:52:38,348][1054527] Avg episode reward: [(0, '4510.606')] [2023-03-10 16:52:41,364][1054815] Updated weights for policy 0, policy_version 10240 (0.0005) [2023-03-10 16:52:43,348][1054527] Fps is (10 sec: 8192.2, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 5255168. Throughput: 0: 8610.0. Samples: 5238724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:52:43,348][1054527] Avg episode reward: [(0, '4407.614')] [2023-03-10 16:52:46,248][1054815] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-10 16:52:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 5300224. Throughput: 0: 8563.7. Samples: 5288288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:52:48,348][1054527] Avg episode reward: [(0, '4465.826')] [2023-03-10 16:52:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010352_5300224.pth... [2023-03-10 16:52:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000009856_5046272.pth [2023-03-10 16:52:50,964][1054815] Updated weights for policy 0, policy_version 10400 (0.0004) [2023-03-10 16:52:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 5341184. Throughput: 0: 8545.9. Samples: 5340200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:52:53,348][1054527] Avg episode reward: [(0, '4165.495')] [2023-03-10 16:52:55,859][1054815] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-10 16:52:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 5386240. Throughput: 0: 8541.9. Samples: 5365760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:52:58,348][1054527] Avg episode reward: [(0, '4327.656')] [2023-03-10 16:53:00,788][1054815] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-10 16:53:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 5427200. Throughput: 0: 8496.0. Samples: 5416248. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:53:03,349][1054527] Avg episode reward: [(0, '4241.556')] [2023-03-10 16:53:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010600_5427200.pth... [2023-03-10 16:53:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010104_5173248.pth [2023-03-10 16:53:05,576][1054815] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-10 16:53:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 5468160. Throughput: 0: 8507.2. Samples: 5466748. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:53:08,349][1054527] Avg episode reward: [(0, '4302.335')] [2023-03-10 16:53:10,471][1054815] Updated weights for policy 0, policy_version 10720 (0.0004) [2023-03-10 16:53:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 5509120. Throughput: 0: 8498.6. Samples: 5492492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:53:13,348][1054527] Avg episode reward: [(0, '4201.862')] [2023-03-10 16:53:15,381][1054815] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-10 16:53:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 5554176. Throughput: 0: 8463.8. Samples: 5541896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:53:18,348][1054527] Avg episode reward: [(0, '4094.926')] [2023-03-10 16:53:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010848_5554176.pth... [2023-03-10 16:53:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010352_5300224.pth [2023-03-10 16:53:20,302][1054815] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-10 16:53:23,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8465.0, 300 sec: 8497.5). Total num frames: 5595136. Throughput: 0: 8416.6. Samples: 5591104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:53:23,349][1054527] Avg episode reward: [(0, '4325.358')] [2023-03-10 16:53:25,496][1054815] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-10 16:53:28,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 5632000. Throughput: 0: 8356.4. Samples: 5614764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:53:28,348][1054527] Avg episode reward: [(0, '4415.830')] [2023-03-10 16:53:30,179][1054815] Updated weights for policy 0, policy_version 11040 (0.0004) [2023-03-10 16:53:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 5677056. Throughput: 0: 8391.6. Samples: 5665912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:53:33,349][1054527] Avg episode reward: [(0, '4346.130')] [2023-03-10 16:53:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011088_5677056.pth... [2023-03-10 16:53:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010600_5427200.pth [2023-03-10 16:53:34,960][1054815] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-10 16:53:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 5722112. Throughput: 0: 8395.9. Samples: 5718016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:53:38,348][1054527] Avg episode reward: [(0, '4334.265')] [2023-03-10 16:53:39,667][1054815] Updated weights for policy 0, policy_version 11200 (0.0006) [2023-03-10 16:53:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 5767168. Throughput: 0: 8404.8. Samples: 5743976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:53:43,348][1054527] Avg episode reward: [(0, '4195.832')] [2023-03-10 16:53:44,239][1054815] Updated weights for policy 0, policy_version 11280 (0.0004) [2023-03-10 16:53:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 5808128. Throughput: 0: 8486.1. Samples: 5798120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:53:48,348][1054527] Avg episode reward: [(0, '4189.855')] [2023-03-10 16:53:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011344_5808128.pth... [2023-03-10 16:53:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000010848_5554176.pth [2023-03-10 16:53:48,931][1054815] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-10 16:53:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 5853184. Throughput: 0: 8511.0. Samples: 5849744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:53:53,348][1054527] Avg episode reward: [(0, '4317.705')] [2023-03-10 16:53:53,707][1054815] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-10 16:53:58,150][1054815] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-10 16:53:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 5898240. Throughput: 0: 8550.4. Samples: 5877260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:53:58,348][1054527] Avg episode reward: [(0, '4057.525')] [2023-03-10 16:54:03,266][1054815] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-10 16:54:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 5939200. Throughput: 0: 8556.1. Samples: 5926920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:54:03,349][1054527] Avg episode reward: [(0, '4490.859')] [2023-03-10 16:54:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011600_5939200.pth... [2023-03-10 16:54:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011088_5677056.pth [2023-03-10 16:54:07,987][1054815] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-10 16:54:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.4, 300 sec: 8539.1). Total num frames: 5980160. Throughput: 0: 8636.1. Samples: 5979728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:54:08,348][1054527] Avg episode reward: [(0, '4297.234')] [2023-03-10 16:54:12,635][1054815] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-10 16:54:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 6025216. Throughput: 0: 8666.0. Samples: 6004736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:13,348][1054527] Avg episode reward: [(0, '4109.353')] [2023-03-10 16:54:17,472][1054815] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-10 16:54:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 6066176. Throughput: 0: 8700.1. Samples: 6057416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:18,349][1054527] Avg episode reward: [(0, '3902.517')] [2023-03-10 16:54:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011848_6066176.pth... [2023-03-10 16:54:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011344_5808128.pth [2023-03-10 16:54:22,230][1054815] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-10 16:54:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 6111232. Throughput: 0: 8663.8. Samples: 6107888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:54:23,348][1054527] Avg episode reward: [(0, '3998.460')] [2023-03-10 16:54:27,026][1054815] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-10 16:54:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 6152192. Throughput: 0: 8648.8. Samples: 6133172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:54:28,348][1054527] Avg episode reward: [(0, '4385.121')] [2023-03-10 16:54:31,870][1054815] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-10 16:54:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 6197248. Throughput: 0: 8595.6. Samples: 6184920. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:54:33,348][1054527] Avg episode reward: [(0, '4348.078')] [2023-03-10 16:54:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012104_6197248.pth... [2023-03-10 16:54:33,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011600_5939200.pth [2023-03-10 16:54:36,572][1054815] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-10 16:54:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 6238208. Throughput: 0: 8630.0. Samples: 6238092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:54:38,348][1054527] Avg episode reward: [(0, '4468.416')] [2023-03-10 16:54:41,261][1054815] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-10 16:54:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 6283264. Throughput: 0: 8569.5. Samples: 6262888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:43,348][1054527] Avg episode reward: [(0, '4105.915')] [2023-03-10 16:54:45,972][1054815] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-10 16:54:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 6328320. Throughput: 0: 8640.7. Samples: 6315752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:48,348][1054527] Avg episode reward: [(0, '4183.813')] [2023-03-10 16:54:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012360_6328320.pth... [2023-03-10 16:54:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000011848_6066176.pth [2023-03-10 16:54:50,543][1054815] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-10 16:54:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 6369280. Throughput: 0: 8619.7. Samples: 6367616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:53,348][1054527] Avg episode reward: [(0, '4349.313')] [2023-03-10 16:54:55,304][1054815] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-10 16:54:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 6414336. Throughput: 0: 8648.6. Samples: 6393920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:54:58,348][1054527] Avg episode reward: [(0, '3027.993')] [2023-03-10 16:55:00,061][1054815] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-10 16:55:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 6455296. Throughput: 0: 8642.3. Samples: 6446320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:03,348][1054527] Avg episode reward: [(0, '4096.131')] [2023-03-10 16:55:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012608_6455296.pth... [2023-03-10 16:55:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012104_6197248.pth [2023-03-10 16:55:04,782][1054815] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-10 16:55:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 6500352. Throughput: 0: 8698.1. Samples: 6499300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:08,348][1054527] Avg episode reward: [(0, '4144.670')] [2023-03-10 16:55:09,398][1054815] Updated weights for policy 0, policy_version 12720 (0.0006) [2023-03-10 16:55:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 6545408. Throughput: 0: 8705.9. Samples: 6524936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:13,348][1054527] Avg episode reward: [(0, '3990.272')] [2023-03-10 16:55:14,085][1054815] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-10 16:55:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 6590464. Throughput: 0: 8736.2. Samples: 6578048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:18,348][1054527] Avg episode reward: [(0, '3779.267')] [2023-03-10 16:55:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012872_6590464.pth... [2023-03-10 16:55:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012360_6328320.pth [2023-03-10 16:55:18,754][1054815] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-10 16:55:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 6631424. Throughput: 0: 8693.4. Samples: 6629296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:23,348][1054527] Avg episode reward: [(0, '3848.190')] [2023-03-10 16:55:23,446][1054815] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-10 16:55:27,735][1054815] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-10 16:55:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 6680576. Throughput: 0: 8762.4. Samples: 6657196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:28,348][1054527] Avg episode reward: [(0, '4335.776')] [2023-03-10 16:55:32,263][1054815] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-10 16:55:33,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 6725632. Throughput: 0: 8827.2. Samples: 6712976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:33,348][1054527] Avg episode reward: [(0, '3874.294')] [2023-03-10 16:55:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013136_6725632.pth... [2023-03-10 16:55:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012608_6455296.pth [2023-03-10 16:55:36,979][1054815] Updated weights for policy 0, policy_version 13200 (0.0005) [2023-03-10 16:55:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 6766592. Throughput: 0: 8854.6. Samples: 6766072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:38,348][1054527] Avg episode reward: [(0, '3699.586')] [2023-03-10 16:55:41,706][1054815] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-10 16:55:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8636.4). Total num frames: 6811648. Throughput: 0: 8829.1. Samples: 6791232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:43,348][1054527] Avg episode reward: [(0, '4080.954')] [2023-03-10 16:55:46,114][1054815] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-10 16:55:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8650.2). Total num frames: 6856704. Throughput: 0: 8886.5. Samples: 6846212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:48,348][1054527] Avg episode reward: [(0, '3917.055')] [2023-03-10 16:55:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013392_6856704.pth... [2023-03-10 16:55:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000012872_6590464.pth [2023-03-10 16:55:50,894][1054815] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-10 16:55:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 6901760. Throughput: 0: 8866.8. Samples: 6898308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:55:53,348][1054527] Avg episode reward: [(0, '3671.998')] [2023-03-10 16:55:55,555][1054815] Updated weights for policy 0, policy_version 13520 (0.0005) [2023-03-10 16:55:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8664.1). Total num frames: 6946816. Throughput: 0: 8886.0. Samples: 6924804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:55:58,348][1054527] Avg episode reward: [(0, '3652.084')] [2023-03-10 16:56:00,158][1054815] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-10 16:56:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8664.1). Total num frames: 6991872. Throughput: 0: 8916.5. Samples: 6979292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 16:56:03,348][1054527] Avg episode reward: [(0, '3781.439')] [2023-03-10 16:56:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013656_6991872.pth... [2023-03-10 16:56:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013136_6725632.pth [2023-03-10 16:56:04,634][1054815] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-10 16:56:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 7032832. Throughput: 0: 8927.1. Samples: 7031016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:56:08,348][1054527] Avg episode reward: [(0, '3873.755')] [2023-03-10 16:56:09,554][1054815] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-10 16:56:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8650.2). Total num frames: 7073792. Throughput: 0: 8865.6. Samples: 7056148. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 16:56:13,349][1054527] Avg episode reward: [(0, '4130.622')] [2023-03-10 16:56:14,284][1054815] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-10 16:56:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8650.2). Total num frames: 7118848. Throughput: 0: 8825.7. Samples: 7110132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:56:18,348][1054527] Avg episode reward: [(0, '3814.334')] [2023-03-10 16:56:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013904_7118848.pth... [2023-03-10 16:56:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013392_6856704.pth [2023-03-10 16:56:18,890][1054815] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-10 16:56:23,298][1054815] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-10 16:56:23,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8942.9, 300 sec: 8664.1). Total num frames: 7168000. Throughput: 0: 8822.6. Samples: 7163088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:56:23,348][1054527] Avg episode reward: [(0, '3912.407')] [2023-03-10 16:56:27,809][1054815] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-10 16:56:28,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 7213056. Throughput: 0: 8900.3. Samples: 7191744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:56:28,348][1054527] Avg episode reward: [(0, '4074.157')] [2023-03-10 16:56:32,406][1054815] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-10 16:56:33,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 7258112. Throughput: 0: 8873.2. Samples: 7245508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:56:33,349][1054527] Avg episode reward: [(0, '4214.364')] [2023-03-10 16:56:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014176_7258112.pth... [2023-03-10 16:56:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013656_6991872.pth [2023-03-10 16:56:37,029][1054815] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-10 16:56:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 7299072. Throughput: 0: 8895.3. Samples: 7298596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:56:38,348][1054527] Avg episode reward: [(0, '4054.931')] [2023-03-10 16:56:41,821][1054815] Updated weights for policy 0, policy_version 14320 (0.0004) [2023-03-10 16:56:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8691.9). Total num frames: 7344128. Throughput: 0: 8863.4. Samples: 7323656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:56:43,348][1054527] Avg episode reward: [(0, '4377.258')] [2023-03-10 16:56:46,783][1054815] Updated weights for policy 0, policy_version 14400 (0.0004) [2023-03-10 16:56:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 7385088. Throughput: 0: 8746.0. Samples: 7372864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:56:48,348][1054527] Avg episode reward: [(0, '4234.874')] [2023-03-10 16:56:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014424_7385088.pth... [2023-03-10 16:56:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000013904_7118848.pth [2023-03-10 16:56:51,500][1054815] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-10 16:56:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 7426048. Throughput: 0: 8776.8. Samples: 7425972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:56:53,349][1054527] Avg episode reward: [(0, '4140.949')] [2023-03-10 16:56:56,051][1054815] Updated weights for policy 0, policy_version 14560 (0.0005) [2023-03-10 16:56:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 7471104. Throughput: 0: 8800.3. Samples: 7452160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 16:56:58,348][1054527] Avg episode reward: [(0, '4194.645')] [2023-03-10 16:57:00,729][1054815] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-10 16:57:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 7516160. Throughput: 0: 8769.1. Samples: 7504744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:57:03,349][1054527] Avg episode reward: [(0, '4249.112')] [2023-03-10 16:57:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014680_7516160.pth... [2023-03-10 16:57:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014176_7258112.pth [2023-03-10 16:57:05,519][1054815] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-10 16:57:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 7561216. Throughput: 0: 8802.7. Samples: 7559208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 16:57:08,348][1054527] Avg episode reward: [(0, '4236.663')] [2023-03-10 16:57:09,927][1054815] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-10 16:57:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 7606272. Throughput: 0: 8756.8. Samples: 7585800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:13,348][1054527] Avg episode reward: [(0, '3736.473')] [2023-03-10 16:57:14,824][1054815] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-10 16:57:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 7647232. Throughput: 0: 8708.4. Samples: 7637384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:18,348][1054527] Avg episode reward: [(0, '4402.134')] [2023-03-10 16:57:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014936_7647232.pth... [2023-03-10 16:57:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014424_7385088.pth [2023-03-10 16:57:19,301][1054815] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-10 16:57:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8705.7). Total num frames: 7696384. Throughput: 0: 8748.2. Samples: 7692264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:23,348][1054527] Avg episode reward: [(0, '4372.687')] [2023-03-10 16:57:23,846][1054815] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-10 16:57:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8691.9). Total num frames: 7737344. Throughput: 0: 8738.0. Samples: 7716864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:28,348][1054527] Avg episode reward: [(0, '4485.782')] [2023-03-10 16:57:28,713][1054815] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-10 16:57:33,118][1054815] Updated weights for policy 0, policy_version 15200 (0.0005) [2023-03-10 16:57:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 7782400. Throughput: 0: 8829.3. Samples: 7770184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:33,348][1054527] Avg episode reward: [(0, '4039.827')] [2023-03-10 16:57:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015200_7782400.pth... [2023-03-10 16:57:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014680_7516160.pth [2023-03-10 16:57:37,658][1054815] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-10 16:57:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8719.6). Total num frames: 7827456. Throughput: 0: 8859.9. Samples: 7824668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:38,348][1054527] Avg episode reward: [(0, '4075.227')] [2023-03-10 16:57:42,714][1054815] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-10 16:57:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 7868416. Throughput: 0: 8823.1. Samples: 7849200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:43,348][1054527] Avg episode reward: [(0, '4513.453')] [2023-03-10 16:57:47,707][1054815] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-10 16:57:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 7909376. Throughput: 0: 8740.8. Samples: 7898080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:48,348][1054527] Avg episode reward: [(0, '4493.873')] [2023-03-10 16:57:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015448_7909376.pth... [2023-03-10 16:57:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000014936_7647232.pth [2023-03-10 16:57:52,357][1054815] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-10 16:57:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8691.9). Total num frames: 7950336. Throughput: 0: 8690.0. Samples: 7950256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:57:53,348][1054527] Avg episode reward: [(0, '3401.236')] [2023-03-10 16:57:57,406][1054815] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-10 16:57:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 7991296. Throughput: 0: 8645.6. Samples: 7974852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:57:58,348][1054527] Avg episode reward: [(0, '4069.618')] [2023-03-10 16:58:02,208][1054815] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-10 16:58:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 8036352. Throughput: 0: 8611.9. Samples: 8024920. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:03,348][1054527] Avg episode reward: [(0, '3788.102')] [2023-03-10 16:58:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015696_8036352.pth... [2023-03-10 16:58:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015200_7782400.pth [2023-03-10 16:58:06,718][1054815] Updated weights for policy 0, policy_version 15760 (0.0006) [2023-03-10 16:58:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 8081408. Throughput: 0: 8606.8. Samples: 8079572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:08,348][1054527] Avg episode reward: [(0, '4426.678')] [2023-03-10 16:58:11,430][1054815] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-10 16:58:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 8126464. Throughput: 0: 8617.5. Samples: 8104652. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:13,348][1054527] Avg episode reward: [(0, '4253.736')] [2023-03-10 16:58:15,893][1054815] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-10 16:58:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 8171520. Throughput: 0: 8643.9. Samples: 8159160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:18,348][1054527] Avg episode reward: [(0, '3945.753')] [2023-03-10 16:58:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015960_8171520.pth... [2023-03-10 16:58:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015448_7909376.pth [2023-03-10 16:58:20,533][1054815] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-10 16:58:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8747.4). Total num frames: 8212480. Throughput: 0: 8601.5. Samples: 8211736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:23,348][1054527] Avg episode reward: [(0, '4189.075')] [2023-03-10 16:58:25,599][1054815] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-10 16:58:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 8257536. Throughput: 0: 8577.1. Samples: 8235168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 16:58:28,348][1054527] Avg episode reward: [(0, '4125.881')] [2023-03-10 16:58:29,960][1054815] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-10 16:58:33,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8298496. Throughput: 0: 8716.1. Samples: 8290304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:58:33,348][1054527] Avg episode reward: [(0, '4382.946')] [2023-03-10 16:58:33,396][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016216_8302592.pth... [2023-03-10 16:58:33,398][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015696_8036352.pth [2023-03-10 16:58:34,944][1054815] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-10 16:58:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8343552. Throughput: 0: 8648.3. Samples: 8339428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:58:38,348][1054527] Avg episode reward: [(0, '4306.051')] [2023-03-10 16:58:39,775][1054815] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-10 16:58:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8384512. Throughput: 0: 8712.8. Samples: 8366928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:58:43,348][1054527] Avg episode reward: [(0, '4434.482')] [2023-03-10 16:58:44,423][1054815] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-10 16:58:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8601.6, 300 sec: 8719.6). Total num frames: 8425472. Throughput: 0: 8720.5. Samples: 8417344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:58:48,348][1054527] Avg episode reward: [(0, '3120.177')] [2023-03-10 16:58:48,387][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016464_8429568.pth... [2023-03-10 16:58:48,389][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000015960_8171520.pth [2023-03-10 16:58:49,397][1054815] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-10 16:58:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 8470528. Throughput: 0: 8606.8. Samples: 8466876. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 16:58:53,348][1054527] Avg episode reward: [(0, '2347.709')] [2023-03-10 16:58:54,121][1054815] Updated weights for policy 0, policy_version 16560 (0.0006) [2023-03-10 16:58:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 8511488. Throughput: 0: 8646.8. Samples: 8493756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:58:58,348][1054527] Avg episode reward: [(0, '3232.394')] [2023-03-10 16:58:58,860][1054815] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-10 16:59:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 8556544. Throughput: 0: 8577.9. Samples: 8545164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:03,349][1054527] Avg episode reward: [(0, '3538.020')] [2023-03-10 16:59:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016712_8556544.pth... [2023-03-10 16:59:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016216_8302592.pth [2023-03-10 16:59:03,634][1054815] Updated weights for policy 0, policy_version 16720 (0.0004) [2023-03-10 16:59:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8719.6). Total num frames: 8597504. Throughput: 0: 8571.3. Samples: 8597444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:08,348][1054527] Avg episode reward: [(0, '3940.189')] [2023-03-10 16:59:08,388][1054815] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-10 16:59:12,996][1054815] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-10 16:59:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8642560. Throughput: 0: 8633.5. Samples: 8623676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:13,348][1054527] Avg episode reward: [(0, '4028.651')] [2023-03-10 16:59:17,661][1054815] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-10 16:59:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8687616. Throughput: 0: 8556.2. Samples: 8675336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:18,348][1054527] Avg episode reward: [(0, '3603.495')] [2023-03-10 16:59:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016968_8687616.pth... [2023-03-10 16:59:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016464_8429568.pth [2023-03-10 16:59:22,341][1054815] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-10 16:59:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8728576. Throughput: 0: 8647.9. Samples: 8728584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:23,348][1054527] Avg episode reward: [(0, '3834.536')] [2023-03-10 16:59:27,108][1054815] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-10 16:59:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8733.5). Total num frames: 8773632. Throughput: 0: 8626.0. Samples: 8755100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:28,348][1054527] Avg episode reward: [(0, '4103.379')] [2023-03-10 16:59:31,797][1054815] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-10 16:59:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 8818688. Throughput: 0: 8647.1. Samples: 8806464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:33,348][1054527] Avg episode reward: [(0, '3700.904')] [2023-03-10 16:59:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017224_8818688.pth... [2023-03-10 16:59:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016712_8556544.pth [2023-03-10 16:59:36,366][1054815] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-10 16:59:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 8863744. Throughput: 0: 8729.9. Samples: 8859720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:38,348][1054527] Avg episode reward: [(0, '3553.295')] [2023-03-10 16:59:41,349][1054815] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-10 16:59:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 8904704. Throughput: 0: 8677.0. Samples: 8884224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:43,348][1054527] Avg episode reward: [(0, '4002.544')] [2023-03-10 16:59:45,974][1054815] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-10 16:59:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 8949760. Throughput: 0: 8724.0. Samples: 8937744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:48,348][1054527] Avg episode reward: [(0, '3433.480')] [2023-03-10 16:59:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017480_8949760.pth... [2023-03-10 16:59:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000016968_8687616.pth [2023-03-10 16:59:50,571][1054815] Updated weights for policy 0, policy_version 17520 (0.0006) [2023-03-10 16:59:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 8990720. Throughput: 0: 8736.3. Samples: 8990576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:53,348][1054527] Avg episode reward: [(0, '4060.015')] [2023-03-10 16:59:55,167][1054815] Updated weights for policy 0, policy_version 17600 (0.0004) [2023-03-10 16:59:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 9035776. Throughput: 0: 8741.3. Samples: 9017036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 16:59:58,348][1054527] Avg episode reward: [(0, '4140.231')] [2023-03-10 16:59:59,946][1054815] Updated weights for policy 0, policy_version 17680 (0.0004) [2023-03-10 17:00:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 9076736. Throughput: 0: 8717.9. Samples: 9067640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:03,348][1054527] Avg episode reward: [(0, '4338.982')] [2023-03-10 17:00:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017736_9080832.pth... [2023-03-10 17:00:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017224_8818688.pth [2023-03-10 17:00:04,675][1054815] Updated weights for policy 0, policy_version 17760 (0.0004) [2023-03-10 17:00:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 9121792. Throughput: 0: 8708.8. Samples: 9120480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:08,348][1054527] Avg episode reward: [(0, '4439.936')] [2023-03-10 17:00:09,557][1054815] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-10 17:00:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 9162752. Throughput: 0: 8648.2. Samples: 9144268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:13,348][1054527] Avg episode reward: [(0, '4287.348')] [2023-03-10 17:00:14,371][1054815] Updated weights for policy 0, policy_version 17920 (0.0004) [2023-03-10 17:00:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 9207808. Throughput: 0: 8668.4. Samples: 9196544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:18,348][1054527] Avg episode reward: [(0, '3752.450')] [2023-03-10 17:00:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017984_9207808.pth... [2023-03-10 17:00:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017480_8949760.pth [2023-03-10 17:00:18,999][1054815] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-10 17:00:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 9248768. Throughput: 0: 8639.4. Samples: 9248492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:00:23,348][1054527] Avg episode reward: [(0, '4034.114')] [2023-03-10 17:00:23,785][1054815] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-10 17:00:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 9293824. Throughput: 0: 8655.5. Samples: 9273720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:00:28,348][1054527] Avg episode reward: [(0, '4415.902')] [2023-03-10 17:00:28,634][1054815] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-10 17:00:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 9334784. Throughput: 0: 8620.5. Samples: 9325668. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:00:33,348][1054527] Avg episode reward: [(0, '4118.306')] [2023-03-10 17:00:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018232_9334784.pth... [2023-03-10 17:00:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017736_9080832.pth [2023-03-10 17:00:33,405][1054815] Updated weights for policy 0, policy_version 18240 (0.0006) [2023-03-10 17:00:38,287][1054815] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-10 17:00:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 9379840. Throughput: 0: 8560.7. Samples: 9375808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:38,348][1054527] Avg episode reward: [(0, '3960.746')] [2023-03-10 17:00:43,109][1054815] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-10 17:00:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8691.9). Total num frames: 9420800. Throughput: 0: 8548.8. Samples: 9401732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:00:43,348][1054527] Avg episode reward: [(0, '4225.664')] [2023-03-10 17:00:47,822][1054815] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-10 17:00:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8691.8). Total num frames: 9465856. Throughput: 0: 8565.7. Samples: 9453096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:00:48,348][1054527] Avg episode reward: [(0, '4410.033')] [2023-03-10 17:00:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018488_9465856.pth... [2023-03-10 17:00:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000017984_9207808.pth [2023-03-10 17:00:52,714][1054815] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-10 17:00:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 9506816. Throughput: 0: 8507.1. Samples: 9503300. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:00:53,348][1054527] Avg episode reward: [(0, '4238.442')] [2023-03-10 17:00:57,367][1054815] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-10 17:00:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 9551872. Throughput: 0: 8602.9. Samples: 9531400. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:00:58,348][1054527] Avg episode reward: [(0, '4241.770')] [2023-03-10 17:01:02,173][1054815] Updated weights for policy 0, policy_version 18720 (0.0004) [2023-03-10 17:01:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 9592832. Throughput: 0: 8551.7. Samples: 9581368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:03,348][1054527] Avg episode reward: [(0, '4347.237')] [2023-03-10 17:01:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018736_9592832.pth... [2023-03-10 17:01:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018232_9334784.pth [2023-03-10 17:01:06,908][1054815] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-10 17:01:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8678.0). Total num frames: 9633792. Throughput: 0: 8556.6. Samples: 9633540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:08,348][1054527] Avg episode reward: [(0, '4332.527')] [2023-03-10 17:01:11,703][1054815] Updated weights for policy 0, policy_version 18880 (0.0004) [2023-03-10 17:01:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 9678848. Throughput: 0: 8547.9. Samples: 9658376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:13,348][1054527] Avg episode reward: [(0, '4038.134')] [2023-03-10 17:01:16,489][1054815] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-10 17:01:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 9719808. Throughput: 0: 8559.0. Samples: 9710824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:18,348][1054527] Avg episode reward: [(0, '4247.029')] [2023-03-10 17:01:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018984_9719808.pth... [2023-03-10 17:01:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018488_9465856.pth [2023-03-10 17:01:21,569][1054815] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-10 17:01:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 9760768. Throughput: 0: 8526.7. Samples: 9759508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:23,348][1054527] Avg episode reward: [(0, '4282.766')] [2023-03-10 17:01:26,404][1054815] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-10 17:01:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 9805824. Throughput: 0: 8494.0. Samples: 9783964. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:01:28,348][1054527] Avg episode reward: [(0, '4538.111')] [2023-03-10 17:01:31,157][1054815] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-10 17:01:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 9846784. Throughput: 0: 8504.6. Samples: 9835804. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:01:33,349][1054527] Avg episode reward: [(0, '4101.511')] [2023-03-10 17:01:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019232_9846784.pth... [2023-03-10 17:01:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018736_9592832.pth [2023-03-10 17:01:35,926][1054815] Updated weights for policy 0, policy_version 19280 (0.0004) [2023-03-10 17:01:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 9891840. Throughput: 0: 8541.5. Samples: 9887668. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:01:38,348][1054527] Avg episode reward: [(0, '3861.903')] [2023-03-10 17:01:40,718][1054815] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-10 17:01:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 9932800. Throughput: 0: 8480.4. Samples: 9913020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:01:43,348][1054527] Avg episode reward: [(0, '3714.098')] [2023-03-10 17:01:45,543][1054815] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-10 17:01:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 9973760. Throughput: 0: 8514.2. Samples: 9964508. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:01:48,348][1054527] Avg episode reward: [(0, '3801.010')] [2023-03-10 17:01:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019480_9973760.pth... [2023-03-10 17:01:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000018984_9719808.pth [2023-03-10 17:01:50,545][1054815] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-10 17:01:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 10014720. Throughput: 0: 8448.7. Samples: 10013732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:01:53,348][1054527] Avg episode reward: [(0, '3838.444')] [2023-03-10 17:01:55,450][1054815] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-10 17:01:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 10055680. Throughput: 0: 8455.7. Samples: 10038884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:01:58,348][1054527] Avg episode reward: [(0, '3821.560')] [2023-03-10 17:02:00,390][1054815] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-10 17:02:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8608.5). Total num frames: 10100736. Throughput: 0: 8390.7. Samples: 10088404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:02:03,349][1054527] Avg episode reward: [(0, '3959.019')] [2023-03-10 17:02:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019728_10100736.pth... [2023-03-10 17:02:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019232_9846784.pth [2023-03-10 17:02:05,316][1054815] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-10 17:02:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 10141696. Throughput: 0: 8401.7. Samples: 10137584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:08,348][1054527] Avg episode reward: [(0, '3235.909')] [2023-03-10 17:02:10,233][1054815] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-10 17:02:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 10182656. Throughput: 0: 8425.0. Samples: 10163088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:13,348][1054527] Avg episode reward: [(0, '3461.810')] [2023-03-10 17:02:15,106][1054815] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-10 17:02:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 10223616. Throughput: 0: 8416.0. Samples: 10214524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:18,348][1054527] Avg episode reward: [(0, '4125.863')] [2023-03-10 17:02:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019968_10223616.pth... [2023-03-10 17:02:18,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019480_9973760.pth [2023-03-10 17:02:19,805][1054815] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-10 17:02:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 10268672. Throughput: 0: 8401.6. Samples: 10265740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:02:23,349][1054527] Avg episode reward: [(0, '4185.526')] [2023-03-10 17:02:24,681][1054815] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-10 17:02:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 10309632. Throughput: 0: 8396.4. Samples: 10290860. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:02:28,348][1054527] Avg episode reward: [(0, '4338.534')] [2023-03-10 17:02:29,695][1054815] Updated weights for policy 0, policy_version 20160 (0.0004) [2023-03-10 17:02:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 10350592. Throughput: 0: 8359.4. Samples: 10340680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:02:33,348][1054527] Avg episode reward: [(0, '3769.948')] [2023-03-10 17:02:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020216_10350592.pth... [2023-03-10 17:02:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019728_10100736.pth [2023-03-10 17:02:34,456][1054815] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-10 17:02:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 10391552. Throughput: 0: 8351.1. Samples: 10389532. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:38,348][1054527] Avg episode reward: [(0, '3597.950')] [2023-03-10 17:02:39,550][1054815] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-10 17:02:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 10432512. Throughput: 0: 8354.0. Samples: 10414812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:43,348][1054527] Avg episode reward: [(0, '4236.637')] [2023-03-10 17:02:44,508][1054815] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-10 17:02:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 10477568. Throughput: 0: 8375.0. Samples: 10465280. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:02:48,349][1054527] Avg episode reward: [(0, '4283.985')] [2023-03-10 17:02:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020464_10477568.pth... [2023-03-10 17:02:48,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000019968_10223616.pth [2023-03-10 17:02:49,275][1054815] Updated weights for policy 0, policy_version 20480 (0.0006) [2023-03-10 17:02:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 10518528. Throughput: 0: 8407.9. Samples: 10515940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:02:53,348][1054527] Avg episode reward: [(0, '3911.150')] [2023-03-10 17:02:54,091][1054815] Updated weights for policy 0, policy_version 20560 (0.0006) [2023-03-10 17:02:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 10559488. Throughput: 0: 8443.5. Samples: 10543044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:02:58,348][1054527] Avg episode reward: [(0, '4483.041')] [2023-03-10 17:02:59,012][1054815] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-10 17:03:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 10600448. Throughput: 0: 8346.6. Samples: 10590120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:03:03,349][1054527] Avg episode reward: [(0, '4017.938')] [2023-03-10 17:03:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020704_10600448.pth... [2023-03-10 17:03:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020216_10350592.pth [2023-03-10 17:03:03,990][1054815] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-10 17:03:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 10645504. Throughput: 0: 8345.3. Samples: 10641280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:08,348][1054527] Avg episode reward: [(0, '3677.238')] [2023-03-10 17:03:08,808][1054815] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-10 17:03:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 10686464. Throughput: 0: 8359.8. Samples: 10667052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:13,348][1054527] Avg episode reward: [(0, '3930.597')] [2023-03-10 17:03:13,780][1054815] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-10 17:03:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 10727424. Throughput: 0: 8326.6. Samples: 10715376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:03:18,349][1054527] Avg episode reward: [(0, '4033.412')] [2023-03-10 17:03:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020952_10727424.pth... [2023-03-10 17:03:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020464_10477568.pth [2023-03-10 17:03:18,746][1054815] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-10 17:03:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 10768384. Throughput: 0: 8346.6. Samples: 10765128. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:03:23,348][1054527] Avg episode reward: [(0, '3687.956')] [2023-03-10 17:03:23,765][1054815] Updated weights for policy 0, policy_version 21040 (0.0006) [2023-03-10 17:03:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 10809344. Throughput: 0: 8313.9. Samples: 10788936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:03:28,348][1054527] Avg episode reward: [(0, '4000.057')] [2023-03-10 17:03:28,659][1054815] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-10 17:03:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 10850304. Throughput: 0: 8338.6. Samples: 10840516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:33,348][1054527] Avg episode reward: [(0, '3706.103')] [2023-03-10 17:03:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021192_10850304.pth... [2023-03-10 17:03:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020704_10600448.pth [2023-03-10 17:03:33,664][1054815] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-10 17:03:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 10891264. Throughput: 0: 8252.1. Samples: 10887284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:38,348][1054527] Avg episode reward: [(0, '4135.482')] [2023-03-10 17:03:38,806][1054815] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-10 17:03:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 10932224. Throughput: 0: 8194.7. Samples: 10911808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:43,348][1054527] Avg episode reward: [(0, '3897.642')] [2023-03-10 17:03:43,797][1054815] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-10 17:03:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8483.6). Total num frames: 10973184. Throughput: 0: 8263.5. Samples: 10961976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:48,348][1054527] Avg episode reward: [(0, '4234.615')] [2023-03-10 17:03:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021432_10973184.pth... [2023-03-10 17:03:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000020952_10727424.pth [2023-03-10 17:03:48,592][1054815] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-10 17:03:53,331][1054815] Updated weights for policy 0, policy_version 21520 (0.0004) [2023-03-10 17:03:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 11018240. Throughput: 0: 8284.5. Samples: 11014080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:53,348][1054527] Avg episode reward: [(0, '4071.073')] [2023-03-10 17:03:58,192][1054815] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-10 17:03:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 11059200. Throughput: 0: 8255.2. Samples: 11038536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:03:58,348][1054527] Avg episode reward: [(0, '3978.130')] [2023-03-10 17:04:02,996][1054815] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-10 17:04:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 11100160. Throughput: 0: 8342.8. Samples: 11090800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:03,348][1054527] Avg episode reward: [(0, '4184.779')] [2023-03-10 17:04:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021680_11100160.pth... [2023-03-10 17:04:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021192_10850304.pth [2023-03-10 17:04:07,830][1054815] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-10 17:04:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 11145216. Throughput: 0: 8355.7. Samples: 11141136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:08,348][1054527] Avg episode reward: [(0, '4004.967')] [2023-03-10 17:04:12,758][1054815] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-10 17:04:13,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8328.6, 300 sec: 8469.7). Total num frames: 11186176. Throughput: 0: 8378.7. Samples: 11165976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:13,348][1054527] Avg episode reward: [(0, '3436.778')] [2023-03-10 17:04:17,420][1054815] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-10 17:04:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 11231232. Throughput: 0: 8380.3. Samples: 11217628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:18,348][1054527] Avg episode reward: [(0, '3816.557')] [2023-03-10 17:04:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021936_11231232.pth... [2023-03-10 17:04:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021432_10973184.pth [2023-03-10 17:04:22,107][1054815] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-10 17:04:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 11272192. Throughput: 0: 8501.1. Samples: 11269832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:23,348][1054527] Avg episode reward: [(0, '4310.365')] [2023-03-10 17:04:27,161][1054815] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-10 17:04:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 11313152. Throughput: 0: 8505.4. Samples: 11294548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:28,348][1054527] Avg episode reward: [(0, '4274.900')] [2023-03-10 17:04:31,891][1054815] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-10 17:04:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 11354112. Throughput: 0: 8530.7. Samples: 11345856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:33,348][1054527] Avg episode reward: [(0, '3946.350')] [2023-03-10 17:04:33,381][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022184_11358208.pth... [2023-03-10 17:04:33,384][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021680_11100160.pth [2023-03-10 17:04:36,724][1054815] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-10 17:04:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 11399168. Throughput: 0: 8496.3. Samples: 11396412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:38,348][1054527] Avg episode reward: [(0, '3489.057')] [2023-03-10 17:04:41,523][1054815] Updated weights for policy 0, policy_version 22320 (0.0006) [2023-03-10 17:04:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 11440128. Throughput: 0: 8535.9. Samples: 11422652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:04:43,348][1054527] Avg episode reward: [(0, '4064.081')] [2023-03-10 17:04:46,467][1054815] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-10 17:04:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 11481088. Throughput: 0: 8477.0. Samples: 11472264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:04:48,349][1054527] Avg episode reward: [(0, '4379.299')] [2023-03-10 17:04:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022424_11481088.pth... [2023-03-10 17:04:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000021936_11231232.pth [2023-03-10 17:04:51,408][1054815] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-10 17:04:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 11522048. Throughput: 0: 8463.6. Samples: 11521996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:04:53,348][1054527] Avg episode reward: [(0, '3883.067')] [2023-03-10 17:04:56,247][1054815] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-10 17:04:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 11567104. Throughput: 0: 8459.2. Samples: 11546640. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:04:58,348][1054527] Avg episode reward: [(0, '4270.427')] [2023-03-10 17:05:01,032][1054815] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-10 17:05:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 11608064. Throughput: 0: 8478.8. Samples: 11599172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:05:03,348][1054527] Avg episode reward: [(0, '4235.744')] [2023-03-10 17:05:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022672_11608064.pth... [2023-03-10 17:05:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022184_11358208.pth [2023-03-10 17:05:05,674][1054815] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-10 17:05:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 11653120. Throughput: 0: 8460.9. Samples: 11650572. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:05:08,348][1054527] Avg episode reward: [(0, '3932.353')] [2023-03-10 17:05:10,423][1054815] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-10 17:05:13,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 11698176. Throughput: 0: 8511.5. Samples: 11677568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:05:13,348][1054527] Avg episode reward: [(0, '4003.687')] [2023-03-10 17:05:15,235][1054815] Updated weights for policy 0, policy_version 22880 (0.0004) [2023-03-10 17:05:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 11739136. Throughput: 0: 8489.9. Samples: 11727900. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:18,348][1054527] Avg episode reward: [(0, '3631.326')] [2023-03-10 17:05:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022928_11739136.pth... [2023-03-10 17:05:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022424_11481088.pth [2023-03-10 17:05:20,030][1054815] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-10 17:05:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 11780096. Throughput: 0: 8474.3. Samples: 11777756. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:23,348][1054527] Avg episode reward: [(0, '3774.516')] [2023-03-10 17:05:25,195][1054815] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-10 17:05:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 11821056. Throughput: 0: 8424.1. Samples: 11801736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:28,348][1054527] Avg episode reward: [(0, '3830.450')] [2023-03-10 17:05:29,945][1054815] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-10 17:05:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 11862016. Throughput: 0: 8476.4. Samples: 11853700. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:33,348][1054527] Avg episode reward: [(0, '3738.512')] [2023-03-10 17:05:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023168_11862016.pth... [2023-03-10 17:05:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022672_11608064.pth [2023-03-10 17:05:34,988][1054815] Updated weights for policy 0, policy_version 23200 (0.0006) [2023-03-10 17:05:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 11902976. Throughput: 0: 8421.4. Samples: 11900960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:38,348][1054527] Avg episode reward: [(0, '4118.028')] [2023-03-10 17:05:39,943][1054815] Updated weights for policy 0, policy_version 23280 (0.0005) [2023-03-10 17:05:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 11948032. Throughput: 0: 8463.1. Samples: 11927480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:43,348][1054527] Avg episode reward: [(0, '3610.284')] [2023-03-10 17:05:44,735][1054815] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-10 17:05:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 11988992. Throughput: 0: 8400.7. Samples: 11977204. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:05:48,348][1054527] Avg episode reward: [(0, '2995.214')] [2023-03-10 17:05:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023416_11988992.pth... [2023-03-10 17:05:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000022928_11739136.pth [2023-03-10 17:05:49,708][1054815] Updated weights for policy 0, policy_version 23440 (0.0004) [2023-03-10 17:05:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8400.3). Total num frames: 12029952. Throughput: 0: 8396.8. Samples: 12028428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:05:53,348][1054527] Avg episode reward: [(0, '3689.078')] [2023-03-10 17:05:54,578][1054815] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-10 17:05:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 12075008. Throughput: 0: 8326.7. Samples: 12052268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:05:58,348][1054527] Avg episode reward: [(0, '3654.531')] [2023-03-10 17:05:59,299][1054815] Updated weights for policy 0, policy_version 23600 (0.0004) [2023-03-10 17:06:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8414.2). Total num frames: 12115968. Throughput: 0: 8352.1. Samples: 12103744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:03,348][1054527] Avg episode reward: [(0, '3992.556')] [2023-03-10 17:06:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023664_12115968.pth... [2023-03-10 17:06:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023168_11862016.pth [2023-03-10 17:06:04,186][1054815] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-10 17:06:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12156928. Throughput: 0: 8392.0. Samples: 12155396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:08,348][1054527] Avg episode reward: [(0, '4020.502')] [2023-03-10 17:06:09,079][1054815] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-10 17:06:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8400.3). Total num frames: 12197888. Throughput: 0: 8377.3. Samples: 12178716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:13,348][1054527] Avg episode reward: [(0, '4011.315')] [2023-03-10 17:06:13,900][1054815] Updated weights for policy 0, policy_version 23840 (0.0004) [2023-03-10 17:06:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 12242944. Throughput: 0: 8378.2. Samples: 12230720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:18,349][1054527] Avg episode reward: [(0, '4063.030')] [2023-03-10 17:06:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023912_12242944.pth... [2023-03-10 17:06:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023416_11988992.pth [2023-03-10 17:06:18,660][1054815] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-10 17:06:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12283904. Throughput: 0: 8420.3. Samples: 12279872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:23,348][1054527] Avg episode reward: [(0, '3798.490')] [2023-03-10 17:06:23,780][1054815] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-10 17:06:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12324864. Throughput: 0: 8396.2. Samples: 12305308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:28,348][1054527] Avg episode reward: [(0, '4109.708')] [2023-03-10 17:06:28,539][1054815] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-10 17:06:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8386.4). Total num frames: 12365824. Throughput: 0: 8421.9. Samples: 12356192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:33,348][1054527] Avg episode reward: [(0, '3906.827')] [2023-03-10 17:06:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024152_12365824.pth... [2023-03-10 17:06:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023664_12115968.pth [2023-03-10 17:06:33,412][1054815] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-10 17:06:38,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8386.4). Total num frames: 12406784. Throughput: 0: 8384.6. Samples: 12405736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:38,348][1054527] Avg episode reward: [(0, '3440.562')] [2023-03-10 17:06:38,509][1054815] Updated weights for policy 0, policy_version 24240 (0.0006) [2023-03-10 17:06:43,276][1054815] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-10 17:06:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12451840. Throughput: 0: 8420.7. Samples: 12431200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:43,348][1054527] Avg episode reward: [(0, '4391.605')] [2023-03-10 17:06:48,086][1054815] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-10 17:06:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12492800. Throughput: 0: 8397.4. Samples: 12481628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:48,348][1054527] Avg episode reward: [(0, '3990.502')] [2023-03-10 17:06:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024400_12492800.pth... [2023-03-10 17:06:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000023912_12242944.pth [2023-03-10 17:06:52,876][1054815] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-10 17:06:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 12537856. Throughput: 0: 8407.8. Samples: 12533748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:53,348][1054527] Avg episode reward: [(0, '3776.964')] [2023-03-10 17:06:57,690][1054815] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-10 17:06:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12578816. Throughput: 0: 8446.4. Samples: 12558804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:06:58,348][1054527] Avg episode reward: [(0, '4192.630')] [2023-03-10 17:07:02,616][1054815] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-10 17:07:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12619776. Throughput: 0: 8421.5. Samples: 12609688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:03,348][1054527] Avg episode reward: [(0, '4127.267')] [2023-03-10 17:07:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024648_12619776.pth... [2023-03-10 17:07:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024152_12365824.pth [2023-03-10 17:07:07,799][1054815] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-10 17:07:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12660736. Throughput: 0: 8374.1. Samples: 12656704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:08,348][1054527] Avg episode reward: [(0, '4325.978')] [2023-03-10 17:07:12,917][1054815] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-10 17:07:13,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 12697600. Throughput: 0: 8337.9. Samples: 12680516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:13,348][1054527] Avg episode reward: [(0, '4403.651')] [2023-03-10 17:07:17,885][1054815] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-10 17:07:18,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 12738560. Throughput: 0: 8316.5. Samples: 12730432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:18,348][1054527] Avg episode reward: [(0, '4494.079')] [2023-03-10 17:07:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024880_12738560.pth... [2023-03-10 17:07:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024400_12492800.pth [2023-03-10 17:07:22,834][1054815] Updated weights for policy 0, policy_version 24960 (0.0006) [2023-03-10 17:07:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 12779520. Throughput: 0: 8306.8. Samples: 12779540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:23,348][1054527] Avg episode reward: [(0, '4280.683')] [2023-03-10 17:07:27,781][1054815] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-10 17:07:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 12824576. Throughput: 0: 8286.7. Samples: 12804104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:07:28,349][1054527] Avg episode reward: [(0, '4383.866')] [2023-03-10 17:07:32,442][1054815] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-10 17:07:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 12865536. Throughput: 0: 8316.4. Samples: 12855868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:07:33,348][1054527] Avg episode reward: [(0, '3957.260')] [2023-03-10 17:07:33,362][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025136_12869632.pth... [2023-03-10 17:07:33,364][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024648_12619776.pth [2023-03-10 17:07:37,374][1054815] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-10 17:07:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 12910592. Throughput: 0: 8283.5. Samples: 12906504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:07:38,348][1054527] Avg episode reward: [(0, '3481.706')] [2023-03-10 17:07:42,390][1054815] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-10 17:07:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 12947456. Throughput: 0: 8274.1. Samples: 12931136. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:07:43,359][1054527] Avg episode reward: [(0, '4058.318')] [2023-03-10 17:07:47,346][1054815] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-10 17:07:48,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 12988416. Throughput: 0: 8234.4. Samples: 12980236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:48,348][1054527] Avg episode reward: [(0, '4047.827')] [2023-03-10 17:07:48,384][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025376_12992512.pth... [2023-03-10 17:07:48,386][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000024880_12738560.pth [2023-03-10 17:07:52,393][1054815] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-10 17:07:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 13029376. Throughput: 0: 8274.8. Samples: 13029068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:53,348][1054527] Avg episode reward: [(0, '4051.216')] [2023-03-10 17:07:57,684][1054815] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-10 17:07:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 13070336. Throughput: 0: 8247.7. Samples: 13051664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:07:58,348][1054527] Avg episode reward: [(0, '3854.148')] [2023-03-10 17:08:02,907][1054815] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-10 17:08:03,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8123.7, 300 sec: 8344.7). Total num frames: 13107200. Throughput: 0: 8188.7. Samples: 13098924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:08:03,348][1054527] Avg episode reward: [(0, '3419.836')] [2023-03-10 17:08:03,388][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025608_13111296.pth... [2023-03-10 17:08:03,390][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025136_12869632.pth [2023-03-10 17:08:07,852][1054815] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-10 17:08:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 13152256. Throughput: 0: 8191.5. Samples: 13148160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:08:08,348][1054527] Avg episode reward: [(0, '3489.787')] [2023-03-10 17:08:12,651][1054815] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-10 17:08:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 13193216. Throughput: 0: 8225.2. Samples: 13174236. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:08:13,348][1054527] Avg episode reward: [(0, '4093.090')] [2023-03-10 17:08:17,742][1054815] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-10 17:08:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 13234176. Throughput: 0: 8133.4. Samples: 13221872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:08:18,348][1054527] Avg episode reward: [(0, '3864.730')] [2023-03-10 17:08:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025848_13234176.pth... [2023-03-10 17:08:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025376_12992512.pth [2023-03-10 17:08:22,766][1054815] Updated weights for policy 0, policy_version 25920 (0.0004) [2023-03-10 17:08:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 13275136. Throughput: 0: 8103.6. Samples: 13271164. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:08:23,348][1054527] Avg episode reward: [(0, '3241.159')] [2023-03-10 17:08:27,675][1054815] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-10 17:08:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 13316096. Throughput: 0: 8101.1. Samples: 13295688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:08:28,348][1054527] Avg episode reward: [(0, '3406.763')] [2023-03-10 17:08:32,209][1054815] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-10 17:08:33,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8260.2, 300 sec: 8372.5). Total num frames: 13361152. Throughput: 0: 8197.0. Samples: 13349104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:08:33,349][1054527] Avg episode reward: [(0, '3700.719')] [2023-03-10 17:08:33,354][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026096_13361152.pth... [2023-03-10 17:08:33,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025608_13111296.pth [2023-03-10 17:08:36,836][1054815] Updated weights for policy 0, policy_version 26160 (0.0006) [2023-03-10 17:08:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 13402112. Throughput: 0: 8285.0. Samples: 13401892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:08:38,349][1054527] Avg episode reward: [(0, '2863.933')] [2023-03-10 17:08:41,759][1054815] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-10 17:08:43,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 13447168. Throughput: 0: 8334.1. Samples: 13426696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:08:43,348][1054527] Avg episode reward: [(0, '2784.721')] [2023-03-10 17:08:46,691][1054815] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-10 17:08:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8372.5). Total num frames: 13488128. Throughput: 0: 8398.7. Samples: 13476868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:08:48,349][1054527] Avg episode reward: [(0, '3572.717')] [2023-03-10 17:08:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026344_13488128.pth... [2023-03-10 17:08:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000025848_13234176.pth [2023-03-10 17:08:51,544][1054815] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-10 17:08:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8372.5). Total num frames: 13529088. Throughput: 0: 8449.4. Samples: 13528384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:08:53,348][1054527] Avg episode reward: [(0, '4206.654')] [2023-03-10 17:08:56,671][1054815] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-10 17:08:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8372.5). Total num frames: 13570048. Throughput: 0: 8367.8. Samples: 13550788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:08:58,348][1054527] Avg episode reward: [(0, '3778.046')] [2023-03-10 17:09:01,489][1054815] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-10 17:09:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 13611008. Throughput: 0: 8451.3. Samples: 13602180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:09:03,348][1054527] Avg episode reward: [(0, '3757.910')] [2023-03-10 17:09:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026584_13611008.pth... [2023-03-10 17:09:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026096_13361152.pth [2023-03-10 17:09:06,270][1054815] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-10 17:09:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 13656064. Throughput: 0: 8497.9. Samples: 13653572. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:09:08,348][1054527] Avg episode reward: [(0, '3804.187')] [2023-03-10 17:09:11,060][1054815] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-10 17:09:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 13697024. Throughput: 0: 8502.0. Samples: 13678276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:13,348][1054527] Avg episode reward: [(0, '3825.366')] [2023-03-10 17:09:15,704][1054815] Updated weights for policy 0, policy_version 26800 (0.0004) [2023-03-10 17:09:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 13742080. Throughput: 0: 8478.7. Samples: 13730644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:18,348][1054527] Avg episode reward: [(0, '3695.090')] [2023-03-10 17:09:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026840_13742080.pth... [2023-03-10 17:09:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026344_13488128.pth [2023-03-10 17:09:20,405][1054815] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-10 17:09:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 13787136. Throughput: 0: 8483.6. Samples: 13783656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:23,349][1054527] Avg episode reward: [(0, '2721.594')] [2023-03-10 17:09:25,271][1054815] Updated weights for policy 0, policy_version 26960 (0.0006) [2023-03-10 17:09:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 13828096. Throughput: 0: 8468.5. Samples: 13807780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:28,348][1054527] Avg episode reward: [(0, '3829.874')] [2023-03-10 17:09:30,122][1054815] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-10 17:09:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 13869056. Throughput: 0: 8445.3. Samples: 13856904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:33,348][1054527] Avg episode reward: [(0, '4124.119')] [2023-03-10 17:09:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027088_13869056.pth... [2023-03-10 17:09:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026584_13611008.pth [2023-03-10 17:09:35,253][1054815] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-10 17:09:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 13910016. Throughput: 0: 8416.3. Samples: 13907120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:38,348][1054527] Avg episode reward: [(0, '3427.150')] [2023-03-10 17:09:40,057][1054815] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-10 17:09:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 13950976. Throughput: 0: 8504.6. Samples: 13933496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:43,348][1054527] Avg episode reward: [(0, '4244.708')] [2023-03-10 17:09:45,032][1054815] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-10 17:09:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 13991936. Throughput: 0: 8444.6. Samples: 13982184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:48,348][1054527] Avg episode reward: [(0, '4249.233')] [2023-03-10 17:09:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027328_13991936.pth... [2023-03-10 17:09:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000026840_13742080.pth [2023-03-10 17:09:49,904][1054815] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-10 17:09:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 14036992. Throughput: 0: 8448.4. Samples: 14033748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:53,348][1054527] Avg episode reward: [(0, '4110.737')] [2023-03-10 17:09:54,591][1054815] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-10 17:09:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 14077952. Throughput: 0: 8486.5. Samples: 14060168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:09:58,348][1054527] Avg episode reward: [(0, '3875.475')] [2023-03-10 17:09:59,417][1054815] Updated weights for policy 0, policy_version 27520 (0.0005) [2023-03-10 17:10:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8372.5). Total num frames: 14123008. Throughput: 0: 8447.4. Samples: 14110776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:10:03,348][1054527] Avg episode reward: [(0, '4118.121')] [2023-03-10 17:10:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027584_14123008.pth... [2023-03-10 17:10:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027088_13869056.pth [2023-03-10 17:10:04,210][1054815] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-10 17:10:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8358.6). Total num frames: 14163968. Throughput: 0: 8382.7. Samples: 14160876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:10:08,348][1054527] Avg episode reward: [(0, '4038.343')] [2023-03-10 17:10:09,174][1054815] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-10 17:10:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8358.6). Total num frames: 14204928. Throughput: 0: 8411.7. Samples: 14186308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:10:13,348][1054527] Avg episode reward: [(0, '4486.034')] [2023-03-10 17:10:14,115][1054815] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-10 17:10:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 14245888. Throughput: 0: 8449.5. Samples: 14237132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:10:18,348][1054527] Avg episode reward: [(0, '4380.307')] [2023-03-10 17:10:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027824_14245888.pth... [2023-03-10 17:10:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027328_13991936.pth [2023-03-10 17:10:18,825][1054815] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-10 17:10:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 14290944. Throughput: 0: 8476.1. Samples: 14288544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:10:23,349][1054527] Avg episode reward: [(0, '3833.503')] [2023-03-10 17:10:23,677][1054815] Updated weights for policy 0, policy_version 27920 (0.0005) [2023-03-10 17:10:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 14331904. Throughput: 0: 8419.1. Samples: 14312356. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:10:28,348][1054527] Avg episode reward: [(0, '4267.163')] [2023-03-10 17:10:28,531][1054815] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-10 17:10:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 14372864. Throughput: 0: 8463.2. Samples: 14363028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:10:33,349][1054527] Avg episode reward: [(0, '4125.417')] [2023-03-10 17:10:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028072_14372864.pth... [2023-03-10 17:10:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027584_14123008.pth [2023-03-10 17:10:33,586][1054815] Updated weights for policy 0, policy_version 28080 (0.0005) [2023-03-10 17:10:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 14413824. Throughput: 0: 8427.9. Samples: 14413004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:10:38,348][1054527] Avg episode reward: [(0, '3674.361')] [2023-03-10 17:10:38,466][1054815] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-10 17:10:43,282][1054815] Updated weights for policy 0, policy_version 28240 (0.0006) [2023-03-10 17:10:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 14458880. Throughput: 0: 8406.8. Samples: 14438472. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:10:43,348][1054527] Avg episode reward: [(0, '4165.423')] [2023-03-10 17:10:48,152][1054815] Updated weights for policy 0, policy_version 28320 (0.0005) [2023-03-10 17:10:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8372.5). Total num frames: 14499840. Throughput: 0: 8373.1. Samples: 14487564. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:10:48,348][1054527] Avg episode reward: [(0, '3996.431')] [2023-03-10 17:10:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028320_14499840.pth... [2023-03-10 17:10:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000027824_14245888.pth [2023-03-10 17:10:52,819][1054815] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-10 17:10:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 14544896. Throughput: 0: 8442.9. Samples: 14540808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:10:53,348][1054527] Avg episode reward: [(0, '3988.065')] [2023-03-10 17:10:57,574][1054815] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-10 17:10:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 14585856. Throughput: 0: 8466.8. Samples: 14567312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:10:58,348][1054527] Avg episode reward: [(0, '3660.389')] [2023-03-10 17:11:02,196][1054815] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-10 17:11:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8386.4). Total num frames: 14630912. Throughput: 0: 8493.1. Samples: 14619324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:03,349][1054527] Avg episode reward: [(0, '4177.768')] [2023-03-10 17:11:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028576_14630912.pth... [2023-03-10 17:11:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028072_14372864.pth [2023-03-10 17:11:07,082][1054815] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-10 17:11:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8386.4). Total num frames: 14671872. Throughput: 0: 8487.7. Samples: 14670492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:08,348][1054527] Avg episode reward: [(0, '4142.509')] [2023-03-10 17:11:11,889][1054815] Updated weights for policy 0, policy_version 28720 (0.0006) [2023-03-10 17:11:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 14716928. Throughput: 0: 8525.3. Samples: 14695996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:13,348][1054527] Avg episode reward: [(0, '4018.667')] [2023-03-10 17:11:16,665][1054815] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-10 17:11:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 14757888. Throughput: 0: 8532.4. Samples: 14746984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:18,348][1054527] Avg episode reward: [(0, '3890.399')] [2023-03-10 17:11:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028824_14757888.pth... [2023-03-10 17:11:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028320_14499840.pth [2023-03-10 17:11:21,252][1054815] Updated weights for policy 0, policy_version 28880 (0.0006) [2023-03-10 17:11:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 14802944. Throughput: 0: 8593.7. Samples: 14799720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:23,348][1054527] Avg episode reward: [(0, '3771.097')] [2023-03-10 17:11:25,781][1054815] Updated weights for policy 0, policy_version 28960 (0.0005) [2023-03-10 17:11:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 14848000. Throughput: 0: 8647.1. Samples: 14827592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:28,348][1054527] Avg episode reward: [(0, '3930.778')] [2023-03-10 17:11:30,605][1054815] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-10 17:11:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 14888960. Throughput: 0: 8701.0. Samples: 14879108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:33,349][1054527] Avg episode reward: [(0, '3431.625')] [2023-03-10 17:11:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029080_14888960.pth... [2023-03-10 17:11:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028576_14630912.pth [2023-03-10 17:11:35,484][1054815] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-10 17:11:38,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8669.8, 300 sec: 8414.2). Total num frames: 14934016. Throughput: 0: 8648.3. Samples: 14929984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:38,349][1054527] Avg episode reward: [(0, '3564.609')] [2023-03-10 17:11:40,078][1054815] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-10 17:11:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 14974976. Throughput: 0: 8661.7. Samples: 14957088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:43,348][1054527] Avg episode reward: [(0, '3449.765')] [2023-03-10 17:11:44,977][1054815] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-10 17:11:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 15015936. Throughput: 0: 8623.8. Samples: 15007396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:48,348][1054527] Avg episode reward: [(0, '4111.917')] [2023-03-10 17:11:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029328_15015936.pth... [2023-03-10 17:11:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000028824_14757888.pth [2023-03-10 17:11:49,936][1054815] Updated weights for policy 0, policy_version 29360 (0.0006) [2023-03-10 17:11:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 15060992. Throughput: 0: 8586.8. Samples: 15056896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:53,348][1054527] Avg episode reward: [(0, '3988.675')] [2023-03-10 17:11:54,842][1054815] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-10 17:11:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 15101952. Throughput: 0: 8592.5. Samples: 15082656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:11:58,348][1054527] Avg episode reward: [(0, '4123.069')] [2023-03-10 17:11:59,373][1054815] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-10 17:12:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 15147008. Throughput: 0: 8616.4. Samples: 15134720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:12:03,349][1054527] Avg episode reward: [(0, '4012.557')] [2023-03-10 17:12:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029584_15147008.pth... [2023-03-10 17:12:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029080_14888960.pth [2023-03-10 17:12:04,219][1054815] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-10 17:12:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 15187968. Throughput: 0: 8557.8. Samples: 15184820. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:12:08,348][1054527] Avg episode reward: [(0, '3952.788')] [2023-03-10 17:12:09,022][1054815] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-10 17:12:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 15228928. Throughput: 0: 8530.3. Samples: 15211456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:12:13,348][1054527] Avg episode reward: [(0, '3888.918')] [2023-03-10 17:12:13,860][1054815] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-10 17:12:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 15273984. Throughput: 0: 8503.4. Samples: 15261760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:12:18,348][1054527] Avg episode reward: [(0, '3349.426')] [2023-03-10 17:12:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029832_15273984.pth... [2023-03-10 17:12:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029328_15015936.pth [2023-03-10 17:12:18,591][1054815] Updated weights for policy 0, policy_version 29840 (0.0006) [2023-03-10 17:12:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 15314944. Throughput: 0: 8513.1. Samples: 15313072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:12:23,349][1054527] Avg episode reward: [(0, '2973.873')] [2023-03-10 17:12:23,595][1054815] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-10 17:12:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 15355904. Throughput: 0: 8460.7. Samples: 15337820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:12:28,348][1054527] Avg episode reward: [(0, '3599.651')] [2023-03-10 17:12:28,529][1054815] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-10 17:12:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 15396864. Throughput: 0: 8469.7. Samples: 15388532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:12:33,348][1054527] Avg episode reward: [(0, '3988.374')] [2023-03-10 17:12:33,356][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030080_15400960.pth... [2023-03-10 17:12:33,356][1054815] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-10 17:12:33,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029584_15147008.pth [2023-03-10 17:12:38,187][1054815] Updated weights for policy 0, policy_version 30160 (0.0004) [2023-03-10 17:12:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 15441920. Throughput: 0: 8484.4. Samples: 15438696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:12:38,348][1054527] Avg episode reward: [(0, '3428.523')] [2023-03-10 17:12:43,060][1054815] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-10 17:12:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 15482880. Throughput: 0: 8470.1. Samples: 15463812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:12:43,348][1054527] Avg episode reward: [(0, '2228.509')] [2023-03-10 17:12:48,116][1054815] Updated weights for policy 0, policy_version 30320 (0.0004) [2023-03-10 17:12:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 15523840. Throughput: 0: 8429.3. Samples: 15514040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:12:48,348][1054527] Avg episode reward: [(0, '1585.037')] [2023-03-10 17:12:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030320_15523840.pth... [2023-03-10 17:12:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000029832_15273984.pth [2023-03-10 17:12:53,256][1054815] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-10 17:12:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 15564800. Throughput: 0: 8356.4. Samples: 15560860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:12:53,348][1054527] Avg episode reward: [(0, '2744.055')] [2023-03-10 17:12:58,023][1054815] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-10 17:12:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 15605760. Throughput: 0: 8353.8. Samples: 15587376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:12:58,349][1054527] Avg episode reward: [(0, '2961.356')] [2023-03-10 17:13:02,756][1054815] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-10 17:13:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 15650816. Throughput: 0: 8374.1. Samples: 15638592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:03,348][1054527] Avg episode reward: [(0, '3275.335')] [2023-03-10 17:13:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030568_15650816.pth... [2023-03-10 17:13:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030080_15400960.pth [2023-03-10 17:13:07,696][1054815] Updated weights for policy 0, policy_version 30640 (0.0006) [2023-03-10 17:13:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 15691776. Throughput: 0: 8345.2. Samples: 15688604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:08,348][1054527] Avg episode reward: [(0, '3419.617')] [2023-03-10 17:13:12,789][1054815] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-10 17:13:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 15732736. Throughput: 0: 8322.8. Samples: 15712344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:13,348][1054527] Avg episode reward: [(0, '3853.924')] [2023-03-10 17:13:17,709][1054815] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-10 17:13:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 15773696. Throughput: 0: 8311.3. Samples: 15762540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:18,349][1054527] Avg episode reward: [(0, '3376.060')] [2023-03-10 17:13:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030808_15773696.pth... [2023-03-10 17:13:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030320_15523840.pth [2023-03-10 17:13:22,486][1054815] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-10 17:13:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 15814656. Throughput: 0: 8336.0. Samples: 15813816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:13:23,348][1054527] Avg episode reward: [(0, '2477.593')] [2023-03-10 17:13:27,628][1054815] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-10 17:13:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 15855616. Throughput: 0: 8299.1. Samples: 15837272. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:13:28,349][1054527] Avg episode reward: [(0, '3509.998')] [2023-03-10 17:13:32,721][1054815] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-10 17:13:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 15896576. Throughput: 0: 8249.5. Samples: 15885268. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:13:33,349][1054527] Avg episode reward: [(0, '3756.408')] [2023-03-10 17:13:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031048_15896576.pth... [2023-03-10 17:13:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030568_15650816.pth [2023-03-10 17:13:37,893][1054815] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-10 17:13:38,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8428.0). Total num frames: 15933440. Throughput: 0: 8279.1. Samples: 15933420. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:13:38,348][1054527] Avg episode reward: [(0, '3697.748')] [2023-03-10 17:13:42,583][1054815] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-10 17:13:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 15978496. Throughput: 0: 8253.3. Samples: 15958772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:43,348][1054527] Avg episode reward: [(0, '3729.348')] [2023-03-10 17:13:47,474][1054815] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-10 17:13:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 16019456. Throughput: 0: 8257.3. Samples: 16010172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:48,348][1054527] Avg episode reward: [(0, '3342.131')] [2023-03-10 17:13:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031288_16019456.pth... [2023-03-10 17:13:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000030808_15773696.pth [2023-03-10 17:13:52,347][1054815] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-10 17:13:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 16064512. Throughput: 0: 8262.7. Samples: 16060424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:53,348][1054527] Avg episode reward: [(0, '3823.306')] [2023-03-10 17:13:57,158][1054815] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-10 17:13:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 16105472. Throughput: 0: 8293.3. Samples: 16085544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:13:58,348][1054527] Avg episode reward: [(0, '3687.006')] [2023-03-10 17:14:02,143][1054815] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-10 17:14:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 16146432. Throughput: 0: 8286.4. Samples: 16135428. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:14:03,348][1054527] Avg episode reward: [(0, '3620.703')] [2023-03-10 17:14:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031536_16146432.pth... [2023-03-10 17:14:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031048_15896576.pth [2023-03-10 17:14:07,038][1054815] Updated weights for policy 0, policy_version 31600 (0.0005) [2023-03-10 17:14:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 16187392. Throughput: 0: 8268.1. Samples: 16185880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:14:08,348][1054527] Avg episode reward: [(0, '3426.609')] [2023-03-10 17:14:11,864][1054815] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-10 17:14:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 16232448. Throughput: 0: 8326.6. Samples: 16211968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:14:13,348][1054527] Avg episode reward: [(0, '4008.903')] [2023-03-10 17:14:16,692][1054815] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-10 17:14:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 16273408. Throughput: 0: 8373.8. Samples: 16262088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 17:14:18,348][1054527] Avg episode reward: [(0, '3625.846')] [2023-03-10 17:14:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031784_16273408.pth... [2023-03-10 17:14:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031288_16019456.pth [2023-03-10 17:14:21,539][1054815] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-10 17:14:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 16314368. Throughput: 0: 8445.4. Samples: 16313464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:23,348][1054527] Avg episode reward: [(0, '2551.085')] [2023-03-10 17:14:26,492][1054815] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-10 17:14:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 16359424. Throughput: 0: 8421.5. Samples: 16337740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:28,349][1054527] Avg episode reward: [(0, '2954.781')] [2023-03-10 17:14:31,016][1054815] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-10 17:14:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 16404480. Throughput: 0: 8489.0. Samples: 16392176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:33,348][1054527] Avg episode reward: [(0, '3823.208')] [2023-03-10 17:14:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032040_16404480.pth... [2023-03-10 17:14:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031536_16146432.pth [2023-03-10 17:14:35,677][1054815] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-10 17:14:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16445440. Throughput: 0: 8520.2. Samples: 16443832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:38,348][1054527] Avg episode reward: [(0, '3548.284')] [2023-03-10 17:14:40,355][1054815] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-10 17:14:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 16490496. Throughput: 0: 8542.4. Samples: 16469952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:43,348][1054527] Avg episode reward: [(0, '3665.861')] [2023-03-10 17:14:45,159][1054815] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-10 17:14:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16531456. Throughput: 0: 8572.7. Samples: 16521200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:48,348][1054527] Avg episode reward: [(0, '3559.649')] [2023-03-10 17:14:48,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032288_16531456.pth... [2023-03-10 17:14:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000031784_16273408.pth [2023-03-10 17:14:49,875][1054815] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-10 17:14:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 16576512. Throughput: 0: 8601.9. Samples: 16572968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:53,348][1054527] Avg episode reward: [(0, '3620.879')] [2023-03-10 17:14:54,786][1054815] Updated weights for policy 0, policy_version 32400 (0.0004) [2023-03-10 17:14:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16617472. Throughput: 0: 8568.4. Samples: 16597544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:14:58,348][1054527] Avg episode reward: [(0, '3965.287')] [2023-03-10 17:14:59,603][1054815] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-10 17:15:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16658432. Throughput: 0: 8617.1. Samples: 16649856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:03,348][1054527] Avg episode reward: [(0, '3939.000')] [2023-03-10 17:15:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032536_16658432.pth... [2023-03-10 17:15:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032040_16404480.pth [2023-03-10 17:15:04,557][1054815] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-10 17:15:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16699392. Throughput: 0: 8552.3. Samples: 16698320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:08,348][1054527] Avg episode reward: [(0, '4279.380')] [2023-03-10 17:15:09,428][1054815] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-10 17:15:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 16744448. Throughput: 0: 8577.7. Samples: 16723736. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:13,348][1054527] Avg episode reward: [(0, '4075.883')] [2023-03-10 17:15:14,212][1054815] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-10 17:15:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 16785408. Throughput: 0: 8529.2. Samples: 16775992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:18,348][1054527] Avg episode reward: [(0, '3221.466')] [2023-03-10 17:15:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032784_16785408.pth... [2023-03-10 17:15:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032288_16531456.pth [2023-03-10 17:15:18,919][1054815] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-10 17:15:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 16830464. Throughput: 0: 8536.0. Samples: 16827952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:23,348][1054527] Avg episode reward: [(0, '2879.704')] [2023-03-10 17:15:23,554][1054815] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-10 17:15:28,329][1054815] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-10 17:15:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 16875520. Throughput: 0: 8554.6. Samples: 16854908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:15:28,348][1054527] Avg episode reward: [(0, '3577.111')] [2023-03-10 17:15:33,069][1054815] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-10 17:15:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 16916480. Throughput: 0: 8567.0. Samples: 16906716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:15:33,349][1054527] Avg episode reward: [(0, '4156.573')] [2023-03-10 17:15:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033040_16916480.pth... [2023-03-10 17:15:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032536_16658432.pth [2023-03-10 17:15:37,865][1054815] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-10 17:15:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 16957440. Throughput: 0: 8542.9. Samples: 16957400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:15:38,348][1054527] Avg episode reward: [(0, '3860.930')] [2023-03-10 17:15:42,876][1054815] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-10 17:15:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 17002496. Throughput: 0: 8541.4. Samples: 16981908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:15:43,348][1054527] Avg episode reward: [(0, '3817.781')] [2023-03-10 17:15:47,781][1054815] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-10 17:15:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 17043456. Throughput: 0: 8475.0. Samples: 17031232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:48,348][1054527] Avg episode reward: [(0, '4141.090')] [2023-03-10 17:15:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033288_17043456.pth... [2023-03-10 17:15:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000032784_16785408.pth [2023-03-10 17:15:52,890][1054815] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-10 17:15:53,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 17080320. Throughput: 0: 8487.4. Samples: 17080252. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:53,348][1054527] Avg episode reward: [(0, '3983.317')] [2023-03-10 17:15:57,756][1054815] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-10 17:15:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 17125376. Throughput: 0: 8493.2. Samples: 17105928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:15:58,348][1054527] Avg episode reward: [(0, '4219.348')] [2023-03-10 17:16:02,571][1054815] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-10 17:16:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 17166336. Throughput: 0: 8444.4. Samples: 17155988. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:16:03,348][1054527] Avg episode reward: [(0, '3945.991')] [2023-03-10 17:16:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033528_17166336.pth... [2023-03-10 17:16:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033040_16916480.pth [2023-03-10 17:16:07,293][1054815] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-10 17:16:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17211392. Throughput: 0: 8433.0. Samples: 17207436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:08,348][1054527] Avg episode reward: [(0, '4002.968')] [2023-03-10 17:16:12,208][1054815] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-10 17:16:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 17252352. Throughput: 0: 8404.0. Samples: 17233088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:13,348][1054527] Avg episode reward: [(0, '4029.624')] [2023-03-10 17:16:16,887][1054815] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-10 17:16:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 17293312. Throughput: 0: 8408.1. Samples: 17285080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:18,348][1054527] Avg episode reward: [(0, '3797.101')] [2023-03-10 17:16:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033776_17293312.pth... [2023-03-10 17:16:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033288_17043456.pth [2023-03-10 17:16:21,717][1054815] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-10 17:16:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 17338368. Throughput: 0: 8429.4. Samples: 17336724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:23,348][1054527] Avg episode reward: [(0, '3862.477')] [2023-03-10 17:16:26,428][1054815] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-10 17:16:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 17383424. Throughput: 0: 8452.5. Samples: 17362272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:28,348][1054527] Avg episode reward: [(0, '4204.593')] [2023-03-10 17:16:31,099][1054815] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-10 17:16:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 17424384. Throughput: 0: 8504.8. Samples: 17413948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:33,349][1054527] Avg episode reward: [(0, '4283.710')] [2023-03-10 17:16:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034032_17424384.pth... [2023-03-10 17:16:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033528_17166336.pth [2023-03-10 17:16:36,096][1054815] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-10 17:16:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 17465344. Throughput: 0: 8555.7. Samples: 17465260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:38,348][1054527] Avg episode reward: [(0, '3927.256')] [2023-03-10 17:16:40,761][1054815] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-10 17:16:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 17510400. Throughput: 0: 8537.1. Samples: 17490096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:43,348][1054527] Avg episode reward: [(0, '3893.468')] [2023-03-10 17:16:45,427][1054815] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-10 17:16:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17555456. Throughput: 0: 8599.3. Samples: 17542956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:16:48,348][1054527] Avg episode reward: [(0, '3753.329')] [2023-03-10 17:16:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034288_17555456.pth... [2023-03-10 17:16:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000033776_17293312.pth [2023-03-10 17:16:50,173][1054815] Updated weights for policy 0, policy_version 34320 (0.0004) [2023-03-10 17:16:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 17596416. Throughput: 0: 8564.2. Samples: 17592824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:16:53,348][1054527] Avg episode reward: [(0, '3426.314')] [2023-03-10 17:16:55,123][1054815] Updated weights for policy 0, policy_version 34400 (0.0006) [2023-03-10 17:16:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 17637376. Throughput: 0: 8563.7. Samples: 17618452. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:16:58,349][1054527] Avg episode reward: [(0, '3799.429')] [2023-03-10 17:17:00,088][1054815] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-10 17:17:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 17682432. Throughput: 0: 8543.0. Samples: 17669516. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:17:03,348][1054527] Avg episode reward: [(0, '3851.930')] [2023-03-10 17:17:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034536_17682432.pth... [2023-03-10 17:17:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034032_17424384.pth [2023-03-10 17:17:04,782][1054815] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-10 17:17:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17723392. Throughput: 0: 8516.5. Samples: 17719964. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:17:08,348][1054527] Avg episode reward: [(0, '3762.375')] [2023-03-10 17:17:09,536][1054815] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-10 17:17:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 17764352. Throughput: 0: 8559.6. Samples: 17747452. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:17:13,348][1054527] Avg episode reward: [(0, '3377.046')] [2023-03-10 17:17:14,380][1054815] Updated weights for policy 0, policy_version 34720 (0.0006) [2023-03-10 17:17:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 17809408. Throughput: 0: 8524.6. Samples: 17797556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:18,348][1054527] Avg episode reward: [(0, '3960.521')] [2023-03-10 17:17:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034784_17809408.pth... [2023-03-10 17:17:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034288_17555456.pth [2023-03-10 17:17:19,154][1054815] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-10 17:17:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17850368. Throughput: 0: 8522.9. Samples: 17848792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:23,348][1054527] Avg episode reward: [(0, '4010.608')] [2023-03-10 17:17:24,026][1054815] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-10 17:17:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 17895424. Throughput: 0: 8551.7. Samples: 17874924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:28,349][1054527] Avg episode reward: [(0, '4079.286')] [2023-03-10 17:17:28,798][1054815] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-10 17:17:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17936384. Throughput: 0: 8491.2. Samples: 17925060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:33,348][1054527] Avg episode reward: [(0, '3757.831')] [2023-03-10 17:17:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035032_17936384.pth... [2023-03-10 17:17:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034536_17682432.pth [2023-03-10 17:17:33,455][1054815] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-10 17:17:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 17977344. Throughput: 0: 8538.5. Samples: 17977056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:38,348][1054527] Avg episode reward: [(0, '4171.539')] [2023-03-10 17:17:38,414][1054815] Updated weights for policy 0, policy_version 35120 (0.0004) [2023-03-10 17:17:43,321][1054815] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-10 17:17:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 18022400. Throughput: 0: 8506.5. Samples: 18001244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:43,349][1054527] Avg episode reward: [(0, '4239.013')] [2023-03-10 17:17:48,059][1054815] Updated weights for policy 0, policy_version 35280 (0.0006) [2023-03-10 17:17:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 18063360. Throughput: 0: 8503.6. Samples: 18052180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:48,348][1054527] Avg episode reward: [(0, '4009.362')] [2023-03-10 17:17:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035280_18063360.pth... [2023-03-10 17:17:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000034784_17809408.pth [2023-03-10 17:17:52,941][1054815] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-10 17:17:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 18104320. Throughput: 0: 8534.2. Samples: 18104004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:53,348][1054527] Avg episode reward: [(0, '4301.873')] [2023-03-10 17:17:57,880][1054815] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-10 17:17:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 18149376. Throughput: 0: 8472.3. Samples: 18128704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:17:58,348][1054527] Avg episode reward: [(0, '4097.404')] [2023-03-10 17:18:02,612][1054815] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-10 17:18:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 18190336. Throughput: 0: 8486.1. Samples: 18179432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:18:03,348][1054527] Avg episode reward: [(0, '3833.736')] [2023-03-10 17:18:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035528_18190336.pth... [2023-03-10 17:18:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035032_17936384.pth [2023-03-10 17:18:07,512][1054815] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-10 17:18:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 18231296. Throughput: 0: 8479.9. Samples: 18230388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:18:08,348][1054527] Avg episode reward: [(0, '3972.113')] [2023-03-10 17:18:12,104][1054815] Updated weights for policy 0, policy_version 35680 (0.0006) [2023-03-10 17:18:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 18276352. Throughput: 0: 8472.2. Samples: 18256172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:18:13,348][1054527] Avg episode reward: [(0, '4303.953')] [2023-03-10 17:18:16,949][1054815] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-10 17:18:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 18317312. Throughput: 0: 8527.3. Samples: 18308788. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:18:18,348][1054527] Avg episode reward: [(0, '4267.194')] [2023-03-10 17:18:18,377][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035784_18321408.pth... [2023-03-10 17:18:18,379][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035280_18063360.pth [2023-03-10 17:18:21,741][1054815] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-10 17:18:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 18362368. Throughput: 0: 8489.5. Samples: 18359084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:18:23,348][1054527] Avg episode reward: [(0, '3939.297')] [2023-03-10 17:18:26,455][1054815] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-10 17:18:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 18403328. Throughput: 0: 8567.8. Samples: 18386796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:18:28,348][1054527] Avg episode reward: [(0, '4180.749')] [2023-03-10 17:18:31,298][1054815] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-10 17:18:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 18448384. Throughput: 0: 8531.6. Samples: 18436104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:18:33,349][1054527] Avg episode reward: [(0, '4209.056')] [2023-03-10 17:18:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036032_18448384.pth... [2023-03-10 17:18:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035528_18190336.pth [2023-03-10 17:18:36,042][1054815] Updated weights for policy 0, policy_version 36080 (0.0004) [2023-03-10 17:18:38,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 18493440. Throughput: 0: 8563.5. Samples: 18489360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:18:38,349][1054527] Avg episode reward: [(0, '3976.608')] [2023-03-10 17:18:40,652][1054815] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-10 17:18:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 18534400. Throughput: 0: 8593.8. Samples: 18515424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:18:43,348][1054527] Avg episode reward: [(0, '3939.163')] [2023-03-10 17:18:45,544][1054815] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-10 17:18:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 18575360. Throughput: 0: 8570.1. Samples: 18565088. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:18:48,349][1054527] Avg episode reward: [(0, '3513.492')] [2023-03-10 17:18:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036280_18575360.pth... [2023-03-10 17:18:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000035784_18321408.pth [2023-03-10 17:18:50,604][1054815] Updated weights for policy 0, policy_version 36320 (0.0005) [2023-03-10 17:18:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.4, 300 sec: 8511.4). Total num frames: 18616320. Throughput: 0: 8548.9. Samples: 18615088. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:18:53,348][1054527] Avg episode reward: [(0, '3782.756')] [2023-03-10 17:18:55,585][1054815] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-10 17:18:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 18657280. Throughput: 0: 8511.1. Samples: 18639172. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:18:58,348][1054527] Avg episode reward: [(0, '4160.464')] [2023-03-10 17:19:00,739][1054815] Updated weights for policy 0, policy_version 36480 (0.0004) [2023-03-10 17:19:03,348][1054527] Fps is (10 sec: 8191.8, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 18698240. Throughput: 0: 8388.6. Samples: 18686276. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:19:03,349][1054527] Avg episode reward: [(0, '4113.492')] [2023-03-10 17:19:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036520_18698240.pth... [2023-03-10 17:19:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036032_18448384.pth [2023-03-10 17:19:05,890][1054815] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-10 17:19:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 18739200. Throughput: 0: 8353.2. Samples: 18734976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:19:08,348][1054527] Avg episode reward: [(0, '4104.708')] [2023-03-10 17:19:10,600][1054815] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-10 17:19:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 18780160. Throughput: 0: 8332.9. Samples: 18761776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:13,348][1054527] Avg episode reward: [(0, '4109.098')] [2023-03-10 17:19:15,495][1054815] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-10 17:19:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 18825216. Throughput: 0: 8365.2. Samples: 18812540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:18,348][1054527] Avg episode reward: [(0, '3984.727')] [2023-03-10 17:19:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036768_18825216.pth... [2023-03-10 17:19:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036280_18575360.pth [2023-03-10 17:19:20,304][1054815] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-10 17:19:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 18862080. Throughput: 0: 8281.3. Samples: 18862016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:23,348][1054527] Avg episode reward: [(0, '3880.775')] [2023-03-10 17:19:25,370][1054815] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-10 17:19:28,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 18903040. Throughput: 0: 8249.5. Samples: 18886652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:28,348][1054527] Avg episode reward: [(0, '4196.185')] [2023-03-10 17:19:30,157][1054815] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-10 17:19:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 18948096. Throughput: 0: 8300.7. Samples: 18938620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:33,348][1054527] Avg episode reward: [(0, '3966.143')] [2023-03-10 17:19:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037008_18948096.pth... [2023-03-10 17:19:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036520_18698240.pth [2023-03-10 17:19:34,934][1054815] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-10 17:19:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8469.7). Total num frames: 18989056. Throughput: 0: 8310.3. Samples: 18989052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:38,348][1054527] Avg episode reward: [(0, '3925.458')] [2023-03-10 17:19:39,848][1054815] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-10 17:19:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8469.7). Total num frames: 19030016. Throughput: 0: 8320.5. Samples: 19013592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:43,348][1054527] Avg episode reward: [(0, '3655.879')] [2023-03-10 17:19:45,032][1054815] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-10 17:19:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8455.8). Total num frames: 19070976. Throughput: 0: 8325.6. Samples: 19060928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:48,349][1054527] Avg episode reward: [(0, '4139.872')] [2023-03-10 17:19:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037248_19070976.pth... [2023-03-10 17:19:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000036768_18825216.pth [2023-03-10 17:19:49,997][1054815] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-10 17:19:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 19116032. Throughput: 0: 8378.3. Samples: 19112000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:19:53,348][1054527] Avg episode reward: [(0, '4290.686')] [2023-03-10 17:19:54,704][1054815] Updated weights for policy 0, policy_version 37360 (0.0006) [2023-03-10 17:19:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 19156992. Throughput: 0: 8365.6. Samples: 19138228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:19:58,348][1054527] Avg episode reward: [(0, '3353.274')] [2023-03-10 17:19:59,412][1054815] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-10 17:20:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 19202048. Throughput: 0: 8385.4. Samples: 19189884. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:20:03,349][1054527] Avg episode reward: [(0, '3802.249')] [2023-03-10 17:20:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037504_19202048.pth... [2023-03-10 17:20:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037008_18948096.pth [2023-03-10 17:20:04,295][1054815] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-10 17:20:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.0, 300 sec: 8483.6). Total num frames: 19247104. Throughput: 0: 8471.1. Samples: 19243216. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:20:08,349][1054527] Avg episode reward: [(0, '2755.622')] [2023-03-10 17:20:08,756][1054815] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-10 17:20:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 19288064. Throughput: 0: 8466.7. Samples: 19267656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:20:13,348][1054527] Avg episode reward: [(0, '2615.093')] [2023-03-10 17:20:13,619][1054815] Updated weights for policy 0, policy_version 37680 (0.0004) [2023-03-10 17:20:18,298][1054815] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-10 17:20:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 19333120. Throughput: 0: 8478.9. Samples: 19320172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:20:18,348][1054527] Avg episode reward: [(0, '3146.721')] [2023-03-10 17:20:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037760_19333120.pth... [2023-03-10 17:20:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037248_19070976.pth [2023-03-10 17:20:22,971][1054815] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-10 17:20:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 19374080. Throughput: 0: 8533.4. Samples: 19373056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:20:23,348][1054527] Avg episode reward: [(0, '3072.195')] [2023-03-10 17:20:27,986][1054815] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-10 17:20:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 19415040. Throughput: 0: 8552.3. Samples: 19398444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:20:28,348][1054527] Avg episode reward: [(0, '3710.386')] [2023-03-10 17:20:32,880][1054815] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-10 17:20:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 19456000. Throughput: 0: 8594.8. Samples: 19447692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:20:33,348][1054527] Avg episode reward: [(0, '3644.997')] [2023-03-10 17:20:33,382][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038008_19460096.pth... [2023-03-10 17:20:33,383][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037504_19202048.pth [2023-03-10 17:20:37,486][1054815] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-10 17:20:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 19501056. Throughput: 0: 8636.4. Samples: 19500636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:20:38,348][1054527] Avg episode reward: [(0, '3436.785')] [2023-03-10 17:20:42,411][1054815] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-10 17:20:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 19542016. Throughput: 0: 8602.8. Samples: 19525356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:20:43,348][1054527] Avg episode reward: [(0, '3741.077')] [2023-03-10 17:20:47,081][1054815] Updated weights for policy 0, policy_version 38240 (0.0005) [2023-03-10 17:20:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19587072. Throughput: 0: 8594.2. Samples: 19576624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:20:48,349][1054527] Avg episode reward: [(0, '3179.865')] [2023-03-10 17:20:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038256_19587072.pth... [2023-03-10 17:20:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000037760_19333120.pth [2023-03-10 17:20:51,754][1054815] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-10 17:20:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19632128. Throughput: 0: 8568.3. Samples: 19628788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:20:53,348][1054527] Avg episode reward: [(0, '3605.281')] [2023-03-10 17:20:56,609][1054815] Updated weights for policy 0, policy_version 38400 (0.0004) [2023-03-10 17:20:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19673088. Throughput: 0: 8580.9. Samples: 19653796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:20:58,348][1054527] Avg episode reward: [(0, '2647.986')] [2023-03-10 17:21:01,270][1054815] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-10 17:21:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19718144. Throughput: 0: 8572.8. Samples: 19705948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:03,349][1054527] Avg episode reward: [(0, '3841.726')] [2023-03-10 17:21:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038512_19718144.pth... [2023-03-10 17:21:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038008_19460096.pth [2023-03-10 17:21:06,245][1054815] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-10 17:21:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 19759104. Throughput: 0: 8500.3. Samples: 19755572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:08,348][1054527] Avg episode reward: [(0, '4146.139')] [2023-03-10 17:21:11,050][1054815] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-10 17:21:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 19800064. Throughput: 0: 8524.2. Samples: 19782032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:13,348][1054527] Avg episode reward: [(0, '3749.525')] [2023-03-10 17:21:15,835][1054815] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-10 17:21:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 19841024. Throughput: 0: 8558.9. Samples: 19832840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:18,348][1054527] Avg episode reward: [(0, '3862.623')] [2023-03-10 17:21:18,375][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038760_19845120.pth... [2023-03-10 17:21:18,377][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038256_19587072.pth [2023-03-10 17:21:20,845][1054815] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-10 17:21:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 19886080. Throughput: 0: 8501.1. Samples: 19883184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:23,348][1054527] Avg episode reward: [(0, '3833.867')] [2023-03-10 17:21:25,535][1054815] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-10 17:21:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19931136. Throughput: 0: 8537.0. Samples: 19909520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:28,348][1054527] Avg episode reward: [(0, '4243.710')] [2023-03-10 17:21:30,033][1054815] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-10 17:21:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 19972096. Throughput: 0: 8592.9. Samples: 19963304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:21:33,348][1054527] Avg episode reward: [(0, '4002.191')] [2023-03-10 17:21:33,364][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039016_19976192.pth... [2023-03-10 17:21:33,366][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038512_19718144.pth [2023-03-10 17:21:34,778][1054815] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-10 17:21:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 20017152. Throughput: 0: 8588.5. Samples: 20015272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:21:38,348][1054527] Avg episode reward: [(0, '3577.392')] [2023-03-10 17:21:39,527][1054815] Updated weights for policy 0, policy_version 39120 (0.0005) [2023-03-10 17:21:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 20062208. Throughput: 0: 8620.7. Samples: 20041728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:21:43,348][1054527] Avg episode reward: [(0, '4055.058')] [2023-03-10 17:21:44,190][1054815] Updated weights for policy 0, policy_version 39200 (0.0005) [2023-03-10 17:21:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 20103168. Throughput: 0: 8593.4. Samples: 20092652. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:21:48,348][1054527] Avg episode reward: [(0, '4283.598')] [2023-03-10 17:21:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039264_20103168.pth... [2023-03-10 17:21:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000038760_19845120.pth [2023-03-10 17:21:48,990][1054815] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-10 17:21:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8511.3). Total num frames: 20148224. Throughput: 0: 8634.4. Samples: 20144120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:21:53,349][1054527] Avg episode reward: [(0, '4341.444')] [2023-03-10 17:21:53,842][1054815] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-10 17:21:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 20185088. Throughput: 0: 8586.6. Samples: 20168432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:21:58,348][1054527] Avg episode reward: [(0, '4147.967')] [2023-03-10 17:21:58,904][1054815] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-10 17:22:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20230144. Throughput: 0: 8591.3. Samples: 20219448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:03,348][1054527] Avg episode reward: [(0, '4075.758')] [2023-03-10 17:22:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039512_20230144.pth... [2023-03-10 17:22:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039016_19976192.pth [2023-03-10 17:22:03,573][1054815] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-10 17:22:08,296][1054815] Updated weights for policy 0, policy_version 39600 (0.0004) [2023-03-10 17:22:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8511.3). Total num frames: 20275200. Throughput: 0: 8621.9. Samples: 20271168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:08,348][1054527] Avg episode reward: [(0, '3943.213')] [2023-03-10 17:22:12,941][1054815] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-10 17:22:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 20316160. Throughput: 0: 8619.2. Samples: 20297384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:13,348][1054527] Avg episode reward: [(0, '3674.936')] [2023-03-10 17:22:17,656][1054815] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-10 17:22:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 20361216. Throughput: 0: 8584.3. Samples: 20349600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:18,349][1054527] Avg episode reward: [(0, '4126.428')] [2023-03-10 17:22:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039768_20361216.pth... [2023-03-10 17:22:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039264_20103168.pth [2023-03-10 17:22:22,487][1054815] Updated weights for policy 0, policy_version 39840 (0.0005) [2023-03-10 17:22:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 20402176. Throughput: 0: 8583.4. Samples: 20401524. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:23,348][1054527] Avg episode reward: [(0, '4062.123')] [2023-03-10 17:22:27,605][1054815] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-10 17:22:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20443136. Throughput: 0: 8516.2. Samples: 20424956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:22:28,348][1054527] Avg episode reward: [(0, '4311.858')] [2023-03-10 17:22:32,468][1054815] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-10 17:22:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20484096. Throughput: 0: 8505.2. Samples: 20475384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:22:33,348][1054527] Avg episode reward: [(0, '3863.084')] [2023-03-10 17:22:33,405][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040016_20488192.pth... [2023-03-10 17:22:33,407][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039512_20230144.pth [2023-03-10 17:22:37,046][1054815] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-10 17:22:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20529152. Throughput: 0: 8526.2. Samples: 20527796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:22:38,348][1054527] Avg episode reward: [(0, '3542.985')] [2023-03-10 17:22:42,020][1054815] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-10 17:22:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 20570112. Throughput: 0: 8546.1. Samples: 20553008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:22:43,348][1054527] Avg episode reward: [(0, '3436.786')] [2023-03-10 17:22:46,695][1054815] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-10 17:22:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 20615168. Throughput: 0: 8540.6. Samples: 20603776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:22:48,349][1054527] Avg episode reward: [(0, '3539.445')] [2023-03-10 17:22:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040264_20615168.pth... [2023-03-10 17:22:48,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000039768_20361216.pth [2023-03-10 17:22:51,471][1054815] Updated weights for policy 0, policy_version 40320 (0.0004) [2023-03-10 17:22:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 20656128. Throughput: 0: 8529.4. Samples: 20654992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:53,348][1054527] Avg episode reward: [(0, '3167.928')] [2023-03-10 17:22:56,466][1054815] Updated weights for policy 0, policy_version 40400 (0.0006) [2023-03-10 17:22:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20697088. Throughput: 0: 8511.2. Samples: 20680388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:22:58,348][1054527] Avg episode reward: [(0, '3944.936')] [2023-03-10 17:23:01,273][1054815] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-10 17:23:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 20742144. Throughput: 0: 8470.7. Samples: 20730780. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:23:03,348][1054527] Avg episode reward: [(0, '4212.801')] [2023-03-10 17:23:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040512_20742144.pth... [2023-03-10 17:23:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040016_20488192.pth [2023-03-10 17:23:05,975][1054815] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-10 17:23:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8511.4). Total num frames: 20787200. Throughput: 0: 8481.2. Samples: 20783176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:23:08,348][1054527] Avg episode reward: [(0, '3858.998')] [2023-03-10 17:23:10,791][1054815] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-10 17:23:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 20828160. Throughput: 0: 8506.6. Samples: 20807752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:23:13,348][1054527] Avg episode reward: [(0, '4296.129')] [2023-03-10 17:23:15,694][1054815] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-10 17:23:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 20869120. Throughput: 0: 8493.1. Samples: 20857576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:23:18,348][1054527] Avg episode reward: [(0, '4272.079')] [2023-03-10 17:23:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040760_20869120.pth... [2023-03-10 17:23:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040264_20615168.pth [2023-03-10 17:23:20,515][1054815] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-10 17:23:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 20910080. Throughput: 0: 8492.5. Samples: 20909956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:23:23,348][1054527] Avg episode reward: [(0, '4161.783')] [2023-03-10 17:23:25,173][1054815] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-10 17:23:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 20955136. Throughput: 0: 8503.0. Samples: 20935644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:23:28,348][1054527] Avg episode reward: [(0, '4103.772')] [2023-03-10 17:23:30,134][1054815] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-10 17:23:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 20996096. Throughput: 0: 8498.3. Samples: 20986200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:23:33,348][1054527] Avg episode reward: [(0, '3648.407')] [2023-03-10 17:23:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041008_20996096.pth... [2023-03-10 17:23:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040512_20742144.pth [2023-03-10 17:23:34,948][1054815] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-10 17:23:38,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 21037056. Throughput: 0: 8477.1. Samples: 21036460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:23:38,348][1054527] Avg episode reward: [(0, '3672.453')] [2023-03-10 17:23:39,864][1054815] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-10 17:23:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 21082112. Throughput: 0: 8470.0. Samples: 21061540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:23:43,349][1054527] Avg episode reward: [(0, '3850.694')] [2023-03-10 17:23:44,884][1054815] Updated weights for policy 0, policy_version 41200 (0.0004) [2023-03-10 17:23:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 21118976. Throughput: 0: 8436.4. Samples: 21110416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:23:48,348][1054527] Avg episode reward: [(0, '3903.234')] [2023-03-10 17:23:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041256_21123072.pth... [2023-03-10 17:23:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000040760_20869120.pth [2023-03-10 17:23:49,801][1054815] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-10 17:23:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 21164032. Throughput: 0: 8374.8. Samples: 21160044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:23:53,348][1054527] Avg episode reward: [(0, '3542.009')] [2023-03-10 17:23:54,607][1054815] Updated weights for policy 0, policy_version 41360 (0.0006) [2023-03-10 17:23:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 21204992. Throughput: 0: 8414.0. Samples: 21186384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:23:58,349][1054527] Avg episode reward: [(0, '3711.003')] [2023-03-10 17:23:59,385][1054815] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-10 17:24:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 21250048. Throughput: 0: 8470.8. Samples: 21238760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:24:03,348][1054527] Avg episode reward: [(0, '3439.233')] [2023-03-10 17:24:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041504_21250048.pth... [2023-03-10 17:24:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041008_20996096.pth [2023-03-10 17:24:04,162][1054815] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-10 17:24:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 21291008. Throughput: 0: 8426.1. Samples: 21289132. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:24:08,348][1054527] Avg episode reward: [(0, '3878.714')] [2023-03-10 17:24:09,031][1054815] Updated weights for policy 0, policy_version 41600 (0.0004) [2023-03-10 17:24:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 21331968. Throughput: 0: 8434.0. Samples: 21315176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:13,348][1054527] Avg episode reward: [(0, '3579.242')] [2023-03-10 17:24:13,858][1054815] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-10 17:24:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 21377024. Throughput: 0: 8413.3. Samples: 21364800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:18,349][1054527] Avg episode reward: [(0, '4011.566')] [2023-03-10 17:24:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041752_21377024.pth... [2023-03-10 17:24:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041256_21123072.pth [2023-03-10 17:24:18,649][1054815] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-10 17:24:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 21417984. Throughput: 0: 8415.1. Samples: 21415140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:23,348][1054527] Avg episode reward: [(0, '3893.687')] [2023-03-10 17:24:23,528][1054815] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-10 17:24:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 21458944. Throughput: 0: 8439.8. Samples: 21441332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:28,349][1054527] Avg episode reward: [(0, '3846.547')] [2023-03-10 17:24:28,443][1054815] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-10 17:24:33,307][1054815] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-10 17:24:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 21504000. Throughput: 0: 8473.4. Samples: 21491720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:33,348][1054527] Avg episode reward: [(0, '4062.422')] [2023-03-10 17:24:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042000_21504000.pth... [2023-03-10 17:24:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041504_21250048.pth [2023-03-10 17:24:38,231][1054815] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-10 17:24:38,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 21544960. Throughput: 0: 8472.5. Samples: 21541304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:38,348][1054527] Avg episode reward: [(0, '3849.137')] [2023-03-10 17:24:42,800][1054815] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-10 17:24:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 21590016. Throughput: 0: 8458.5. Samples: 21567016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:43,348][1054527] Avg episode reward: [(0, '3475.148')] [2023-03-10 17:24:47,242][1054815] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-10 17:24:48,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 21635072. Throughput: 0: 8525.1. Samples: 21622392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:48,349][1054527] Avg episode reward: [(0, '3197.476')] [2023-03-10 17:24:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042256_21635072.pth... [2023-03-10 17:24:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000041752_21377024.pth [2023-03-10 17:24:51,853][1054815] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-10 17:24:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 21680128. Throughput: 0: 8597.8. Samples: 21676032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:53,348][1054527] Avg episode reward: [(0, '4024.359')] [2023-03-10 17:24:56,573][1054815] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-10 17:24:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 21721088. Throughput: 0: 8629.2. Samples: 21703492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:24:58,348][1054527] Avg episode reward: [(0, '3784.986')] [2023-03-10 17:25:01,321][1054815] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-10 17:25:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 21766144. Throughput: 0: 8645.7. Samples: 21753856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:03,348][1054527] Avg episode reward: [(0, '3821.801')] [2023-03-10 17:25:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042512_21766144.pth... [2023-03-10 17:25:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042000_21504000.pth [2023-03-10 17:25:06,136][1054815] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-10 17:25:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 21807104. Throughput: 0: 8625.5. Samples: 21803288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:08,348][1054527] Avg episode reward: [(0, '3352.098')] [2023-03-10 17:25:11,158][1054815] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-10 17:25:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 21848064. Throughput: 0: 8606.3. Samples: 21828612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:13,348][1054527] Avg episode reward: [(0, '3826.723')] [2023-03-10 17:25:15,653][1054815] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-10 17:25:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 21893120. Throughput: 0: 8698.8. Samples: 21883168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:18,348][1054527] Avg episode reward: [(0, '3536.444')] [2023-03-10 17:25:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042760_21893120.pth... [2023-03-10 17:25:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042256_21635072.pth [2023-03-10 17:25:20,450][1054815] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-10 17:25:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 21938176. Throughput: 0: 8768.4. Samples: 21935884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:23,348][1054527] Avg episode reward: [(0, '4189.526')] [2023-03-10 17:25:24,942][1054815] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-10 17:25:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 21979136. Throughput: 0: 8776.4. Samples: 21961952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:28,348][1054527] Avg episode reward: [(0, '3633.210')] [2023-03-10 17:25:29,831][1054815] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-10 17:25:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 22024192. Throughput: 0: 8712.4. Samples: 22014448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:33,349][1054527] Avg episode reward: [(0, '4017.208')] [2023-03-10 17:25:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043016_22024192.pth... [2023-03-10 17:25:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042512_21766144.pth [2023-03-10 17:25:34,408][1054815] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-10 17:25:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 22065152. Throughput: 0: 8639.0. Samples: 22064788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:38,348][1054527] Avg episode reward: [(0, '4130.379')] [2023-03-10 17:25:39,594][1054815] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-10 17:25:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 22110208. Throughput: 0: 8564.2. Samples: 22088880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:43,348][1054527] Avg episode reward: [(0, '3646.174')] [2023-03-10 17:25:44,290][1054815] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-10 17:25:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 22151168. Throughput: 0: 8578.0. Samples: 22139868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:48,348][1054527] Avg episode reward: [(0, '2784.089')] [2023-03-10 17:25:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043264_22151168.pth... [2023-03-10 17:25:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000042760_21893120.pth [2023-03-10 17:25:49,102][1054815] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-10 17:25:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.4, 300 sec: 8539.1). Total num frames: 22192128. Throughput: 0: 8634.1. Samples: 22191820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:53,348][1054527] Avg episode reward: [(0, '3659.907')] [2023-03-10 17:25:53,855][1054815] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-10 17:25:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 22237184. Throughput: 0: 8635.8. Samples: 22217224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:25:58,349][1054527] Avg episode reward: [(0, '3909.920')] [2023-03-10 17:25:58,534][1054815] Updated weights for policy 0, policy_version 43440 (0.0006) [2023-03-10 17:26:03,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 22278144. Throughput: 0: 8595.2. Samples: 22269952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:03,349][1054527] Avg episode reward: [(0, '3912.028')] [2023-03-10 17:26:03,356][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043520_22282240.pth... [2023-03-10 17:26:03,357][1054815] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-10 17:26:03,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043016_22024192.pth [2023-03-10 17:26:08,101][1054815] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-10 17:26:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 22323200. Throughput: 0: 8563.6. Samples: 22321244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:08,348][1054527] Avg episode reward: [(0, '3467.800')] [2023-03-10 17:26:12,808][1054815] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-10 17:26:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.8, 300 sec: 8566.9). Total num frames: 22368256. Throughput: 0: 8568.8. Samples: 22347548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:13,348][1054527] Avg episode reward: [(0, '4381.162')] [2023-03-10 17:26:17,403][1054815] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-10 17:26:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 22413312. Throughput: 0: 8569.5. Samples: 22400076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:18,348][1054527] Avg episode reward: [(0, '4189.411')] [2023-03-10 17:26:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043776_22413312.pth... [2023-03-10 17:26:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043264_22151168.pth [2023-03-10 17:26:22,034][1054815] Updated weights for policy 0, policy_version 43840 (0.0006) [2023-03-10 17:26:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 22454272. Throughput: 0: 8640.3. Samples: 22453600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:23,348][1054527] Avg episode reward: [(0, '3527.675')] [2023-03-10 17:26:26,798][1054815] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-10 17:26:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 22495232. Throughput: 0: 8665.3. Samples: 22478820. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:28,348][1054527] Avg episode reward: [(0, '3654.861')] [2023-03-10 17:26:31,819][1054815] Updated weights for policy 0, policy_version 44000 (0.0006) [2023-03-10 17:26:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 22540288. Throughput: 0: 8625.3. Samples: 22528008. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:33,348][1054527] Avg episode reward: [(0, '4176.722')] [2023-03-10 17:26:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044024_22540288.pth... [2023-03-10 17:26:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043520_22282240.pth [2023-03-10 17:26:36,570][1054815] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-10 17:26:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 22581248. Throughput: 0: 8637.3. Samples: 22580500. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:38,348][1054527] Avg episode reward: [(0, '4144.315')] [2023-03-10 17:26:40,928][1054815] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-10 17:26:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 22626304. Throughput: 0: 8717.4. Samples: 22609508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:43,348][1054527] Avg episode reward: [(0, '3657.723')] [2023-03-10 17:26:45,535][1054815] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-10 17:26:48,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 22675456. Throughput: 0: 8739.6. Samples: 22663232. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:48,348][1054527] Avg episode reward: [(0, '2974.565')] [2023-03-10 17:26:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044288_22675456.pth... [2023-03-10 17:26:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000043776_22413312.pth [2023-03-10 17:26:50,163][1054815] Updated weights for policy 0, policy_version 44320 (0.0006) [2023-03-10 17:26:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 22716416. Throughput: 0: 8779.0. Samples: 22716296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:26:53,348][1054527] Avg episode reward: [(0, '3654.951')] [2023-03-10 17:26:54,738][1054815] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-10 17:26:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 22761472. Throughput: 0: 8754.0. Samples: 22741476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:26:58,348][1054527] Avg episode reward: [(0, '3694.723')] [2023-03-10 17:26:59,691][1054815] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-10 17:27:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.2, 300 sec: 8566.9). Total num frames: 22802432. Throughput: 0: 8722.9. Samples: 22792608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:03,348][1054527] Avg episode reward: [(0, '3051.162')] [2023-03-10 17:27:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044536_22802432.pth... [2023-03-10 17:27:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044024_22540288.pth [2023-03-10 17:27:04,555][1054815] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-10 17:27:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 22843392. Throughput: 0: 8637.2. Samples: 22842276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:08,348][1054527] Avg episode reward: [(0, '2871.194')] [2023-03-10 17:27:09,413][1054815] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-10 17:27:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 22888448. Throughput: 0: 8647.6. Samples: 22867964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:13,348][1054527] Avg episode reward: [(0, '3181.340')] [2023-03-10 17:27:14,279][1054815] Updated weights for policy 0, policy_version 44720 (0.0005) [2023-03-10 17:27:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 22929408. Throughput: 0: 8667.1. Samples: 22918028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:18,348][1054527] Avg episode reward: [(0, '4071.949')] [2023-03-10 17:27:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044784_22929408.pth... [2023-03-10 17:27:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044288_22675456.pth [2023-03-10 17:27:19,030][1054815] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-10 17:27:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 22974464. Throughput: 0: 8674.8. Samples: 22970868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:23,348][1054527] Avg episode reward: [(0, '4036.471')] [2023-03-10 17:27:23,812][1054815] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-10 17:27:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 23015424. Throughput: 0: 8564.6. Samples: 22994916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:28,348][1054527] Avg episode reward: [(0, '4141.691')] [2023-03-10 17:27:28,586][1054815] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-10 17:27:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 23056384. Throughput: 0: 8548.5. Samples: 23047912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:33,348][1054527] Avg episode reward: [(0, '4370.091')] [2023-03-10 17:27:33,398][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045040_23060480.pth... [2023-03-10 17:27:33,399][1054815] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-10 17:27:33,400][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044536_22802432.pth [2023-03-10 17:27:38,176][1054815] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-10 17:27:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 23101440. Throughput: 0: 8493.0. Samples: 23098480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:38,348][1054527] Avg episode reward: [(0, '4377.445')] [2023-03-10 17:27:42,880][1054815] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-10 17:27:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 23142400. Throughput: 0: 8503.8. Samples: 23124144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:43,348][1054527] Avg episode reward: [(0, '4201.111')] [2023-03-10 17:27:47,800][1054815] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-10 17:27:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23187456. Throughput: 0: 8502.8. Samples: 23175232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:27:48,348][1054527] Avg episode reward: [(0, '4113.594')] [2023-03-10 17:27:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045288_23187456.pth... [2023-03-10 17:27:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000044784_22929408.pth [2023-03-10 17:27:52,776][1054815] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-10 17:27:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23228416. Throughput: 0: 8491.5. Samples: 23224392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:53,348][1054527] Avg episode reward: [(0, '4344.391')] [2023-03-10 17:27:57,228][1054815] Updated weights for policy 0, policy_version 45440 (0.0004) [2023-03-10 17:27:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23273472. Throughput: 0: 8549.4. Samples: 23252688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:27:58,348][1054527] Avg episode reward: [(0, '4021.400')] [2023-03-10 17:28:01,981][1054815] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-10 17:28:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 23314432. Throughput: 0: 8621.7. Samples: 23306004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:03,348][1054527] Avg episode reward: [(0, '3821.571')] [2023-03-10 17:28:03,377][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045544_23318528.pth... [2023-03-10 17:28:03,378][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045040_23060480.pth [2023-03-10 17:28:06,770][1054815] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-10 17:28:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 23359488. Throughput: 0: 8546.4. Samples: 23355456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:08,348][1054527] Avg episode reward: [(0, '3488.581')] [2023-03-10 17:28:11,679][1054815] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-10 17:28:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23400448. Throughput: 0: 8560.8. Samples: 23380152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:13,348][1054527] Avg episode reward: [(0, '3687.883')] [2023-03-10 17:28:16,525][1054815] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-10 17:28:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23441408. Throughput: 0: 8531.8. Samples: 23431844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:18,348][1054527] Avg episode reward: [(0, '3719.404')] [2023-03-10 17:28:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045784_23441408.pth... [2023-03-10 17:28:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045288_23187456.pth [2023-03-10 17:28:21,594][1054815] Updated weights for policy 0, policy_version 45840 (0.0006) [2023-03-10 17:28:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 23482368. Throughput: 0: 8474.6. Samples: 23479836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:23,348][1054527] Avg episode reward: [(0, '3910.906')] [2023-03-10 17:28:26,442][1054815] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-10 17:28:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 23523328. Throughput: 0: 8494.9. Samples: 23506416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:28,348][1054527] Avg episode reward: [(0, '3612.109')] [2023-03-10 17:28:31,391][1054815] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-10 17:28:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23568384. Throughput: 0: 8463.6. Samples: 23556096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:33,348][1054527] Avg episode reward: [(0, '3143.970')] [2023-03-10 17:28:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046032_23568384.pth... [2023-03-10 17:28:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045544_23318528.pth [2023-03-10 17:28:35,868][1054815] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-10 17:28:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 23613440. Throughput: 0: 8556.1. Samples: 23609416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:38,349][1054527] Avg episode reward: [(0, '2770.798')] [2023-03-10 17:28:40,662][1054815] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-10 17:28:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 23654400. Throughput: 0: 8499.9. Samples: 23635184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:43,348][1054527] Avg episode reward: [(0, '3635.832')] [2023-03-10 17:28:45,519][1054815] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-10 17:28:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 23695360. Throughput: 0: 8465.2. Samples: 23686940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:28:48,348][1054527] Avg episode reward: [(0, '3647.835')] [2023-03-10 17:28:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046280_23695360.pth... [2023-03-10 17:28:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000045784_23441408.pth [2023-03-10 17:28:50,418][1054815] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-10 17:28:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 23736320. Throughput: 0: 8462.4. Samples: 23736264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:28:53,348][1054527] Avg episode reward: [(0, '3454.362')] [2023-03-10 17:28:55,377][1054815] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-10 17:28:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 23781376. Throughput: 0: 8461.2. Samples: 23760904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:28:58,348][1054527] Avg episode reward: [(0, '3857.070')] [2023-03-10 17:29:00,140][1054815] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-10 17:29:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 23822336. Throughput: 0: 8442.8. Samples: 23811768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:29:03,348][1054527] Avg episode reward: [(0, '3777.523')] [2023-03-10 17:29:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046528_23822336.pth... [2023-03-10 17:29:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046032_23568384.pth [2023-03-10 17:29:05,030][1054815] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-10 17:29:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 23867392. Throughput: 0: 8522.8. Samples: 23863360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:29:08,348][1054527] Avg episode reward: [(0, '4053.654')] [2023-03-10 17:29:09,837][1054815] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-10 17:29:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 23904256. Throughput: 0: 8476.1. Samples: 23887840. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:29:13,348][1054527] Avg episode reward: [(0, '4076.711')] [2023-03-10 17:29:14,781][1054815] Updated weights for policy 0, policy_version 46720 (0.0006) [2023-03-10 17:29:18,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 23945216. Throughput: 0: 8482.5. Samples: 23937808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:18,348][1054527] Avg episode reward: [(0, '4283.319')] [2023-03-10 17:29:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046768_23945216.pth... [2023-03-10 17:29:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046280_23695360.pth [2023-03-10 17:29:20,062][1054815] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-10 17:29:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 23986176. Throughput: 0: 8318.8. Samples: 23983764. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:23,348][1054527] Avg episode reward: [(0, '4240.618')] [2023-03-10 17:29:25,029][1054815] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-10 17:29:28,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 24027136. Throughput: 0: 8329.2. Samples: 24009996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:28,348][1054527] Avg episode reward: [(0, '4167.517')] [2023-03-10 17:29:29,836][1054815] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-10 17:29:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 24068096. Throughput: 0: 8288.1. Samples: 24059904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:33,348][1054527] Avg episode reward: [(0, '4146.007')] [2023-03-10 17:29:33,368][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047016_24072192.pth... [2023-03-10 17:29:33,370][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046528_23822336.pth [2023-03-10 17:29:34,925][1054815] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-10 17:29:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8539.1). Total num frames: 24109056. Throughput: 0: 8277.5. Samples: 24108752. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:38,348][1054527] Avg episode reward: [(0, '4269.365')] [2023-03-10 17:29:39,820][1054815] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-10 17:29:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 24154112. Throughput: 0: 8282.8. Samples: 24133632. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:29:43,348][1054527] Avg episode reward: [(0, '4005.838')] [2023-03-10 17:29:44,560][1054815] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-10 17:29:48,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 24199168. Throughput: 0: 8332.9. Samples: 24186748. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:29:48,348][1054527] Avg episode reward: [(0, '3479.563')] [2023-03-10 17:29:48,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047264_24199168.pth... [2023-03-10 17:29:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000046768_23945216.pth [2023-03-10 17:29:49,241][1054815] Updated weights for policy 0, policy_version 47280 (0.0004) [2023-03-10 17:29:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 24240128. Throughput: 0: 8368.7. Samples: 24239952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:29:53,348][1054527] Avg episode reward: [(0, '3843.165')] [2023-03-10 17:29:53,859][1054815] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-10 17:29:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 24285184. Throughput: 0: 8376.2. Samples: 24264768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:29:58,348][1054527] Avg episode reward: [(0, '3621.605')] [2023-03-10 17:29:58,595][1054815] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-10 17:30:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 24326144. Throughput: 0: 8358.8. Samples: 24313952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:30:03,348][1054527] Avg episode reward: [(0, '3743.548')] [2023-03-10 17:30:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047512_24326144.pth... [2023-03-10 17:30:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047016_24072192.pth [2023-03-10 17:30:03,859][1054815] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-10 17:30:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 24367104. Throughput: 0: 8429.1. Samples: 24363072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:30:08,349][1054527] Avg episode reward: [(0, '4013.311')] [2023-03-10 17:30:08,819][1054815] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-10 17:30:13,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 24408064. Throughput: 0: 8391.2. Samples: 24387600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:30:13,348][1054527] Avg episode reward: [(0, '3914.520')] [2023-03-10 17:30:13,605][1054815] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-10 17:30:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 24449024. Throughput: 0: 8424.9. Samples: 24439024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:18,349][1054527] Avg episode reward: [(0, '4001.593')] [2023-03-10 17:30:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047752_24449024.pth... [2023-03-10 17:30:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047264_24199168.pth [2023-03-10 17:30:18,670][1054815] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-10 17:30:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 24489984. Throughput: 0: 8423.4. Samples: 24487804. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:23,348][1054527] Avg episode reward: [(0, '3556.778')] [2023-03-10 17:30:23,619][1054815] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-10 17:30:28,342][1054815] Updated weights for policy 0, policy_version 47920 (0.0004) [2023-03-10 17:30:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 24535040. Throughput: 0: 8464.6. Samples: 24514540. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:28,349][1054527] Avg episode reward: [(0, '2897.282')] [2023-03-10 17:30:33,091][1054815] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-10 17:30:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 24576000. Throughput: 0: 8387.8. Samples: 24564200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:33,348][1054527] Avg episode reward: [(0, '4161.994')] [2023-03-10 17:30:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048000_24576000.pth... [2023-03-10 17:30:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047512_24326144.pth [2023-03-10 17:30:37,706][1054815] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-10 17:30:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 24621056. Throughput: 0: 8397.9. Samples: 24617860. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:38,348][1054527] Avg episode reward: [(0, '4279.996')] [2023-03-10 17:30:42,780][1054815] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-10 17:30:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 24662016. Throughput: 0: 8404.5. Samples: 24642972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:30:43,349][1054527] Avg episode reward: [(0, '4382.116')] [2023-03-10 17:30:47,572][1054815] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-10 17:30:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 24702976. Throughput: 0: 8407.4. Samples: 24692288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:30:48,348][1054527] Avg episode reward: [(0, '4453.203')] [2023-03-10 17:30:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048248_24702976.pth... [2023-03-10 17:30:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000047752_24449024.pth [2023-03-10 17:30:52,417][1054815] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-10 17:30:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 24743936. Throughput: 0: 8460.2. Samples: 24743780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:30:53,348][1054527] Avg episode reward: [(0, '3508.262')] [2023-03-10 17:30:57,155][1054815] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-10 17:30:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 24788992. Throughput: 0: 8464.7. Samples: 24768512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:30:58,348][1054527] Avg episode reward: [(0, '3118.360')] [2023-03-10 17:31:01,903][1054815] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-10 17:31:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 24829952. Throughput: 0: 8501.7. Samples: 24821600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:31:03,348][1054527] Avg episode reward: [(0, '4239.173')] [2023-03-10 17:31:03,391][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048504_24834048.pth... [2023-03-10 17:31:03,393][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048000_24576000.pth [2023-03-10 17:31:06,760][1054815] Updated weights for policy 0, policy_version 48560 (0.0006) [2023-03-10 17:31:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 24875008. Throughput: 0: 8524.6. Samples: 24871412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:31:08,348][1054527] Avg episode reward: [(0, '3532.458')] [2023-03-10 17:31:11,617][1054815] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-10 17:31:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 24915968. Throughput: 0: 8514.9. Samples: 24897708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:31:13,348][1054527] Avg episode reward: [(0, '3237.413')] [2023-03-10 17:31:16,355][1054815] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-10 17:31:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 24961024. Throughput: 0: 8545.5. Samples: 24948748. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:18,348][1054527] Avg episode reward: [(0, '3957.602')] [2023-03-10 17:31:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048752_24961024.pth... [2023-03-10 17:31:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048248_24702976.pth [2023-03-10 17:31:21,191][1054815] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-10 17:31:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 25001984. Throughput: 0: 8475.9. Samples: 24999276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:23,348][1054527] Avg episode reward: [(0, '4390.002')] [2023-03-10 17:31:26,067][1054815] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-10 17:31:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 25042944. Throughput: 0: 8478.5. Samples: 25024504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:28,348][1054527] Avg episode reward: [(0, '4102.614')] [2023-03-10 17:31:30,860][1054815] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-10 17:31:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 25083904. Throughput: 0: 8517.0. Samples: 25075552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:33,348][1054527] Avg episode reward: [(0, '4105.305')] [2023-03-10 17:31:33,374][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049000_25088000.pth... [2023-03-10 17:31:33,377][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048504_24834048.pth [2023-03-10 17:31:35,622][1054815] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-10 17:31:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 25128960. Throughput: 0: 8542.0. Samples: 25128168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:38,348][1054527] Avg episode reward: [(0, '3874.125')] [2023-03-10 17:31:40,412][1054815] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-10 17:31:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25174016. Throughput: 0: 8556.1. Samples: 25153536. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:43,348][1054527] Avg episode reward: [(0, '3547.363')] [2023-03-10 17:31:45,133][1054815] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-10 17:31:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 25219072. Throughput: 0: 8522.5. Samples: 25205112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:31:48,348][1054527] Avg episode reward: [(0, '3843.258')] [2023-03-10 17:31:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049256_25219072.pth... [2023-03-10 17:31:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000048752_24961024.pth [2023-03-10 17:31:49,849][1054815] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-10 17:31:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 25260032. Throughput: 0: 8545.2. Samples: 25255948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:31:53,348][1054527] Avg episode reward: [(0, '3864.977')] [2023-03-10 17:31:54,686][1054815] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-10 17:31:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25300992. Throughput: 0: 8508.4. Samples: 25280584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:31:58,348][1054527] Avg episode reward: [(0, '3862.621')] [2023-03-10 17:31:59,769][1054815] Updated weights for policy 0, policy_version 49440 (0.0004) [2023-03-10 17:32:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25341952. Throughput: 0: 8490.2. Samples: 25330808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:03,348][1054527] Avg episode reward: [(0, '3992.200')] [2023-03-10 17:32:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049496_25341952.pth... [2023-03-10 17:32:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049000_25088000.pth [2023-03-10 17:32:04,627][1054815] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-10 17:32:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 25382912. Throughput: 0: 8482.4. Samples: 25380984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:08,348][1054527] Avg episode reward: [(0, '4186.374')] [2023-03-10 17:32:09,436][1054815] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-10 17:32:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25427968. Throughput: 0: 8510.9. Samples: 25407496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:13,348][1054527] Avg episode reward: [(0, '3742.962')] [2023-03-10 17:32:14,163][1054815] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-10 17:32:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 25468928. Throughput: 0: 8558.3. Samples: 25460676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:18,348][1054527] Avg episode reward: [(0, '3664.201')] [2023-03-10 17:32:18,369][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049752_25473024.pth... [2023-03-10 17:32:18,371][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049256_25219072.pth [2023-03-10 17:32:18,862][1054815] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-10 17:32:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25513984. Throughput: 0: 8482.6. Samples: 25509888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:23,348][1054527] Avg episode reward: [(0, '3241.181')] [2023-03-10 17:32:23,774][1054815] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-10 17:32:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25554944. Throughput: 0: 8499.2. Samples: 25536000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:28,348][1054527] Avg episode reward: [(0, '2962.474')] [2023-03-10 17:32:28,454][1054815] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-10 17:32:33,198][1054815] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-10 17:32:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 25600000. Throughput: 0: 8503.6. Samples: 25587776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:33,348][1054527] Avg episode reward: [(0, '3375.762')] [2023-03-10 17:32:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050000_25600000.pth... [2023-03-10 17:32:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049496_25341952.pth [2023-03-10 17:32:37,887][1054815] Updated weights for policy 0, policy_version 50080 (0.0005) [2023-03-10 17:32:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25640960. Throughput: 0: 8549.6. Samples: 25640680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:38,348][1054527] Avg episode reward: [(0, '3811.114')] [2023-03-10 17:32:42,655][1054815] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-10 17:32:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25686016. Throughput: 0: 8559.7. Samples: 25665772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:43,348][1054527] Avg episode reward: [(0, '4013.023')] [2023-03-10 17:32:47,400][1054815] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-10 17:32:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 25726976. Throughput: 0: 8613.2. Samples: 25718404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:48,348][1054527] Avg episode reward: [(0, '3723.522')] [2023-03-10 17:32:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050248_25726976.pth... [2023-03-10 17:32:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000049752_25473024.pth [2023-03-10 17:32:52,246][1054815] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-10 17:32:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25772032. Throughput: 0: 8607.2. Samples: 25768308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:53,349][1054527] Avg episode reward: [(0, '4248.093')] [2023-03-10 17:32:57,131][1054815] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-10 17:32:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25812992. Throughput: 0: 8590.3. Samples: 25794060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:32:58,348][1054527] Avg episode reward: [(0, '3907.214')] [2023-03-10 17:33:01,783][1054815] Updated weights for policy 0, policy_version 50480 (0.0005) [2023-03-10 17:33:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 25858048. Throughput: 0: 8559.0. Samples: 25845832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:03,348][1054527] Avg episode reward: [(0, '4216.286')] [2023-03-10 17:33:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050504_25858048.pth... [2023-03-10 17:33:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050000_25600000.pth [2023-03-10 17:33:06,760][1054815] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-10 17:33:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 25899008. Throughput: 0: 8572.1. Samples: 25895632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:08,348][1054527] Avg episode reward: [(0, '4442.633')] [2023-03-10 17:33:11,523][1054815] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-10 17:33:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 25939968. Throughput: 0: 8575.1. Samples: 25921880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:13,348][1054527] Avg episode reward: [(0, '4092.471')] [2023-03-10 17:33:16,617][1054815] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-10 17:33:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.4, 300 sec: 8469.7). Total num frames: 25980928. Throughput: 0: 8505.6. Samples: 25970528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:18,348][1054527] Avg episode reward: [(0, '4368.024')] [2023-03-10 17:33:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050744_25980928.pth... [2023-03-10 17:33:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050248_25726976.pth [2023-03-10 17:33:21,395][1054815] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-10 17:33:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 26025984. Throughput: 0: 8482.0. Samples: 26022372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:23,348][1054527] Avg episode reward: [(0, '4253.248')] [2023-03-10 17:33:26,198][1054815] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-10 17:33:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 26066944. Throughput: 0: 8476.3. Samples: 26047204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:28,348][1054527] Avg episode reward: [(0, '4006.329')] [2023-03-10 17:33:31,060][1054815] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-10 17:33:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 26107904. Throughput: 0: 8462.7. Samples: 26099224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:33,348][1054527] Avg episode reward: [(0, '3992.717')] [2023-03-10 17:33:33,381][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051000_26112000.pth... [2023-03-10 17:33:33,383][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050504_25858048.pth [2023-03-10 17:33:35,701][1054815] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-10 17:33:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 26152960. Throughput: 0: 8456.6. Samples: 26148856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:38,348][1054527] Avg episode reward: [(0, '4043.779')] [2023-03-10 17:33:40,598][1054815] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-10 17:33:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 26193920. Throughput: 0: 8479.4. Samples: 26175632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:43,348][1054527] Avg episode reward: [(0, '4340.283')] [2023-03-10 17:33:45,625][1054815] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-10 17:33:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 26234880. Throughput: 0: 8412.3. Samples: 26224384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:48,349][1054527] Avg episode reward: [(0, '3878.431')] [2023-03-10 17:33:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051240_26234880.pth... [2023-03-10 17:33:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000050744_25980928.pth [2023-03-10 17:33:50,330][1054815] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-10 17:33:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 26275840. Throughput: 0: 8442.8. Samples: 26275556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:33:53,348][1054527] Avg episode reward: [(0, '4182.394')] [2023-03-10 17:33:55,153][1054815] Updated weights for policy 0, policy_version 51360 (0.0004) [2023-03-10 17:33:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 26320896. Throughput: 0: 8442.3. Samples: 26301784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:33:58,348][1054527] Avg episode reward: [(0, '4129.538')] [2023-03-10 17:34:00,021][1054815] Updated weights for policy 0, policy_version 51440 (0.0004) [2023-03-10 17:34:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 26361856. Throughput: 0: 8480.5. Samples: 26352152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:03,348][1054527] Avg episode reward: [(0, '4048.347')] [2023-03-10 17:34:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051488_26361856.pth... [2023-03-10 17:34:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051000_26112000.pth [2023-03-10 17:34:04,952][1054815] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-10 17:34:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 26402816. Throughput: 0: 8435.9. Samples: 26401988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:08,348][1054527] Avg episode reward: [(0, '4376.340')] [2023-03-10 17:34:10,062][1054815] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-10 17:34:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 26443776. Throughput: 0: 8436.5. Samples: 26426844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:13,348][1054527] Avg episode reward: [(0, '4396.194')] [2023-03-10 17:34:14,978][1054815] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-10 17:34:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.0, 300 sec: 8483.6). Total num frames: 26488832. Throughput: 0: 8383.8. Samples: 26476496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:18,348][1054527] Avg episode reward: [(0, '4063.338')] [2023-03-10 17:34:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051736_26488832.pth... [2023-03-10 17:34:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051240_26234880.pth [2023-03-10 17:34:19,793][1054815] Updated weights for policy 0, policy_version 51760 (0.0004) [2023-03-10 17:34:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 26529792. Throughput: 0: 8385.6. Samples: 26526208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:23,348][1054527] Avg episode reward: [(0, '4389.610')] [2023-03-10 17:34:24,658][1054815] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-10 17:34:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 26570752. Throughput: 0: 8347.1. Samples: 26551252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:28,348][1054527] Avg episode reward: [(0, '3755.169')] [2023-03-10 17:34:29,525][1054815] Updated weights for policy 0, policy_version 51920 (0.0005) [2023-03-10 17:34:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 26611712. Throughput: 0: 8392.7. Samples: 26602056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:33,348][1054527] Avg episode reward: [(0, '4194.385')] [2023-03-10 17:34:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051976_26611712.pth... [2023-03-10 17:34:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051488_26361856.pth [2023-03-10 17:34:34,495][1054815] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-10 17:34:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 26652672. Throughput: 0: 8379.1. Samples: 26652616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:38,348][1054527] Avg episode reward: [(0, '4076.529')] [2023-03-10 17:34:39,399][1054815] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-10 17:34:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 26693632. Throughput: 0: 8344.1. Samples: 26677268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:43,348][1054527] Avg episode reward: [(0, '4450.045')] [2023-03-10 17:34:44,387][1054815] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-10 17:34:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 26738688. Throughput: 0: 8316.8. Samples: 26726408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:48,349][1054527] Avg episode reward: [(0, '4289.140')] [2023-03-10 17:34:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052224_26738688.pth... [2023-03-10 17:34:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051736_26488832.pth [2023-03-10 17:34:49,307][1054815] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-10 17:34:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 26779648. Throughput: 0: 8317.2. Samples: 26776264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:53,348][1054527] Avg episode reward: [(0, '4302.306')] [2023-03-10 17:34:54,167][1054815] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-10 17:34:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 26820608. Throughput: 0: 8350.9. Samples: 26802636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:34:58,348][1054527] Avg episode reward: [(0, '3971.084')] [2023-03-10 17:34:58,952][1054815] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-10 17:35:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 26865664. Throughput: 0: 8389.9. Samples: 26854040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:03,348][1054527] Avg episode reward: [(0, '3946.915')] [2023-03-10 17:35:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052472_26865664.pth... [2023-03-10 17:35:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000051976_26611712.pth [2023-03-10 17:35:03,612][1054815] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-10 17:35:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 26906624. Throughput: 0: 8418.4. Samples: 26905036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:08,348][1054527] Avg episode reward: [(0, '3916.748')] [2023-03-10 17:35:08,511][1054815] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-10 17:35:13,235][1054815] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-10 17:35:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.0, 300 sec: 8483.6). Total num frames: 26951680. Throughput: 0: 8443.4. Samples: 26931208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:13,349][1054527] Avg episode reward: [(0, '3741.563')] [2023-03-10 17:35:18,021][1054815] Updated weights for policy 0, policy_version 52720 (0.0005) [2023-03-10 17:35:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 26992640. Throughput: 0: 8468.4. Samples: 26983136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:18,348][1054527] Avg episode reward: [(0, '4038.812')] [2023-03-10 17:35:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052720_26992640.pth... [2023-03-10 17:35:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052224_26738688.pth [2023-03-10 17:35:22,990][1054815] Updated weights for policy 0, policy_version 52800 (0.0004) [2023-03-10 17:35:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 27033600. Throughput: 0: 8453.4. Samples: 27033020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:23,348][1054527] Avg episode reward: [(0, '3606.203')] [2023-03-10 17:35:27,749][1054815] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-10 17:35:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 27078656. Throughput: 0: 8466.2. Samples: 27058248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:28,348][1054527] Avg episode reward: [(0, '4225.472')] [2023-03-10 17:35:32,723][1054815] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-10 17:35:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 27119616. Throughput: 0: 8478.9. Samples: 27107960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:33,349][1054527] Avg episode reward: [(0, '4244.556')] [2023-03-10 17:35:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052968_27119616.pth... [2023-03-10 17:35:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052472_26865664.pth [2023-03-10 17:35:38,001][1054815] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-10 17:35:38,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 27156480. Throughput: 0: 8442.2. Samples: 27156164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:38,348][1054527] Avg episode reward: [(0, '4509.267')] [2023-03-10 17:35:42,945][1054815] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-10 17:35:43,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 27197440. Throughput: 0: 8373.7. Samples: 27179452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:43,348][1054527] Avg episode reward: [(0, '4242.893')] [2023-03-10 17:35:48,205][1054815] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-10 17:35:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 27238400. Throughput: 0: 8315.9. Samples: 27228256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:48,348][1054527] Avg episode reward: [(0, '4018.405')] [2023-03-10 17:35:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053200_27238400.pth... [2023-03-10 17:35:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052720_26992640.pth [2023-03-10 17:35:53,050][1054815] Updated weights for policy 0, policy_version 53280 (0.0004) [2023-03-10 17:35:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 27279360. Throughput: 0: 8278.3. Samples: 27277560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:53,348][1054527] Avg episode reward: [(0, '3893.065')] [2023-03-10 17:35:57,986][1054815] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-10 17:35:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 27320320. Throughput: 0: 8281.7. Samples: 27303884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:35:58,348][1054527] Avg episode reward: [(0, '3832.871')] [2023-03-10 17:36:02,949][1054815] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-10 17:36:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8428.0). Total num frames: 27361280. Throughput: 0: 8219.9. Samples: 27353032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:36:03,348][1054527] Avg episode reward: [(0, '4042.690')] [2023-03-10 17:36:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053440_27361280.pth... [2023-03-10 17:36:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000052968_27119616.pth [2023-03-10 17:36:08,120][1054815] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-10 17:36:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8428.0). Total num frames: 27402240. Throughput: 0: 8164.2. Samples: 27400408. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:08,348][1054527] Avg episode reward: [(0, '3787.028')] [2023-03-10 17:36:13,068][1054815] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-10 17:36:13,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8192.0, 300 sec: 8414.2). Total num frames: 27443200. Throughput: 0: 8158.6. Samples: 27425384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:13,349][1054527] Avg episode reward: [(0, '4071.100')] [2023-03-10 17:36:18,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8123.7, 300 sec: 8400.3). Total num frames: 27480064. Throughput: 0: 8088.4. Samples: 27471936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:18,348][1054527] Avg episode reward: [(0, '4117.863')] [2023-03-10 17:36:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053672_27480064.pth... [2023-03-10 17:36:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053200_27238400.pth [2023-03-10 17:36:18,418][1054815] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-10 17:36:23,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8123.7, 300 sec: 8400.3). Total num frames: 27521024. Throughput: 0: 8079.3. Samples: 27519732. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:23,348][1054527] Avg episode reward: [(0, '3520.151')] [2023-03-10 17:36:23,473][1054815] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-10 17:36:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8055.5, 300 sec: 8400.3). Total num frames: 27561984. Throughput: 0: 8115.7. Samples: 27544656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:28,348][1054527] Avg episode reward: [(0, '3870.273')] [2023-03-10 17:36:28,459][1054815] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-10 17:36:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8055.5, 300 sec: 8386.4). Total num frames: 27602944. Throughput: 0: 8127.7. Samples: 27594004. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:33,348][1054527] Avg episode reward: [(0, '3779.298')] [2023-03-10 17:36:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053912_27602944.pth... [2023-03-10 17:36:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053440_27361280.pth [2023-03-10 17:36:33,536][1054815] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-10 17:36:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8372.5). Total num frames: 27643904. Throughput: 0: 8136.2. Samples: 27643688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:36:38,348][1054527] Avg episode reward: [(0, '3732.177')] [2023-03-10 17:36:38,438][1054815] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-10 17:36:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.7, 300 sec: 8358.6). Total num frames: 27684864. Throughput: 0: 8090.8. Samples: 27667972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:36:43,348][1054527] Avg episode reward: [(0, '3434.947')] [2023-03-10 17:36:43,379][1054815] Updated weights for policy 0, policy_version 54080 (0.0004) [2023-03-10 17:36:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8358.6). Total num frames: 27725824. Throughput: 0: 8101.6. Samples: 27717604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:36:48,348][1054527] Avg episode reward: [(0, '3576.938')] [2023-03-10 17:36:48,355][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054160_27729920.pth... [2023-03-10 17:36:48,355][1054815] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-10 17:36:48,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053672_27480064.pth [2023-03-10 17:36:53,184][1054815] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-10 17:36:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 27770880. Throughput: 0: 8160.2. Samples: 27767616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:36:53,348][1054527] Avg episode reward: [(0, '3986.222')] [2023-03-10 17:36:58,176][1054815] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-10 17:36:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 27811840. Throughput: 0: 8160.9. Samples: 27792624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:36:58,348][1054527] Avg episode reward: [(0, '3966.933')] [2023-03-10 17:37:02,905][1054815] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-10 17:37:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 27852800. Throughput: 0: 8269.8. Samples: 27844076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:37:03,348][1054527] Avg episode reward: [(0, '3747.668')] [2023-03-10 17:37:03,382][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054408_27856896.pth... [2023-03-10 17:37:03,385][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000053912_27602944.pth [2023-03-10 17:37:07,748][1054815] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-10 17:37:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 27897856. Throughput: 0: 8318.9. Samples: 27894084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:37:08,348][1054527] Avg episode reward: [(0, '3802.709')] [2023-03-10 17:37:12,642][1054815] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-10 17:37:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 27938816. Throughput: 0: 8310.9. Samples: 27918648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:37:13,348][1054527] Avg episode reward: [(0, '3797.390')] [2023-03-10 17:37:17,503][1054815] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-10 17:37:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 27979776. Throughput: 0: 8363.9. Samples: 27970380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:18,348][1054527] Avg episode reward: [(0, '4013.029')] [2023-03-10 17:37:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054648_27979776.pth... [2023-03-10 17:37:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054160_27729920.pth [2023-03-10 17:37:22,456][1054815] Updated weights for policy 0, policy_version 54720 (0.0004) [2023-03-10 17:37:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 28020736. Throughput: 0: 8371.5. Samples: 28020404. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:23,348][1054527] Avg episode reward: [(0, '4118.333')] [2023-03-10 17:37:27,396][1054815] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-10 17:37:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 28061696. Throughput: 0: 8387.7. Samples: 28045416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:28,348][1054527] Avg episode reward: [(0, '3321.105')] [2023-03-10 17:37:32,191][1054815] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-10 17:37:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 28106752. Throughput: 0: 8392.6. Samples: 28095272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:33,349][1054527] Avg episode reward: [(0, '3140.782')] [2023-03-10 17:37:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054896_28106752.pth... [2023-03-10 17:37:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054408_27856896.pth [2023-03-10 17:37:37,207][1054815] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-10 17:37:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 28147712. Throughput: 0: 8384.8. Samples: 28144932. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:38,348][1054527] Avg episode reward: [(0, '3736.252')] [2023-03-10 17:37:42,219][1054815] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-10 17:37:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 28188672. Throughput: 0: 8379.6. Samples: 28169708. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:43,348][1054527] Avg episode reward: [(0, '3604.109')] [2023-03-10 17:37:46,983][1054815] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-10 17:37:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8330.8). Total num frames: 28229632. Throughput: 0: 8372.3. Samples: 28220828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:48,348][1054527] Avg episode reward: [(0, '2924.632')] [2023-03-10 17:37:48,357][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055144_28233728.pth... [2023-03-10 17:37:48,359][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054648_27979776.pth [2023-03-10 17:37:51,624][1054815] Updated weights for policy 0, policy_version 55200 (0.0006) [2023-03-10 17:37:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 28274688. Throughput: 0: 8427.9. Samples: 28273340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:53,348][1054527] Avg episode reward: [(0, '3339.714')] [2023-03-10 17:37:56,589][1054815] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-10 17:37:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8330.8). Total num frames: 28315648. Throughput: 0: 8422.7. Samples: 28297672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:37:58,348][1054527] Avg episode reward: [(0, '3538.417')] [2023-03-10 17:38:01,394][1054815] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-10 17:38:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 28360704. Throughput: 0: 8400.5. Samples: 28348404. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:38:03,348][1054527] Avg episode reward: [(0, '3782.830')] [2023-03-10 17:38:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055392_28360704.pth... [2023-03-10 17:38:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000054896_28106752.pth [2023-03-10 17:38:06,110][1054815] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-10 17:38:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 28401664. Throughput: 0: 8445.0. Samples: 28400428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:38:08,348][1054527] Avg episode reward: [(0, '3455.736')] [2023-03-10 17:38:10,896][1054815] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-10 17:38:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 28442624. Throughput: 0: 8460.7. Samples: 28426148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:38:13,348][1054527] Avg episode reward: [(0, '4008.841')] [2023-03-10 17:38:15,752][1054815] Updated weights for policy 0, policy_version 55600 (0.0004) [2023-03-10 17:38:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 28487680. Throughput: 0: 8460.2. Samples: 28475980. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:38:18,348][1054527] Avg episode reward: [(0, '4061.527')] [2023-03-10 17:38:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055640_28487680.pth... [2023-03-10 17:38:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055144_28233728.pth [2023-03-10 17:38:20,647][1054815] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-10 17:38:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 28528640. Throughput: 0: 8494.9. Samples: 28527204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:38:23,348][1054527] Avg episode reward: [(0, '3786.911')] [2023-03-10 17:38:25,585][1054815] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-10 17:38:28,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.0, 300 sec: 8344.7). Total num frames: 28569600. Throughput: 0: 8479.1. Samples: 28551268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:28,348][1054527] Avg episode reward: [(0, '3839.409')] [2023-03-10 17:38:30,484][1054815] Updated weights for policy 0, policy_version 55840 (0.0006) [2023-03-10 17:38:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 28614656. Throughput: 0: 8476.0. Samples: 28602248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:33,348][1054527] Avg episode reward: [(0, '3835.669')] [2023-03-10 17:38:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055888_28614656.pth... [2023-03-10 17:38:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055392_28360704.pth [2023-03-10 17:38:35,179][1054815] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-10 17:38:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 28655616. Throughput: 0: 8460.2. Samples: 28654048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:38,348][1054527] Avg episode reward: [(0, '3969.616')] [2023-03-10 17:38:39,782][1054815] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-10 17:38:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 28700672. Throughput: 0: 8532.2. Samples: 28681620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:43,348][1054527] Avg episode reward: [(0, '4137.385')] [2023-03-10 17:38:44,476][1054815] Updated weights for policy 0, policy_version 56080 (0.0004) [2023-03-10 17:38:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8372.5). Total num frames: 28745728. Throughput: 0: 8554.5. Samples: 28733356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:48,348][1054527] Avg episode reward: [(0, '3733.315')] [2023-03-10 17:38:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056144_28745728.pth... [2023-03-10 17:38:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055640_28487680.pth [2023-03-10 17:38:49,280][1054815] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-10 17:38:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 28786688. Throughput: 0: 8564.5. Samples: 28785832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:38:53,348][1054527] Avg episode reward: [(0, '4112.213')] [2023-03-10 17:38:53,895][1054815] Updated weights for policy 0, policy_version 56240 (0.0004) [2023-03-10 17:38:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8372.5). Total num frames: 28831744. Throughput: 0: 8558.1. Samples: 28811264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:38:58,348][1054527] Avg episode reward: [(0, '4171.171')] [2023-03-10 17:38:58,775][1054815] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-10 17:39:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8372.5). Total num frames: 28872704. Throughput: 0: 8595.9. Samples: 28862796. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:03,348][1054527] Avg episode reward: [(0, '3964.070')] [2023-03-10 17:39:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056392_28872704.pth... [2023-03-10 17:39:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000055888_28614656.pth [2023-03-10 17:39:03,608][1054815] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-10 17:39:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8372.5). Total num frames: 28913664. Throughput: 0: 8550.4. Samples: 28911972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:08,348][1054527] Avg episode reward: [(0, '3997.745')] [2023-03-10 17:39:08,542][1054815] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-10 17:39:13,285][1054815] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-10 17:39:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8372.5). Total num frames: 28958720. Throughput: 0: 8601.0. Samples: 28938312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:13,348][1054527] Avg episode reward: [(0, '3927.750')] [2023-03-10 17:39:18,080][1054815] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-10 17:39:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8372.5). Total num frames: 28999680. Throughput: 0: 8579.3. Samples: 28988316. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:18,349][1054527] Avg episode reward: [(0, '3954.635')] [2023-03-10 17:39:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056640_28999680.pth... [2023-03-10 17:39:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056144_28745728.pth [2023-03-10 17:39:22,783][1054815] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-10 17:39:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8386.4). Total num frames: 29044736. Throughput: 0: 8592.5. Samples: 29040712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:23,348][1054527] Avg episode reward: [(0, '3678.325')] [2023-03-10 17:39:27,368][1054815] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-10 17:39:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8400.3). Total num frames: 29089792. Throughput: 0: 8596.7. Samples: 29068472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:28,348][1054527] Avg episode reward: [(0, '3455.757')] [2023-03-10 17:39:32,207][1054815] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-10 17:39:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 29130752. Throughput: 0: 8562.1. Samples: 29118652. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:39:33,349][1054527] Avg episode reward: [(0, '4275.190')] [2023-03-10 17:39:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056896_29130752.pth... [2023-03-10 17:39:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056392_28872704.pth [2023-03-10 17:39:37,150][1054815] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-10 17:39:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 29171712. Throughput: 0: 8519.9. Samples: 29169228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:39:38,348][1054527] Avg episode reward: [(0, '4148.018')] [2023-03-10 17:39:41,954][1054815] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-10 17:39:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 29216768. Throughput: 0: 8525.8. Samples: 29194924. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:39:43,348][1054527] Avg episode reward: [(0, '4405.228')] [2023-03-10 17:39:46,688][1054815] Updated weights for policy 0, policy_version 57120 (0.0006) [2023-03-10 17:39:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 29257728. Throughput: 0: 8528.4. Samples: 29246576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:39:48,348][1054527] Avg episode reward: [(0, '4098.651')] [2023-03-10 17:39:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057144_29257728.pth... [2023-03-10 17:39:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056640_28999680.pth [2023-03-10 17:39:51,522][1054815] Updated weights for policy 0, policy_version 57200 (0.0005) [2023-03-10 17:39:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 29298688. Throughput: 0: 8584.6. Samples: 29298280. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:39:53,348][1054527] Avg episode reward: [(0, '4149.344')] [2023-03-10 17:39:56,344][1054815] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-10 17:39:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 29343744. Throughput: 0: 8552.1. Samples: 29323156. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:39:58,349][1054527] Avg episode reward: [(0, '3271.815')] [2023-03-10 17:40:00,934][1054815] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-10 17:40:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.4, 300 sec: 8400.3). Total num frames: 29384704. Throughput: 0: 8621.6. Samples: 29376288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:40:03,348][1054527] Avg episode reward: [(0, '3113.060')] [2023-03-10 17:40:03,380][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057400_29388800.pth... [2023-03-10 17:40:03,382][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000056896_29130752.pth [2023-03-10 17:40:05,832][1054815] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-10 17:40:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 29429760. Throughput: 0: 8570.5. Samples: 29426384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:40:08,349][1054527] Avg episode reward: [(0, '2822.503')] [2023-03-10 17:40:10,655][1054815] Updated weights for policy 0, policy_version 57520 (0.0004) [2023-03-10 17:40:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 29470720. Throughput: 0: 8513.3. Samples: 29451572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:13,348][1054527] Avg episode reward: [(0, '3560.370')] [2023-03-10 17:40:15,579][1054815] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-10 17:40:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 29511680. Throughput: 0: 8551.7. Samples: 29503476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:18,348][1054527] Avg episode reward: [(0, '3526.324')] [2023-03-10 17:40:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057640_29511680.pth... [2023-03-10 17:40:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057144_29257728.pth [2023-03-10 17:40:20,221][1054815] Updated weights for policy 0, policy_version 57680 (0.0004) [2023-03-10 17:40:23,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 29560832. Throughput: 0: 8622.7. Samples: 29557248. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:23,348][1054527] Avg episode reward: [(0, '3731.720')] [2023-03-10 17:40:24,583][1054815] Updated weights for policy 0, policy_version 57760 (0.0004) [2023-03-10 17:40:28,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 29605888. Throughput: 0: 8665.4. Samples: 29584868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:28,348][1054527] Avg episode reward: [(0, '3634.650')] [2023-03-10 17:40:29,239][1054815] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-10 17:40:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 29646848. Throughput: 0: 8656.3. Samples: 29636108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:33,348][1054527] Avg episode reward: [(0, '3732.445')] [2023-03-10 17:40:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057904_29646848.pth... [2023-03-10 17:40:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057400_29388800.pth [2023-03-10 17:40:34,214][1054815] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-10 17:40:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 29687808. Throughput: 0: 8612.3. Samples: 29685836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:38,348][1054527] Avg episode reward: [(0, '3890.800')] [2023-03-10 17:40:39,015][1054815] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-10 17:40:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 29728768. Throughput: 0: 8638.3. Samples: 29711880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 17:40:43,348][1054527] Avg episode reward: [(0, '4375.901')] [2023-03-10 17:40:43,915][1054815] Updated weights for policy 0, policy_version 58080 (0.0006) [2023-03-10 17:40:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 29769728. Throughput: 0: 8549.8. Samples: 29761028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:40:48,348][1054527] Avg episode reward: [(0, '3837.491')] [2023-03-10 17:40:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058144_29769728.pth... [2023-03-10 17:40:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057640_29511680.pth [2023-03-10 17:40:49,013][1054815] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-10 17:40:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 29810688. Throughput: 0: 8520.9. Samples: 29809824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:40:53,348][1054527] Avg episode reward: [(0, '3364.445')] [2023-03-10 17:40:53,960][1054815] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-10 17:40:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 29851648. Throughput: 0: 8504.3. Samples: 29834264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:40:58,348][1054527] Avg episode reward: [(0, '3871.615')] [2023-03-10 17:40:58,996][1054815] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-10 17:41:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 29896704. Throughput: 0: 8466.9. Samples: 29884488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:03,348][1054527] Avg episode reward: [(0, '4519.205')] [2023-03-10 17:41:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058392_29896704.pth... [2023-03-10 17:41:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000057904_29646848.pth [2023-03-10 17:41:03,638][1054815] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-10 17:41:08,118][1054815] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-10 17:41:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 29941760. Throughput: 0: 8472.2. Samples: 29938496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:08,348][1054527] Avg episode reward: [(0, '4090.483')] [2023-03-10 17:41:12,583][1054815] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-10 17:41:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 29986816. Throughput: 0: 8478.8. Samples: 29966416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:13,348][1054527] Avg episode reward: [(0, '3866.715')] [2023-03-10 17:41:17,299][1054815] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-10 17:41:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 30031872. Throughput: 0: 8521.7. Samples: 30019584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:18,348][1054527] Avg episode reward: [(0, '4088.262')] [2023-03-10 17:41:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058656_30031872.pth... [2023-03-10 17:41:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058144_29769728.pth [2023-03-10 17:41:22,001][1054815] Updated weights for policy 0, policy_version 58720 (0.0004) [2023-03-10 17:41:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 30072832. Throughput: 0: 8597.1. Samples: 30072704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:23,348][1054527] Avg episode reward: [(0, '3821.548')] [2023-03-10 17:41:26,658][1054815] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-10 17:41:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 30117888. Throughput: 0: 8586.6. Samples: 30098276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:28,348][1054527] Avg episode reward: [(0, '3829.617')] [2023-03-10 17:41:31,759][1054815] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-10 17:41:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 30158848. Throughput: 0: 8572.3. Samples: 30146780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:33,348][1054527] Avg episode reward: [(0, '4111.168')] [2023-03-10 17:41:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058904_30158848.pth... [2023-03-10 17:41:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058392_29896704.pth [2023-03-10 17:41:36,522][1054815] Updated weights for policy 0, policy_version 58960 (0.0004) [2023-03-10 17:41:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.4, 300 sec: 8525.2). Total num frames: 30199808. Throughput: 0: 8653.8. Samples: 30199244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:38,348][1054527] Avg episode reward: [(0, '4071.715')] [2023-03-10 17:41:41,299][1054815] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-10 17:41:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 30244864. Throughput: 0: 8668.3. Samples: 30224336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:43,348][1054527] Avg episode reward: [(0, '4060.136')] [2023-03-10 17:41:46,062][1054815] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-10 17:41:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8539.1). Total num frames: 30289920. Throughput: 0: 8715.7. Samples: 30276696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:48,348][1054527] Avg episode reward: [(0, '4413.889')] [2023-03-10 17:41:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059160_30289920.pth... [2023-03-10 17:41:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058656_30031872.pth [2023-03-10 17:41:50,955][1054815] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-10 17:41:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 30326784. Throughput: 0: 8628.5. Samples: 30326780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:53,348][1054527] Avg episode reward: [(0, '4037.058')] [2023-03-10 17:41:55,866][1054815] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-10 17:41:58,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 30367744. Throughput: 0: 8554.3. Samples: 30351360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:41:58,348][1054527] Avg episode reward: [(0, '3723.666')] [2023-03-10 17:42:00,912][1054815] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-10 17:42:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 30408704. Throughput: 0: 8461.0. Samples: 30400332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:03,349][1054527] Avg episode reward: [(0, '3785.299')] [2023-03-10 17:42:03,367][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059400_30412800.pth... [2023-03-10 17:42:03,369][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000058904_30158848.pth [2023-03-10 17:42:05,765][1054815] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-10 17:42:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 30453760. Throughput: 0: 8415.3. Samples: 30451392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:08,349][1054527] Avg episode reward: [(0, '3486.834')] [2023-03-10 17:42:10,654][1054815] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-10 17:42:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 30494720. Throughput: 0: 8386.8. Samples: 30475684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:13,348][1054527] Avg episode reward: [(0, '3876.756')] [2023-03-10 17:42:15,388][1054815] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-10 17:42:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 30535680. Throughput: 0: 8458.4. Samples: 30527408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:18,348][1054527] Avg episode reward: [(0, '3635.994')] [2023-03-10 17:42:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059640_30535680.pth... [2023-03-10 17:42:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059160_30289920.pth [2023-03-10 17:42:20,228][1054815] Updated weights for policy 0, policy_version 59680 (0.0004) [2023-03-10 17:42:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 30580736. Throughput: 0: 8408.6. Samples: 30577632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:23,348][1054527] Avg episode reward: [(0, '4101.409')] [2023-03-10 17:42:25,198][1054815] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-10 17:42:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 30621696. Throughput: 0: 8399.0. Samples: 30602292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:28,348][1054527] Avg episode reward: [(0, '3559.735')] [2023-03-10 17:42:29,898][1054815] Updated weights for policy 0, policy_version 59840 (0.0005) [2023-03-10 17:42:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 30666752. Throughput: 0: 8396.4. Samples: 30654536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:33,348][1054527] Avg episode reward: [(0, '3412.863')] [2023-03-10 17:42:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059896_30666752.pth... [2023-03-10 17:42:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059400_30412800.pth [2023-03-10 17:42:34,598][1054815] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-10 17:42:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8539.1). Total num frames: 30707712. Throughput: 0: 8400.0. Samples: 30704780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:38,348][1054527] Avg episode reward: [(0, '3092.683')] [2023-03-10 17:42:39,512][1054815] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-10 17:42:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 30752768. Throughput: 0: 8459.5. Samples: 30732036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:43,348][1054527] Avg episode reward: [(0, '3772.889')] [2023-03-10 17:42:44,195][1054815] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-10 17:42:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 30797824. Throughput: 0: 8536.8. Samples: 30784488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:48,349][1054527] Avg episode reward: [(0, '4038.368')] [2023-03-10 17:42:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060152_30797824.pth... [2023-03-10 17:42:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059640_30535680.pth [2023-03-10 17:42:48,864][1054815] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-10 17:42:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 30838784. Throughput: 0: 8543.2. Samples: 30835836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:53,348][1054527] Avg episode reward: [(0, '3619.314')] [2023-03-10 17:42:53,661][1054815] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-10 17:42:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 30879744. Throughput: 0: 8594.4. Samples: 30862432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:42:58,348][1054527] Avg episode reward: [(0, '3997.508')] [2023-03-10 17:42:58,449][1054815] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-10 17:43:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 30920704. Throughput: 0: 8488.9. Samples: 30909408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:03,349][1054527] Avg episode reward: [(0, '3976.654')] [2023-03-10 17:43:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060392_30920704.pth... [2023-03-10 17:43:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000059896_30666752.pth [2023-03-10 17:43:03,749][1054815] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-10 17:43:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 30961664. Throughput: 0: 8502.8. Samples: 30960260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:08,348][1054527] Avg episode reward: [(0, '3025.836')] [2023-03-10 17:43:08,614][1054815] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-10 17:43:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 31002624. Throughput: 0: 8491.6. Samples: 30984416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:13,348][1054527] Avg episode reward: [(0, '3362.354')] [2023-03-10 17:43:13,450][1054815] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-10 17:43:18,275][1054815] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-10 17:43:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 31047680. Throughput: 0: 8464.9. Samples: 31035456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:18,348][1054527] Avg episode reward: [(0, '4195.898')] [2023-03-10 17:43:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060640_31047680.pth... [2023-03-10 17:43:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060152_30797824.pth [2023-03-10 17:43:23,069][1054815] Updated weights for policy 0, policy_version 60720 (0.0006) [2023-03-10 17:43:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 31088640. Throughput: 0: 8489.5. Samples: 31086808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:23,349][1054527] Avg episode reward: [(0, '4053.119')] [2023-03-10 17:43:28,030][1054815] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-10 17:43:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 31129600. Throughput: 0: 8414.9. Samples: 31110708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:28,349][1054527] Avg episode reward: [(0, '4037.454')] [2023-03-10 17:43:32,851][1054815] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-10 17:43:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 31174656. Throughput: 0: 8392.5. Samples: 31162152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:33,348][1054527] Avg episode reward: [(0, '3936.767')] [2023-03-10 17:43:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060888_31174656.pth... [2023-03-10 17:43:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060392_30920704.pth [2023-03-10 17:43:37,469][1054815] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-10 17:43:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 31215616. Throughput: 0: 8420.0. Samples: 31214736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:38,348][1054527] Avg episode reward: [(0, '4548.644')] [2023-03-10 17:43:42,569][1054815] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-10 17:43:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 31256576. Throughput: 0: 8364.2. Samples: 31238820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:43,348][1054527] Avg episode reward: [(0, '4266.113')] [2023-03-10 17:43:47,424][1054815] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-10 17:43:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 31297536. Throughput: 0: 8442.6. Samples: 31289324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:43:48,348][1054527] Avg episode reward: [(0, '4391.223')] [2023-03-10 17:43:48,381][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061136_31301632.pth... [2023-03-10 17:43:48,382][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060640_31047680.pth [2023-03-10 17:43:52,422][1054815] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-10 17:43:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 31342592. Throughput: 0: 8403.6. Samples: 31338424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:43:53,348][1054527] Avg episode reward: [(0, '4566.604')] [2023-03-10 17:43:53,349][1054771] Saving new best policy, reward=4566.604! [2023-03-10 17:43:57,338][1054815] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-10 17:43:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 31383552. Throughput: 0: 8414.5. Samples: 31363068. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:43:58,348][1054527] Avg episode reward: [(0, '4521.064')] [2023-03-10 17:44:02,190][1054815] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-10 17:44:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 31424512. Throughput: 0: 8394.2. Samples: 31413196. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:03,348][1054527] Avg episode reward: [(0, '4224.466')] [2023-03-10 17:44:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061376_31424512.pth... [2023-03-10 17:44:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000060888_31174656.pth [2023-03-10 17:44:06,691][1054815] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-10 17:44:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 31469568. Throughput: 0: 8428.7. Samples: 31466100. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:08,348][1054527] Avg episode reward: [(0, '4472.150')] [2023-03-10 17:44:11,545][1054815] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-10 17:44:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8511.4). Total num frames: 31510528. Throughput: 0: 8498.7. Samples: 31493148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:13,349][1054527] Avg episode reward: [(0, '4506.390')] [2023-03-10 17:44:16,684][1054815] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-10 17:44:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 31551488. Throughput: 0: 8400.6. Samples: 31540180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:18,348][1054527] Avg episode reward: [(0, '4338.970')] [2023-03-10 17:44:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061624_31551488.pth... [2023-03-10 17:44:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061136_31301632.pth [2023-03-10 17:44:21,569][1054815] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-10 17:44:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 31592448. Throughput: 0: 8348.9. Samples: 31590436. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:23,348][1054527] Avg episode reward: [(0, '4319.925')] [2023-03-10 17:44:26,425][1054815] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-10 17:44:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 31633408. Throughput: 0: 8397.6. Samples: 31616712. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:44:28,348][1054527] Avg episode reward: [(0, '4463.279')] [2023-03-10 17:44:31,334][1054815] Updated weights for policy 0, policy_version 61840 (0.0004) [2023-03-10 17:44:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 31678464. Throughput: 0: 8375.9. Samples: 31666240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:33,348][1054527] Avg episode reward: [(0, '4470.705')] [2023-03-10 17:44:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061872_31678464.pth... [2023-03-10 17:44:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061376_31424512.pth [2023-03-10 17:44:36,385][1054815] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-10 17:44:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 31719424. Throughput: 0: 8385.2. Samples: 31715756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:38,348][1054527] Avg episode reward: [(0, '4338.070')] [2023-03-10 17:44:41,210][1054815] Updated weights for policy 0, policy_version 62000 (0.0004) [2023-03-10 17:44:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 31760384. Throughput: 0: 8386.1. Samples: 31740444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:43,348][1054527] Avg episode reward: [(0, '4045.792')] [2023-03-10 17:44:46,010][1054815] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-10 17:44:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 31805440. Throughput: 0: 8441.3. Samples: 31793056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:48,349][1054527] Avg episode reward: [(0, '4489.715')] [2023-03-10 17:44:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062120_31805440.pth... [2023-03-10 17:44:48,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061624_31551488.pth [2023-03-10 17:44:50,611][1054815] Updated weights for policy 0, policy_version 62160 (0.0006) [2023-03-10 17:44:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 31846400. Throughput: 0: 8450.1. Samples: 31846352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:53,348][1054527] Avg episode reward: [(0, '4472.717')] [2023-03-10 17:44:55,203][1054815] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-10 17:44:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 31891456. Throughput: 0: 8424.7. Samples: 31872260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:44:58,348][1054527] Avg episode reward: [(0, '4414.237')] [2023-03-10 17:44:59,955][1054815] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-10 17:45:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 31932416. Throughput: 0: 8511.4. Samples: 31923192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:45:03,348][1054527] Avg episode reward: [(0, '4565.526')] [2023-03-10 17:45:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062368_31932416.pth... [2023-03-10 17:45:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000061872_31678464.pth [2023-03-10 17:45:04,974][1054815] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-10 17:45:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 31977472. Throughput: 0: 8511.2. Samples: 31973440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:08,348][1054527] Avg episode reward: [(0, '4401.220')] [2023-03-10 17:45:09,636][1054815] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-10 17:45:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 32018432. Throughput: 0: 8507.6. Samples: 31999556. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:13,348][1054527] Avg episode reward: [(0, '4183.253')] [2023-03-10 17:45:14,429][1054815] Updated weights for policy 0, policy_version 62560 (0.0005) [2023-03-10 17:45:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 32063488. Throughput: 0: 8554.2. Samples: 32051180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:18,349][1054527] Avg episode reward: [(0, '4163.342')] [2023-03-10 17:45:18,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062624_32063488.pth... [2023-03-10 17:45:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062120_31805440.pth [2023-03-10 17:45:19,347][1054815] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-10 17:45:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 32104448. Throughput: 0: 8545.9. Samples: 32100320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:23,348][1054527] Avg episode reward: [(0, '4432.478')] [2023-03-10 17:45:24,206][1054815] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-10 17:45:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 32149504. Throughput: 0: 8635.0. Samples: 32129020. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:28,348][1054527] Avg episode reward: [(0, '4223.780')] [2023-03-10 17:45:28,765][1054815] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-10 17:45:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 32190464. Throughput: 0: 8621.7. Samples: 32181032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:33,348][1054527] Avg episode reward: [(0, '4051.567')] [2023-03-10 17:45:33,366][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062880_32194560.pth... [2023-03-10 17:45:33,367][1054815] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-10 17:45:33,368][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062368_31932416.pth [2023-03-10 17:45:37,815][1054815] Updated weights for policy 0, policy_version 62960 (0.0006) [2023-03-10 17:45:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 32239616. Throughput: 0: 8648.3. Samples: 32235528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:38,348][1054527] Avg episode reward: [(0, '4349.183')] [2023-03-10 17:45:42,424][1054815] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-10 17:45:43,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 32284672. Throughput: 0: 8690.6. Samples: 32263336. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:45:43,348][1054527] Avg episode reward: [(0, '4604.999')] [2023-03-10 17:45:43,349][1054771] Saving new best policy, reward=4604.999! [2023-03-10 17:45:47,018][1054815] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-10 17:45:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 32325632. Throughput: 0: 8726.3. Samples: 32315876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:45:48,348][1054527] Avg episode reward: [(0, '4486.211')] [2023-03-10 17:45:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063144_32329728.pth... [2023-03-10 17:45:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062624_32063488.pth [2023-03-10 17:45:51,499][1054815] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-10 17:45:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8539.1). Total num frames: 32370688. Throughput: 0: 8822.9. Samples: 32370468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:45:53,348][1054527] Avg episode reward: [(0, '4337.549')] [2023-03-10 17:45:56,145][1054815] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-10 17:45:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8539.1). Total num frames: 32415744. Throughput: 0: 8831.6. Samples: 32396980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:45:58,348][1054527] Avg episode reward: [(0, '4031.861')] [2023-03-10 17:46:01,051][1054815] Updated weights for policy 0, policy_version 63360 (0.0004) [2023-03-10 17:46:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 32456704. Throughput: 0: 8786.0. Samples: 32446548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:46:03,349][1054527] Avg episode reward: [(0, '4350.155')] [2023-03-10 17:46:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063392_32456704.pth... [2023-03-10 17:46:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000062880_32194560.pth [2023-03-10 17:46:06,162][1054815] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-10 17:46:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 32497664. Throughput: 0: 8763.7. Samples: 32494688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:46:08,348][1054527] Avg episode reward: [(0, '4209.153')] [2023-03-10 17:46:11,042][1054815] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-10 17:46:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 32538624. Throughput: 0: 8697.2. Samples: 32520392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:46:13,348][1054527] Avg episode reward: [(0, '4054.118')] [2023-03-10 17:46:15,544][1054815] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-10 17:46:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8511.4). Total num frames: 32583680. Throughput: 0: 8765.7. Samples: 32575488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:46:18,348][1054527] Avg episode reward: [(0, '3849.703')] [2023-03-10 17:46:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063648_32587776.pth... [2023-03-10 17:46:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063144_32329728.pth [2023-03-10 17:46:20,127][1054815] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-10 17:46:23,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8806.4, 300 sec: 8525.2). Total num frames: 32632832. Throughput: 0: 8737.6. Samples: 32628720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:46:23,348][1054527] Avg episode reward: [(0, '3783.262')] [2023-03-10 17:46:24,693][1054815] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-10 17:46:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 32673792. Throughput: 0: 8725.3. Samples: 32655976. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:28,348][1054527] Avg episode reward: [(0, '4066.113')] [2023-03-10 17:46:29,204][1054815] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-10 17:46:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 32718848. Throughput: 0: 8773.2. Samples: 32710672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:33,348][1054527] Avg episode reward: [(0, '3841.680')] [2023-03-10 17:46:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063904_32718848.pth... [2023-03-10 17:46:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063392_32456704.pth [2023-03-10 17:46:33,873][1054815] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-10 17:46:38,284][1054815] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-10 17:46:38,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8553.0). Total num frames: 32768000. Throughput: 0: 8743.0. Samples: 32763904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:38,348][1054527] Avg episode reward: [(0, '4045.803')] [2023-03-10 17:46:42,883][1054815] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-10 17:46:43,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8553.0). Total num frames: 32813056. Throughput: 0: 8788.2. Samples: 32792448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:43,348][1054527] Avg episode reward: [(0, '3991.966')] [2023-03-10 17:46:47,462][1054815] Updated weights for policy 0, policy_version 64160 (0.0004) [2023-03-10 17:46:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 32854016. Throughput: 0: 8866.2. Samples: 32845528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:48,348][1054527] Avg episode reward: [(0, '4115.287')] [2023-03-10 17:46:48,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064168_32854016.pth... [2023-03-10 17:46:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063648_32587776.pth [2023-03-10 17:46:52,192][1054815] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-10 17:46:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 32899072. Throughput: 0: 8909.9. Samples: 32895632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:53,348][1054527] Avg episode reward: [(0, '3997.661')] [2023-03-10 17:46:56,972][1054815] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-10 17:46:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 32940032. Throughput: 0: 8920.1. Samples: 32921796. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:46:58,348][1054527] Avg episode reward: [(0, '4335.142')] [2023-03-10 17:47:01,536][1054815] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-10 17:47:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 32985088. Throughput: 0: 8894.5. Samples: 32975740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:47:03,348][1054527] Avg episode reward: [(0, '4112.207')] [2023-03-10 17:47:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064424_32985088.pth... [2023-03-10 17:47:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000063904_32718848.pth [2023-03-10 17:47:06,192][1054815] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-10 17:47:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8594.7). Total num frames: 33030144. Throughput: 0: 8898.7. Samples: 33029164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:08,348][1054527] Avg episode reward: [(0, '4115.822')] [2023-03-10 17:47:10,740][1054815] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-10 17:47:13,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8608.5). Total num frames: 33075200. Throughput: 0: 8870.7. Samples: 33055156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:13,348][1054527] Avg episode reward: [(0, '4178.634')] [2023-03-10 17:47:15,392][1054815] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-10 17:47:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8608.5). Total num frames: 33120256. Throughput: 0: 8867.5. Samples: 33109712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:18,348][1054527] Avg episode reward: [(0, '4034.953')] [2023-03-10 17:47:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064688_33120256.pth... [2023-03-10 17:47:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064168_32854016.pth [2023-03-10 17:47:19,965][1054815] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-10 17:47:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.6, 300 sec: 8622.4). Total num frames: 33165312. Throughput: 0: 8839.3. Samples: 33161672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:23,348][1054527] Avg episode reward: [(0, '4058.783')] [2023-03-10 17:47:24,672][1054815] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-10 17:47:28,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8943.0, 300 sec: 8622.4). Total num frames: 33210368. Throughput: 0: 8816.5. Samples: 33189188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:28,348][1054527] Avg episode reward: [(0, '3924.381')] [2023-03-10 17:47:29,247][1054815] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-10 17:47:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8622.4). Total num frames: 33251328. Throughput: 0: 8785.1. Samples: 33240860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:33,349][1054527] Avg episode reward: [(0, '4164.341')] [2023-03-10 17:47:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064944_33251328.pth... [2023-03-10 17:47:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064424_32985088.pth [2023-03-10 17:47:34,149][1054815] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-10 17:47:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 33296384. Throughput: 0: 8838.7. Samples: 33293376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:38,348][1054527] Avg episode reward: [(0, '4088.790')] [2023-03-10 17:47:38,606][1054815] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-10 17:47:43,210][1054815] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-10 17:47:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 33341440. Throughput: 0: 8869.6. Samples: 33320928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:47:43,348][1054527] Avg episode reward: [(0, '4058.209')] [2023-03-10 17:47:47,836][1054815] Updated weights for policy 0, policy_version 65200 (0.0006) [2023-03-10 17:47:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8636.3). Total num frames: 33386496. Throughput: 0: 8849.8. Samples: 33373980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:47:48,348][1054527] Avg episode reward: [(0, '3909.586')] [2023-03-10 17:47:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065208_33386496.pth... [2023-03-10 17:47:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064688_33120256.pth [2023-03-10 17:47:52,274][1054815] Updated weights for policy 0, policy_version 65280 (0.0006) [2023-03-10 17:47:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 33431552. Throughput: 0: 8865.6. Samples: 33428116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:47:53,348][1054527] Avg episode reward: [(0, '3987.127')] [2023-03-10 17:47:56,914][1054815] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-10 17:47:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 33472512. Throughput: 0: 8885.3. Samples: 33454996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:47:58,348][1054527] Avg episode reward: [(0, '4176.416')] [2023-03-10 17:48:01,842][1054815] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-10 17:48:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8664.1). Total num frames: 33517568. Throughput: 0: 8790.4. Samples: 33505280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:48:03,348][1054527] Avg episode reward: [(0, '4155.263')] [2023-03-10 17:48:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065464_33517568.pth... [2023-03-10 17:48:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000064944_33251328.pth [2023-03-10 17:48:06,518][1054815] Updated weights for policy 0, policy_version 65520 (0.0006) [2023-03-10 17:48:08,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 33562624. Throughput: 0: 8814.4. Samples: 33558320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:48:08,348][1054527] Avg episode reward: [(0, '4332.541')] [2023-03-10 17:48:11,108][1054815] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-10 17:48:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8664.1). Total num frames: 33603584. Throughput: 0: 8809.1. Samples: 33585600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:48:13,348][1054527] Avg episode reward: [(0, '4307.691')] [2023-03-10 17:48:15,794][1054815] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-10 17:48:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 33648640. Throughput: 0: 8788.7. Samples: 33636352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:48:18,348][1054527] Avg episode reward: [(0, '4086.476')] [2023-03-10 17:48:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065720_33648640.pth... [2023-03-10 17:48:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065208_33386496.pth [2023-03-10 17:48:20,246][1054815] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-10 17:48:23,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 33693696. Throughput: 0: 8878.5. Samples: 33692908. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:48:23,348][1054527] Avg episode reward: [(0, '4294.728')] [2023-03-10 17:48:24,753][1054815] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-10 17:48:28,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 33738752. Throughput: 0: 8852.5. Samples: 33719288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:28,348][1054527] Avg episode reward: [(0, '4152.316')] [2023-03-10 17:48:29,457][1054815] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-10 17:48:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8705.7). Total num frames: 33783808. Throughput: 0: 8891.1. Samples: 33774080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:33,348][1054527] Avg episode reward: [(0, '4343.371')] [2023-03-10 17:48:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065984_33783808.pth... [2023-03-10 17:48:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065464_33517568.pth [2023-03-10 17:48:34,015][1054815] Updated weights for policy 0, policy_version 66000 (0.0004) [2023-03-10 17:48:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8719.6). Total num frames: 33828864. Throughput: 0: 8814.5. Samples: 33824768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:38,348][1054527] Avg episode reward: [(0, '4223.128')] [2023-03-10 17:48:38,678][1054815] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-10 17:48:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8719.6). Total num frames: 33869824. Throughput: 0: 8818.8. Samples: 33851840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:43,348][1054527] Avg episode reward: [(0, '3845.839')] [2023-03-10 17:48:43,566][1054815] Updated weights for policy 0, policy_version 66160 (0.0004) [2023-03-10 17:48:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 33910784. Throughput: 0: 8826.5. Samples: 33902472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:48,348][1054527] Avg episode reward: [(0, '4043.982')] [2023-03-10 17:48:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066232_33910784.pth... [2023-03-10 17:48:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065720_33648640.pth [2023-03-10 17:48:48,439][1054815] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-10 17:48:53,257][1054815] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-10 17:48:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8719.6). Total num frames: 33955840. Throughput: 0: 8759.6. Samples: 33952504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:53,348][1054527] Avg episode reward: [(0, '4248.040')] [2023-03-10 17:48:57,639][1054815] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-10 17:48:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8733.5). Total num frames: 34000896. Throughput: 0: 8764.9. Samples: 33980020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:48:58,348][1054527] Avg episode reward: [(0, '4292.365')] [2023-03-10 17:49:02,388][1054815] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-10 17:49:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8719.6). Total num frames: 34041856. Throughput: 0: 8826.0. Samples: 34033520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:03,348][1054527] Avg episode reward: [(0, '3837.111')] [2023-03-10 17:49:03,388][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066496_34045952.pth... [2023-03-10 17:49:03,390][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000065984_33783808.pth [2023-03-10 17:49:07,000][1054815] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-10 17:49:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 34086912. Throughput: 0: 8743.8. Samples: 34086380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:08,348][1054527] Avg episode reward: [(0, '4255.798')] [2023-03-10 17:49:11,892][1054815] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-10 17:49:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.2, 300 sec: 8733.5). Total num frames: 34127872. Throughput: 0: 8711.5. Samples: 34111304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:13,348][1054527] Avg episode reward: [(0, '4201.973')] [2023-03-10 17:49:16,593][1054815] Updated weights for policy 0, policy_version 66720 (0.0006) [2023-03-10 17:49:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.2, 300 sec: 8747.4). Total num frames: 34172928. Throughput: 0: 8642.5. Samples: 34162992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:18,348][1054527] Avg episode reward: [(0, '3949.423')] [2023-03-10 17:49:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066744_34172928.pth... [2023-03-10 17:49:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066232_33910784.pth [2023-03-10 17:49:21,479][1054815] Updated weights for policy 0, policy_version 66800 (0.0004) [2023-03-10 17:49:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8761.3). Total num frames: 34217984. Throughput: 0: 8646.6. Samples: 34213864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:23,348][1054527] Avg episode reward: [(0, '3905.014')] [2023-03-10 17:49:26,099][1054815] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-10 17:49:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 34258944. Throughput: 0: 8630.2. Samples: 34240200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:28,348][1054527] Avg episode reward: [(0, '4202.406')] [2023-03-10 17:49:31,006][1054815] Updated weights for policy 0, policy_version 66960 (0.0004) [2023-03-10 17:49:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8747.4). Total num frames: 34299904. Throughput: 0: 8620.4. Samples: 34290392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:33,348][1054527] Avg episode reward: [(0, '4235.651')] [2023-03-10 17:49:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066992_34299904.pth... [2023-03-10 17:49:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066496_34045952.pth [2023-03-10 17:49:35,809][1054815] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-10 17:49:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8761.3). Total num frames: 34344960. Throughput: 0: 8680.6. Samples: 34343132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:38,348][1054527] Avg episode reward: [(0, '3905.867')] [2023-03-10 17:49:40,206][1054815] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-10 17:49:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8761.3). Total num frames: 34390016. Throughput: 0: 8670.7. Samples: 34370200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:43,348][1054527] Avg episode reward: [(0, '3815.128')] [2023-03-10 17:49:44,831][1054815] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-10 17:49:48,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 34439168. Throughput: 0: 8699.5. Samples: 34424996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:49:48,348][1054527] Avg episode reward: [(0, '3951.342')] [2023-03-10 17:49:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067264_34439168.pth... [2023-03-10 17:49:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066744_34172928.pth [2023-03-10 17:49:49,255][1054815] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-10 17:49:53,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 34484224. Throughput: 0: 8752.2. Samples: 34480232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:49:53,349][1054527] Avg episode reward: [(0, '3738.794')] [2023-03-10 17:49:53,677][1054815] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-10 17:49:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 34525184. Throughput: 0: 8828.6. Samples: 34508592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:49:58,348][1054527] Avg episode reward: [(0, '3852.704')] [2023-03-10 17:49:58,484][1054815] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-10 17:50:03,094][1054815] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-10 17:50:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 34570240. Throughput: 0: 8778.5. Samples: 34558024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:03,348][1054527] Avg episode reward: [(0, '4060.200')] [2023-03-10 17:50:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067520_34570240.pth... [2023-03-10 17:50:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000066992_34299904.pth [2023-03-10 17:50:08,025][1054815] Updated weights for policy 0, policy_version 67600 (0.0004) [2023-03-10 17:50:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 34611200. Throughput: 0: 8804.7. Samples: 34610076. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:08,348][1054527] Avg episode reward: [(0, '3852.099')] [2023-03-10 17:50:12,809][1054815] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-10 17:50:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 34656256. Throughput: 0: 8790.7. Samples: 34635784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:13,348][1054527] Avg episode reward: [(0, '4027.183')] [2023-03-10 17:50:17,296][1054815] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-10 17:50:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 34701312. Throughput: 0: 8858.6. Samples: 34689032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:18,349][1054527] Avg episode reward: [(0, '3700.203')] [2023-03-10 17:50:18,354][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067776_34701312.pth... [2023-03-10 17:50:18,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067264_34439168.pth [2023-03-10 17:50:22,018][1054815] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-10 17:50:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 34746368. Throughput: 0: 8869.6. Samples: 34742264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:23,348][1054527] Avg episode reward: [(0, '4042.558')] [2023-03-10 17:50:26,717][1054815] Updated weights for policy 0, policy_version 67920 (0.0004) [2023-03-10 17:50:28,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 34787328. Throughput: 0: 8836.8. Samples: 34767856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:50:28,348][1054527] Avg episode reward: [(0, '3900.828')] [2023-03-10 17:50:31,255][1054815] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-10 17:50:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 34832384. Throughput: 0: 8781.6. Samples: 34820168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:33,348][1054527] Avg episode reward: [(0, '3779.088')] [2023-03-10 17:50:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068032_34832384.pth... [2023-03-10 17:50:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067520_34570240.pth [2023-03-10 17:50:36,011][1054815] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-10 17:50:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 34873344. Throughput: 0: 8728.8. Samples: 34873028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:38,348][1054527] Avg episode reward: [(0, '3449.660')] [2023-03-10 17:50:40,664][1054815] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-10 17:50:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 34918400. Throughput: 0: 8682.8. Samples: 34899316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:43,348][1054527] Avg episode reward: [(0, '2331.441')] [2023-03-10 17:50:45,418][1054815] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-10 17:50:48,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 34963456. Throughput: 0: 8736.8. Samples: 34951180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:48,348][1054527] Avg episode reward: [(0, '2605.474')] [2023-03-10 17:50:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068288_34963456.pth... [2023-03-10 17:50:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000067776_34701312.pth [2023-03-10 17:50:49,976][1054815] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-10 17:50:53,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 35012608. Throughput: 0: 8862.5. Samples: 35008888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:53,348][1054527] Avg episode reward: [(0, '3366.036')] [2023-03-10 17:50:54,204][1054815] Updated weights for policy 0, policy_version 68400 (0.0004) [2023-03-10 17:50:58,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 35057664. Throughput: 0: 8902.7. Samples: 35036404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:50:58,348][1054527] Avg episode reward: [(0, '2892.352')] [2023-03-10 17:50:58,464][1054815] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-10 17:51:02,848][1054815] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-10 17:51:03,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8844.6). Total num frames: 35106816. Throughput: 0: 9003.0. Samples: 35094168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:03,348][1054527] Avg episode reward: [(0, '2742.837')] [2023-03-10 17:51:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068568_35106816.pth... [2023-03-10 17:51:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068032_34832384.pth [2023-03-10 17:51:07,361][1054815] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-10 17:51:08,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 35151872. Throughput: 0: 9011.4. Samples: 35147776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:08,349][1054527] Avg episode reward: [(0, '3216.065')] [2023-03-10 17:51:11,994][1054815] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-10 17:51:13,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8943.0, 300 sec: 8844.6). Total num frames: 35192832. Throughput: 0: 9047.0. Samples: 35174972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:13,348][1054527] Avg episode reward: [(0, '2685.794')] [2023-03-10 17:51:16,594][1054815] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-10 17:51:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8844.6). Total num frames: 35241984. Throughput: 0: 9061.0. Samples: 35227912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:18,349][1054527] Avg episode reward: [(0, '2191.984')] [2023-03-10 17:51:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068832_35241984.pth... [2023-03-10 17:51:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068288_34963456.pth [2023-03-10 17:51:21,069][1054815] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-10 17:51:23,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 35287040. Throughput: 0: 9137.3. Samples: 35284208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:23,348][1054527] Avg episode reward: [(0, '3258.633')] [2023-03-10 17:51:25,441][1054815] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-10 17:51:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8858.5). Total num frames: 35332096. Throughput: 0: 9158.1. Samples: 35311432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:28,349][1054527] Avg episode reward: [(0, '3456.121')] [2023-03-10 17:51:30,063][1054815] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-10 17:51:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8844.6). Total num frames: 35377152. Throughput: 0: 9193.1. Samples: 35364872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:33,349][1054527] Avg episode reward: [(0, '3077.733')] [2023-03-10 17:51:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069096_35377152.pth... [2023-03-10 17:51:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068568_35106816.pth [2023-03-10 17:51:34,725][1054815] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-10 17:51:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8844.6). Total num frames: 35422208. Throughput: 0: 9122.6. Samples: 35419404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:38,349][1054527] Avg episode reward: [(0, '3178.784')] [2023-03-10 17:51:39,186][1054815] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-10 17:51:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 8844.6). Total num frames: 35463168. Throughput: 0: 9101.1. Samples: 35445956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:43,348][1054527] Avg episode reward: [(0, '3728.468')] [2023-03-10 17:51:43,960][1054815] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-10 17:51:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 9011.2, 300 sec: 8830.7). Total num frames: 35504128. Throughput: 0: 8929.6. Samples: 35496000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:48,348][1054527] Avg episode reward: [(0, '3986.941')] [2023-03-10 17:51:48,364][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069352_35508224.pth... [2023-03-10 17:51:48,365][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000068832_35241984.pth [2023-03-10 17:51:48,858][1054815] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-10 17:51:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8943.0, 300 sec: 8844.6). Total num frames: 35549184. Throughput: 0: 8911.5. Samples: 35548792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:51:53,348][1054527] Avg episode reward: [(0, '3471.770')] [2023-03-10 17:51:53,460][1054815] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-10 17:51:58,077][1054815] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-10 17:51:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8844.6). Total num frames: 35594240. Throughput: 0: 8873.3. Samples: 35574272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:51:58,348][1054527] Avg episode reward: [(0, '3402.329')] [2023-03-10 17:52:02,804][1054815] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-10 17:52:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 35639296. Throughput: 0: 8867.3. Samples: 35626940. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:03,348][1054527] Avg episode reward: [(0, '3534.078')] [2023-03-10 17:52:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069608_35639296.pth... [2023-03-10 17:52:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069096_35377152.pth [2023-03-10 17:52:07,314][1054815] Updated weights for policy 0, policy_version 69680 (0.0004) [2023-03-10 17:52:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 35684352. Throughput: 0: 8807.1. Samples: 35680528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:08,348][1054527] Avg episode reward: [(0, '3697.174')] [2023-03-10 17:52:11,760][1054815] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-10 17:52:13,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 35733504. Throughput: 0: 8837.1. Samples: 35709100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:13,348][1054527] Avg episode reward: [(0, '3841.218')] [2023-03-10 17:52:15,930][1054815] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-10 17:52:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 35774464. Throughput: 0: 8917.4. Samples: 35766156. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:18,348][1054527] Avg episode reward: [(0, '3450.728')] [2023-03-10 17:52:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069872_35774464.pth... [2023-03-10 17:52:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069352_35508224.pth [2023-03-10 17:52:20,859][1054815] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-10 17:52:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 35819520. Throughput: 0: 8835.3. Samples: 35816992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:23,348][1054527] Avg episode reward: [(0, '3761.431')] [2023-03-10 17:52:25,483][1054815] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-10 17:52:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 35864576. Throughput: 0: 8831.5. Samples: 35843376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:28,348][1054527] Avg episode reward: [(0, '4250.935')] [2023-03-10 17:52:30,114][1054815] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-10 17:52:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 35909632. Throughput: 0: 8917.0. Samples: 35897264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:52:33,348][1054527] Avg episode reward: [(0, '4218.771')] [2023-03-10 17:52:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070136_35909632.pth... [2023-03-10 17:52:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069608_35639296.pth [2023-03-10 17:52:34,592][1054815] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-10 17:52:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8844.6). Total num frames: 35950592. Throughput: 0: 8891.3. Samples: 35948900. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:52:38,348][1054527] Avg episode reward: [(0, '3997.363')] [2023-03-10 17:52:39,451][1054815] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-10 17:52:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 35995648. Throughput: 0: 8909.2. Samples: 35975184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:52:43,348][1054527] Avg episode reward: [(0, '4033.663')] [2023-03-10 17:52:44,164][1054815] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-10 17:52:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 36036608. Throughput: 0: 8874.8. Samples: 36026304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:52:48,348][1054527] Avg episode reward: [(0, '4059.009')] [2023-03-10 17:52:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070384_36036608.pth... [2023-03-10 17:52:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000069872_35774464.pth [2023-03-10 17:52:48,977][1054815] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-10 17:52:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.6, 300 sec: 8844.6). Total num frames: 36081664. Throughput: 0: 8827.2. Samples: 36077752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:52:53,348][1054527] Avg episode reward: [(0, '4158.571')] [2023-03-10 17:52:53,723][1054815] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-10 17:52:58,298][1054815] Updated weights for policy 0, policy_version 70560 (0.0006) [2023-03-10 17:52:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 36126720. Throughput: 0: 8817.4. Samples: 36105884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:52:58,348][1054527] Avg episode reward: [(0, '3942.498')] [2023-03-10 17:53:02,734][1054815] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-10 17:53:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 36171776. Throughput: 0: 8740.6. Samples: 36159484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:53:03,348][1054527] Avg episode reward: [(0, '4241.814')] [2023-03-10 17:53:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070648_36171776.pth... [2023-03-10 17:53:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070136_35909632.pth [2023-03-10 17:53:07,275][1054815] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-10 17:53:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 36216832. Throughput: 0: 8798.1. Samples: 36212904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:53:08,348][1054527] Avg episode reward: [(0, '4202.817')] [2023-03-10 17:53:11,953][1054815] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-10 17:53:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 36261888. Throughput: 0: 8807.0. Samples: 36239692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:53:13,348][1054527] Avg episode reward: [(0, '4323.389')] [2023-03-10 17:53:16,381][1054815] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-10 17:53:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8844.6). Total num frames: 36302848. Throughput: 0: 8830.9. Samples: 36294656. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:53:18,348][1054527] Avg episode reward: [(0, '4194.308')] [2023-03-10 17:53:18,373][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070912_36306944.pth... [2023-03-10 17:53:18,375][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070384_36036608.pth [2023-03-10 17:53:21,039][1054815] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-10 17:53:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8844.6). Total num frames: 36347904. Throughput: 0: 8863.7. Samples: 36347768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:23,348][1054527] Avg episode reward: [(0, '4387.280')] [2023-03-10 17:53:25,727][1054815] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-10 17:53:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8844.6). Total num frames: 36392960. Throughput: 0: 8841.9. Samples: 36373068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:28,348][1054527] Avg episode reward: [(0, '4351.649')] [2023-03-10 17:53:30,323][1054815] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-10 17:53:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8844.6). Total num frames: 36438016. Throughput: 0: 8892.3. Samples: 36426456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:33,348][1054527] Avg episode reward: [(0, '4246.728')] [2023-03-10 17:53:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071168_36438016.pth... [2023-03-10 17:53:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070648_36171776.pth [2023-03-10 17:53:35,044][1054815] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-10 17:53:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 36483072. Throughput: 0: 8916.3. Samples: 36478984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:38,348][1054527] Avg episode reward: [(0, '4256.207')] [2023-03-10 17:53:39,784][1054815] Updated weights for policy 0, policy_version 71280 (0.0004) [2023-03-10 17:53:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 36524032. Throughput: 0: 8869.2. Samples: 36504996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:43,348][1054527] Avg episode reward: [(0, '4303.094')] [2023-03-10 17:53:44,469][1054815] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-10 17:53:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.6, 300 sec: 8858.5). Total num frames: 36569088. Throughput: 0: 8829.2. Samples: 36556800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:48,349][1054527] Avg episode reward: [(0, '4365.099')] [2023-03-10 17:53:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071424_36569088.pth... [2023-03-10 17:53:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000070912_36306944.pth [2023-03-10 17:53:49,151][1054815] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-10 17:53:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 36614144. Throughput: 0: 8840.9. Samples: 36610744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:53,348][1054527] Avg episode reward: [(0, '4038.597')] [2023-03-10 17:53:53,502][1054815] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-10 17:53:58,019][1054815] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-10 17:53:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.6, 300 sec: 8872.4). Total num frames: 36659200. Throughput: 0: 8881.6. Samples: 36639364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:53:58,349][1054527] Avg episode reward: [(0, '4066.005')] [2023-03-10 17:54:02,652][1054815] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-10 17:54:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8872.3). Total num frames: 36704256. Throughput: 0: 8838.4. Samples: 36692384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:54:03,348][1054527] Avg episode reward: [(0, '4193.669')] [2023-03-10 17:54:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071688_36704256.pth... [2023-03-10 17:54:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071168_36438016.pth [2023-03-10 17:54:07,485][1054815] Updated weights for policy 0, policy_version 71760 (0.0004) [2023-03-10 17:54:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8872.3). Total num frames: 36745216. Throughput: 0: 8823.2. Samples: 36744812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:08,348][1054527] Avg episode reward: [(0, '3911.875')] [2023-03-10 17:54:12,163][1054815] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-10 17:54:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8872.3). Total num frames: 36790272. Throughput: 0: 8815.7. Samples: 36769776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:13,348][1054527] Avg episode reward: [(0, '3965.213')] [2023-03-10 17:54:16,972][1054815] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-10 17:54:18,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8872.4). Total num frames: 36835328. Throughput: 0: 8802.7. Samples: 36822576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:18,348][1054527] Avg episode reward: [(0, '4141.113')] [2023-03-10 17:54:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071944_36835328.pth... [2023-03-10 17:54:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071424_36569088.pth [2023-03-10 17:54:21,529][1054815] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-10 17:54:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 36876288. Throughput: 0: 8804.9. Samples: 36875204. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:23,348][1054527] Avg episode reward: [(0, '4343.691')] [2023-03-10 17:54:26,309][1054815] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-10 17:54:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8886.2). Total num frames: 36921344. Throughput: 0: 8797.5. Samples: 36900884. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:28,348][1054527] Avg episode reward: [(0, '4183.421')] [2023-03-10 17:54:30,932][1054815] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-10 17:54:33,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 36962304. Throughput: 0: 8828.4. Samples: 36954076. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:33,348][1054527] Avg episode reward: [(0, '3726.282')] [2023-03-10 17:54:33,369][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072200_36966400.pth... [2023-03-10 17:54:33,371][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071688_36704256.pth [2023-03-10 17:54:35,685][1054815] Updated weights for policy 0, policy_version 72240 (0.0004) [2023-03-10 17:54:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 37007360. Throughput: 0: 8806.7. Samples: 37007044. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:38,348][1054527] Avg episode reward: [(0, '4000.771')] [2023-03-10 17:54:40,205][1054815] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-10 17:54:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 37052416. Throughput: 0: 8748.2. Samples: 37033032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:43,348][1054527] Avg episode reward: [(0, '4075.831')] [2023-03-10 17:54:44,939][1054815] Updated weights for policy 0, policy_version 72400 (0.0006) [2023-03-10 17:54:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 37097472. Throughput: 0: 8730.5. Samples: 37085256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 17:54:48,348][1054527] Avg episode reward: [(0, '3858.143')] [2023-03-10 17:54:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072456_37097472.pth... [2023-03-10 17:54:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000071944_36835328.pth [2023-03-10 17:54:49,715][1054815] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-10 17:54:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 37142528. Throughput: 0: 8747.3. Samples: 37138440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:54:53,348][1054527] Avg episode reward: [(0, '3961.298')] [2023-03-10 17:54:54,207][1054815] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-10 17:54:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.2, 300 sec: 8858.5). Total num frames: 37183488. Throughput: 0: 8766.2. Samples: 37164256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:54:58,348][1054527] Avg episode reward: [(0, '4132.853')] [2023-03-10 17:54:58,944][1054815] Updated weights for policy 0, policy_version 72640 (0.0006) [2023-03-10 17:55:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 37228544. Throughput: 0: 8758.0. Samples: 37216688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:03,349][1054527] Avg episode reward: [(0, '4267.687')] [2023-03-10 17:55:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072712_37228544.pth... [2023-03-10 17:55:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072200_36966400.pth [2023-03-10 17:55:03,824][1054815] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-10 17:55:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 37269504. Throughput: 0: 8716.7. Samples: 37267456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:08,348][1054527] Avg episode reward: [(0, '2975.271')] [2023-03-10 17:55:08,520][1054815] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-10 17:55:13,126][1054815] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-10 17:55:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 37314560. Throughput: 0: 8739.1. Samples: 37294144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:13,348][1054527] Avg episode reward: [(0, '2169.959')] [2023-03-10 17:55:17,773][1054815] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-10 17:55:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 37359616. Throughput: 0: 8738.9. Samples: 37347328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:18,348][1054527] Avg episode reward: [(0, '4151.702')] [2023-03-10 17:55:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072968_37359616.pth... [2023-03-10 17:55:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072456_37097472.pth [2023-03-10 17:55:22,423][1054815] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-10 17:55:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 37404672. Throughput: 0: 8743.8. Samples: 37400516. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:23,348][1054527] Avg episode reward: [(0, '4324.959')] [2023-03-10 17:55:27,255][1054815] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-10 17:55:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 37445632. Throughput: 0: 8722.8. Samples: 37425560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:28,348][1054527] Avg episode reward: [(0, '4052.936')] [2023-03-10 17:55:31,841][1054815] Updated weights for policy 0, policy_version 73200 (0.0004) [2023-03-10 17:55:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 37490688. Throughput: 0: 8736.7. Samples: 37478408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 17:55:33,348][1054527] Avg episode reward: [(0, '3807.086')] [2023-03-10 17:55:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073224_37490688.pth... [2023-03-10 17:55:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072712_37228544.pth [2023-03-10 17:55:36,189][1054815] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-10 17:55:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8872.3). Total num frames: 37535744. Throughput: 0: 8745.7. Samples: 37531996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:55:38,348][1054527] Avg episode reward: [(0, '3912.257')] [2023-03-10 17:55:41,003][1054815] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-10 17:55:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8872.3). Total num frames: 37580800. Throughput: 0: 8783.9. Samples: 37559532. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:55:43,348][1054527] Avg episode reward: [(0, '3889.420')] [2023-03-10 17:55:45,542][1054815] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-10 17:55:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 37621760. Throughput: 0: 8819.5. Samples: 37613564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:55:48,348][1054527] Avg episode reward: [(0, '3537.534')] [2023-03-10 17:55:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073488_37625856.pth... [2023-03-10 17:55:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000072968_37359616.pth [2023-03-10 17:55:50,298][1054815] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-10 17:55:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 37666816. Throughput: 0: 8806.0. Samples: 37663724. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:55:53,348][1054527] Avg episode reward: [(0, '3848.711')] [2023-03-10 17:55:54,913][1054815] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-10 17:55:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8816.8). Total num frames: 37707776. Throughput: 0: 8826.8. Samples: 37691348. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:55:58,348][1054527] Avg episode reward: [(0, '4033.495')] [2023-03-10 17:55:59,948][1054815] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-10 17:56:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8816.8). Total num frames: 37752832. Throughput: 0: 8739.6. Samples: 37740608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:56:03,348][1054527] Avg episode reward: [(0, '4271.382')] [2023-03-10 17:56:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073736_37752832.pth... [2023-03-10 17:56:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073224_37490688.pth [2023-03-10 17:56:04,571][1054815] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-10 17:56:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8830.7). Total num frames: 37797888. Throughput: 0: 8740.9. Samples: 37793856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:56:08,348][1054527] Avg episode reward: [(0, '4418.417')] [2023-03-10 17:56:09,125][1054815] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-10 17:56:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8816.8). Total num frames: 37842944. Throughput: 0: 8808.0. Samples: 37821920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:56:13,348][1054527] Avg episode reward: [(0, '4170.291')] [2023-03-10 17:56:13,688][1054815] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-10 17:56:18,267][1054815] Updated weights for policy 0, policy_version 74000 (0.0006) [2023-03-10 17:56:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8816.8). Total num frames: 37888000. Throughput: 0: 8797.0. Samples: 37874272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 17:56:18,348][1054527] Avg episode reward: [(0, '4360.501')] [2023-03-10 17:56:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074000_37888000.pth... [2023-03-10 17:56:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073488_37625856.pth [2023-03-10 17:56:22,947][1054815] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-10 17:56:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8802.9). Total num frames: 37928960. Throughput: 0: 8816.2. Samples: 37928724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:23,348][1054527] Avg episode reward: [(0, '4029.149')] [2023-03-10 17:56:27,650][1054815] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-10 17:56:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 37974016. Throughput: 0: 8763.8. Samples: 37953904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:28,348][1054527] Avg episode reward: [(0, '3679.445')] [2023-03-10 17:56:32,369][1054815] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-10 17:56:33,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 38014976. Throughput: 0: 8738.0. Samples: 38006772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:33,348][1054527] Avg episode reward: [(0, '3946.322')] [2023-03-10 17:56:33,367][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074256_38019072.pth... [2023-03-10 17:56:33,369][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000073736_37752832.pth [2023-03-10 17:56:37,021][1054815] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-10 17:56:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.2, 300 sec: 8802.9). Total num frames: 38060032. Throughput: 0: 8794.2. Samples: 38059460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:38,348][1054527] Avg episode reward: [(0, '4225.037')] [2023-03-10 17:56:41,783][1054815] Updated weights for policy 0, policy_version 74400 (0.0006) [2023-03-10 17:56:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8816.8). Total num frames: 38105088. Throughput: 0: 8739.3. Samples: 38084616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:43,349][1054527] Avg episode reward: [(0, '4411.506')] [2023-03-10 17:56:46,418][1054815] Updated weights for policy 0, policy_version 74480 (0.0004) [2023-03-10 17:56:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8802.9). Total num frames: 38146048. Throughput: 0: 8825.8. Samples: 38137768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:48,348][1054527] Avg episode reward: [(0, '4166.833')] [2023-03-10 17:56:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074504_38146048.pth... [2023-03-10 17:56:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074000_37888000.pth [2023-03-10 17:56:51,356][1054815] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-10 17:56:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8802.9). Total num frames: 38191104. Throughput: 0: 8747.4. Samples: 38187488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:53,348][1054527] Avg episode reward: [(0, '4195.084')] [2023-03-10 17:56:55,967][1054815] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-10 17:56:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 38236160. Throughput: 0: 8714.3. Samples: 38214064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:56:58,348][1054527] Avg episode reward: [(0, '4376.960')] [2023-03-10 17:57:00,708][1054815] Updated weights for policy 0, policy_version 74720 (0.0004) [2023-03-10 17:57:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 38277120. Throughput: 0: 8694.8. Samples: 38265540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:57:03,349][1054527] Avg episode reward: [(0, '4322.389')] [2023-03-10 17:57:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074760_38277120.pth... [2023-03-10 17:57:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074256_38019072.pth [2023-03-10 17:57:05,455][1054815] Updated weights for policy 0, policy_version 74800 (0.0006) [2023-03-10 17:57:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8761.3). Total num frames: 38318080. Throughput: 0: 8650.8. Samples: 38318008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:08,348][1054527] Avg episode reward: [(0, '4281.337')] [2023-03-10 17:57:10,171][1054815] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-10 17:57:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 38367232. Throughput: 0: 8682.2. Samples: 38344604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:13,348][1054527] Avg episode reward: [(0, '4389.788')] [2023-03-10 17:57:14,570][1054815] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-10 17:57:18,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 38412288. Throughput: 0: 8740.0. Samples: 38400072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:18,348][1054527] Avg episode reward: [(0, '4500.491')] [2023-03-10 17:57:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075024_38412288.pth... [2023-03-10 17:57:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074504_38146048.pth [2023-03-10 17:57:19,217][1054815] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-10 17:57:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 38457344. Throughput: 0: 8752.4. Samples: 38453320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:23,348][1054527] Avg episode reward: [(0, '4477.938')] [2023-03-10 17:57:23,570][1054815] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-10 17:57:27,752][1054815] Updated weights for policy 0, policy_version 75200 (0.0005) [2023-03-10 17:57:28,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 38506496. Throughput: 0: 8885.8. Samples: 38484476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:28,348][1054527] Avg episode reward: [(0, '3994.018')] [2023-03-10 17:57:29,992][1054771] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000008 [2023-03-10 17:57:32,338][1054815] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-10 17:57:33,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 38551552. Throughput: 0: 8922.1. Samples: 38539264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:33,349][1054527] Avg episode reward: [(0, '4054.228')] [2023-03-10 17:57:33,354][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075296_38551552.pth... [2023-03-10 17:57:33,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000074760_38277120.pth [2023-03-10 17:57:37,108][1054815] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-10 17:57:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 38592512. Throughput: 0: 8942.6. Samples: 38589904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:38,348][1054527] Avg episode reward: [(0, '3710.559')] [2023-03-10 17:57:41,848][1054815] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-10 17:57:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 38637568. Throughput: 0: 8954.0. Samples: 38616992. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:43,348][1054527] Avg episode reward: [(0, '3922.690')] [2023-03-10 17:57:46,294][1054815] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-10 17:57:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 38682624. Throughput: 0: 8996.9. Samples: 38670400. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 17:57:48,348][1054527] Avg episode reward: [(0, '3974.021')] [2023-03-10 17:57:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075552_38682624.pth... [2023-03-10 17:57:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075024_38412288.pth [2023-03-10 17:57:50,992][1054815] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-10 17:57:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 38723584. Throughput: 0: 8977.9. Samples: 38722012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:57:53,348][1054527] Avg episode reward: [(0, '4143.667')] [2023-03-10 17:57:56,019][1054815] Updated weights for policy 0, policy_version 75680 (0.0005) [2023-03-10 17:57:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 38768640. Throughput: 0: 8944.0. Samples: 38747084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:57:58,348][1054527] Avg episode reward: [(0, '4265.097')] [2023-03-10 17:58:00,713][1054815] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-10 17:58:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 38809600. Throughput: 0: 8879.6. Samples: 38799652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:03,348][1054527] Avg episode reward: [(0, '3929.958')] [2023-03-10 17:58:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075800_38809600.pth... [2023-03-10 17:58:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075296_38551552.pth [2023-03-10 17:58:05,392][1054815] Updated weights for policy 0, policy_version 75840 (0.0005) [2023-03-10 17:58:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 38854656. Throughput: 0: 8859.6. Samples: 38852000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:08,348][1054527] Avg episode reward: [(0, '4069.013')] [2023-03-10 17:58:10,016][1054815] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-10 17:58:13,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 38899712. Throughput: 0: 8756.0. Samples: 38878496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:13,348][1054527] Avg episode reward: [(0, '4428.232')] [2023-03-10 17:58:14,729][1054815] Updated weights for policy 0, policy_version 76000 (0.0004) [2023-03-10 17:58:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 38940672. Throughput: 0: 8696.6. Samples: 38930608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:18,348][1054527] Avg episode reward: [(0, '4570.256')] [2023-03-10 17:58:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076056_38940672.pth... [2023-03-10 17:58:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075552_38682624.pth [2023-03-10 17:58:19,451][1054815] Updated weights for policy 0, policy_version 76080 (0.0004) [2023-03-10 17:58:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 38985728. Throughput: 0: 8734.3. Samples: 38982948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:23,348][1054527] Avg episode reward: [(0, '4410.952')] [2023-03-10 17:58:24,167][1054815] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-10 17:58:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 39030784. Throughput: 0: 8721.4. Samples: 39009456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:28,348][1054527] Avg episode reward: [(0, '4298.311')] [2023-03-10 17:58:28,800][1054815] Updated weights for policy 0, policy_version 76240 (0.0004) [2023-03-10 17:58:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8775.2). Total num frames: 39071744. Throughput: 0: 8693.9. Samples: 39061624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:58:33,348][1054527] Avg episode reward: [(0, '4519.195')] [2023-03-10 17:58:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076312_39071744.pth... [2023-03-10 17:58:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000075800_38809600.pth [2023-03-10 17:58:33,576][1054815] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-10 17:58:38,086][1054815] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-10 17:58:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 39116800. Throughput: 0: 8724.3. Samples: 39114604. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:58:38,348][1054527] Avg episode reward: [(0, '4199.537')] [2023-03-10 17:58:42,877][1054815] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-10 17:58:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8775.2). Total num frames: 39157760. Throughput: 0: 8762.1. Samples: 39141376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:58:43,348][1054527] Avg episode reward: [(0, '3856.146')] [2023-03-10 17:58:47,544][1054815] Updated weights for policy 0, policy_version 76560 (0.0004) [2023-03-10 17:58:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8669.8, 300 sec: 8775.2). Total num frames: 39202816. Throughput: 0: 8737.5. Samples: 39192844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:58:48,349][1054527] Avg episode reward: [(0, '4117.942')] [2023-03-10 17:58:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076568_39202816.pth... [2023-03-10 17:58:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076056_38940672.pth [2023-03-10 17:58:52,387][1054815] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-10 17:58:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8761.3). Total num frames: 39243776. Throughput: 0: 8705.6. Samples: 39243752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:58:53,348][1054527] Avg episode reward: [(0, '4413.482')] [2023-03-10 17:58:56,949][1054815] Updated weights for policy 0, policy_version 76720 (0.0004) [2023-03-10 17:58:58,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8738.1, 300 sec: 8775.2). Total num frames: 39292928. Throughput: 0: 8711.8. Samples: 39270528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:58:58,348][1054527] Avg episode reward: [(0, '4548.043')] [2023-03-10 17:59:01,343][1054815] Updated weights for policy 0, policy_version 76800 (0.0006) [2023-03-10 17:59:03,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 39337984. Throughput: 0: 8799.7. Samples: 39326596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:59:03,348][1054527] Avg episode reward: [(0, '3984.753')] [2023-03-10 17:59:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076832_39337984.pth... [2023-03-10 17:59:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076312_39071744.pth [2023-03-10 17:59:05,811][1054815] Updated weights for policy 0, policy_version 76880 (0.0006) [2023-03-10 17:59:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 39383040. Throughput: 0: 8810.6. Samples: 39379424. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:59:08,348][1054527] Avg episode reward: [(0, '4318.542')] [2023-03-10 17:59:10,545][1054815] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-10 17:59:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 39428096. Throughput: 0: 8828.4. Samples: 39406732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:59:13,348][1054527] Avg episode reward: [(0, '4426.282')] [2023-03-10 17:59:14,924][1054815] Updated weights for policy 0, policy_version 77040 (0.0006) [2023-03-10 17:59:18,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 39473152. Throughput: 0: 8879.3. Samples: 39461192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:59:18,348][1054527] Avg episode reward: [(0, '3667.288')] [2023-03-10 17:59:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077096_39473152.pth... [2023-03-10 17:59:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076568_39202816.pth [2023-03-10 17:59:19,495][1054815] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-10 17:59:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 39518208. Throughput: 0: 8899.4. Samples: 39515080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 17:59:23,348][1054527] Avg episode reward: [(0, '3766.776')] [2023-03-10 17:59:24,138][1054815] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-10 17:59:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 39563264. Throughput: 0: 8898.5. Samples: 39541808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:28,348][1054527] Avg episode reward: [(0, '4442.070')] [2023-03-10 17:59:28,820][1054815] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-10 17:59:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 39604224. Throughput: 0: 8888.1. Samples: 39592808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:33,348][1054527] Avg episode reward: [(0, '4273.184')] [2023-03-10 17:59:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077352_39604224.pth... [2023-03-10 17:59:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000076832_39337984.pth [2023-03-10 17:59:33,552][1054815] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-10 17:59:37,976][1054815] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-10 17:59:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 39649280. Throughput: 0: 8970.0. Samples: 39647400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:38,348][1054527] Avg episode reward: [(0, '4334.185')] [2023-03-10 17:59:42,549][1054815] Updated weights for policy 0, policy_version 77520 (0.0004) [2023-03-10 17:59:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8802.9). Total num frames: 39694336. Throughput: 0: 8998.3. Samples: 39675452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:43,348][1054527] Avg episode reward: [(0, '4384.034')] [2023-03-10 17:59:46,898][1054815] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-10 17:59:48,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 8816.8). Total num frames: 39743488. Throughput: 0: 8987.8. Samples: 39731048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:48,348][1054527] Avg episode reward: [(0, '4450.702')] [2023-03-10 17:59:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077624_39743488.pth... [2023-03-10 17:59:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077096_39473152.pth [2023-03-10 17:59:51,697][1054815] Updated weights for policy 0, policy_version 77680 (0.0004) [2023-03-10 17:59:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 8816.8). Total num frames: 39784448. Throughput: 0: 8968.9. Samples: 39783024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:53,348][1054527] Avg episode reward: [(0, '4522.306')] [2023-03-10 17:59:56,222][1054815] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-10 17:59:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 39829504. Throughput: 0: 8943.3. Samples: 39809180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 17:59:58,348][1054527] Avg episode reward: [(0, '4457.411')] [2023-03-10 18:00:00,761][1054815] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-10 18:00:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 39874560. Throughput: 0: 8917.4. Samples: 39862476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:03,348][1054527] Avg episode reward: [(0, '4468.601')] [2023-03-10 18:00:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077880_39874560.pth... [2023-03-10 18:00:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077352_39604224.pth [2023-03-10 18:00:05,265][1054815] Updated weights for policy 0, policy_version 77920 (0.0004) [2023-03-10 18:00:08,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8844.6). Total num frames: 39923712. Throughput: 0: 8989.7. Samples: 39919616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:08,348][1054527] Avg episode reward: [(0, '4274.709')] [2023-03-10 18:00:09,696][1054815] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-10 18:00:13,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8844.6). Total num frames: 39968768. Throughput: 0: 9001.9. Samples: 39946892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:13,348][1054527] Avg episode reward: [(0, '4300.356')] [2023-03-10 18:00:14,136][1054815] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-10 18:00:15,883][1054771] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000004 [2023-03-10 18:00:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8844.6). Total num frames: 40013824. Throughput: 0: 9083.0. Samples: 40001544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:18,348][1054527] Avg episode reward: [(0, '4395.583')] [2023-03-10 18:00:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078152_40013824.pth... [2023-03-10 18:00:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077624_39743488.pth [2023-03-10 18:00:18,678][1054815] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-10 18:00:23,068][1054815] Updated weights for policy 0, policy_version 78240 (0.0005) [2023-03-10 18:00:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 40058880. Throughput: 0: 9109.4. Samples: 40057324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:23,348][1054527] Avg episode reward: [(0, '4388.519')] [2023-03-10 18:00:27,590][1054815] Updated weights for policy 0, policy_version 78320 (0.0005) [2023-03-10 18:00:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 40103936. Throughput: 0: 9092.4. Samples: 40084612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:28,348][1054527] Avg episode reward: [(0, '4471.500')] [2023-03-10 18:00:32,122][1054815] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-10 18:00:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8858.5). Total num frames: 40148992. Throughput: 0: 9033.6. Samples: 40137560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:33,348][1054527] Avg episode reward: [(0, '4577.717')] [2023-03-10 18:00:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078416_40148992.pth... [2023-03-10 18:00:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000077880_39874560.pth [2023-03-10 18:00:37,102][1054815] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-10 18:00:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8844.6). Total num frames: 40189952. Throughput: 0: 9011.9. Samples: 40188560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:38,348][1054527] Avg episode reward: [(0, '4356.084')] [2023-03-10 18:00:41,702][1054815] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-10 18:00:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 8858.5). Total num frames: 40235008. Throughput: 0: 9011.2. Samples: 40214684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:43,348][1054527] Avg episode reward: [(0, '4409.080')] [2023-03-10 18:00:46,076][1054815] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-10 18:00:48,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8872.4). Total num frames: 40284160. Throughput: 0: 9083.4. Samples: 40271228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:48,348][1054527] Avg episode reward: [(0, '4314.554')] [2023-03-10 18:00:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078680_40284160.pth... [2023-03-10 18:00:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078152_40013824.pth [2023-03-10 18:00:50,476][1054815] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-10 18:00:53,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 8886.2). Total num frames: 40329216. Throughput: 0: 9013.2. Samples: 40325212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:53,348][1054527] Avg episode reward: [(0, '3951.877')] [2023-03-10 18:00:55,347][1054815] Updated weights for policy 0, policy_version 78800 (0.0004) [2023-03-10 18:00:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8872.4). Total num frames: 40370176. Throughput: 0: 8952.6. Samples: 40349760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:00:58,348][1054527] Avg episode reward: [(0, '4498.823')] [2023-03-10 18:00:59,749][1054815] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-10 18:01:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8872.4). Total num frames: 40415232. Throughput: 0: 8942.1. Samples: 40403940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:03,348][1054527] Avg episode reward: [(0, '4407.754')] [2023-03-10 18:01:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078936_40415232.pth... [2023-03-10 18:01:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078416_40148992.pth [2023-03-10 18:01:04,213][1054815] Updated weights for policy 0, policy_version 78960 (0.0004) [2023-03-10 18:01:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8872.4). Total num frames: 40460288. Throughput: 0: 8949.8. Samples: 40460064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:08,348][1054527] Avg episode reward: [(0, '4446.983')] [2023-03-10 18:01:08,842][1054815] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-10 18:01:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8872.4). Total num frames: 40505344. Throughput: 0: 8905.2. Samples: 40485344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:13,348][1054527] Avg episode reward: [(0, '4218.820')] [2023-03-10 18:01:13,534][1054815] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-10 18:01:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8872.4). Total num frames: 40546304. Throughput: 0: 8900.7. Samples: 40538092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:18,348][1054527] Avg episode reward: [(0, '3074.576')] [2023-03-10 18:01:18,358][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079200_40550400.pth... [2023-03-10 18:01:18,359][1054815] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-10 18:01:18,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078680_40284160.pth [2023-03-10 18:01:22,864][1054815] Updated weights for policy 0, policy_version 79280 (0.0004) [2023-03-10 18:01:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8886.2). Total num frames: 40595456. Throughput: 0: 8950.8. Samples: 40591348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:23,348][1054527] Avg episode reward: [(0, '3321.439')] [2023-03-10 18:01:27,441][1054815] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-10 18:01:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8886.2). Total num frames: 40636416. Throughput: 0: 8955.3. Samples: 40617672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:28,348][1054527] Avg episode reward: [(0, '3840.204')] [2023-03-10 18:01:32,063][1054815] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-10 18:01:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8886.2). Total num frames: 40681472. Throughput: 0: 8900.4. Samples: 40671748. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:33,348][1054527] Avg episode reward: [(0, '4008.827')] [2023-03-10 18:01:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079456_40681472.pth... [2023-03-10 18:01:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000078936_40415232.pth [2023-03-10 18:01:36,683][1054815] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-10 18:01:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8886.2). Total num frames: 40726528. Throughput: 0: 8860.9. Samples: 40723952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:38,348][1054527] Avg episode reward: [(0, '4012.707')] [2023-03-10 18:01:41,246][1054815] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-10 18:01:43,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8914.0). Total num frames: 40775680. Throughput: 0: 8908.2. Samples: 40750628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:01:43,349][1054527] Avg episode reward: [(0, '3892.254')] [2023-03-10 18:01:45,474][1054815] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-10 18:01:48,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8914.0). Total num frames: 40820736. Throughput: 0: 8986.9. Samples: 40808352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:01:48,348][1054527] Avg episode reward: [(0, '3594.371')] [2023-03-10 18:01:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079728_40820736.pth... [2023-03-10 18:01:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079200_40550400.pth [2023-03-10 18:01:50,014][1054815] Updated weights for policy 0, policy_version 79760 (0.0004) [2023-03-10 18:01:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8914.0). Total num frames: 40865792. Throughput: 0: 8993.8. Samples: 40864784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:01:53,348][1054527] Avg episode reward: [(0, '3591.397')] [2023-03-10 18:01:54,390][1054815] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-10 18:01:58,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 8941.8). Total num frames: 40914944. Throughput: 0: 9039.6. Samples: 40892124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:01:58,348][1054527] Avg episode reward: [(0, '3456.850')] [2023-03-10 18:01:58,709][1054815] Updated weights for policy 0, policy_version 79920 (0.0004) [2023-03-10 18:02:03,261][1054815] Updated weights for policy 0, policy_version 80000 (0.0006) [2023-03-10 18:02:03,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 8955.7). Total num frames: 40960000. Throughput: 0: 9079.5. Samples: 40946672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:03,348][1054527] Avg episode reward: [(0, '4177.059')] [2023-03-10 18:02:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080000_40960000.pth... [2023-03-10 18:02:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079456_40681472.pth [2023-03-10 18:02:07,775][1054815] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-10 18:02:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 8941.8). Total num frames: 41005056. Throughput: 0: 9104.1. Samples: 41001032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:08,348][1054527] Avg episode reward: [(0, '2902.958')] [2023-03-10 18:02:12,833][1054815] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-10 18:02:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8942.9, 300 sec: 8914.0). Total num frames: 41041920. Throughput: 0: 9079.7. Samples: 41026260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:13,348][1054527] Avg episode reward: [(0, '2949.149')] [2023-03-10 18:02:17,731][1054815] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-10 18:02:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 9011.2, 300 sec: 8914.0). Total num frames: 41086976. Throughput: 0: 8976.4. Samples: 41075688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:18,348][1054527] Avg episode reward: [(0, '4251.560')] [2023-03-10 18:02:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080248_41086976.pth... [2023-03-10 18:02:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000079728_40820736.pth [2023-03-10 18:02:22,643][1054815] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-10 18:02:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8886.2). Total num frames: 41127936. Throughput: 0: 8921.1. Samples: 41125400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:23,348][1054527] Avg episode reward: [(0, '4539.364')] [2023-03-10 18:02:27,839][1054815] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-10 18:02:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8874.6, 300 sec: 8872.4). Total num frames: 41168896. Throughput: 0: 8841.1. Samples: 41148480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:28,349][1054527] Avg episode reward: [(0, '4617.251')] [2023-03-10 18:02:28,349][1054771] Saving new best policy, reward=4617.251! [2023-03-10 18:02:32,788][1054815] Updated weights for policy 0, policy_version 80480 (0.0004) [2023-03-10 18:02:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8872.3). Total num frames: 41209856. Throughput: 0: 8650.7. Samples: 41197632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:33,348][1054527] Avg episode reward: [(0, '4661.958')] [2023-03-10 18:02:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080488_41209856.pth... [2023-03-10 18:02:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080000_40960000.pth [2023-03-10 18:02:33,355][1054771] Saving new best policy, reward=4661.958! [2023-03-10 18:02:37,735][1054815] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-10 18:02:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 41250816. Throughput: 0: 8497.1. Samples: 41247152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:38,348][1054527] Avg episode reward: [(0, '4542.528')] [2023-03-10 18:02:42,909][1054815] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-10 18:02:43,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8533.4, 300 sec: 8830.7). Total num frames: 41287680. Throughput: 0: 8425.7. Samples: 41271280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:43,348][1054527] Avg episode reward: [(0, '4607.720')] [2023-03-10 18:02:47,587][1054815] Updated weights for policy 0, policy_version 80720 (0.0004) [2023-03-10 18:02:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8844.6). Total num frames: 41332736. Throughput: 0: 8326.1. Samples: 41321344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:48,348][1054527] Avg episode reward: [(0, '4299.467')] [2023-03-10 18:02:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080728_41332736.pth... [2023-03-10 18:02:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080248_41086976.pth [2023-03-10 18:02:52,136][1054815] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-10 18:02:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8844.6). Total num frames: 41377792. Throughput: 0: 8321.7. Samples: 41375508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:53,348][1054527] Avg episode reward: [(0, '4407.640')] [2023-03-10 18:02:56,745][1054815] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-10 18:02:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8858.5). Total num frames: 41422848. Throughput: 0: 8349.2. Samples: 41401976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:02:58,349][1054527] Avg episode reward: [(0, '4588.278')] [2023-03-10 18:03:01,202][1054815] Updated weights for policy 0, policy_version 80960 (0.0006) [2023-03-10 18:03:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8858.5). Total num frames: 41467904. Throughput: 0: 8459.8. Samples: 41456380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:03:03,349][1054527] Avg episode reward: [(0, '4435.229')] [2023-03-10 18:03:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080992_41467904.pth... [2023-03-10 18:03:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080488_41209856.pth [2023-03-10 18:03:05,842][1054815] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-10 18:03:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8858.5). Total num frames: 41512960. Throughput: 0: 8535.0. Samples: 41509476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:03:08,348][1054527] Avg episode reward: [(0, '4461.825')] [2023-03-10 18:03:10,548][1054815] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-10 18:03:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8872.3). Total num frames: 41558016. Throughput: 0: 8616.0. Samples: 41536200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:03:13,349][1054527] Avg episode reward: [(0, '4315.145')] [2023-03-10 18:03:15,233][1054815] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-10 18:03:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8858.5). Total num frames: 41598976. Throughput: 0: 8647.1. Samples: 41586752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:03:18,348][1054527] Avg episode reward: [(0, '4096.887')] [2023-03-10 18:03:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081248_41598976.pth... [2023-03-10 18:03:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080728_41332736.pth [2023-03-10 18:03:20,082][1054815] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-10 18:03:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8844.6). Total num frames: 41639936. Throughput: 0: 8698.9. Samples: 41638604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:03:23,348][1054527] Avg episode reward: [(0, '4437.154')] [2023-03-10 18:03:24,831][1054815] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-10 18:03:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8858.5). Total num frames: 41684992. Throughput: 0: 8765.1. Samples: 41665708. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:28,348][1054527] Avg episode reward: [(0, '4501.844')] [2023-03-10 18:03:29,427][1054815] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-10 18:03:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8858.5). Total num frames: 41730048. Throughput: 0: 8821.7. Samples: 41718320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:33,348][1054527] Avg episode reward: [(0, '4326.088')] [2023-03-10 18:03:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081504_41730048.pth... [2023-03-10 18:03:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000080992_41467904.pth [2023-03-10 18:03:34,018][1054815] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-10 18:03:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 41775104. Throughput: 0: 8822.0. Samples: 41772500. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:38,348][1054527] Avg episode reward: [(0, '4189.276')] [2023-03-10 18:03:38,664][1054815] Updated weights for policy 0, policy_version 81600 (0.0006) [2023-03-10 18:03:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 41811968. Throughput: 0: 8755.5. Samples: 41795972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:43,348][1054527] Avg episode reward: [(0, '4157.023')] [2023-03-10 18:03:43,988][1054815] Updated weights for policy 0, policy_version 81680 (0.0004) [2023-03-10 18:03:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 41857024. Throughput: 0: 8630.1. Samples: 41844736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:48,348][1054527] Avg episode reward: [(0, '4171.232')] [2023-03-10 18:03:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081752_41857024.pth... [2023-03-10 18:03:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081248_41598976.pth [2023-03-10 18:03:48,728][1054815] Updated weights for policy 0, policy_version 81760 (0.0004) [2023-03-10 18:03:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8830.7). Total num frames: 41897984. Throughput: 0: 8575.4. Samples: 41895368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:53,348][1054527] Avg episode reward: [(0, '4320.741')] [2023-03-10 18:03:53,619][1054815] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-10 18:03:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8816.8). Total num frames: 41938944. Throughput: 0: 8557.5. Samples: 41921288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:03:58,348][1054527] Avg episode reward: [(0, '4260.427')] [2023-03-10 18:03:58,359][1054815] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-10 18:04:03,084][1054815] Updated weights for policy 0, policy_version 82000 (0.0005) [2023-03-10 18:04:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8816.8). Total num frames: 41984000. Throughput: 0: 8571.8. Samples: 41972484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:04:03,348][1054527] Avg episode reward: [(0, '4292.369')] [2023-03-10 18:04:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082000_41984000.pth... [2023-03-10 18:04:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081504_41730048.pth [2023-03-10 18:04:08,046][1054815] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-10 18:04:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8802.9). Total num frames: 42024960. Throughput: 0: 8571.3. Samples: 42024312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:04:08,348][1054527] Avg episode reward: [(0, '4143.691')] [2023-03-10 18:04:12,651][1054815] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-10 18:04:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8802.9). Total num frames: 42070016. Throughput: 0: 8531.1. Samples: 42049608. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:04:13,348][1054527] Avg episode reward: [(0, '3367.139')] [2023-03-10 18:04:17,473][1054815] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-10 18:04:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8789.0). Total num frames: 42110976. Throughput: 0: 8494.7. Samples: 42100580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:18,348][1054527] Avg episode reward: [(0, '3203.124')] [2023-03-10 18:04:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082248_42110976.pth... [2023-03-10 18:04:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000081752_41857024.pth [2023-03-10 18:04:22,232][1054815] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-10 18:04:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8789.0). Total num frames: 42156032. Throughput: 0: 8439.9. Samples: 42152296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:23,348][1054527] Avg episode reward: [(0, '3610.093')] [2023-03-10 18:04:27,001][1054815] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-10 18:04:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8789.0). Total num frames: 42196992. Throughput: 0: 8507.7. Samples: 42178820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:28,348][1054527] Avg episode reward: [(0, '3845.256')] [2023-03-10 18:04:31,763][1054815] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-10 18:04:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8789.0). Total num frames: 42242048. Throughput: 0: 8559.1. Samples: 42229896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:33,348][1054527] Avg episode reward: [(0, '4062.727')] [2023-03-10 18:04:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082504_42242048.pth... [2023-03-10 18:04:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082000_41984000.pth [2023-03-10 18:04:36,339][1054815] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-10 18:04:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.4, 300 sec: 8789.0). Total num frames: 42287104. Throughput: 0: 8625.7. Samples: 42283524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:38,348][1054527] Avg episode reward: [(0, '4498.796')] [2023-03-10 18:04:41,063][1054815] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-10 18:04:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8761.3). Total num frames: 42328064. Throughput: 0: 8640.0. Samples: 42310088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:43,348][1054527] Avg episode reward: [(0, '4466.140')] [2023-03-10 18:04:45,906][1054815] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-10 18:04:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8789.0). Total num frames: 42377216. Throughput: 0: 8653.0. Samples: 42361868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:48,348][1054527] Avg episode reward: [(0, '4380.015')] [2023-03-10 18:04:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082768_42377216.pth... [2023-03-10 18:04:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082248_42110976.pth [2023-03-10 18:04:50,116][1054815] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-10 18:04:53,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 42422272. Throughput: 0: 8754.0. Samples: 42418240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:53,348][1054527] Avg episode reward: [(0, '4484.023')] [2023-03-10 18:04:54,679][1054815] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-10 18:04:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8775.2). Total num frames: 42463232. Throughput: 0: 8778.6. Samples: 42444644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:04:58,348][1054527] Avg episode reward: [(0, '4082.407')] [2023-03-10 18:04:59,694][1054815] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-10 18:05:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 42504192. Throughput: 0: 8755.8. Samples: 42494592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:03,348][1054527] Avg episode reward: [(0, '3954.307')] [2023-03-10 18:05:03,379][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083024_42508288.pth... [2023-03-10 18:05:03,381][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082504_42242048.pth [2023-03-10 18:05:04,164][1054815] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-10 18:05:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 42549248. Throughput: 0: 8807.9. Samples: 42548652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:08,348][1054527] Avg episode reward: [(0, '4237.580')] [2023-03-10 18:05:08,948][1054815] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-10 18:05:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 42594304. Throughput: 0: 8778.3. Samples: 42573844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:13,348][1054527] Avg episode reward: [(0, '3969.357')] [2023-03-10 18:05:13,519][1054815] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-10 18:05:18,205][1054815] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-10 18:05:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8747.4). Total num frames: 42639360. Throughput: 0: 8820.5. Samples: 42626820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:18,348][1054527] Avg episode reward: [(0, '4179.193')] [2023-03-10 18:05:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083280_42639360.pth... [2023-03-10 18:05:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000082768_42377216.pth [2023-03-10 18:05:22,986][1054815] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-10 18:05:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 42680320. Throughput: 0: 8803.0. Samples: 42679660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:23,348][1054527] Avg episode reward: [(0, '3851.542')] [2023-03-10 18:05:27,576][1054815] Updated weights for policy 0, policy_version 83440 (0.0004) [2023-03-10 18:05:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8733.5). Total num frames: 42725376. Throughput: 0: 8780.6. Samples: 42705216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:28,348][1054527] Avg episode reward: [(0, '4053.451')] [2023-03-10 18:05:32,490][1054815] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-10 18:05:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 42766336. Throughput: 0: 8791.1. Samples: 42757468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:33,348][1054527] Avg episode reward: [(0, '4274.501')] [2023-03-10 18:05:33,401][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083536_42770432.pth... [2023-03-10 18:05:33,403][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083024_42508288.pth [2023-03-10 18:05:37,047][1054815] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-10 18:05:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8733.5). Total num frames: 42811392. Throughput: 0: 8696.6. Samples: 42809588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:38,348][1054527] Avg episode reward: [(0, '4356.615')] [2023-03-10 18:05:41,843][1054815] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-10 18:05:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 42852352. Throughput: 0: 8696.1. Samples: 42835968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:43,348][1054527] Avg episode reward: [(0, '4576.447')] [2023-03-10 18:05:46,607][1054815] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-10 18:05:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 42897408. Throughput: 0: 8721.2. Samples: 42887048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:48,348][1054527] Avg episode reward: [(0, '4321.557')] [2023-03-10 18:05:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083784_42897408.pth... [2023-03-10 18:05:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083280_42639360.pth [2023-03-10 18:05:51,383][1054815] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-10 18:05:53,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 42942464. Throughput: 0: 8660.5. Samples: 42938376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:53,349][1054527] Avg episode reward: [(0, '4394.530')] [2023-03-10 18:05:56,192][1054815] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-10 18:05:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 42983424. Throughput: 0: 8670.9. Samples: 42964036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:05:58,348][1054527] Avg episode reward: [(0, '4501.184')] [2023-03-10 18:06:00,989][1054815] Updated weights for policy 0, policy_version 84000 (0.0004) [2023-03-10 18:06:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 43028480. Throughput: 0: 8644.7. Samples: 43015832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:03,348][1054527] Avg episode reward: [(0, '4500.127')] [2023-03-10 18:06:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084040_43028480.pth... [2023-03-10 18:06:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083536_42770432.pth [2023-03-10 18:06:05,664][1054815] Updated weights for policy 0, policy_version 84080 (0.0006) [2023-03-10 18:06:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 43073536. Throughput: 0: 8662.1. Samples: 43069456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:08,348][1054527] Avg episode reward: [(0, '4376.947')] [2023-03-10 18:06:10,230][1054815] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-10 18:06:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 43114496. Throughput: 0: 8652.4. Samples: 43094576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:13,348][1054527] Avg episode reward: [(0, '4454.150')] [2023-03-10 18:06:15,008][1054815] Updated weights for policy 0, policy_version 84240 (0.0006) [2023-03-10 18:06:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.8). Total num frames: 43159552. Throughput: 0: 8645.8. Samples: 43146528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:18,348][1054527] Avg episode reward: [(0, '4365.874')] [2023-03-10 18:06:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084296_43159552.pth... [2023-03-10 18:06:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000083784_42897408.pth [2023-03-10 18:06:19,837][1054815] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-10 18:06:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.8). Total num frames: 43200512. Throughput: 0: 8606.1. Samples: 43196864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:23,348][1054527] Avg episode reward: [(0, '4374.036')] [2023-03-10 18:06:24,338][1054815] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-10 18:06:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 43245568. Throughput: 0: 8667.7. Samples: 43226016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:28,348][1054527] Avg episode reward: [(0, '4293.526')] [2023-03-10 18:06:29,142][1054815] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-10 18:06:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 43286528. Throughput: 0: 8617.9. Samples: 43274852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:33,348][1054527] Avg episode reward: [(0, '4240.874')] [2023-03-10 18:06:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084544_43286528.pth... [2023-03-10 18:06:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084040_43028480.pth [2023-03-10 18:06:34,088][1054815] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-10 18:06:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 43327488. Throughput: 0: 8596.5. Samples: 43325216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:38,348][1054527] Avg episode reward: [(0, '4447.964')] [2023-03-10 18:06:39,095][1054815] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-10 18:06:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 43372544. Throughput: 0: 8618.7. Samples: 43351876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:43,348][1054527] Avg episode reward: [(0, '4275.703')] [2023-03-10 18:06:43,367][1054815] Updated weights for policy 0, policy_version 84720 (0.0005) [2023-03-10 18:06:48,182][1054815] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-10 18:06:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 43417600. Throughput: 0: 8657.3. Samples: 43405412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:48,348][1054527] Avg episode reward: [(0, '4180.499')] [2023-03-10 18:06:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084800_43417600.pth... [2023-03-10 18:06:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084296_43159552.pth [2023-03-10 18:06:52,706][1054815] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-10 18:06:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 43462656. Throughput: 0: 8663.2. Samples: 43459300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:53,348][1054527] Avg episode reward: [(0, '4375.540')] [2023-03-10 18:06:57,668][1054815] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-10 18:06:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 43503616. Throughput: 0: 8655.3. Samples: 43484064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:06:58,348][1054527] Avg episode reward: [(0, '4519.184')] [2023-03-10 18:07:02,060][1054815] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-10 18:07:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 43548672. Throughput: 0: 8708.9. Samples: 43538428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:03,348][1054527] Avg episode reward: [(0, '4576.924')] [2023-03-10 18:07:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085056_43548672.pth... [2023-03-10 18:07:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084544_43286528.pth [2023-03-10 18:07:06,740][1054815] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-10 18:07:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 43593728. Throughput: 0: 8729.8. Samples: 43589704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:08,348][1054527] Avg episode reward: [(0, '4512.630')] [2023-03-10 18:07:11,654][1054815] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-10 18:07:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 43634688. Throughput: 0: 8652.7. Samples: 43615388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:13,348][1054527] Avg episode reward: [(0, '4452.866')] [2023-03-10 18:07:16,469][1054815] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-10 18:07:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 43675648. Throughput: 0: 8708.8. Samples: 43666748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:18,348][1054527] Avg episode reward: [(0, '4412.748')] [2023-03-10 18:07:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085304_43675648.pth... [2023-03-10 18:07:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000084800_43417600.pth [2023-03-10 18:07:21,734][1054815] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-10 18:07:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 43716608. Throughput: 0: 8615.0. Samples: 43712892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:23,348][1054527] Avg episode reward: [(0, '4342.722')] [2023-03-10 18:07:26,689][1054815] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-10 18:07:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 43757568. Throughput: 0: 8588.6. Samples: 43738364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:28,349][1054527] Avg episode reward: [(0, '4376.851')] [2023-03-10 18:07:31,553][1054815] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-10 18:07:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 43798528. Throughput: 0: 8517.1. Samples: 43788680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:33,348][1054527] Avg episode reward: [(0, '4252.875')] [2023-03-10 18:07:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085544_43798528.pth... [2023-03-10 18:07:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085056_43548672.pth [2023-03-10 18:07:36,443][1054815] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-10 18:07:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 43839488. Throughput: 0: 8435.0. Samples: 43838876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:07:38,348][1054527] Avg episode reward: [(0, '4312.306')] [2023-03-10 18:07:41,299][1054815] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-10 18:07:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 43884544. Throughput: 0: 8446.7. Samples: 43864164. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:07:43,349][1054527] Avg episode reward: [(0, '4297.462')] [2023-03-10 18:07:46,129][1054815] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-10 18:07:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 43925504. Throughput: 0: 8378.1. Samples: 43915444. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:07:48,348][1054527] Avg episode reward: [(0, '4452.932')] [2023-03-10 18:07:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085792_43925504.pth... [2023-03-10 18:07:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085304_43675648.pth [2023-03-10 18:07:50,969][1054815] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-10 18:07:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 43970560. Throughput: 0: 8378.1. Samples: 43966720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:07:53,348][1054527] Avg episode reward: [(0, '4195.703')] [2023-03-10 18:07:55,445][1054815] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-10 18:07:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 44015616. Throughput: 0: 8439.2. Samples: 43995152. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:07:58,348][1054527] Avg episode reward: [(0, '4004.704')] [2023-03-10 18:07:59,985][1054815] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-10 18:08:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 44056576. Throughput: 0: 8469.2. Samples: 44047860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:03,348][1054527] Avg episode reward: [(0, '3907.484')] [2023-03-10 18:08:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086048_44056576.pth... [2023-03-10 18:08:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085544_43798528.pth [2023-03-10 18:08:04,956][1054815] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-10 18:08:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 44097536. Throughput: 0: 8544.7. Samples: 44097404. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:08,349][1054527] Avg episode reward: [(0, '3837.534')] [2023-03-10 18:08:09,852][1054815] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-10 18:08:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 44142592. Throughput: 0: 8527.4. Samples: 44122096. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:13,348][1054527] Avg episode reward: [(0, '3764.260')] [2023-03-10 18:08:14,652][1054815] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-10 18:08:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 44183552. Throughput: 0: 8549.5. Samples: 44173408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:18,349][1054527] Avg episode reward: [(0, '4201.246')] [2023-03-10 18:08:18,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086296_44183552.pth... [2023-03-10 18:08:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000085792_43925504.pth [2023-03-10 18:08:19,728][1054815] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-10 18:08:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 44228608. Throughput: 0: 8575.8. Samples: 44224788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:23,348][1054527] Avg episode reward: [(0, '4278.082')] [2023-03-10 18:08:24,098][1054815] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-10 18:08:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8608.5). Total num frames: 44269568. Throughput: 0: 8632.5. Samples: 44252628. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:28,348][1054527] Avg episode reward: [(0, '4179.270')] [2023-03-10 18:08:28,919][1054815] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-10 18:08:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 44314624. Throughput: 0: 8627.2. Samples: 44303668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:08:33,348][1054527] Avg episode reward: [(0, '3879.922')] [2023-03-10 18:08:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086552_44314624.pth... [2023-03-10 18:08:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086048_44056576.pth [2023-03-10 18:08:33,402][1054815] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-10 18:08:38,192][1054815] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-10 18:08:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 44359680. Throughput: 0: 8643.6. Samples: 44355684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:08:38,348][1054527] Avg episode reward: [(0, '3573.366')] [2023-03-10 18:08:43,266][1054815] Updated weights for policy 0, policy_version 86720 (0.0004) [2023-03-10 18:08:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44400640. Throughput: 0: 8557.2. Samples: 44380224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:08:43,348][1054527] Avg episode reward: [(0, '3739.324')] [2023-03-10 18:08:48,276][1054815] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-10 18:08:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44441600. Throughput: 0: 8476.7. Samples: 44429312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:08:48,348][1054527] Avg episode reward: [(0, '4276.250')] [2023-03-10 18:08:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086800_44441600.pth... [2023-03-10 18:08:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086296_44183552.pth [2023-03-10 18:08:53,101][1054815] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-10 18:08:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 44482560. Throughput: 0: 8518.7. Samples: 44480744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:08:53,348][1054527] Avg episode reward: [(0, '3660.475')] [2023-03-10 18:08:57,905][1054815] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-10 18:08:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 44523520. Throughput: 0: 8531.7. Samples: 44506020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:08:58,348][1054527] Avg episode reward: [(0, '3904.040')] [2023-03-10 18:09:02,614][1054815] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-10 18:09:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 44568576. Throughput: 0: 8557.2. Samples: 44558484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:09:03,348][1054527] Avg episode reward: [(0, '4138.890')] [2023-03-10 18:09:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087048_44568576.pth... [2023-03-10 18:09:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086552_44314624.pth [2023-03-10 18:09:07,164][1054815] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-10 18:09:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44613632. Throughput: 0: 8567.0. Samples: 44610304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:09:08,348][1054527] Avg episode reward: [(0, '4262.656')] [2023-03-10 18:09:12,054][1054815] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-10 18:09:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 44654592. Throughput: 0: 8537.8. Samples: 44636828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:09:13,348][1054527] Avg episode reward: [(0, '4059.346')] [2023-03-10 18:09:16,672][1054815] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-10 18:09:18,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44699648. Throughput: 0: 8548.1. Samples: 44688332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:09:18,348][1054527] Avg episode reward: [(0, '4207.178')] [2023-03-10 18:09:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087304_44699648.pth... [2023-03-10 18:09:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000086800_44441600.pth [2023-03-10 18:09:21,336][1054815] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-10 18:09:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 44744704. Throughput: 0: 8567.2. Samples: 44741208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:09:23,348][1054527] Avg episode reward: [(0, '4258.549')] [2023-03-10 18:09:25,982][1054815] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-10 18:09:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44785664. Throughput: 0: 8627.9. Samples: 44768480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:28,348][1054527] Avg episode reward: [(0, '4457.786')] [2023-03-10 18:09:30,965][1054815] Updated weights for policy 0, policy_version 87520 (0.0006) [2023-03-10 18:09:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 44830720. Throughput: 0: 8645.5. Samples: 44818360. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:33,348][1054527] Avg episode reward: [(0, '4559.925')] [2023-03-10 18:09:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087560_44830720.pth... [2023-03-10 18:09:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087048_44568576.pth [2023-03-10 18:09:35,409][1054815] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-10 18:09:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.4, 300 sec: 8622.4). Total num frames: 44871680. Throughput: 0: 8684.3. Samples: 44871536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:38,348][1054527] Avg episode reward: [(0, '4467.756')] [2023-03-10 18:09:40,119][1054815] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-10 18:09:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 44920832. Throughput: 0: 8743.3. Samples: 44899468. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:43,348][1054527] Avg episode reward: [(0, '4279.077')] [2023-03-10 18:09:44,759][1054815] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-10 18:09:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8608.5). Total num frames: 44961792. Throughput: 0: 8736.7. Samples: 44951636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:48,348][1054527] Avg episode reward: [(0, '4330.719')] [2023-03-10 18:09:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087816_44961792.pth... [2023-03-10 18:09:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087304_44699648.pth [2023-03-10 18:09:49,340][1054815] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-10 18:09:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 45006848. Throughput: 0: 8752.3. Samples: 45004160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:53,348][1054527] Avg episode reward: [(0, '4326.537')] [2023-03-10 18:09:54,132][1054815] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-10 18:09:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 45047808. Throughput: 0: 8721.6. Samples: 45029300. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:09:58,348][1054527] Avg episode reward: [(0, '4315.000')] [2023-03-10 18:09:58,932][1054815] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-10 18:10:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 45092864. Throughput: 0: 8724.1. Samples: 45080916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:10:03,348][1054527] Avg episode reward: [(0, '4260.049')] [2023-03-10 18:10:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088072_45092864.pth... [2023-03-10 18:10:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087560_44830720.pth [2023-03-10 18:10:03,763][1054815] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-10 18:10:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 45129728. Throughput: 0: 8635.2. Samples: 45129792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:10:08,348][1054527] Avg episode reward: [(0, '4434.640')] [2023-03-10 18:10:08,911][1054815] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-10 18:10:13,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 45170688. Throughput: 0: 8560.9. Samples: 45153720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:10:13,349][1054527] Avg episode reward: [(0, '4515.658')] [2023-03-10 18:10:13,875][1054815] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-10 18:10:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 45215744. Throughput: 0: 8583.1. Samples: 45204600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:10:18,348][1054527] Avg episode reward: [(0, '4449.538')] [2023-03-10 18:10:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088312_45215744.pth... [2023-03-10 18:10:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000087816_44961792.pth [2023-03-10 18:10:18,817][1054815] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-10 18:10:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 45256704. Throughput: 0: 8507.8. Samples: 45254388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:23,348][1054527] Avg episode reward: [(0, '4157.981')] [2023-03-10 18:10:23,508][1054815] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-10 18:10:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 45297664. Throughput: 0: 8454.0. Samples: 45279900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:28,348][1054527] Avg episode reward: [(0, '4223.987')] [2023-03-10 18:10:28,572][1054815] Updated weights for policy 0, policy_version 88480 (0.0004) [2023-03-10 18:10:33,146][1054815] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-10 18:10:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 45342720. Throughput: 0: 8424.0. Samples: 45330716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:33,348][1054527] Avg episode reward: [(0, '4274.603')] [2023-03-10 18:10:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088560_45342720.pth... [2023-03-10 18:10:33,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088072_45092864.pth [2023-03-10 18:10:37,775][1054815] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-10 18:10:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 45387776. Throughput: 0: 8435.4. Samples: 45383752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:38,348][1054527] Avg episode reward: [(0, '4395.391')] [2023-03-10 18:10:42,403][1054815] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-10 18:10:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 45432832. Throughput: 0: 8466.9. Samples: 45410312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:43,348][1054527] Avg episode reward: [(0, '4492.895')] [2023-03-10 18:10:47,634][1054815] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-10 18:10:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 45469696. Throughput: 0: 8424.1. Samples: 45460000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:48,349][1054527] Avg episode reward: [(0, '4553.668')] [2023-03-10 18:10:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088808_45469696.pth... [2023-03-10 18:10:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088312_45215744.pth [2023-03-10 18:10:52,591][1054815] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-10 18:10:53,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 45510656. Throughput: 0: 8418.3. Samples: 45508616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:53,348][1054527] Avg episode reward: [(0, '4549.209')] [2023-03-10 18:10:57,735][1054815] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-10 18:10:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 45551616. Throughput: 0: 8388.6. Samples: 45531208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:10:58,348][1054527] Avg episode reward: [(0, '4411.907')] [2023-03-10 18:11:02,570][1054815] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-10 18:11:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 45592576. Throughput: 0: 8411.6. Samples: 45583124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:03,349][1054527] Avg episode reward: [(0, '4448.045')] [2023-03-10 18:11:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089048_45592576.pth... [2023-03-10 18:11:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088560_45342720.pth [2023-03-10 18:11:07,409][1054815] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-10 18:11:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 45633536. Throughput: 0: 8419.6. Samples: 45633272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:08,348][1054527] Avg episode reward: [(0, '4445.724')] [2023-03-10 18:11:12,526][1054815] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-10 18:11:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 45674496. Throughput: 0: 8384.8. Samples: 45657216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:13,348][1054527] Avg episode reward: [(0, '4340.251')] [2023-03-10 18:11:17,392][1054815] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-10 18:11:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8525.2). Total num frames: 45715456. Throughput: 0: 8366.8. Samples: 45707224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:18,348][1054527] Avg episode reward: [(0, '4577.813')] [2023-03-10 18:11:18,378][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089296_45719552.pth... [2023-03-10 18:11:18,380][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000088808_45469696.pth [2023-03-10 18:11:22,470][1054815] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-10 18:11:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 45756416. Throughput: 0: 8269.5. Samples: 45755880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:23,348][1054527] Avg episode reward: [(0, '4562.050')] [2023-03-10 18:11:27,411][1054815] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-10 18:11:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 45801472. Throughput: 0: 8230.8. Samples: 45780700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:28,349][1054527] Avg episode reward: [(0, '4309.770')] [2023-03-10 18:11:32,387][1054815] Updated weights for policy 0, policy_version 89520 (0.0004) [2023-03-10 18:11:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8511.3). Total num frames: 45838336. Throughput: 0: 8206.9. Samples: 45829312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:33,348][1054527] Avg episode reward: [(0, '4347.184')] [2023-03-10 18:11:33,367][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089536_45842432.pth... [2023-03-10 18:11:33,369][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089048_45592576.pth [2023-03-10 18:11:37,195][1054815] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-10 18:11:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8511.3). Total num frames: 45883392. Throughput: 0: 8261.7. Samples: 45880392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:38,348][1054527] Avg episode reward: [(0, '4321.451')] [2023-03-10 18:11:41,839][1054815] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-10 18:11:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8192.0, 300 sec: 8497.5). Total num frames: 45924352. Throughput: 0: 8352.3. Samples: 45907060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:43,348][1054527] Avg episode reward: [(0, '4605.469')] [2023-03-10 18:11:46,697][1054815] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-10 18:11:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 45969408. Throughput: 0: 8330.4. Samples: 45957992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:48,348][1054527] Avg episode reward: [(0, '4509.999')] [2023-03-10 18:11:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089784_45969408.pth... [2023-03-10 18:11:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089296_45719552.pth [2023-03-10 18:11:51,287][1054815] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-10 18:11:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 46014464. Throughput: 0: 8381.5. Samples: 46010440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:53,348][1054527] Avg episode reward: [(0, '3945.598')] [2023-03-10 18:11:56,314][1054815] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-10 18:11:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 46055424. Throughput: 0: 8395.4. Samples: 46035008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:11:58,348][1054527] Avg episode reward: [(0, '4580.998')] [2023-03-10 18:12:01,285][1054815] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-10 18:12:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46096384. Throughput: 0: 8397.4. Samples: 46085108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:03,348][1054527] Avg episode reward: [(0, '4544.188')] [2023-03-10 18:12:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090032_46096384.pth... [2023-03-10 18:12:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089536_45842432.pth [2023-03-10 18:12:06,162][1054815] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-10 18:12:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46137344. Throughput: 0: 8418.4. Samples: 46134708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:08,348][1054527] Avg episode reward: [(0, '4384.112')] [2023-03-10 18:12:11,187][1054815] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-10 18:12:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46178304. Throughput: 0: 8405.1. Samples: 46158928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:13,348][1054527] Avg episode reward: [(0, '4259.969')] [2023-03-10 18:12:16,083][1054815] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-10 18:12:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46219264. Throughput: 0: 8451.7. Samples: 46209640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:18,348][1054527] Avg episode reward: [(0, '4378.009')] [2023-03-10 18:12:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090272_46219264.pth... [2023-03-10 18:12:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000089784_45969408.pth [2023-03-10 18:12:20,950][1054815] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-10 18:12:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46260224. Throughput: 0: 8438.1. Samples: 46260104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:23,348][1054527] Avg episode reward: [(0, '4571.735')] [2023-03-10 18:12:25,892][1054815] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-10 18:12:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 46305280. Throughput: 0: 8381.7. Samples: 46284236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:28,348][1054527] Avg episode reward: [(0, '4647.639')] [2023-03-10 18:12:30,675][1054815] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-10 18:12:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 46346240. Throughput: 0: 8398.4. Samples: 46335920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:33,348][1054527] Avg episode reward: [(0, '4560.153')] [2023-03-10 18:12:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090520_46346240.pth... [2023-03-10 18:12:33,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090032_46096384.pth [2023-03-10 18:12:35,530][1054815] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-10 18:12:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46387200. Throughput: 0: 8372.7. Samples: 46387212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:38,348][1054527] Avg episode reward: [(0, '4675.362')] [2023-03-10 18:12:38,350][1054771] Saving new best policy, reward=4675.362! [2023-03-10 18:12:40,197][1054815] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-10 18:12:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 46432256. Throughput: 0: 8400.3. Samples: 46413020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:43,348][1054527] Avg episode reward: [(0, '4620.782')] [2023-03-10 18:12:45,026][1054815] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-10 18:12:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 46477312. Throughput: 0: 8446.8. Samples: 46465216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:48,349][1054527] Avg episode reward: [(0, '4621.550')] [2023-03-10 18:12:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090776_46477312.pth... [2023-03-10 18:12:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090272_46219264.pth [2023-03-10 18:12:49,697][1054815] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-10 18:12:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46518272. Throughput: 0: 8451.5. Samples: 46515024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:53,348][1054527] Avg episode reward: [(0, '3645.546')] [2023-03-10 18:12:54,598][1054815] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-10 18:12:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 46559232. Throughput: 0: 8491.5. Samples: 46541044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:12:58,348][1054527] Avg episode reward: [(0, '4380.565')] [2023-03-10 18:12:59,480][1054815] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-10 18:13:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 46604288. Throughput: 0: 8495.4. Samples: 46591932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:13:03,348][1054527] Avg episode reward: [(0, '4654.170')] [2023-03-10 18:13:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091024_46604288.pth... [2023-03-10 18:13:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090520_46346240.pth [2023-03-10 18:13:04,320][1054815] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-10 18:13:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 46645248. Throughput: 0: 8469.1. Samples: 46641216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:08,348][1054527] Avg episode reward: [(0, '4571.818')] [2023-03-10 18:13:09,237][1054815] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-10 18:13:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 46686208. Throughput: 0: 8491.1. Samples: 46666336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:13,349][1054527] Avg episode reward: [(0, '4243.356')] [2023-03-10 18:13:14,173][1054815] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-10 18:13:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 46727168. Throughput: 0: 8422.9. Samples: 46714952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:18,348][1054527] Avg episode reward: [(0, '4274.284')] [2023-03-10 18:13:18,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091264_46727168.pth... [2023-03-10 18:13:18,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000090776_46477312.pth [2023-03-10 18:13:19,244][1054815] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-10 18:13:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 46768128. Throughput: 0: 8462.7. Samples: 46768032. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:23,348][1054527] Avg episode reward: [(0, '4336.648')] [2023-03-10 18:13:23,842][1054815] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-10 18:13:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 46813184. Throughput: 0: 8449.4. Samples: 46793244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:28,348][1054527] Avg episode reward: [(0, '4485.685')] [2023-03-10 18:13:28,517][1054815] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-10 18:13:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 46854144. Throughput: 0: 8422.4. Samples: 46844224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:33,348][1054527] Avg episode reward: [(0, '4544.063')] [2023-03-10 18:13:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091512_46854144.pth... [2023-03-10 18:13:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091024_46604288.pth [2023-03-10 18:13:33,442][1054815] Updated weights for policy 0, policy_version 91520 (0.0004) [2023-03-10 18:13:38,176][1054815] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-10 18:13:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 46899200. Throughput: 0: 8466.6. Samples: 46896024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:38,348][1054527] Avg episode reward: [(0, '4673.921')] [2023-03-10 18:13:43,115][1054815] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-10 18:13:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 46940160. Throughput: 0: 8424.8. Samples: 46920160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:43,348][1054527] Avg episode reward: [(0, '4455.179')] [2023-03-10 18:13:47,713][1054815] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-10 18:13:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 46985216. Throughput: 0: 8489.4. Samples: 46973956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:48,348][1054527] Avg episode reward: [(0, '4669.345')] [2023-03-10 18:13:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091768_46985216.pth... [2023-03-10 18:13:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091264_46727168.pth [2023-03-10 18:13:52,553][1054815] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-10 18:13:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.0, 300 sec: 8483.6). Total num frames: 47026176. Throughput: 0: 8519.7. Samples: 47024604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:53,348][1054527] Avg episode reward: [(0, '4548.674')] [2023-03-10 18:13:57,526][1054815] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-10 18:13:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 47067136. Throughput: 0: 8531.3. Samples: 47050244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 18:13:58,348][1054527] Avg episode reward: [(0, '4471.953')] [2023-03-10 18:14:01,953][1054815] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-10 18:14:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 47112192. Throughput: 0: 8626.3. Samples: 47103136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:03,348][1054527] Avg episode reward: [(0, '4528.116')] [2023-03-10 18:14:03,374][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092024_47116288.pth... [2023-03-10 18:14:03,375][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091512_46854144.pth [2023-03-10 18:14:06,751][1054815] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-10 18:14:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 47157248. Throughput: 0: 8605.2. Samples: 47155268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:08,348][1054527] Avg episode reward: [(0, '4520.909')] [2023-03-10 18:14:11,407][1054815] Updated weights for policy 0, policy_version 92160 (0.0006) [2023-03-10 18:14:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 47198208. Throughput: 0: 8622.4. Samples: 47181252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:13,348][1054527] Avg episode reward: [(0, '4268.060')] [2023-03-10 18:14:16,317][1054815] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-10 18:14:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 47243264. Throughput: 0: 8594.7. Samples: 47230984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:18,348][1054527] Avg episode reward: [(0, '4561.347')] [2023-03-10 18:14:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092272_47243264.pth... [2023-03-10 18:14:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000091768_46985216.pth [2023-03-10 18:14:21,178][1054815] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-10 18:14:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 47284224. Throughput: 0: 8553.2. Samples: 47280916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:23,348][1054527] Avg episode reward: [(0, '4516.595')] [2023-03-10 18:14:26,152][1054815] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-10 18:14:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 47325184. Throughput: 0: 8579.7. Samples: 47306248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:28,348][1054527] Avg episode reward: [(0, '4512.710')] [2023-03-10 18:14:31,170][1054815] Updated weights for policy 0, policy_version 92480 (0.0004) [2023-03-10 18:14:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 47366144. Throughput: 0: 8475.0. Samples: 47355328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:33,348][1054527] Avg episode reward: [(0, '4061.649')] [2023-03-10 18:14:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092512_47366144.pth... [2023-03-10 18:14:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092024_47116288.pth [2023-03-10 18:14:36,247][1054815] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-10 18:14:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 47407104. Throughput: 0: 8413.6. Samples: 47403216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:38,348][1054527] Avg episode reward: [(0, '4328.267')] [2023-03-10 18:14:41,114][1054815] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-10 18:14:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 47448064. Throughput: 0: 8424.4. Samples: 47429340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:43,348][1054527] Avg episode reward: [(0, '4240.509')] [2023-03-10 18:14:45,946][1054815] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-10 18:14:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 47493120. Throughput: 0: 8392.7. Samples: 47480808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:48,348][1054527] Avg episode reward: [(0, '4261.877')] [2023-03-10 18:14:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092760_47493120.pth... [2023-03-10 18:14:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092272_47243264.pth [2023-03-10 18:14:50,868][1054815] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-10 18:14:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 47534080. Throughput: 0: 8334.8. Samples: 47530336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:53,348][1054527] Avg episode reward: [(0, '4273.564')] [2023-03-10 18:14:55,594][1054815] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-10 18:14:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 47575040. Throughput: 0: 8339.3. Samples: 47556520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:14:58,348][1054527] Avg episode reward: [(0, '4036.579')] [2023-03-10 18:15:00,401][1054815] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-10 18:15:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 47620096. Throughput: 0: 8372.1. Samples: 47607728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:03,348][1054527] Avg episode reward: [(0, '4233.893')] [2023-03-10 18:15:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093008_47620096.pth... [2023-03-10 18:15:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092512_47366144.pth [2023-03-10 18:15:05,301][1054815] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-10 18:15:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 47661056. Throughput: 0: 8421.2. Samples: 47659868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:08,348][1054527] Avg episode reward: [(0, '4197.538')] [2023-03-10 18:15:09,949][1054815] Updated weights for policy 0, policy_version 93120 (0.0005) [2023-03-10 18:15:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 47702016. Throughput: 0: 8432.2. Samples: 47685696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:13,348][1054527] Avg episode reward: [(0, '4164.259')] [2023-03-10 18:15:15,009][1054815] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-10 18:15:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 47747072. Throughput: 0: 8424.4. Samples: 47734428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:18,349][1054527] Avg episode reward: [(0, '3970.307')] [2023-03-10 18:15:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093256_47747072.pth... [2023-03-10 18:15:18,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000092760_47493120.pth [2023-03-10 18:15:19,781][1054815] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-10 18:15:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 47788032. Throughput: 0: 8462.6. Samples: 47784032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:23,348][1054527] Avg episode reward: [(0, '3486.262')] [2023-03-10 18:15:24,461][1054815] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-10 18:15:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 47833088. Throughput: 0: 8517.2. Samples: 47812616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:28,348][1054527] Avg episode reward: [(0, '4045.666')] [2023-03-10 18:15:29,286][1054815] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-10 18:15:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 47874048. Throughput: 0: 8465.6. Samples: 47861760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:33,348][1054527] Avg episode reward: [(0, '3968.874')] [2023-03-10 18:15:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093504_47874048.pth... [2023-03-10 18:15:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093008_47620096.pth [2023-03-10 18:15:34,443][1054815] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-10 18:15:38,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 47910912. Throughput: 0: 8388.9. Samples: 47907836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:38,348][1054527] Avg episode reward: [(0, '3972.842')] [2023-03-10 18:15:39,576][1054815] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-10 18:15:43,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 47951872. Throughput: 0: 8389.2. Samples: 47934032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:43,348][1054527] Avg episode reward: [(0, '3953.109')] [2023-03-10 18:15:44,446][1054815] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-10 18:15:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8414.2). Total num frames: 47992832. Throughput: 0: 8377.2. Samples: 47984704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:48,348][1054527] Avg episode reward: [(0, '3984.619')] [2023-03-10 18:15:48,370][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093744_47996928.pth... [2023-03-10 18:15:48,372][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093256_47747072.pth [2023-03-10 18:15:49,287][1054815] Updated weights for policy 0, policy_version 93760 (0.0006) [2023-03-10 18:15:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 48037888. Throughput: 0: 8347.5. Samples: 48035508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:53,348][1054527] Avg episode reward: [(0, '4208.981')] [2023-03-10 18:15:54,144][1054815] Updated weights for policy 0, policy_version 93840 (0.0006) [2023-03-10 18:15:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 48078848. Throughput: 0: 8283.2. Samples: 48058440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:15:58,348][1054527] Avg episode reward: [(0, '4319.804')] [2023-03-10 18:15:59,251][1054815] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-10 18:16:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 48119808. Throughput: 0: 8320.1. Samples: 48108832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:03,348][1054527] Avg episode reward: [(0, '4067.371')] [2023-03-10 18:16:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093984_48119808.pth... [2023-03-10 18:16:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093504_47874048.pth [2023-03-10 18:16:03,955][1054815] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-10 18:16:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 48160768. Throughput: 0: 8365.2. Samples: 48160464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:08,348][1054527] Avg episode reward: [(0, '3780.263')] [2023-03-10 18:16:08,959][1054815] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-10 18:16:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48205824. Throughput: 0: 8284.3. Samples: 48185408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:13,348][1054527] Avg episode reward: [(0, '3906.398')] [2023-03-10 18:16:13,494][1054815] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-10 18:16:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.6, 300 sec: 8441.9). Total num frames: 48246784. Throughput: 0: 8371.8. Samples: 48238492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:18,348][1054527] Avg episode reward: [(0, '3379.588')] [2023-03-10 18:16:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094232_48246784.pth... [2023-03-10 18:16:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093744_47996928.pth [2023-03-10 18:16:18,493][1054815] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-10 18:16:23,170][1054815] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-10 18:16:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48291840. Throughput: 0: 8467.8. Samples: 48288884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:23,348][1054527] Avg episode reward: [(0, '3682.436')] [2023-03-10 18:16:28,211][1054815] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-10 18:16:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 48332800. Throughput: 0: 8439.4. Samples: 48313804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:28,348][1054527] Avg episode reward: [(0, '3985.667')] [2023-03-10 18:16:32,959][1054815] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-10 18:16:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 48373760. Throughput: 0: 8431.8. Samples: 48364136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:33,348][1054527] Avg episode reward: [(0, '4120.373')] [2023-03-10 18:16:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094480_48373760.pth... [2023-03-10 18:16:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000093984_48119808.pth [2023-03-10 18:16:38,057][1054815] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-10 18:16:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48414720. Throughput: 0: 8385.8. Samples: 48412868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:38,348][1054527] Avg episode reward: [(0, '3795.384')] [2023-03-10 18:16:42,973][1054815] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-10 18:16:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 48455680. Throughput: 0: 8413.2. Samples: 48437032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:43,348][1054527] Avg episode reward: [(0, '4301.747')] [2023-03-10 18:16:47,354][1054815] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-10 18:16:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 48500736. Throughput: 0: 8489.9. Samples: 48490876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:48,348][1054527] Avg episode reward: [(0, '4298.179')] [2023-03-10 18:16:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094728_48500736.pth... [2023-03-10 18:16:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094232_48246784.pth [2023-03-10 18:16:52,460][1054815] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-10 18:16:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 48541696. Throughput: 0: 8458.2. Samples: 48541084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:53,348][1054527] Avg episode reward: [(0, '4162.315')] [2023-03-10 18:16:57,625][1054815] Updated weights for policy 0, policy_version 94880 (0.0004) [2023-03-10 18:16:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 48582656. Throughput: 0: 8417.3. Samples: 48564188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:16:58,348][1054527] Avg episode reward: [(0, '4475.881')] [2023-03-10 18:17:02,327][1054815] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-10 18:17:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 48627712. Throughput: 0: 8376.2. Samples: 48615424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:03,349][1054527] Avg episode reward: [(0, '4359.897')] [2023-03-10 18:17:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094976_48627712.pth... [2023-03-10 18:17:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094480_48373760.pth [2023-03-10 18:17:07,214][1054815] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-10 18:17:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8441.9). Total num frames: 48668672. Throughput: 0: 8354.2. Samples: 48664824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:08,349][1054527] Avg episode reward: [(0, '4365.148')] [2023-03-10 18:17:12,127][1054815] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-10 18:17:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48709632. Throughput: 0: 8358.7. Samples: 48689948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:13,349][1054527] Avg episode reward: [(0, '4486.539')] [2023-03-10 18:17:17,053][1054815] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-10 18:17:18,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48750592. Throughput: 0: 8359.2. Samples: 48740300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:18,348][1054527] Avg episode reward: [(0, '4321.791')] [2023-03-10 18:17:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095216_48750592.pth... [2023-03-10 18:17:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094728_48500736.pth [2023-03-10 18:17:21,973][1054815] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-10 18:17:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 48791552. Throughput: 0: 8411.6. Samples: 48791388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:23,348][1054527] Avg episode reward: [(0, '4332.836')] [2023-03-10 18:17:26,538][1054815] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-10 18:17:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48836608. Throughput: 0: 8483.5. Samples: 48818788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:28,348][1054527] Avg episode reward: [(0, '4062.220')] [2023-03-10 18:17:31,275][1054815] Updated weights for policy 0, policy_version 95440 (0.0006) [2023-03-10 18:17:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 48877568. Throughput: 0: 8411.3. Samples: 48869384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:33,348][1054527] Avg episode reward: [(0, '4538.593')] [2023-03-10 18:17:33,358][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095472_48881664.pth... [2023-03-10 18:17:33,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000094976_48627712.pth [2023-03-10 18:17:36,275][1054815] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-10 18:17:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 48922624. Throughput: 0: 8389.3. Samples: 48918600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:38,348][1054527] Avg episode reward: [(0, '4628.709')] [2023-03-10 18:17:41,282][1054815] Updated weights for policy 0, policy_version 95600 (0.0004) [2023-03-10 18:17:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 48963584. Throughput: 0: 8430.2. Samples: 48943548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:43,348][1054527] Avg episode reward: [(0, '4333.084')] [2023-03-10 18:17:46,136][1054815] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-10 18:17:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 49004544. Throughput: 0: 8404.7. Samples: 48993636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:48,348][1054527] Avg episode reward: [(0, '4560.116')] [2023-03-10 18:17:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095712_49004544.pth... [2023-03-10 18:17:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095216_48750592.pth [2023-03-10 18:17:51,228][1054815] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-10 18:17:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 49045504. Throughput: 0: 8388.1. Samples: 49042288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:53,348][1054527] Avg episode reward: [(0, '4457.619')] [2023-03-10 18:17:56,133][1054815] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-10 18:17:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 49086464. Throughput: 0: 8414.2. Samples: 49068588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:17:58,348][1054527] Avg episode reward: [(0, '4523.789')] [2023-03-10 18:18:01,181][1054815] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-10 18:18:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8414.2). Total num frames: 49127424. Throughput: 0: 8357.8. Samples: 49116400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:03,349][1054527] Avg episode reward: [(0, '4260.934')] [2023-03-10 18:18:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095952_49127424.pth... [2023-03-10 18:18:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095472_48881664.pth [2023-03-10 18:18:05,893][1054815] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-10 18:18:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 49172480. Throughput: 0: 8379.3. Samples: 49168456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:08,348][1054527] Avg episode reward: [(0, '4245.697')] [2023-03-10 18:18:10,801][1054815] Updated weights for policy 0, policy_version 96080 (0.0006) [2023-03-10 18:18:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 49213440. Throughput: 0: 8316.3. Samples: 49193024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:13,348][1054527] Avg episode reward: [(0, '4252.311')] [2023-03-10 18:18:15,797][1054815] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-10 18:18:18,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8328.5, 300 sec: 8414.2). Total num frames: 49250304. Throughput: 0: 8283.0. Samples: 49242120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:18,348][1054527] Avg episode reward: [(0, '4176.104')] [2023-03-10 18:18:18,388][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096200_49254400.pth... [2023-03-10 18:18:18,389][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095712_49004544.pth [2023-03-10 18:18:20,761][1054815] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-10 18:18:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 49295360. Throughput: 0: 8283.0. Samples: 49291336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:23,348][1054527] Avg episode reward: [(0, '4224.839')] [2023-03-10 18:18:25,864][1054815] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-10 18:18:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8400.3). Total num frames: 49332224. Throughput: 0: 8272.5. Samples: 49315808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:28,348][1054527] Avg episode reward: [(0, '4304.802')] [2023-03-10 18:18:30,985][1054815] Updated weights for policy 0, policy_version 96400 (0.0004) [2023-03-10 18:18:33,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8260.3, 300 sec: 8386.4). Total num frames: 49373184. Throughput: 0: 8248.9. Samples: 49364836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:33,348][1054527] Avg episode reward: [(0, '4265.696')] [2023-03-10 18:18:33,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096432_49373184.pth... [2023-03-10 18:18:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000095952_49127424.pth [2023-03-10 18:18:36,162][1054815] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-10 18:18:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8386.4). Total num frames: 49414144. Throughput: 0: 8174.4. Samples: 49410136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:38,348][1054527] Avg episode reward: [(0, '3942.726')] [2023-03-10 18:18:41,349][1054815] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-10 18:18:43,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8123.7, 300 sec: 8358.6). Total num frames: 49451008. Throughput: 0: 8133.8. Samples: 49434608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:18:43,348][1054527] Avg episode reward: [(0, '4226.195')] [2023-03-10 18:18:46,279][1054815] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-10 18:18:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 49496064. Throughput: 0: 8168.9. Samples: 49484000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:18:48,348][1054527] Avg episode reward: [(0, '4351.377')] [2023-03-10 18:18:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096672_49496064.pth... [2023-03-10 18:18:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096200_49254400.pth [2023-03-10 18:18:51,185][1054815] Updated weights for policy 0, policy_version 96720 (0.0005) [2023-03-10 18:18:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8192.0, 300 sec: 8372.5). Total num frames: 49537024. Throughput: 0: 8126.4. Samples: 49534144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:18:53,348][1054527] Avg episode reward: [(0, '4214.592')] [2023-03-10 18:18:56,026][1054815] Updated weights for policy 0, policy_version 96800 (0.0005) [2023-03-10 18:18:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 49577984. Throughput: 0: 8148.1. Samples: 49559688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:18:58,348][1054527] Avg episode reward: [(0, '4086.973')] [2023-03-10 18:19:00,839][1054815] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-10 18:19:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 49623040. Throughput: 0: 8193.4. Samples: 49610824. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:03,348][1054527] Avg episode reward: [(0, '3859.572')] [2023-03-10 18:19:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096920_49623040.pth... [2023-03-10 18:19:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096432_49373184.pth [2023-03-10 18:19:05,799][1054815] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-10 18:19:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 49664000. Throughput: 0: 8216.5. Samples: 49661080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:08,348][1054527] Avg episode reward: [(0, '3706.431')] [2023-03-10 18:19:10,696][1054815] Updated weights for policy 0, policy_version 97040 (0.0005) [2023-03-10 18:19:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8344.7). Total num frames: 49704960. Throughput: 0: 8210.3. Samples: 49685272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:13,348][1054527] Avg episode reward: [(0, '3986.354')] [2023-03-10 18:19:15,657][1054815] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-10 18:19:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.2, 300 sec: 8344.7). Total num frames: 49745920. Throughput: 0: 8244.5. Samples: 49735840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:18,349][1054527] Avg episode reward: [(0, '3637.058')] [2023-03-10 18:19:18,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097160_49745920.pth... [2023-03-10 18:19:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096672_49496064.pth [2023-03-10 18:19:20,408][1054815] Updated weights for policy 0, policy_version 97200 (0.0004) [2023-03-10 18:19:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 49790976. Throughput: 0: 8387.9. Samples: 49787592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:23,348][1054527] Avg episode reward: [(0, '3895.134')] [2023-03-10 18:19:25,166][1054815] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-10 18:19:28,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 49831936. Throughput: 0: 8391.2. Samples: 49812212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:28,348][1054527] Avg episode reward: [(0, '4265.023')] [2023-03-10 18:19:30,275][1054815] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-10 18:19:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 49872896. Throughput: 0: 8370.7. Samples: 49860680. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:33,349][1054527] Avg episode reward: [(0, '4122.755')] [2023-03-10 18:19:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097408_49872896.pth... [2023-03-10 18:19:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000096920_49623040.pth [2023-03-10 18:19:35,377][1054815] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-10 18:19:38,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 49913856. Throughput: 0: 8376.1. Samples: 49911068. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:38,348][1054527] Avg episode reward: [(0, '4166.914')] [2023-03-10 18:19:40,024][1054815] Updated weights for policy 0, policy_version 97520 (0.0006) [2023-03-10 18:19:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 49954816. Throughput: 0: 8414.4. Samples: 49938336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:19:43,348][1054527] Avg episode reward: [(0, '4162.842')] [2023-03-10 18:19:44,804][1054815] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-10 18:19:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 49999872. Throughput: 0: 8375.9. Samples: 49987740. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:19:48,348][1054527] Avg episode reward: [(0, '3663.561')] [2023-03-10 18:19:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097656_49999872.pth... [2023-03-10 18:19:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097160_49745920.pth [2023-03-10 18:19:49,538][1054815] Updated weights for policy 0, policy_version 97680 (0.0006) [2023-03-10 18:19:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.0, 300 sec: 8372.5). Total num frames: 50044928. Throughput: 0: 8439.3. Samples: 50040848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:19:53,348][1054527] Avg episode reward: [(0, '3790.873')] [2023-03-10 18:19:54,261][1054815] Updated weights for policy 0, policy_version 97760 (0.0006) [2023-03-10 18:19:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8358.6). Total num frames: 50085888. Throughput: 0: 8472.3. Samples: 50066528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:19:58,348][1054527] Avg episode reward: [(0, '3961.403')] [2023-03-10 18:19:59,091][1054815] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-10 18:20:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 50126848. Throughput: 0: 8501.3. Samples: 50118396. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:03,348][1054527] Avg episode reward: [(0, '4219.028')] [2023-03-10 18:20:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097904_50126848.pth... [2023-03-10 18:20:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097408_49872896.pth [2023-03-10 18:20:03,877][1054815] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-10 18:20:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 50171904. Throughput: 0: 8449.5. Samples: 50167820. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:08,348][1054527] Avg episode reward: [(0, '4541.592')] [2023-03-10 18:20:08,724][1054815] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-10 18:20:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 50208768. Throughput: 0: 8449.9. Samples: 50192456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:13,348][1054527] Avg episode reward: [(0, '4142.221')] [2023-03-10 18:20:13,861][1054815] Updated weights for policy 0, policy_version 98080 (0.0004) [2023-03-10 18:20:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8358.6). Total num frames: 50253824. Throughput: 0: 8463.5. Samples: 50241536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:18,348][1054527] Avg episode reward: [(0, '4166.970')] [2023-03-10 18:20:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098152_50253824.pth... [2023-03-10 18:20:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097656_49999872.pth [2023-03-10 18:20:18,781][1054815] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-10 18:20:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 50294784. Throughput: 0: 8440.1. Samples: 50290872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:23,349][1054527] Avg episode reward: [(0, '4092.126')] [2023-03-10 18:20:23,795][1054815] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-10 18:20:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8344.7). Total num frames: 50335744. Throughput: 0: 8424.3. Samples: 50317428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:28,348][1054527] Avg episode reward: [(0, '4360.601')] [2023-03-10 18:20:28,457][1054815] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-10 18:20:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 50376704. Throughput: 0: 8457.8. Samples: 50368340. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:33,348][1054527] Avg episode reward: [(0, '4223.241')] [2023-03-10 18:20:33,381][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098400_50380800.pth... [2023-03-10 18:20:33,382][1054815] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-10 18:20:33,383][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000097904_50126848.pth [2023-03-10 18:20:38,185][1054815] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-10 18:20:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 50421760. Throughput: 0: 8388.8. Samples: 50418344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:38,348][1054527] Avg episode reward: [(0, '4445.143')] [2023-03-10 18:20:42,929][1054815] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-10 18:20:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 50462720. Throughput: 0: 8395.4. Samples: 50444320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:20:43,348][1054527] Avg episode reward: [(0, '3787.827')] [2023-03-10 18:20:47,738][1054815] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-10 18:20:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 50507776. Throughput: 0: 8379.2. Samples: 50495460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:20:48,348][1054527] Avg episode reward: [(0, '4075.320')] [2023-03-10 18:20:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098648_50507776.pth... [2023-03-10 18:20:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098152_50253824.pth [2023-03-10 18:20:53,022][1054815] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-10 18:20:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 50544640. Throughput: 0: 8352.4. Samples: 50543676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:20:53,349][1054527] Avg episode reward: [(0, '4169.644')] [2023-03-10 18:20:57,872][1054815] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-10 18:20:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 50589696. Throughput: 0: 8367.8. Samples: 50569008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:20:58,348][1054527] Avg episode reward: [(0, '4484.537')] [2023-03-10 18:21:02,628][1054815] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-10 18:21:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 50630656. Throughput: 0: 8401.1. Samples: 50619584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:03,348][1054527] Avg episode reward: [(0, '4188.604')] [2023-03-10 18:21:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098888_50630656.pth... [2023-03-10 18:21:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098400_50380800.pth [2023-03-10 18:21:07,514][1054815] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-10 18:21:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.6, 300 sec: 8358.6). Total num frames: 50671616. Throughput: 0: 8438.1. Samples: 50670584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:08,348][1054527] Avg episode reward: [(0, '4035.903')] [2023-03-10 18:21:12,425][1054815] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-10 18:21:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 50716672. Throughput: 0: 8413.6. Samples: 50696040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:13,348][1054527] Avg episode reward: [(0, '4234.003')] [2023-03-10 18:21:17,117][1054815] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-10 18:21:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 50757632. Throughput: 0: 8424.3. Samples: 50747436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:18,348][1054527] Avg episode reward: [(0, '4398.919')] [2023-03-10 18:21:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099136_50757632.pth... [2023-03-10 18:21:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098648_50507776.pth [2023-03-10 18:21:22,323][1054815] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-10 18:21:23,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 50794496. Throughput: 0: 8358.9. Samples: 50794496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:23,348][1054527] Avg episode reward: [(0, '4561.131')] [2023-03-10 18:21:27,369][1054815] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-10 18:21:28,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 50835456. Throughput: 0: 8329.3. Samples: 50819136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:28,348][1054527] Avg episode reward: [(0, '3782.738')] [2023-03-10 18:21:32,353][1054815] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-10 18:21:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 50880512. Throughput: 0: 8282.2. Samples: 50868160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:33,348][1054527] Avg episode reward: [(0, '3681.955')] [2023-03-10 18:21:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099376_50880512.pth... [2023-03-10 18:21:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000098888_50630656.pth [2023-03-10 18:21:37,127][1054815] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-10 18:21:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 50921472. Throughput: 0: 8335.6. Samples: 50918776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:38,348][1054527] Avg episode reward: [(0, '3889.189')] [2023-03-10 18:21:42,279][1054815] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-10 18:21:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 50962432. Throughput: 0: 8301.2. Samples: 50942564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:43,348][1054527] Avg episode reward: [(0, '3972.233')] [2023-03-10 18:21:47,276][1054815] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-10 18:21:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 51003392. Throughput: 0: 8257.6. Samples: 50991176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:48,348][1054527] Avg episode reward: [(0, '4193.080')] [2023-03-10 18:21:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099616_51003392.pth... [2023-03-10 18:21:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099136_50757632.pth [2023-03-10 18:21:52,279][1054815] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-10 18:21:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 51044352. Throughput: 0: 8241.2. Samples: 51041440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:53,348][1054527] Avg episode reward: [(0, '4306.988')] [2023-03-10 18:21:56,981][1054815] Updated weights for policy 0, policy_version 99760 (0.0005) [2023-03-10 18:21:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 51089408. Throughput: 0: 8261.6. Samples: 51067812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:21:58,348][1054527] Avg episode reward: [(0, '4528.502')] [2023-03-10 18:22:01,644][1054815] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-10 18:22:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 51130368. Throughput: 0: 8268.5. Samples: 51119516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:03,348][1054527] Avg episode reward: [(0, '4131.279')] [2023-03-10 18:22:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099864_51130368.pth... [2023-03-10 18:22:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099376_50880512.pth [2023-03-10 18:22:06,474][1054815] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-10 18:22:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 51171328. Throughput: 0: 8328.6. Samples: 51169284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:08,348][1054527] Avg episode reward: [(0, '4392.494')] [2023-03-10 18:22:11,454][1054815] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-10 18:22:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 51212288. Throughput: 0: 8364.1. Samples: 51195520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:13,348][1054527] Avg episode reward: [(0, '4328.873')] [2023-03-10 18:22:16,482][1054815] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-10 18:22:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 51253248. Throughput: 0: 8351.9. Samples: 51243996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:18,349][1054527] Avg episode reward: [(0, '4307.817')] [2023-03-10 18:22:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100104_51253248.pth... [2023-03-10 18:22:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099616_51003392.pth [2023-03-10 18:22:21,560][1054815] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-10 18:22:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8330.8). Total num frames: 51294208. Throughput: 0: 8327.0. Samples: 51293492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:23,348][1054527] Avg episode reward: [(0, '4051.933')] [2023-03-10 18:22:26,406][1054815] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-10 18:22:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8330.8). Total num frames: 51335168. Throughput: 0: 8356.0. Samples: 51318584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:28,348][1054527] Avg episode reward: [(0, '4178.290')] [2023-03-10 18:22:31,660][1054815] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-10 18:22:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8317.0). Total num frames: 51376128. Throughput: 0: 8308.9. Samples: 51365076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:33,349][1054527] Avg episode reward: [(0, '3989.720')] [2023-03-10 18:22:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100344_51376128.pth... [2023-03-10 18:22:33,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000099864_51130368.pth [2023-03-10 18:22:37,054][1054815] Updated weights for policy 0, policy_version 100400 (0.0004) [2023-03-10 18:22:38,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8303.1). Total num frames: 51412992. Throughput: 0: 8202.1. Samples: 51410536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:38,348][1054527] Avg episode reward: [(0, '4083.471')] [2023-03-10 18:22:42,111][1054815] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-10 18:22:43,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8192.0, 300 sec: 8303.1). Total num frames: 51453952. Throughput: 0: 8172.5. Samples: 51435576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:43,348][1054527] Avg episode reward: [(0, '4086.702')] [2023-03-10 18:22:47,031][1054815] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-10 18:22:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8303.1). Total num frames: 51494912. Throughput: 0: 8138.5. Samples: 51485748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:48,348][1054527] Avg episode reward: [(0, '4337.928')] [2023-03-10 18:22:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100576_51494912.pth... [2023-03-10 18:22:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100104_51253248.pth [2023-03-10 18:22:52,146][1054815] Updated weights for policy 0, policy_version 100640 (0.0004) [2023-03-10 18:22:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8192.0, 300 sec: 8303.1). Total num frames: 51535872. Throughput: 0: 8082.1. Samples: 51532980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:53,349][1054527] Avg episode reward: [(0, '4129.279')] [2023-03-10 18:22:57,083][1054815] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-10 18:22:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 51576832. Throughput: 0: 8072.9. Samples: 51558800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:22:58,348][1054527] Avg episode reward: [(0, '4048.893')] [2023-03-10 18:23:01,976][1054815] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-10 18:23:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8289.2). Total num frames: 51617792. Throughput: 0: 8110.8. Samples: 51608980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:03,349][1054527] Avg episode reward: [(0, '4170.019')] [2023-03-10 18:23:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100816_51617792.pth... [2023-03-10 18:23:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100344_51376128.pth [2023-03-10 18:23:06,986][1054815] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-10 18:23:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8289.2). Total num frames: 51658752. Throughput: 0: 8092.4. Samples: 51657652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:08,349][1054527] Avg episode reward: [(0, '4483.189')] [2023-03-10 18:23:12,175][1054815] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-10 18:23:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 51699712. Throughput: 0: 8046.8. Samples: 51680688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:13,348][1054527] Avg episode reward: [(0, '4649.536')] [2023-03-10 18:23:17,204][1054815] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-10 18:23:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8289.2). Total num frames: 51740672. Throughput: 0: 8085.8. Samples: 51728936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:18,348][1054527] Avg episode reward: [(0, '4576.161')] [2023-03-10 18:23:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101056_51740672.pth... [2023-03-10 18:23:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100576_51494912.pth [2023-03-10 18:23:22,403][1054815] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-10 18:23:23,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8055.5, 300 sec: 8289.2). Total num frames: 51777536. Throughput: 0: 8151.5. Samples: 51777352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:23,348][1054527] Avg episode reward: [(0, '4177.022')] [2023-03-10 18:23:27,360][1054815] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-10 18:23:28,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8055.5, 300 sec: 8289.2). Total num frames: 51818496. Throughput: 0: 8141.9. Samples: 51801960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:28,348][1054527] Avg episode reward: [(0, '4474.320')] [2023-03-10 18:23:32,364][1054815] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-10 18:23:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8055.5, 300 sec: 8289.2). Total num frames: 51859456. Throughput: 0: 8113.5. Samples: 51850856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:33,348][1054527] Avg episode reward: [(0, '4523.378')] [2023-03-10 18:23:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101288_51859456.pth... [2023-03-10 18:23:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000100816_51617792.pth [2023-03-10 18:23:37,365][1054815] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-10 18:23:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 51900416. Throughput: 0: 8162.9. Samples: 51900308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:38,348][1054527] Avg episode reward: [(0, '4321.741')] [2023-03-10 18:23:42,662][1054815] Updated weights for policy 0, policy_version 101440 (0.0004) [2023-03-10 18:23:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8289.2). Total num frames: 51941376. Throughput: 0: 8096.5. Samples: 51923144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:43,348][1054527] Avg episode reward: [(0, '4485.911')] [2023-03-10 18:23:47,937][1054815] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-10 18:23:48,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8055.5, 300 sec: 8275.3). Total num frames: 51978240. Throughput: 0: 8015.6. Samples: 51969680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:48,348][1054527] Avg episode reward: [(0, '4655.915')] [2023-03-10 18:23:48,379][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101528_51982336.pth... [2023-03-10 18:23:48,381][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101056_51740672.pth [2023-03-10 18:23:52,674][1054815] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-10 18:23:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8289.2). Total num frames: 52023296. Throughput: 0: 8055.7. Samples: 52020160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:53,348][1054527] Avg episode reward: [(0, '4516.535')] [2023-03-10 18:23:57,527][1054815] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-10 18:23:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8123.7, 300 sec: 8275.3). Total num frames: 52064256. Throughput: 0: 8099.4. Samples: 52045160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:23:58,349][1054527] Avg episode reward: [(0, '4595.416')] [2023-03-10 18:24:02,420][1054815] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-10 18:24:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.8, 300 sec: 8275.3). Total num frames: 52105216. Throughput: 0: 8163.3. Samples: 52096284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:03,348][1054527] Avg episode reward: [(0, '4363.236')] [2023-03-10 18:24:03,379][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101776_52109312.pth... [2023-03-10 18:24:03,381][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101288_51859456.pth [2023-03-10 18:24:07,408][1054815] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-10 18:24:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.7, 300 sec: 8275.3). Total num frames: 52146176. Throughput: 0: 8192.8. Samples: 52146028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:08,348][1054527] Avg episode reward: [(0, '4263.723')] [2023-03-10 18:24:12,669][1054815] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-10 18:24:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8275.3). Total num frames: 52187136. Throughput: 0: 8161.0. Samples: 52169204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:13,348][1054527] Avg episode reward: [(0, '3948.800')] [2023-03-10 18:24:17,366][1054815] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-10 18:24:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8192.0, 300 sec: 8275.3). Total num frames: 52232192. Throughput: 0: 8200.5. Samples: 52219880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:18,348][1054527] Avg episode reward: [(0, '4430.006')] [2023-03-10 18:24:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102016_52232192.pth... [2023-03-10 18:24:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101528_51982336.pth [2023-03-10 18:24:22,144][1054815] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-10 18:24:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8275.3). Total num frames: 52273152. Throughput: 0: 8231.5. Samples: 52270728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:23,348][1054527] Avg episode reward: [(0, '4332.094')] [2023-03-10 18:24:27,192][1054815] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-10 18:24:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8275.3). Total num frames: 52314112. Throughput: 0: 8253.7. Samples: 52294560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:28,348][1054527] Avg episode reward: [(0, '4491.708')] [2023-03-10 18:24:31,953][1054815] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-10 18:24:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8275.3). Total num frames: 52355072. Throughput: 0: 8362.1. Samples: 52345976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:33,348][1054527] Avg episode reward: [(0, '4294.507')] [2023-03-10 18:24:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102256_52355072.pth... [2023-03-10 18:24:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000101776_52109312.pth [2023-03-10 18:24:36,444][1054815] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-10 18:24:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8289.2). Total num frames: 52400128. Throughput: 0: 8439.2. Samples: 52399924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:38,348][1054527] Avg episode reward: [(0, '4234.762')] [2023-03-10 18:24:41,402][1054815] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-10 18:24:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8275.3). Total num frames: 52441088. Throughput: 0: 8428.9. Samples: 52424460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:24:43,348][1054527] Avg episode reward: [(0, '4536.369')] [2023-03-10 18:24:46,506][1054815] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-10 18:24:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 52482048. Throughput: 0: 8360.0. Samples: 52472484. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:24:48,348][1054527] Avg episode reward: [(0, '4485.074')] [2023-03-10 18:24:48,380][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102512_52486144.pth... [2023-03-10 18:24:48,382][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102016_52232192.pth [2023-03-10 18:24:51,095][1054815] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-10 18:24:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 52527104. Throughput: 0: 8429.8. Samples: 52525368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:24:53,349][1054527] Avg episode reward: [(0, '3629.333')] [2023-03-10 18:24:56,059][1054815] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-10 18:24:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 52568064. Throughput: 0: 8472.9. Samples: 52550484. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:24:58,349][1054527] Avg episode reward: [(0, '3806.866')] [2023-03-10 18:25:01,027][1054815] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-10 18:25:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 52609024. Throughput: 0: 8443.2. Samples: 52599824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:03,348][1054527] Avg episode reward: [(0, '4183.085')] [2023-03-10 18:25:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102752_52609024.pth... [2023-03-10 18:25:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102256_52355072.pth [2023-03-10 18:25:06,002][1054815] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-10 18:25:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 52649984. Throughput: 0: 8420.0. Samples: 52649628. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:08,348][1054527] Avg episode reward: [(0, '3894.495')] [2023-03-10 18:25:11,066][1054815] Updated weights for policy 0, policy_version 102880 (0.0006) [2023-03-10 18:25:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 52690944. Throughput: 0: 8416.5. Samples: 52673300. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:13,348][1054527] Avg episode reward: [(0, '4120.975')] [2023-03-10 18:25:16,143][1054815] Updated weights for policy 0, policy_version 102960 (0.0006) [2023-03-10 18:25:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8261.4). Total num frames: 52731904. Throughput: 0: 8343.9. Samples: 52721452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:18,348][1054527] Avg episode reward: [(0, '4187.573')] [2023-03-10 18:25:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102992_52731904.pth... [2023-03-10 18:25:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102512_52486144.pth [2023-03-10 18:25:20,985][1054815] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-10 18:25:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8261.4). Total num frames: 52772864. Throughput: 0: 8243.7. Samples: 52770892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:23,348][1054527] Avg episode reward: [(0, '4488.640')] [2023-03-10 18:25:25,796][1054815] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-10 18:25:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 52817920. Throughput: 0: 8289.8. Samples: 52797504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:28,348][1054527] Avg episode reward: [(0, '4053.182')] [2023-03-10 18:25:30,697][1054815] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-10 18:25:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 52858880. Throughput: 0: 8320.6. Samples: 52846912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:33,348][1054527] Avg episode reward: [(0, '4253.791')] [2023-03-10 18:25:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103240_52858880.pth... [2023-03-10 18:25:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102752_52609024.pth [2023-03-10 18:25:35,767][1054815] Updated weights for policy 0, policy_version 103280 (0.0004) [2023-03-10 18:25:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8261.4). Total num frames: 52899840. Throughput: 0: 8242.1. Samples: 52896264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:38,348][1054527] Avg episode reward: [(0, '4261.427')] [2023-03-10 18:25:40,732][1054815] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-10 18:25:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8247.5). Total num frames: 52940800. Throughput: 0: 8227.7. Samples: 52920732. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:25:43,348][1054527] Avg episode reward: [(0, '4222.742')] [2023-03-10 18:25:45,697][1054815] Updated weights for policy 0, policy_version 103440 (0.0004) [2023-03-10 18:25:48,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8260.3, 300 sec: 8247.5). Total num frames: 52977664. Throughput: 0: 8219.0. Samples: 52969680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:25:48,348][1054527] Avg episode reward: [(0, '3833.076')] [2023-03-10 18:25:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103472_52977664.pth... [2023-03-10 18:25:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000102992_52731904.pth [2023-03-10 18:25:50,974][1054815] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-10 18:25:53,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53018624. Throughput: 0: 8199.5. Samples: 53018608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:25:53,348][1054527] Avg episode reward: [(0, '4327.032')] [2023-03-10 18:25:55,982][1054815] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-10 18:25:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53059584. Throughput: 0: 8211.4. Samples: 53042812. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:25:58,348][1054527] Avg episode reward: [(0, '4132.178')] [2023-03-10 18:26:01,222][1054815] Updated weights for policy 0, policy_version 103680 (0.0006) [2023-03-10 18:26:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53100544. Throughput: 0: 8178.5. Samples: 53089484. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:03,348][1054527] Avg episode reward: [(0, '3571.369')] [2023-03-10 18:26:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103712_53100544.pth... [2023-03-10 18:26:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103240_52858880.pth [2023-03-10 18:26:06,163][1054815] Updated weights for policy 0, policy_version 103760 (0.0006) [2023-03-10 18:26:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8219.8). Total num frames: 53141504. Throughput: 0: 8155.6. Samples: 53137892. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:08,348][1054527] Avg episode reward: [(0, '3921.130')] [2023-03-10 18:26:11,184][1054815] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-10 18:26:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8219.8). Total num frames: 53182464. Throughput: 0: 8117.6. Samples: 53162796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:13,348][1054527] Avg episode reward: [(0, '4177.664')] [2023-03-10 18:26:15,668][1054815] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-10 18:26:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8260.3, 300 sec: 8247.5). Total num frames: 53227520. Throughput: 0: 8203.0. Samples: 53216048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:18,348][1054527] Avg episode reward: [(0, '4240.166')] [2023-03-10 18:26:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103960_53227520.pth... [2023-03-10 18:26:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103472_52977664.pth [2023-03-10 18:26:20,477][1054815] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-10 18:26:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8260.3, 300 sec: 8247.5). Total num frames: 53268480. Throughput: 0: 8271.4. Samples: 53268476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:23,348][1054527] Avg episode reward: [(0, '4182.475')] [2023-03-10 18:26:25,419][1054815] Updated weights for policy 0, policy_version 104080 (0.0006) [2023-03-10 18:26:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53309440. Throughput: 0: 8264.9. Samples: 53292652. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:28,349][1054527] Avg episode reward: [(0, '4111.011')] [2023-03-10 18:26:30,337][1054815] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-10 18:26:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53350400. Throughput: 0: 8277.9. Samples: 53342184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:33,348][1054527] Avg episode reward: [(0, '3919.811')] [2023-03-10 18:26:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104200_53350400.pth... [2023-03-10 18:26:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103712_53100544.pth [2023-03-10 18:26:35,377][1054815] Updated weights for policy 0, policy_version 104240 (0.0006) [2023-03-10 18:26:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53391360. Throughput: 0: 8281.7. Samples: 53391284. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:38,348][1054527] Avg episode reward: [(0, '4076.519')] [2023-03-10 18:26:40,295][1054815] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-10 18:26:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8233.7). Total num frames: 53432320. Throughput: 0: 8293.1. Samples: 53416000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:43,348][1054527] Avg episode reward: [(0, '4457.339')] [2023-03-10 18:26:45,507][1054815] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-10 18:26:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8233.7). Total num frames: 53473280. Throughput: 0: 8344.4. Samples: 53464984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:26:48,348][1054527] Avg episode reward: [(0, '4286.734')] [2023-03-10 18:26:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104440_53473280.pth... [2023-03-10 18:26:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000103960_53227520.pth [2023-03-10 18:26:50,357][1054815] Updated weights for policy 0, policy_version 104480 (0.0006) [2023-03-10 18:26:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 53518336. Throughput: 0: 8374.6. Samples: 53514748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:26:53,348][1054527] Avg episode reward: [(0, '4161.894')] [2023-03-10 18:26:55,121][1054815] Updated weights for policy 0, policy_version 104560 (0.0006) [2023-03-10 18:26:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 53559296. Throughput: 0: 8398.2. Samples: 53540712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:26:58,348][1054527] Avg episode reward: [(0, '4019.995')] [2023-03-10 18:27:00,016][1054815] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-10 18:27:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 53600256. Throughput: 0: 8319.0. Samples: 53590404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:03,348][1054527] Avg episode reward: [(0, '3837.465')] [2023-03-10 18:27:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104688_53600256.pth... [2023-03-10 18:27:03,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104200_53350400.pth [2023-03-10 18:27:04,878][1054815] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-10 18:27:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8247.5). Total num frames: 53645312. Throughput: 0: 8291.1. Samples: 53641576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:08,348][1054527] Avg episode reward: [(0, '3590.506')] [2023-03-10 18:27:09,705][1054815] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-10 18:27:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8247.5). Total num frames: 53686272. Throughput: 0: 8329.7. Samples: 53667488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:13,348][1054527] Avg episode reward: [(0, '3851.605')] [2023-03-10 18:27:14,460][1054815] Updated weights for policy 0, policy_version 104880 (0.0005) [2023-03-10 18:27:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 53731328. Throughput: 0: 8371.0. Samples: 53718880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:18,348][1054527] Avg episode reward: [(0, '3395.706')] [2023-03-10 18:27:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104944_53731328.pth... [2023-03-10 18:27:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104440_53473280.pth [2023-03-10 18:27:19,326][1054815] Updated weights for policy 0, policy_version 104960 (0.0006) [2023-03-10 18:27:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 53772288. Throughput: 0: 8423.0. Samples: 53770320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:23,349][1054527] Avg episode reward: [(0, '2838.181')] [2023-03-10 18:27:24,156][1054815] Updated weights for policy 0, policy_version 105040 (0.0004) [2023-03-10 18:27:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8261.4). Total num frames: 53813248. Throughput: 0: 8401.4. Samples: 53794064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:28,348][1054527] Avg episode reward: [(0, '2833.417')] [2023-03-10 18:27:28,999][1054815] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-10 18:27:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 53854208. Throughput: 0: 8465.8. Samples: 53845944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:33,348][1054527] Avg episode reward: [(0, '3396.050')] [2023-03-10 18:27:33,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105192_53858304.pth... [2023-03-10 18:27:33,364][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104688_53600256.pth [2023-03-10 18:27:33,813][1054815] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-10 18:27:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8289.2). Total num frames: 53899264. Throughput: 0: 8475.8. Samples: 53896160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:38,348][1054527] Avg episode reward: [(0, '3501.077')] [2023-03-10 18:27:38,636][1054815] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-10 18:27:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8289.2). Total num frames: 53940224. Throughput: 0: 8468.8. Samples: 53921808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:43,348][1054527] Avg episode reward: [(0, '3518.226')] [2023-03-10 18:27:43,506][1054815] Updated weights for policy 0, policy_version 105360 (0.0004) [2023-03-10 18:27:48,173][1054815] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-10 18:27:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8303.1). Total num frames: 53985280. Throughput: 0: 8512.5. Samples: 53973468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:48,348][1054527] Avg episode reward: [(0, '3472.567')] [2023-03-10 18:27:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105440_53985280.pth... [2023-03-10 18:27:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000104944_53731328.pth [2023-03-10 18:27:52,689][1054815] Updated weights for policy 0, policy_version 105520 (0.0004) [2023-03-10 18:27:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8317.0). Total num frames: 54030336. Throughput: 0: 8572.7. Samples: 54027348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:53,348][1054527] Avg episode reward: [(0, '3368.852')] [2023-03-10 18:27:57,543][1054815] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-10 18:27:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8317.0). Total num frames: 54071296. Throughput: 0: 8565.5. Samples: 54052936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:27:58,348][1054527] Avg episode reward: [(0, '3226.705')] [2023-03-10 18:28:02,508][1054815] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-10 18:28:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8317.0). Total num frames: 54112256. Throughput: 0: 8532.0. Samples: 54102820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:03,348][1054527] Avg episode reward: [(0, '3668.591')] [2023-03-10 18:28:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105688_54112256.pth... [2023-03-10 18:28:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105192_53858304.pth [2023-03-10 18:28:07,337][1054815] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-10 18:28:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8330.8). Total num frames: 54157312. Throughput: 0: 8509.2. Samples: 54153232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:08,349][1054527] Avg episode reward: [(0, '3850.536')] [2023-03-10 18:28:12,173][1054815] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-10 18:28:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8330.8). Total num frames: 54198272. Throughput: 0: 8531.6. Samples: 54177984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:13,348][1054527] Avg episode reward: [(0, '3380.904')] [2023-03-10 18:28:17,019][1054815] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-10 18:28:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 54239232. Throughput: 0: 8524.4. Samples: 54229540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:18,348][1054527] Avg episode reward: [(0, '3191.568')] [2023-03-10 18:28:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105936_54239232.pth... [2023-03-10 18:28:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105440_53985280.pth [2023-03-10 18:28:21,738][1054815] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-10 18:28:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 54284288. Throughput: 0: 8544.3. Samples: 54280656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:23,348][1054527] Avg episode reward: [(0, '3691.099')] [2023-03-10 18:28:26,717][1054815] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-10 18:28:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 54325248. Throughput: 0: 8531.1. Samples: 54305708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:28,349][1054527] Avg episode reward: [(0, '3819.817')] [2023-03-10 18:28:31,640][1054815] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-10 18:28:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 54366208. Throughput: 0: 8492.0. Samples: 54355608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:33,348][1054527] Avg episode reward: [(0, '3606.184')] [2023-03-10 18:28:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106184_54366208.pth... [2023-03-10 18:28:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105688_54112256.pth [2023-03-10 18:28:36,398][1054815] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-10 18:28:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8372.5). Total num frames: 54411264. Throughput: 0: 8441.9. Samples: 54407232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:38,348][1054527] Avg episode reward: [(0, '3664.367')] [2023-03-10 18:28:41,351][1054815] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-10 18:28:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 54448128. Throughput: 0: 8419.4. Samples: 54431808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:43,348][1054527] Avg episode reward: [(0, '3961.609')] [2023-03-10 18:28:46,167][1054815] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-10 18:28:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8372.5). Total num frames: 54493184. Throughput: 0: 8432.6. Samples: 54482288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:48,349][1054527] Avg episode reward: [(0, '4136.758')] [2023-03-10 18:28:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106432_54493184.pth... [2023-03-10 18:28:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000105936_54239232.pth [2023-03-10 18:28:51,098][1054815] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-10 18:28:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 54534144. Throughput: 0: 8419.3. Samples: 54532100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:53,349][1054527] Avg episode reward: [(0, '4252.440')] [2023-03-10 18:28:55,975][1054815] Updated weights for policy 0, policy_version 106560 (0.0006) [2023-03-10 18:28:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 54575104. Throughput: 0: 8432.9. Samples: 54557464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:28:58,348][1054527] Avg episode reward: [(0, '4333.519')] [2023-03-10 18:29:00,918][1054815] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-10 18:29:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8372.5). Total num frames: 54616064. Throughput: 0: 8402.7. Samples: 54607664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:03,348][1054527] Avg episode reward: [(0, '4384.819')] [2023-03-10 18:29:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106672_54616064.pth... [2023-03-10 18:29:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106184_54366208.pth [2023-03-10 18:29:06,254][1054815] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-10 18:29:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8372.5). Total num frames: 54657024. Throughput: 0: 8274.1. Samples: 54652992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:08,348][1054527] Avg episode reward: [(0, '4410.433')] [2023-03-10 18:29:11,311][1054815] Updated weights for policy 0, policy_version 106800 (0.0004) [2023-03-10 18:29:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 54697984. Throughput: 0: 8263.6. Samples: 54677568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:13,348][1054527] Avg episode reward: [(0, '4412.484')] [2023-03-10 18:29:16,244][1054815] Updated weights for policy 0, policy_version 106880 (0.0006) [2023-03-10 18:29:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 54738944. Throughput: 0: 8258.4. Samples: 54727236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:18,348][1054527] Avg episode reward: [(0, '4425.697')] [2023-03-10 18:29:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106912_54738944.pth... [2023-03-10 18:29:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106432_54493184.pth [2023-03-10 18:29:21,082][1054815] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-10 18:29:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8372.5). Total num frames: 54784000. Throughput: 0: 8280.3. Samples: 54779848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:23,349][1054527] Avg episode reward: [(0, '4248.693')] [2023-03-10 18:29:25,852][1054815] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-10 18:29:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.6, 300 sec: 8372.5). Total num frames: 54824960. Throughput: 0: 8281.6. Samples: 54804480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:28,348][1054527] Avg episode reward: [(0, '4560.772')] [2023-03-10 18:29:30,837][1054815] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-10 18:29:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 54865920. Throughput: 0: 8258.7. Samples: 54853928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:33,349][1054527] Avg episode reward: [(0, '4057.058')] [2023-03-10 18:29:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107160_54865920.pth... [2023-03-10 18:29:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106672_54616064.pth [2023-03-10 18:29:35,635][1054815] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-10 18:29:38,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 54906880. Throughput: 0: 8294.9. Samples: 54905372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:38,348][1054527] Avg episode reward: [(0, '4235.013')] [2023-03-10 18:29:40,427][1054815] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-10 18:29:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 54947840. Throughput: 0: 8305.3. Samples: 54931204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:43,348][1054527] Avg episode reward: [(0, '4537.382')] [2023-03-10 18:29:45,511][1054815] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-10 18:29:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 54988800. Throughput: 0: 8262.4. Samples: 54979472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:29:48,348][1054527] Avg episode reward: [(0, '4470.224')] [2023-03-10 18:29:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107400_54988800.pth... [2023-03-10 18:29:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000106912_54738944.pth [2023-03-10 18:29:50,403][1054815] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-10 18:29:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 55029760. Throughput: 0: 8344.2. Samples: 55028480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:29:53,348][1054527] Avg episode reward: [(0, '4276.497')] [2023-03-10 18:29:55,641][1054815] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-10 18:29:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 55070720. Throughput: 0: 8313.8. Samples: 55051688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:29:58,349][1054527] Avg episode reward: [(0, '4295.540')] [2023-03-10 18:30:00,441][1054815] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-10 18:30:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55115776. Throughput: 0: 8362.8. Samples: 55103560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:03,348][1054527] Avg episode reward: [(0, '4513.131')] [2023-03-10 18:30:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107648_55115776.pth... [2023-03-10 18:30:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107160_54865920.pth [2023-03-10 18:30:05,209][1054815] Updated weights for policy 0, policy_version 107680 (0.0006) [2023-03-10 18:30:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55156736. Throughput: 0: 8284.5. Samples: 55152652. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:08,348][1054527] Avg episode reward: [(0, '4555.629')] [2023-03-10 18:30:10,498][1054815] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-10 18:30:13,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 55193600. Throughput: 0: 8265.1. Samples: 55176408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:13,348][1054527] Avg episode reward: [(0, '4482.016')] [2023-03-10 18:30:15,458][1054815] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-10 18:30:18,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 55234560. Throughput: 0: 8263.3. Samples: 55225776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:18,348][1054527] Avg episode reward: [(0, '4426.732')] [2023-03-10 18:30:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107880_55234560.pth... [2023-03-10 18:30:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107400_54988800.pth [2023-03-10 18:30:20,709][1054815] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-10 18:30:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8192.0, 300 sec: 8330.8). Total num frames: 55275520. Throughput: 0: 8155.4. Samples: 55272364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:23,348][1054527] Avg episode reward: [(0, '4421.609')] [2023-03-10 18:30:25,792][1054815] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-10 18:30:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8330.8). Total num frames: 55316480. Throughput: 0: 8108.2. Samples: 55296072. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:28,348][1054527] Avg episode reward: [(0, '4438.240')] [2023-03-10 18:30:30,781][1054815] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-10 18:30:33,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8123.8, 300 sec: 8317.0). Total num frames: 55353344. Throughput: 0: 8126.2. Samples: 55345152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:33,348][1054527] Avg episode reward: [(0, '4333.534')] [2023-03-10 18:30:33,379][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108120_55357440.pth... [2023-03-10 18:30:33,381][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107648_55115776.pth [2023-03-10 18:30:35,810][1054815] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-10 18:30:38,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8123.7, 300 sec: 8317.0). Total num frames: 55394304. Throughput: 0: 8128.6. Samples: 55394268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:38,348][1054527] Avg episode reward: [(0, '4462.765')] [2023-03-10 18:30:40,807][1054815] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-10 18:30:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8192.0, 300 sec: 8344.7). Total num frames: 55439360. Throughput: 0: 8161.2. Samples: 55418944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:43,348][1054527] Avg episode reward: [(0, '4607.385')] [2023-03-10 18:30:45,548][1054815] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-10 18:30:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8192.0, 300 sec: 8344.7). Total num frames: 55480320. Throughput: 0: 8171.8. Samples: 55471292. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:30:48,348][1054527] Avg episode reward: [(0, '4654.975')] [2023-03-10 18:30:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108360_55480320.pth... [2023-03-10 18:30:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000107880_55234560.pth [2023-03-10 18:30:50,545][1054815] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-10 18:30:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8192.0, 300 sec: 8344.7). Total num frames: 55521280. Throughput: 0: 8184.2. Samples: 55520940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:30:53,348][1054527] Avg episode reward: [(0, '4593.972')] [2023-03-10 18:30:55,361][1054815] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-10 18:30:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8358.6). Total num frames: 55566336. Throughput: 0: 8221.7. Samples: 55546384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:30:58,349][1054527] Avg episode reward: [(0, '4456.574')] [2023-03-10 18:31:00,274][1054815] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-10 18:31:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 55607296. Throughput: 0: 8217.3. Samples: 55595556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:03,348][1054527] Avg episode reward: [(0, '4660.337')] [2023-03-10 18:31:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108608_55607296.pth... [2023-03-10 18:31:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108120_55357440.pth [2023-03-10 18:31:05,066][1054815] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-10 18:31:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8358.6). Total num frames: 55648256. Throughput: 0: 8328.8. Samples: 55647160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:08,348][1054527] Avg episode reward: [(0, '4592.969')] [2023-03-10 18:31:09,841][1054815] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-10 18:31:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55693312. Throughput: 0: 8393.6. Samples: 55673784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:13,348][1054527] Avg episode reward: [(0, '4482.951')] [2023-03-10 18:31:14,610][1054815] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-10 18:31:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55734272. Throughput: 0: 8426.3. Samples: 55724336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:18,348][1054527] Avg episode reward: [(0, '4437.683')] [2023-03-10 18:31:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108856_55734272.pth... [2023-03-10 18:31:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108360_55480320.pth [2023-03-10 18:31:19,660][1054815] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-10 18:31:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55775232. Throughput: 0: 8375.0. Samples: 55771144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:23,349][1054527] Avg episode reward: [(0, '4579.692')] [2023-03-10 18:31:24,728][1054815] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-10 18:31:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55816192. Throughput: 0: 8406.9. Samples: 55797256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:28,348][1054527] Avg episode reward: [(0, '4191.433')] [2023-03-10 18:31:29,601][1054815] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-10 18:31:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 55857152. Throughput: 0: 8359.2. Samples: 55847456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:33,348][1054527] Avg episode reward: [(0, '4586.985')] [2023-03-10 18:31:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109096_55857152.pth... [2023-03-10 18:31:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108608_55607296.pth [2023-03-10 18:31:34,460][1054815] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-10 18:31:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8358.6). Total num frames: 55898112. Throughput: 0: 8345.7. Samples: 55896496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:38,348][1054527] Avg episode reward: [(0, '4452.433')] [2023-03-10 18:31:39,548][1054815] Updated weights for policy 0, policy_version 109200 (0.0006) [2023-03-10 18:31:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8358.6). Total num frames: 55939072. Throughput: 0: 8358.8. Samples: 55922528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:43,348][1054527] Avg episode reward: [(0, '4486.132')] [2023-03-10 18:31:44,375][1054815] Updated weights for policy 0, policy_version 109280 (0.0006) [2023-03-10 18:31:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 55980032. Throughput: 0: 8339.3. Samples: 55970824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:31:48,348][1054527] Avg episode reward: [(0, '4447.190')] [2023-03-10 18:31:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109336_55980032.pth... [2023-03-10 18:31:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000108856_55734272.pth [2023-03-10 18:31:49,579][1054815] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-10 18:31:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8344.7). Total num frames: 56020992. Throughput: 0: 8246.7. Samples: 56018264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:31:53,348][1054527] Avg episode reward: [(0, '4371.898')] [2023-03-10 18:31:54,722][1054815] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-10 18:31:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8344.7). Total num frames: 56061952. Throughput: 0: 8177.3. Samples: 56041764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:31:58,348][1054527] Avg episode reward: [(0, '4005.892')] [2023-03-10 18:31:59,806][1054815] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-10 18:32:03,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8317.0). Total num frames: 56098816. Throughput: 0: 8141.1. Samples: 56090688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:03,348][1054527] Avg episode reward: [(0, '3404.477')] [2023-03-10 18:32:03,360][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109576_56102912.pth... [2023-03-10 18:32:03,362][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109096_55857152.pth [2023-03-10 18:32:04,865][1054815] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-10 18:32:08,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8317.0). Total num frames: 56139776. Throughput: 0: 8149.8. Samples: 56137884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:08,348][1054527] Avg episode reward: [(0, '4093.117')] [2023-03-10 18:32:10,017][1054815] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-10 18:32:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 56180736. Throughput: 0: 8141.0. Samples: 56163600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:13,348][1054527] Avg episode reward: [(0, '4255.181')] [2023-03-10 18:32:15,074][1054815] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-10 18:32:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 56221696. Throughput: 0: 8100.4. Samples: 56211976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:18,348][1054527] Avg episode reward: [(0, '3093.241')] [2023-03-10 18:32:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109808_56221696.pth... [2023-03-10 18:32:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109336_55980032.pth [2023-03-10 18:32:20,072][1054815] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-10 18:32:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8303.1). Total num frames: 56262656. Throughput: 0: 8049.1. Samples: 56258704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:23,348][1054527] Avg episode reward: [(0, '3433.635')] [2023-03-10 18:32:25,395][1054815] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-10 18:32:28,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8055.5, 300 sec: 8289.2). Total num frames: 56299520. Throughput: 0: 8008.3. Samples: 56282904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:28,348][1054527] Avg episode reward: [(0, '4410.438')] [2023-03-10 18:32:30,523][1054815] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-10 18:32:33,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8055.5, 300 sec: 8275.3). Total num frames: 56340480. Throughput: 0: 8012.5. Samples: 56331388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:33,348][1054527] Avg episode reward: [(0, '4429.775')] [2023-03-10 18:32:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110040_56340480.pth... [2023-03-10 18:32:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109576_56102912.pth [2023-03-10 18:32:35,176][1054815] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-10 18:32:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8192.0, 300 sec: 8303.1). Total num frames: 56389632. Throughput: 0: 8159.0. Samples: 56385420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:38,348][1054527] Avg episode reward: [(0, '4355.369')] [2023-03-10 18:32:39,955][1054815] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-10 18:32:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8123.7, 300 sec: 8275.3). Total num frames: 56426496. Throughput: 0: 8173.7. Samples: 56409580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:43,348][1054527] Avg episode reward: [(0, '4446.473')] [2023-03-10 18:32:45,092][1054815] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-10 18:32:48,348][1054527] Fps is (10 sec: 7782.3, 60 sec: 8123.7, 300 sec: 8261.4). Total num frames: 56467456. Throughput: 0: 8135.4. Samples: 56456780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:48,348][1054527] Avg episode reward: [(0, '4368.447')] [2023-03-10 18:32:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110288_56467456.pth... [2023-03-10 18:32:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000109808_56221696.pth [2023-03-10 18:32:50,321][1054815] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-10 18:32:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8261.4). Total num frames: 56508416. Throughput: 0: 8152.7. Samples: 56504756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:53,348][1054527] Avg episode reward: [(0, '4348.462')] [2023-03-10 18:32:55,331][1054815] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-10 18:32:58,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8055.5, 300 sec: 8247.5). Total num frames: 56545280. Throughput: 0: 8113.2. Samples: 56528696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:32:58,348][1054527] Avg episode reward: [(0, '4447.374')] [2023-03-10 18:33:00,402][1054815] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-10 18:33:03,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8123.7, 300 sec: 8233.7). Total num frames: 56586240. Throughput: 0: 8128.1. Samples: 56577740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:03,349][1054527] Avg episode reward: [(0, '4221.170')] [2023-03-10 18:33:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110520_56586240.pth... [2023-03-10 18:33:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110040_56340480.pth [2023-03-10 18:33:05,472][1054815] Updated weights for policy 0, policy_version 110560 (0.0006) [2023-03-10 18:33:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8233.7). Total num frames: 56627200. Throughput: 0: 8148.9. Samples: 56625404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:08,348][1054527] Avg episode reward: [(0, '4151.860')] [2023-03-10 18:33:10,518][1054815] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-10 18:33:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8123.7, 300 sec: 8233.7). Total num frames: 56668160. Throughput: 0: 8176.6. Samples: 56650852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:13,348][1054527] Avg episode reward: [(0, '4343.533')] [2023-03-10 18:33:15,546][1054815] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-10 18:33:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8123.7, 300 sec: 8219.8). Total num frames: 56709120. Throughput: 0: 8160.6. Samples: 56698616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:18,349][1054527] Avg episode reward: [(0, '4512.074')] [2023-03-10 18:33:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110760_56709120.pth... [2023-03-10 18:33:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110288_56467456.pth [2023-03-10 18:33:20,831][1054815] Updated weights for policy 0, policy_version 110800 (0.0004) [2023-03-10 18:33:23,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8055.5, 300 sec: 8205.9). Total num frames: 56745984. Throughput: 0: 7997.0. Samples: 56745284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:23,348][1054527] Avg episode reward: [(0, '4207.965')] [2023-03-10 18:33:26,055][1054815] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-10 18:33:28,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8123.7, 300 sec: 8205.9). Total num frames: 56786944. Throughput: 0: 7992.1. Samples: 56769224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:28,349][1054527] Avg episode reward: [(0, '4209.695')] [2023-03-10 18:33:31,281][1054815] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-10 18:33:33,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8055.5, 300 sec: 8178.1). Total num frames: 56823808. Throughput: 0: 7974.1. Samples: 56815616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:33,348][1054527] Avg episode reward: [(0, '4416.361')] [2023-03-10 18:33:33,362][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110992_56827904.pth... [2023-03-10 18:33:33,364][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110520_56586240.pth [2023-03-10 18:33:36,420][1054815] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-10 18:33:38,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 7918.9, 300 sec: 8192.0). Total num frames: 56864768. Throughput: 0: 7998.3. Samples: 56864680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:38,348][1054527] Avg episode reward: [(0, '4561.365')] [2023-03-10 18:33:41,154][1054815] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-10 18:33:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8055.5, 300 sec: 8192.0). Total num frames: 56909824. Throughput: 0: 8024.3. Samples: 56889788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:43,348][1054527] Avg episode reward: [(0, '4015.801')] [2023-03-10 18:33:46,037][1054815] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-10 18:33:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8055.5, 300 sec: 8192.0). Total num frames: 56950784. Throughput: 0: 8068.8. Samples: 56940836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:48,348][1054527] Avg episode reward: [(0, '4196.849')] [2023-03-10 18:33:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111232_56950784.pth... [2023-03-10 18:33:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110760_56709120.pth [2023-03-10 18:33:51,138][1054815] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-10 18:33:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8055.5, 300 sec: 8192.0). Total num frames: 56991744. Throughput: 0: 8092.6. Samples: 56989572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:33:53,348][1054527] Avg episode reward: [(0, '4633.698')] [2023-03-10 18:33:56,134][1054815] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-10 18:33:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8192.0). Total num frames: 57032704. Throughput: 0: 8071.8. Samples: 57014084. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:33:58,348][1054527] Avg episode reward: [(0, '4435.037')] [2023-03-10 18:34:01,128][1054815] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-10 18:34:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8192.0). Total num frames: 57073664. Throughput: 0: 8094.9. Samples: 57062888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:03,348][1054527] Avg episode reward: [(0, '4466.417')] [2023-03-10 18:34:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111472_57073664.pth... [2023-03-10 18:34:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000110992_56827904.pth [2023-03-10 18:34:06,074][1054815] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-10 18:34:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8123.7, 300 sec: 8192.0). Total num frames: 57114624. Throughput: 0: 8180.5. Samples: 57113408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:08,348][1054527] Avg episode reward: [(0, '4589.020')] [2023-03-10 18:34:10,733][1054815] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-10 18:34:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8192.0, 300 sec: 8205.9). Total num frames: 57159680. Throughput: 0: 8232.1. Samples: 57139668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:13,348][1054527] Avg episode reward: [(0, '4522.183')] [2023-03-10 18:34:15,590][1054815] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-10 18:34:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8192.0, 300 sec: 8192.0). Total num frames: 57200640. Throughput: 0: 8322.8. Samples: 57190144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:18,348][1054527] Avg episode reward: [(0, '4722.286')] [2023-03-10 18:34:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111720_57200640.pth... [2023-03-10 18:34:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111232_56950784.pth [2023-03-10 18:34:18,355][1054771] Saving new best policy, reward=4722.286! [2023-03-10 18:34:20,604][1054815] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-10 18:34:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8192.0). Total num frames: 57241600. Throughput: 0: 8358.4. Samples: 57240808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:23,348][1054527] Avg episode reward: [(0, '4609.397')] [2023-03-10 18:34:25,394][1054815] Updated weights for policy 0, policy_version 111840 (0.0006) [2023-03-10 18:34:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8205.9). Total num frames: 57286656. Throughput: 0: 8361.7. Samples: 57266064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:28,349][1054527] Avg episode reward: [(0, '4395.025')] [2023-03-10 18:34:30,205][1054815] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-10 18:34:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8205.9). Total num frames: 57327616. Throughput: 0: 8352.4. Samples: 57316696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:33,348][1054527] Avg episode reward: [(0, '4384.759')] [2023-03-10 18:34:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111968_57327616.pth... [2023-03-10 18:34:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111472_57073664.pth [2023-03-10 18:34:34,969][1054815] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-10 18:34:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8205.9). Total num frames: 57368576. Throughput: 0: 8417.4. Samples: 57368356. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:38,348][1054527] Avg episode reward: [(0, '4601.365')] [2023-03-10 18:34:40,062][1054815] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-10 18:34:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8205.9). Total num frames: 57409536. Throughput: 0: 8377.2. Samples: 57391056. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:43,348][1054527] Avg episode reward: [(0, '4520.732')] [2023-03-10 18:34:45,005][1054815] Updated weights for policy 0, policy_version 112160 (0.0004) [2023-03-10 18:34:48,348][1054527] Fps is (10 sec: 8191.8, 60 sec: 8328.5, 300 sec: 8205.9). Total num frames: 57450496. Throughput: 0: 8426.9. Samples: 57442100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:48,349][1054527] Avg episode reward: [(0, '3958.942')] [2023-03-10 18:34:48,391][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112216_57454592.pth... [2023-03-10 18:34:48,393][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111720_57200640.pth [2023-03-10 18:34:49,806][1054815] Updated weights for policy 0, policy_version 112240 (0.0004) [2023-03-10 18:34:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8219.8). Total num frames: 57495552. Throughput: 0: 8422.8. Samples: 57492436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 18:34:53,348][1054527] Avg episode reward: [(0, '4131.764')] [2023-03-10 18:34:54,563][1054815] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-10 18:34:58,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8396.8, 300 sec: 8205.9). Total num frames: 57536512. Throughput: 0: 8415.2. Samples: 57518352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:34:58,348][1054527] Avg episode reward: [(0, '4531.909')] [2023-03-10 18:34:59,439][1054815] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-10 18:35:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8205.9). Total num frames: 57577472. Throughput: 0: 8384.9. Samples: 57567464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:03,348][1054527] Avg episode reward: [(0, '4545.532')] [2023-03-10 18:35:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112456_57577472.pth... [2023-03-10 18:35:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000111968_57327616.pth [2023-03-10 18:35:04,625][1054815] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-10 18:35:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8219.8). Total num frames: 57618432. Throughput: 0: 8367.5. Samples: 57617344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:08,348][1054527] Avg episode reward: [(0, '4493.438')] [2023-03-10 18:35:09,462][1054815] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-10 18:35:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8219.8). Total num frames: 57659392. Throughput: 0: 8372.5. Samples: 57642824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:13,348][1054527] Avg episode reward: [(0, '4411.604')] [2023-03-10 18:35:14,516][1054815] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-10 18:35:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8219.8). Total num frames: 57700352. Throughput: 0: 8316.1. Samples: 57690920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:18,348][1054527] Avg episode reward: [(0, '4362.031')] [2023-03-10 18:35:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112696_57700352.pth... [2023-03-10 18:35:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112216_57454592.pth [2023-03-10 18:35:19,458][1054815] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-10 18:35:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8219.8). Total num frames: 57741312. Throughput: 0: 8269.4. Samples: 57740480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:23,348][1054527] Avg episode reward: [(0, '4219.966')] [2023-03-10 18:35:24,480][1054815] Updated weights for policy 0, policy_version 112800 (0.0005) [2023-03-10 18:35:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8233.7). Total num frames: 57782272. Throughput: 0: 8325.9. Samples: 57765720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:28,348][1054527] Avg episode reward: [(0, '3938.637')] [2023-03-10 18:35:29,425][1054815] Updated weights for policy 0, policy_version 112880 (0.0005) [2023-03-10 18:35:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8233.7). Total num frames: 57823232. Throughput: 0: 8284.6. Samples: 57814904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:33,348][1054527] Avg episode reward: [(0, '4140.716')] [2023-03-10 18:35:33,405][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112944_57827328.pth... [2023-03-10 18:35:33,407][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112456_57577472.pth [2023-03-10 18:35:34,320][1054815] Updated weights for policy 0, policy_version 112960 (0.0006) [2023-03-10 18:35:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 57868288. Throughput: 0: 8292.2. Samples: 57865584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:38,348][1054527] Avg episode reward: [(0, '4653.108')] [2023-03-10 18:35:39,172][1054815] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-10 18:35:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8219.8). Total num frames: 57905152. Throughput: 0: 8232.9. Samples: 57888832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:43,348][1054527] Avg episode reward: [(0, '4443.571')] [2023-03-10 18:35:44,401][1054815] Updated weights for policy 0, policy_version 113120 (0.0004) [2023-03-10 18:35:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.6, 300 sec: 8233.7). Total num frames: 57950208. Throughput: 0: 8271.3. Samples: 57939672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:48,348][1054527] Avg episode reward: [(0, '3406.802')] [2023-03-10 18:35:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113184_57950208.pth... [2023-03-10 18:35:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112696_57700352.pth [2023-03-10 18:35:49,014][1054815] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-10 18:35:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 57995264. Throughput: 0: 8307.2. Samples: 57991168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:35:53,348][1054527] Avg episode reward: [(0, '3815.568')] [2023-03-10 18:35:53,813][1054815] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-10 18:35:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8233.7). Total num frames: 58036224. Throughput: 0: 8341.4. Samples: 58018188. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:35:58,348][1054527] Avg episode reward: [(0, '4179.280')] [2023-03-10 18:35:58,462][1054815] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-10 18:36:03,138][1054815] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-10 18:36:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8247.5). Total num frames: 58081280. Throughput: 0: 8421.7. Samples: 58069896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:03,348][1054527] Avg episode reward: [(0, '4423.043')] [2023-03-10 18:36:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113440_58081280.pth... [2023-03-10 18:36:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000112944_57827328.pth [2023-03-10 18:36:07,921][1054815] Updated weights for policy 0, policy_version 113520 (0.0005) [2023-03-10 18:36:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8233.7). Total num frames: 58122240. Throughput: 0: 8480.8. Samples: 58122116. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:08,348][1054527] Avg episode reward: [(0, '3998.245')] [2023-03-10 18:36:12,636][1054815] Updated weights for policy 0, policy_version 113600 (0.0005) [2023-03-10 18:36:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8247.5). Total num frames: 58167296. Throughput: 0: 8469.1. Samples: 58146828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:13,348][1054527] Avg episode reward: [(0, '3868.525')] [2023-03-10 18:36:17,464][1054815] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-10 18:36:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8247.5). Total num frames: 58208256. Throughput: 0: 8556.8. Samples: 58199960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:18,348][1054527] Avg episode reward: [(0, '4246.460')] [2023-03-10 18:36:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113688_58208256.pth... [2023-03-10 18:36:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113184_57950208.pth [2023-03-10 18:36:22,343][1054815] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-10 18:36:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8261.4). Total num frames: 58253312. Throughput: 0: 8526.6. Samples: 58249280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:23,348][1054527] Avg episode reward: [(0, '4425.217')] [2023-03-10 18:36:27,354][1054815] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-10 18:36:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8247.5). Total num frames: 58290176. Throughput: 0: 8554.8. Samples: 58273800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:28,348][1054527] Avg episode reward: [(0, '4631.213')] [2023-03-10 18:36:32,289][1054815] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-10 18:36:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8261.4). Total num frames: 58335232. Throughput: 0: 8518.6. Samples: 58323008. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:33,348][1054527] Avg episode reward: [(0, '4438.228')] [2023-03-10 18:36:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113936_58335232.pth... [2023-03-10 18:36:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113440_58081280.pth [2023-03-10 18:36:36,811][1054815] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-10 18:36:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8275.3). Total num frames: 58380288. Throughput: 0: 8604.4. Samples: 58378364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:38,348][1054527] Avg episode reward: [(0, '4480.934')] [2023-03-10 18:36:41,514][1054815] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-10 18:36:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8275.3). Total num frames: 58421248. Throughput: 0: 8548.8. Samples: 58402884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:43,348][1054527] Avg episode reward: [(0, '4559.811')] [2023-03-10 18:36:46,484][1054815] Updated weights for policy 0, policy_version 114160 (0.0006) [2023-03-10 18:36:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8275.3). Total num frames: 58462208. Throughput: 0: 8523.0. Samples: 58453432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:48,359][1054527] Avg episode reward: [(0, '4659.028')] [2023-03-10 18:36:48,361][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114184_58462208.pth... [2023-03-10 18:36:48,362][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113688_58208256.pth [2023-03-10 18:36:51,414][1054815] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-10 18:36:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8275.3). Total num frames: 58503168. Throughput: 0: 8448.6. Samples: 58502304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:36:53,348][1054527] Avg episode reward: [(0, '4579.475')] [2023-03-10 18:36:56,436][1054815] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-10 18:36:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8303.1). Total num frames: 58548224. Throughput: 0: 8437.9. Samples: 58526532. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:36:58,348][1054527] Avg episode reward: [(0, '4527.974')] [2023-03-10 18:37:01,173][1054815] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-10 18:37:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8303.1). Total num frames: 58589184. Throughput: 0: 8425.4. Samples: 58579104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:03,348][1054527] Avg episode reward: [(0, '4286.422')] [2023-03-10 18:37:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114432_58589184.pth... [2023-03-10 18:37:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000113936_58335232.pth [2023-03-10 18:37:05,904][1054815] Updated weights for policy 0, policy_version 114480 (0.0005) [2023-03-10 18:37:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8317.0). Total num frames: 58634240. Throughput: 0: 8467.0. Samples: 58630296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:08,348][1054527] Avg episode reward: [(0, '4254.397')] [2023-03-10 18:37:10,622][1054815] Updated weights for policy 0, policy_version 114560 (0.0005) [2023-03-10 18:37:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8317.0). Total num frames: 58675200. Throughput: 0: 8504.7. Samples: 58656512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:13,348][1054527] Avg episode reward: [(0, '4546.874')] [2023-03-10 18:37:15,541][1054815] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-10 18:37:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8317.0). Total num frames: 58716160. Throughput: 0: 8526.0. Samples: 58706676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:18,348][1054527] Avg episode reward: [(0, '4313.466')] [2023-03-10 18:37:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114680_58716160.pth... [2023-03-10 18:37:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114184_58462208.pth [2023-03-10 18:37:20,401][1054815] Updated weights for policy 0, policy_version 114720 (0.0004) [2023-03-10 18:37:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8344.7). Total num frames: 58761216. Throughput: 0: 8416.8. Samples: 58757120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:23,348][1054527] Avg episode reward: [(0, '4554.067')] [2023-03-10 18:37:25,150][1054815] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-10 18:37:28,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8358.6). Total num frames: 58806272. Throughput: 0: 8461.6. Samples: 58783656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:28,349][1054527] Avg episode reward: [(0, '4561.395')] [2023-03-10 18:37:29,703][1054815] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-10 18:37:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8330.8). Total num frames: 58847232. Throughput: 0: 8497.8. Samples: 58835832. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:33,348][1054527] Avg episode reward: [(0, '4269.200')] [2023-03-10 18:37:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114936_58847232.pth... [2023-03-10 18:37:33,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114432_58589184.pth [2023-03-10 18:37:34,399][1054815] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-10 18:37:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 58892288. Throughput: 0: 8575.5. Samples: 58888200. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:38,349][1054527] Avg episode reward: [(0, '4142.524')] [2023-03-10 18:37:39,202][1054815] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-10 18:37:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 58933248. Throughput: 0: 8623.5. Samples: 58914588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:43,348][1054527] Avg episode reward: [(0, '4382.124')] [2023-03-10 18:37:44,113][1054815] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-10 18:37:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8358.6). Total num frames: 58974208. Throughput: 0: 8511.0. Samples: 58962100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:48,348][1054527] Avg episode reward: [(0, '4519.059')] [2023-03-10 18:37:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115184_58974208.pth... [2023-03-10 18:37:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114680_58716160.pth [2023-03-10 18:37:49,123][1054815] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-10 18:37:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8386.4). Total num frames: 59019264. Throughput: 0: 8563.5. Samples: 59015652. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:53,348][1054527] Avg episode reward: [(0, '4559.104')] [2023-03-10 18:37:53,735][1054815] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-10 18:37:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 59060224. Throughput: 0: 8559.0. Samples: 59041668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:37:58,349][1054527] Avg episode reward: [(0, '4240.477')] [2023-03-10 18:37:58,564][1054815] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-10 18:38:03,139][1054815] Updated weights for policy 0, policy_version 115440 (0.0005) [2023-03-10 18:38:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 59105280. Throughput: 0: 8592.4. Samples: 59093336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:03,348][1054527] Avg episode reward: [(0, '4203.703')] [2023-03-10 18:38:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115440_59105280.pth... [2023-03-10 18:38:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000114936_58847232.pth [2023-03-10 18:38:08,006][1054815] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-10 18:38:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 59146240. Throughput: 0: 8629.6. Samples: 59145452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:08,348][1054527] Avg episode reward: [(0, '3780.225')] [2023-03-10 18:38:12,555][1054815] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-10 18:38:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 59191296. Throughput: 0: 8605.2. Samples: 59170888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:13,348][1054527] Avg episode reward: [(0, '3818.521')] [2023-03-10 18:38:17,474][1054815] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-10 18:38:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 59232256. Throughput: 0: 8605.8. Samples: 59223092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:18,348][1054527] Avg episode reward: [(0, '4057.440')] [2023-03-10 18:38:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115688_59232256.pth... [2023-03-10 18:38:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115184_58974208.pth [2023-03-10 18:38:22,217][1054815] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-10 18:38:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 59277312. Throughput: 0: 8588.6. Samples: 59274688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:23,348][1054527] Avg episode reward: [(0, '4271.257')] [2023-03-10 18:38:26,937][1054815] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-10 18:38:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 59318272. Throughput: 0: 8597.9. Samples: 59301492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:28,348][1054527] Avg episode reward: [(0, '4372.313')] [2023-03-10 18:38:31,696][1054815] Updated weights for policy 0, policy_version 115920 (0.0006) [2023-03-10 18:38:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 59363328. Throughput: 0: 8661.2. Samples: 59351856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:33,348][1054527] Avg episode reward: [(0, '4367.633')] [2023-03-10 18:38:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115944_59363328.pth... [2023-03-10 18:38:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115440_59105280.pth [2023-03-10 18:38:36,074][1054815] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-10 18:38:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 59408384. Throughput: 0: 8717.3. Samples: 59407932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:38,348][1054527] Avg episode reward: [(0, '4449.950')] [2023-03-10 18:38:41,164][1054815] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-10 18:38:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 59449344. Throughput: 0: 8628.2. Samples: 59429936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:43,348][1054527] Avg episode reward: [(0, '4394.005')] [2023-03-10 18:38:45,857][1054815] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-10 18:38:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 59494400. Throughput: 0: 8639.5. Samples: 59482112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:48,348][1054527] Avg episode reward: [(0, '4378.102')] [2023-03-10 18:38:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116200_59494400.pth... [2023-03-10 18:38:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115688_59232256.pth [2023-03-10 18:38:50,707][1054815] Updated weights for policy 0, policy_version 116240 (0.0006) [2023-03-10 18:38:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 59535360. Throughput: 0: 8655.5. Samples: 59534948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:53,348][1054527] Avg episode reward: [(0, '4378.691')] [2023-03-10 18:38:55,388][1054815] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-10 18:38:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 59576320. Throughput: 0: 8645.5. Samples: 59559936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:38:58,348][1054527] Avg episode reward: [(0, '4508.736')] [2023-03-10 18:39:00,468][1054815] Updated weights for policy 0, policy_version 116400 (0.0006) [2023-03-10 18:39:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 59617280. Throughput: 0: 8556.1. Samples: 59608116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:03,348][1054527] Avg episode reward: [(0, '4586.543')] [2023-03-10 18:39:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116440_59617280.pth... [2023-03-10 18:39:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000115944_59363328.pth [2023-03-10 18:39:05,529][1054815] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-10 18:39:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 59658240. Throughput: 0: 8517.6. Samples: 59657980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:08,348][1054527] Avg episode reward: [(0, '4589.318')] [2023-03-10 18:39:10,493][1054815] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-10 18:39:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 59699200. Throughput: 0: 8444.1. Samples: 59681476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:13,348][1054527] Avg episode reward: [(0, '4314.844')] [2023-03-10 18:39:15,270][1054815] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-10 18:39:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 59744256. Throughput: 0: 8448.5. Samples: 59732040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:18,348][1054527] Avg episode reward: [(0, '4101.656')] [2023-03-10 18:39:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116688_59744256.pth... [2023-03-10 18:39:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116200_59494400.pth [2023-03-10 18:39:20,181][1054815] Updated weights for policy 0, policy_version 116720 (0.0004) [2023-03-10 18:39:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 59785216. Throughput: 0: 8363.6. Samples: 59784296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:23,350][1054527] Avg episode reward: [(0, '4034.960')] [2023-03-10 18:39:24,930][1054815] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-10 18:39:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 59830272. Throughput: 0: 8440.0. Samples: 59809736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:28,348][1054527] Avg episode reward: [(0, '3622.219')] [2023-03-10 18:39:29,337][1054815] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-10 18:39:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 59875328. Throughput: 0: 8465.0. Samples: 59863040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:33,349][1054527] Avg episode reward: [(0, '4374.375')] [2023-03-10 18:39:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116944_59875328.pth... [2023-03-10 18:39:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116440_59617280.pth [2023-03-10 18:39:34,186][1054815] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-10 18:39:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 59920384. Throughput: 0: 8471.2. Samples: 59916152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:38,348][1054527] Avg episode reward: [(0, '4327.470')] [2023-03-10 18:39:38,828][1054815] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-10 18:39:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.4). Total num frames: 59961344. Throughput: 0: 8465.2. Samples: 59940872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:43,348][1054527] Avg episode reward: [(0, '4459.671')] [2023-03-10 18:39:43,502][1054815] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-10 18:39:48,303][1054815] Updated weights for policy 0, policy_version 117200 (0.0006) [2023-03-10 18:39:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 60006400. Throughput: 0: 8577.7. Samples: 59994112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:48,348][1054527] Avg episode reward: [(0, '4522.912')] [2023-03-10 18:39:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117200_60006400.pth... [2023-03-10 18:39:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116688_59744256.pth [2023-03-10 18:39:53,159][1054815] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-10 18:39:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 60047360. Throughput: 0: 8588.0. Samples: 60044440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:53,348][1054527] Avg episode reward: [(0, '4654.735')] [2023-03-10 18:39:57,834][1054815] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-10 18:39:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 60092416. Throughput: 0: 8644.7. Samples: 60070488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:39:58,348][1054527] Avg episode reward: [(0, '4476.783')] [2023-03-10 18:40:02,664][1054815] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-10 18:40:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 60133376. Throughput: 0: 8678.1. Samples: 60122556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:03,348][1054527] Avg episode reward: [(0, '4605.914')] [2023-03-10 18:40:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117448_60133376.pth... [2023-03-10 18:40:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000116944_59875328.pth [2023-03-10 18:40:07,157][1054815] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-10 18:40:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8539.1). Total num frames: 60178432. Throughput: 0: 8690.7. Samples: 60175380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:08,349][1054527] Avg episode reward: [(0, '4259.795')] [2023-03-10 18:40:12,315][1054815] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-10 18:40:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 60215296. Throughput: 0: 8657.3. Samples: 60199312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:13,348][1054527] Avg episode reward: [(0, '4185.478')] [2023-03-10 18:40:17,409][1054815] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-10 18:40:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 60260352. Throughput: 0: 8525.5. Samples: 60246688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:18,348][1054527] Avg episode reward: [(0, '4615.174')] [2023-03-10 18:40:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117696_60260352.pth... [2023-03-10 18:40:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117200_60006400.pth [2023-03-10 18:40:22,190][1054815] Updated weights for policy 0, policy_version 117760 (0.0006) [2023-03-10 18:40:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 60301312. Throughput: 0: 8491.6. Samples: 60298276. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:23,348][1054527] Avg episode reward: [(0, '4482.226')] [2023-03-10 18:40:26,883][1054815] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-10 18:40:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 60346368. Throughput: 0: 8546.5. Samples: 60325464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:28,348][1054527] Avg episode reward: [(0, '4438.212')] [2023-03-10 18:40:31,452][1054815] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-10 18:40:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 60391424. Throughput: 0: 8543.6. Samples: 60378572. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:33,348][1054527] Avg episode reward: [(0, '4479.746')] [2023-03-10 18:40:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117952_60391424.pth... [2023-03-10 18:40:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117448_60133376.pth [2023-03-10 18:40:35,723][1054815] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-10 18:40:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.4, 300 sec: 8566.9). Total num frames: 60432384. Throughput: 0: 8621.4. Samples: 60432400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:38,348][1054527] Avg episode reward: [(0, '4356.390')] [2023-03-10 18:40:40,796][1054815] Updated weights for policy 0, policy_version 118080 (0.0006) [2023-03-10 18:40:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 60473344. Throughput: 0: 8589.7. Samples: 60457024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:43,348][1054527] Avg episode reward: [(0, '4478.498')] [2023-03-10 18:40:45,887][1054815] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-10 18:40:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 60514304. Throughput: 0: 8517.5. Samples: 60505844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:48,348][1054527] Avg episode reward: [(0, '4029.826')] [2023-03-10 18:40:48,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118192_60514304.pth... [2023-03-10 18:40:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117696_60260352.pth [2023-03-10 18:40:51,144][1054815] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-10 18:40:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 60555264. Throughput: 0: 8362.2. Samples: 60551680. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:53,349][1054527] Avg episode reward: [(0, '4387.590')] [2023-03-10 18:40:56,260][1054815] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-10 18:40:58,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60596224. Throughput: 0: 8374.6. Samples: 60576168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:40:58,348][1054527] Avg episode reward: [(0, '4430.775')] [2023-03-10 18:41:01,152][1054815] Updated weights for policy 0, policy_version 118400 (0.0005) [2023-03-10 18:41:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60637184. Throughput: 0: 8429.5. Samples: 60626016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:03,348][1054527] Avg episode reward: [(0, '4274.616')] [2023-03-10 18:41:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118432_60637184.pth... [2023-03-10 18:41:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000117952_60391424.pth [2023-03-10 18:41:06,073][1054815] Updated weights for policy 0, policy_version 118480 (0.0005) [2023-03-10 18:41:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 60678144. Throughput: 0: 8407.6. Samples: 60676620. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:08,348][1054527] Avg episode reward: [(0, '4015.878')] [2023-03-10 18:41:10,958][1054815] Updated weights for policy 0, policy_version 118560 (0.0005) [2023-03-10 18:41:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 60719104. Throughput: 0: 8380.9. Samples: 60702604. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:13,348][1054527] Avg episode reward: [(0, '4197.569')] [2023-03-10 18:41:15,977][1054815] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-10 18:41:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 60760064. Throughput: 0: 8275.1. Samples: 60750952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:18,348][1054527] Avg episode reward: [(0, '4525.445')] [2023-03-10 18:41:18,390][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118680_60764160.pth... [2023-03-10 18:41:18,392][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118192_60514304.pth [2023-03-10 18:41:20,710][1054815] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-10 18:41:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60805120. Throughput: 0: 8242.8. Samples: 60803328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:23,348][1054527] Avg episode reward: [(0, '4114.095')] [2023-03-10 18:41:25,230][1054815] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-10 18:41:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60850176. Throughput: 0: 8293.3. Samples: 60830220. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:28,348][1054527] Avg episode reward: [(0, '4287.107')] [2023-03-10 18:41:30,099][1054815] Updated weights for policy 0, policy_version 118880 (0.0004) [2023-03-10 18:41:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 60891136. Throughput: 0: 8359.2. Samples: 60882008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:33,348][1054527] Avg episode reward: [(0, '4520.402')] [2023-03-10 18:41:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118928_60891136.pth... [2023-03-10 18:41:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118432_60637184.pth [2023-03-10 18:41:34,913][1054815] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-10 18:41:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60936192. Throughput: 0: 8476.3. Samples: 60933112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:38,348][1054527] Avg episode reward: [(0, '4224.849')] [2023-03-10 18:41:39,596][1054815] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-10 18:41:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 60977152. Throughput: 0: 8506.9. Samples: 60958980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:43,348][1054527] Avg episode reward: [(0, '4164.830')] [2023-03-10 18:41:44,366][1054815] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-10 18:41:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 61022208. Throughput: 0: 8548.5. Samples: 61010696. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:48,348][1054527] Avg episode reward: [(0, '4097.863')] [2023-03-10 18:41:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119184_61022208.pth... [2023-03-10 18:41:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118680_60764160.pth [2023-03-10 18:41:49,201][1054815] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-10 18:41:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 61063168. Throughput: 0: 8503.6. Samples: 61059280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:53,348][1054527] Avg episode reward: [(0, '4392.999')] [2023-03-10 18:41:54,173][1054815] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-10 18:41:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 61104128. Throughput: 0: 8482.8. Samples: 61084328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:41:58,349][1054527] Avg episode reward: [(0, '4548.958')] [2023-03-10 18:41:59,098][1054815] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-10 18:42:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 61149184. Throughput: 0: 8576.7. Samples: 61136904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:42:03,348][1054527] Avg episode reward: [(0, '4325.532')] [2023-03-10 18:42:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119432_61149184.pth... [2023-03-10 18:42:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000118928_60891136.pth [2023-03-10 18:42:03,760][1054815] Updated weights for policy 0, policy_version 119440 (0.0006) [2023-03-10 18:42:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 61190144. Throughput: 0: 8505.1. Samples: 61186056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:08,348][1054527] Avg episode reward: [(0, '4238.693')] [2023-03-10 18:42:08,707][1054815] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-10 18:42:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 61231104. Throughput: 0: 8496.8. Samples: 61212576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:13,348][1054527] Avg episode reward: [(0, '4301.533')] [2023-03-10 18:42:13,516][1054815] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-10 18:42:18,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 61272064. Throughput: 0: 8422.3. Samples: 61261012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:18,348][1054527] Avg episode reward: [(0, '4535.549')] [2023-03-10 18:42:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119672_61272064.pth... [2023-03-10 18:42:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119184_61022208.pth [2023-03-10 18:42:18,754][1054815] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-10 18:42:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 61313024. Throughput: 0: 8377.7. Samples: 61310108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:23,348][1054527] Avg episode reward: [(0, '4533.349')] [2023-03-10 18:42:23,597][1054815] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-10 18:42:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 61353984. Throughput: 0: 8342.9. Samples: 61334408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:28,348][1054527] Avg episode reward: [(0, '4312.098')] [2023-03-10 18:42:28,515][1054815] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-10 18:42:33,267][1054815] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-10 18:42:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 61399040. Throughput: 0: 8357.0. Samples: 61386760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:33,348][1054527] Avg episode reward: [(0, '4341.991')] [2023-03-10 18:42:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119920_61399040.pth... [2023-03-10 18:42:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119432_61149184.pth [2023-03-10 18:42:38,257][1054815] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-10 18:42:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 61440000. Throughput: 0: 8377.1. Samples: 61436248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:38,348][1054527] Avg episode reward: [(0, '3529.542')] [2023-03-10 18:42:43,152][1054815] Updated weights for policy 0, policy_version 120080 (0.0004) [2023-03-10 18:42:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 61480960. Throughput: 0: 8378.7. Samples: 61461368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:43,348][1054527] Avg episode reward: [(0, '4223.258')] [2023-03-10 18:42:47,881][1054815] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-10 18:42:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 61521920. Throughput: 0: 8371.1. Samples: 61513604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:48,348][1054527] Avg episode reward: [(0, '3967.646')] [2023-03-10 18:42:48,387][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120168_61526016.pth... [2023-03-10 18:42:48,389][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119672_61272064.pth [2023-03-10 18:42:52,525][1054815] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-10 18:42:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 61566976. Throughput: 0: 8444.7. Samples: 61566068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:53,348][1054527] Avg episode reward: [(0, '3965.611')] [2023-03-10 18:42:57,175][1054815] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-10 18:42:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 61612032. Throughput: 0: 8448.2. Samples: 61592744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:42:58,348][1054527] Avg episode reward: [(0, '4034.334')] [2023-03-10 18:43:01,669][1054815] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-10 18:43:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8511.4). Total num frames: 61657088. Throughput: 0: 8558.0. Samples: 61646124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:03,348][1054527] Avg episode reward: [(0, '4135.090')] [2023-03-10 18:43:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120424_61657088.pth... [2023-03-10 18:43:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000119920_61399040.pth [2023-03-10 18:43:06,338][1054815] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-10 18:43:08,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 61702144. Throughput: 0: 8675.6. Samples: 61700512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:08,348][1054527] Avg episode reward: [(0, '4013.177')] [2023-03-10 18:43:11,022][1054815] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-10 18:43:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 61743104. Throughput: 0: 8701.9. Samples: 61725996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:13,348][1054527] Avg episode reward: [(0, '4030.086')] [2023-03-10 18:43:16,115][1054815] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-10 18:43:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 61784064. Throughput: 0: 8596.7. Samples: 61773612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:18,348][1054527] Avg episode reward: [(0, '4583.197')] [2023-03-10 18:43:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120672_61784064.pth... [2023-03-10 18:43:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120168_61526016.pth [2023-03-10 18:43:21,038][1054815] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-10 18:43:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 61825024. Throughput: 0: 8622.4. Samples: 61824256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:23,348][1054527] Avg episode reward: [(0, '4375.115')] [2023-03-10 18:43:25,968][1054815] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-10 18:43:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 61870080. Throughput: 0: 8597.4. Samples: 61848252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:28,348][1054527] Avg episode reward: [(0, '4378.976')] [2023-03-10 18:43:30,770][1054815] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-10 18:43:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 61911040. Throughput: 0: 8616.8. Samples: 61901360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:33,348][1054527] Avg episode reward: [(0, '4471.219')] [2023-03-10 18:43:33,358][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120928_61915136.pth... [2023-03-10 18:43:33,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120424_61657088.pth [2023-03-10 18:43:35,170][1054815] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-10 18:43:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 61956096. Throughput: 0: 8631.2. Samples: 61954472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:38,348][1054527] Avg episode reward: [(0, '4304.158')] [2023-03-10 18:43:39,921][1054815] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-10 18:43:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 61997056. Throughput: 0: 8618.9. Samples: 61980596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:43,348][1054527] Avg episode reward: [(0, '4437.248')] [2023-03-10 18:43:44,672][1054815] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-10 18:43:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8497.5). Total num frames: 62042112. Throughput: 0: 8574.8. Samples: 62031992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:48,348][1054527] Avg episode reward: [(0, '3858.619')] [2023-03-10 18:43:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121176_62042112.pth... [2023-03-10 18:43:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120672_61784064.pth [2023-03-10 18:43:49,407][1054815] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-10 18:43:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 62087168. Throughput: 0: 8515.7. Samples: 62083720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:53,348][1054527] Avg episode reward: [(0, '4436.403')] [2023-03-10 18:43:54,168][1054815] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-10 18:43:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8511.4). Total num frames: 62128128. Throughput: 0: 8568.7. Samples: 62111588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:43:58,348][1054527] Avg episode reward: [(0, '4567.583')] [2023-03-10 18:43:58,936][1054815] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-10 18:44:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 62169088. Throughput: 0: 8603.4. Samples: 62160764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:03,349][1054527] Avg episode reward: [(0, '4626.631')] [2023-03-10 18:44:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121424_62169088.pth... [2023-03-10 18:44:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000120928_61915136.pth [2023-03-10 18:44:04,046][1054815] Updated weights for policy 0, policy_version 121440 (0.0006) [2023-03-10 18:44:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 62210048. Throughput: 0: 8570.2. Samples: 62209916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:08,348][1054527] Avg episode reward: [(0, '3923.441')] [2023-03-10 18:44:09,043][1054815] Updated weights for policy 0, policy_version 121520 (0.0006) [2023-03-10 18:44:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 62251008. Throughput: 0: 8519.7. Samples: 62231636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:13,348][1054527] Avg episode reward: [(0, '4155.042')] [2023-03-10 18:44:14,106][1054815] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-10 18:44:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 62291968. Throughput: 0: 8481.6. Samples: 62283032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:18,348][1054527] Avg episode reward: [(0, '4067.764')] [2023-03-10 18:44:18,358][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121672_62296064.pth... [2023-03-10 18:44:18,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121176_62042112.pth [2023-03-10 18:44:18,903][1054815] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-10 18:44:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 62337024. Throughput: 0: 8444.5. Samples: 62334476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:23,348][1054527] Avg episode reward: [(0, '4384.288')] [2023-03-10 18:44:23,666][1054815] Updated weights for policy 0, policy_version 121760 (0.0004) [2023-03-10 18:44:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 62377984. Throughput: 0: 8411.3. Samples: 62359104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:28,349][1054527] Avg episode reward: [(0, '4314.124')] [2023-03-10 18:44:28,451][1054815] Updated weights for policy 0, policy_version 121840 (0.0004) [2023-03-10 18:44:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 62418944. Throughput: 0: 8414.9. Samples: 62410660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:33,348][1054527] Avg episode reward: [(0, '4197.355')] [2023-03-10 18:44:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121912_62418944.pth... [2023-03-10 18:44:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121424_62169088.pth [2023-03-10 18:44:33,476][1054815] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-10 18:44:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 62459904. Throughput: 0: 8345.5. Samples: 62459268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:38,348][1054527] Avg episode reward: [(0, '4161.464')] [2023-03-10 18:44:38,425][1054815] Updated weights for policy 0, policy_version 122000 (0.0004) [2023-03-10 18:44:43,334][1054815] Updated weights for policy 0, policy_version 122080 (0.0004) [2023-03-10 18:44:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 62504960. Throughput: 0: 8288.1. Samples: 62484552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:43,349][1054527] Avg episode reward: [(0, '4332.876')] [2023-03-10 18:44:47,896][1054815] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-10 18:44:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 62545920. Throughput: 0: 8297.1. Samples: 62534132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:48,348][1054527] Avg episode reward: [(0, '4451.886')] [2023-03-10 18:44:48,388][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122168_62550016.pth... [2023-03-10 18:44:48,389][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121672_62296064.pth [2023-03-10 18:44:52,508][1054815] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-10 18:44:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 62595072. Throughput: 0: 8454.6. Samples: 62590372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:53,348][1054527] Avg episode reward: [(0, '4196.581')] [2023-03-10 18:44:56,969][1054815] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-10 18:44:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 62636032. Throughput: 0: 8616.9. Samples: 62619396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:44:58,348][1054527] Avg episode reward: [(0, '4192.865')] [2023-03-10 18:45:01,502][1054815] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-10 18:45:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 62685184. Throughput: 0: 8647.8. Samples: 62672184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:45:03,348][1054527] Avg episode reward: [(0, '4388.098')] [2023-03-10 18:45:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122432_62685184.pth... [2023-03-10 18:45:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000121912_62418944.pth [2023-03-10 18:45:06,072][1054815] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-10 18:45:08,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 62730240. Throughput: 0: 8705.1. Samples: 62726208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:45:08,348][1054527] Avg episode reward: [(0, '4252.249')] [2023-03-10 18:45:10,646][1054815] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-10 18:45:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8511.4). Total num frames: 62771200. Throughput: 0: 8736.7. Samples: 62752256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:13,348][1054527] Avg episode reward: [(0, '4496.439')] [2023-03-10 18:45:15,200][1054815] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-10 18:45:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 62820352. Throughput: 0: 8809.2. Samples: 62807076. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:18,349][1054527] Avg episode reward: [(0, '4097.633')] [2023-03-10 18:45:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122696_62820352.pth... [2023-03-10 18:45:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122168_62550016.pth [2023-03-10 18:45:19,759][1054815] Updated weights for policy 0, policy_version 122720 (0.0006) [2023-03-10 18:45:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 62861312. Throughput: 0: 8886.9. Samples: 62859180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:23,348][1054527] Avg episode reward: [(0, '3779.509')] [2023-03-10 18:45:24,478][1054815] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-10 18:45:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8511.4). Total num frames: 62902272. Throughput: 0: 8904.3. Samples: 62885244. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:28,348][1054527] Avg episode reward: [(0, '3957.395')] [2023-03-10 18:45:29,409][1054815] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-10 18:45:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8525.2). Total num frames: 62947328. Throughput: 0: 8933.2. Samples: 62936128. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:33,348][1054527] Avg episode reward: [(0, '4141.766')] [2023-03-10 18:45:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122944_62947328.pth... [2023-03-10 18:45:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122432_62685184.pth [2023-03-10 18:45:33,997][1054815] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-10 18:45:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8539.1). Total num frames: 62992384. Throughput: 0: 8858.3. Samples: 62988996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:38,348][1054527] Avg episode reward: [(0, '3999.537')] [2023-03-10 18:45:38,477][1054815] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-10 18:45:42,975][1054815] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-10 18:45:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8553.0). Total num frames: 63037440. Throughput: 0: 8854.0. Samples: 63017824. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:43,348][1054527] Avg episode reward: [(0, '4038.834')] [2023-03-10 18:45:47,769][1054815] Updated weights for policy 0, policy_version 123200 (0.0004) [2023-03-10 18:45:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8566.9). Total num frames: 63082496. Throughput: 0: 8854.9. Samples: 63070656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:48,348][1054527] Avg episode reward: [(0, '4199.950')] [2023-03-10 18:45:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123208_63082496.pth... [2023-03-10 18:45:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122696_62820352.pth [2023-03-10 18:45:52,602][1054815] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-10 18:45:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 63123456. Throughput: 0: 8784.3. Samples: 63121500. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:53,348][1054527] Avg episode reward: [(0, '4276.876')] [2023-03-10 18:45:57,406][1054815] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-10 18:45:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 63164416. Throughput: 0: 8784.1. Samples: 63147540. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:45:58,348][1054527] Avg episode reward: [(0, '3944.169')] [2023-03-10 18:46:02,335][1054815] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-10 18:46:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 63205376. Throughput: 0: 8666.8. Samples: 63197080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:46:03,348][1054527] Avg episode reward: [(0, '3677.045')] [2023-03-10 18:46:03,359][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123456_63209472.pth... [2023-03-10 18:46:03,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000122944_62947328.pth [2023-03-10 18:46:06,977][1054815] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-10 18:46:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 63254528. Throughput: 0: 8697.8. Samples: 63250580. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 18:46:08,348][1054527] Avg episode reward: [(0, '3911.204')] [2023-03-10 18:46:11,577][1054815] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-10 18:46:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 63295488. Throughput: 0: 8729.7. Samples: 63278080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:13,348][1054527] Avg episode reward: [(0, '3620.417')] [2023-03-10 18:46:16,184][1054815] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-10 18:46:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 63340544. Throughput: 0: 8760.3. Samples: 63330340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:18,348][1054527] Avg episode reward: [(0, '4081.183')] [2023-03-10 18:46:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123712_63340544.pth... [2023-03-10 18:46:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123208_63082496.pth [2023-03-10 18:46:20,852][1054815] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-10 18:46:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 63385600. Throughput: 0: 8763.5. Samples: 63383356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:23,348][1054527] Avg episode reward: [(0, '4199.422')] [2023-03-10 18:46:25,599][1054815] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-10 18:46:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 63426560. Throughput: 0: 8670.4. Samples: 63407992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:28,348][1054527] Avg episode reward: [(0, '3972.524')] [2023-03-10 18:46:30,240][1054815] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-10 18:46:33,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.2, 300 sec: 8594.7). Total num frames: 63471616. Throughput: 0: 8707.5. Samples: 63462492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:33,348][1054527] Avg episode reward: [(0, '3964.352')] [2023-03-10 18:46:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123968_63471616.pth... [2023-03-10 18:46:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123456_63209472.pth [2023-03-10 18:46:34,969][1054815] Updated weights for policy 0, policy_version 124000 (0.0004) [2023-03-10 18:46:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 63512576. Throughput: 0: 8687.9. Samples: 63512456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:38,348][1054527] Avg episode reward: [(0, '4118.053')] [2023-03-10 18:46:39,801][1054815] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-10 18:46:43,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 63557632. Throughput: 0: 8662.3. Samples: 63537344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:43,348][1054527] Avg episode reward: [(0, '4346.406')] [2023-03-10 18:46:44,537][1054815] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-10 18:46:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 63598592. Throughput: 0: 8715.9. Samples: 63589296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:48,348][1054527] Avg episode reward: [(0, '4264.142')] [2023-03-10 18:46:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124216_63598592.pth... [2023-03-10 18:46:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123712_63340544.pth [2023-03-10 18:46:49,359][1054815] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-10 18:46:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8608.5). Total num frames: 63643648. Throughput: 0: 8662.0. Samples: 63640372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:53,348][1054527] Avg episode reward: [(0, '4151.999')] [2023-03-10 18:46:54,138][1054815] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-10 18:46:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 63688704. Throughput: 0: 8648.8. Samples: 63667276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:46:58,348][1054527] Avg episode reward: [(0, '4021.964')] [2023-03-10 18:46:58,782][1054815] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-10 18:47:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 63729664. Throughput: 0: 8615.6. Samples: 63718044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:03,348][1054527] Avg episode reward: [(0, '3933.554')] [2023-03-10 18:47:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124472_63729664.pth... [2023-03-10 18:47:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000123968_63471616.pth [2023-03-10 18:47:03,614][1054815] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-10 18:47:08,040][1054815] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-10 18:47:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 63774720. Throughput: 0: 8647.8. Samples: 63772508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:08,348][1054527] Avg episode reward: [(0, '4207.876')] [2023-03-10 18:47:12,985][1054815] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-10 18:47:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 63815680. Throughput: 0: 8658.4. Samples: 63797620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:13,348][1054527] Avg episode reward: [(0, '4189.634')] [2023-03-10 18:47:17,542][1054815] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-10 18:47:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 63860736. Throughput: 0: 8643.2. Samples: 63851436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:18,348][1054527] Avg episode reward: [(0, '4341.205')] [2023-03-10 18:47:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124728_63860736.pth... [2023-03-10 18:47:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124216_63598592.pth [2023-03-10 18:47:21,895][1054815] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-10 18:47:23,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 63909888. Throughput: 0: 8743.5. Samples: 63905916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:23,348][1054527] Avg episode reward: [(0, '4182.661')] [2023-03-10 18:47:26,685][1054815] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-10 18:47:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8650.2). Total num frames: 63950848. Throughput: 0: 8726.9. Samples: 63930052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:28,348][1054527] Avg episode reward: [(0, '4177.394')] [2023-03-10 18:47:31,577][1054815] Updated weights for policy 0, policy_version 124960 (0.0005) [2023-03-10 18:47:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 63991808. Throughput: 0: 8724.1. Samples: 63981880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:33,348][1054527] Avg episode reward: [(0, '4263.563')] [2023-03-10 18:47:33,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124992_63995904.pth... [2023-03-10 18:47:33,365][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124472_63729664.pth [2023-03-10 18:47:36,393][1054815] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-10 18:47:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 64036864. Throughput: 0: 8721.3. Samples: 64032832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:38,348][1054527] Avg episode reward: [(0, '4429.942')] [2023-03-10 18:47:41,052][1054815] Updated weights for policy 0, policy_version 125120 (0.0005) [2023-03-10 18:47:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8664.1). Total num frames: 64077824. Throughput: 0: 8735.4. Samples: 64060368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:43,348][1054527] Avg episode reward: [(0, '4433.779')] [2023-03-10 18:47:45,953][1054815] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-10 18:47:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 64118784. Throughput: 0: 8697.5. Samples: 64109432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:48,349][1054527] Avg episode reward: [(0, '4398.103')] [2023-03-10 18:47:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125232_64118784.pth... [2023-03-10 18:47:48,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124728_63860736.pth [2023-03-10 18:47:50,862][1054815] Updated weights for policy 0, policy_version 125280 (0.0006) [2023-03-10 18:47:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 64163840. Throughput: 0: 8606.7. Samples: 64159808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:53,348][1054527] Avg episode reward: [(0, '4089.699')] [2023-03-10 18:47:55,930][1054815] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-10 18:47:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 64204800. Throughput: 0: 8590.8. Samples: 64184208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:47:58,348][1054527] Avg episode reward: [(0, '4326.369')] [2023-03-10 18:48:00,804][1054815] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-10 18:48:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 64245760. Throughput: 0: 8491.1. Samples: 64233536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:03,348][1054527] Avg episode reward: [(0, '4463.573')] [2023-03-10 18:48:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125480_64245760.pth... [2023-03-10 18:48:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000124992_63995904.pth [2023-03-10 18:48:05,756][1054815] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-10 18:48:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 64286720. Throughput: 0: 8377.2. Samples: 64282892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:08,348][1054527] Avg episode reward: [(0, '4206.615')] [2023-03-10 18:48:10,458][1054815] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-10 18:48:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 64331776. Throughput: 0: 8460.6. Samples: 64310780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:13,348][1054527] Avg episode reward: [(0, '4333.600')] [2023-03-10 18:48:15,139][1054815] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-10 18:48:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 64376832. Throughput: 0: 8497.1. Samples: 64364248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:18,348][1054527] Avg episode reward: [(0, '4366.284')] [2023-03-10 18:48:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125736_64376832.pth... [2023-03-10 18:48:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125232_64118784.pth [2023-03-10 18:48:19,626][1054815] Updated weights for policy 0, policy_version 125760 (0.0005) [2023-03-10 18:48:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 64417792. Throughput: 0: 8552.5. Samples: 64417692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:23,348][1054527] Avg episode reward: [(0, '4042.620')] [2023-03-10 18:48:24,361][1054815] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-10 18:48:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 64462848. Throughput: 0: 8490.3. Samples: 64442432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:28,348][1054527] Avg episode reward: [(0, '4498.338')] [2023-03-10 18:48:29,231][1054815] Updated weights for policy 0, policy_version 125920 (0.0006) [2023-03-10 18:48:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 64503808. Throughput: 0: 8500.6. Samples: 64491960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:33,348][1054527] Avg episode reward: [(0, '4554.465')] [2023-03-10 18:48:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125984_64503808.pth... [2023-03-10 18:48:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125480_64245760.pth [2023-03-10 18:48:34,138][1054815] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-10 18:48:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 64544768. Throughput: 0: 8528.8. Samples: 64543604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:38,348][1054527] Avg episode reward: [(0, '4562.942')] [2023-03-10 18:48:39,022][1054815] Updated weights for policy 0, policy_version 126080 (0.0006) [2023-03-10 18:48:43,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 64589824. Throughput: 0: 8555.5. Samples: 64569204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:43,348][1054527] Avg episode reward: [(0, '4660.847')] [2023-03-10 18:48:43,684][1054815] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-10 18:48:48,319][1054815] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-10 18:48:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 64634880. Throughput: 0: 8647.8. Samples: 64622688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:48,348][1054527] Avg episode reward: [(0, '4659.601')] [2023-03-10 18:48:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126240_64634880.pth... [2023-03-10 18:48:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125736_64376832.pth [2023-03-10 18:48:52,830][1054815] Updated weights for policy 0, policy_version 126320 (0.0005) [2023-03-10 18:48:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 64679936. Throughput: 0: 8732.4. Samples: 64675848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:53,348][1054527] Avg episode reward: [(0, '4573.450')] [2023-03-10 18:48:57,731][1054815] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-10 18:48:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 64720896. Throughput: 0: 8661.0. Samples: 64700524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:48:58,348][1054527] Avg episode reward: [(0, '4680.626')] [2023-03-10 18:49:02,281][1054815] Updated weights for policy 0, policy_version 126480 (0.0005) [2023-03-10 18:49:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8664.1). Total num frames: 64765952. Throughput: 0: 8653.9. Samples: 64753672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:03,348][1054527] Avg episode reward: [(0, '4493.025')] [2023-03-10 18:49:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126496_64765952.pth... [2023-03-10 18:49:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000125984_64503808.pth [2023-03-10 18:49:06,808][1054815] Updated weights for policy 0, policy_version 126560 (0.0005) [2023-03-10 18:49:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 64811008. Throughput: 0: 8676.9. Samples: 64808152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:08,348][1054527] Avg episode reward: [(0, '4313.760')] [2023-03-10 18:49:11,277][1054815] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-10 18:49:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.2, 300 sec: 8691.9). Total num frames: 64856064. Throughput: 0: 8738.3. Samples: 64835656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:13,348][1054527] Avg episode reward: [(0, '4593.983')] [2023-03-10 18:49:15,880][1054815] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-10 18:49:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8691.8). Total num frames: 64901120. Throughput: 0: 8819.4. Samples: 64888832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:18,348][1054527] Avg episode reward: [(0, '4473.977')] [2023-03-10 18:49:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126760_64901120.pth... [2023-03-10 18:49:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126240_64634880.pth [2023-03-10 18:49:20,643][1054815] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-10 18:49:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8691.9). Total num frames: 64942080. Throughput: 0: 8809.9. Samples: 64940048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:23,348][1054527] Avg episode reward: [(0, '4095.276')] [2023-03-10 18:49:25,448][1054815] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-10 18:49:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 64987136. Throughput: 0: 8830.4. Samples: 64966572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:28,348][1054527] Avg episode reward: [(0, '4685.171')] [2023-03-10 18:49:30,178][1054815] Updated weights for policy 0, policy_version 126960 (0.0006) [2023-03-10 18:49:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 65028096. Throughput: 0: 8801.1. Samples: 65018736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:33,348][1054527] Avg episode reward: [(0, '4551.541')] [2023-03-10 18:49:33,383][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127016_65032192.pth... [2023-03-10 18:49:33,385][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126496_64765952.pth [2023-03-10 18:49:34,717][1054815] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-10 18:49:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8719.6). Total num frames: 65077248. Throughput: 0: 8826.1. Samples: 65073024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:38,348][1054527] Avg episode reward: [(0, '4600.863')] [2023-03-10 18:49:39,114][1054815] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-10 18:49:43,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8874.6, 300 sec: 8733.5). Total num frames: 65122304. Throughput: 0: 8899.9. Samples: 65101020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:43,348][1054527] Avg episode reward: [(0, '4461.660')] [2023-03-10 18:49:43,749][1054815] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-10 18:49:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8705.7). Total num frames: 65163264. Throughput: 0: 8920.0. Samples: 65155072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:48,359][1054527] Avg episode reward: [(0, '4546.385')] [2023-03-10 18:49:48,364][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127280_65167360.pth... [2023-03-10 18:49:48,365][1054815] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-10 18:49:48,366][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000126760_64901120.pth [2023-03-10 18:49:53,279][1054815] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-10 18:49:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8719.6). Total num frames: 65208320. Throughput: 0: 8803.0. Samples: 65204288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:53,348][1054527] Avg episode reward: [(0, '4595.478')] [2023-03-10 18:49:57,944][1054815] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-10 18:49:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 65249280. Throughput: 0: 8763.5. Samples: 65230016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:49:58,348][1054527] Avg episode reward: [(0, '4567.682')] [2023-03-10 18:50:02,500][1054815] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-10 18:50:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8691.8). Total num frames: 65294336. Throughput: 0: 8760.9. Samples: 65283072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:50:03,348][1054527] Avg episode reward: [(0, '4564.051')] [2023-03-10 18:50:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127528_65294336.pth... [2023-03-10 18:50:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127016_65032192.pth [2023-03-10 18:50:07,372][1054815] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-10 18:50:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8691.8). Total num frames: 65335296. Throughput: 0: 8782.0. Samples: 65335240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:50:08,348][1054527] Avg episode reward: [(0, '4587.939')] [2023-03-10 18:50:12,342][1054815] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-10 18:50:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 65380352. Throughput: 0: 8738.0. Samples: 65359784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:50:13,349][1054527] Avg episode reward: [(0, '4600.408')] [2023-03-10 18:50:17,195][1054815] Updated weights for policy 0, policy_version 127760 (0.0006) [2023-03-10 18:50:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 65421312. Throughput: 0: 8689.0. Samples: 65409740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:50:18,348][1054527] Avg episode reward: [(0, '4331.732')] [2023-03-10 18:50:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127776_65421312.pth... [2023-03-10 18:50:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127280_65167360.pth [2023-03-10 18:50:22,019][1054815] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-10 18:50:23,348][1054527] Fps is (10 sec: 8192.2, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 65462272. Throughput: 0: 8614.3. Samples: 65460668. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:23,348][1054527] Avg episode reward: [(0, '4465.403')] [2023-03-10 18:50:27,141][1054815] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-10 18:50:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65503232. Throughput: 0: 8537.6. Samples: 65485212. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:28,348][1054527] Avg episode reward: [(0, '4416.140')] [2023-03-10 18:50:32,008][1054815] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-10 18:50:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8664.1). Total num frames: 65548288. Throughput: 0: 8452.0. Samples: 65535412. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:33,349][1054527] Avg episode reward: [(0, '4500.636')] [2023-03-10 18:50:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128024_65548288.pth... [2023-03-10 18:50:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127528_65294336.pth [2023-03-10 18:50:36,594][1054815] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-10 18:50:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65593344. Throughput: 0: 8524.6. Samples: 65587892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:38,348][1054527] Avg episode reward: [(0, '4506.583')] [2023-03-10 18:50:40,933][1054815] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-10 18:50:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65638400. Throughput: 0: 8600.8. Samples: 65617052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:43,348][1054527] Avg episode reward: [(0, '4182.580')] [2023-03-10 18:50:45,754][1054815] Updated weights for policy 0, policy_version 128240 (0.0006) [2023-03-10 18:50:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65679360. Throughput: 0: 8565.5. Samples: 65668520. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:48,348][1054527] Avg episode reward: [(0, '4531.358')] [2023-03-10 18:50:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128288_65683456.pth... [2023-03-10 18:50:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000127776_65421312.pth [2023-03-10 18:50:50,426][1054815] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-10 18:50:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 65724416. Throughput: 0: 8557.6. Samples: 65720332. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:53,348][1054527] Avg episode reward: [(0, '4629.809')] [2023-03-10 18:50:55,374][1054815] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-10 18:50:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 65765376. Throughput: 0: 8553.5. Samples: 65744688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:50:58,348][1054527] Avg episode reward: [(0, '4634.307')] [2023-03-10 18:51:00,218][1054815] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-10 18:51:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 65806336. Throughput: 0: 8587.6. Samples: 65796180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:51:03,348][1054527] Avg episode reward: [(0, '4666.261')] [2023-03-10 18:51:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128528_65806336.pth... [2023-03-10 18:51:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128024_65548288.pth [2023-03-10 18:51:05,000][1054815] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-10 18:51:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65851392. Throughput: 0: 8595.6. Samples: 65847472. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:51:08,348][1054527] Avg episode reward: [(0, '4562.744')] [2023-03-10 18:51:09,667][1054815] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-10 18:51:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 65896448. Throughput: 0: 8640.5. Samples: 65874036. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:51:13,348][1054527] Avg episode reward: [(0, '4677.149')] [2023-03-10 18:51:14,247][1054815] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-10 18:51:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 65937408. Throughput: 0: 8725.1. Samples: 65928040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:51:18,348][1054527] Avg episode reward: [(0, '4537.987')] [2023-03-10 18:51:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128784_65937408.pth... [2023-03-10 18:51:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128288_65683456.pth [2023-03-10 18:51:19,012][1054815] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-10 18:51:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8664.1). Total num frames: 65982464. Throughput: 0: 8676.6. Samples: 65978340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:23,349][1054527] Avg episode reward: [(0, '4629.950')] [2023-03-10 18:51:23,836][1054815] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-10 18:51:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 66023424. Throughput: 0: 8570.6. Samples: 66002728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:28,348][1054527] Avg episode reward: [(0, '4447.505')] [2023-03-10 18:51:28,760][1054815] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-10 18:51:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 66064384. Throughput: 0: 8589.9. Samples: 66055068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:33,348][1054527] Avg episode reward: [(0, '4632.496')] [2023-03-10 18:51:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129032_66064384.pth... [2023-03-10 18:51:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128528_65806336.pth [2023-03-10 18:51:33,501][1054815] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-10 18:51:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 66105344. Throughput: 0: 8489.0. Samples: 66102336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:38,348][1054527] Avg episode reward: [(0, '4544.643')] [2023-03-10 18:51:38,642][1054815] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-10 18:51:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 66146304. Throughput: 0: 8518.8. Samples: 66128036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:43,348][1054527] Avg episode reward: [(0, '4677.331')] [2023-03-10 18:51:43,795][1054815] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-10 18:51:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 66187264. Throughput: 0: 8419.3. Samples: 66175048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:48,348][1054527] Avg episode reward: [(0, '4555.029')] [2023-03-10 18:51:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129272_66187264.pth... [2023-03-10 18:51:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000128784_65937408.pth [2023-03-10 18:51:48,741][1054815] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-10 18:51:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 66228224. Throughput: 0: 8389.4. Samples: 66224996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:53,349][1054527] Avg episode reward: [(0, '4587.140')] [2023-03-10 18:51:53,497][1054815] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-10 18:51:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 66269184. Throughput: 0: 8407.6. Samples: 66252376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:51:58,348][1054527] Avg episode reward: [(0, '4081.888')] [2023-03-10 18:51:58,492][1054815] Updated weights for policy 0, policy_version 129440 (0.0004) [2023-03-10 18:52:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 66310144. Throughput: 0: 8292.9. Samples: 66301220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:52:03,348][1054527] Avg episode reward: [(0, '4454.908')] [2023-03-10 18:52:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129512_66310144.pth... [2023-03-10 18:52:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129032_66064384.pth [2023-03-10 18:52:03,543][1054815] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-10 18:52:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 66351104. Throughput: 0: 8270.3. Samples: 66350500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:52:08,348][1054527] Avg episode reward: [(0, '4686.045')] [2023-03-10 18:52:08,466][1054815] Updated weights for policy 0, policy_version 129600 (0.0005) [2023-03-10 18:52:13,274][1054815] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-10 18:52:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 66396160. Throughput: 0: 8286.4. Samples: 66375616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:52:13,348][1054527] Avg episode reward: [(0, '4462.799')] [2023-03-10 18:52:18,084][1054815] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-10 18:52:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 66437120. Throughput: 0: 8267.2. Samples: 66427092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:52:18,348][1054527] Avg episode reward: [(0, '4369.823')] [2023-03-10 18:52:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129760_66437120.pth... [2023-03-10 18:52:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129272_66187264.pth [2023-03-10 18:52:23,006][1054815] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-10 18:52:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8566.9). Total num frames: 66478080. Throughput: 0: 8321.9. Samples: 66476820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:52:23,348][1054527] Avg episode reward: [(0, '3888.208')] [2023-03-10 18:52:27,821][1054815] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-10 18:52:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8566.9). Total num frames: 66519040. Throughput: 0: 8324.4. Samples: 66502632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:28,348][1054527] Avg episode reward: [(0, '3860.680')] [2023-03-10 18:52:32,444][1054815] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-10 18:52:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 66564096. Throughput: 0: 8432.8. Samples: 66554524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:33,348][1054527] Avg episode reward: [(0, '4603.247')] [2023-03-10 18:52:33,389][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130016_66568192.pth... [2023-03-10 18:52:33,391][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129512_66310144.pth [2023-03-10 18:52:37,251][1054815] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-10 18:52:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8396.8, 300 sec: 8580.8). Total num frames: 66609152. Throughput: 0: 8452.7. Samples: 66605368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:38,348][1054527] Avg episode reward: [(0, '4465.926')] [2023-03-10 18:52:41,945][1054815] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-10 18:52:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8580.8). Total num frames: 66650112. Throughput: 0: 8469.9. Samples: 66633520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:43,348][1054527] Avg episode reward: [(0, '4601.872')] [2023-03-10 18:52:46,754][1054815] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-10 18:52:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 66695168. Throughput: 0: 8486.7. Samples: 66683120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:48,348][1054527] Avg episode reward: [(0, '4646.465')] [2023-03-10 18:52:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130264_66695168.pth... [2023-03-10 18:52:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000129760_66437120.pth [2023-03-10 18:52:51,633][1054815] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-10 18:52:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 66736128. Throughput: 0: 8551.2. Samples: 66735304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:53,348][1054527] Avg episode reward: [(0, '4561.752')] [2023-03-10 18:52:56,017][1054815] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-10 18:52:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 66785280. Throughput: 0: 8621.9. Samples: 66763600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:52:58,348][1054527] Avg episode reward: [(0, '4513.190')] [2023-03-10 18:53:00,225][1054815] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-10 18:53:03,348][1054527] Fps is (10 sec: 9830.3, 60 sec: 8738.2, 300 sec: 8636.3). Total num frames: 66834432. Throughput: 0: 8779.0. Samples: 66822144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:53:03,348][1054527] Avg episode reward: [(0, '4474.678')] [2023-03-10 18:53:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130536_66834432.pth... [2023-03-10 18:53:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130016_66568192.pth [2023-03-10 18:53:04,623][1054815] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-10 18:53:08,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 66879488. Throughput: 0: 8898.6. Samples: 66877256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:53:08,348][1054527] Avg episode reward: [(0, '4386.077')] [2023-03-10 18:53:08,996][1054815] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-10 18:53:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 66924544. Throughput: 0: 8917.8. Samples: 66903932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:53:13,348][1054527] Avg episode reward: [(0, '4331.048')] [2023-03-10 18:53:13,828][1054815] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-10 18:53:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 66965504. Throughput: 0: 8887.0. Samples: 66954440. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:53:18,348][1054527] Avg episode reward: [(0, '4327.985')] [2023-03-10 18:53:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130792_66965504.pth... [2023-03-10 18:53:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130264_66695168.pth [2023-03-10 18:53:18,525][1054815] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-10 18:53:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 67006464. Throughput: 0: 8871.0. Samples: 67004564. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 18:53:23,348][1054527] Avg episode reward: [(0, '4405.482')] [2023-03-10 18:53:23,443][1054815] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-10 18:53:28,134][1054815] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-10 18:53:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8636.3). Total num frames: 67051520. Throughput: 0: 8848.1. Samples: 67031684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:28,348][1054527] Avg episode reward: [(0, '4558.548')] [2023-03-10 18:53:32,710][1054815] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-10 18:53:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 67096576. Throughput: 0: 8914.9. Samples: 67084288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:33,348][1054527] Avg episode reward: [(0, '4269.192')] [2023-03-10 18:53:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131048_67096576.pth... [2023-03-10 18:53:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130536_66834432.pth [2023-03-10 18:53:37,652][1054815] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-10 18:53:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 67137536. Throughput: 0: 8881.4. Samples: 67134968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:38,348][1054527] Avg episode reward: [(0, '4043.872')] [2023-03-10 18:53:42,391][1054815] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-10 18:53:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 67178496. Throughput: 0: 8812.3. Samples: 67160152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:43,348][1054527] Avg episode reward: [(0, '3830.009')] [2023-03-10 18:53:47,373][1054815] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-10 18:53:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 67219456. Throughput: 0: 8647.3. Samples: 67211272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:48,348][1054527] Avg episode reward: [(0, '4128.466')] [2023-03-10 18:53:48,389][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131296_67223552.pth... [2023-03-10 18:53:48,391][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000130792_66965504.pth [2023-03-10 18:53:52,518][1054815] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-10 18:53:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 67260416. Throughput: 0: 8493.8. Samples: 67259476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:53,348][1054527] Avg episode reward: [(0, '4411.978')] [2023-03-10 18:53:57,558][1054815] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-10 18:53:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 67301376. Throughput: 0: 8454.7. Samples: 67284396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:53:58,348][1054527] Avg episode reward: [(0, '4331.924')] [2023-03-10 18:54:02,425][1054815] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-10 18:54:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 67342336. Throughput: 0: 8436.4. Samples: 67334076. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:03,348][1054527] Avg episode reward: [(0, '4544.420')] [2023-03-10 18:54:03,387][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131536_67346432.pth... [2023-03-10 18:54:03,388][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131048_67096576.pth [2023-03-10 18:54:07,173][1054815] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-10 18:54:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 67387392. Throughput: 0: 8449.5. Samples: 67384792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:08,348][1054527] Avg episode reward: [(0, '4455.500')] [2023-03-10 18:54:11,562][1054815] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-10 18:54:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 67432448. Throughput: 0: 8485.3. Samples: 67413520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:13,348][1054527] Avg episode reward: [(0, '4334.336')] [2023-03-10 18:54:16,377][1054815] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-10 18:54:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 67477504. Throughput: 0: 8466.5. Samples: 67465280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:18,348][1054527] Avg episode reward: [(0, '4272.504')] [2023-03-10 18:54:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131792_67477504.pth... [2023-03-10 18:54:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131296_67223552.pth [2023-03-10 18:54:21,119][1054815] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-10 18:54:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 67518464. Throughput: 0: 8461.7. Samples: 67515744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:23,348][1054527] Avg episode reward: [(0, '4302.620')] [2023-03-10 18:54:25,970][1054815] Updated weights for policy 0, policy_version 131920 (0.0006) [2023-03-10 18:54:28,348][1054527] Fps is (10 sec: 8192.2, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 67559424. Throughput: 0: 8493.4. Samples: 67542356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 18:54:28,348][1054527] Avg episode reward: [(0, '4103.174')] [2023-03-10 18:54:30,728][1054815] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-10 18:54:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 67604480. Throughput: 0: 8480.5. Samples: 67592896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:33,348][1054527] Avg episode reward: [(0, '4283.876')] [2023-03-10 18:54:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132040_67604480.pth... [2023-03-10 18:54:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131536_67346432.pth [2023-03-10 18:54:35,749][1054815] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-10 18:54:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 67645440. Throughput: 0: 8513.1. Samples: 67642564. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:38,359][1054527] Avg episode reward: [(0, '4328.381')] [2023-03-10 18:54:40,490][1054815] Updated weights for policy 0, policy_version 132160 (0.0004) [2023-03-10 18:54:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 67690496. Throughput: 0: 8561.0. Samples: 67669640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:43,348][1054527] Avg episode reward: [(0, '4285.696')] [2023-03-10 18:54:45,128][1054815] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-10 18:54:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 67731456. Throughput: 0: 8600.5. Samples: 67721100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:48,348][1054527] Avg episode reward: [(0, '3823.639')] [2023-03-10 18:54:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132288_67731456.pth... [2023-03-10 18:54:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000131792_67477504.pth [2023-03-10 18:54:50,039][1054815] Updated weights for policy 0, policy_version 132320 (0.0006) [2023-03-10 18:54:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 67776512. Throughput: 0: 8615.3. Samples: 67772480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:53,349][1054527] Avg episode reward: [(0, '4062.345')] [2023-03-10 18:54:54,887][1054815] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-10 18:54:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 67817472. Throughput: 0: 8521.2. Samples: 67796976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:54:58,348][1054527] Avg episode reward: [(0, '4109.208')] [2023-03-10 18:54:59,726][1054815] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-10 18:55:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 67858432. Throughput: 0: 8469.3. Samples: 67846396. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:03,348][1054527] Avg episode reward: [(0, '4058.542')] [2023-03-10 18:55:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132536_67858432.pth... [2023-03-10 18:55:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132040_67604480.pth [2023-03-10 18:55:04,586][1054815] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-10 18:55:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 67903488. Throughput: 0: 8521.7. Samples: 67899220. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:08,348][1054527] Avg episode reward: [(0, '4286.591')] [2023-03-10 18:55:09,307][1054815] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-10 18:55:13,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 67948544. Throughput: 0: 8505.8. Samples: 67925120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:13,348][1054527] Avg episode reward: [(0, '4431.074')] [2023-03-10 18:55:13,730][1054815] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-10 18:55:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 67989504. Throughput: 0: 8604.5. Samples: 67980100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:18,348][1054527] Avg episode reward: [(0, '4085.991')] [2023-03-10 18:55:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132792_67989504.pth... [2023-03-10 18:55:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132288_67731456.pth [2023-03-10 18:55:18,451][1054815] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-10 18:55:23,177][1054815] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-10 18:55:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 68034560. Throughput: 0: 8631.9. Samples: 68031000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:23,348][1054527] Avg episode reward: [(0, '4044.378')] [2023-03-10 18:55:27,870][1054815] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-10 18:55:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 68075520. Throughput: 0: 8617.8. Samples: 68057440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 18:55:28,349][1054527] Avg episode reward: [(0, '3952.615')] [2023-03-10 18:55:32,675][1054815] Updated weights for policy 0, policy_version 133040 (0.0004) [2023-03-10 18:55:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 68120576. Throughput: 0: 8605.9. Samples: 68108364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:33,348][1054527] Avg episode reward: [(0, '4147.887')] [2023-03-10 18:55:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133048_68120576.pth... [2023-03-10 18:55:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132536_67858432.pth [2023-03-10 18:55:37,552][1054815] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-10 18:55:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 68161536. Throughput: 0: 8611.3. Samples: 68159988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:38,348][1054527] Avg episode reward: [(0, '4362.789')] [2023-03-10 18:55:42,465][1054815] Updated weights for policy 0, policy_version 133200 (0.0005) [2023-03-10 18:55:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 68202496. Throughput: 0: 8640.5. Samples: 68185800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:43,348][1054527] Avg episode reward: [(0, '3858.354')] [2023-03-10 18:55:47,481][1054815] Updated weights for policy 0, policy_version 133280 (0.0004) [2023-03-10 18:55:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 68243456. Throughput: 0: 8632.2. Samples: 68234844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:48,348][1054527] Avg episode reward: [(0, '3919.152')] [2023-03-10 18:55:48,376][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133296_68247552.pth... [2023-03-10 18:55:48,377][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000132792_67989504.pth [2023-03-10 18:55:52,135][1054815] Updated weights for policy 0, policy_version 133360 (0.0005) [2023-03-10 18:55:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 68288512. Throughput: 0: 8591.5. Samples: 68285836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:53,348][1054527] Avg episode reward: [(0, '3856.644')] [2023-03-10 18:55:57,030][1054815] Updated weights for policy 0, policy_version 133440 (0.0004) [2023-03-10 18:55:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 68329472. Throughput: 0: 8581.5. Samples: 68311288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:55:58,348][1054527] Avg episode reward: [(0, '3960.416')] [2023-03-10 18:56:01,617][1054815] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-10 18:56:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 68374528. Throughput: 0: 8534.0. Samples: 68364132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:03,348][1054527] Avg episode reward: [(0, '4284.337')] [2023-03-10 18:56:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133544_68374528.pth... [2023-03-10 18:56:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133048_68120576.pth [2023-03-10 18:56:06,452][1054815] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-10 18:56:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 68415488. Throughput: 0: 8542.9. Samples: 68415432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:08,348][1054527] Avg episode reward: [(0, '4164.183')] [2023-03-10 18:56:11,393][1054815] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-10 18:56:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 68460544. Throughput: 0: 8502.1. Samples: 68440032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:13,348][1054527] Avg episode reward: [(0, '3876.741')] [2023-03-10 18:56:15,917][1054815] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-10 18:56:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 68501504. Throughput: 0: 8546.8. Samples: 68492972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:18,348][1054527] Avg episode reward: [(0, '3621.066')] [2023-03-10 18:56:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133792_68501504.pth... [2023-03-10 18:56:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133296_68247552.pth [2023-03-10 18:56:20,545][1054815] Updated weights for policy 0, policy_version 133840 (0.0006) [2023-03-10 18:56:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 68546560. Throughput: 0: 8567.4. Samples: 68545520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:23,348][1054527] Avg episode reward: [(0, '3879.536')] [2023-03-10 18:56:25,339][1054815] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-10 18:56:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 68591616. Throughput: 0: 8564.6. Samples: 68571208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:28,348][1054527] Avg episode reward: [(0, '4118.645')] [2023-03-10 18:56:29,882][1054815] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-10 18:56:33,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 68640768. Throughput: 0: 8697.3. Samples: 68626224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:56:33,348][1054527] Avg episode reward: [(0, '4446.202')] [2023-03-10 18:56:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134064_68640768.pth... [2023-03-10 18:56:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133544_68374528.pth [2023-03-10 18:56:34,261][1054815] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-10 18:56:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 68681728. Throughput: 0: 8760.4. Samples: 68680052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:56:38,348][1054527] Avg episode reward: [(0, '4031.263')] [2023-03-10 18:56:39,045][1054815] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-10 18:56:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 68722688. Throughput: 0: 8737.3. Samples: 68704468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:56:43,348][1054527] Avg episode reward: [(0, '3905.904')] [2023-03-10 18:56:43,926][1054815] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-10 18:56:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 68767744. Throughput: 0: 8718.1. Samples: 68756448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:56:48,348][1054527] Avg episode reward: [(0, '4344.614')] [2023-03-10 18:56:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134312_68767744.pth... [2023-03-10 18:56:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000133792_68501504.pth [2023-03-10 18:56:48,463][1054815] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-10 18:56:53,003][1054815] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-10 18:56:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 68812800. Throughput: 0: 8811.8. Samples: 68811964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:56:53,348][1054527] Avg episode reward: [(0, '4448.927')] [2023-03-10 18:56:58,067][1054815] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-10 18:56:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 68853760. Throughput: 0: 8829.0. Samples: 68837336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:56:58,348][1054527] Avg episode reward: [(0, '4303.139')] [2023-03-10 18:57:02,910][1054815] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-10 18:57:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 68894720. Throughput: 0: 8710.9. Samples: 68884964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:03,348][1054527] Avg episode reward: [(0, '4244.988')] [2023-03-10 18:57:03,373][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134568_68898816.pth... [2023-03-10 18:57:03,375][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134064_68640768.pth [2023-03-10 18:57:07,724][1054815] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-10 18:57:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 68939776. Throughput: 0: 8684.0. Samples: 68936300. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:08,348][1054527] Avg episode reward: [(0, '4234.830')] [2023-03-10 18:57:12,669][1054815] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-10 18:57:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 68980736. Throughput: 0: 8671.5. Samples: 68961424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:13,348][1054527] Avg episode reward: [(0, '4039.932')] [2023-03-10 18:57:17,129][1054815] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-10 18:57:18,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 69025792. Throughput: 0: 8619.6. Samples: 69014108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:18,349][1054527] Avg episode reward: [(0, '4380.944')] [2023-03-10 18:57:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134816_69025792.pth... [2023-03-10 18:57:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134312_68767744.pth [2023-03-10 18:57:21,673][1054815] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-10 18:57:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8650.2). Total num frames: 69070848. Throughput: 0: 8648.2. Samples: 69069220. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:23,348][1054527] Avg episode reward: [(0, '4013.940')] [2023-03-10 18:57:26,410][1054815] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-10 18:57:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8650.2). Total num frames: 69115904. Throughput: 0: 8671.4. Samples: 69094680. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:28,348][1054527] Avg episode reward: [(0, '4243.922')] [2023-03-10 18:57:31,052][1054815] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-10 18:57:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 69160960. Throughput: 0: 8702.8. Samples: 69148076. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:33,348][1054527] Avg episode reward: [(0, '3785.896')] [2023-03-10 18:57:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135080_69160960.pth... [2023-03-10 18:57:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134568_68898816.pth [2023-03-10 18:57:35,307][1054815] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-10 18:57:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 69206016. Throughput: 0: 8714.0. Samples: 69204092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:38,348][1054527] Avg episode reward: [(0, '3329.942')] [2023-03-10 18:57:39,862][1054815] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-10 18:57:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8664.1). Total num frames: 69251072. Throughput: 0: 8744.0. Samples: 69230816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:43,348][1054527] Avg episode reward: [(0, '4240.919')] [2023-03-10 18:57:44,161][1054815] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-10 18:57:48,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8691.8). Total num frames: 69300224. Throughput: 0: 8954.7. Samples: 69287924. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:48,349][1054527] Avg episode reward: [(0, '3725.345')] [2023-03-10 18:57:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135352_69300224.pth... [2023-03-10 18:57:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000134816_69025792.pth [2023-03-10 18:57:48,626][1054815] Updated weights for policy 0, policy_version 135360 (0.0006) [2023-03-10 18:57:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8664.1). Total num frames: 69341184. Throughput: 0: 8997.4. Samples: 69341184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:53,348][1054527] Avg episode reward: [(0, '3578.310')] [2023-03-10 18:57:53,351][1054815] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-10 18:57:57,881][1054815] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-10 18:57:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 69386240. Throughput: 0: 9020.5. Samples: 69367344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:57:58,348][1054527] Avg episode reward: [(0, '2642.834')] [2023-03-10 18:58:02,680][1054815] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-10 18:58:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8650.2). Total num frames: 69431296. Throughput: 0: 9017.0. Samples: 69419872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:03,348][1054527] Avg episode reward: [(0, '2723.245')] [2023-03-10 18:58:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135608_69431296.pth... [2023-03-10 18:58:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135080_69160960.pth [2023-03-10 18:58:07,540][1054815] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-10 18:58:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8636.3). Total num frames: 69472256. Throughput: 0: 8929.4. Samples: 69471044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:08,348][1054527] Avg episode reward: [(0, '3404.335')] [2023-03-10 18:58:12,381][1054815] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-10 18:58:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8874.7, 300 sec: 8636.3). Total num frames: 69513216. Throughput: 0: 8938.3. Samples: 69496904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:13,348][1054527] Avg episode reward: [(0, '3397.812')] [2023-03-10 18:58:17,365][1054815] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-10 18:58:18,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 69554176. Throughput: 0: 8842.4. Samples: 69545984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:18,348][1054527] Avg episode reward: [(0, '3962.500')] [2023-03-10 18:58:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135848_69554176.pth... [2023-03-10 18:58:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135352_69300224.pth [2023-03-10 18:58:22,239][1054815] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-10 18:58:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 69599232. Throughput: 0: 8706.1. Samples: 69595868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:23,348][1054527] Avg episode reward: [(0, '4063.463')] [2023-03-10 18:58:27,287][1054815] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-10 18:58:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 69640192. Throughput: 0: 8642.1. Samples: 69619712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:28,349][1054527] Avg episode reward: [(0, '3929.803')] [2023-03-10 18:58:32,220][1054815] Updated weights for policy 0, policy_version 136080 (0.0004) [2023-03-10 18:58:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 69681152. Throughput: 0: 8473.3. Samples: 69669224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:33,348][1054527] Avg episode reward: [(0, '3838.741')] [2023-03-10 18:58:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136096_69681152.pth... [2023-03-10 18:58:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135608_69431296.pth [2023-03-10 18:58:37,097][1054815] Updated weights for policy 0, policy_version 136160 (0.0004) [2023-03-10 18:58:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 69722112. Throughput: 0: 8420.2. Samples: 69720092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 18:58:38,348][1054527] Avg episode reward: [(0, '3995.172')] [2023-03-10 18:58:41,785][1054815] Updated weights for policy 0, policy_version 136240 (0.0005) [2023-03-10 18:58:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 69767168. Throughput: 0: 8429.8. Samples: 69746688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:58:43,348][1054527] Avg episode reward: [(0, '4025.170')] [2023-03-10 18:58:46,336][1054815] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-10 18:58:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 69812224. Throughput: 0: 8447.3. Samples: 69800000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:58:48,348][1054527] Avg episode reward: [(0, '3808.610')] [2023-03-10 18:58:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136352_69812224.pth... [2023-03-10 18:58:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000135848_69554176.pth [2023-03-10 18:58:51,225][1054815] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-10 18:58:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 69853184. Throughput: 0: 8431.6. Samples: 69850464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:58:53,348][1054527] Avg episode reward: [(0, '3488.152')] [2023-03-10 18:58:56,125][1054815] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-10 18:58:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8650.2). Total num frames: 69894144. Throughput: 0: 8409.1. Samples: 69875312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:58:58,348][1054527] Avg episode reward: [(0, '3336.829')] [2023-03-10 18:59:01,161][1054815] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-10 18:59:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8636.3). Total num frames: 69935104. Throughput: 0: 8393.6. Samples: 69923700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:03,349][1054527] Avg episode reward: [(0, '3770.634')] [2023-03-10 18:59:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136592_69935104.pth... [2023-03-10 18:59:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136096_69681152.pth [2023-03-10 18:59:06,387][1054815] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-10 18:59:08,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8328.5, 300 sec: 8608.5). Total num frames: 69971968. Throughput: 0: 8354.9. Samples: 69971840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:08,348][1054527] Avg episode reward: [(0, '3619.490')] [2023-03-10 18:59:11,619][1054815] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-10 18:59:13,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 70012928. Throughput: 0: 8343.6. Samples: 69995172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:13,348][1054527] Avg episode reward: [(0, '3822.861')] [2023-03-10 18:59:16,448][1054815] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-10 18:59:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 70057984. Throughput: 0: 8360.6. Samples: 70045448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:18,348][1054527] Avg episode reward: [(0, '3452.211')] [2023-03-10 18:59:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136832_70057984.pth... [2023-03-10 18:59:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136352_69812224.pth [2023-03-10 18:59:21,177][1054815] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-10 18:59:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8608.5). Total num frames: 70098944. Throughput: 0: 8392.1. Samples: 70097736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:23,348][1054527] Avg episode reward: [(0, '3377.549')] [2023-03-10 18:59:26,021][1054815] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-10 18:59:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 70144000. Throughput: 0: 8348.9. Samples: 70122388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:28,348][1054527] Avg episode reward: [(0, '3572.005')] [2023-03-10 18:59:30,635][1054815] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-10 18:59:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 70184960. Throughput: 0: 8306.4. Samples: 70173788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:33,349][1054527] Avg episode reward: [(0, '4018.206')] [2023-03-10 18:59:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137080_70184960.pth... [2023-03-10 18:59:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136592_69935104.pth [2023-03-10 18:59:35,489][1054815] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-10 18:59:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 70230016. Throughput: 0: 8344.9. Samples: 70225984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:38,348][1054527] Avg episode reward: [(0, '4064.742')] [2023-03-10 18:59:40,326][1054815] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-10 18:59:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 70266880. Throughput: 0: 8337.4. Samples: 70250496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:43,348][1054527] Avg episode reward: [(0, '4091.966')] [2023-03-10 18:59:45,250][1054815] Updated weights for policy 0, policy_version 137280 (0.0004) [2023-03-10 18:59:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 70311936. Throughput: 0: 8381.6. Samples: 70300872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:48,348][1054527] Avg episode reward: [(0, '4097.450')] [2023-03-10 18:59:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137328_70311936.pth... [2023-03-10 18:59:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000136832_70057984.pth [2023-03-10 18:59:49,848][1054815] Updated weights for policy 0, policy_version 137360 (0.0006) [2023-03-10 18:59:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 70356992. Throughput: 0: 8514.8. Samples: 70355004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:53,348][1054527] Avg episode reward: [(0, '4355.482')] [2023-03-10 18:59:54,683][1054815] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-10 18:59:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 70397952. Throughput: 0: 8497.0. Samples: 70377536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 18:59:58,348][1054527] Avg episode reward: [(0, '4391.932')] [2023-03-10 18:59:59,563][1054815] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-10 19:00:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 70438912. Throughput: 0: 8504.8. Samples: 70428164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:03,348][1054527] Avg episode reward: [(0, '4315.178')] [2023-03-10 19:00:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137576_70438912.pth... [2023-03-10 19:00:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137080_70184960.pth [2023-03-10 19:00:04,668][1054815] Updated weights for policy 0, policy_version 137600 (0.0004) [2023-03-10 19:00:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.0, 300 sec: 8580.8). Total num frames: 70479872. Throughput: 0: 8467.2. Samples: 70478760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:08,348][1054527] Avg episode reward: [(0, '4297.790')] [2023-03-10 19:00:09,572][1054815] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-10 19:00:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 70520832. Throughput: 0: 8481.5. Samples: 70504056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:13,348][1054527] Avg episode reward: [(0, '4305.435')] [2023-03-10 19:00:14,304][1054815] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-10 19:00:18,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 70565888. Throughput: 0: 8469.4. Samples: 70554908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:18,348][1054527] Avg episode reward: [(0, '4381.462')] [2023-03-10 19:00:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137824_70565888.pth... [2023-03-10 19:00:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137328_70311936.pth [2023-03-10 19:00:19,189][1054815] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-10 19:00:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 70606848. Throughput: 0: 8392.5. Samples: 70603648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:23,348][1054527] Avg episode reward: [(0, '4419.056')] [2023-03-10 19:00:24,150][1054815] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-10 19:00:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 70647808. Throughput: 0: 8429.3. Samples: 70629812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:28,348][1054527] Avg episode reward: [(0, '4377.194')] [2023-03-10 19:00:28,968][1054815] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-10 19:00:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 70688768. Throughput: 0: 8391.8. Samples: 70678504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:33,348][1054527] Avg episode reward: [(0, '4458.413')] [2023-03-10 19:00:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138064_70688768.pth... [2023-03-10 19:00:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137576_70438912.pth [2023-03-10 19:00:34,154][1054815] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-10 19:00:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 70729728. Throughput: 0: 8298.6. Samples: 70728440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:38,348][1054527] Avg episode reward: [(0, '4307.593')] [2023-03-10 19:00:39,070][1054815] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-10 19:00:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 70770688. Throughput: 0: 8312.2. Samples: 70751584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:00:43,348][1054527] Avg episode reward: [(0, '4491.169')] [2023-03-10 19:00:43,993][1054815] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-10 19:00:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 70811648. Throughput: 0: 8314.8. Samples: 70802328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:00:48,348][1054527] Avg episode reward: [(0, '4309.570')] [2023-03-10 19:00:48,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138304_70811648.pth... [2023-03-10 19:00:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000137824_70565888.pth [2023-03-10 19:00:49,000][1054815] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-10 19:00:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8553.0). Total num frames: 70852608. Throughput: 0: 8294.7. Samples: 70852020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:00:53,349][1054527] Avg episode reward: [(0, '4305.809')] [2023-03-10 19:00:53,992][1054815] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-10 19:00:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 70897664. Throughput: 0: 8290.5. Samples: 70877128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:00:58,348][1054527] Avg episode reward: [(0, '4524.551')] [2023-03-10 19:00:58,820][1054815] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-10 19:01:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 70938624. Throughput: 0: 8327.5. Samples: 70929644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:03,348][1054527] Avg episode reward: [(0, '4532.937')] [2023-03-10 19:01:03,386][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138560_70942720.pth... [2023-03-10 19:01:03,386][1054815] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-10 19:01:03,388][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138064_70688768.pth [2023-03-10 19:01:08,312][1054815] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-10 19:01:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 70983680. Throughput: 0: 8356.1. Samples: 70979672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:08,349][1054527] Avg episode reward: [(0, '4490.184')] [2023-03-10 19:01:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8539.1). Total num frames: 71020544. Throughput: 0: 8307.5. Samples: 71003652. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:13,348][1054527] Avg episode reward: [(0, '4428.889')] [2023-03-10 19:01:13,452][1054815] Updated weights for policy 0, policy_version 138720 (0.0004) [2023-03-10 19:01:18,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8260.3, 300 sec: 8525.2). Total num frames: 71061504. Throughput: 0: 8277.5. Samples: 71050992. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:18,348][1054527] Avg episode reward: [(0, '4170.248')] [2023-03-10 19:01:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138792_71061504.pth... [2023-03-10 19:01:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138304_70811648.pth [2023-03-10 19:01:18,530][1054815] Updated weights for policy 0, policy_version 138800 (0.0004) [2023-03-10 19:01:23,149][1054815] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-10 19:01:23,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8525.2). Total num frames: 71106560. Throughput: 0: 8335.3. Samples: 71103528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:23,348][1054527] Avg episode reward: [(0, '4485.270')] [2023-03-10 19:01:28,053][1054815] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-10 19:01:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 71147520. Throughput: 0: 8406.2. Samples: 71129864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:28,348][1054527] Avg episode reward: [(0, '4203.087')] [2023-03-10 19:01:32,693][1054815] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-10 19:01:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 71192576. Throughput: 0: 8400.7. Samples: 71180360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:33,348][1054527] Avg episode reward: [(0, '4372.379')] [2023-03-10 19:01:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139048_71192576.pth... [2023-03-10 19:01:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138560_70942720.pth [2023-03-10 19:01:37,514][1054815] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-10 19:01:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 71233536. Throughput: 0: 8455.0. Samples: 71232496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:38,348][1054527] Avg episode reward: [(0, '3834.255')] [2023-03-10 19:01:42,294][1054815] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-10 19:01:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.4). Total num frames: 71278592. Throughput: 0: 8457.7. Samples: 71257724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:43,349][1054527] Avg episode reward: [(0, '3749.129')] [2023-03-10 19:01:47,080][1054815] Updated weights for policy 0, policy_version 139280 (0.0006) [2023-03-10 19:01:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8497.5). Total num frames: 71319552. Throughput: 0: 8432.8. Samples: 71309120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:01:48,348][1054527] Avg episode reward: [(0, '4474.164')] [2023-03-10 19:01:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139296_71319552.pth... [2023-03-10 19:01:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000138792_71061504.pth [2023-03-10 19:01:51,743][1054815] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-10 19:01:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.4, 300 sec: 8511.3). Total num frames: 71364608. Throughput: 0: 8474.5. Samples: 71361024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:01:53,348][1054527] Avg episode reward: [(0, '4436.861')] [2023-03-10 19:01:56,405][1054815] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-10 19:01:58,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 71409664. Throughput: 0: 8549.0. Samples: 71388356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:01:58,348][1054527] Avg episode reward: [(0, '4495.191')] [2023-03-10 19:02:01,049][1054815] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-10 19:02:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 71450624. Throughput: 0: 8669.0. Samples: 71441096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:03,348][1054527] Avg episode reward: [(0, '4423.057')] [2023-03-10 19:02:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139552_71450624.pth... [2023-03-10 19:02:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139048_71192576.pth [2023-03-10 19:02:05,834][1054815] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-10 19:02:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 71495680. Throughput: 0: 8628.3. Samples: 71491800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:08,348][1054527] Avg episode reward: [(0, '4351.540')] [2023-03-10 19:02:10,524][1054815] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-10 19:02:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8511.4). Total num frames: 71536640. Throughput: 0: 8653.4. Samples: 71519264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:13,348][1054527] Avg episode reward: [(0, '4342.037')] [2023-03-10 19:02:15,243][1054815] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-10 19:02:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 71581696. Throughput: 0: 8666.1. Samples: 71570336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:18,348][1054527] Avg episode reward: [(0, '4462.891')] [2023-03-10 19:02:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139808_71581696.pth... [2023-03-10 19:02:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139296_71319552.pth [2023-03-10 19:02:20,089][1054815] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-10 19:02:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 71622656. Throughput: 0: 8635.5. Samples: 71621092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:23,348][1054527] Avg episode reward: [(0, '4457.877')] [2023-03-10 19:02:24,969][1054815] Updated weights for policy 0, policy_version 139920 (0.0005) [2023-03-10 19:02:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 71663616. Throughput: 0: 8626.5. Samples: 71645916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:28,348][1054527] Avg episode reward: [(0, '4520.769')] [2023-03-10 19:02:29,993][1054815] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-10 19:02:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 71704576. Throughput: 0: 8560.2. Samples: 71694328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:33,348][1054527] Avg episode reward: [(0, '4490.848')] [2023-03-10 19:02:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140048_71704576.pth... [2023-03-10 19:02:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139552_71450624.pth [2023-03-10 19:02:34,980][1054815] Updated weights for policy 0, policy_version 140080 (0.0006) [2023-03-10 19:02:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 71745536. Throughput: 0: 8535.0. Samples: 71745100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:38,348][1054527] Avg episode reward: [(0, '4414.387')] [2023-03-10 19:02:39,967][1054815] Updated weights for policy 0, policy_version 140160 (0.0006) [2023-03-10 19:02:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 71786496. Throughput: 0: 8467.4. Samples: 71769388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:43,348][1054527] Avg episode reward: [(0, '4505.586')] [2023-03-10 19:02:44,818][1054815] Updated weights for policy 0, policy_version 140240 (0.0006) [2023-03-10 19:02:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 71831552. Throughput: 0: 8406.5. Samples: 71819388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:48,348][1054527] Avg episode reward: [(0, '4037.408')] [2023-03-10 19:02:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140296_71831552.pth... [2023-03-10 19:02:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000139808_71581696.pth [2023-03-10 19:02:49,694][1054815] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-10 19:02:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 71872512. Throughput: 0: 8367.5. Samples: 71868336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:53,348][1054527] Avg episode reward: [(0, '4119.117')] [2023-03-10 19:02:54,615][1054815] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-10 19:02:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 71913472. Throughput: 0: 8351.6. Samples: 71895088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:02:58,348][1054527] Avg episode reward: [(0, '4204.850')] [2023-03-10 19:02:59,476][1054815] Updated weights for policy 0, policy_version 140480 (0.0006) [2023-03-10 19:03:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 71958528. Throughput: 0: 8349.8. Samples: 71946080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:03,348][1054527] Avg episode reward: [(0, '4140.434')] [2023-03-10 19:03:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140544_71958528.pth... [2023-03-10 19:03:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140048_71704576.pth [2023-03-10 19:03:04,086][1054815] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-10 19:03:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 71999488. Throughput: 0: 8369.3. Samples: 71997712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:08,348][1054527] Avg episode reward: [(0, '4141.748')] [2023-03-10 19:03:08,991][1054815] Updated weights for policy 0, policy_version 140640 (0.0004) [2023-03-10 19:03:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8441.9). Total num frames: 72044544. Throughput: 0: 8399.9. Samples: 72023912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:13,348][1054527] Avg episode reward: [(0, '4506.631')] [2023-03-10 19:03:13,806][1054815] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-10 19:03:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 72085504. Throughput: 0: 8437.4. Samples: 72074012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:18,348][1054527] Avg episode reward: [(0, '4499.688')] [2023-03-10 19:03:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140792_72085504.pth... [2023-03-10 19:03:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140296_71831552.pth [2023-03-10 19:03:18,447][1054815] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-10 19:03:22,637][1054815] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-10 19:03:23,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 72134656. Throughput: 0: 8596.8. Samples: 72131956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:23,348][1054527] Avg episode reward: [(0, '4323.225')] [2023-03-10 19:03:27,627][1054815] Updated weights for policy 0, policy_version 140960 (0.0006) [2023-03-10 19:03:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 72175616. Throughput: 0: 8612.2. Samples: 72156940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:28,348][1054527] Avg episode reward: [(0, '4415.306')] [2023-03-10 19:03:32,524][1054815] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-10 19:03:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 72216576. Throughput: 0: 8623.3. Samples: 72207436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:33,348][1054527] Avg episode reward: [(0, '4312.828')] [2023-03-10 19:03:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141048_72216576.pth... [2023-03-10 19:03:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140544_71958528.pth [2023-03-10 19:03:37,342][1054815] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-10 19:03:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 72257536. Throughput: 0: 8648.9. Samples: 72257536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:38,359][1054527] Avg episode reward: [(0, '4396.577')] [2023-03-10 19:03:42,222][1054815] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-10 19:03:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 72302592. Throughput: 0: 8602.0. Samples: 72282176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:43,359][1054527] Avg episode reward: [(0, '4283.938')] [2023-03-10 19:03:47,251][1054815] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-10 19:03:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 72343552. Throughput: 0: 8568.5. Samples: 72331664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:48,359][1054527] Avg episode reward: [(0, '4493.724')] [2023-03-10 19:03:48,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141296_72343552.pth... [2023-03-10 19:03:48,365][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000140792_72085504.pth [2023-03-10 19:03:52,205][1054815] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-10 19:03:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 72384512. Throughput: 0: 8531.9. Samples: 72381648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:03:53,348][1054527] Avg episode reward: [(0, '3830.936')] [2023-03-10 19:03:57,195][1054815] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-10 19:03:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 72425472. Throughput: 0: 8491.6. Samples: 72406032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:03:58,348][1054527] Avg episode reward: [(0, '3838.277')] [2023-03-10 19:04:02,061][1054815] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-10 19:04:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 72466432. Throughput: 0: 8497.5. Samples: 72456400. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:03,348][1054527] Avg episode reward: [(0, '4359.153')] [2023-03-10 19:04:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141536_72466432.pth... [2023-03-10 19:04:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141048_72216576.pth [2023-03-10 19:04:06,937][1054815] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-10 19:04:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 72507392. Throughput: 0: 8334.6. Samples: 72507012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:08,348][1054527] Avg episode reward: [(0, '4232.489')] [2023-03-10 19:04:11,821][1054815] Updated weights for policy 0, policy_version 141680 (0.0006) [2023-03-10 19:04:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 72552448. Throughput: 0: 8333.0. Samples: 72531924. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:13,349][1054527] Avg episode reward: [(0, '4321.577')] [2023-03-10 19:04:16,765][1054815] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-10 19:04:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 72593408. Throughput: 0: 8307.1. Samples: 72581256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:18,348][1054527] Avg episode reward: [(0, '4683.654')] [2023-03-10 19:04:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141784_72593408.pth... [2023-03-10 19:04:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141296_72343552.pth [2023-03-10 19:04:21,569][1054815] Updated weights for policy 0, policy_version 141840 (0.0006) [2023-03-10 19:04:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 72634368. Throughput: 0: 8367.9. Samples: 72634092. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:23,348][1054527] Avg episode reward: [(0, '3075.341')] [2023-03-10 19:04:26,366][1054815] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-10 19:04:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 72679424. Throughput: 0: 8372.2. Samples: 72658924. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:28,349][1054527] Avg episode reward: [(0, '4230.244')] [2023-03-10 19:04:31,115][1054815] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-10 19:04:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 72720384. Throughput: 0: 8434.7. Samples: 72711224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:33,348][1054527] Avg episode reward: [(0, '4489.570')] [2023-03-10 19:04:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142032_72720384.pth... [2023-03-10 19:04:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141536_72466432.pth [2023-03-10 19:04:35,880][1054815] Updated weights for policy 0, policy_version 142080 (0.0006) [2023-03-10 19:04:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 72765440. Throughput: 0: 8439.1. Samples: 72761408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:38,349][1054527] Avg episode reward: [(0, '4386.864')] [2023-03-10 19:04:40,593][1054815] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-10 19:04:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 72810496. Throughput: 0: 8486.9. Samples: 72787944. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:43,348][1054527] Avg episode reward: [(0, '4208.099')] [2023-03-10 19:04:45,035][1054815] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-10 19:04:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 72855552. Throughput: 0: 8594.9. Samples: 72843172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:48,348][1054527] Avg episode reward: [(0, '4541.018')] [2023-03-10 19:04:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142296_72855552.pth... [2023-03-10 19:04:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000141784_72593408.pth [2023-03-10 19:04:49,762][1054815] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-10 19:04:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 72896512. Throughput: 0: 8587.4. Samples: 72893444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:04:53,349][1054527] Avg episode reward: [(0, '4346.278')] [2023-03-10 19:04:54,669][1054815] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-10 19:04:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 72937472. Throughput: 0: 8569.3. Samples: 72917540. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:04:58,348][1054527] Avg episode reward: [(0, '4293.890')] [2023-03-10 19:04:59,677][1054815] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-10 19:05:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 72978432. Throughput: 0: 8565.3. Samples: 72966692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:03,348][1054527] Avg episode reward: [(0, '4334.319')] [2023-03-10 19:05:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142536_72978432.pth... [2023-03-10 19:05:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142032_72720384.pth [2023-03-10 19:05:04,560][1054815] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-10 19:05:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 73019392. Throughput: 0: 8550.3. Samples: 73018856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:08,348][1054527] Avg episode reward: [(0, '4370.358')] [2023-03-10 19:05:09,388][1054815] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-10 19:05:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 73064448. Throughput: 0: 8552.3. Samples: 73043776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:13,348][1054527] Avg episode reward: [(0, '4401.986')] [2023-03-10 19:05:14,312][1054815] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-10 19:05:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 73105408. Throughput: 0: 8488.0. Samples: 73093184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:18,348][1054527] Avg episode reward: [(0, '4009.905')] [2023-03-10 19:05:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142784_73105408.pth... [2023-03-10 19:05:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142296_72855552.pth [2023-03-10 19:05:19,235][1054815] Updated weights for policy 0, policy_version 142800 (0.0005) [2023-03-10 19:05:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 73146368. Throughput: 0: 8511.7. Samples: 73144436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:23,348][1054527] Avg episode reward: [(0, '4480.274')] [2023-03-10 19:05:24,223][1054815] Updated weights for policy 0, policy_version 142880 (0.0006) [2023-03-10 19:05:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 73187328. Throughput: 0: 8451.3. Samples: 73168252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:28,348][1054527] Avg episode reward: [(0, '4439.795')] [2023-03-10 19:05:29,025][1054815] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-10 19:05:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 73232384. Throughput: 0: 8406.1. Samples: 73221448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:33,349][1054527] Avg episode reward: [(0, '4573.238')] [2023-03-10 19:05:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143032_73232384.pth... [2023-03-10 19:05:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142536_72978432.pth [2023-03-10 19:05:33,611][1054815] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-10 19:05:38,215][1054815] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-10 19:05:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 73277440. Throughput: 0: 8451.0. Samples: 73273740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:38,348][1054527] Avg episode reward: [(0, '4320.991')] [2023-03-10 19:05:42,968][1054815] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-10 19:05:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 73318400. Throughput: 0: 8485.3. Samples: 73299380. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:43,348][1054527] Avg episode reward: [(0, '4162.067')] [2023-03-10 19:05:47,897][1054815] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-10 19:05:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 73359360. Throughput: 0: 8541.9. Samples: 73351076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:48,348][1054527] Avg episode reward: [(0, '3812.389')] [2023-03-10 19:05:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143280_73359360.pth... [2023-03-10 19:05:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000142784_73105408.pth [2023-03-10 19:05:53,112][1054815] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-10 19:05:53,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 73400320. Throughput: 0: 8432.5. Samples: 73398320. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:53,348][1054527] Avg episode reward: [(0, '4122.694')] [2023-03-10 19:05:57,935][1054815] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-10 19:05:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8483.6). Total num frames: 73441280. Throughput: 0: 8438.1. Samples: 73423492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:05:58,348][1054527] Avg episode reward: [(0, '4271.496')] [2023-03-10 19:06:02,915][1054815] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-10 19:06:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 73482240. Throughput: 0: 8459.0. Samples: 73473840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:03,348][1054527] Avg episode reward: [(0, '4202.312')] [2023-03-10 19:06:03,391][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143528_73486336.pth... [2023-03-10 19:06:03,393][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143032_73232384.pth [2023-03-10 19:06:07,620][1054815] Updated weights for policy 0, policy_version 143600 (0.0006) [2023-03-10 19:06:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 73527296. Throughput: 0: 8462.3. Samples: 73525240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:08,348][1054527] Avg episode reward: [(0, '4248.626')] [2023-03-10 19:06:12,023][1054815] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-10 19:06:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8511.4). Total num frames: 73572352. Throughput: 0: 8581.7. Samples: 73554428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:13,348][1054527] Avg episode reward: [(0, '4377.199')] [2023-03-10 19:06:16,684][1054815] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-10 19:06:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 73617408. Throughput: 0: 8552.4. Samples: 73606304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:18,349][1054527] Avg episode reward: [(0, '4374.915')] [2023-03-10 19:06:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143784_73617408.pth... [2023-03-10 19:06:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143280_73359360.pth [2023-03-10 19:06:21,391][1054815] Updated weights for policy 0, policy_version 143840 (0.0005) [2023-03-10 19:06:23,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 73662464. Throughput: 0: 8552.5. Samples: 73658600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:23,348][1054527] Avg episode reward: [(0, '4364.298')] [2023-03-10 19:06:25,920][1054815] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-10 19:06:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 73707520. Throughput: 0: 8609.5. Samples: 73686808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:28,348][1054527] Avg episode reward: [(0, '4238.039')] [2023-03-10 19:06:30,573][1054815] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-10 19:06:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8539.1). Total num frames: 73752576. Throughput: 0: 8630.3. Samples: 73739440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:33,348][1054527] Avg episode reward: [(0, '4394.434')] [2023-03-10 19:06:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144048_73752576.pth... [2023-03-10 19:06:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143528_73486336.pth [2023-03-10 19:06:35,242][1054815] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-10 19:06:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 73793536. Throughput: 0: 8758.4. Samples: 73792448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:38,348][1054527] Avg episode reward: [(0, '4386.737')] [2023-03-10 19:06:39,613][1054815] Updated weights for policy 0, policy_version 144160 (0.0004) [2023-03-10 19:06:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8539.1). Total num frames: 73838592. Throughput: 0: 8836.4. Samples: 73821128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:43,348][1054527] Avg episode reward: [(0, '4325.902')] [2023-03-10 19:06:44,350][1054815] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-10 19:06:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8539.1). Total num frames: 73883648. Throughput: 0: 8832.4. Samples: 73871296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:48,348][1054527] Avg episode reward: [(0, '4258.171')] [2023-03-10 19:06:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144304_73883648.pth... [2023-03-10 19:06:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000143784_73617408.pth [2023-03-10 19:06:49,238][1054815] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-10 19:06:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 73924608. Throughput: 0: 8794.0. Samples: 73920972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:53,348][1054527] Avg episode reward: [(0, '4583.118')] [2023-03-10 19:06:54,073][1054815] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-10 19:06:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 73969664. Throughput: 0: 8709.9. Samples: 73946376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:06:58,349][1054527] Avg episode reward: [(0, '4499.286')] [2023-03-10 19:06:58,799][1054815] Updated weights for policy 0, policy_version 144480 (0.0005) [2023-03-10 19:07:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8525.2). Total num frames: 74010624. Throughput: 0: 8757.7. Samples: 74000400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:03,348][1054527] Avg episode reward: [(0, '4466.939')] [2023-03-10 19:07:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144552_74010624.pth... [2023-03-10 19:07:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144048_73752576.pth [2023-03-10 19:07:03,616][1054815] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-10 19:07:08,231][1054815] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-10 19:07:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 74055680. Throughput: 0: 8734.4. Samples: 74051648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:08,348][1054527] Avg episode reward: [(0, '4469.186')] [2023-03-10 19:07:13,121][1054815] Updated weights for policy 0, policy_version 144720 (0.0004) [2023-03-10 19:07:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 74096640. Throughput: 0: 8653.7. Samples: 74076224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:13,348][1054527] Avg episode reward: [(0, '4722.937')] [2023-03-10 19:07:13,349][1054771] Saving new best policy, reward=4722.937! [2023-03-10 19:07:18,006][1054815] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-10 19:07:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 74137600. Throughput: 0: 8621.2. Samples: 74127396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:18,348][1054527] Avg episode reward: [(0, '4536.519')] [2023-03-10 19:07:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144800_74137600.pth... [2023-03-10 19:07:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144304_73883648.pth [2023-03-10 19:07:22,563][1054815] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-10 19:07:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8539.1). Total num frames: 74182656. Throughput: 0: 8639.4. Samples: 74181224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:23,348][1054527] Avg episode reward: [(0, '3197.228')] [2023-03-10 19:07:26,907][1054815] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-10 19:07:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 74227712. Throughput: 0: 8658.6. Samples: 74210764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:28,348][1054527] Avg episode reward: [(0, '3633.786')] [2023-03-10 19:07:31,707][1054815] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-10 19:07:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 74272768. Throughput: 0: 8665.4. Samples: 74261240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:33,348][1054527] Avg episode reward: [(0, '4158.150')] [2023-03-10 19:07:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145064_74272768.pth... [2023-03-10 19:07:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144552_74010624.pth [2023-03-10 19:07:36,674][1054815] Updated weights for policy 0, policy_version 145120 (0.0004) [2023-03-10 19:07:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 74313728. Throughput: 0: 8701.6. Samples: 74312544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:38,348][1054527] Avg episode reward: [(0, '4385.348')] [2023-03-10 19:07:41,137][1054815] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-10 19:07:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 74358784. Throughput: 0: 8726.9. Samples: 74339084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:43,348][1054527] Avg episode reward: [(0, '4645.246')] [2023-03-10 19:07:45,958][1054815] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-10 19:07:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 74403840. Throughput: 0: 8690.6. Samples: 74391476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:48,359][1054527] Avg episode reward: [(0, '4642.113')] [2023-03-10 19:07:48,363][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145320_74403840.pth... [2023-03-10 19:07:48,364][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000144800_74137600.pth [2023-03-10 19:07:50,512][1054815] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-10 19:07:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 74448896. Throughput: 0: 8734.8. Samples: 74444712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:53,359][1054527] Avg episode reward: [(0, '4132.394')] [2023-03-10 19:07:55,224][1054815] Updated weights for policy 0, policy_version 145440 (0.0004) [2023-03-10 19:07:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 74489856. Throughput: 0: 8742.2. Samples: 74469624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:07:58,348][1054527] Avg episode reward: [(0, '4412.953')] [2023-03-10 19:07:59,911][1054815] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-10 19:08:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 74530816. Throughput: 0: 8780.9. Samples: 74522536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:03,348][1054527] Avg episode reward: [(0, '4301.087')] [2023-03-10 19:08:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145568_74530816.pth... [2023-03-10 19:08:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145064_74272768.pth [2023-03-10 19:08:04,934][1054815] Updated weights for policy 0, policy_version 145600 (0.0005) [2023-03-10 19:08:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 74575872. Throughput: 0: 8701.8. Samples: 74572804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:08,348][1054527] Avg episode reward: [(0, '3938.664')] [2023-03-10 19:08:09,539][1054815] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-10 19:08:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 74620928. Throughput: 0: 8649.8. Samples: 74600004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:13,348][1054527] Avg episode reward: [(0, '4591.086')] [2023-03-10 19:08:14,076][1054815] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-10 19:08:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 74661888. Throughput: 0: 8713.1. Samples: 74653328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:18,348][1054527] Avg episode reward: [(0, '4682.908')] [2023-03-10 19:08:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145824_74661888.pth... [2023-03-10 19:08:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145320_74403840.pth [2023-03-10 19:08:18,933][1054815] Updated weights for policy 0, policy_version 145840 (0.0006) [2023-03-10 19:08:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 74702848. Throughput: 0: 8673.4. Samples: 74702848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:23,348][1054527] Avg episode reward: [(0, '4541.890')] [2023-03-10 19:08:23,890][1054815] Updated weights for policy 0, policy_version 145920 (0.0006) [2023-03-10 19:08:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 74743808. Throughput: 0: 8623.5. Samples: 74727140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:28,348][1054527] Avg episode reward: [(0, '4674.320')] [2023-03-10 19:08:29,065][1054815] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-10 19:08:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.4, 300 sec: 8566.9). Total num frames: 74784768. Throughput: 0: 8502.1. Samples: 74774068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:33,348][1054527] Avg episode reward: [(0, '4607.278')] [2023-03-10 19:08:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146064_74784768.pth... [2023-03-10 19:08:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145568_74530816.pth [2023-03-10 19:08:34,104][1054815] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-10 19:08:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 74825728. Throughput: 0: 8457.5. Samples: 74825300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:38,348][1054527] Avg episode reward: [(0, '4553.781')] [2023-03-10 19:08:38,920][1054815] Updated weights for policy 0, policy_version 146160 (0.0006) [2023-03-10 19:08:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 74870784. Throughput: 0: 8466.0. Samples: 74850592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:43,348][1054527] Avg episode reward: [(0, '4677.219')] [2023-03-10 19:08:43,501][1054815] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-10 19:08:48,280][1054815] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-10 19:08:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 74915840. Throughput: 0: 8467.2. Samples: 74903560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:48,348][1054527] Avg episode reward: [(0, '4546.186')] [2023-03-10 19:08:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146320_74915840.pth... [2023-03-10 19:08:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000145824_74661888.pth [2023-03-10 19:08:52,893][1054815] Updated weights for policy 0, policy_version 146400 (0.0006) [2023-03-10 19:08:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 74956800. Throughput: 0: 8532.5. Samples: 74956764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:53,348][1054527] Avg episode reward: [(0, '4492.599')] [2023-03-10 19:08:57,332][1054815] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-10 19:08:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 75005952. Throughput: 0: 8551.7. Samples: 74984832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:08:58,348][1054527] Avg episode reward: [(0, '4584.542')] [2023-03-10 19:09:02,035][1054815] Updated weights for policy 0, policy_version 146560 (0.0006) [2023-03-10 19:09:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 75046912. Throughput: 0: 8539.7. Samples: 75037616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:09:03,348][1054527] Avg episode reward: [(0, '4611.037')] [2023-03-10 19:09:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146576_75046912.pth... [2023-03-10 19:09:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146064_74784768.pth [2023-03-10 19:09:06,854][1054815] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-10 19:09:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 75091968. Throughput: 0: 8572.3. Samples: 75088600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:09:08,348][1054527] Avg episode reward: [(0, '4674.500')] [2023-03-10 19:09:11,396][1054815] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-10 19:09:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8608.5). Total num frames: 75132928. Throughput: 0: 8633.9. Samples: 75115668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:13,348][1054527] Avg episode reward: [(0, '4566.159')] [2023-03-10 19:09:16,461][1054815] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-10 19:09:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 75177984. Throughput: 0: 8694.3. Samples: 75165312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:18,348][1054527] Avg episode reward: [(0, '4538.520')] [2023-03-10 19:09:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146832_75177984.pth... [2023-03-10 19:09:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146320_74915840.pth [2023-03-10 19:09:21,204][1054815] Updated weights for policy 0, policy_version 146880 (0.0006) [2023-03-10 19:09:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 75218944. Throughput: 0: 8683.3. Samples: 75216048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:23,348][1054527] Avg episode reward: [(0, '4726.757')] [2023-03-10 19:09:23,349][1054771] Saving new best policy, reward=4726.757! [2023-03-10 19:09:25,956][1054815] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-10 19:09:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 75259904. Throughput: 0: 8725.1. Samples: 75243220. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:28,348][1054527] Avg episode reward: [(0, '4638.869')] [2023-03-10 19:09:30,773][1054815] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-10 19:09:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8608.5). Total num frames: 75304960. Throughput: 0: 8663.2. Samples: 75293404. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:33,348][1054527] Avg episode reward: [(0, '4643.266')] [2023-03-10 19:09:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147080_75304960.pth... [2023-03-10 19:09:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146576_75046912.pth [2023-03-10 19:09:35,431][1054815] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-10 19:09:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 75350016. Throughput: 0: 8650.4. Samples: 75346032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:38,348][1054527] Avg episode reward: [(0, '4589.935')] [2023-03-10 19:09:40,348][1054815] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-10 19:09:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 75390976. Throughput: 0: 8575.2. Samples: 75370716. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:43,348][1054527] Avg episode reward: [(0, '4407.279')] [2023-03-10 19:09:45,217][1054815] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-10 19:09:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 75431936. Throughput: 0: 8562.3. Samples: 75422920. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:48,348][1054527] Avg episode reward: [(0, '4644.724')] [2023-03-10 19:09:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147328_75431936.pth... [2023-03-10 19:09:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000146832_75177984.pth [2023-03-10 19:09:50,229][1054815] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-10 19:09:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 75472896. Throughput: 0: 8464.2. Samples: 75469488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:53,348][1054527] Avg episode reward: [(0, '4628.671')] [2023-03-10 19:09:55,138][1054815] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-10 19:09:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 75513856. Throughput: 0: 8438.7. Samples: 75495412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:09:58,348][1054527] Avg episode reward: [(0, '4721.172')] [2023-03-10 19:10:00,138][1054815] Updated weights for policy 0, policy_version 147520 (0.0004) [2023-03-10 19:10:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8608.5). Total num frames: 75558912. Throughput: 0: 8471.4. Samples: 75546524. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:10:03,348][1054527] Avg episode reward: [(0, '4662.995')] [2023-03-10 19:10:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147576_75558912.pth... [2023-03-10 19:10:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147080_75304960.pth [2023-03-10 19:10:04,693][1054815] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-10 19:10:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 75599872. Throughput: 0: 8440.4. Samples: 75595868. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:10:08,349][1054527] Avg episode reward: [(0, '4507.730')] [2023-03-10 19:10:09,889][1054815] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-10 19:10:13,348][1054527] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8580.8). Total num frames: 75636736. Throughput: 0: 8374.9. Samples: 75620092. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:10:13,348][1054527] Avg episode reward: [(0, '4587.005')] [2023-03-10 19:10:14,770][1054815] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-10 19:10:18,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 75681792. Throughput: 0: 8359.2. Samples: 75669568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:18,348][1054527] Avg episode reward: [(0, '4598.174')] [2023-03-10 19:10:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147816_75681792.pth... [2023-03-10 19:10:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147328_75431936.pth [2023-03-10 19:10:19,753][1054815] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-10 19:10:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 75722752. Throughput: 0: 8330.1. Samples: 75720888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:23,348][1054527] Avg episode reward: [(0, '4689.260')] [2023-03-10 19:10:24,490][1054815] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-10 19:10:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 75767808. Throughput: 0: 8363.6. Samples: 75747076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:28,348][1054527] Avg episode reward: [(0, '4669.228')] [2023-03-10 19:10:29,109][1054815] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-10 19:10:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8580.8). Total num frames: 75808768. Throughput: 0: 8359.7. Samples: 75799104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:33,348][1054527] Avg episode reward: [(0, '4724.870')] [2023-03-10 19:10:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148064_75808768.pth... [2023-03-10 19:10:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147576_75558912.pth [2023-03-10 19:10:34,016][1054815] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-10 19:10:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 75853824. Throughput: 0: 8465.4. Samples: 75850432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:38,348][1054527] Avg episode reward: [(0, '4635.043')] [2023-03-10 19:10:38,724][1054815] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-10 19:10:43,264][1054815] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-10 19:10:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 75898880. Throughput: 0: 8510.9. Samples: 75878400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:43,348][1054527] Avg episode reward: [(0, '4730.721')] [2023-03-10 19:10:43,349][1054771] Saving new best policy, reward=4730.721! [2023-03-10 19:10:48,003][1054815] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-10 19:10:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 75939840. Throughput: 0: 8511.9. Samples: 75929560. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:48,348][1054527] Avg episode reward: [(0, '4721.752')] [2023-03-10 19:10:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148320_75939840.pth... [2023-03-10 19:10:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000147816_75681792.pth [2023-03-10 19:10:52,647][1054815] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-10 19:10:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 75984896. Throughput: 0: 8592.0. Samples: 75982508. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:53,348][1054527] Avg episode reward: [(0, '4210.567')] [2023-03-10 19:10:57,314][1054815] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-10 19:10:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 76029952. Throughput: 0: 8647.5. Samples: 76009232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:10:58,348][1054527] Avg episode reward: [(0, '3413.947')] [2023-03-10 19:11:01,795][1054815] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-10 19:11:03,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 76075008. Throughput: 0: 8738.3. Samples: 76062792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:11:03,349][1054527] Avg episode reward: [(0, '4481.773')] [2023-03-10 19:11:03,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148584_76075008.pth... [2023-03-10 19:11:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148064_75808768.pth [2023-03-10 19:11:06,517][1054815] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-10 19:11:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 76115968. Throughput: 0: 8769.9. Samples: 76115532. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:11:08,348][1054527] Avg episode reward: [(0, '4669.386')] [2023-03-10 19:11:11,316][1054815] Updated weights for policy 0, policy_version 148720 (0.0004) [2023-03-10 19:11:13,348][1054527] Fps is (10 sec: 8601.8, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 76161024. Throughput: 0: 8744.2. Samples: 76140564. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:11:13,348][1054527] Avg episode reward: [(0, '4581.652')] [2023-03-10 19:11:16,076][1054815] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-10 19:11:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 76206080. Throughput: 0: 8755.3. Samples: 76193092. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:18,349][1054527] Avg episode reward: [(0, '4650.937')] [2023-03-10 19:11:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148840_76206080.pth... [2023-03-10 19:11:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148320_75939840.pth [2023-03-10 19:11:20,673][1054815] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-10 19:11:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 76247040. Throughput: 0: 8777.3. Samples: 76245412. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:23,348][1054527] Avg episode reward: [(0, '4665.007')] [2023-03-10 19:11:25,570][1054815] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-10 19:11:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 76288000. Throughput: 0: 8703.1. Samples: 76270040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:28,348][1054527] Avg episode reward: [(0, '4712.809')] [2023-03-10 19:11:30,318][1054815] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-10 19:11:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 76333056. Throughput: 0: 8746.0. Samples: 76323128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:33,348][1054527] Avg episode reward: [(0, '4715.447')] [2023-03-10 19:11:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149088_76333056.pth... [2023-03-10 19:11:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148584_76075008.pth [2023-03-10 19:11:34,900][1054815] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-10 19:11:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 76378112. Throughput: 0: 8723.0. Samples: 76375044. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:38,348][1054527] Avg episode reward: [(0, '4715.868')] [2023-03-10 19:11:39,661][1054815] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-10 19:11:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 76419072. Throughput: 0: 8734.5. Samples: 76402284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:43,348][1054527] Avg episode reward: [(0, '4617.700')] [2023-03-10 19:11:44,274][1054815] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-10 19:11:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 76464128. Throughput: 0: 8730.6. Samples: 76455668. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:48,348][1054527] Avg episode reward: [(0, '4668.595')] [2023-03-10 19:11:48,374][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149352_76468224.pth... [2023-03-10 19:11:48,376][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000148840_76206080.pth [2023-03-10 19:11:48,768][1054815] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-10 19:11:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 76509184. Throughput: 0: 8714.7. Samples: 76507692. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:53,348][1054527] Avg episode reward: [(0, '4666.649')] [2023-03-10 19:11:53,535][1054815] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-10 19:11:58,313][1054815] Updated weights for policy 0, policy_version 149520 (0.0004) [2023-03-10 19:11:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 76554240. Throughput: 0: 8731.6. Samples: 76533488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:11:58,349][1054527] Avg episode reward: [(0, '4664.954')] [2023-03-10 19:12:02,946][1054815] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-10 19:12:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8608.5). Total num frames: 76595200. Throughput: 0: 8722.3. Samples: 76585596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:12:03,348][1054527] Avg episode reward: [(0, '4716.066')] [2023-03-10 19:12:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149600_76595200.pth... [2023-03-10 19:12:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149088_76333056.pth [2023-03-10 19:12:07,876][1054815] Updated weights for policy 0, policy_version 149680 (0.0004) [2023-03-10 19:12:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 76640256. Throughput: 0: 8674.1. Samples: 76635748. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:12:08,348][1054527] Avg episode reward: [(0, '4493.443')] [2023-03-10 19:12:12,713][1054815] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-10 19:12:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 76681216. Throughput: 0: 8683.6. Samples: 76660800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:12:13,348][1054527] Avg episode reward: [(0, '4395.780')] [2023-03-10 19:12:17,644][1054815] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-10 19:12:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 76722176. Throughput: 0: 8644.3. Samples: 76712120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:12:18,348][1054527] Avg episode reward: [(0, '4396.374')] [2023-03-10 19:12:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149848_76722176.pth... [2023-03-10 19:12:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149352_76468224.pth [2023-03-10 19:12:22,615][1054815] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-10 19:12:23,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 76763136. Throughput: 0: 8574.1. Samples: 76760880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:23,348][1054527] Avg episode reward: [(0, '4579.557')] [2023-03-10 19:12:27,412][1054815] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-10 19:12:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 76804096. Throughput: 0: 8536.5. Samples: 76786424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:28,348][1054527] Avg episode reward: [(0, '4629.533')] [2023-03-10 19:12:32,114][1054815] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-10 19:12:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 76849152. Throughput: 0: 8486.2. Samples: 76837548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:33,349][1054527] Avg episode reward: [(0, '4537.242')] [2023-03-10 19:12:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150096_76849152.pth... [2023-03-10 19:12:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149600_76595200.pth [2023-03-10 19:12:36,903][1054815] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-10 19:12:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 76890112. Throughput: 0: 8486.8. Samples: 76889596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:38,348][1054527] Avg episode reward: [(0, '4139.467')] [2023-03-10 19:12:41,705][1054815] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-10 19:12:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 76935168. Throughput: 0: 8472.5. Samples: 76914752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:43,349][1054527] Avg episode reward: [(0, '4718.965')] [2023-03-10 19:12:46,473][1054815] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-10 19:12:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 76976128. Throughput: 0: 8483.6. Samples: 76967360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:48,348][1054527] Avg episode reward: [(0, '4728.341')] [2023-03-10 19:12:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150344_76976128.pth... [2023-03-10 19:12:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000149848_76722176.pth [2023-03-10 19:12:51,021][1054815] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-10 19:12:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 77021184. Throughput: 0: 8558.8. Samples: 77020892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:53,348][1054527] Avg episode reward: [(0, '4725.044')] [2023-03-10 19:12:55,965][1054815] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-10 19:12:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 77062144. Throughput: 0: 8549.5. Samples: 77045528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:12:58,348][1054527] Avg episode reward: [(0, '4675.377')] [2023-03-10 19:13:01,062][1054815] Updated weights for policy 0, policy_version 150560 (0.0006) [2023-03-10 19:13:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 77103104. Throughput: 0: 8454.9. Samples: 77092592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:03,348][1054527] Avg episode reward: [(0, '4617.870')] [2023-03-10 19:13:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150592_77103104.pth... [2023-03-10 19:13:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150096_76849152.pth [2023-03-10 19:13:06,042][1054815] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-10 19:13:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 77144064. Throughput: 0: 8499.7. Samples: 77143368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:08,348][1054527] Avg episode reward: [(0, '4673.924')] [2023-03-10 19:13:10,803][1054815] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-10 19:13:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 77189120. Throughput: 0: 8493.9. Samples: 77168648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:13,348][1054527] Avg episode reward: [(0, '4626.256')] [2023-03-10 19:13:15,654][1054815] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-10 19:13:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 77230080. Throughput: 0: 8522.0. Samples: 77221036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:18,348][1054527] Avg episode reward: [(0, '4536.263')] [2023-03-10 19:13:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150840_77230080.pth... [2023-03-10 19:13:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150344_76976128.pth [2023-03-10 19:13:20,237][1054815] Updated weights for policy 0, policy_version 150880 (0.0006) [2023-03-10 19:13:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 77275136. Throughput: 0: 8476.8. Samples: 77271052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:23,348][1054527] Avg episode reward: [(0, '4493.901')] [2023-03-10 19:13:25,342][1054815] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-10 19:13:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 77316096. Throughput: 0: 8463.8. Samples: 77295624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:28,348][1054527] Avg episode reward: [(0, '4405.252')] [2023-03-10 19:13:30,051][1054815] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-10 19:13:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 77357056. Throughput: 0: 8435.6. Samples: 77346964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:33,348][1054527] Avg episode reward: [(0, '4585.248')] [2023-03-10 19:13:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151088_77357056.pth... [2023-03-10 19:13:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150592_77103104.pth [2023-03-10 19:13:35,065][1054815] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-10 19:13:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 77398016. Throughput: 0: 8378.6. Samples: 77397928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:38,348][1054527] Avg episode reward: [(0, '4540.796')] [2023-03-10 19:13:39,803][1054815] Updated weights for policy 0, policy_version 151200 (0.0005) [2023-03-10 19:13:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 77438976. Throughput: 0: 8380.8. Samples: 77422664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:43,348][1054527] Avg episode reward: [(0, '4365.472')] [2023-03-10 19:13:45,119][1054815] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-10 19:13:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8553.0). Total num frames: 77479936. Throughput: 0: 8362.9. Samples: 77468920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:48,348][1054527] Avg episode reward: [(0, '4543.529')] [2023-03-10 19:13:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151328_77479936.pth... [2023-03-10 19:13:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000150840_77230080.pth [2023-03-10 19:13:49,990][1054815] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-10 19:13:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8525.2). Total num frames: 77520896. Throughput: 0: 8375.2. Samples: 77520252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:53,348][1054527] Avg episode reward: [(0, '4526.086')] [2023-03-10 19:13:55,085][1054815] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-10 19:13:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8525.2). Total num frames: 77561856. Throughput: 0: 8356.4. Samples: 77544684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:13:58,348][1054527] Avg episode reward: [(0, '4675.703')] [2023-03-10 19:13:59,812][1054815] Updated weights for policy 0, policy_version 151520 (0.0005) [2023-03-10 19:14:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 77606912. Throughput: 0: 8303.5. Samples: 77594696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:03,348][1054527] Avg episode reward: [(0, '4588.385')] [2023-03-10 19:14:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151576_77606912.pth... [2023-03-10 19:14:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151088_77357056.pth [2023-03-10 19:14:04,679][1054815] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-10 19:14:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 77647872. Throughput: 0: 8288.4. Samples: 77644032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:08,348][1054527] Avg episode reward: [(0, '4452.731')] [2023-03-10 19:14:09,603][1054815] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-10 19:14:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8511.4). Total num frames: 77688832. Throughput: 0: 8339.5. Samples: 77670904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:13,348][1054527] Avg episode reward: [(0, '4467.600')] [2023-03-10 19:14:14,763][1054815] Updated weights for policy 0, policy_version 151760 (0.0006) [2023-03-10 19:14:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8511.3). Total num frames: 77729792. Throughput: 0: 8234.5. Samples: 77717516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:18,348][1054527] Avg episode reward: [(0, '4726.612')] [2023-03-10 19:14:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151816_77729792.pth... [2023-03-10 19:14:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151328_77479936.pth [2023-03-10 19:14:19,768][1054815] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-10 19:14:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8511.3). Total num frames: 77770752. Throughput: 0: 8264.5. Samples: 77769832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:23,348][1054527] Avg episode reward: [(0, '4692.393')] [2023-03-10 19:14:24,402][1054815] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-10 19:14:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8511.4). Total num frames: 77815808. Throughput: 0: 8287.6. Samples: 77795608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:28,348][1054527] Avg episode reward: [(0, '4594.285')] [2023-03-10 19:14:29,025][1054815] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-10 19:14:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8497.5). Total num frames: 77856768. Throughput: 0: 8433.5. Samples: 77848428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:33,348][1054527] Avg episode reward: [(0, '4580.251')] [2023-03-10 19:14:33,395][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152072_77860864.pth... [2023-03-10 19:14:33,396][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151576_77606912.pth [2023-03-10 19:14:33,885][1054815] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-10 19:14:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 77901824. Throughput: 0: 8473.7. Samples: 77901568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:38,348][1054527] Avg episode reward: [(0, '4616.247')] [2023-03-10 19:14:38,483][1054815] Updated weights for policy 0, policy_version 152160 (0.0006) [2023-03-10 19:14:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 77942784. Throughput: 0: 8441.0. Samples: 77924528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:43,348][1054527] Avg episode reward: [(0, '4497.766')] [2023-03-10 19:14:43,446][1054815] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-10 19:14:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8511.3). Total num frames: 77983744. Throughput: 0: 8455.0. Samples: 77975172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:48,348][1054527] Avg episode reward: [(0, '4639.086')] [2023-03-10 19:14:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152312_77983744.pth... [2023-03-10 19:14:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000151816_77729792.pth [2023-03-10 19:14:48,489][1054815] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-10 19:14:53,097][1054815] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-10 19:14:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 78028800. Throughput: 0: 8499.8. Samples: 78026524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:53,348][1054527] Avg episode reward: [(0, '4501.564')] [2023-03-10 19:14:58,083][1054815] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-10 19:14:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.4). Total num frames: 78069760. Throughput: 0: 8463.6. Samples: 78051768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:14:58,348][1054527] Avg episode reward: [(0, '4422.977')] [2023-03-10 19:15:02,874][1054815] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-10 19:15:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 78114816. Throughput: 0: 8522.2. Samples: 78101016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:03,348][1054527] Avg episode reward: [(0, '3881.351')] [2023-03-10 19:15:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152568_78114816.pth... [2023-03-10 19:15:03,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152072_77860864.pth [2023-03-10 19:15:07,451][1054815] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-10 19:15:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 78155776. Throughput: 0: 8570.8. Samples: 78155520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:08,348][1054527] Avg episode reward: [(0, '4206.217')] [2023-03-10 19:15:12,258][1054815] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-10 19:15:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 78200832. Throughput: 0: 8549.1. Samples: 78180320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:13,348][1054527] Avg episode reward: [(0, '4325.577')] [2023-03-10 19:15:17,468][1054815] Updated weights for policy 0, policy_version 152800 (0.0004) [2023-03-10 19:15:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 78237696. Throughput: 0: 8465.8. Samples: 78229388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:18,348][1054527] Avg episode reward: [(0, '4087.544')] [2023-03-10 19:15:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152808_78237696.pth... [2023-03-10 19:15:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152312_77983744.pth [2023-03-10 19:15:22,492][1054815] Updated weights for policy 0, policy_version 152880 (0.0004) [2023-03-10 19:15:23,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 78278656. Throughput: 0: 8358.5. Samples: 78277700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:23,348][1054527] Avg episode reward: [(0, '4051.537')] [2023-03-10 19:15:27,336][1054815] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-10 19:15:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 78323712. Throughput: 0: 8410.5. Samples: 78303000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:15:28,348][1054527] Avg episode reward: [(0, '4526.523')] [2023-03-10 19:15:32,436][1054815] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-10 19:15:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 78360576. Throughput: 0: 8380.3. Samples: 78352284. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:33,348][1054527] Avg episode reward: [(0, '4599.414')] [2023-03-10 19:15:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153048_78360576.pth... [2023-03-10 19:15:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152568_78114816.pth [2023-03-10 19:15:37,393][1054815] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-10 19:15:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8497.5). Total num frames: 78405632. Throughput: 0: 8333.2. Samples: 78401520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:38,348][1054527] Avg episode reward: [(0, '4571.511')] [2023-03-10 19:15:42,482][1054815] Updated weights for policy 0, policy_version 153200 (0.0006) [2023-03-10 19:15:43,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8483.6). Total num frames: 78442496. Throughput: 0: 8318.8. Samples: 78426112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:43,348][1054527] Avg episode reward: [(0, '4598.060')] [2023-03-10 19:15:47,511][1054815] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-10 19:15:48,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 78483456. Throughput: 0: 8295.5. Samples: 78474312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:48,348][1054527] Avg episode reward: [(0, '4613.581')] [2023-03-10 19:15:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153288_78483456.pth... [2023-03-10 19:15:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000152808_78237696.pth [2023-03-10 19:15:52,329][1054815] Updated weights for policy 0, policy_version 153360 (0.0004) [2023-03-10 19:15:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8469.7). Total num frames: 78528512. Throughput: 0: 8199.3. Samples: 78524488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:53,348][1054527] Avg episode reward: [(0, '4588.223')] [2023-03-10 19:15:57,218][1054815] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-10 19:15:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8455.8). Total num frames: 78569472. Throughput: 0: 8233.4. Samples: 78550824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:15:58,348][1054527] Avg episode reward: [(0, '4410.459')] [2023-03-10 19:16:02,136][1054815] Updated weights for policy 0, policy_version 153520 (0.0004) [2023-03-10 19:16:03,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8455.8). Total num frames: 78610432. Throughput: 0: 8235.5. Samples: 78599988. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:03,348][1054527] Avg episode reward: [(0, '4647.202')] [2023-03-10 19:16:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153536_78610432.pth... [2023-03-10 19:16:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153048_78360576.pth [2023-03-10 19:16:06,927][1054815] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-10 19:16:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 78651392. Throughput: 0: 8298.5. Samples: 78651132. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:08,348][1054527] Avg episode reward: [(0, '4491.264')] [2023-03-10 19:16:11,572][1054815] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-10 19:16:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8441.9). Total num frames: 78696448. Throughput: 0: 8327.2. Samples: 78677724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:13,348][1054527] Avg episode reward: [(0, '4517.774')] [2023-03-10 19:16:16,369][1054815] Updated weights for policy 0, policy_version 153760 (0.0005) [2023-03-10 19:16:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 78737408. Throughput: 0: 8376.1. Samples: 78729208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:18,348][1054527] Avg episode reward: [(0, '4517.422')] [2023-03-10 19:16:18,361][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153792_78741504.pth... [2023-03-10 19:16:18,363][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153288_78483456.pth [2023-03-10 19:16:21,184][1054815] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-10 19:16:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 78782464. Throughput: 0: 8418.4. Samples: 78780348. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:23,348][1054527] Avg episode reward: [(0, '4484.447')] [2023-03-10 19:16:25,869][1054815] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-10 19:16:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 78827520. Throughput: 0: 8464.4. Samples: 78807008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:28,348][1054527] Avg episode reward: [(0, '4268.354')] [2023-03-10 19:16:30,620][1054815] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-10 19:16:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.0, 300 sec: 8441.9). Total num frames: 78868480. Throughput: 0: 8551.3. Samples: 78859120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:16:33,348][1054527] Avg episode reward: [(0, '4335.553')] [2023-03-10 19:16:33,359][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154048_78872576.pth... [2023-03-10 19:16:33,360][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153536_78610432.pth [2023-03-10 19:16:35,138][1054815] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-10 19:16:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8455.8). Total num frames: 78913536. Throughput: 0: 8566.3. Samples: 78909972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:16:38,348][1054527] Avg episode reward: [(0, '4274.751')] [2023-03-10 19:16:40,161][1054815] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-10 19:16:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 78954496. Throughput: 0: 8545.1. Samples: 78935352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:16:43,348][1054527] Avg episode reward: [(0, '4125.795')] [2023-03-10 19:16:45,122][1054815] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-10 19:16:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8428.0). Total num frames: 78995456. Throughput: 0: 8601.5. Samples: 78987056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:16:48,348][1054527] Avg episode reward: [(0, '4450.466')] [2023-03-10 19:16:48,390][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154296_78999552.pth... [2023-03-10 19:16:48,391][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000153792_78741504.pth [2023-03-10 19:16:49,994][1054815] Updated weights for policy 0, policy_version 154320 (0.0006) [2023-03-10 19:16:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 79036416. Throughput: 0: 8552.4. Samples: 79035988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:16:53,348][1054527] Avg episode reward: [(0, '4448.282')] [2023-03-10 19:16:54,847][1054815] Updated weights for policy 0, policy_version 154400 (0.0006) [2023-03-10 19:16:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8428.0). Total num frames: 79081472. Throughput: 0: 8541.6. Samples: 79062096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:16:58,348][1054527] Avg episode reward: [(0, '4490.158')] [2023-03-10 19:16:59,644][1054815] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-10 19:17:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8414.2). Total num frames: 79122432. Throughput: 0: 8485.9. Samples: 79111072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:03,348][1054527] Avg episode reward: [(0, '4524.894')] [2023-03-10 19:17:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154536_79122432.pth... [2023-03-10 19:17:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154048_78872576.pth [2023-03-10 19:17:04,754][1054815] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-10 19:17:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8414.2). Total num frames: 79163392. Throughput: 0: 8431.6. Samples: 79159772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:08,348][1054527] Avg episode reward: [(0, '4638.176')] [2023-03-10 19:17:09,782][1054815] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-10 19:17:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 79204352. Throughput: 0: 8399.5. Samples: 79184984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:13,348][1054527] Avg episode reward: [(0, '4588.313')] [2023-03-10 19:17:14,488][1054815] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-10 19:17:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8428.0). Total num frames: 79249408. Throughput: 0: 8399.8. Samples: 79237112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:18,348][1054527] Avg episode reward: [(0, '4661.841')] [2023-03-10 19:17:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154784_79249408.pth... [2023-03-10 19:17:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154296_78999552.pth [2023-03-10 19:17:19,167][1054815] Updated weights for policy 0, policy_version 154800 (0.0004) [2023-03-10 19:17:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 79294464. Throughput: 0: 8485.1. Samples: 79291800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:23,348][1054527] Avg episode reward: [(0, '4711.216')] [2023-03-10 19:17:23,591][1054815] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-10 19:17:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 79335424. Throughput: 0: 8526.6. Samples: 79319048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:28,348][1054527] Avg episode reward: [(0, '4661.755')] [2023-03-10 19:17:28,482][1054815] Updated weights for policy 0, policy_version 154960 (0.0004) [2023-03-10 19:17:33,304][1054815] Updated weights for policy 0, policy_version 155040 (0.0004) [2023-03-10 19:17:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 79380480. Throughput: 0: 8475.0. Samples: 79368432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:33,348][1054527] Avg episode reward: [(0, '4665.187')] [2023-03-10 19:17:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155040_79380480.pth... [2023-03-10 19:17:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154536_79122432.pth [2023-03-10 19:17:38,022][1054815] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-10 19:17:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 79421440. Throughput: 0: 8529.8. Samples: 79419828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:17:38,348][1054527] Avg episode reward: [(0, '4106.709')] [2023-03-10 19:17:42,419][1054815] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-10 19:17:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 79470592. Throughput: 0: 8533.0. Samples: 79446080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:17:43,348][1054527] Avg episode reward: [(0, '4556.697')] [2023-03-10 19:17:47,051][1054815] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-10 19:17:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 79511552. Throughput: 0: 8659.2. Samples: 79500736. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:17:48,348][1054527] Avg episode reward: [(0, '4611.740')] [2023-03-10 19:17:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155296_79511552.pth... [2023-03-10 19:17:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000154784_79249408.pth [2023-03-10 19:17:51,883][1054815] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-10 19:17:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 79552512. Throughput: 0: 8727.5. Samples: 79552512. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:17:53,348][1054527] Avg episode reward: [(0, '4606.073')] [2023-03-10 19:17:56,885][1054815] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-10 19:17:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 79597568. Throughput: 0: 8710.0. Samples: 79576932. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:17:58,348][1054527] Avg episode reward: [(0, '4474.821')] [2023-03-10 19:18:01,670][1054815] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-10 19:18:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 79638528. Throughput: 0: 8674.4. Samples: 79627460. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:03,348][1054527] Avg episode reward: [(0, '4625.908')] [2023-03-10 19:18:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155544_79638528.pth... [2023-03-10 19:18:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155040_79380480.pth [2023-03-10 19:18:06,583][1054815] Updated weights for policy 0, policy_version 155600 (0.0004) [2023-03-10 19:18:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 79679488. Throughput: 0: 8574.1. Samples: 79677632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:08,348][1054527] Avg episode reward: [(0, '4514.650')] [2023-03-10 19:18:11,443][1054815] Updated weights for policy 0, policy_version 155680 (0.0006) [2023-03-10 19:18:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 79720448. Throughput: 0: 8554.0. Samples: 79703980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:13,348][1054527] Avg episode reward: [(0, '4668.340')] [2023-03-10 19:18:16,105][1054815] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-10 19:18:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8455.8). Total num frames: 79769600. Throughput: 0: 8587.4. Samples: 79754864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:18,348][1054527] Avg episode reward: [(0, '4665.789')] [2023-03-10 19:18:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155800_79769600.pth... [2023-03-10 19:18:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155296_79511552.pth [2023-03-10 19:18:20,589][1054815] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-10 19:18:23,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8669.9, 300 sec: 8469.7). Total num frames: 79814656. Throughput: 0: 8723.2. Samples: 79812372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:23,348][1054527] Avg episode reward: [(0, '4236.460')] [2023-03-10 19:18:24,913][1054815] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-10 19:18:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8483.6). Total num frames: 79859712. Throughput: 0: 8736.9. Samples: 79839240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:28,348][1054527] Avg episode reward: [(0, '4013.103')] [2023-03-10 19:18:29,530][1054815] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-10 19:18:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8497.5). Total num frames: 79904768. Throughput: 0: 8714.8. Samples: 79892904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:33,348][1054527] Avg episode reward: [(0, '4141.437')] [2023-03-10 19:18:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156064_79904768.pth... [2023-03-10 19:18:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155544_79638528.pth [2023-03-10 19:18:34,100][1054815] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-10 19:18:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8511.3). Total num frames: 79949824. Throughput: 0: 8817.8. Samples: 79949312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:38,348][1054527] Avg episode reward: [(0, '4252.170')] [2023-03-10 19:18:38,404][1054815] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-10 19:18:43,001][1054815] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-10 19:18:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 79994880. Throughput: 0: 8840.5. Samples: 79974756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:18:43,348][1054527] Avg episode reward: [(0, '4425.060')] [2023-03-10 19:18:47,770][1054815] Updated weights for policy 0, policy_version 156320 (0.0006) [2023-03-10 19:18:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 80039936. Throughput: 0: 8898.4. Samples: 80027888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:18:48,349][1054527] Avg episode reward: [(0, '4644.715')] [2023-03-10 19:18:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156328_80039936.pth... [2023-03-10 19:18:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000155800_79769600.pth [2023-03-10 19:18:52,666][1054815] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-10 19:18:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 80080896. Throughput: 0: 8895.8. Samples: 80077944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:18:53,348][1054527] Avg episode reward: [(0, '4578.683')] [2023-03-10 19:18:57,138][1054815] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-10 19:18:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 80125952. Throughput: 0: 8950.9. Samples: 80106772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:18:58,349][1054527] Avg episode reward: [(0, '4601.299')] [2023-03-10 19:19:01,723][1054815] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-10 19:19:03,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8874.7, 300 sec: 8553.0). Total num frames: 80171008. Throughput: 0: 8987.1. Samples: 80159284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:03,348][1054527] Avg episode reward: [(0, '4670.351')] [2023-03-10 19:19:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156584_80171008.pth... [2023-03-10 19:19:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156064_79904768.pth [2023-03-10 19:19:06,359][1054815] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-10 19:19:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8566.9). Total num frames: 80216064. Throughput: 0: 8888.3. Samples: 80212344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:08,348][1054527] Avg episode reward: [(0, '4454.857')] [2023-03-10 19:19:11,148][1054815] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-10 19:19:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8566.9). Total num frames: 80257024. Throughput: 0: 8856.5. Samples: 80237784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:13,348][1054527] Avg episode reward: [(0, '4625.349')] [2023-03-10 19:19:15,943][1054815] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-10 19:19:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8580.8). Total num frames: 80302080. Throughput: 0: 8819.7. Samples: 80289792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:18,349][1054527] Avg episode reward: [(0, '4713.435')] [2023-03-10 19:19:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156840_80302080.pth... [2023-03-10 19:19:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156328_80039936.pth [2023-03-10 19:19:20,734][1054815] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-10 19:19:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 80343040. Throughput: 0: 8676.3. Samples: 80339744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:23,348][1054527] Avg episode reward: [(0, '4685.479')] [2023-03-10 19:19:25,761][1054815] Updated weights for policy 0, policy_version 156960 (0.0004) [2023-03-10 19:19:28,348][1054527] Fps is (10 sec: 8192.2, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 80384000. Throughput: 0: 8642.8. Samples: 80363680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:28,348][1054527] Avg episode reward: [(0, '4675.181')] [2023-03-10 19:19:30,506][1054815] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-10 19:19:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 80429056. Throughput: 0: 8637.2. Samples: 80416564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:33,349][1054527] Avg episode reward: [(0, '4621.203')] [2023-03-10 19:19:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157088_80429056.pth... [2023-03-10 19:19:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156584_80171008.pth [2023-03-10 19:19:35,132][1054815] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-10 19:19:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 80474112. Throughput: 0: 8709.8. Samples: 80469884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:38,348][1054527] Avg episode reward: [(0, '4383.617')] [2023-03-10 19:19:39,831][1054815] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-10 19:19:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8580.8). Total num frames: 80515072. Throughput: 0: 8619.8. Samples: 80494664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:43,349][1054527] Avg episode reward: [(0, '4646.419')] [2023-03-10 19:19:44,506][1054815] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-10 19:19:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8601.6, 300 sec: 8566.9). Total num frames: 80556032. Throughput: 0: 8618.0. Samples: 80547092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:48,348][1054527] Avg episode reward: [(0, '4652.534')] [2023-03-10 19:19:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157336_80556032.pth... [2023-03-10 19:19:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000156840_80302080.pth [2023-03-10 19:19:49,286][1054815] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-10 19:19:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 80605184. Throughput: 0: 8648.7. Samples: 80601536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:53,348][1054527] Avg episode reward: [(0, '4670.784')] [2023-03-10 19:19:53,551][1054815] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-10 19:19:58,180][1054815] Updated weights for policy 0, policy_version 157520 (0.0004) [2023-03-10 19:19:58,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8738.2, 300 sec: 8594.7). Total num frames: 80650240. Throughput: 0: 8726.8. Samples: 80630488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:19:58,348][1054527] Avg episode reward: [(0, '4709.775')] [2023-03-10 19:20:02,931][1054815] Updated weights for policy 0, policy_version 157600 (0.0006) [2023-03-10 19:20:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 80691200. Throughput: 0: 8714.4. Samples: 80681940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:03,348][1054527] Avg episode reward: [(0, '4717.168')] [2023-03-10 19:20:03,416][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157608_80695296.pth... [2023-03-10 19:20:03,418][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157088_80429056.pth [2023-03-10 19:20:07,326][1054815] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-10 19:20:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 80740352. Throughput: 0: 8812.8. Samples: 80736320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:08,348][1054527] Avg episode reward: [(0, '4676.217')] [2023-03-10 19:20:12,133][1054815] Updated weights for policy 0, policy_version 157760 (0.0006) [2023-03-10 19:20:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 80781312. Throughput: 0: 8838.9. Samples: 80761432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:13,348][1054527] Avg episode reward: [(0, '4632.277')] [2023-03-10 19:20:16,688][1054815] Updated weights for policy 0, policy_version 157840 (0.0006) [2023-03-10 19:20:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 80826368. Throughput: 0: 8856.4. Samples: 80815100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:18,348][1054527] Avg episode reward: [(0, '4723.605')] [2023-03-10 19:20:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157864_80826368.pth... [2023-03-10 19:20:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157336_80556032.pth [2023-03-10 19:20:21,547][1054815] Updated weights for policy 0, policy_version 157920 (0.0006) [2023-03-10 19:20:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 80871424. Throughput: 0: 8832.2. Samples: 80867336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:23,348][1054527] Avg episode reward: [(0, '4722.624')] [2023-03-10 19:20:26,122][1054815] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-10 19:20:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8650.2). Total num frames: 80912384. Throughput: 0: 8860.4. Samples: 80893380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:28,348][1054527] Avg episode reward: [(0, '4719.820')] [2023-03-10 19:20:30,789][1054815] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-10 19:20:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8650.2). Total num frames: 80957440. Throughput: 0: 8853.2. Samples: 80945484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:33,348][1054527] Avg episode reward: [(0, '4674.760')] [2023-03-10 19:20:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158120_80957440.pth... [2023-03-10 19:20:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157608_80695296.pth [2023-03-10 19:20:35,509][1054815] Updated weights for policy 0, policy_version 158160 (0.0006) [2023-03-10 19:20:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 81002496. Throughput: 0: 8819.4. Samples: 80998408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:38,348][1054527] Avg episode reward: [(0, '4673.857')] [2023-03-10 19:20:40,158][1054815] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-10 19:20:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 81043456. Throughput: 0: 8737.6. Samples: 81023680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:43,348][1054527] Avg episode reward: [(0, '4682.416')] [2023-03-10 19:20:45,073][1054815] Updated weights for policy 0, policy_version 158320 (0.0004) [2023-03-10 19:20:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 81088512. Throughput: 0: 8740.2. Samples: 81075248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:48,348][1054527] Avg episode reward: [(0, '4726.208')] [2023-03-10 19:20:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158376_81088512.pth... [2023-03-10 19:20:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000157864_80826368.pth [2023-03-10 19:20:49,894][1054815] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-10 19:20:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 81129472. Throughput: 0: 8666.0. Samples: 81126292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:53,348][1054527] Avg episode reward: [(0, '4721.826')] [2023-03-10 19:20:54,601][1054815] Updated weights for policy 0, policy_version 158480 (0.0006) [2023-03-10 19:20:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 81170432. Throughput: 0: 8677.8. Samples: 81151932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:20:58,348][1054527] Avg episode reward: [(0, '4724.639')] [2023-03-10 19:20:59,329][1054815] Updated weights for policy 0, policy_version 158560 (0.0006) [2023-03-10 19:21:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8691.9). Total num frames: 81215488. Throughput: 0: 8654.2. Samples: 81204536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:03,348][1054527] Avg episode reward: [(0, '4721.835')] [2023-03-10 19:21:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158624_81215488.pth... [2023-03-10 19:21:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158120_80957440.pth [2023-03-10 19:21:03,920][1054815] Updated weights for policy 0, policy_version 158640 (0.0006) [2023-03-10 19:21:08,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 81260544. Throughput: 0: 8738.3. Samples: 81260560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:08,348][1054527] Avg episode reward: [(0, '4670.674')] [2023-03-10 19:21:08,350][1054815] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-10 19:21:13,124][1054815] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-10 19:21:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 81305600. Throughput: 0: 8712.2. Samples: 81285428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:13,348][1054527] Avg episode reward: [(0, '4578.053')] [2023-03-10 19:21:17,846][1054815] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-10 19:21:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 81346560. Throughput: 0: 8726.6. Samples: 81338180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:18,348][1054527] Avg episode reward: [(0, '4714.865')] [2023-03-10 19:21:18,373][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158888_81350656.pth... [2023-03-10 19:21:18,375][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158376_81088512.pth [2023-03-10 19:21:22,547][1054815] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-10 19:21:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 81391616. Throughput: 0: 8706.0. Samples: 81390180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:23,348][1054527] Avg episode reward: [(0, '4579.044')] [2023-03-10 19:21:27,397][1054815] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-10 19:21:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 81432576. Throughput: 0: 8711.0. Samples: 81415676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:28,348][1054527] Avg episode reward: [(0, '4621.591')] [2023-03-10 19:21:32,170][1054815] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-10 19:21:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8691.8). Total num frames: 81477632. Throughput: 0: 8686.2. Samples: 81466128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:33,348][1054527] Avg episode reward: [(0, '4531.385')] [2023-03-10 19:21:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159136_81477632.pth... [2023-03-10 19:21:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158624_81215488.pth [2023-03-10 19:21:37,142][1054815] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-10 19:21:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8691.9). Total num frames: 81518592. Throughput: 0: 8670.6. Samples: 81516468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:38,348][1054527] Avg episode reward: [(0, '4526.731')] [2023-03-10 19:21:41,854][1054815] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-10 19:21:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 81563648. Throughput: 0: 8680.2. Samples: 81542540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:43,348][1054527] Avg episode reward: [(0, '4532.133')] [2023-03-10 19:21:46,631][1054815] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-10 19:21:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 81604608. Throughput: 0: 8653.9. Samples: 81593960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:48,348][1054527] Avg episode reward: [(0, '4437.981')] [2023-03-10 19:21:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159384_81604608.pth... [2023-03-10 19:21:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000158888_81350656.pth [2023-03-10 19:21:51,515][1054815] Updated weights for policy 0, policy_version 159440 (0.0004) [2023-03-10 19:21:53,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8691.9). Total num frames: 81645568. Throughput: 0: 8541.5. Samples: 81644928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:21:53,348][1054527] Avg episode reward: [(0, '4537.259')] [2023-03-10 19:21:56,032][1054815] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-10 19:21:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 81690624. Throughput: 0: 8600.0. Samples: 81672428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:21:58,348][1054527] Avg episode reward: [(0, '4673.793')] [2023-03-10 19:22:00,998][1054815] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-10 19:22:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 81731584. Throughput: 0: 8545.8. Samples: 81722740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:03,348][1054527] Avg episode reward: [(0, '4722.102')] [2023-03-10 19:22:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159632_81731584.pth... [2023-03-10 19:22:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159136_81477632.pth [2023-03-10 19:22:05,898][1054815] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-10 19:22:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8705.7). Total num frames: 81772544. Throughput: 0: 8494.0. Samples: 81772408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:08,348][1054527] Avg episode reward: [(0, '4628.910')] [2023-03-10 19:22:10,717][1054815] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-10 19:22:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8705.7). Total num frames: 81817600. Throughput: 0: 8490.2. Samples: 81797736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:13,348][1054527] Avg episode reward: [(0, '4582.312')] [2023-03-10 19:22:15,689][1054815] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-10 19:22:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8691.8). Total num frames: 81858560. Throughput: 0: 8467.4. Samples: 81847160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:18,348][1054527] Avg episode reward: [(0, '4586.877')] [2023-03-10 19:22:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159880_81858560.pth... [2023-03-10 19:22:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159384_81604608.pth [2023-03-10 19:22:20,595][1054815] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-10 19:22:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8691.9). Total num frames: 81899520. Throughput: 0: 8481.0. Samples: 81898112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:23,348][1054527] Avg episode reward: [(0, '4679.147')] [2023-03-10 19:22:25,317][1054815] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-10 19:22:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8691.9). Total num frames: 81944576. Throughput: 0: 8485.0. Samples: 81924364. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:28,348][1054527] Avg episode reward: [(0, '4589.939')] [2023-03-10 19:22:30,092][1054815] Updated weights for policy 0, policy_version 160080 (0.0006) [2023-03-10 19:22:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8691.9). Total num frames: 81985536. Throughput: 0: 8508.8. Samples: 81976856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:33,348][1054527] Avg episode reward: [(0, '4681.706')] [2023-03-10 19:22:33,370][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160136_81989632.pth... [2023-03-10 19:22:33,372][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159632_81731584.pth [2023-03-10 19:22:34,858][1054815] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-10 19:22:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8678.0). Total num frames: 82030592. Throughput: 0: 8480.7. Samples: 82026560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:38,349][1054527] Avg episode reward: [(0, '4499.935')] [2023-03-10 19:22:39,593][1054815] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-10 19:22:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 82071552. Throughput: 0: 8459.8. Samples: 82053120. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:43,348][1054527] Avg episode reward: [(0, '4681.096')] [2023-03-10 19:22:44,405][1054815] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-10 19:22:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8691.9). Total num frames: 82116608. Throughput: 0: 8481.2. Samples: 82104392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:48,348][1054527] Avg episode reward: [(0, '4730.051')] [2023-03-10 19:22:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160384_82116608.pth... [2023-03-10 19:22:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000159880_81858560.pth [2023-03-10 19:22:49,160][1054815] Updated weights for policy 0, policy_version 160400 (0.0006) [2023-03-10 19:22:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8678.0). Total num frames: 82157568. Throughput: 0: 8508.2. Samples: 82155276. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:53,348][1054527] Avg episode reward: [(0, '4682.028')] [2023-03-10 19:22:54,186][1054815] Updated weights for policy 0, policy_version 160480 (0.0006) [2023-03-10 19:22:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 82198528. Throughput: 0: 8452.8. Samples: 82178112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:22:58,348][1054527] Avg episode reward: [(0, '4545.261')] [2023-03-10 19:22:59,172][1054815] Updated weights for policy 0, policy_version 160560 (0.0004) [2023-03-10 19:23:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 82239488. Throughput: 0: 8495.9. Samples: 82229476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:03,348][1054527] Avg episode reward: [(0, '4634.779')] [2023-03-10 19:23:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160624_82239488.pth... [2023-03-10 19:23:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160136_81989632.pth [2023-03-10 19:23:04,133][1054815] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-10 19:23:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 82280448. Throughput: 0: 8466.1. Samples: 82279084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:08,348][1054527] Avg episode reward: [(0, '4539.199')] [2023-03-10 19:23:09,035][1054815] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-10 19:23:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8650.2). Total num frames: 82321408. Throughput: 0: 8451.7. Samples: 82304692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:13,348][1054527] Avg episode reward: [(0, '4350.420')] [2023-03-10 19:23:14,066][1054815] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-10 19:23:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8636.3). Total num frames: 82362368. Throughput: 0: 8377.2. Samples: 82353828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:18,348][1054527] Avg episode reward: [(0, '4686.257')] [2023-03-10 19:23:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160864_82362368.pth... [2023-03-10 19:23:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160384_82116608.pth [2023-03-10 19:23:18,927][1054815] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-10 19:23:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 82407424. Throughput: 0: 8381.4. Samples: 82403724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:23,348][1054527] Avg episode reward: [(0, '4682.104')] [2023-03-10 19:23:23,690][1054815] Updated weights for policy 0, policy_version 160960 (0.0006) [2023-03-10 19:23:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8622.4). Total num frames: 82448384. Throughput: 0: 8365.1. Samples: 82429552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:28,348][1054527] Avg episode reward: [(0, '4676.191')] [2023-03-10 19:23:28,736][1054815] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-10 19:23:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 82489344. Throughput: 0: 8341.1. Samples: 82479744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:33,348][1054527] Avg episode reward: [(0, '4508.740')] [2023-03-10 19:23:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161112_82489344.pth... [2023-03-10 19:23:33,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160624_82239488.pth [2023-03-10 19:23:33,466][1054815] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-10 19:23:38,163][1054815] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-10 19:23:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 82534400. Throughput: 0: 8335.4. Samples: 82530368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:38,348][1054527] Avg episode reward: [(0, '4476.797')] [2023-03-10 19:23:42,637][1054815] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-10 19:23:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 82579456. Throughput: 0: 8465.1. Samples: 82559040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:43,348][1054527] Avg episode reward: [(0, '4660.101')] [2023-03-10 19:23:47,420][1054815] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-10 19:23:48,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8608.5). Total num frames: 82620416. Throughput: 0: 8502.2. Samples: 82612076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:48,348][1054527] Avg episode reward: [(0, '4549.743')] [2023-03-10 19:23:48,378][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161376_82624512.pth... [2023-03-10 19:23:48,380][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000160864_82362368.pth [2023-03-10 19:23:51,945][1054815] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-10 19:23:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8608.5). Total num frames: 82665472. Throughput: 0: 8580.5. Samples: 82665208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:53,348][1054527] Avg episode reward: [(0, '4574.414')] [2023-03-10 19:23:56,947][1054815] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-10 19:23:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 82706432. Throughput: 0: 8563.5. Samples: 82690048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:23:58,348][1054527] Avg episode reward: [(0, '4629.675')] [2023-03-10 19:24:01,464][1054815] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-10 19:24:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.4, 300 sec: 8594.7). Total num frames: 82751488. Throughput: 0: 8650.3. Samples: 82743092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:03,348][1054527] Avg episode reward: [(0, '4615.346')] [2023-03-10 19:24:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161624_82751488.pth... [2023-03-10 19:24:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161112_82489344.pth [2023-03-10 19:24:06,401][1054815] Updated weights for policy 0, policy_version 161680 (0.0004) [2023-03-10 19:24:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 82796544. Throughput: 0: 8639.9. Samples: 82792520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:08,348][1054527] Avg episode reward: [(0, '4626.907')] [2023-03-10 19:24:11,338][1054815] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-10 19:24:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 82837504. Throughput: 0: 8610.7. Samples: 82817032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:13,348][1054527] Avg episode reward: [(0, '4643.257')] [2023-03-10 19:24:16,195][1054815] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-10 19:24:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 82878464. Throughput: 0: 8616.5. Samples: 82867488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:18,348][1054527] Avg episode reward: [(0, '4583.631')] [2023-03-10 19:24:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161872_82878464.pth... [2023-03-10 19:24:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161376_82624512.pth [2023-03-10 19:24:21,027][1054815] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-10 19:24:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.4, 300 sec: 8594.7). Total num frames: 82919424. Throughput: 0: 8608.8. Samples: 82917764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:23,348][1054527] Avg episode reward: [(0, '4575.394')] [2023-03-10 19:24:25,784][1054815] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-10 19:24:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 82964480. Throughput: 0: 8556.1. Samples: 82944064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:28,349][1054527] Avg episode reward: [(0, '4580.725')] [2023-03-10 19:24:30,467][1054815] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-10 19:24:33,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 83005440. Throughput: 0: 8551.8. Samples: 82996908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:33,349][1054527] Avg episode reward: [(0, '4474.447')] [2023-03-10 19:24:33,386][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162128_83009536.pth... [2023-03-10 19:24:33,387][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161624_82751488.pth [2023-03-10 19:24:35,208][1054815] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-10 19:24:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8608.5). Total num frames: 83054592. Throughput: 0: 8562.1. Samples: 83050504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:38,349][1054527] Avg episode reward: [(0, '4313.858')] [2023-03-10 19:24:39,719][1054815] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-10 19:24:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 83095552. Throughput: 0: 8576.4. Samples: 83075988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:43,348][1054527] Avg episode reward: [(0, '4678.539')] [2023-03-10 19:24:44,539][1054815] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-10 19:24:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 83136512. Throughput: 0: 8548.4. Samples: 83127772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:48,348][1054527] Avg episode reward: [(0, '4671.218')] [2023-03-10 19:24:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162376_83136512.pth... [2023-03-10 19:24:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000161872_82878464.pth [2023-03-10 19:24:49,570][1054815] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-10 19:24:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 83177472. Throughput: 0: 8530.7. Samples: 83176400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:53,348][1054527] Avg episode reward: [(0, '4440.630')] [2023-03-10 19:24:54,253][1054815] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-10 19:24:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 83222528. Throughput: 0: 8557.5. Samples: 83202120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:24:58,348][1054527] Avg episode reward: [(0, '3942.800')] [2023-03-10 19:24:59,071][1054815] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-10 19:25:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 83263488. Throughput: 0: 8563.1. Samples: 83252828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:25:03,348][1054527] Avg episode reward: [(0, '4586.460')] [2023-03-10 19:25:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162624_83263488.pth... [2023-03-10 19:25:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162128_83009536.pth [2023-03-10 19:25:03,922][1054815] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-10 19:25:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 83308544. Throughput: 0: 8591.9. Samples: 83304400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:25:08,348][1054527] Avg episode reward: [(0, '4591.958')] [2023-03-10 19:25:08,778][1054815] Updated weights for policy 0, policy_version 162720 (0.0006) [2023-03-10 19:25:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 83349504. Throughput: 0: 8597.6. Samples: 83330956. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:13,348][1054527] Avg episode reward: [(0, '4682.885')] [2023-03-10 19:25:13,433][1054815] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-10 19:25:18,278][1054815] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-10 19:25:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 83394560. Throughput: 0: 8565.3. Samples: 83382344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:18,349][1054527] Avg episode reward: [(0, '4731.690')] [2023-03-10 19:25:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162880_83394560.pth... [2023-03-10 19:25:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162376_83136512.pth [2023-03-10 19:25:18,355][1054771] Saving new best policy, reward=4731.690! [2023-03-10 19:25:23,150][1054815] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-10 19:25:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 83435520. Throughput: 0: 8498.9. Samples: 83432956. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:23,348][1054527] Avg episode reward: [(0, '4539.458')] [2023-03-10 19:25:28,096][1054815] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-10 19:25:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 83476480. Throughput: 0: 8488.7. Samples: 83457980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:28,349][1054527] Avg episode reward: [(0, '4634.348')] [2023-03-10 19:25:32,838][1054815] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-10 19:25:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 83521536. Throughput: 0: 8471.6. Samples: 83508996. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:33,348][1054527] Avg episode reward: [(0, '4622.619')] [2023-03-10 19:25:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163128_83521536.pth... [2023-03-10 19:25:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162624_83263488.pth [2023-03-10 19:25:37,306][1054815] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-10 19:25:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 83566592. Throughput: 0: 8598.2. Samples: 83563320. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:38,348][1054527] Avg episode reward: [(0, '4456.510')] [2023-03-10 19:25:42,033][1054815] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-10 19:25:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 83607552. Throughput: 0: 8615.8. Samples: 83589832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:43,348][1054527] Avg episode reward: [(0, '4597.644')] [2023-03-10 19:25:46,862][1054815] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-10 19:25:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 83652608. Throughput: 0: 8610.4. Samples: 83640296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:48,348][1054527] Avg episode reward: [(0, '4637.668')] [2023-03-10 19:25:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163384_83652608.pth... [2023-03-10 19:25:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000162880_83394560.pth [2023-03-10 19:25:51,162][1054815] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-10 19:25:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 83697664. Throughput: 0: 8701.5. Samples: 83695968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:53,348][1054527] Avg episode reward: [(0, '4279.675')] [2023-03-10 19:25:55,948][1054815] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-10 19:25:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8553.0). Total num frames: 83738624. Throughput: 0: 8674.3. Samples: 83721300. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:25:58,348][1054527] Avg episode reward: [(0, '4310.065')] [2023-03-10 19:26:00,862][1054815] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-10 19:26:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 83783680. Throughput: 0: 8652.7. Samples: 83771716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:26:03,348][1054527] Avg episode reward: [(0, '4546.351')] [2023-03-10 19:26:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163640_83783680.pth... [2023-03-10 19:26:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163128_83521536.pth [2023-03-10 19:26:05,407][1054815] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-10 19:26:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 83828736. Throughput: 0: 8716.7. Samples: 83825208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:26:08,348][1054527] Avg episode reward: [(0, '4669.447')] [2023-03-10 19:26:09,866][1054815] Updated weights for policy 0, policy_version 163760 (0.0004) [2023-03-10 19:26:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 83873792. Throughput: 0: 8790.4. Samples: 83853548. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:26:13,348][1054527] Avg episode reward: [(0, '4673.105')] [2023-03-10 19:26:14,396][1054815] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-10 19:26:18,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 83922944. Throughput: 0: 8927.2. Samples: 83910720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:18,348][1054527] Avg episode reward: [(0, '4579.852')] [2023-03-10 19:26:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163912_83922944.pth... [2023-03-10 19:26:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163384_83652608.pth [2023-03-10 19:26:18,728][1054815] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-10 19:26:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 83963904. Throughput: 0: 8844.8. Samples: 83961336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:23,348][1054527] Avg episode reward: [(0, '4720.910')] [2023-03-10 19:26:23,575][1054815] Updated weights for policy 0, policy_version 164000 (0.0006) [2023-03-10 19:26:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 84004864. Throughput: 0: 8829.7. Samples: 83987168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:28,348][1054527] Avg episode reward: [(0, '4686.160')] [2023-03-10 19:26:28,547][1054815] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-10 19:26:33,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 84045824. Throughput: 0: 8827.3. Samples: 84037524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:33,348][1054527] Avg episode reward: [(0, '4408.817')] [2023-03-10 19:26:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164152_84045824.pth... [2023-03-10 19:26:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163640_83783680.pth [2023-03-10 19:26:33,395][1054815] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-10 19:26:38,213][1054815] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-10 19:26:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 84090880. Throughput: 0: 8686.4. Samples: 84086856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:38,349][1054527] Avg episode reward: [(0, '4400.339')] [2023-03-10 19:26:42,807][1054815] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-10 19:26:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 84135936. Throughput: 0: 8730.4. Samples: 84114168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:43,348][1054527] Avg episode reward: [(0, '4726.034')] [2023-03-10 19:26:47,246][1054815] Updated weights for policy 0, policy_version 164400 (0.0004) [2023-03-10 19:26:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8594.7). Total num frames: 84180992. Throughput: 0: 8822.2. Samples: 84168716. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:48,348][1054527] Avg episode reward: [(0, '4327.447')] [2023-03-10 19:26:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164416_84180992.pth... [2023-03-10 19:26:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000163912_83922944.pth [2023-03-10 19:26:51,758][1054815] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-10 19:26:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8594.7). Total num frames: 84226048. Throughput: 0: 8872.0. Samples: 84224448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:53,348][1054527] Avg episode reward: [(0, '4179.482')] [2023-03-10 19:26:56,187][1054815] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-10 19:26:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8608.5). Total num frames: 84271104. Throughput: 0: 8838.6. Samples: 84251284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:26:58,348][1054527] Avg episode reward: [(0, '4452.688')] [2023-03-10 19:27:00,720][1054815] Updated weights for policy 0, policy_version 164640 (0.0004) [2023-03-10 19:27:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8622.4). Total num frames: 84316160. Throughput: 0: 8750.2. Samples: 84304480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:27:03,348][1054527] Avg episode reward: [(0, '4596.564')] [2023-03-10 19:27:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164680_84316160.pth... [2023-03-10 19:27:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164152_84045824.pth [2023-03-10 19:27:05,597][1054815] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-10 19:27:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8608.5). Total num frames: 84357120. Throughput: 0: 8791.9. Samples: 84356972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:27:08,348][1054527] Avg episode reward: [(0, '4523.487')] [2023-03-10 19:27:10,182][1054815] Updated weights for policy 0, policy_version 164800 (0.0006) [2023-03-10 19:27:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 84402176. Throughput: 0: 8798.8. Samples: 84383116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:27:13,348][1054527] Avg episode reward: [(0, '4344.934')] [2023-03-10 19:27:14,906][1054815] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-10 19:27:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 84447232. Throughput: 0: 8830.4. Samples: 84434892. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:18,348][1054527] Avg episode reward: [(0, '4574.890')] [2023-03-10 19:27:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164936_84447232.pth... [2023-03-10 19:27:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164416_84180992.pth [2023-03-10 19:27:19,615][1054815] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-10 19:27:23,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 84492288. Throughput: 0: 8939.6. Samples: 84489140. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:23,348][1054527] Avg episode reward: [(0, '4462.697')] [2023-03-10 19:27:23,958][1054815] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-10 19:27:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 84537344. Throughput: 0: 8951.5. Samples: 84516984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:28,348][1054527] Avg episode reward: [(0, '4554.730')] [2023-03-10 19:27:28,591][1054815] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-10 19:27:33,324][1054815] Updated weights for policy 0, policy_version 165200 (0.0006) [2023-03-10 19:27:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8650.2). Total num frames: 84582400. Throughput: 0: 8916.4. Samples: 84569952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:33,349][1054527] Avg episode reward: [(0, '4634.042')] [2023-03-10 19:27:33,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165200_84582400.pth... [2023-03-10 19:27:33,357][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164680_84316160.pth [2023-03-10 19:27:37,830][1054815] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-10 19:27:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8664.1). Total num frames: 84627456. Throughput: 0: 8865.0. Samples: 84623372. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:38,349][1054527] Avg episode reward: [(0, '4492.842')] [2023-03-10 19:27:42,620][1054815] Updated weights for policy 0, policy_version 165360 (0.0005) [2023-03-10 19:27:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8650.2). Total num frames: 84668416. Throughput: 0: 8852.6. Samples: 84649652. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:43,348][1054527] Avg episode reward: [(0, '4537.977')] [2023-03-10 19:27:47,146][1054815] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-10 19:27:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8664.1). Total num frames: 84713472. Throughput: 0: 8826.4. Samples: 84701668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:48,348][1054527] Avg episode reward: [(0, '4552.881')] [2023-03-10 19:27:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165456_84713472.pth... [2023-03-10 19:27:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000164936_84447232.pth [2023-03-10 19:27:51,795][1054815] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-10 19:27:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 84758528. Throughput: 0: 8865.8. Samples: 84755932. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:53,348][1054527] Avg episode reward: [(0, '4546.977')] [2023-03-10 19:27:55,977][1054815] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-10 19:27:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8691.9). Total num frames: 84803584. Throughput: 0: 8962.6. Samples: 84786432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:27:58,348][1054527] Avg episode reward: [(0, '4465.000')] [2023-03-10 19:28:00,750][1054815] Updated weights for policy 0, policy_version 165680 (0.0004) [2023-03-10 19:28:03,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8705.7). Total num frames: 84848640. Throughput: 0: 8934.9. Samples: 84836964. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:28:03,348][1054527] Avg episode reward: [(0, '4484.889')] [2023-03-10 19:28:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165720_84848640.pth... [2023-03-10 19:28:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165200_84582400.pth [2023-03-10 19:28:05,134][1054815] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-10 19:28:08,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8733.5). Total num frames: 84897792. Throughput: 0: 8989.9. Samples: 84893684. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:28:08,348][1054527] Avg episode reward: [(0, '4494.202')] [2023-03-10 19:28:09,628][1054815] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-10 19:28:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8733.5). Total num frames: 84938752. Throughput: 0: 8947.4. Samples: 84919616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:28:13,348][1054527] Avg episode reward: [(0, '4504.539')] [2023-03-10 19:28:14,480][1054815] Updated weights for policy 0, policy_version 165920 (0.0005) [2023-03-10 19:28:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 8747.4). Total num frames: 84987904. Throughput: 0: 8945.6. Samples: 84972504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:28:18,348][1054527] Avg episode reward: [(0, '4518.202')] [2023-03-10 19:28:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165992_84987904.pth... [2023-03-10 19:28:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165456_84713472.pth [2023-03-10 19:28:18,785][1054815] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-10 19:28:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8747.4). Total num frames: 85028864. Throughput: 0: 8974.8. Samples: 85027236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:23,348][1054527] Avg episode reward: [(0, '4509.070')] [2023-03-10 19:28:23,541][1054815] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-10 19:28:28,215][1054815] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-10 19:28:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8761.3). Total num frames: 85073920. Throughput: 0: 8973.1. Samples: 85053440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:28,348][1054527] Avg episode reward: [(0, '4453.135')] [2023-03-10 19:28:33,080][1054815] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-10 19:28:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8747.4). Total num frames: 85114880. Throughput: 0: 8928.3. Samples: 85103444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:33,349][1054527] Avg episode reward: [(0, '4587.936')] [2023-03-10 19:28:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166240_85114880.pth... [2023-03-10 19:28:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165720_84848640.pth [2023-03-10 19:28:37,852][1054815] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-10 19:28:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8747.4). Total num frames: 85159936. Throughput: 0: 8886.8. Samples: 85155840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:38,348][1054527] Avg episode reward: [(0, '4538.224')] [2023-03-10 19:28:42,561][1054815] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-10 19:28:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8747.4). Total num frames: 85200896. Throughput: 0: 8804.0. Samples: 85182612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:43,348][1054527] Avg episode reward: [(0, '4455.230')] [2023-03-10 19:28:47,275][1054815] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-10 19:28:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8747.4). Total num frames: 85245952. Throughput: 0: 8817.0. Samples: 85233728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:48,348][1054527] Avg episode reward: [(0, '4449.144')] [2023-03-10 19:28:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166496_85245952.pth... [2023-03-10 19:28:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000165992_84987904.pth [2023-03-10 19:28:51,813][1054815] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-10 19:28:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8761.3). Total num frames: 85291008. Throughput: 0: 8752.3. Samples: 85287540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:53,348][1054527] Avg episode reward: [(0, '4355.957')] [2023-03-10 19:28:56,037][1054815] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-10 19:28:58,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8942.9, 300 sec: 8775.2). Total num frames: 85340160. Throughput: 0: 8860.0. Samples: 85318316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:28:58,348][1054527] Avg episode reward: [(0, '4520.279')] [2023-03-10 19:29:00,716][1054815] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-10 19:29:03,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 8775.2). Total num frames: 85385216. Throughput: 0: 8892.7. Samples: 85372676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:29:03,349][1054527] Avg episode reward: [(0, '4473.196')] [2023-03-10 19:29:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166768_85385216.pth... [2023-03-10 19:29:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166240_85114880.pth [2023-03-10 19:29:05,247][1054815] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-10 19:29:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 85426176. Throughput: 0: 8815.2. Samples: 85423920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:29:08,348][1054527] Avg episode reward: [(0, '4548.276')] [2023-03-10 19:29:10,027][1054815] Updated weights for policy 0, policy_version 166880 (0.0006) [2023-03-10 19:29:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 85467136. Throughput: 0: 8787.8. Samples: 85448892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:29:13,348][1054527] Avg episode reward: [(0, '4592.715')] [2023-03-10 19:29:14,822][1054815] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-10 19:29:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 85512192. Throughput: 0: 8821.9. Samples: 85500428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:29:18,348][1054527] Avg episode reward: [(0, '4637.554')] [2023-03-10 19:29:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167016_85512192.pth... [2023-03-10 19:29:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166496_85245952.pth [2023-03-10 19:29:19,456][1054815] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-10 19:29:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 85557248. Throughput: 0: 8839.9. Samples: 85553636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:29:23,348][1054527] Avg episode reward: [(0, '4559.965')] [2023-03-10 19:29:24,229][1054815] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-10 19:29:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8789.0). Total num frames: 85598208. Throughput: 0: 8783.0. Samples: 85577848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:28,348][1054527] Avg episode reward: [(0, '4507.416')] [2023-03-10 19:29:29,090][1054815] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-10 19:29:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 85643264. Throughput: 0: 8843.5. Samples: 85631684. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:33,348][1054527] Avg episode reward: [(0, '4679.849')] [2023-03-10 19:29:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167272_85643264.pth... [2023-03-10 19:29:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000166768_85385216.pth [2023-03-10 19:29:33,488][1054815] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-10 19:29:37,898][1054815] Updated weights for policy 0, policy_version 167360 (0.0006) [2023-03-10 19:29:38,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 85692416. Throughput: 0: 8895.4. Samples: 85687836. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:38,349][1054527] Avg episode reward: [(0, '4581.500')] [2023-03-10 19:29:42,411][1054815] Updated weights for policy 0, policy_version 167440 (0.0006) [2023-03-10 19:29:43,348][1054527] Fps is (10 sec: 9420.9, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 85737472. Throughput: 0: 8794.5. Samples: 85714068. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:43,348][1054527] Avg episode reward: [(0, '4456.534')] [2023-03-10 19:29:46,912][1054815] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-10 19:29:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 85782528. Throughput: 0: 8822.6. Samples: 85769692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:48,348][1054527] Avg episode reward: [(0, '4367.631')] [2023-03-10 19:29:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167544_85782528.pth... [2023-03-10 19:29:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167016_85512192.pth [2023-03-10 19:29:51,308][1054815] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-10 19:29:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 85827584. Throughput: 0: 8882.4. Samples: 85823628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:53,348][1054527] Avg episode reward: [(0, '4342.730')] [2023-03-10 19:29:56,338][1054815] Updated weights for policy 0, policy_version 167680 (0.0006) [2023-03-10 19:29:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8830.7). Total num frames: 85868544. Throughput: 0: 8870.5. Samples: 85848064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:29:58,348][1054527] Avg episode reward: [(0, '4593.589')] [2023-03-10 19:30:01,031][1054815] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-10 19:30:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8830.7). Total num frames: 85913600. Throughput: 0: 8908.5. Samples: 85901312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:03,348][1054527] Avg episode reward: [(0, '4508.744')] [2023-03-10 19:30:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167800_85913600.pth... [2023-03-10 19:30:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167272_85643264.pth [2023-03-10 19:30:05,265][1054815] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-10 19:30:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 85958656. Throughput: 0: 8932.4. Samples: 85955596. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:08,348][1054527] Avg episode reward: [(0, '4629.197')] [2023-03-10 19:30:10,120][1054815] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-10 19:30:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 85999616. Throughput: 0: 8970.1. Samples: 85981504. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:13,349][1054527] Avg episode reward: [(0, '4543.241')] [2023-03-10 19:30:14,739][1054815] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-10 19:30:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8858.5). Total num frames: 86048768. Throughput: 0: 8977.5. Samples: 86035672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:18,348][1054527] Avg episode reward: [(0, '4589.406')] [2023-03-10 19:30:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168064_86048768.pth... [2023-03-10 19:30:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167544_85782528.pth [2023-03-10 19:30:19,183][1054815] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-10 19:30:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 86089728. Throughput: 0: 8927.3. Samples: 86089564. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:23,348][1054527] Avg episode reward: [(0, '4467.585')] [2023-03-10 19:30:23,841][1054815] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-10 19:30:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 8858.5). Total num frames: 86134784. Throughput: 0: 8895.8. Samples: 86114380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 19:30:28,348][1054527] Avg episode reward: [(0, '4604.728')] [2023-03-10 19:30:28,526][1054815] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-10 19:30:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8844.6). Total num frames: 86175744. Throughput: 0: 8841.6. Samples: 86167564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:33,348][1054527] Avg episode reward: [(0, '4600.751')] [2023-03-10 19:30:33,385][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168320_86179840.pth... [2023-03-10 19:30:33,386][1054815] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-10 19:30:33,387][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000167800_85913600.pth [2023-03-10 19:30:37,962][1054815] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-10 19:30:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86220800. Throughput: 0: 8802.8. Samples: 86219752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:38,349][1054527] Avg episode reward: [(0, '4640.330')] [2023-03-10 19:30:42,631][1054815] Updated weights for policy 0, policy_version 168480 (0.0004) [2023-03-10 19:30:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86265856. Throughput: 0: 8828.4. Samples: 86245344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:43,348][1054527] Avg episode reward: [(0, '4176.995')] [2023-03-10 19:30:47,254][1054815] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-10 19:30:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86310912. Throughput: 0: 8830.6. Samples: 86298688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:48,348][1054527] Avg episode reward: [(0, '4260.519')] [2023-03-10 19:30:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168576_86310912.pth... [2023-03-10 19:30:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168064_86048768.pth [2023-03-10 19:30:51,896][1054815] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-10 19:30:53,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 86355968. Throughput: 0: 8807.9. Samples: 86351952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:53,348][1054527] Avg episode reward: [(0, '4225.809')] [2023-03-10 19:30:56,568][1054815] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-10 19:30:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86396928. Throughput: 0: 8825.6. Samples: 86378656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:30:58,348][1054527] Avg episode reward: [(0, '4395.285')] [2023-03-10 19:31:01,065][1054815] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-10 19:31:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86441984. Throughput: 0: 8821.0. Samples: 86432616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:03,348][1054527] Avg episode reward: [(0, '4353.214')] [2023-03-10 19:31:03,378][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168840_86446080.pth... [2023-03-10 19:31:03,381][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168320_86179840.pth [2023-03-10 19:31:05,703][1054815] Updated weights for policy 0, policy_version 168880 (0.0004) [2023-03-10 19:31:08,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8858.5). Total num frames: 86487040. Throughput: 0: 8757.2. Samples: 86483640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:08,348][1054527] Avg episode reward: [(0, '4538.217')] [2023-03-10 19:31:10,697][1054815] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-10 19:31:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8830.7). Total num frames: 86528000. Throughput: 0: 8759.9. Samples: 86508576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:13,348][1054527] Avg episode reward: [(0, '4578.379')] [2023-03-10 19:31:15,470][1054815] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-10 19:31:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8830.7). Total num frames: 86568960. Throughput: 0: 8712.3. Samples: 86559616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:18,348][1054527] Avg episode reward: [(0, '4731.049')] [2023-03-10 19:31:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169080_86568960.pth... [2023-03-10 19:31:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168576_86310912.pth [2023-03-10 19:31:20,408][1054815] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-10 19:31:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 86614016. Throughput: 0: 8695.2. Samples: 86611036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:23,348][1054527] Avg episode reward: [(0, '4736.740')] [2023-03-10 19:31:23,349][1054771] Saving new best policy, reward=4736.740! [2023-03-10 19:31:25,223][1054815] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-10 19:31:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8844.6). Total num frames: 86654976. Throughput: 0: 8690.5. Samples: 86636416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:28,348][1054527] Avg episode reward: [(0, '4733.265')] [2023-03-10 19:31:29,944][1054815] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-10 19:31:33,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 86700032. Throughput: 0: 8698.2. Samples: 86690108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:33,348][1054527] Avg episode reward: [(0, '4732.193')] [2023-03-10 19:31:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169336_86700032.pth... [2023-03-10 19:31:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000168840_86446080.pth [2023-03-10 19:31:34,237][1054815] Updated weights for policy 0, policy_version 169360 (0.0006) [2023-03-10 19:31:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 86745088. Throughput: 0: 8699.6. Samples: 86743436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:38,348][1054527] Avg episode reward: [(0, '4686.611')] [2023-03-10 19:31:38,923][1054815] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-10 19:31:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8844.6). Total num frames: 86790144. Throughput: 0: 8682.5. Samples: 86769368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:43,348][1054527] Avg episode reward: [(0, '4732.378')] [2023-03-10 19:31:43,866][1054815] Updated weights for policy 0, policy_version 169520 (0.0004) [2023-03-10 19:31:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8830.7). Total num frames: 86831104. Throughput: 0: 8605.4. Samples: 86819860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:48,348][1054527] Avg episode reward: [(0, '4734.568')] [2023-03-10 19:31:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169592_86831104.pth... [2023-03-10 19:31:48,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169080_86568960.pth [2023-03-10 19:31:48,527][1054815] Updated weights for policy 0, policy_version 169600 (0.0004) [2023-03-10 19:31:53,152][1054815] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-10 19:31:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8830.7). Total num frames: 86876160. Throughput: 0: 8654.0. Samples: 86873072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:53,348][1054527] Avg episode reward: [(0, '4686.320')] [2023-03-10 19:31:58,000][1054815] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-10 19:31:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8816.8). Total num frames: 86917120. Throughput: 0: 8681.1. Samples: 86899228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:31:58,348][1054527] Avg episode reward: [(0, '4635.385')] [2023-03-10 19:32:02,914][1054815] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-10 19:32:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8816.8). Total num frames: 86958080. Throughput: 0: 8671.0. Samples: 86949812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:03,348][1054527] Avg episode reward: [(0, '4684.166')] [2023-03-10 19:32:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169840_86958080.pth... [2023-03-10 19:32:03,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169336_86700032.pth [2023-03-10 19:32:07,839][1054815] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-10 19:32:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8816.8). Total num frames: 87003136. Throughput: 0: 8622.3. Samples: 86999040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:08,349][1054527] Avg episode reward: [(0, '4730.320')] [2023-03-10 19:32:12,552][1054815] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-10 19:32:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8802.9). Total num frames: 87044096. Throughput: 0: 8655.7. Samples: 87025920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:13,348][1054527] Avg episode reward: [(0, '4685.339')] [2023-03-10 19:32:17,407][1054815] Updated weights for policy 0, policy_version 170080 (0.0006) [2023-03-10 19:32:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.8, 300 sec: 8802.9). Total num frames: 87089152. Throughput: 0: 8593.9. Samples: 87076836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:18,349][1054527] Avg episode reward: [(0, '4680.244')] [2023-03-10 19:32:18,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170096_87089152.pth... [2023-03-10 19:32:18,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169592_86831104.pth [2023-03-10 19:32:22,307][1054815] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-10 19:32:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8789.0). Total num frames: 87130112. Throughput: 0: 8512.3. Samples: 87126488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:23,348][1054527] Avg episode reward: [(0, '4619.790')] [2023-03-10 19:32:27,089][1054815] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-10 19:32:28,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8775.2). Total num frames: 87171072. Throughput: 0: 8521.2. Samples: 87152824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:28,348][1054527] Avg episode reward: [(0, '4716.803')] [2023-03-10 19:32:32,006][1054815] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-10 19:32:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8761.3). Total num frames: 87212032. Throughput: 0: 8521.1. Samples: 87203312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:33,348][1054527] Avg episode reward: [(0, '4638.097')] [2023-03-10 19:32:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170336_87212032.pth... [2023-03-10 19:32:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000169840_86958080.pth [2023-03-10 19:32:37,001][1054815] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-10 19:32:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8761.3). Total num frames: 87252992. Throughput: 0: 8422.3. Samples: 87252076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:32:38,348][1054527] Avg episode reward: [(0, '4452.919')] [2023-03-10 19:32:41,786][1054815] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-10 19:32:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8761.3). Total num frames: 87298048. Throughput: 0: 8406.4. Samples: 87277516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:32:43,348][1054527] Avg episode reward: [(0, '4565.040')] [2023-03-10 19:32:46,785][1054815] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-10 19:32:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8747.4). Total num frames: 87339008. Throughput: 0: 8377.3. Samples: 87326792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:32:48,348][1054527] Avg episode reward: [(0, '4544.938')] [2023-03-10 19:32:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170584_87339008.pth... [2023-03-10 19:32:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170096_87089152.pth [2023-03-10 19:32:51,591][1054815] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-10 19:32:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8733.5). Total num frames: 87379968. Throughput: 0: 8413.8. Samples: 87377660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:32:53,348][1054527] Avg episode reward: [(0, '4542.277')] [2023-03-10 19:32:56,784][1054815] Updated weights for policy 0, policy_version 170720 (0.0004) [2023-03-10 19:32:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8719.6). Total num frames: 87420928. Throughput: 0: 8338.9. Samples: 87401172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:32:58,348][1054527] Avg episode reward: [(0, '4678.701')] [2023-03-10 19:33:01,508][1054815] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-10 19:33:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8705.7). Total num frames: 87465984. Throughput: 0: 8355.4. Samples: 87452828. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:03,348][1054527] Avg episode reward: [(0, '4628.063')] [2023-03-10 19:33:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170832_87465984.pth... [2023-03-10 19:33:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170336_87212032.pth [2023-03-10 19:33:06,006][1054815] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-10 19:33:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8705.7). Total num frames: 87506944. Throughput: 0: 8444.3. Samples: 87506480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:08,348][1054527] Avg episode reward: [(0, '4553.741')] [2023-03-10 19:33:10,819][1054815] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-10 19:33:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8691.9). Total num frames: 87552000. Throughput: 0: 8415.7. Samples: 87531528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:13,348][1054527] Avg episode reward: [(0, '4277.028')] [2023-03-10 19:33:15,425][1054815] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-10 19:33:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8705.7). Total num frames: 87597056. Throughput: 0: 8478.4. Samples: 87584840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:18,349][1054527] Avg episode reward: [(0, '4075.850')] [2023-03-10 19:33:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171088_87597056.pth... [2023-03-10 19:33:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170584_87339008.pth [2023-03-10 19:33:20,220][1054815] Updated weights for policy 0, policy_version 171120 (0.0006) [2023-03-10 19:33:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8691.9). Total num frames: 87638016. Throughput: 0: 8538.6. Samples: 87636312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:23,348][1054527] Avg episode reward: [(0, '4310.219')] [2023-03-10 19:33:24,950][1054815] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-10 19:33:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8691.9). Total num frames: 87678976. Throughput: 0: 8547.8. Samples: 87662168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:28,348][1054527] Avg episode reward: [(0, '4291.030')] [2023-03-10 19:33:29,812][1054815] Updated weights for policy 0, policy_version 171280 (0.0005) [2023-03-10 19:33:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8691.8). Total num frames: 87724032. Throughput: 0: 8554.1. Samples: 87711728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:33,348][1054527] Avg episode reward: [(0, '4496.350')] [2023-03-10 19:33:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171336_87724032.pth... [2023-03-10 19:33:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000170832_87465984.pth [2023-03-10 19:33:34,702][1054815] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-10 19:33:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8691.9). Total num frames: 87764992. Throughput: 0: 8578.8. Samples: 87763704. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:38,348][1054527] Avg episode reward: [(0, '4595.863')] [2023-03-10 19:33:39,528][1054815] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-10 19:33:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 87805952. Throughput: 0: 8589.9. Samples: 87787720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:43,348][1054527] Avg episode reward: [(0, '4180.065')] [2023-03-10 19:33:44,586][1054815] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-10 19:33:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8664.1). Total num frames: 87846912. Throughput: 0: 8547.5. Samples: 87837464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:48,348][1054527] Avg episode reward: [(0, '4314.500')] [2023-03-10 19:33:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171576_87846912.pth... [2023-03-10 19:33:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171088_87597056.pth [2023-03-10 19:33:49,525][1054815] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-10 19:33:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8650.2). Total num frames: 87891968. Throughput: 0: 8474.1. Samples: 87887816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:53,348][1054527] Avg episode reward: [(0, '4443.489')] [2023-03-10 19:33:54,307][1054815] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-10 19:33:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 87928832. Throughput: 0: 8464.3. Samples: 87912420. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:33:58,348][1054527] Avg episode reward: [(0, '4443.873')] [2023-03-10 19:33:59,386][1054815] Updated weights for policy 0, policy_version 171760 (0.0004) [2023-03-10 19:34:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 87973888. Throughput: 0: 8371.2. Samples: 87961544. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:03,349][1054527] Avg episode reward: [(0, '4625.259')] [2023-03-10 19:34:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171824_87973888.pth... [2023-03-10 19:34:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171336_87724032.pth [2023-03-10 19:34:04,347][1054815] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-10 19:34:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 88014848. Throughput: 0: 8361.1. Samples: 88012564. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:08,348][1054527] Avg episode reward: [(0, '4635.883')] [2023-03-10 19:34:09,063][1054815] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-10 19:34:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 88059904. Throughput: 0: 8379.7. Samples: 88039256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:13,348][1054527] Avg episode reward: [(0, '4640.543')] [2023-03-10 19:34:13,698][1054815] Updated weights for policy 0, policy_version 172000 (0.0006) [2023-03-10 19:34:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8622.4). Total num frames: 88100864. Throughput: 0: 8426.7. Samples: 88090928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:18,348][1054527] Avg episode reward: [(0, '4545.128')] [2023-03-10 19:34:18,376][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172080_88104960.pth... [2023-03-10 19:34:18,377][1054815] Updated weights for policy 0, policy_version 172080 (0.0005) [2023-03-10 19:34:18,377][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171576_87846912.pth [2023-03-10 19:34:22,996][1054815] Updated weights for policy 0, policy_version 172160 (0.0005) [2023-03-10 19:34:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8636.3). Total num frames: 88145920. Throughput: 0: 8463.2. Samples: 88144548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:23,348][1054527] Avg episode reward: [(0, '4586.109')] [2023-03-10 19:34:28,109][1054815] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-10 19:34:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 88186880. Throughput: 0: 8494.8. Samples: 88169984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:28,348][1054527] Avg episode reward: [(0, '4634.295')] [2023-03-10 19:34:33,138][1054815] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-10 19:34:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 88227840. Throughput: 0: 8407.0. Samples: 88215780. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:33,348][1054527] Avg episode reward: [(0, '4728.787')] [2023-03-10 19:34:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172320_88227840.pth... [2023-03-10 19:34:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000171824_87973888.pth [2023-03-10 19:34:37,995][1054815] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-10 19:34:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8580.8). Total num frames: 88268800. Throughput: 0: 8442.3. Samples: 88267720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:38,348][1054527] Avg episode reward: [(0, '4538.597')] [2023-03-10 19:34:42,773][1054815] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-10 19:34:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8580.8). Total num frames: 88313856. Throughput: 0: 8465.7. Samples: 88293376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:43,348][1054527] Avg episode reward: [(0, '4729.589')] [2023-03-10 19:34:47,819][1054815] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-10 19:34:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 88354816. Throughput: 0: 8471.5. Samples: 88342764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:48,348][1054527] Avg episode reward: [(0, '4724.294')] [2023-03-10 19:34:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172568_88354816.pth... [2023-03-10 19:34:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172080_88104960.pth [2023-03-10 19:34:52,631][1054815] Updated weights for policy 0, policy_version 172640 (0.0004) [2023-03-10 19:34:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 88395776. Throughput: 0: 8463.0. Samples: 88393400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:53,348][1054527] Avg episode reward: [(0, '4585.912')] [2023-03-10 19:34:57,386][1054815] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-10 19:34:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8566.9). Total num frames: 88440832. Throughput: 0: 8431.7. Samples: 88418684. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:34:58,348][1054527] Avg episode reward: [(0, '4594.037')] [2023-03-10 19:35:02,147][1054815] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-10 19:35:03,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 88481792. Throughput: 0: 8443.2. Samples: 88470872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:03,348][1054527] Avg episode reward: [(0, '4286.558')] [2023-03-10 19:35:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172816_88481792.pth... [2023-03-10 19:35:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172320_88227840.pth [2023-03-10 19:35:07,080][1054815] Updated weights for policy 0, policy_version 172880 (0.0005) [2023-03-10 19:35:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 88522752. Throughput: 0: 8363.9. Samples: 88520924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:08,348][1054527] Avg episode reward: [(0, '3846.041')] [2023-03-10 19:35:11,900][1054815] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-10 19:35:13,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 88563712. Throughput: 0: 8368.2. Samples: 88546552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:13,348][1054527] Avg episode reward: [(0, '4250.248')] [2023-03-10 19:35:16,829][1054815] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-10 19:35:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 88608768. Throughput: 0: 8460.2. Samples: 88596488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:18,348][1054527] Avg episode reward: [(0, '4633.538')] [2023-03-10 19:35:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173064_88608768.pth... [2023-03-10 19:35:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172568_88354816.pth [2023-03-10 19:35:21,866][1054815] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-10 19:35:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 88649728. Throughput: 0: 8398.1. Samples: 88645636. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:23,348][1054527] Avg episode reward: [(0, '4591.285')] [2023-03-10 19:35:26,762][1054815] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-10 19:35:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8525.2). Total num frames: 88690688. Throughput: 0: 8382.2. Samples: 88670576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:28,348][1054527] Avg episode reward: [(0, '4592.704')] [2023-03-10 19:35:31,633][1054815] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-10 19:35:33,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8525.2). Total num frames: 88735744. Throughput: 0: 8408.7. Samples: 88721156. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:33,348][1054527] Avg episode reward: [(0, '4582.731')] [2023-03-10 19:35:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173312_88735744.pth... [2023-03-10 19:35:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000172816_88481792.pth [2023-03-10 19:35:36,122][1054815] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-10 19:35:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 88776704. Throughput: 0: 8511.4. Samples: 88776412. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:38,348][1054527] Avg episode reward: [(0, '4369.829')] [2023-03-10 19:35:40,652][1054815] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-10 19:35:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 88821760. Throughput: 0: 8533.5. Samples: 88802692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:43,348][1054527] Avg episode reward: [(0, '4630.339')] [2023-03-10 19:35:45,375][1054815] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-10 19:35:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 88862720. Throughput: 0: 8521.1. Samples: 88854324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:48,348][1054527] Avg episode reward: [(0, '4672.734')] [2023-03-10 19:35:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173560_88862720.pth... [2023-03-10 19:35:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173064_88608768.pth [2023-03-10 19:35:50,325][1054815] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-10 19:35:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 88907776. Throughput: 0: 8522.3. Samples: 88904428. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:35:53,348][1054527] Avg episode reward: [(0, '4587.483')] [2023-03-10 19:35:55,294][1054815] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-10 19:35:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 88948736. Throughput: 0: 8483.7. Samples: 88928320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:35:58,348][1054527] Avg episode reward: [(0, '4676.024')] [2023-03-10 19:35:59,965][1054815] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-10 19:36:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.0, 300 sec: 8483.6). Total num frames: 88989696. Throughput: 0: 8515.6. Samples: 88979688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:03,348][1054527] Avg episode reward: [(0, '4719.805')] [2023-03-10 19:36:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173808_88989696.pth... [2023-03-10 19:36:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173312_88735744.pth [2023-03-10 19:36:05,062][1054815] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-10 19:36:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 89030656. Throughput: 0: 8517.3. Samples: 89028916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:08,348][1054527] Avg episode reward: [(0, '4585.565')] [2023-03-10 19:36:09,756][1054815] Updated weights for policy 0, policy_version 173920 (0.0006) [2023-03-10 19:36:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 89075712. Throughput: 0: 8611.7. Samples: 89058104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:13,348][1054527] Avg episode reward: [(0, '4549.394')] [2023-03-10 19:36:14,522][1054815] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-10 19:36:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 89116672. Throughput: 0: 8584.4. Samples: 89107452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:18,348][1054527] Avg episode reward: [(0, '4684.815')] [2023-03-10 19:36:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174056_89116672.pth... [2023-03-10 19:36:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173560_88862720.pth [2023-03-10 19:36:19,553][1054815] Updated weights for policy 0, policy_version 174080 (0.0006) [2023-03-10 19:36:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 89157632. Throughput: 0: 8448.1. Samples: 89156576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:23,348][1054527] Avg episode reward: [(0, '4676.374')] [2023-03-10 19:36:24,525][1054815] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-10 19:36:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 89198592. Throughput: 0: 8406.4. Samples: 89180980. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:28,348][1054527] Avg episode reward: [(0, '4698.997')] [2023-03-10 19:36:29,432][1054815] Updated weights for policy 0, policy_version 174240 (0.0006) [2023-03-10 19:36:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 89239552. Throughput: 0: 8373.5. Samples: 89231132. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:33,349][1054527] Avg episode reward: [(0, '4524.533')] [2023-03-10 19:36:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174296_89239552.pth... [2023-03-10 19:36:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000173808_88989696.pth [2023-03-10 19:36:34,488][1054815] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-10 19:36:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8441.9). Total num frames: 89280512. Throughput: 0: 8324.0. Samples: 89279008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:38,348][1054527] Avg episode reward: [(0, '4641.340')] [2023-03-10 19:36:39,534][1054815] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-10 19:36:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8441.9). Total num frames: 89321472. Throughput: 0: 8356.6. Samples: 89304368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:43,348][1054527] Avg episode reward: [(0, '4598.776')] [2023-03-10 19:36:44,631][1054815] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-10 19:36:48,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 89362432. Throughput: 0: 8251.5. Samples: 89351004. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:48,349][1054527] Avg episode reward: [(0, '4627.046')] [2023-03-10 19:36:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174536_89362432.pth... [2023-03-10 19:36:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174056_89116672.pth [2023-03-10 19:36:49,889][1054815] Updated weights for policy 0, policy_version 174560 (0.0004) [2023-03-10 19:36:53,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8414.2). Total num frames: 89399296. Throughput: 0: 8223.4. Samples: 89398968. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:53,348][1054527] Avg episode reward: [(0, '4593.052')] [2023-03-10 19:36:55,038][1054815] Updated weights for policy 0, policy_version 174640 (0.0004) [2023-03-10 19:36:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8428.0). Total num frames: 89444352. Throughput: 0: 8099.4. Samples: 89422576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:36:58,349][1054527] Avg episode reward: [(0, '4662.907')] [2023-03-10 19:36:59,779][1054815] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-10 19:37:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8260.3, 300 sec: 8414.2). Total num frames: 89485312. Throughput: 0: 8132.5. Samples: 89473416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:03,348][1054527] Avg episode reward: [(0, '4694.392')] [2023-03-10 19:37:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174776_89485312.pth... [2023-03-10 19:37:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174296_89239552.pth [2023-03-10 19:37:04,584][1054815] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-10 19:37:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8414.2). Total num frames: 89526272. Throughput: 0: 8192.0. Samples: 89525216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:08,348][1054527] Avg episode reward: [(0, '4588.020')] [2023-03-10 19:37:09,431][1054815] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-10 19:37:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8192.0, 300 sec: 8400.3). Total num frames: 89567232. Throughput: 0: 8205.4. Samples: 89550224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:13,348][1054527] Avg episode reward: [(0, '4686.938')] [2023-03-10 19:37:14,162][1054815] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-10 19:37:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8414.2). Total num frames: 89612288. Throughput: 0: 8277.0. Samples: 89603596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:18,348][1054527] Avg episode reward: [(0, '4598.670')] [2023-03-10 19:37:18,398][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175032_89616384.pth... [2023-03-10 19:37:18,400][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174536_89362432.pth [2023-03-10 19:37:18,862][1054815] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-10 19:37:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 89657344. Throughput: 0: 8355.7. Samples: 89655016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:23,348][1054527] Avg episode reward: [(0, '4504.132')] [2023-03-10 19:37:23,472][1054815] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-10 19:37:28,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 89698304. Throughput: 0: 8347.8. Samples: 89680020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:28,348][1054527] Avg episode reward: [(0, '4596.531')] [2023-03-10 19:37:28,613][1054815] Updated weights for policy 0, policy_version 175200 (0.0004) [2023-03-10 19:37:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8428.0). Total num frames: 89739264. Throughput: 0: 8419.8. Samples: 89729892. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:33,348][1054527] Avg episode reward: [(0, '4549.188')] [2023-03-10 19:37:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175272_89739264.pth... [2023-03-10 19:37:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000174776_89485312.pth [2023-03-10 19:37:33,468][1054815] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-10 19:37:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8414.2). Total num frames: 89780224. Throughput: 0: 8429.5. Samples: 89778296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:38,348][1054527] Avg episode reward: [(0, '4598.086')] [2023-03-10 19:37:38,594][1054815] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-10 19:37:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8414.2). Total num frames: 89821184. Throughput: 0: 8463.1. Samples: 89803412. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:43,348][1054527] Avg episode reward: [(0, '4552.885')] [2023-03-10 19:37:43,491][1054815] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-10 19:37:48,280][1054815] Updated weights for policy 0, policy_version 175520 (0.0005) [2023-03-10 19:37:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8428.0). Total num frames: 89866240. Throughput: 0: 8456.5. Samples: 89853960. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:48,348][1054527] Avg episode reward: [(0, '4737.828')] [2023-03-10 19:37:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175520_89866240.pth... [2023-03-10 19:37:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175032_89616384.pth [2023-03-10 19:37:48,355][1054771] Saving new best policy, reward=4737.828! [2023-03-10 19:37:53,312][1054815] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-10 19:37:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8428.0). Total num frames: 89907200. Throughput: 0: 8395.7. Samples: 89903024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:53,348][1054527] Avg episode reward: [(0, '4656.366')] [2023-03-10 19:37:58,126][1054815] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-10 19:37:58,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 89948160. Throughput: 0: 8389.3. Samples: 89927744. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:37:58,348][1054527] Avg episode reward: [(0, '4688.193')] [2023-03-10 19:38:02,964][1054815] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-10 19:38:03,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 89989120. Throughput: 0: 8360.6. Samples: 89979824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:38:03,348][1054527] Avg episode reward: [(0, '4573.909')] [2023-03-10 19:38:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175760_89989120.pth... [2023-03-10 19:38:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175272_89739264.pth [2023-03-10 19:38:08,215][1054815] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-10 19:38:08,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 90030080. Throughput: 0: 8263.7. Samples: 90026884. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:08,348][1054527] Avg episode reward: [(0, '4169.934')] [2023-03-10 19:38:13,078][1054815] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-10 19:38:13,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8386.4). Total num frames: 90071040. Throughput: 0: 8271.6. Samples: 90052240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:13,349][1054527] Avg episode reward: [(0, '3927.950')] [2023-03-10 19:38:18,116][1054815] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-10 19:38:18,348][1054527] Fps is (10 sec: 8191.8, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 90112000. Throughput: 0: 8275.1. Samples: 90102272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:18,348][1054527] Avg episode reward: [(0, '4440.314')] [2023-03-10 19:38:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176000_90112000.pth... [2023-03-10 19:38:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175520_89866240.pth [2023-03-10 19:38:22,958][1054815] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-10 19:38:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8386.4). Total num frames: 90152960. Throughput: 0: 8298.9. Samples: 90151744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:23,348][1054527] Avg episode reward: [(0, '4632.084')] [2023-03-10 19:38:28,263][1054815] Updated weights for policy 0, policy_version 176160 (0.0005) [2023-03-10 19:38:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 90193920. Throughput: 0: 8249.2. Samples: 90174628. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:28,348][1054527] Avg episode reward: [(0, '4458.838')] [2023-03-10 19:38:32,968][1054815] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-10 19:38:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 90234880. Throughput: 0: 8235.6. Samples: 90224564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:33,348][1054527] Avg episode reward: [(0, '4537.978')] [2023-03-10 19:38:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176240_90234880.pth... [2023-03-10 19:38:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000175760_89989120.pth [2023-03-10 19:38:37,972][1054815] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-10 19:38:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8372.5). Total num frames: 90275840. Throughput: 0: 8269.6. Samples: 90275156. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:38,348][1054527] Avg episode reward: [(0, '4688.378')] [2023-03-10 19:38:42,844][1054815] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-10 19:38:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8386.4). Total num frames: 90320896. Throughput: 0: 8264.7. Samples: 90299656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:43,348][1054527] Avg episode reward: [(0, '4593.929')] [2023-03-10 19:38:47,410][1054815] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-10 19:38:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8260.2, 300 sec: 8372.5). Total num frames: 90361856. Throughput: 0: 8294.3. Samples: 90353068. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:48,349][1054527] Avg episode reward: [(0, '4682.284')] [2023-03-10 19:38:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176496_90365952.pth... [2023-03-10 19:38:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176000_90112000.pth [2023-03-10 19:38:52,148][1054815] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-10 19:38:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8400.3). Total num frames: 90406912. Throughput: 0: 8384.0. Samples: 90404164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:53,348][1054527] Avg episode reward: [(0, '4628.396')] [2023-03-10 19:38:56,850][1054815] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-10 19:38:58,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 90451968. Throughput: 0: 8421.5. Samples: 90431208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:38:58,348][1054527] Avg episode reward: [(0, '4682.386')] [2023-03-10 19:39:01,478][1054815] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-10 19:39:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 90492928. Throughput: 0: 8487.9. Samples: 90484228. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:39:03,348][1054527] Avg episode reward: [(0, '4731.589')] [2023-03-10 19:39:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176744_90492928.pth... [2023-03-10 19:39:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176240_90234880.pth [2023-03-10 19:39:06,289][1054815] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-10 19:39:08,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8386.4). Total num frames: 90533888. Throughput: 0: 8492.3. Samples: 90533896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:39:08,348][1054527] Avg episode reward: [(0, '4679.872')] [2023-03-10 19:39:11,030][1054815] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-10 19:39:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8400.3). Total num frames: 90578944. Throughput: 0: 8590.3. Samples: 90561192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:39:13,348][1054527] Avg episode reward: [(0, '4633.498')] [2023-03-10 19:39:15,936][1054815] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-10 19:39:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 90624000. Throughput: 0: 8603.3. Samples: 90611712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:18,348][1054527] Avg episode reward: [(0, '4626.033')] [2023-03-10 19:39:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177000_90624000.pth... [2023-03-10 19:39:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176496_90365952.pth [2023-03-10 19:39:20,555][1054815] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-10 19:39:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 90664960. Throughput: 0: 8651.4. Samples: 90664468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:23,348][1054527] Avg episode reward: [(0, '4604.760')] [2023-03-10 19:39:25,415][1054815] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-10 19:39:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 90705920. Throughput: 0: 8663.9. Samples: 90689532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:28,348][1054527] Avg episode reward: [(0, '4725.654')] [2023-03-10 19:39:30,279][1054815] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-10 19:39:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 90746880. Throughput: 0: 8569.6. Samples: 90738700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:33,348][1054527] Avg episode reward: [(0, '4553.629')] [2023-03-10 19:39:33,372][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177248_90750976.pth... [2023-03-10 19:39:33,373][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000176744_90492928.pth [2023-03-10 19:39:35,376][1054815] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-10 19:39:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8386.4). Total num frames: 90787840. Throughput: 0: 8525.6. Samples: 90787816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:38,348][1054527] Avg episode reward: [(0, '4622.131')] [2023-03-10 19:39:40,485][1054815] Updated weights for policy 0, policy_version 177360 (0.0004) [2023-03-10 19:39:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8465.1, 300 sec: 8386.4). Total num frames: 90828800. Throughput: 0: 8452.8. Samples: 90811584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:43,348][1054527] Avg episode reward: [(0, '4675.037')] [2023-03-10 19:39:45,409][1054815] Updated weights for policy 0, policy_version 177440 (0.0004) [2023-03-10 19:39:48,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8386.4). Total num frames: 90869760. Throughput: 0: 8381.9. Samples: 90861412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:48,348][1054527] Avg episode reward: [(0, '4675.049')] [2023-03-10 19:39:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177480_90869760.pth... [2023-03-10 19:39:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177000_90624000.pth [2023-03-10 19:39:50,267][1054815] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-10 19:39:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8386.4). Total num frames: 90914816. Throughput: 0: 8392.2. Samples: 90911544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:53,348][1054527] Avg episode reward: [(0, '4636.798')] [2023-03-10 19:39:54,911][1054815] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-10 19:39:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8465.0, 300 sec: 8400.3). Total num frames: 90959872. Throughput: 0: 8410.4. Samples: 90939660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:39:58,348][1054527] Avg episode reward: [(0, '4679.335')] [2023-03-10 19:39:59,590][1054815] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-10 19:40:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8400.3). Total num frames: 91000832. Throughput: 0: 8429.4. Samples: 90991036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:03,348][1054527] Avg episode reward: [(0, '4635.344')] [2023-03-10 19:40:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177736_91000832.pth... [2023-03-10 19:40:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177248_90750976.pth [2023-03-10 19:40:04,425][1054815] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-10 19:40:08,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8414.2). Total num frames: 91045888. Throughput: 0: 8385.0. Samples: 91041792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:08,348][1054527] Avg episode reward: [(0, '4683.762')] [2023-03-10 19:40:09,214][1054815] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-10 19:40:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8400.3). Total num frames: 91086848. Throughput: 0: 8404.4. Samples: 91067732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:13,349][1054527] Avg episode reward: [(0, '4725.825')] [2023-03-10 19:40:14,180][1054815] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-10 19:40:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8396.8, 300 sec: 8400.3). Total num frames: 91127808. Throughput: 0: 8382.1. Samples: 91115896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:18,348][1054527] Avg episode reward: [(0, '4682.358')] [2023-03-10 19:40:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177984_91127808.pth... [2023-03-10 19:40:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177480_90869760.pth [2023-03-10 19:40:19,032][1054815] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-10 19:40:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8414.2). Total num frames: 91172864. Throughput: 0: 8465.8. Samples: 91168776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:23,348][1054527] Avg episode reward: [(0, '4541.336')] [2023-03-10 19:40:23,748][1054815] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-10 19:40:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8400.3). Total num frames: 91213824. Throughput: 0: 8485.4. Samples: 91193428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:28,348][1054527] Avg episode reward: [(0, '4681.172')] [2023-03-10 19:40:28,554][1054815] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-10 19:40:33,217][1054815] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-10 19:40:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8414.2). Total num frames: 91258880. Throughput: 0: 8546.5. Samples: 91246004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:33,348][1054527] Avg episode reward: [(0, '4685.656')] [2023-03-10 19:40:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178240_91258880.pth... [2023-03-10 19:40:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177736_91000832.pth [2023-03-10 19:40:38,067][1054815] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-10 19:40:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 91299840. Throughput: 0: 8585.4. Samples: 91297888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:38,348][1054527] Avg episode reward: [(0, '4637.349')] [2023-03-10 19:40:42,889][1054815] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-10 19:40:43,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8400.3). Total num frames: 91340800. Throughput: 0: 8538.0. Samples: 91323868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:43,348][1054527] Avg episode reward: [(0, '4593.232')] [2023-03-10 19:40:47,524][1054815] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-10 19:40:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8400.3). Total num frames: 91385856. Throughput: 0: 8534.3. Samples: 91375080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:48,348][1054527] Avg episode reward: [(0, '4499.379')] [2023-03-10 19:40:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178488_91385856.pth... [2023-03-10 19:40:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000177984_91127808.pth [2023-03-10 19:40:52,318][1054815] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-10 19:40:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8414.2). Total num frames: 91430912. Throughput: 0: 8567.6. Samples: 91427336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:53,348][1054527] Avg episode reward: [(0, '4685.419')] [2023-03-10 19:40:57,035][1054815] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-10 19:40:58,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 91475968. Throughput: 0: 8586.4. Samples: 91454120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:40:58,348][1054527] Avg episode reward: [(0, '4646.288')] [2023-03-10 19:41:01,620][1054815] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-10 19:41:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 91516928. Throughput: 0: 8676.6. Samples: 91506344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:41:03,348][1054527] Avg episode reward: [(0, '4686.846')] [2023-03-10 19:41:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178744_91516928.pth... [2023-03-10 19:41:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178240_91258880.pth [2023-03-10 19:41:06,395][1054815] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-10 19:41:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 91561984. Throughput: 0: 8662.9. Samples: 91558608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:41:08,348][1054527] Avg episode reward: [(0, '4684.356')] [2023-03-10 19:41:11,347][1054815] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-10 19:41:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 91602944. Throughput: 0: 8644.9. Samples: 91582448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:41:13,348][1054527] Avg episode reward: [(0, '4560.873')] [2023-03-10 19:41:16,154][1054815] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-10 19:41:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8428.0). Total num frames: 91643904. Throughput: 0: 8604.9. Samples: 91633224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:41:18,348][1054527] Avg episode reward: [(0, '4447.619')] [2023-03-10 19:41:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178992_91643904.pth... [2023-03-10 19:41:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178488_91385856.pth [2023-03-10 19:41:21,016][1054815] Updated weights for policy 0, policy_version 179040 (0.0004) [2023-03-10 19:41:23,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 91688960. Throughput: 0: 8600.9. Samples: 91684928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:41:23,348][1054527] Avg episode reward: [(0, '4484.061')] [2023-03-10 19:41:25,737][1054815] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-10 19:41:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8441.9). Total num frames: 91729920. Throughput: 0: 8578.2. Samples: 91709888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:28,348][1054527] Avg episode reward: [(0, '4670.826')] [2023-03-10 19:41:30,535][1054815] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-10 19:41:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8441.9). Total num frames: 91770880. Throughput: 0: 8588.3. Samples: 91761556. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:33,348][1054527] Avg episode reward: [(0, '4728.376')] [2023-03-10 19:41:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179240_91770880.pth... [2023-03-10 19:41:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178744_91516928.pth [2023-03-10 19:41:35,286][1054815] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-10 19:41:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 91815936. Throughput: 0: 8594.3. Samples: 91814080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:38,349][1054527] Avg episode reward: [(0, '4725.300')] [2023-03-10 19:41:39,929][1054815] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-10 19:41:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8455.8). Total num frames: 91856896. Throughput: 0: 8570.9. Samples: 91839808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:43,348][1054527] Avg episode reward: [(0, '4719.674')] [2023-03-10 19:41:44,994][1054815] Updated weights for policy 0, policy_version 179440 (0.0004) [2023-03-10 19:41:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 91897856. Throughput: 0: 8479.1. Samples: 91887904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:48,348][1054527] Avg episode reward: [(0, '4678.773')] [2023-03-10 19:41:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179488_91897856.pth... [2023-03-10 19:41:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000178992_91643904.pth [2023-03-10 19:41:50,000][1054815] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-10 19:41:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 91942912. Throughput: 0: 8450.5. Samples: 91938880. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:53,348][1054527] Avg episode reward: [(0, '4683.043')] [2023-03-10 19:41:54,816][1054815] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-10 19:41:58,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8455.8). Total num frames: 91979776. Throughput: 0: 8465.4. Samples: 91963392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:41:58,348][1054527] Avg episode reward: [(0, '4724.278')] [2023-03-10 19:41:59,910][1054815] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-10 19:42:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 92024832. Throughput: 0: 8428.6. Samples: 92012512. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:03,348][1054527] Avg episode reward: [(0, '4631.445')] [2023-03-10 19:42:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179736_92024832.pth... [2023-03-10 19:42:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179240_91770880.pth [2023-03-10 19:42:04,605][1054815] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-10 19:42:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 92065792. Throughput: 0: 8458.3. Samples: 92065552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:08,348][1054527] Avg episode reward: [(0, '4665.978')] [2023-03-10 19:42:09,337][1054815] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-10 19:42:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8469.7). Total num frames: 92110848. Throughput: 0: 8463.1. Samples: 92090728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:13,348][1054527] Avg episode reward: [(0, '4569.242')] [2023-03-10 19:42:13,925][1054815] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-10 19:42:18,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 92155904. Throughput: 0: 8507.2. Samples: 92144380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:18,348][1054527] Avg episode reward: [(0, '4718.709')] [2023-03-10 19:42:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179992_92155904.pth... [2023-03-10 19:42:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179488_91897856.pth [2023-03-10 19:42:18,453][1054815] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-10 19:42:23,164][1054815] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-10 19:42:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 92200960. Throughput: 0: 8527.6. Samples: 92197820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:23,348][1054527] Avg episode reward: [(0, '4700.505')] [2023-03-10 19:42:27,920][1054815] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-10 19:42:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 92241920. Throughput: 0: 8500.4. Samples: 92222328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:28,348][1054527] Avg episode reward: [(0, '4664.674')] [2023-03-10 19:42:32,682][1054815] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-10 19:42:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 92286976. Throughput: 0: 8600.3. Samples: 92274916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:33,348][1054527] Avg episode reward: [(0, '4665.762')] [2023-03-10 19:42:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180248_92286976.pth... [2023-03-10 19:42:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179736_92024832.pth [2023-03-10 19:42:37,329][1054815] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-10 19:42:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8511.3). Total num frames: 92332032. Throughput: 0: 8658.2. Samples: 92328500. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:38,348][1054527] Avg episode reward: [(0, '4478.439')] [2023-03-10 19:42:41,767][1054815] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-10 19:42:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8511.3). Total num frames: 92377088. Throughput: 0: 8731.7. Samples: 92356320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:43,348][1054527] Avg episode reward: [(0, '4616.497')] [2023-03-10 19:42:46,300][1054815] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-10 19:42:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8525.2). Total num frames: 92422144. Throughput: 0: 8838.5. Samples: 92410244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:48,348][1054527] Avg episode reward: [(0, '4707.797')] [2023-03-10 19:42:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180512_92422144.pth... [2023-03-10 19:42:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000179992_92155904.pth [2023-03-10 19:42:50,957][1054815] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-10 19:42:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8539.1). Total num frames: 92467200. Throughput: 0: 8834.4. Samples: 92463100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:53,348][1054527] Avg episode reward: [(0, '4658.056')] [2023-03-10 19:42:55,639][1054815] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-10 19:42:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 92508160. Throughput: 0: 8858.1. Samples: 92489344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:42:58,348][1054527] Avg episode reward: [(0, '4565.524')] [2023-03-10 19:43:00,199][1054815] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-10 19:43:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8553.0). Total num frames: 92553216. Throughput: 0: 8857.0. Samples: 92542944. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:03,348][1054527] Avg episode reward: [(0, '4355.026')] [2023-03-10 19:43:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180768_92553216.pth... [2023-03-10 19:43:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180248_92286976.pth [2023-03-10 19:43:04,841][1054815] Updated weights for policy 0, policy_version 180800 (0.0006) [2023-03-10 19:43:08,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8580.8). Total num frames: 92602368. Throughput: 0: 8896.7. Samples: 92598172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:08,348][1054527] Avg episode reward: [(0, '3995.376')] [2023-03-10 19:43:09,283][1054815] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-10 19:43:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8580.8). Total num frames: 92643328. Throughput: 0: 8902.7. Samples: 92622952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:13,348][1054527] Avg episode reward: [(0, '4493.838')] [2023-03-10 19:43:14,113][1054815] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-10 19:43:18,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 92684288. Throughput: 0: 8910.4. Samples: 92675884. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:18,348][1054527] Avg episode reward: [(0, '4592.724')] [2023-03-10 19:43:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181024_92684288.pth... [2023-03-10 19:43:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180512_92422144.pth [2023-03-10 19:43:18,922][1054815] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-10 19:43:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8594.7). Total num frames: 92729344. Throughput: 0: 8830.7. Samples: 92725880. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:23,348][1054527] Avg episode reward: [(0, '4725.514')] [2023-03-10 19:43:23,609][1054815] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-10 19:43:28,297][1054815] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-10 19:43:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8608.5). Total num frames: 92774400. Throughput: 0: 8830.5. Samples: 92753692. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:28,348][1054527] Avg episode reward: [(0, '4684.009')] [2023-03-10 19:43:33,145][1054815] Updated weights for policy 0, policy_version 181280 (0.0004) [2023-03-10 19:43:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8608.5). Total num frames: 92815360. Throughput: 0: 8740.2. Samples: 92803552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 19:43:33,348][1054527] Avg episode reward: [(0, '4631.385')] [2023-03-10 19:43:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181280_92815360.pth... [2023-03-10 19:43:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000180768_92553216.pth [2023-03-10 19:43:37,910][1054815] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-10 19:43:38,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8738.1, 300 sec: 8594.7). Total num frames: 92856320. Throughput: 0: 8735.8. Samples: 92856212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:43:38,348][1054527] Avg episode reward: [(0, '4595.087')] [2023-03-10 19:43:42,456][1054815] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-10 19:43:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 92905472. Throughput: 0: 8713.6. Samples: 92881456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:43:43,348][1054527] Avg episode reward: [(0, '4678.946')] [2023-03-10 19:43:47,136][1054815] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-10 19:43:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 92946432. Throughput: 0: 8722.8. Samples: 92935468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:43:48,348][1054527] Avg episode reward: [(0, '4677.546')] [2023-03-10 19:43:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181536_92946432.pth... [2023-03-10 19:43:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181024_92684288.pth [2023-03-10 19:43:52,092][1054815] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-10 19:43:53,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 92987392. Throughput: 0: 8592.5. Samples: 92984836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:43:53,348][1054527] Avg episode reward: [(0, '4727.167')] [2023-03-10 19:43:56,944][1054815] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-10 19:43:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8608.5). Total num frames: 93032448. Throughput: 0: 8590.9. Samples: 93009540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:43:58,348][1054527] Avg episode reward: [(0, '4681.797')] [2023-03-10 19:44:01,514][1054815] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-10 19:44:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8608.5). Total num frames: 93073408. Throughput: 0: 8631.8. Samples: 93064316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:03,348][1054527] Avg episode reward: [(0, '4697.367')] [2023-03-10 19:44:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181784_93073408.pth... [2023-03-10 19:44:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181280_92815360.pth [2023-03-10 19:44:06,385][1054815] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-10 19:44:08,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 93118464. Throughput: 0: 8634.7. Samples: 93114440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:08,348][1054527] Avg episode reward: [(0, '4729.517')] [2023-03-10 19:44:11,288][1054815] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-10 19:44:13,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8533.4, 300 sec: 8580.8). Total num frames: 93155328. Throughput: 0: 8566.5. Samples: 93139184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:13,348][1054527] Avg episode reward: [(0, '4590.306')] [2023-03-10 19:44:16,180][1054815] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-10 19:44:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8594.7). Total num frames: 93200384. Throughput: 0: 8572.6. Samples: 93189320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:18,348][1054527] Avg episode reward: [(0, '4683.999')] [2023-03-10 19:44:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182032_93200384.pth... [2023-03-10 19:44:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181536_92946432.pth [2023-03-10 19:44:20,821][1054815] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-10 19:44:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 93241344. Throughput: 0: 8557.1. Samples: 93241280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:23,348][1054527] Avg episode reward: [(0, '4636.615')] [2023-03-10 19:44:25,794][1054815] Updated weights for policy 0, policy_version 182160 (0.0004) [2023-03-10 19:44:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8608.5). Total num frames: 93286400. Throughput: 0: 8545.1. Samples: 93265984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:28,348][1054527] Avg episode reward: [(0, '4640.715')] [2023-03-10 19:44:30,296][1054815] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-10 19:44:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 93331456. Throughput: 0: 8547.8. Samples: 93320120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:33,348][1054527] Avg episode reward: [(0, '4677.986')] [2023-03-10 19:44:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182288_93331456.pth... [2023-03-10 19:44:33,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000181784_93073408.pth [2023-03-10 19:44:34,887][1054815] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-10 19:44:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 93376512. Throughput: 0: 8642.9. Samples: 93373764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:44:38,348][1054527] Avg episode reward: [(0, '4539.072')] [2023-03-10 19:44:39,494][1054815] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-10 19:44:43,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 93421568. Throughput: 0: 8700.4. Samples: 93401060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:44:43,348][1054527] Avg episode reward: [(0, '4577.515')] [2023-03-10 19:44:43,909][1054815] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-10 19:44:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 93466624. Throughput: 0: 8678.7. Samples: 93454856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:44:48,348][1054527] Avg episode reward: [(0, '4626.475')] [2023-03-10 19:44:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182552_93466624.pth... [2023-03-10 19:44:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182032_93200384.pth [2023-03-10 19:44:48,627][1054815] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-10 19:44:53,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 93507584. Throughput: 0: 8727.6. Samples: 93507180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:44:53,348][1054527] Avg episode reward: [(0, '4554.207')] [2023-03-10 19:44:53,422][1054815] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-10 19:44:57,919][1054815] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-10 19:44:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 93552640. Throughput: 0: 8792.2. Samples: 93534832. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:44:58,348][1054527] Avg episode reward: [(0, '4623.701')] [2023-03-10 19:45:02,366][1054815] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-10 19:45:03,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8806.4, 300 sec: 8664.1). Total num frames: 93601792. Throughput: 0: 8881.6. Samples: 93588992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:03,348][1054527] Avg episode reward: [(0, '4593.159')] [2023-03-10 19:45:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182816_93601792.pth... [2023-03-10 19:45:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182288_93331456.pth [2023-03-10 19:45:07,026][1054815] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-10 19:45:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 93642752. Throughput: 0: 8895.8. Samples: 93641592. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:08,348][1054527] Avg episode reward: [(0, '4356.486')] [2023-03-10 19:45:11,794][1054815] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-10 19:45:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.6, 300 sec: 8678.0). Total num frames: 93687808. Throughput: 0: 8918.9. Samples: 93667336. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:13,348][1054527] Avg episode reward: [(0, '4476.921')] [2023-03-10 19:45:16,061][1054815] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-10 19:45:18,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8691.8). Total num frames: 93736960. Throughput: 0: 8989.0. Samples: 93724628. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:18,348][1054527] Avg episode reward: [(0, '4561.408')] [2023-03-10 19:45:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183080_93736960.pth... [2023-03-10 19:45:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182552_93466624.pth [2023-03-10 19:45:20,286][1054815] Updated weights for policy 0, policy_version 183120 (0.0004) [2023-03-10 19:45:23,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 8705.7). Total num frames: 93782016. Throughput: 0: 9053.8. Samples: 93781188. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:23,349][1054527] Avg episode reward: [(0, '4561.152')] [2023-03-10 19:45:24,709][1054815] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-10 19:45:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8705.7). Total num frames: 93827072. Throughput: 0: 9051.4. Samples: 93808372. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:28,348][1054527] Avg episode reward: [(0, '4665.151')] [2023-03-10 19:45:29,386][1054815] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-10 19:45:33,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 9011.2, 300 sec: 8719.6). Total num frames: 93872128. Throughput: 0: 9014.8. Samples: 93860520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:33,348][1054527] Avg episode reward: [(0, '4458.905')] [2023-03-10 19:45:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183344_93872128.pth... [2023-03-10 19:45:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000182816_93601792.pth [2023-03-10 19:45:33,998][1054815] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-10 19:45:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8733.5). Total num frames: 93917184. Throughput: 0: 9074.6. Samples: 93915536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:38,348][1054527] Avg episode reward: [(0, '4521.829')] [2023-03-10 19:45:38,610][1054815] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-10 19:45:43,314][1054815] Updated weights for policy 0, policy_version 183520 (0.0004) [2023-03-10 19:45:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8733.5). Total num frames: 93962240. Throughput: 0: 9039.7. Samples: 93941620. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:45:43,348][1054527] Avg episode reward: [(0, '4660.503')] [2023-03-10 19:45:47,880][1054815] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-10 19:45:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8719.6). Total num frames: 94003200. Throughput: 0: 8973.2. Samples: 93992784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:45:48,348][1054527] Avg episode reward: [(0, '4646.389')] [2023-03-10 19:45:48,359][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183608_94007296.pth... [2023-03-10 19:45:48,361][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183080_93736960.pth [2023-03-10 19:45:52,547][1054815] Updated weights for policy 0, policy_version 183680 (0.0006) [2023-03-10 19:45:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 8719.6). Total num frames: 94048256. Throughput: 0: 9013.2. Samples: 94047184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:45:53,348][1054527] Avg episode reward: [(0, '4605.290')] [2023-03-10 19:45:57,289][1054815] Updated weights for policy 0, policy_version 183760 (0.0004) [2023-03-10 19:45:58,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 8733.5). Total num frames: 94093312. Throughput: 0: 9008.6. Samples: 94072720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:45:58,348][1054527] Avg episode reward: [(0, '4597.251')] [2023-03-10 19:46:01,837][1054815] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-10 19:46:03,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8943.0, 300 sec: 8733.5). Total num frames: 94138368. Throughput: 0: 8921.4. Samples: 94126088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:03,348][1054527] Avg episode reward: [(0, '4664.551')] [2023-03-10 19:46:03,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183864_94138368.pth... [2023-03-10 19:46:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183344_93872128.pth [2023-03-10 19:46:06,564][1054815] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-10 19:46:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8733.5). Total num frames: 94179328. Throughput: 0: 8835.9. Samples: 94178800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:08,348][1054527] Avg episode reward: [(0, '4528.750')] [2023-03-10 19:46:11,166][1054815] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-10 19:46:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8943.0, 300 sec: 8747.4). Total num frames: 94224384. Throughput: 0: 8811.9. Samples: 94204908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:13,348][1054527] Avg episode reward: [(0, '4619.510')] [2023-03-10 19:46:15,753][1054815] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-10 19:46:18,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 8761.3). Total num frames: 94273536. Throughput: 0: 8857.9. Samples: 94259128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:18,348][1054527] Avg episode reward: [(0, '4566.815')] [2023-03-10 19:46:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184128_94273536.pth... [2023-03-10 19:46:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183608_94007296.pth [2023-03-10 19:46:20,258][1054815] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-10 19:46:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8761.3). Total num frames: 94314496. Throughput: 0: 8810.4. Samples: 94312004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:23,348][1054527] Avg episode reward: [(0, '4519.271')] [2023-03-10 19:46:24,895][1054815] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-10 19:46:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8775.2). Total num frames: 94359552. Throughput: 0: 8832.3. Samples: 94339072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:28,348][1054527] Avg episode reward: [(0, '4513.033')] [2023-03-10 19:46:29,394][1054815] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-10 19:46:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.6, 300 sec: 8775.2). Total num frames: 94404608. Throughput: 0: 8880.0. Samples: 94392384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:33,348][1054527] Avg episode reward: [(0, '4513.455')] [2023-03-10 19:46:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184384_94404608.pth... [2023-03-10 19:46:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000183864_94138368.pth [2023-03-10 19:46:34,145][1054815] Updated weights for policy 0, policy_version 184400 (0.0004) [2023-03-10 19:46:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 94449664. Throughput: 0: 8853.2. Samples: 94445576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:38,348][1054527] Avg episode reward: [(0, '4296.641')] [2023-03-10 19:46:38,756][1054815] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-10 19:46:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 94490624. Throughput: 0: 8881.8. Samples: 94472400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:43,348][1054527] Avg episode reward: [(0, '4614.262')] [2023-03-10 19:46:43,399][1054815] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-10 19:46:48,234][1054815] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-10 19:46:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 94535680. Throughput: 0: 8829.1. Samples: 94523400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:48,348][1054527] Avg episode reward: [(0, '4673.337')] [2023-03-10 19:46:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184640_94535680.pth... [2023-03-10 19:46:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184128_94273536.pth [2023-03-10 19:46:52,826][1054815] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-10 19:46:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 94580736. Throughput: 0: 8841.1. Samples: 94576652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:53,348][1054527] Avg episode reward: [(0, '4718.617')] [2023-03-10 19:46:57,073][1054815] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-10 19:46:58,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 94625792. Throughput: 0: 8899.4. Samples: 94605384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:46:58,348][1054527] Avg episode reward: [(0, '4592.300')] [2023-03-10 19:47:01,967][1054815] Updated weights for policy 0, policy_version 184880 (0.0004) [2023-03-10 19:47:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 94670848. Throughput: 0: 8873.5. Samples: 94658436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:03,349][1054527] Avg episode reward: [(0, '4574.709')] [2023-03-10 19:47:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184904_94670848.pth... [2023-03-10 19:47:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184384_94404608.pth [2023-03-10 19:47:06,473][1054815] Updated weights for policy 0, policy_version 184960 (0.0004) [2023-03-10 19:47:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 94715904. Throughput: 0: 8884.7. Samples: 94711816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:08,348][1054527] Avg episode reward: [(0, '4616.229')] [2023-03-10 19:47:10,909][1054815] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-10 19:47:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 94760960. Throughput: 0: 8918.5. Samples: 94740404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:13,348][1054527] Avg episode reward: [(0, '4713.651')] [2023-03-10 19:47:15,443][1054815] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-10 19:47:18,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 94806016. Throughput: 0: 8919.2. Samples: 94793748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:18,348][1054527] Avg episode reward: [(0, '4662.694')] [2023-03-10 19:47:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185168_94806016.pth... [2023-03-10 19:47:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184640_94535680.pth [2023-03-10 19:47:20,255][1054815] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-10 19:47:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 94846976. Throughput: 0: 8864.9. Samples: 94844496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:23,348][1054527] Avg episode reward: [(0, '4708.445')] [2023-03-10 19:47:24,927][1054815] Updated weights for policy 0, policy_version 185280 (0.0004) [2023-03-10 19:47:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 94892032. Throughput: 0: 8870.0. Samples: 94871552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:28,348][1054527] Avg episode reward: [(0, '4628.276')] [2023-03-10 19:47:29,527][1054815] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-10 19:47:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8830.7). Total num frames: 94937088. Throughput: 0: 8915.6. Samples: 94924600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:33,348][1054527] Avg episode reward: [(0, '4681.491')] [2023-03-10 19:47:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185424_94937088.pth... [2023-03-10 19:47:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000184904_94670848.pth [2023-03-10 19:47:34,135][1054815] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-10 19:47:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8816.8). Total num frames: 94978048. Throughput: 0: 8917.4. Samples: 94977936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:38,348][1054527] Avg episode reward: [(0, '4635.969')] [2023-03-10 19:47:38,877][1054815] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-10 19:47:43,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8816.8). Total num frames: 95023104. Throughput: 0: 8827.7. Samples: 95002632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:43,348][1054527] Avg episode reward: [(0, '4634.265')] [2023-03-10 19:47:43,619][1054815] Updated weights for policy 0, policy_version 185600 (0.0006) [2023-03-10 19:47:48,348][1054527] Fps is (10 sec: 8601.4, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 95064064. Throughput: 0: 8755.6. Samples: 95052440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:48,349][1054527] Avg episode reward: [(0, '4632.823')] [2023-03-10 19:47:48,353][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185672_95064064.pth... [2023-03-10 19:47:48,356][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185168_94806016.pth [2023-03-10 19:47:48,833][1054815] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-10 19:47:53,348][1054527] Fps is (10 sec: 7782.4, 60 sec: 8669.9, 300 sec: 8789.0). Total num frames: 95100928. Throughput: 0: 8634.8. Samples: 95100384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:53,348][1054527] Avg episode reward: [(0, '4726.808')] [2023-03-10 19:47:53,820][1054815] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-10 19:47:58,348][1054527] Fps is (10 sec: 8192.2, 60 sec: 8669.9, 300 sec: 8789.0). Total num frames: 95145984. Throughput: 0: 8563.7. Samples: 95125768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:47:58,348][1054527] Avg episode reward: [(0, '4400.310')] [2023-03-10 19:47:58,626][1054815] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-10 19:48:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8761.3). Total num frames: 95186944. Throughput: 0: 8537.4. Samples: 95177932. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:03,348][1054527] Avg episode reward: [(0, '4327.628')] [2023-03-10 19:48:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185912_95186944.pth... [2023-03-10 19:48:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185424_94937088.pth [2023-03-10 19:48:03,404][1054815] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-10 19:48:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.4, 300 sec: 8761.3). Total num frames: 95227904. Throughput: 0: 8520.2. Samples: 95227904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:08,348][1054527] Avg episode reward: [(0, '4459.058')] [2023-03-10 19:48:08,380][1054815] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-10 19:48:13,136][1054815] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-10 19:48:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8775.2). Total num frames: 95272960. Throughput: 0: 8466.8. Samples: 95252556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:13,348][1054527] Avg episode reward: [(0, '4726.330')] [2023-03-10 19:48:17,854][1054815] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-10 19:48:18,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8761.3). Total num frames: 95313920. Throughput: 0: 8471.1. Samples: 95305800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:18,348][1054527] Avg episode reward: [(0, '4679.682')] [2023-03-10 19:48:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186160_95313920.pth... [2023-03-10 19:48:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185672_95064064.pth [2023-03-10 19:48:22,983][1054815] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-10 19:48:23,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8747.4). Total num frames: 95354880. Throughput: 0: 8359.6. Samples: 95354116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:23,348][1054527] Avg episode reward: [(0, '4680.255')] [2023-03-10 19:48:27,967][1054815] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-10 19:48:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8747.4). Total num frames: 95395840. Throughput: 0: 8353.3. Samples: 95378532. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:28,348][1054527] Avg episode reward: [(0, '4724.437')] [2023-03-10 19:48:33,293][1054815] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-10 19:48:33,348][1054527] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8747.4). Total num frames: 95436800. Throughput: 0: 8299.6. Samples: 95425924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:33,348][1054527] Avg episode reward: [(0, '4632.524')] [2023-03-10 19:48:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186400_95436800.pth... [2023-03-10 19:48:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000185912_95186944.pth [2023-03-10 19:48:38,103][1054815] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-10 19:48:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8719.6). Total num frames: 95477760. Throughput: 0: 8325.6. Samples: 95475036. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:38,349][1054527] Avg episode reward: [(0, '4679.001')] [2023-03-10 19:48:43,109][1054815] Updated weights for policy 0, policy_version 186560 (0.0005) [2023-03-10 19:48:43,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8719.6). Total num frames: 95518720. Throughput: 0: 8303.3. Samples: 95499416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:43,349][1054527] Avg episode reward: [(0, '4726.210')] [2023-03-10 19:48:47,974][1054815] Updated weights for policy 0, policy_version 186640 (0.0004) [2023-03-10 19:48:48,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8719.6). Total num frames: 95559680. Throughput: 0: 8295.6. Samples: 95551232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:48,348][1054527] Avg episode reward: [(0, '4725.101')] [2023-03-10 19:48:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186640_95559680.pth... [2023-03-10 19:48:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186160_95313920.pth [2023-03-10 19:48:52,876][1054815] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-10 19:48:53,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8719.6). Total num frames: 95604736. Throughput: 0: 8282.1. Samples: 95600600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:53,348][1054527] Avg episode reward: [(0, '4716.513')] [2023-03-10 19:48:57,499][1054815] Updated weights for policy 0, policy_version 186800 (0.0004) [2023-03-10 19:48:58,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8719.6). Total num frames: 95645696. Throughput: 0: 8317.5. Samples: 95626844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:48:58,348][1054527] Avg episode reward: [(0, '4724.577')] [2023-03-10 19:49:02,602][1054815] Updated weights for policy 0, policy_version 186880 (0.0005) [2023-03-10 19:49:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8705.7). Total num frames: 95686656. Throughput: 0: 8225.1. Samples: 95675928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 19:49:03,348][1054527] Avg episode reward: [(0, '4723.449')] [2023-03-10 19:49:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186888_95686656.pth... [2023-03-10 19:49:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186400_95436800.pth [2023-03-10 19:49:07,193][1054815] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-10 19:49:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8733.5). Total num frames: 95731712. Throughput: 0: 8326.9. Samples: 95728828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:08,348][1054527] Avg episode reward: [(0, '4632.820')] [2023-03-10 19:49:11,947][1054815] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-10 19:49:13,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8719.6). Total num frames: 95772672. Throughput: 0: 8389.5. Samples: 95756060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:13,348][1054527] Avg episode reward: [(0, '4678.676')] [2023-03-10 19:49:16,713][1054815] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-10 19:49:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8733.5). Total num frames: 95817728. Throughput: 0: 8449.0. Samples: 95806128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:18,348][1054527] Avg episode reward: [(0, '4727.382')] [2023-03-10 19:49:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187144_95817728.pth... [2023-03-10 19:49:18,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186640_95559680.pth [2023-03-10 19:49:21,428][1054815] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-10 19:49:23,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8733.5). Total num frames: 95862784. Throughput: 0: 8538.9. Samples: 95859288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:23,348][1054527] Avg episode reward: [(0, '4726.751')] [2023-03-10 19:49:25,769][1054815] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-10 19:49:28,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8733.5). Total num frames: 95907840. Throughput: 0: 8623.3. Samples: 95887464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:28,348][1054527] Avg episode reward: [(0, '4726.638')] [2023-03-10 19:49:30,758][1054815] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-10 19:49:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8719.6). Total num frames: 95948800. Throughput: 0: 8601.2. Samples: 95938288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:33,348][1054527] Avg episode reward: [(0, '4725.820')] [2023-03-10 19:49:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187400_95948800.pth... [2023-03-10 19:49:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000186888_95686656.pth [2023-03-10 19:49:35,498][1054815] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-10 19:49:38,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8719.6). Total num frames: 95993856. Throughput: 0: 8649.6. Samples: 95989832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:38,348][1054527] Avg episode reward: [(0, '4691.279')] [2023-03-10 19:49:40,223][1054815] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-10 19:49:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 96034816. Throughput: 0: 8619.4. Samples: 96014716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:43,348][1054527] Avg episode reward: [(0, '4725.770')] [2023-03-10 19:49:45,022][1054815] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-10 19:49:48,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 96079872. Throughput: 0: 8683.2. Samples: 96066672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:48,348][1054527] Avg episode reward: [(0, '4726.512')] [2023-03-10 19:49:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187656_96079872.pth... [2023-03-10 19:49:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187144_95817728.pth [2023-03-10 19:49:49,747][1054815] Updated weights for policy 0, policy_version 187680 (0.0004) [2023-03-10 19:49:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8705.7). Total num frames: 96120832. Throughput: 0: 8682.3. Samples: 96119532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:53,348][1054527] Avg episode reward: [(0, '4689.806')] [2023-03-10 19:49:54,323][1054815] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-10 19:49:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 96165888. Throughput: 0: 8701.5. Samples: 96147628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:49:58,348][1054527] Avg episode reward: [(0, '4728.223')] [2023-03-10 19:49:58,900][1054815] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-10 19:50:03,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 96210944. Throughput: 0: 8774.0. Samples: 96200956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:03,348][1054527] Avg episode reward: [(0, '4726.269')] [2023-03-10 19:50:03,386][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187920_96215040.pth... [2023-03-10 19:50:03,386][1054815] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-10 19:50:03,388][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187400_95948800.pth [2023-03-10 19:50:08,182][1054815] Updated weights for policy 0, policy_version 188000 (0.0004) [2023-03-10 19:50:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8705.7). Total num frames: 96256000. Throughput: 0: 8751.8. Samples: 96253120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:08,348][1054527] Avg episode reward: [(0, '4682.105')] [2023-03-10 19:50:13,042][1054815] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-10 19:50:13,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 96296960. Throughput: 0: 8690.3. Samples: 96278528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:13,348][1054527] Avg episode reward: [(0, '4725.648')] [2023-03-10 19:50:17,875][1054815] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-10 19:50:18,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8664.1). Total num frames: 96337920. Throughput: 0: 8693.6. Samples: 96329500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:18,348][1054527] Avg episode reward: [(0, '4679.773')] [2023-03-10 19:50:18,376][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188168_96342016.pth... [2023-03-10 19:50:18,378][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187656_96079872.pth [2023-03-10 19:50:22,680][1054815] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-10 19:50:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8664.1). Total num frames: 96382976. Throughput: 0: 8670.1. Samples: 96379988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:23,348][1054527] Avg episode reward: [(0, '4728.780')] [2023-03-10 19:50:27,549][1054815] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-10 19:50:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 96423936. Throughput: 0: 8665.8. Samples: 96404676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:28,348][1054527] Avg episode reward: [(0, '4729.236')] [2023-03-10 19:50:32,282][1054815] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-10 19:50:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 96468992. Throughput: 0: 8667.4. Samples: 96456704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:33,348][1054527] Avg episode reward: [(0, '4680.793')] [2023-03-10 19:50:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188416_96468992.pth... [2023-03-10 19:50:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000187920_96215040.pth [2023-03-10 19:50:37,148][1054815] Updated weights for policy 0, policy_version 188480 (0.0006) [2023-03-10 19:50:38,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 96509952. Throughput: 0: 8636.9. Samples: 96508192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:38,348][1054527] Avg episode reward: [(0, '4682.277')] [2023-03-10 19:50:41,875][1054815] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-10 19:50:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8650.2). Total num frames: 96555008. Throughput: 0: 8587.3. Samples: 96534056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:43,348][1054527] Avg episode reward: [(0, '4683.757')] [2023-03-10 19:50:46,746][1054815] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-10 19:50:48,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8636.3). Total num frames: 96595968. Throughput: 0: 8513.1. Samples: 96584048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:48,348][1054527] Avg episode reward: [(0, '4730.457')] [2023-03-10 19:50:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188664_96595968.pth... [2023-03-10 19:50:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188168_96342016.pth [2023-03-10 19:50:51,375][1054815] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-10 19:50:53,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 96641024. Throughput: 0: 8529.1. Samples: 96636928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:53,349][1054527] Avg episode reward: [(0, '4729.291')] [2023-03-10 19:50:56,282][1054815] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-10 19:50:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8622.4). Total num frames: 96681984. Throughput: 0: 8510.9. Samples: 96661520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:50:58,348][1054527] Avg episode reward: [(0, '4730.966')] [2023-03-10 19:51:00,954][1054815] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-10 19:51:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 96722944. Throughput: 0: 8556.3. Samples: 96714532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:03,348][1054527] Avg episode reward: [(0, '4730.342')] [2023-03-10 19:51:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188912_96722944.pth... [2023-03-10 19:51:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188416_96468992.pth [2023-03-10 19:51:05,886][1054815] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-10 19:51:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 96768000. Throughput: 0: 8531.6. Samples: 96763912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:08,348][1054527] Avg episode reward: [(0, '4729.945')] [2023-03-10 19:51:10,560][1054815] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-10 19:51:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 96808960. Throughput: 0: 8586.6. Samples: 96791072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:13,348][1054527] Avg episode reward: [(0, '4731.043')] [2023-03-10 19:51:15,287][1054815] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-10 19:51:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8608.5). Total num frames: 96854016. Throughput: 0: 8557.5. Samples: 96841792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:18,349][1054527] Avg episode reward: [(0, '4684.180')] [2023-03-10 19:51:18,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189168_96854016.pth... [2023-03-10 19:51:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188664_96595968.pth [2023-03-10 19:51:20,051][1054815] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-10 19:51:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 96894976. Throughput: 0: 8567.1. Samples: 96893712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:23,348][1054527] Avg episode reward: [(0, '4731.395')] [2023-03-10 19:51:25,174][1054815] Updated weights for policy 0, policy_version 189280 (0.0004) [2023-03-10 19:51:28,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 96935936. Throughput: 0: 8494.4. Samples: 96916304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:28,348][1054527] Avg episode reward: [(0, '4730.520')] [2023-03-10 19:51:29,974][1054815] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-10 19:51:33,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 96976896. Throughput: 0: 8540.0. Samples: 96968348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:33,348][1054527] Avg episode reward: [(0, '4730.274')] [2023-03-10 19:51:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189416_96980992.pth... [2023-03-10 19:51:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000188912_96722944.pth [2023-03-10 19:51:34,944][1054815] Updated weights for policy 0, policy_version 189440 (0.0004) [2023-03-10 19:51:38,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 97021952. Throughput: 0: 8486.9. Samples: 97018836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:38,348][1054527] Avg episode reward: [(0, '4728.901')] [2023-03-10 19:51:39,579][1054815] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-10 19:51:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 97067008. Throughput: 0: 8564.8. Samples: 97046936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:43,348][1054527] Avg episode reward: [(0, '4730.892')] [2023-03-10 19:51:43,925][1054815] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-10 19:51:48,338][1054815] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-10 19:51:48,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8669.9, 300 sec: 8594.7). Total num frames: 97116160. Throughput: 0: 8612.7. Samples: 97102104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:48,348][1054527] Avg episode reward: [(0, '4679.786')] [2023-03-10 19:51:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189680_97116160.pth... [2023-03-10 19:51:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189168_96854016.pth [2023-03-10 19:51:52,932][1054815] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-10 19:51:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8580.8). Total num frames: 97157120. Throughput: 0: 8726.5. Samples: 97156604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:53,348][1054527] Avg episode reward: [(0, '4727.876')] [2023-03-10 19:51:57,828][1054815] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-10 19:51:58,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.8, 300 sec: 8580.8). Total num frames: 97202176. Throughput: 0: 8680.2. Samples: 97181684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:51:58,349][1054527] Avg episode reward: [(0, '4725.229')] [2023-03-10 19:52:02,526][1054815] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-10 19:52:03,348][1054527] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 97243136. Throughput: 0: 8687.6. Samples: 97232732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:52:03,348][1054527] Avg episode reward: [(0, '4725.616')] [2023-03-10 19:52:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189928_97243136.pth... [2023-03-10 19:52:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189416_96980992.pth [2023-03-10 19:52:06,913][1054815] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-10 19:52:08,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 97292288. Throughput: 0: 8765.3. Samples: 97288152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:52:08,349][1054527] Avg episode reward: [(0, '4727.898')] [2023-03-10 19:52:11,534][1054815] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-10 19:52:13,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 97333248. Throughput: 0: 8867.2. Samples: 97315328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:52:13,348][1054527] Avg episode reward: [(0, '4724.678')] [2023-03-10 19:52:16,107][1054815] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-10 19:52:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 97378304. Throughput: 0: 8874.3. Samples: 97367692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:52:18,348][1054527] Avg episode reward: [(0, '4726.753')] [2023-03-10 19:52:18,350][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190192_97378304.pth... [2023-03-10 19:52:18,352][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189680_97116160.pth [2023-03-10 19:52:21,024][1054815] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-10 19:52:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 97419264. Throughput: 0: 8889.4. Samples: 97418860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:52:23,348][1054527] Avg episode reward: [(0, '4682.764')] [2023-03-10 19:52:25,643][1054815] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-10 19:52:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 97464320. Throughput: 0: 8857.2. Samples: 97445508. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:28,348][1054527] Avg episode reward: [(0, '4728.005')] [2023-03-10 19:52:30,296][1054815] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-10 19:52:33,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8580.8). Total num frames: 97509376. Throughput: 0: 8798.4. Samples: 97498032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:33,348][1054527] Avg episode reward: [(0, '4727.165')] [2023-03-10 19:52:33,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190448_97509376.pth... [2023-03-10 19:52:33,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000189928_97243136.pth [2023-03-10 19:52:34,990][1054815] Updated weights for policy 0, policy_version 190480 (0.0005) [2023-03-10 19:52:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8580.8). Total num frames: 97554432. Throughput: 0: 8751.0. Samples: 97550400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:38,349][1054527] Avg episode reward: [(0, '4728.753')] [2023-03-10 19:52:39,686][1054815] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-10 19:52:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8594.7). Total num frames: 97599488. Throughput: 0: 8792.5. Samples: 97577344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:43,348][1054527] Avg episode reward: [(0, '4731.940')] [2023-03-10 19:52:44,085][1054815] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-10 19:52:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 97644544. Throughput: 0: 8878.5. Samples: 97632264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:48,348][1054527] Avg episode reward: [(0, '4726.190')] [2023-03-10 19:52:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190712_97644544.pth... [2023-03-10 19:52:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190192_97378304.pth [2023-03-10 19:52:48,683][1054815] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-10 19:52:53,333][1054815] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-10 19:52:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8622.4). Total num frames: 97689600. Throughput: 0: 8829.8. Samples: 97685492. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:53,349][1054527] Avg episode reward: [(0, '4690.498')] [2023-03-10 19:52:58,113][1054815] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-10 19:52:58,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 97730560. Throughput: 0: 8779.5. Samples: 97710404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:52:58,348][1054527] Avg episode reward: [(0, '4724.726')] [2023-03-10 19:53:02,975][1054815] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-10 19:53:03,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8622.4). Total num frames: 97771520. Throughput: 0: 8779.3. Samples: 97762760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:03,348][1054527] Avg episode reward: [(0, '4635.851')] [2023-03-10 19:53:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190960_97771520.pth... [2023-03-10 19:53:03,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190448_97509376.pth [2023-03-10 19:53:07,452][1054815] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-10 19:53:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8622.4). Total num frames: 97816576. Throughput: 0: 8834.5. Samples: 97816412. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:08,348][1054527] Avg episode reward: [(0, '4588.596')] [2023-03-10 19:53:12,090][1054815] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-10 19:53:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 97861632. Throughput: 0: 8794.1. Samples: 97841240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:13,348][1054527] Avg episode reward: [(0, '4727.483')] [2023-03-10 19:53:16,563][1054815] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-10 19:53:18,348][1054527] Fps is (10 sec: 9420.7, 60 sec: 8874.6, 300 sec: 8664.1). Total num frames: 97910784. Throughput: 0: 8864.1. Samples: 97896920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:18,348][1054527] Avg episode reward: [(0, '4675.783')] [2023-03-10 19:53:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191232_97910784.pth... [2023-03-10 19:53:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190712_97644544.pth [2023-03-10 19:53:21,013][1054815] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-10 19:53:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8664.1). Total num frames: 97951744. Throughput: 0: 8909.9. Samples: 97951344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:23,348][1054527] Avg episode reward: [(0, '4727.278')] [2023-03-10 19:53:25,828][1054815] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-10 19:53:28,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 97996800. Throughput: 0: 8866.6. Samples: 97976340. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 19:53:28,348][1054527] Avg episode reward: [(0, '4726.719')] [2023-03-10 19:53:30,666][1054815] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-10 19:53:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.6, 300 sec: 8691.8). Total num frames: 98041856. Throughput: 0: 8810.4. Samples: 98028732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:33,348][1054527] Avg episode reward: [(0, '4725.883')] [2023-03-10 19:53:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191488_98041856.pth... [2023-03-10 19:53:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000190960_97771520.pth [2023-03-10 19:53:35,108][1054815] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-10 19:53:38,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8705.7). Total num frames: 98086912. Throughput: 0: 8831.0. Samples: 98082888. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:38,348][1054527] Avg episode reward: [(0, '4727.855')] [2023-03-10 19:53:39,582][1054815] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-10 19:53:43,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8719.6). Total num frames: 98131968. Throughput: 0: 8908.6. Samples: 98111292. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:43,348][1054527] Avg episode reward: [(0, '4672.432')] [2023-03-10 19:53:43,908][1054815] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-10 19:53:48,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8719.6). Total num frames: 98177024. Throughput: 0: 8951.3. Samples: 98165568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:48,348][1054527] Avg episode reward: [(0, '4731.657')] [2023-03-10 19:53:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191752_98177024.pth... [2023-03-10 19:53:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191232_97910784.pth [2023-03-10 19:53:48,612][1054815] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-10 19:53:52,922][1054815] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-10 19:53:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8733.5). Total num frames: 98222080. Throughput: 0: 9000.0. Samples: 98221412. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:53,348][1054527] Avg episode reward: [(0, '4730.255')] [2023-03-10 19:53:57,420][1054815] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-10 19:53:58,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8761.3). Total num frames: 98271232. Throughput: 0: 9010.8. Samples: 98246728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:53:58,348][1054527] Avg episode reward: [(0, '4698.617')] [2023-03-10 19:54:01,843][1054815] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-10 19:54:03,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 8761.3). Total num frames: 98316288. Throughput: 0: 9046.4. Samples: 98304008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:03,348][1054527] Avg episode reward: [(0, '4601.072')] [2023-03-10 19:54:03,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192024_98316288.pth... [2023-03-10 19:54:03,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191488_98041856.pth [2023-03-10 19:54:06,377][1054815] Updated weights for policy 0, policy_version 192080 (0.0006) [2023-03-10 19:54:08,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8775.2). Total num frames: 98361344. Throughput: 0: 9039.5. Samples: 98358124. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:08,348][1054527] Avg episode reward: [(0, '4726.029')] [2023-03-10 19:54:10,860][1054815] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-10 19:54:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8775.2). Total num frames: 98406400. Throughput: 0: 9101.8. Samples: 98385920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:13,348][1054527] Avg episode reward: [(0, '4688.209')] [2023-03-10 19:54:15,698][1054815] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-10 19:54:18,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8761.3). Total num frames: 98447360. Throughput: 0: 9051.6. Samples: 98436052. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:18,348][1054527] Avg episode reward: [(0, '4692.649')] [2023-03-10 19:54:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192280_98447360.pth... [2023-03-10 19:54:18,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000191752_98177024.pth [2023-03-10 19:54:20,478][1054815] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-10 19:54:23,348][1054527] Fps is (10 sec: 8192.1, 60 sec: 8942.9, 300 sec: 8747.4). Total num frames: 98488320. Throughput: 0: 9007.9. Samples: 98488244. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:23,348][1054527] Avg episode reward: [(0, '4635.749')] [2023-03-10 19:54:25,232][1054815] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-10 19:54:28,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 8761.3). Total num frames: 98533376. Throughput: 0: 8935.5. Samples: 98513388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:28,348][1054527] Avg episode reward: [(0, '4726.246')] [2023-03-10 19:54:29,936][1054815] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-10 19:54:33,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8761.3). Total num frames: 98578432. Throughput: 0: 8922.9. Samples: 98567096. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 19:54:33,348][1054527] Avg episode reward: [(0, '4691.547')] [2023-03-10 19:54:33,378][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192544_98582528.pth... [2023-03-10 19:54:33,380][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192024_98316288.pth [2023-03-10 19:54:34,311][1054815] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-10 19:54:38,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8943.0, 300 sec: 8775.2). Total num frames: 98623488. Throughput: 0: 8924.4. Samples: 98623008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:54:38,348][1054527] Avg episode reward: [(0, '4692.918')] [2023-03-10 19:54:38,958][1054815] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-10 19:54:43,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8775.2). Total num frames: 98668544. Throughput: 0: 8918.2. Samples: 98648048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:54:43,348][1054527] Avg episode reward: [(0, '4717.434')] [2023-03-10 19:54:43,589][1054815] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-10 19:54:48,210][1054815] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-10 19:54:48,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 98713600. Throughput: 0: 8827.6. Samples: 98701252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:54:48,348][1054527] Avg episode reward: [(0, '4725.353')] [2023-03-10 19:54:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192800_98713600.pth... [2023-03-10 19:54:48,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192280_98447360.pth [2023-03-10 19:54:52,779][1054815] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-10 19:54:53,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 98758656. Throughput: 0: 8811.3. Samples: 98754632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:54:53,348][1054527] Avg episode reward: [(0, '4724.187')] [2023-03-10 19:54:57,077][1054815] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-10 19:54:58,348][1054527] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8802.9). Total num frames: 98807808. Throughput: 0: 8843.3. Samples: 98783868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:54:58,348][1054527] Avg episode reward: [(0, '4726.172')] [2023-03-10 19:55:01,495][1054815] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-10 19:55:03,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 98848768. Throughput: 0: 8978.5. Samples: 98840084. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:03,348][1054527] Avg episode reward: [(0, '4707.093')] [2023-03-10 19:55:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193064_98848768.pth... [2023-03-10 19:55:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192544_98582528.pth [2023-03-10 19:55:06,411][1054815] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-10 19:55:08,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 98889728. Throughput: 0: 8919.4. Samples: 98889616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:08,348][1054527] Avg episode reward: [(0, '4705.257')] [2023-03-10 19:55:11,198][1054815] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-10 19:55:13,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8802.9). Total num frames: 98934784. Throughput: 0: 8910.7. Samples: 98914368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:13,348][1054527] Avg episode reward: [(0, '4627.062')] [2023-03-10 19:55:15,867][1054815] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-10 19:55:18,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8802.9). Total num frames: 98979840. Throughput: 0: 8902.9. Samples: 98967728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:18,348][1054527] Avg episode reward: [(0, '4609.245')] [2023-03-10 19:55:18,376][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193328_98983936.pth... [2023-03-10 19:55:18,377][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000192800_98713600.pth [2023-03-10 19:55:20,203][1054815] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-10 19:55:23,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 99024896. Throughput: 0: 8927.6. Samples: 99024752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:23,348][1054527] Avg episode reward: [(0, '4676.604')] [2023-03-10 19:55:24,640][1054815] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-10 19:55:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8816.8). Total num frames: 99069952. Throughput: 0: 8964.0. Samples: 99051428. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:28,348][1054527] Avg episode reward: [(0, '4722.729')] [2023-03-10 19:55:29,592][1054815] Updated weights for policy 0, policy_version 193520 (0.0004) [2023-03-10 19:55:33,348][1054527] Fps is (10 sec: 9011.0, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 99115008. Throughput: 0: 8915.6. Samples: 99102456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:33,349][1054527] Avg episode reward: [(0, '4719.654')] [2023-03-10 19:55:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193584_99115008.pth... [2023-03-10 19:55:33,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193064_98848768.pth [2023-03-10 19:55:34,324][1054815] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-10 19:55:38,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8830.7). Total num frames: 99160064. Throughput: 0: 8918.6. Samples: 99155968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 19:55:38,349][1054527] Avg episode reward: [(0, '4681.303')] [2023-03-10 19:55:38,610][1054815] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-10 19:55:43,000][1054815] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-10 19:55:43,348][1054527] Fps is (10 sec: 9011.4, 60 sec: 8942.9, 300 sec: 8844.6). Total num frames: 99205120. Throughput: 0: 8927.4. Samples: 99185600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:55:43,359][1054527] Avg episode reward: [(0, '4644.730')] [2023-03-10 19:55:47,508][1054815] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-10 19:55:48,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8844.6). Total num frames: 99250176. Throughput: 0: 8879.7. Samples: 99239668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:55:48,348][1054527] Avg episode reward: [(0, '4675.518')] [2023-03-10 19:55:48,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193848_99250176.pth... [2023-03-10 19:55:48,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193328_98983936.pth [2023-03-10 19:55:52,122][1054815] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-10 19:55:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8858.5). Total num frames: 99295232. Throughput: 0: 8975.9. Samples: 99293532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:55:53,348][1054527] Avg episode reward: [(0, '4710.568')] [2023-03-10 19:55:56,793][1054815] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-10 19:55:58,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8872.4). Total num frames: 99340288. Throughput: 0: 9000.0. Samples: 99319368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:55:58,349][1054527] Avg episode reward: [(0, '4724.249')] [2023-03-10 19:56:01,476][1054815] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-10 19:56:03,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8858.5). Total num frames: 99381248. Throughput: 0: 8994.6. Samples: 99372484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:03,348][1054527] Avg episode reward: [(0, '4677.387')] [2023-03-10 19:56:03,373][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194112_99385344.pth... [2023-03-10 19:56:03,374][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193584_99115008.pth [2023-03-10 19:56:06,174][1054815] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-10 19:56:08,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8872.4). Total num frames: 99426304. Throughput: 0: 8853.8. Samples: 99423176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:08,348][1054527] Avg episode reward: [(0, '4726.259')] [2023-03-10 19:56:10,843][1054815] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-10 19:56:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8872.4). Total num frames: 99471360. Throughput: 0: 8876.7. Samples: 99450880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:13,348][1054527] Avg episode reward: [(0, '4722.908')] [2023-03-10 19:56:15,471][1054815] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-10 19:56:18,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8872.4). Total num frames: 99512320. Throughput: 0: 8925.9. Samples: 99504120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:18,348][1054527] Avg episode reward: [(0, '4688.112')] [2023-03-10 19:56:18,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194368_99516416.pth... [2023-03-10 19:56:18,353][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000193848_99250176.pth [2023-03-10 19:56:20,336][1054815] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-10 19:56:23,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8886.2). Total num frames: 99557376. Throughput: 0: 8830.8. Samples: 99553352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:23,348][1054527] Avg episode reward: [(0, '4721.462')] [2023-03-10 19:56:25,126][1054815] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-10 19:56:28,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8900.1). Total num frames: 99602432. Throughput: 0: 8758.1. Samples: 99579712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:28,348][1054527] Avg episode reward: [(0, '4677.565')] [2023-03-10 19:56:29,731][1054815] Updated weights for policy 0, policy_version 194560 (0.0004) [2023-03-10 19:56:33,348][1054527] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8886.2). Total num frames: 99643392. Throughput: 0: 8725.9. Samples: 99632336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:33,348][1054527] Avg episode reward: [(0, '4722.964')] [2023-03-10 19:56:33,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194616_99643392.pth... [2023-03-10 19:56:33,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194112_99385344.pth [2023-03-10 19:56:34,577][1054815] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-10 19:56:38,348][1054527] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 99684352. Throughput: 0: 8682.7. Samples: 99684252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:38,348][1054527] Avg episode reward: [(0, '4674.914')] [2023-03-10 19:56:39,452][1054815] Updated weights for policy 0, policy_version 194720 (0.0005) [2023-03-10 19:56:43,348][1054527] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 8858.5). Total num frames: 99729408. Throughput: 0: 8653.0. Samples: 99708752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:43,348][1054527] Avg episode reward: [(0, '4675.782')] [2023-03-10 19:56:44,034][1054815] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-10 19:56:48,348][1054527] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8872.3). Total num frames: 99774464. Throughput: 0: 8721.7. Samples: 99764960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:48,348][1054527] Avg episode reward: [(0, '4725.076')] [2023-03-10 19:56:48,352][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194872_99774464.pth... [2023-03-10 19:56:48,355][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194368_99516416.pth [2023-03-10 19:56:48,512][1054815] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-10 19:56:53,024][1054815] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-10 19:56:53,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8872.4). Total num frames: 99819520. Throughput: 0: 8771.7. Samples: 99817904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:53,348][1054527] Avg episode reward: [(0, '4668.258')] [2023-03-10 19:56:57,660][1054815] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-10 19:56:58,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8886.2). Total num frames: 99864576. Throughput: 0: 8739.6. Samples: 99844160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:56:58,348][1054527] Avg episode reward: [(0, '4723.785')] [2023-03-10 19:57:02,283][1054815] Updated weights for policy 0, policy_version 195120 (0.0005) [2023-03-10 19:57:03,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8872.4). Total num frames: 99909632. Throughput: 0: 8735.6. Samples: 99897224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:57:03,348][1054527] Avg episode reward: [(0, '4722.835')] [2023-03-10 19:57:03,351][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000195136_99909632.pth... [2023-03-10 19:57:03,354][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194616_99643392.pth [2023-03-10 19:57:06,778][1054815] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-10 19:57:08,348][1054527] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8886.2). Total num frames: 99954688. Throughput: 0: 8850.1. Samples: 99951604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:57:08,348][1054527] Avg episode reward: [(0, '4725.215')] [2023-03-10 19:57:11,087][1054815] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-10 19:57:13,348][1054527] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8886.2). Total num frames: 99999744. Throughput: 0: 8909.9. Samples: 99980660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 19:57:13,348][1054527] Avg episode reward: [(0, '4722.309')] [2023-03-10 19:57:13,392][1054771] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-10 19:57:13,844][1054771] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-10 19:57:13,845][1054819] Stopping RolloutWorker_w4... [2023-03-10 19:57:13,845][1054818] Stopping RolloutWorker_w2... [2023-03-10 19:57:13,845][1054821] Stopping RolloutWorker_w5... [2023-03-10 19:57:13,845][1054820] Stopping RolloutWorker_w3... [2023-03-10 19:57:13,845][1054819] Loop rollout_proc4_evt_loop terminating... [2023-03-10 19:57:13,845][1054817] Stopping RolloutWorker_w1... [2023-03-10 19:57:13,845][1054816] Stopping RolloutWorker_w0... [2023-03-10 19:57:13,846][1054818] Loop rollout_proc2_evt_loop terminating... [2023-03-10 19:57:13,845][1054771] Stopping Batcher_0... [2023-03-10 19:57:13,845][1054916] Stopping RolloutWorker_w7... [2023-03-10 19:57:13,846][1054821] Loop rollout_proc5_evt_loop terminating... [2023-03-10 19:57:13,846][1054816] Loop rollout_proc0_evt_loop terminating... [2023-03-10 19:57:13,845][1054527] Component RolloutWorker_w4 stopped! [2023-03-10 19:57:13,846][1054817] Loop rollout_proc1_evt_loop terminating... [2023-03-10 19:57:13,846][1054820] Loop rollout_proc3_evt_loop terminating... [2023-03-10 19:57:13,846][1054771] Loop batcher_evt_loop terminating... [2023-03-10 19:57:13,846][1054884] Stopping RolloutWorker_w6... [2023-03-10 19:57:13,846][1054916] Loop rollout_proc7_evt_loop terminating... [2023-03-10 19:57:13,846][1054884] Loop rollout_proc6_evt_loop terminating... [2023-03-10 19:57:13,846][1054527] Component RolloutWorker_w3 stopped! [2023-03-10 19:57:13,846][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-10 19:57:13,846][1054527] Component RolloutWorker_w5 stopped! [2023-03-10 19:57:13,846][1054527] Component RolloutWorker_w1 stopped! [2023-03-10 19:57:13,847][1054527] Component RolloutWorker_w2 stopped! [2023-03-10 19:57:13,847][1054527] Component Batcher_0 stopped! [2023-03-10 19:57:13,847][1054527] Component RolloutWorker_w7 stopped! [2023-03-10 19:57:13,847][1054527] Component RolloutWorker_w0 stopped! [2023-03-10 19:57:13,847][1054527] Component RolloutWorker_w6 stopped! [2023-03-10 19:57:13,849][1054771] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000194872_99774464.pth [2023-03-10 19:57:13,850][1054771] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-wall-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-10 19:57:13,852][1054771] Stopping LearnerWorker_p0... [2023-03-10 19:57:13,852][1054771] Loop learner_proc0_evt_loop terminating... [2023-03-10 19:57:13,852][1054527] Component LearnerWorker_p0 stopped! [2023-03-10 19:57:13,898][1054815] Weights refcount: 2 0 [2023-03-10 19:57:13,899][1054815] Stopping InferenceWorker_p0-w0... [2023-03-10 19:57:13,899][1054815] Loop inference_proc0-0_evt_loop terminating... [2023-03-10 19:57:13,899][1054527] Component InferenceWorker_p0-w0 stopped! [2023-03-10 19:57:13,900][1054527] Waiting for process learner_proc0 to stop... [2023-03-10 19:57:14,363][1054527] Waiting for process inference_proc0-0 to join... [2023-03-10 19:57:14,374][1054527] Waiting for process rollout_proc0 to join... [2023-03-10 19:57:14,374][1054527] Waiting for process rollout_proc1 to join... [2023-03-10 19:57:14,374][1054527] Waiting for process rollout_proc2 to join... [2023-03-10 19:57:14,375][1054527] Waiting for process rollout_proc3 to join... [2023-03-10 19:57:14,381][1054527] Waiting for process rollout_proc4 to join... [2023-03-10 19:57:14,382][1054527] Waiting for process rollout_proc5 to join... [2023-03-10 19:57:14,424][1054527] Waiting for process rollout_proc6 to join... [2023-03-10 19:57:14,425][1054527] Waiting for process rollout_proc7 to join... [2023-03-10 19:57:14,425][1054527] Batcher 0 profile tree view: batching: 18.4366, releasing_batches: 15.3594 [2023-03-10 19:57:14,425][1054527] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 4434.1884 update_model: 125.7227 weight_update: 0.0005 one_step: 0.0013 handle_policy_step: 6343.9893 deserialize: 264.7833, stack: 66.9177, obs_to_device_normalize: 1138.0918, forward: 3165.4260, send_messages: 462.4032 prepare_outputs: 690.0588 to_cpu: 107.8100 [2023-03-10 19:57:14,425][1054527] Learner 0 profile tree view: misc: 0.0906, prepare_batch: 81.8612 train: 1053.2348 epoch_init: 0.3531, minibatch_init: 11.2862, losses_postprocess: 12.8203, kl_divergence: 4.0837, after_optimizer: 5.9931 calculate_losses: 429.2831 losses_init: 0.2893, forward_head: 206.4784, bptt_initial: 1.1741, bptt: 1.2352, tail: 106.3746, advantages_returns: 8.6848, losses: 92.1272 update: 574.6640 clip: 52.5494 [2023-03-10 19:57:14,425][1054527] RolloutWorker_w0 profile tree view: wait_for_trajectories: 4.6899, enqueue_policy_requests: 174.7468, env_step: 7202.0719, overhead: 349.0525, complete_rollouts: 3.9241 save_policy_outputs: 378.0258 split_output_tensors: 183.5177 [2023-03-10 19:57:14,426][1054527] RolloutWorker_w7 profile tree view: wait_for_trajectories: 4.3757, enqueue_policy_requests: 174.4590, env_step: 7108.4223, overhead: 346.6402, complete_rollouts: 3.8826 save_policy_outputs: 378.4902 split_output_tensors: 186.3273 [2023-03-10 19:57:14,426][1054527] Loop Runner_EvtLoop terminating... [2023-03-10 19:57:14,426][1054527] Runner profile tree view: main_loop: 11693.6992 [2023-03-10 19:57:14,426][1054527] Collected {0: 100007936}, FPS: 8552.3