[2023-03-10 10:58:57,092][988181] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/config.json... [2023-03-10 10:58:57,107][988181] Rollout worker 0 uses device cpu [2023-03-10 10:58:57,108][988181] Rollout worker 1 uses device cpu [2023-03-10 10:58:57,108][988181] Rollout worker 2 uses device cpu [2023-03-10 10:58:57,108][988181] Rollout worker 3 uses device cpu [2023-03-10 10:58:57,108][988181] Rollout worker 4 uses device cpu [2023-03-10 10:58:57,108][988181] Rollout worker 5 uses device cpu [2023-03-10 10:58:57,109][988181] Rollout worker 6 uses device cpu [2023-03-10 10:58:57,109][988181] Rollout worker 7 uses device cpu [2023-03-10 10:58:57,109][988181] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-10 10:58:57,122][988181] InferenceWorker_p0-w0: min num requests: 2 [2023-03-10 10:58:57,141][988181] Starting all processes... [2023-03-10 10:58:57,142][988181] Starting process learner_proc0 [2023-03-10 10:58:57,191][988181] Starting all processes... [2023-03-10 10:58:57,229][988181] Starting process inference_proc0-0 [2023-03-10 10:58:57,240][988181] Starting process rollout_proc0 [2023-03-10 10:58:57,251][988181] Starting process rollout_proc1 [2023-03-10 10:58:57,253][988181] Starting process rollout_proc2 [2023-03-10 10:58:57,253][988181] Starting process rollout_proc3 [2023-03-10 10:58:57,254][988181] Starting process rollout_proc4 [2023-03-10 10:58:57,254][988181] Starting process rollout_proc5 [2023-03-10 10:58:57,256][988181] Starting process rollout_proc6 [2023-03-10 10:58:57,257][988181] Starting process rollout_proc7 [2023-03-10 10:58:58,729][988448] Starting seed is not provided [2023-03-10 10:58:58,730][988448] Initializing actor-critic model on device cpu [2023-03-10 10:58:58,730][988448] RunningMeanStd input shape: (39,) [2023-03-10 10:58:58,730][988448] RunningMeanStd input shape: (1,) [2023-03-10 10:58:58,833][988448] Created Actor Critic model with architecture: [2023-03-10 10:58:58,839][988448] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-10 10:58:58,879][988560] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-10 10:58:58,915][988626] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-10 10:58:59,077][988495] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-10 10:58:59,181][988448] Using optimizer [2023-03-10 10:58:59,182][988448] No checkpoints found [2023-03-10 10:58:59,182][988448] Did not load from checkpoint, starting from scratch! [2023-03-10 10:58:59,182][988448] Initialized policy 0 weights for model version 0 [2023-03-10 10:58:59,183][988448] LearnerWorker_p0 finished initialization! [2023-03-10 10:58:59,220][988492] RunningMeanStd input shape: (39,) [2023-03-10 10:58:59,221][988492] RunningMeanStd input shape: (1,) [2023-03-10 10:58:59,289][988493] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-10 10:58:59,290][988181] Inference worker 0-0 is ready! [2023-03-10 10:58:59,291][988181] All inference workers are ready! Signal rollout workers to start! [2023-03-10 10:58:59,374][988592] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-10 10:58:59,511][988528] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-10 10:58:59,647][988494] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-10 10:58:59,766][988496] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-10 10:58:59,804][988181] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 10:59:03,212][988560] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,225][988560] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,257][988626] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,265][988560] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,270][988626] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,294][988495] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,308][988495] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,311][988626] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,330][988493] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,331][988560] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,344][988493] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,348][988495] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,378][988626] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,384][988493] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,414][988495] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,440][988592] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,450][988493] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,453][988592] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,493][988592] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,559][988592] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,576][988528] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,589][988528] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,630][988528] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,678][988494] Decorrelating experience for 0 frames... [2023-03-10 10:59:03,691][988494] Decorrelating experience for 64 frames... [2023-03-10 10:59:03,696][988528] Decorrelating experience for 192 frames... [2023-03-10 10:59:03,731][988494] Decorrelating experience for 128 frames... [2023-03-10 10:59:03,797][988494] Decorrelating experience for 192 frames... [2023-03-10 10:59:04,804][988181] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 10:59:05,161][988496] Decorrelating experience for 0 frames... [2023-03-10 10:59:05,174][988496] Decorrelating experience for 64 frames... [2023-03-10 10:59:05,233][988496] Decorrelating experience for 128 frames... [2023-03-10 10:59:05,338][988496] Decorrelating experience for 192 frames... [2023-03-10 10:59:07,286][988560] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,403][988560] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,422][988493] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,522][988495] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,532][988592] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,539][988493] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,547][988560] Decorrelating experience for 384 frames... [2023-03-10 10:59:07,641][988495] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,650][988592] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,666][988528] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,683][988493] Decorrelating experience for 384 frames... [2023-03-10 10:59:07,718][988560] Decorrelating experience for 448 frames... [2023-03-10 10:59:07,752][988494] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,792][988495] Decorrelating experience for 384 frames... [2023-03-10 10:59:07,793][988592] Decorrelating experience for 384 frames... [2023-03-10 10:59:07,794][988528] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,853][988626] Decorrelating experience for 256 frames... [2023-03-10 10:59:07,862][988493] Decorrelating experience for 448 frames... [2023-03-10 10:59:07,868][988494] Decorrelating experience for 320 frames... [2023-03-10 10:59:07,940][988528] Decorrelating experience for 384 frames... [2023-03-10 10:59:07,963][988592] Decorrelating experience for 448 frames... [2023-03-10 10:59:07,973][988626] Decorrelating experience for 320 frames... [2023-03-10 10:59:08,002][988495] Decorrelating experience for 448 frames... [2023-03-10 10:59:08,011][988494] Decorrelating experience for 384 frames... [2023-03-10 10:59:08,112][988528] Decorrelating experience for 448 frames... [2023-03-10 10:59:08,119][988626] Decorrelating experience for 384 frames... [2023-03-10 10:59:08,180][988494] Decorrelating experience for 448 frames... [2023-03-10 10:59:08,290][988626] Decorrelating experience for 448 frames... [2023-03-10 10:59:09,654][988496] Decorrelating experience for 256 frames... [2023-03-10 10:59:09,770][988496] Decorrelating experience for 320 frames... [2023-03-10 10:59:09,804][988181] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 146.0. Samples: 1460. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-10 10:59:09,804][988181] Avg episode reward: [(0, '0.557')] [2023-03-10 10:59:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000000_0.pth... [2023-03-10 10:59:09,912][988496] Decorrelating experience for 384 frames... [2023-03-10 10:59:10,080][988496] Decorrelating experience for 448 frames... [2023-03-10 10:59:14,804][988181] Fps is (10 sec: 3686.4, 60 sec: 2457.6, 300 sec: 2457.6). Total num frames: 36864. Throughput: 0: 2414.7. Samples: 36220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:14,804][988181] Avg episode reward: [(0, '5.439')] [2023-03-10 10:59:14,885][988492] Updated weights for policy 0, policy_version 80 (0.0006) [2023-03-10 10:59:17,117][988181] Heartbeat connected on Batcher_0 [2023-03-10 10:59:17,120][988181] Heartbeat connected on LearnerWorker_p0 [2023-03-10 10:59:17,125][988181] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-10 10:59:17,125][988181] Heartbeat connected on RolloutWorker_w0 [2023-03-10 10:59:17,130][988181] Heartbeat connected on RolloutWorker_w2 [2023-03-10 10:59:17,132][988181] Heartbeat connected on RolloutWorker_w3 [2023-03-10 10:59:17,132][988181] Heartbeat connected on RolloutWorker_w1 [2023-03-10 10:59:17,134][988181] Heartbeat connected on RolloutWorker_w4 [2023-03-10 10:59:17,139][988181] Heartbeat connected on RolloutWorker_w6 [2023-03-10 10:59:17,139][988181] Heartbeat connected on RolloutWorker_w5 [2023-03-10 10:59:17,141][988181] Heartbeat connected on RolloutWorker_w7 [2023-03-10 10:59:18,931][988492] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-10 10:59:19,804][988181] Fps is (10 sec: 9011.2, 60 sec: 4505.6, 300 sec: 4505.6). Total num frames: 90112. Throughput: 0: 3300.0. Samples: 66000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:19,804][988181] Avg episode reward: [(0, '6.553')] [2023-03-10 10:59:23,171][988492] Updated weights for policy 0, policy_version 240 (0.0006) [2023-03-10 10:59:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 5406.7, 300 sec: 5406.7). Total num frames: 135168. Throughput: 0: 4974.4. Samples: 124360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 10:59:24,804][988181] Avg episode reward: [(0, '8.464')] [2023-03-10 10:59:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000264_135168.pth... [2023-03-10 10:59:24,809][988448] Saving new best policy, reward=8.464! [2023-03-10 10:59:27,511][988492] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-10 10:59:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 6144.0, 300 sec: 6144.0). Total num frames: 184320. Throughput: 0: 6012.4. Samples: 180372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:29,804][988181] Avg episode reward: [(0, '9.692')] [2023-03-10 10:59:29,805][988448] Saving new best policy, reward=9.692! [2023-03-10 10:59:31,667][988492] Updated weights for policy 0, policy_version 400 (0.0006) [2023-03-10 10:59:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 6670.6, 300 sec: 6670.6). Total num frames: 233472. Throughput: 0: 6043.1. Samples: 211508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:34,804][988181] Avg episode reward: [(0, '9.787')] [2023-03-10 10:59:34,805][988448] Saving new best policy, reward=9.787! [2023-03-10 10:59:35,862][988492] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-10 10:59:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 7065.6, 300 sec: 7065.6). Total num frames: 282624. Throughput: 0: 6760.0. Samples: 270400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:39,804][988181] Avg episode reward: [(0, '9.942')] [2023-03-10 10:59:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000552_282624.pth... [2023-03-10 10:59:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000000_0.pth [2023-03-10 10:59:39,811][988448] Saving new best policy, reward=9.942! [2023-03-10 10:59:40,065][988492] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-10 10:59:44,188][988492] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-10 10:59:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 7372.8, 300 sec: 7372.8). Total num frames: 331776. Throughput: 0: 7314.6. Samples: 329156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:44,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 10:59:48,122][988492] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-10 10:59:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 7618.6, 300 sec: 7618.6). Total num frames: 380928. Throughput: 0: 8011.6. Samples: 360520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 10:59:49,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 10:59:52,368][988492] Updated weights for policy 0, policy_version 800 (0.0004) [2023-03-10 10:59:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 7819.6, 300 sec: 7819.6). Total num frames: 430080. Throughput: 0: 9282.9. Samples: 419192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 10:59:54,804][988181] Avg episode reward: [(0, '9.942')] [2023-03-10 10:59:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000840_430080.pth... [2023-03-10 10:59:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000264_135168.pth [2023-03-10 10:59:56,657][988492] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-10 10:59:59,804][988181] Fps is (10 sec: 9830.2, 60 sec: 7987.2, 300 sec: 7987.2). Total num frames: 479232. Throughput: 0: 9770.4. Samples: 475888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 10:59:59,804][988181] Avg episode reward: [(0, '9.936')] [2023-03-10 11:00:01,057][988492] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-10 11:00:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 8806.4, 300 sec: 8129.0). Total num frames: 528384. Throughput: 0: 9732.0. Samples: 503940. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:00:04,804][988181] Avg episode reward: [(0, '9.943')] [2023-03-10 11:00:04,805][988448] Saving new best policy, reward=9.943! [2023-03-10 11:00:05,199][988492] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-10 11:00:09,612][988492] Updated weights for policy 0, policy_version 1120 (0.0004) [2023-03-10 11:00:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 8192.0). Total num frames: 573440. Throughput: 0: 9706.5. Samples: 561152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:00:09,805][988181] Avg episode reward: [(0, '9.937')] [2023-03-10 11:00:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001120_573440.pth... [2023-03-10 11:00:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000552_282624.pth [2023-03-10 11:00:13,767][988492] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-10 11:00:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 8301.2). Total num frames: 622592. Throughput: 0: 9784.8. Samples: 620688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:14,805][988181] Avg episode reward: [(0, '9.941')] [2023-03-10 11:00:18,084][988492] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-10 11:00:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 8345.6). Total num frames: 667648. Throughput: 0: 9714.4. Samples: 648656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:19,804][988181] Avg episode reward: [(0, '9.930')] [2023-03-10 11:00:22,547][988492] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-10 11:00:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 8432.9). Total num frames: 716800. Throughput: 0: 9647.3. Samples: 704528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:24,804][988181] Avg episode reward: [(0, '9.931')] [2023-03-10 11:00:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001400_716800.pth... [2023-03-10 11:00:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000000840_430080.pth [2023-03-10 11:00:26,836][988492] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-10 11:00:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 8465.1). Total num frames: 761856. Throughput: 0: 9611.2. Samples: 761660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:29,804][988181] Avg episode reward: [(0, '9.946')] [2023-03-10 11:00:29,804][988448] Saving new best policy, reward=9.946! [2023-03-10 11:00:31,297][988492] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-10 11:00:34,804][988181] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 8493.8). Total num frames: 806912. Throughput: 0: 9490.3. Samples: 787584. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:00:34,804][988181] Avg episode reward: [(0, '9.930')] [2023-03-10 11:00:35,557][988492] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-10 11:00:39,516][988492] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-10 11:00:39,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 8601.6). Total num frames: 860160. Throughput: 0: 9507.3. Samples: 847020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:39,804][988181] Avg episode reward: [(0, '9.951')] [2023-03-10 11:00:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001680_860160.pth... [2023-03-10 11:00:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001120_573440.pth [2023-03-10 11:00:39,809][988448] Saving new best policy, reward=9.951! [2023-03-10 11:00:43,826][988492] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-10 11:00:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 8660.1). Total num frames: 909312. Throughput: 0: 9551.4. Samples: 905700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:44,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 11:00:48,204][988492] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-10 11:00:49,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9557.3, 300 sec: 8676.1). Total num frames: 954368. Throughput: 0: 9555.9. Samples: 933952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:49,804][988181] Avg episode reward: [(0, '9.952')] [2023-03-10 11:00:49,857][988448] Saving new best policy, reward=9.952! [2023-03-10 11:00:52,307][988492] Updated weights for policy 0, policy_version 1920 (0.0006) [2023-03-10 11:00:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 8761.9). Total num frames: 1007616. Throughput: 0: 9603.3. Samples: 993300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:54,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 11:00:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001968_1007616.pth... [2023-03-10 11:00:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001400_716800.pth [2023-03-10 11:00:56,459][988492] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-10 11:00:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9557.4, 300 sec: 8772.3). Total num frames: 1052672. Throughput: 0: 9572.2. Samples: 1051436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:00:59,804][988181] Avg episode reward: [(0, '9.948')] [2023-03-10 11:01:00,843][988492] Updated weights for policy 0, policy_version 2080 (0.0004) [2023-03-10 11:01:04,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 8781.8). Total num frames: 1097728. Throughput: 0: 9552.9. Samples: 1078536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:01:04,804][988181] Avg episode reward: [(0, '9.956')] [2023-03-10 11:01:04,832][988448] Saving new best policy, reward=9.956! [2023-03-10 11:01:05,212][988492] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-10 11:01:09,297][988492] Updated weights for policy 0, policy_version 2240 (0.0004) [2023-03-10 11:01:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 8853.7). Total num frames: 1150976. Throughput: 0: 9614.6. Samples: 1137184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:01:09,804][988181] Avg episode reward: [(0, '9.916')] [2023-03-10 11:01:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002248_1150976.pth... [2023-03-10 11:01:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001680_860160.pth [2023-03-10 11:01:13,669][988492] Updated weights for policy 0, policy_version 2320 (0.0004) [2023-03-10 11:01:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 8859.5). Total num frames: 1196032. Throughput: 0: 9621.4. Samples: 1194624. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:01:14,815][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 11:01:18,097][988492] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-10 11:01:19,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 8894.2). Total num frames: 1245184. Throughput: 0: 9637.6. Samples: 1221276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:01:19,804][988181] Avg episode reward: [(0, '9.950')] [2023-03-10 11:01:22,439][988492] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-10 11:01:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 8898.2). Total num frames: 1290240. Throughput: 0: 9597.7. Samples: 1278916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:01:24,804][988181] Avg episode reward: [(0, '9.971')] [2023-03-10 11:01:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002520_1290240.pth... [2023-03-10 11:01:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000001968_1007616.pth [2023-03-10 11:01:24,811][988448] Saving new best policy, reward=9.971! [2023-03-10 11:01:26,752][988492] Updated weights for policy 0, policy_version 2560 (0.0004) [2023-03-10 11:01:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 8929.3). Total num frames: 1339392. Throughput: 0: 9570.4. Samples: 1336368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:01:29,804][988181] Avg episode reward: [(0, '9.975')] [2023-03-10 11:01:29,805][988448] Saving new best policy, reward=9.975! [2023-03-10 11:01:30,882][988492] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-10 11:01:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 8958.3). Total num frames: 1388544. Throughput: 0: 9598.2. Samples: 1365872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:01:34,804][988181] Avg episode reward: [(0, '9.990')] [2023-03-10 11:01:34,805][988448] Saving new best policy, reward=9.990! [2023-03-10 11:01:35,061][988492] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-10 11:01:39,319][988492] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-10 11:01:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 8985.6). Total num frames: 1437696. Throughput: 0: 9597.7. Samples: 1425200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:01:39,804][988181] Avg episode reward: [(0, '10.007')] [2023-03-10 11:01:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002808_1437696.pth... [2023-03-10 11:01:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002248_1150976.pth [2023-03-10 11:01:39,811][988448] Saving new best policy, reward=10.007! [2023-03-10 11:01:43,480][988492] Updated weights for policy 0, policy_version 2880 (0.0005) [2023-03-10 11:01:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9011.2). Total num frames: 1486848. Throughput: 0: 9586.4. Samples: 1482824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:01:44,804][988181] Avg episode reward: [(0, '10.022')] [2023-03-10 11:01:44,805][988448] Saving new best policy, reward=10.022! [2023-03-10 11:01:47,765][988492] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-10 11:01:49,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9625.6, 300 sec: 9011.2). Total num frames: 1531904. Throughput: 0: 9625.5. Samples: 1511684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:01:49,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 11:01:49,804][988448] Saving new best policy, reward=10.029! [2023-03-10 11:01:51,715][988492] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-10 11:01:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9058.0). Total num frames: 1585152. Throughput: 0: 9703.3. Samples: 1573832. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:01:54,804][988181] Avg episode reward: [(0, '10.033')] [2023-03-10 11:01:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003096_1585152.pth... [2023-03-10 11:01:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002520_1290240.pth [2023-03-10 11:01:54,811][988448] Saving new best policy, reward=10.033! [2023-03-10 11:01:55,915][988492] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-10 11:01:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9693.9, 300 sec: 9079.5). Total num frames: 1634304. Throughput: 0: 9681.2. Samples: 1630280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:01:59,805][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 11:01:59,805][988448] Saving new best policy, reward=10.035! [2023-03-10 11:02:00,106][988492] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-10 11:02:04,251][988492] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-10 11:02:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9099.8). Total num frames: 1683456. Throughput: 0: 9735.2. Samples: 1659360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:02:04,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 11:02:04,805][988448] Saving new best policy, reward=10.046! [2023-03-10 11:02:08,563][988492] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-10 11:02:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.8, 300 sec: 9119.0). Total num frames: 1732608. Throughput: 0: 9741.8. Samples: 1717300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:02:09,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:02:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003384_1732608.pth... [2023-03-10 11:02:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000002808_1437696.pth [2023-03-10 11:02:09,811][988448] Saving new best policy, reward=10.063! [2023-03-10 11:02:12,522][988492] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-10 11:02:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9137.2). Total num frames: 1781760. Throughput: 0: 9886.4. Samples: 1781256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:02:14,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:02:16,704][988492] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-10 11:02:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9154.6). Total num frames: 1830912. Throughput: 0: 9822.4. Samples: 1807880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:02:19,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:02:20,838][988492] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-10 11:02:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9171.0). Total num frames: 1880064. Throughput: 0: 9823.7. Samples: 1867268. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:02:24,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:02:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003672_1880064.pth... [2023-03-10 11:02:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003096_1585152.pth [2023-03-10 11:02:24,811][988448] Saving new best policy, reward=10.083! [2023-03-10 11:02:25,122][988492] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-10 11:02:29,457][988492] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-10 11:02:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9167.2). Total num frames: 1925120. Throughput: 0: 9825.6. Samples: 1924976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:02:29,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:02:33,733][988492] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-10 11:02:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9182.7). Total num frames: 1974272. Throughput: 0: 9813.2. Samples: 1953280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:02:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:02:38,219][988492] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-10 11:02:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9178.8). Total num frames: 2019328. Throughput: 0: 9646.1. Samples: 2007904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:02:39,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:02:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003944_2019328.pth... [2023-03-10 11:02:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003384_1732608.pth [2023-03-10 11:02:42,419][988492] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-10 11:02:44,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9193.2). Total num frames: 2068480. Throughput: 0: 9695.0. Samples: 2066556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:02:44,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:02:46,591][988492] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-10 11:02:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9207.1). Total num frames: 2117632. Throughput: 0: 9713.9. Samples: 2096484. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:02:49,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:02:50,799][988492] Updated weights for policy 0, policy_version 4160 (0.0004) [2023-03-10 11:02:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9220.4). Total num frames: 2166784. Throughput: 0: 9715.3. Samples: 2154488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:02:54,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:02:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004232_2166784.pth... [2023-03-10 11:02:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003672_1880064.pth [2023-03-10 11:02:55,170][988492] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-10 11:02:59,437][988492] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-10 11:02:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9216.0). Total num frames: 2211840. Throughput: 0: 9563.6. Samples: 2211616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:02:59,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:03:03,531][988492] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-10 11:03:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9228.5). Total num frames: 2260992. Throughput: 0: 9624.5. Samples: 2240984. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:03:04,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:03:07,847][988492] Updated weights for policy 0, policy_version 4480 (0.0004) [2023-03-10 11:03:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9240.6). Total num frames: 2310144. Throughput: 0: 9570.2. Samples: 2297928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:03:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:03:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004512_2310144.pth... [2023-03-10 11:03:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000003944_2019328.pth [2023-03-10 11:03:12,163][988492] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-10 11:03:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9252.1). Total num frames: 2359296. Throughput: 0: 9569.9. Samples: 2355624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:03:14,815][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:03:16,291][988492] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-10 11:03:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9263.3). Total num frames: 2408448. Throughput: 0: 9625.2. Samples: 2386416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:19,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:03:20,263][988492] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-10 11:03:24,227][988492] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-10 11:03:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9289.4). Total num frames: 2461696. Throughput: 0: 9809.2. Samples: 2449320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:24,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:03:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004808_2461696.pth... [2023-03-10 11:03:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004232_2166784.pth [2023-03-10 11:03:24,810][988448] Saving new best policy, reward=10.084! [2023-03-10 11:03:28,388][988492] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-10 11:03:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9299.4). Total num frames: 2510848. Throughput: 0: 9814.3. Samples: 2508200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:29,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:03:32,592][988492] Updated weights for policy 0, policy_version 4960 (0.0006) [2023-03-10 11:03:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9309.1). Total num frames: 2560000. Throughput: 0: 9799.7. Samples: 2537472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:34,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:03:36,643][988492] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-10 11:03:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9318.4). Total num frames: 2609152. Throughput: 0: 9832.2. Samples: 2596936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:03:39,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:03:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005096_2609152.pth... [2023-03-10 11:03:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004512_2310144.pth [2023-03-10 11:03:40,699][988492] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-10 11:03:44,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9830.4, 300 sec: 9327.4). Total num frames: 2658304. Throughput: 0: 9915.9. Samples: 2657832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:44,805][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:03:44,851][988492] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-10 11:03:49,143][988492] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-10 11:03:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9336.1). Total num frames: 2707456. Throughput: 0: 9912.3. Samples: 2687040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:03:49,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:03:53,405][988492] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-10 11:03:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9330.5). Total num frames: 2752512. Throughput: 0: 9918.6. Samples: 2744268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:54,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:03:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005384_2756608.pth... [2023-03-10 11:03:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000004808_2461696.pth [2023-03-10 11:03:57,705][988492] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-10 11:03:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 2801664. Throughput: 0: 9902.7. Samples: 2801244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:03:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:04:02,161][988492] Updated weights for policy 0, policy_version 5520 (0.0004) [2023-03-10 11:04:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 2846720. Throughput: 0: 9810.0. Samples: 2827864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:04:04,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:04:06,567][988492] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-10 11:04:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9691.5). Total num frames: 2895872. Throughput: 0: 9650.3. Samples: 2883584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:09,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:04:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005656_2895872.pth... [2023-03-10 11:04:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005096_2609152.pth [2023-03-10 11:04:10,881][988492] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-10 11:04:14,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 2940928. Throughput: 0: 9591.3. Samples: 2939808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:04:14,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:04:15,394][988492] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-10 11:04:19,804][988181] Fps is (10 sec: 9011.3, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 2985984. Throughput: 0: 9516.9. Samples: 2965732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:19,815][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:04:19,865][988492] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-10 11:04:24,110][988492] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-10 11:04:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 3035136. Throughput: 0: 9471.3. Samples: 3023144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:24,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:04:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005928_3035136.pth... [2023-03-10 11:04:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005384_2756608.pth [2023-03-10 11:04:28,070][988492] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-10 11:04:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 3088384. Throughput: 0: 9477.0. Samples: 3084296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:29,815][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 11:04:32,222][988492] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-10 11:04:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 3137536. Throughput: 0: 9487.3. Samples: 3113968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:34,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 11:04:36,318][988492] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-10 11:04:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 3186688. Throughput: 0: 9542.7. Samples: 3173688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:39,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 11:04:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006224_3186688.pth... [2023-03-10 11:04:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005656_2895872.pth [2023-03-10 11:04:40,613][988492] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-10 11:04:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9557.4, 300 sec: 9663.8). Total num frames: 3231744. Throughput: 0: 9527.7. Samples: 3229988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:44,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 11:04:44,947][988492] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-10 11:04:49,108][988492] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-10 11:04:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 3280896. Throughput: 0: 9610.8. Samples: 3260348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:04:49,804][988181] Avg episode reward: [(0, '10.007')] [2023-03-10 11:04:53,278][988492] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-10 11:04:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 3330048. Throughput: 0: 9652.5. Samples: 3317944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:54,804][988181] Avg episode reward: [(0, '10.006')] [2023-03-10 11:04:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006504_3330048.pth... [2023-03-10 11:04:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000005928_3035136.pth [2023-03-10 11:04:57,454][988492] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-10 11:04:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 3379200. Throughput: 0: 9762.4. Samples: 3379116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:04:59,804][988181] Avg episode reward: [(0, '10.017')] [2023-03-10 11:05:01,610][988492] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-10 11:05:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 3424256. Throughput: 0: 9808.9. Samples: 3407132. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:05:04,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:05:06,094][988492] Updated weights for policy 0, policy_version 6720 (0.0005) [2023-03-10 11:05:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 3473408. Throughput: 0: 9740.4. Samples: 3461460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:09,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 11:05:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006784_3473408.pth... [2023-03-10 11:05:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006224_3186688.pth [2023-03-10 11:05:10,259][988492] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-10 11:05:14,337][988492] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-10 11:05:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9691.6). Total num frames: 3526656. Throughput: 0: 9739.5. Samples: 3522572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:14,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:05:18,547][988492] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-10 11:05:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9691.6). Total num frames: 3575808. Throughput: 0: 9737.6. Samples: 3552160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:19,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 11:05:22,660][988492] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-10 11:05:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9691.5). Total num frames: 3620864. Throughput: 0: 9709.1. Samples: 3610596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:05:24,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:05:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007072_3620864.pth... [2023-03-10 11:05:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006504_3330048.pth [2023-03-10 11:05:24,810][988448] Saving new best policy, reward=10.099! [2023-03-10 11:05:27,062][988492] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-10 11:05:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 3670016. Throughput: 0: 9730.9. Samples: 3667880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:05:29,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:05:31,152][988492] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-10 11:05:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 3719168. Throughput: 0: 9734.9. Samples: 3698416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:05:34,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:05:35,297][988492] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-10 11:05:39,576][988492] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-10 11:05:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 3768320. Throughput: 0: 9736.7. Samples: 3756096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:39,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 11:05:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007360_3768320.pth... [2023-03-10 11:05:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000006784_3473408.pth [2023-03-10 11:05:43,629][988492] Updated weights for policy 0, policy_version 7440 (0.0005) [2023-03-10 11:05:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 3817472. Throughput: 0: 9730.4. Samples: 3816984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:44,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:05:47,873][988492] Updated weights for policy 0, policy_version 7520 (0.0004) [2023-03-10 11:05:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9691.5). Total num frames: 3866624. Throughput: 0: 9748.3. Samples: 3845808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:05:49,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:05:51,955][988492] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-10 11:05:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 3915776. Throughput: 0: 9835.1. Samples: 3904040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:54,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:05:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007648_3915776.pth... [2023-03-10 11:05:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007072_3620864.pth [2023-03-10 11:05:56,136][988492] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-10 11:05:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9719.3). Total num frames: 3964928. Throughput: 0: 9822.9. Samples: 3964600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:05:59,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:06:00,284][988492] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-10 11:06:04,425][988492] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-10 11:06:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 4014080. Throughput: 0: 9805.0. Samples: 3993384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:06:04,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:06:08,706][988492] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-10 11:06:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 4063232. Throughput: 0: 9791.7. Samples: 4051220. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:06:09,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:06:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007936_4063232.pth... [2023-03-10 11:06:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007360_3768320.pth [2023-03-10 11:06:12,763][988492] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-10 11:06:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9719.3). Total num frames: 4112384. Throughput: 0: 9877.9. Samples: 4112384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:06:14,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:06:16,850][988492] Updated weights for policy 0, policy_version 8080 (0.0006) [2023-03-10 11:06:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9747.1). Total num frames: 4165632. Throughput: 0: 9847.5. Samples: 4141552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:06:19,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:06:20,795][988492] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-10 11:06:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 4214784. Throughput: 0: 9960.6. Samples: 4204324. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:06:24,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 11:06:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008232_4214784.pth... [2023-03-10 11:06:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007648_3915776.pth [2023-03-10 11:06:24,903][988492] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-10 11:06:28,881][988492] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-10 11:06:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4268032. Throughput: 0: 9943.4. Samples: 4264440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:06:29,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:06:33,157][988492] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-10 11:06:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4317184. Throughput: 0: 9928.3. Samples: 4292580. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:06:34,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:06:37,394][988492] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-10 11:06:39,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 4362240. Throughput: 0: 9922.5. Samples: 4350552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:06:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:06:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008520_4362240.pth... [2023-03-10 11:06:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000007936_4063232.pth [2023-03-10 11:06:41,564][988492] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-10 11:06:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 4415488. Throughput: 0: 9928.7. Samples: 4411392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:06:44,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:06:45,645][988492] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-10 11:06:49,708][988492] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-10 11:06:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4464640. Throughput: 0: 9929.2. Samples: 4440196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:06:49,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:06:53,979][988492] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-10 11:06:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4513792. Throughput: 0: 9971.5. Samples: 4499940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:06:54,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:06:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008816_4513792.pth... [2023-03-10 11:06:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008232_4214784.pth [2023-03-10 11:06:58,135][988492] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-10 11:06:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4562944. Throughput: 0: 9921.7. Samples: 4558860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:06:59,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:07:02,035][988492] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-10 11:07:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 4612096. Throughput: 0: 9997.2. Samples: 4591428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:07:04,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:07:06,055][988492] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-10 11:07:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9774.9). Total num frames: 4665344. Throughput: 0: 9971.3. Samples: 4653032. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:07:09,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:07:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009112_4665344.pth... [2023-03-10 11:07:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008520_4362240.pth [2023-03-10 11:07:10,182][988492] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-10 11:07:14,142][988492] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-10 11:07:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9774.9). Total num frames: 4714496. Throughput: 0: 9958.0. Samples: 4712548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:07:14,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:07:18,406][988492] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-10 11:07:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 4763648. Throughput: 0: 9990.1. Samples: 4742136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:07:19,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:07:22,662][988492] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-10 11:07:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9788.7). Total num frames: 4812800. Throughput: 0: 9983.6. Samples: 4799816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:07:24,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:07:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009400_4812800.pth... [2023-03-10 11:07:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000008816_4513792.pth [2023-03-10 11:07:26,605][988492] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-10 11:07:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 4861952. Throughput: 0: 9979.3. Samples: 4860460. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:07:29,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:07:30,631][988492] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-10 11:07:34,598][988492] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-10 11:07:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 4915200. Throughput: 0: 10010.9. Samples: 4890688. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:07:34,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:07:38,671][988492] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-10 11:07:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 4964352. Throughput: 0: 10058.0. Samples: 4952548. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:07:39,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:07:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009696_4964352.pth... [2023-03-10 11:07:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009112_4665344.pth [2023-03-10 11:07:42,470][988492] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-10 11:07:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9830.4). Total num frames: 5017600. Throughput: 0: 10148.8. Samples: 5015556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:07:44,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:07:46,533][988492] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-10 11:07:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9830.4). Total num frames: 5066752. Throughput: 0: 10107.8. Samples: 5046280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:07:49,804][988181] Avg episode reward: [(0, '10.103')] [2023-03-10 11:07:49,808][988448] Saving new best policy, reward=10.103! [2023-03-10 11:07:50,714][988492] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-10 11:07:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 5115904. Throughput: 0: 10011.9. Samples: 5103568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:07:54,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:07:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009992_5115904.pth... [2023-03-10 11:07:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009400_4812800.pth [2023-03-10 11:07:55,027][988492] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-10 11:07:59,012][988492] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-10 11:07:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 5165056. Throughput: 0: 10048.9. Samples: 5164748. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:07:59,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:08:03,065][988492] Updated weights for policy 0, policy_version 10160 (0.0005) [2023-03-10 11:08:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9858.2). Total num frames: 5218304. Throughput: 0: 10051.2. Samples: 5194440. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:08:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:08:07,122][988492] Updated weights for policy 0, policy_version 10240 (0.0005) [2023-03-10 11:08:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 5267456. Throughput: 0: 10116.3. Samples: 5255048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:09,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:08:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010288_5267456.pth... [2023-03-10 11:08:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009696_4964352.pth [2023-03-10 11:08:11,320][988492] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-10 11:08:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 5316608. Throughput: 0: 10059.5. Samples: 5313140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:14,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:08:15,477][988492] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-10 11:08:19,646][988492] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-10 11:08:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 5365760. Throughput: 0: 10052.4. Samples: 5343048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:19,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:08:23,685][988492] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-10 11:08:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 5414912. Throughput: 0: 10009.0. Samples: 5402952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:24,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:08:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010576_5414912.pth... [2023-03-10 11:08:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000009992_5115904.pth [2023-03-10 11:08:27,769][988492] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-10 11:08:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 5464064. Throughput: 0: 9963.7. Samples: 5463924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:29,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:08:32,038][988492] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-10 11:08:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 5513216. Throughput: 0: 9905.3. Samples: 5492016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:34,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:08:36,236][988492] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-10 11:08:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 5562368. Throughput: 0: 9924.1. Samples: 5550152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:39,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:08:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010864_5562368.pth... [2023-03-10 11:08:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010288_5267456.pth [2023-03-10 11:08:40,329][988492] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-10 11:08:44,504][988492] Updated weights for policy 0, policy_version 10960 (0.0006) [2023-03-10 11:08:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 5611520. Throughput: 0: 9905.3. Samples: 5610488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:08:44,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 11:08:48,598][988492] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-10 11:08:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 5660672. Throughput: 0: 9907.0. Samples: 5640256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:08:49,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:08:52,525][988492] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-10 11:08:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 5713920. Throughput: 0: 9922.2. Samples: 5701548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:08:54,804][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 11:08:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011160_5713920.pth... [2023-03-10 11:08:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010576_5414912.pth [2023-03-10 11:08:56,701][988492] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-10 11:08:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 5763072. Throughput: 0: 9925.4. Samples: 5759784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:08:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:09:00,859][988492] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-10 11:09:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 5812224. Throughput: 0: 9960.7. Samples: 5791280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:09:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:09:04,960][988492] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-10 11:09:08,912][988492] Updated weights for policy 0, policy_version 11440 (0.0004) [2023-03-10 11:09:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 5865472. Throughput: 0: 9972.0. Samples: 5851692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:09:09,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:09:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011456_5865472.pth... [2023-03-10 11:09:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000010864_5562368.pth [2023-03-10 11:09:13,128][988492] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-10 11:09:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 5910528. Throughput: 0: 9922.8. Samples: 5910452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:09:14,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:09:17,339][988492] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-10 11:09:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 5959680. Throughput: 0: 9937.7. Samples: 5939212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:09:19,805][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:09:21,487][988492] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-10 11:09:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 6012928. Throughput: 0: 10008.0. Samples: 6000512. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:09:24,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:09:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011744_6012928.pth... [2023-03-10 11:09:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011160_5713920.pth [2023-03-10 11:09:25,599][988492] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-10 11:09:29,782][988492] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-10 11:09:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 6062080. Throughput: 0: 9943.6. Samples: 6057948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:09:29,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:09:33,959][988492] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-10 11:09:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9967.0, 300 sec: 9913.7). Total num frames: 6111232. Throughput: 0: 9934.9. Samples: 6087328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:09:34,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:09:37,688][988492] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-10 11:09:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 6160384. Throughput: 0: 9971.6. Samples: 6150268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:09:39,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:09:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012032_6160384.pth... [2023-03-10 11:09:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011456_5865472.pth [2023-03-10 11:09:42,101][988492] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-10 11:09:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 6209536. Throughput: 0: 9905.1. Samples: 6205512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:09:44,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:09:46,205][988492] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-10 11:09:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 6258688. Throughput: 0: 9888.1. Samples: 6236244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:09:49,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 11:09:50,529][988492] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-10 11:09:54,586][988492] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-10 11:09:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 6307840. Throughput: 0: 9884.4. Samples: 6296492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:09:54,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:09:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012320_6307840.pth... [2023-03-10 11:09:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000011744_6012928.pth [2023-03-10 11:09:58,754][988492] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-10 11:09:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 6356992. Throughput: 0: 9872.4. Samples: 6354708. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:09:59,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:10:02,867][988492] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-10 11:10:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 6406144. Throughput: 0: 9918.0. Samples: 6385524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:10:04,805][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:10:06,871][988492] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-10 11:10:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 6459392. Throughput: 0: 9923.9. Samples: 6447088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:10:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:10:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012616_6459392.pth... [2023-03-10 11:10:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012032_6160384.pth [2023-03-10 11:10:10,811][988492] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-10 11:10:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 6508544. Throughput: 0: 9996.8. Samples: 6507804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:10:14,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:10:14,929][988492] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-10 11:10:19,158][988492] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-10 11:10:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 6557696. Throughput: 0: 9967.8. Samples: 6535880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:10:19,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:10:23,230][988492] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-10 11:10:24,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6606848. Throughput: 0: 9891.1. Samples: 6595368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:10:24,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:10:24,836][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012912_6610944.pth... [2023-03-10 11:10:24,838][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012320_6307840.pth [2023-03-10 11:10:27,324][988492] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-10 11:10:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 6660096. Throughput: 0: 10016.3. Samples: 6656244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:10:29,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 11:10:31,317][988492] Updated weights for policy 0, policy_version 13040 (0.0004) [2023-03-10 11:10:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9955.4). Total num frames: 6705152. Throughput: 0: 10012.5. Samples: 6686808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:10:34,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 11:10:35,652][988492] Updated weights for policy 0, policy_version 13120 (0.0005) [2023-03-10 11:10:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6754304. Throughput: 0: 9937.4. Samples: 6743676. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:10:39,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:10:39,827][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013200_6758400.pth... [2023-03-10 11:10:39,828][988492] Updated weights for policy 0, policy_version 13200 (0.0005) [2023-03-10 11:10:39,829][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012616_6459392.pth [2023-03-10 11:10:44,064][988492] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-10 11:10:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6803456. Throughput: 0: 9949.4. Samples: 6802432. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:10:44,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:10:48,296][988492] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-10 11:10:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6852608. Throughput: 0: 9911.5. Samples: 6831540. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:10:49,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:10:52,386][988492] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-10 11:10:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6901760. Throughput: 0: 9843.6. Samples: 6890052. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:10:54,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:10:54,826][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013488_6905856.pth... [2023-03-10 11:10:54,828][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000012912_6610944.pth [2023-03-10 11:10:56,489][988492] Updated weights for policy 0, policy_version 13520 (0.0004) [2023-03-10 11:10:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 6950912. Throughput: 0: 9846.0. Samples: 6950876. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:10:59,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:11:00,684][988492] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-10 11:11:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 7000064. Throughput: 0: 9859.5. Samples: 6979556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:11:04,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:11:04,856][988492] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-10 11:11:08,850][988492] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-10 11:11:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 7053312. Throughput: 0: 9867.0. Samples: 7039380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:11:09,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:11:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013776_7053312.pth... [2023-03-10 11:11:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013200_6758400.pth [2023-03-10 11:11:13,024][988492] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-10 11:11:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9955.4). Total num frames: 7102464. Throughput: 0: 9866.2. Samples: 7100224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:11:14,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:11:17,113][988492] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-10 11:11:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 7151616. Throughput: 0: 9837.8. Samples: 7129508. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:11:19,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:11:21,252][988492] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-10 11:11:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 7200768. Throughput: 0: 9884.7. Samples: 7188488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:11:24,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 11:11:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014064_7200768.pth... [2023-03-10 11:11:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013488_6905856.pth [2023-03-10 11:11:25,648][988492] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-10 11:11:29,782][988492] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-10 11:11:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 7249920. Throughput: 0: 9844.3. Samples: 7245428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:11:29,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:11:33,893][988492] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-10 11:11:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 7299072. Throughput: 0: 9853.2. Samples: 7274936. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:11:34,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:11:38,123][988492] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-10 11:11:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 7348224. Throughput: 0: 9877.9. Samples: 7334556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:11:39,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:11:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014352_7348224.pth... [2023-03-10 11:11:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000013776_7053312.pth [2023-03-10 11:11:41,975][988492] Updated weights for policy 0, policy_version 14400 (0.0004) [2023-03-10 11:11:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 7397376. Throughput: 0: 9872.2. Samples: 7395124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:11:44,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:11:46,188][988492] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-10 11:11:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 7450624. Throughput: 0: 9923.5. Samples: 7426112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:11:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:11:50,234][988492] Updated weights for policy 0, policy_version 14560 (0.0005) [2023-03-10 11:11:54,187][988492] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-10 11:11:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 7499776. Throughput: 0: 9958.3. Samples: 7487504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:11:54,815][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:11:54,821][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014656_7503872.pth... [2023-03-10 11:11:54,822][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014064_7200768.pth [2023-03-10 11:11:57,999][988492] Updated weights for policy 0, policy_version 14720 (0.0004) [2023-03-10 11:11:59,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 7553024. Throughput: 0: 9998.1. Samples: 7550140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:11:59,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:12:02,112][988492] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-10 11:12:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 7602176. Throughput: 0: 10014.1. Samples: 7580144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:12:04,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:12:06,294][988492] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-10 11:12:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 7651328. Throughput: 0: 10006.4. Samples: 7638776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:12:09,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:12:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014944_7651328.pth... [2023-03-10 11:12:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014352_7348224.pth [2023-03-10 11:12:10,512][988492] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-10 11:12:14,569][988492] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-10 11:12:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 7700480. Throughput: 0: 10071.7. Samples: 7698656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:12:14,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:12:18,944][988492] Updated weights for policy 0, policy_version 15120 (0.0006) [2023-03-10 11:12:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 7745536. Throughput: 0: 10031.8. Samples: 7726368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:12:19,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:12:23,370][988492] Updated weights for policy 0, policy_version 15200 (0.0006) [2023-03-10 11:12:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 7794688. Throughput: 0: 9952.0. Samples: 7782396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:12:24,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:12:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015224_7794688.pth... [2023-03-10 11:12:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014656_7503872.pth [2023-03-10 11:12:27,423][988492] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-10 11:12:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 7843840. Throughput: 0: 9890.7. Samples: 7840204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:12:29,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:12:31,700][988492] Updated weights for policy 0, policy_version 15360 (0.0006) [2023-03-10 11:12:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 7892992. Throughput: 0: 9916.6. Samples: 7872360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:12:34,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:12:35,800][988492] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-10 11:12:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9913.7). Total num frames: 7942144. Throughput: 0: 9835.0. Samples: 7930080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:12:39,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:12:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015512_7942144.pth... [2023-03-10 11:12:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000014944_7651328.pth [2023-03-10 11:12:40,061][988492] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-10 11:12:44,362][988492] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-10 11:12:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 7991296. Throughput: 0: 9711.7. Samples: 7987168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:12:44,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:12:48,392][988492] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-10 11:12:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8040448. Throughput: 0: 9714.7. Samples: 8017304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:12:49,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 11:12:52,556][988492] Updated weights for policy 0, policy_version 15760 (0.0005) [2023-03-10 11:12:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8089600. Throughput: 0: 9741.8. Samples: 8077156. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:12:54,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:12:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015800_8089600.pth... [2023-03-10 11:12:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015224_7794688.pth [2023-03-10 11:12:56,508][988492] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-10 11:12:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8142848. Throughput: 0: 9781.3. Samples: 8138816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 11:12:59,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:13:00,572][988492] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-10 11:13:04,707][988492] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-10 11:13:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8192000. Throughput: 0: 9800.4. Samples: 8167388. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:13:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:13:08,722][988492] Updated weights for policy 0, policy_version 16080 (0.0006) [2023-03-10 11:13:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8241152. Throughput: 0: 9921.7. Samples: 8228872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:13:09,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:13:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016096_8241152.pth... [2023-03-10 11:13:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015512_7942144.pth [2023-03-10 11:13:13,026][988492] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-10 11:13:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 8290304. Throughput: 0: 9960.5. Samples: 8288424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:13:16,923][988492] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-10 11:13:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 8343552. Throughput: 0: 9927.0. Samples: 8319076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:19,815][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:13:20,911][988492] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-10 11:13:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 8392704. Throughput: 0: 10007.5. Samples: 8380416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:24,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:13:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016392_8392704.pth... [2023-03-10 11:13:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000015800_8089600.pth [2023-03-10 11:13:24,921][988492] Updated weights for policy 0, policy_version 16400 (0.0006) [2023-03-10 11:13:28,974][988492] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-10 11:13:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 8445952. Throughput: 0: 10103.4. Samples: 8441820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:29,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:13:30,493][988448] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000008 [2023-03-10 11:13:32,929][988492] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-10 11:13:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 8495104. Throughput: 0: 10126.3. Samples: 8472988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:34,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:13:37,391][988492] Updated weights for policy 0, policy_version 16640 (0.0006) [2023-03-10 11:13:39,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9927.6). Total num frames: 8540160. Throughput: 0: 10017.6. Samples: 8527948. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:13:39,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:13:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016680_8540160.pth... [2023-03-10 11:13:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016096_8241152.pth [2023-03-10 11:13:41,555][988492] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-10 11:13:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 8593408. Throughput: 0: 10009.2. Samples: 8589232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:13:44,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:13:45,444][988492] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-10 11:13:49,272][988492] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-10 11:13:49,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 8646656. Throughput: 0: 10100.6. Samples: 8621912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:49,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:13:53,127][988492] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-10 11:13:54,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 8699904. Throughput: 0: 10160.1. Samples: 8686076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:54,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:13:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016992_8699904.pth... [2023-03-10 11:13:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016392_8392704.pth [2023-03-10 11:13:57,127][988492] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-10 11:13:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 8749056. Throughput: 0: 10183.7. Samples: 8746692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:13:59,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:14:01,286][988492] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-10 11:14:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 8798208. Throughput: 0: 10148.8. Samples: 8775772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:14:04,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 11:14:05,511][988492] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-10 11:14:09,546][988492] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-10 11:14:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 8847360. Throughput: 0: 10076.6. Samples: 8833864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:14:09,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 11:14:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017280_8847360.pth... [2023-03-10 11:14:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016680_8540160.pth [2023-03-10 11:14:13,737][988492] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-10 11:14:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 8896512. Throughput: 0: 10090.1. Samples: 8895872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:14:14,815][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:14:17,562][988492] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-10 11:14:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 8949760. Throughput: 0: 10065.9. Samples: 8925952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:14:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:14:21,516][988492] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-10 11:14:24,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10171.7, 300 sec: 9969.2). Total num frames: 9003008. Throughput: 0: 10279.3. Samples: 8990516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:14:24,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:14:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017584_9003008.pth... [2023-03-10 11:14:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000016992_8699904.pth [2023-03-10 11:14:25,243][988492] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-10 11:14:29,189][988492] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-10 11:14:29,804][988181] Fps is (10 sec: 10649.7, 60 sec: 10171.8, 300 sec: 9983.1). Total num frames: 9056256. Throughput: 0: 10317.0. Samples: 9053496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:14:29,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:14:33,249][988492] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-10 11:14:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 9105408. Throughput: 0: 10280.5. Samples: 9084536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:14:34,815][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:14:37,425][988492] Updated weights for policy 0, policy_version 17840 (0.0006) [2023-03-10 11:14:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 9983.1). Total num frames: 9154560. Throughput: 0: 10152.7. Samples: 9142948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:14:39,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:14:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017880_9154560.pth... [2023-03-10 11:14:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017280_8847360.pth [2023-03-10 11:14:41,601][988492] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-10 11:14:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 9203712. Throughput: 0: 10129.9. Samples: 9202536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:14:44,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 11:14:44,805][988448] Saving new best policy, reward=10.105! [2023-03-10 11:14:45,783][988492] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-10 11:14:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 9252864. Throughput: 0: 10111.1. Samples: 9230772. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:14:49,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:14:50,015][988492] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-10 11:14:54,431][988492] Updated weights for policy 0, policy_version 18160 (0.0004) [2023-03-10 11:14:54,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 9297920. Throughput: 0: 10082.1. Samples: 9287556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:14:54,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:14:54,858][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018168_9302016.pth... [2023-03-10 11:14:54,859][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017584_9003008.pth [2023-03-10 11:14:58,628][988492] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-10 11:14:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 9351168. Throughput: 0: 10026.7. Samples: 9347072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:14:59,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:15:02,654][988492] Updated weights for policy 0, policy_version 18320 (0.0006) [2023-03-10 11:15:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 9400320. Throughput: 0: 10005.2. Samples: 9376184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:04,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:15:06,722][988492] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-10 11:15:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 9449472. Throughput: 0: 9927.4. Samples: 9437248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:09,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:15:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018456_9449472.pth... [2023-03-10 11:15:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000017880_9154560.pth [2023-03-10 11:15:10,727][988492] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-10 11:15:14,760][988492] Updated weights for policy 0, policy_version 18560 (0.0005) [2023-03-10 11:15:14,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10103.4, 300 sec: 9983.1). Total num frames: 9502720. Throughput: 0: 9894.4. Samples: 9498744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:14,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:15:19,147][988492] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-10 11:15:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9969.3). Total num frames: 9547776. Throughput: 0: 9839.3. Samples: 9527304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:15:23,639][988492] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-10 11:15:24,804][988181] Fps is (10 sec: 9011.3, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 9592832. Throughput: 0: 9768.9. Samples: 9582548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:24,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:15:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018736_9592832.pth... [2023-03-10 11:15:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018168_9302016.pth [2023-03-10 11:15:27,766][988492] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-10 11:15:29,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 9641984. Throughput: 0: 9712.8. Samples: 9639612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:29,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:15:32,112][988492] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-10 11:15:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 9691136. Throughput: 0: 9740.9. Samples: 9669112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:34,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:15:36,071][988492] Updated weights for policy 0, policy_version 18960 (0.0004) [2023-03-10 11:15:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 9740288. Throughput: 0: 9812.3. Samples: 9729112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:15:39,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:15:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019024_9740288.pth... [2023-03-10 11:15:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018456_9449472.pth [2023-03-10 11:15:40,184][988492] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-10 11:15:44,286][988492] Updated weights for policy 0, policy_version 19120 (0.0006) [2023-03-10 11:15:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 9793536. Throughput: 0: 9832.5. Samples: 9789536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:15:44,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:15:48,462][988492] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-10 11:15:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 9842688. Throughput: 0: 9827.6. Samples: 9818428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:15:49,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:15:52,742][988492] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-10 11:15:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 9887744. Throughput: 0: 9791.7. Samples: 9877872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:15:54,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:15:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019312_9887744.pth... [2023-03-10 11:15:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000018736_9592832.pth [2023-03-10 11:15:57,004][988492] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-10 11:15:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 9936896. Throughput: 0: 9678.0. Samples: 9934252. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:15:59,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:16:01,120][988492] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-10 11:16:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 9990144. Throughput: 0: 9748.0. Samples: 9965964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:16:04,815][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 11:16:04,882][988492] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-10 11:16:08,996][988492] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-10 11:16:09,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 10039296. Throughput: 0: 9912.8. Samples: 10028624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:16:09,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:16:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019608_10039296.pth... [2023-03-10 11:16:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019024_9740288.pth [2023-03-10 11:16:13,350][988492] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-10 11:16:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9955.4). Total num frames: 10088448. Throughput: 0: 9898.7. Samples: 10085052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:14,814][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:16:17,570][988492] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-10 11:16:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 10137600. Throughput: 0: 9912.9. Samples: 10115192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:19,815][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:16:21,654][988492] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-10 11:16:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10186752. Throughput: 0: 9896.2. Samples: 10174440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:24,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:16:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019896_10186752.pth... [2023-03-10 11:16:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019312_9887744.pth [2023-03-10 11:16:25,935][988492] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-10 11:16:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10235904. Throughput: 0: 9828.4. Samples: 10231816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:29,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:16:30,084][988492] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-10 11:16:34,091][988492] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-10 11:16:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10285056. Throughput: 0: 9869.8. Samples: 10262568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:34,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 11:16:38,375][988492] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-10 11:16:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10334208. Throughput: 0: 9861.9. Samples: 10321656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:39,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:16:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020184_10334208.pth... [2023-03-10 11:16:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019608_10039296.pth [2023-03-10 11:16:42,135][988492] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-10 11:16:44,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10387456. Throughput: 0: 9980.2. Samples: 10383360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:44,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:16:46,544][988492] Updated weights for policy 0, policy_version 20320 (0.0004) [2023-03-10 11:16:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 10436608. Throughput: 0: 9912.9. Samples: 10412044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:49,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:16:50,517][988492] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-10 11:16:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 10481664. Throughput: 0: 9807.3. Samples: 10469952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:54,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:16:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020472_10481664.pth... [2023-03-10 11:16:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000019896_10186752.pth [2023-03-10 11:16:54,873][988492] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-10 11:16:59,038][988492] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-10 11:16:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 10530816. Throughput: 0: 9897.0. Samples: 10530416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:16:59,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:17:03,332][988492] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-10 11:17:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 10579968. Throughput: 0: 9870.3. Samples: 10559356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:04,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:17:07,685][988492] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-10 11:17:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 10625024. Throughput: 0: 9798.9. Samples: 10615392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:09,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 11:17:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020752_10625024.pth... [2023-03-10 11:17:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020184_10334208.pth [2023-03-10 11:17:12,151][988492] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-10 11:17:14,804][988181] Fps is (10 sec: 9011.3, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 10670080. Throughput: 0: 9738.8. Samples: 10670060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:14,804][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 11:17:16,498][988492] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-10 11:17:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 10719232. Throughput: 0: 9693.0. Samples: 10698752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:19,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:17:20,682][988492] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-10 11:17:24,666][988492] Updated weights for policy 0, policy_version 21040 (0.0006) [2023-03-10 11:17:24,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 10772480. Throughput: 0: 9743.5. Samples: 10760116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:24,804][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 11:17:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021040_10772480.pth... [2023-03-10 11:17:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020472_10481664.pth [2023-03-10 11:17:28,960][988492] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-10 11:17:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 10821632. Throughput: 0: 9649.8. Samples: 10817600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:29,815][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:17:33,230][988492] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-10 11:17:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 10866688. Throughput: 0: 9648.4. Samples: 10846220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:34,815][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 11:17:37,501][988492] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-10 11:17:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 10915840. Throughput: 0: 9637.0. Samples: 10903616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:39,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 11:17:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021320_10915840.pth... [2023-03-10 11:17:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000020752_10625024.pth [2023-03-10 11:17:41,789][988492] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-10 11:17:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9913.7). Total num frames: 10964992. Throughput: 0: 9567.6. Samples: 10960960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:44,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:17:45,872][988492] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-10 11:17:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9913.7). Total num frames: 11014144. Throughput: 0: 9626.9. Samples: 10992564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:49,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:17:49,907][988492] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-10 11:17:54,134][988492] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-10 11:17:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 11063296. Throughput: 0: 9682.0. Samples: 11051080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:54,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:17:54,843][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021616_11067392.pth... [2023-03-10 11:17:54,845][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021040_10772480.pth [2023-03-10 11:17:58,317][988492] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-10 11:17:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 11112448. Throughput: 0: 9787.6. Samples: 11110500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:17:59,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:18:02,436][988492] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-10 11:18:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 11161600. Throughput: 0: 9815.0. Samples: 11140428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:18:04,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:18:06,752][988492] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-10 11:18:09,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 11210752. Throughput: 0: 9741.3. Samples: 11198472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:18:09,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:18:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021896_11210752.pth... [2023-03-10 11:18:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021320_10915840.pth [2023-03-10 11:18:10,908][988492] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-10 11:18:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 11259904. Throughput: 0: 9755.2. Samples: 11256584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:18:14,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:18:15,013][988492] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-10 11:18:19,143][988492] Updated weights for policy 0, policy_version 22080 (0.0004) [2023-03-10 11:18:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 11309056. Throughput: 0: 9813.5. Samples: 11287828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:18:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:18:23,320][988492] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-10 11:18:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 11358208. Throughput: 0: 9830.4. Samples: 11345984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:18:24,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:18:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022184_11358208.pth... [2023-03-10 11:18:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021616_11067392.pth [2023-03-10 11:18:27,539][988492] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-10 11:18:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 11407360. Throughput: 0: 9881.6. Samples: 11405632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:18:29,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:18:31,621][988492] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-10 11:18:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 11456512. Throughput: 0: 9852.5. Samples: 11435928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:18:34,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:18:35,702][988492] Updated weights for policy 0, policy_version 22400 (0.0004) [2023-03-10 11:18:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 11505664. Throughput: 0: 9832.9. Samples: 11493560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:18:39,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:18:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022472_11505664.pth... [2023-03-10 11:18:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000021896_11210752.pth [2023-03-10 11:18:39,880][988492] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-10 11:18:44,128][988492] Updated weights for policy 0, policy_version 22560 (0.0004) [2023-03-10 11:18:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 11554816. Throughput: 0: 9833.6. Samples: 11553012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:18:44,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:18:48,254][988492] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-10 11:18:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 11603968. Throughput: 0: 9844.3. Samples: 11583420. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:18:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:18:52,579][988492] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-10 11:18:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 11653120. Throughput: 0: 9827.2. Samples: 11640696. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:18:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:18:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022760_11653120.pth... [2023-03-10 11:18:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022184_11358208.pth [2023-03-10 11:18:56,734][988492] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-10 11:18:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 11702272. Throughput: 0: 9858.3. Samples: 11700208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:18:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:19:00,820][988492] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-10 11:19:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 11751424. Throughput: 0: 9825.6. Samples: 11729980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:19:04,805][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:19:04,946][988492] Updated weights for policy 0, policy_version 22960 (0.0006) [2023-03-10 11:19:08,937][988492] Updated weights for policy 0, policy_version 23040 (0.0004) [2023-03-10 11:19:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 11800576. Throughput: 0: 9889.8. Samples: 11791024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:19:09,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:19:09,841][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023056_11804672.pth... [2023-03-10 11:19:09,842][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022472_11505664.pth [2023-03-10 11:19:13,083][988492] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-10 11:19:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 11853824. Throughput: 0: 9868.8. Samples: 11849728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:19:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:19:17,158][988492] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-10 11:19:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 11902976. Throughput: 0: 9866.0. Samples: 11879896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:19:19,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:19:21,397][988492] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-10 11:19:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 11952128. Throughput: 0: 9889.3. Samples: 11938580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:24,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:19:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023344_11952128.pth... [2023-03-10 11:19:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000022760_11653120.pth [2023-03-10 11:19:25,585][988492] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-10 11:19:29,741][988492] Updated weights for policy 0, policy_version 23440 (0.0006) [2023-03-10 11:19:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 12001280. Throughput: 0: 9872.1. Samples: 11997256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:29,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:19:33,830][988492] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-10 11:19:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 12050432. Throughput: 0: 9852.9. Samples: 12026800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:34,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 11:19:37,984][988492] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-10 11:19:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 12099584. Throughput: 0: 9923.3. Samples: 12087244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:39,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:19:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023632_12099584.pth... [2023-03-10 11:19:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023056_11804672.pth [2023-03-10 11:19:41,785][988492] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-10 11:19:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9830.4). Total num frames: 12152832. Throughput: 0: 10020.9. Samples: 12151148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:44,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 11:19:45,837][988492] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-10 11:19:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 12201984. Throughput: 0: 10030.6. Samples: 12181356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:49,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 11:19:49,944][988492] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-10 11:19:54,077][988492] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-10 11:19:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9830.4). Total num frames: 12251136. Throughput: 0: 9951.8. Samples: 12238856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:54,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 11:19:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023928_12251136.pth... [2023-03-10 11:19:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023344_11952128.pth [2023-03-10 11:19:58,128][988492] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-10 11:19:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 12304384. Throughput: 0: 10012.6. Samples: 12300296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:19:59,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:20:02,220][988492] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-10 11:20:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 12353536. Throughput: 0: 10003.7. Samples: 12330064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:20:04,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 11:20:06,398][988492] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-10 11:20:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 12398592. Throughput: 0: 9975.8. Samples: 12387492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:20:09,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:20:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024216_12398592.pth... [2023-03-10 11:20:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023632_12099584.pth [2023-03-10 11:20:10,687][988492] Updated weights for policy 0, policy_version 24240 (0.0004) [2023-03-10 11:20:14,673][988492] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-10 11:20:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 12451840. Throughput: 0: 10017.1. Samples: 12448024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:20:14,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:20:18,881][988492] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-10 11:20:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 12500992. Throughput: 0: 10021.8. Samples: 12477780. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:20:19,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:20:23,068][988492] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-10 11:20:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 12546048. Throughput: 0: 9991.7. Samples: 12536872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:20:24,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:20:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024504_12546048.pth... [2023-03-10 11:20:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000023928_12251136.pth [2023-03-10 11:20:27,425][988492] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-10 11:20:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 12599296. Throughput: 0: 9866.9. Samples: 12595160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:20:29,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:20:31,407][988492] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-10 11:20:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 12648448. Throughput: 0: 9864.5. Samples: 12625260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:20:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:20:35,459][988492] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-10 11:20:39,718][988492] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-10 11:20:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 12697600. Throughput: 0: 9907.0. Samples: 12684672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:20:39,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:20:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024800_12697600.pth... [2023-03-10 11:20:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024216_12398592.pth [2023-03-10 11:20:43,991][988492] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-10 11:20:44,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 12742656. Throughput: 0: 9828.7. Samples: 12742588. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:20:44,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:20:47,926][988492] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-10 11:20:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 12800000. Throughput: 0: 9864.8. Samples: 12773980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:20:49,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 11:20:51,626][988492] Updated weights for policy 0, policy_version 25040 (0.0004) [2023-03-10 11:20:54,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 12849152. Throughput: 0: 9989.7. Samples: 12837028. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:20:54,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:20:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025096_12849152.pth... [2023-03-10 11:20:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024504_12546048.pth [2023-03-10 11:20:55,838][988492] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-10 11:20:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9858.2). Total num frames: 12898304. Throughput: 0: 9982.2. Samples: 12897224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:20:59,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:20:59,904][988492] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-10 11:21:03,766][988492] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-10 11:21:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 12951552. Throughput: 0: 10013.0. Samples: 12928364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:21:04,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:21:07,948][988492] Updated weights for policy 0, policy_version 25360 (0.0006) [2023-03-10 11:21:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9872.0). Total num frames: 13000704. Throughput: 0: 10034.5. Samples: 12988424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:21:09,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 11:21:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025392_13000704.pth... [2023-03-10 11:21:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000024800_12697600.pth [2023-03-10 11:21:12,039][988492] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-10 11:21:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 13049856. Throughput: 0: 10044.7. Samples: 13047172. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 11:21:14,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:21:16,268][988492] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-10 11:21:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 13099008. Throughput: 0: 10049.9. Samples: 13077504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:19,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:21:20,400][988492] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-10 11:21:24,261][988492] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-10 11:21:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9885.9). Total num frames: 13152256. Throughput: 0: 10090.0. Samples: 13138724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:24,805][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:21:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025688_13152256.pth... [2023-03-10 11:21:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025096_12849152.pth [2023-03-10 11:21:28,164][988492] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-10 11:21:29,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10103.4, 300 sec: 9899.8). Total num frames: 13205504. Throughput: 0: 10194.3. Samples: 13201332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:29,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 11:21:32,212][988492] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-10 11:21:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 13254656. Throughput: 0: 10159.4. Samples: 13231156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:34,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 11:21:36,549][988492] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-10 11:21:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9885.9). Total num frames: 13303808. Throughput: 0: 10030.9. Samples: 13288420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:39,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 11:21:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025984_13303808.pth... [2023-03-10 11:21:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025392_13000704.pth [2023-03-10 11:21:40,430][988492] Updated weights for policy 0, policy_version 26000 (0.0004) [2023-03-10 11:21:44,494][988492] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-10 11:21:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 9885.9). Total num frames: 13352960. Throughput: 0: 10091.8. Samples: 13351352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:44,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 11:21:48,867][988492] Updated weights for policy 0, policy_version 26160 (0.0004) [2023-03-10 11:21:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 13402112. Throughput: 0: 10041.2. Samples: 13380220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:49,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:21:52,981][988492] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-10 11:21:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 13451264. Throughput: 0: 10012.3. Samples: 13438976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:54,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:21:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026272_13451264.pth... [2023-03-10 11:21:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025688_13152256.pth [2023-03-10 11:21:57,030][988492] Updated weights for policy 0, policy_version 26320 (0.0006) [2023-03-10 11:21:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 13500416. Throughput: 0: 10006.4. Samples: 13497460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:21:59,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:22:01,420][988492] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-10 11:22:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 13549568. Throughput: 0: 9990.7. Samples: 13527084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:22:04,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 11:22:05,320][988492] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-10 11:22:09,612][988492] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-10 11:22:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 13598720. Throughput: 0: 9946.8. Samples: 13586328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:22:09,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:22:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026560_13598720.pth... [2023-03-10 11:22:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000025984_13303808.pth [2023-03-10 11:22:13,532][988492] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-10 11:22:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9927.6). Total num frames: 13647872. Throughput: 0: 9921.5. Samples: 13647796. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:22:14,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 11:22:17,874][988492] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-10 11:22:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 13697024. Throughput: 0: 9895.4. Samples: 13676448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:22:19,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 11:22:22,039][988492] Updated weights for policy 0, policy_version 26800 (0.0005) [2023-03-10 11:22:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 13746176. Throughput: 0: 9900.7. Samples: 13733952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:22:24,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:22:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026848_13746176.pth... [2023-03-10 11:22:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026272_13451264.pth [2023-03-10 11:22:26,222][988492] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-10 11:22:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 13795328. Throughput: 0: 9800.1. Samples: 13792360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:22:29,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:22:30,267][988492] Updated weights for policy 0, policy_version 26960 (0.0005) [2023-03-10 11:22:34,587][988492] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-10 11:22:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 13844480. Throughput: 0: 9860.1. Samples: 13823924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:22:34,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:22:38,664][988492] Updated weights for policy 0, policy_version 27120 (0.0004) [2023-03-10 11:22:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 13893632. Throughput: 0: 9845.2. Samples: 13882008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:22:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:22:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027136_13893632.pth... [2023-03-10 11:22:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026560_13598720.pth [2023-03-10 11:22:42,930][988492] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-10 11:22:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 13942784. Throughput: 0: 9824.4. Samples: 13939560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:22:44,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:22:47,273][988492] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-10 11:22:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 13987840. Throughput: 0: 9789.2. Samples: 13967596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:22:49,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 11:22:51,670][988492] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-10 11:22:54,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 14036992. Throughput: 0: 9743.1. Samples: 14024768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:22:54,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:22:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027416_14036992.pth... [2023-03-10 11:22:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000026848_13746176.pth [2023-03-10 11:22:55,881][988492] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-10 11:22:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 14082048. Throughput: 0: 9648.2. Samples: 14081964. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:22:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:23:00,239][988492] Updated weights for policy 0, policy_version 27520 (0.0006) [2023-03-10 11:23:04,340][988492] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-10 11:23:04,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9762.2, 300 sec: 9913.7). Total num frames: 14135296. Throughput: 0: 9650.7. Samples: 14110728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:23:04,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:23:08,124][988448] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000007 [2023-03-10 11:23:08,126][988492] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-10 11:23:09,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 14188544. Throughput: 0: 9793.7. Samples: 14174672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:23:09,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:23:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027712_14188544.pth... [2023-03-10 11:23:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027136_13893632.pth [2023-03-10 11:23:12,283][988492] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-10 11:23:14,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 14233600. Throughput: 0: 9773.2. Samples: 14232156. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:23:14,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:23:16,558][988492] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-10 11:23:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 14282752. Throughput: 0: 9739.6. Samples: 14262208. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:23:19,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:23:20,651][988492] Updated weights for policy 0, policy_version 27920 (0.0004) [2023-03-10 11:23:24,744][988492] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-10 11:23:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 14336000. Throughput: 0: 9774.4. Samples: 14321856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:23:24,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:23:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028000_14336000.pth... [2023-03-10 11:23:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027416_14036992.pth [2023-03-10 11:23:28,775][988492] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-10 11:23:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 14385152. Throughput: 0: 9839.5. Samples: 14382336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:23:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:23:33,028][988492] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-10 11:23:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 14430208. Throughput: 0: 9850.4. Samples: 14410864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:23:34,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:23:37,367][988492] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-10 11:23:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 14483456. Throughput: 0: 9889.1. Samples: 14469776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:23:39,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:23:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028288_14483456.pth... [2023-03-10 11:23:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000027712_14188544.pth [2023-03-10 11:23:41,453][988492] Updated weights for policy 0, policy_version 28320 (0.0004) [2023-03-10 11:23:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 14528512. Throughput: 0: 9913.4. Samples: 14528068. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:23:44,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:23:45,966][988492] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-10 11:23:49,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 14573568. Throughput: 0: 9864.1. Samples: 14554616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:23:49,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 11:23:50,345][988492] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-10 11:23:54,710][988492] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-10 11:23:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 14622720. Throughput: 0: 9678.7. Samples: 14610212. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:23:54,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:23:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028560_14622720.pth... [2023-03-10 11:23:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028000_14336000.pth [2023-03-10 11:23:58,928][988492] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-10 11:23:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 14671872. Throughput: 0: 9690.7. Samples: 14668236. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:23:59,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:24:02,802][988492] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-10 11:24:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 14725120. Throughput: 0: 9738.0. Samples: 14700416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:24:04,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:24:06,882][988492] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-10 11:24:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 14774272. Throughput: 0: 9764.5. Samples: 14761256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:24:09,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:24:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028856_14774272.pth... [2023-03-10 11:24:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028288_14483456.pth [2023-03-10 11:24:10,971][988492] Updated weights for policy 0, policy_version 28880 (0.0004) [2023-03-10 11:24:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 14823424. Throughput: 0: 9725.2. Samples: 14819968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:24:14,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:24:15,006][988492] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-10 11:24:19,081][988492] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-10 11:24:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 14872576. Throughput: 0: 9783.6. Samples: 14851124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:19,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:24:23,230][988492] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-10 11:24:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 14921728. Throughput: 0: 9787.2. Samples: 14910200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:24,805][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:24:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029144_14921728.pth... [2023-03-10 11:24:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028560_14622720.pth [2023-03-10 11:24:27,543][988492] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-10 11:24:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 14970880. Throughput: 0: 9783.6. Samples: 14968328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:29,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:24:31,621][988492] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-10 11:24:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 15020032. Throughput: 0: 9878.4. Samples: 14999144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:34,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:24:35,658][988492] Updated weights for policy 0, policy_version 29360 (0.0006) [2023-03-10 11:24:39,631][988492] Updated weights for policy 0, policy_version 29440 (0.0006) [2023-03-10 11:24:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 15073280. Throughput: 0: 9984.7. Samples: 15059524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:39,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:24:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029440_15073280.pth... [2023-03-10 11:24:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000028856_14774272.pth [2023-03-10 11:24:44,094][988492] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-10 11:24:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 15118336. Throughput: 0: 9975.0. Samples: 15117112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:44,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:24:48,045][988492] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-10 11:24:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15171584. Throughput: 0: 9928.1. Samples: 15147180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:49,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:24:52,175][988492] Updated weights for policy 0, policy_version 29680 (0.0004) [2023-03-10 11:24:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 15220736. Throughput: 0: 9934.6. Samples: 15208316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:54,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:24:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029728_15220736.pth... [2023-03-10 11:24:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029144_14921728.pth [2023-03-10 11:24:56,410][988492] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-10 11:24:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 15269888. Throughput: 0: 9913.2. Samples: 15266064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:24:59,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:25:00,353][988492] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-10 11:25:04,373][988492] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-10 11:25:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 15323136. Throughput: 0: 9940.7. Samples: 15298456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:04,804][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 11:25:08,431][988492] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-10 11:25:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15372288. Throughput: 0: 9993.9. Samples: 15359924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:09,804][988181] Avg episode reward: [(0, '10.033')] [2023-03-10 11:25:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030024_15372288.pth... [2023-03-10 11:25:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029440_15073280.pth [2023-03-10 11:25:12,568][988492] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-10 11:25:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15421440. Throughput: 0: 10016.0. Samples: 15419048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:14,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 11:25:16,623][988492] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-10 11:25:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 15474688. Throughput: 0: 10001.0. Samples: 15449188. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:25:19,815][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:25:20,649][988492] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-10 11:25:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 15519744. Throughput: 0: 9981.7. Samples: 15508700. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:25:24,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:25:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030312_15519744.pth... [2023-03-10 11:25:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000029728_15220736.pth [2023-03-10 11:25:24,947][988492] Updated weights for policy 0, policy_version 30320 (0.0004) [2023-03-10 11:25:29,290][988492] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-10 11:25:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 15568896. Throughput: 0: 9950.2. Samples: 15564872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:25:29,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 11:25:33,321][988492] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-10 11:25:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15618048. Throughput: 0: 9994.2. Samples: 15596920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:25:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:25:37,463][988492] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-10 11:25:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 15667200. Throughput: 0: 9924.6. Samples: 15654924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:39,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:25:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030600_15667200.pth... [2023-03-10 11:25:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030024_15372288.pth [2023-03-10 11:25:41,665][988492] Updated weights for policy 0, policy_version 30640 (0.0004) [2023-03-10 11:25:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 15716352. Throughput: 0: 9942.8. Samples: 15713492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:44,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:25:45,985][988492] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-10 11:25:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 15765504. Throughput: 0: 9834.3. Samples: 15741000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:49,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:25:50,136][988492] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-10 11:25:53,969][988492] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-10 11:25:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15818752. Throughput: 0: 9852.6. Samples: 15803288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:25:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:25:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030896_15818752.pth... [2023-03-10 11:25:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030312_15519744.pth [2023-03-10 11:25:58,174][988492] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-10 11:25:59,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 15863808. Throughput: 0: 9881.4. Samples: 15863708. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:25:59,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:26:02,277][988492] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-10 11:26:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 15917056. Throughput: 0: 9855.6. Samples: 15892688. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:26:04,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:26:06,244][988492] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-10 11:26:09,804][988181] Fps is (10 sec: 10649.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 15970304. Throughput: 0: 9982.7. Samples: 15957924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:26:09,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:26:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031192_15970304.pth... [2023-03-10 11:26:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030600_15667200.pth [2023-03-10 11:26:09,926][988492] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-10 11:26:13,816][988492] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-10 11:26:14,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 16023552. Throughput: 0: 10126.7. Samples: 16020576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:26:14,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:26:17,966][988492] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-10 11:26:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 16072704. Throughput: 0: 10093.3. Samples: 16051120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:19,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:26:22,216][988492] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-10 11:26:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 16121856. Throughput: 0: 10094.0. Samples: 16109152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:24,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 11:26:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031488_16121856.pth... [2023-03-10 11:26:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000030896_15818752.pth [2023-03-10 11:26:26,287][988492] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-10 11:26:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 16171008. Throughput: 0: 10076.2. Samples: 16166920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:29,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:26:30,587][988492] Updated weights for policy 0, policy_version 31600 (0.0005) [2023-03-10 11:26:34,697][988492] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-10 11:26:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 16220160. Throughput: 0: 10102.0. Samples: 16195592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:34,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:26:38,816][988492] Updated weights for policy 0, policy_version 31760 (0.0004) [2023-03-10 11:26:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 16269312. Throughput: 0: 10067.0. Samples: 16256304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:39,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:26:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031776_16269312.pth... [2023-03-10 11:26:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031192_15970304.pth [2023-03-10 11:26:43,143][988492] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-10 11:26:44,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 16314368. Throughput: 0: 9979.3. Samples: 16312776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:44,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:26:47,537][988492] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-10 11:26:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9872.1). Total num frames: 16363520. Throughput: 0: 9961.4. Samples: 16340952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:49,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:26:51,549][988492] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-10 11:26:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 16412672. Throughput: 0: 9861.2. Samples: 16401676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:26:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032056_16412672.pth... [2023-03-10 11:26:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031488_16121856.pth [2023-03-10 11:26:55,737][988492] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-10 11:26:59,722][988492] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-10 11:26:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 16465920. Throughput: 0: 9806.9. Samples: 16461888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:26:59,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:27:03,687][988492] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-10 11:27:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 16515072. Throughput: 0: 9813.2. Samples: 16492716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:04,805][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 11:27:08,093][988492] Updated weights for policy 0, policy_version 32320 (0.0004) [2023-03-10 11:27:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 16564224. Throughput: 0: 9816.2. Samples: 16550880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:09,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 11:27:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032352_16564224.pth... [2023-03-10 11:27:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000031776_16269312.pth [2023-03-10 11:27:12,271][988492] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-10 11:27:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 16613376. Throughput: 0: 9835.4. Samples: 16609512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:14,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:27:16,361][988492] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-10 11:27:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 16662528. Throughput: 0: 9861.2. Samples: 16639344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:19,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:27:20,440][988492] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-10 11:27:24,735][988492] Updated weights for policy 0, policy_version 32640 (0.0004) [2023-03-10 11:27:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 16711680. Throughput: 0: 9837.0. Samples: 16698968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:24,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 11:27:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032640_16711680.pth... [2023-03-10 11:27:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032056_16412672.pth [2023-03-10 11:27:29,049][988492] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-10 11:27:29,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 16756736. Throughput: 0: 9854.0. Samples: 16756208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:29,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 11:27:32,975][988492] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-10 11:27:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 16809984. Throughput: 0: 9878.4. Samples: 16785480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:34,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:27:37,168][988492] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-10 11:27:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 16859136. Throughput: 0: 9892.0. Samples: 16846816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:27:39,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:27:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032928_16859136.pth... [2023-03-10 11:27:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032352_16564224.pth [2023-03-10 11:27:41,281][988492] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-10 11:27:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 16908288. Throughput: 0: 9865.2. Samples: 16905820. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:27:44,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:27:45,392][988492] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-10 11:27:49,557][988492] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-10 11:27:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9899.8). Total num frames: 16957440. Throughput: 0: 9869.3. Samples: 16936836. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:27:49,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:27:53,578][988492] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-10 11:27:54,804][988181] Fps is (10 sec: 10239.7, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 17010688. Throughput: 0: 9865.1. Samples: 16994808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:27:54,805][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:27:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033224_17010688.pth... [2023-03-10 11:27:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032640_16711680.pth [2023-03-10 11:27:57,712][988492] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-10 11:27:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 17059840. Throughput: 0: 9915.2. Samples: 17055696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:27:59,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:28:01,792][988492] Updated weights for policy 0, policy_version 33360 (0.0004) [2023-03-10 11:28:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 17108992. Throughput: 0: 9916.9. Samples: 17085604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:04,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:28:06,003][988492] Updated weights for policy 0, policy_version 33440 (0.0004) [2023-03-10 11:28:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 17154048. Throughput: 0: 9863.0. Samples: 17142804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:09,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:28:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033504_17154048.pth... [2023-03-10 11:28:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000032928_16859136.pth [2023-03-10 11:28:10,425][988492] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-10 11:28:14,282][988492] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-10 11:28:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 17207296. Throughput: 0: 9936.8. Samples: 17203364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:14,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:28:18,255][988492] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-10 11:28:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 17256448. Throughput: 0: 9981.4. Samples: 17234644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:19,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:28:22,445][988492] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-10 11:28:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 17309696. Throughput: 0: 9956.3. Samples: 17294848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:24,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:28:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033808_17309696.pth... [2023-03-10 11:28:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033224_17010688.pth [2023-03-10 11:28:26,249][988492] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-10 11:28:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 17358848. Throughput: 0: 10020.9. Samples: 17356760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:29,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:28:30,413][988492] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-10 11:28:34,611][988492] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-10 11:28:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 17408000. Throughput: 0: 10014.6. Samples: 17387492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:34,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:28:38,928][988492] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-10 11:28:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 17457152. Throughput: 0: 9941.3. Samples: 17442164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:39,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:28:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034096_17457152.pth... [2023-03-10 11:28:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033504_17154048.pth [2023-03-10 11:28:42,924][988492] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-10 11:28:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 17506304. Throughput: 0: 9948.9. Samples: 17503396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:44,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:28:47,017][988492] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-10 11:28:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9967.0, 300 sec: 9941.5). Total num frames: 17555456. Throughput: 0: 9982.1. Samples: 17534796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:49,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:28:51,400][988492] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-10 11:28:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 17600512. Throughput: 0: 9944.3. Samples: 17590296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:54,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:28:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034376_17600512.pth... [2023-03-10 11:28:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000033808_17309696.pth [2023-03-10 11:28:55,792][988492] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-10 11:28:59,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 17649664. Throughput: 0: 9889.0. Samples: 17648368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:28:59,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:29:00,016][988492] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-10 11:29:04,235][988492] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-10 11:29:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 17698816. Throughput: 0: 9831.4. Samples: 17677056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:29:08,218][988492] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-10 11:29:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 17747968. Throughput: 0: 9819.3. Samples: 17736716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:09,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:29:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034664_17747968.pth... [2023-03-10 11:29:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034096_17457152.pth [2023-03-10 11:29:12,503][988492] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-10 11:29:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 17797120. Throughput: 0: 9729.5. Samples: 17794588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:14,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:29:16,643][988492] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-10 11:29:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 17846272. Throughput: 0: 9711.1. Samples: 17824492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:19,805][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:29:21,031][988492] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-10 11:29:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 17891328. Throughput: 0: 9728.0. Samples: 17879924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:24,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:29:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034944_17891328.pth... [2023-03-10 11:29:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034376_17600512.pth [2023-03-10 11:29:25,298][988492] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-10 11:29:29,480][988492] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-10 11:29:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 17940480. Throughput: 0: 9708.0. Samples: 17940256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:29:29,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:29:33,657][988492] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-10 11:29:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 17989632. Throughput: 0: 9651.3. Samples: 17969104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:29:34,804][988181] Avg episode reward: [(0, '9.982')] [2023-03-10 11:29:37,684][988492] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-10 11:29:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 18042880. Throughput: 0: 9763.5. Samples: 18029656. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:29:39,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 11:29:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035240_18042880.pth... [2023-03-10 11:29:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034664_17747968.pth [2023-03-10 11:29:41,698][988492] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-10 11:29:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 18087936. Throughput: 0: 9766.0. Samples: 18087836. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:29:44,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:29:46,032][988492] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-10 11:29:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 18141184. Throughput: 0: 9776.9. Samples: 18117016. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:29:49,805][988181] Avg episode reward: [(0, '10.118')] [2023-03-10 11:29:49,805][988448] Saving new best policy, reward=10.118! [2023-03-10 11:29:49,942][988492] Updated weights for policy 0, policy_version 35440 (0.0004) [2023-03-10 11:29:54,246][988492] Updated weights for policy 0, policy_version 35520 (0.0006) [2023-03-10 11:29:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 18190336. Throughput: 0: 9806.8. Samples: 18178024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:29:54,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:29:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035528_18190336.pth... [2023-03-10 11:29:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000034944_17891328.pth [2023-03-10 11:29:58,492][988492] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-10 11:29:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 18239488. Throughput: 0: 9797.0. Samples: 18235456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:29:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:30:02,603][988492] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-10 11:30:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 18288640. Throughput: 0: 9808.9. Samples: 18265892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:30:04,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:30:06,859][988492] Updated weights for policy 0, policy_version 35760 (0.0006) [2023-03-10 11:30:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 18337792. Throughput: 0: 9898.9. Samples: 18325372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:30:09,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:30:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035816_18337792.pth... [2023-03-10 11:30:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035240_18042880.pth [2023-03-10 11:30:10,902][988492] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-10 11:30:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 18386944. Throughput: 0: 9919.1. Samples: 18386616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:30:14,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:30:14,859][988492] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-10 11:30:18,742][988492] Updated weights for policy 0, policy_version 36000 (0.0004) [2023-03-10 11:30:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 18440192. Throughput: 0: 9964.0. Samples: 18417484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:30:19,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:30:22,649][988492] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-10 11:30:24,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 18493440. Throughput: 0: 10013.8. Samples: 18480276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:30:24,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:30:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036120_18493440.pth... [2023-03-10 11:30:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035528_18190336.pth [2023-03-10 11:30:26,666][988492] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-10 11:30:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 18542592. Throughput: 0: 10047.3. Samples: 18539964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:30:29,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:30:30,705][988492] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-10 11:30:34,661][988492] Updated weights for policy 0, policy_version 36320 (0.0004) [2023-03-10 11:30:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 18595840. Throughput: 0: 10094.1. Samples: 18571252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:30:34,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:30:38,865][988492] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-10 11:30:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 18644992. Throughput: 0: 10088.2. Samples: 18631992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:30:39,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:30:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036416_18644992.pth... [2023-03-10 11:30:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000035816_18337792.pth [2023-03-10 11:30:42,766][988492] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-10 11:30:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9941.5). Total num frames: 18698240. Throughput: 0: 10193.2. Samples: 18694152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:30:44,805][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:30:47,080][988492] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-10 11:30:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 18743296. Throughput: 0: 10122.0. Samples: 18721380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:30:49,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:30:51,304][988492] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-10 11:30:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 18792448. Throughput: 0: 10104.5. Samples: 18780076. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:30:54,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:30:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036704_18792448.pth... [2023-03-10 11:30:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036120_18493440.pth [2023-03-10 11:30:55,471][988492] Updated weights for policy 0, policy_version 36720 (0.0004) [2023-03-10 11:30:59,645][988492] Updated weights for policy 0, policy_version 36800 (0.0004) [2023-03-10 11:30:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 18841600. Throughput: 0: 10042.0. Samples: 18838508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:30:59,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:31:03,663][988492] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-10 11:31:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9913.7). Total num frames: 18894848. Throughput: 0: 10062.1. Samples: 18870280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:04,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:31:07,675][988492] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-10 11:31:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 9899.8). Total num frames: 18944000. Throughput: 0: 10004.4. Samples: 18930476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:09,805][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 11:31:09,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037000_18944000.pth... [2023-03-10 11:31:09,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036416_18644992.pth [2023-03-10 11:31:11,919][988492] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-10 11:31:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 18993152. Throughput: 0: 9961.5. Samples: 18988232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:14,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:31:16,069][988492] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-10 11:31:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 19042304. Throughput: 0: 9961.2. Samples: 19019504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:19,804][988181] Avg episode reward: [(0, '10.101')] [2023-03-10 11:31:19,950][988492] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-10 11:31:24,098][988492] Updated weights for policy 0, policy_version 37280 (0.0005) [2023-03-10 11:31:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 19091456. Throughput: 0: 9963.4. Samples: 19080344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:24,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:31:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037288_19091456.pth... [2023-03-10 11:31:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000036704_18792448.pth [2023-03-10 11:31:28,232][988492] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-10 11:31:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 19144704. Throughput: 0: 9919.8. Samples: 19140544. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:29,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:31:32,240][988492] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-10 11:31:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 19193856. Throughput: 0: 9967.7. Samples: 19169928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:34,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:31:36,408][988492] Updated weights for policy 0, policy_version 37520 (0.0006) [2023-03-10 11:31:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 19243008. Throughput: 0: 10010.8. Samples: 19230564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:39,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:31:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037584_19243008.pth... [2023-03-10 11:31:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037000_18944000.pth [2023-03-10 11:31:40,386][988492] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-10 11:31:41,501][988448] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000006 [2023-03-10 11:31:44,239][988492] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-10 11:31:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 19296256. Throughput: 0: 10098.8. Samples: 19292956. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:44,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:31:48,328][988492] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-10 11:31:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 19345408. Throughput: 0: 10069.0. Samples: 19323384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:31:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:31:52,576][988492] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-10 11:31:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 19394560. Throughput: 0: 10039.1. Samples: 19382236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:54,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:31:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037880_19394560.pth... [2023-03-10 11:31:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037288_19091456.pth [2023-03-10 11:31:56,811][988492] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-10 11:31:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 19443712. Throughput: 0: 10041.5. Samples: 19440100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:31:59,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:32:00,860][988492] Updated weights for policy 0, policy_version 38000 (0.0006) [2023-03-10 11:32:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9927.6). Total num frames: 19492864. Throughput: 0: 10015.7. Samples: 19470208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:04,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:32:04,977][988492] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-10 11:32:09,146][988492] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-10 11:32:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 19542016. Throughput: 0: 9995.2. Samples: 19530128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:09,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:32:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038168_19542016.pth... [2023-03-10 11:32:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037584_19243008.pth [2023-03-10 11:32:13,255][988492] Updated weights for policy 0, policy_version 38240 (0.0005) [2023-03-10 11:32:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 19591168. Throughput: 0: 9997.6. Samples: 19590436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:14,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:32:17,354][988492] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-10 11:32:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 19640320. Throughput: 0: 9998.1. Samples: 19619840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:19,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:32:21,537][988492] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-10 11:32:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 19693568. Throughput: 0: 9944.8. Samples: 19678080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:24,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:32:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038464_19693568.pth... [2023-03-10 11:32:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000037880_19394560.pth [2023-03-10 11:32:25,519][988492] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-10 11:32:29,571][988492] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-10 11:32:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 19742720. Throughput: 0: 9937.1. Samples: 19740124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:29,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:32:33,567][988492] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-10 11:32:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 19791872. Throughput: 0: 9966.5. Samples: 19771876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:32:37,648][988492] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-10 11:32:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 19845120. Throughput: 0: 9983.5. Samples: 19831492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:32:39,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:32:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038760_19845120.pth... [2023-03-10 11:32:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038168_19542016.pth [2023-03-10 11:32:41,872][988492] Updated weights for policy 0, policy_version 38800 (0.0004) [2023-03-10 11:32:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 19890176. Throughput: 0: 9993.1. Samples: 19889788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:32:44,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:32:46,042][988492] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-10 11:32:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 19939328. Throughput: 0: 9971.2. Samples: 19918912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:32:49,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:32:50,172][988492] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-10 11:32:54,381][988492] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-10 11:32:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 19988480. Throughput: 0: 9956.6. Samples: 19978176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:32:54,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:32:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039048_19992576.pth... [2023-03-10 11:32:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038464_19693568.pth [2023-03-10 11:32:58,445][988492] Updated weights for policy 0, policy_version 39120 (0.0005) [2023-03-10 11:32:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 20041728. Throughput: 0: 9939.1. Samples: 20037696. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:32:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:33:02,794][988492] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-10 11:33:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 20086784. Throughput: 0: 9921.4. Samples: 20066304. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 11:33:04,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:33:07,055][988492] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-10 11:33:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 20135936. Throughput: 0: 9899.0. Samples: 20123536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:09,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:33:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039328_20135936.pth... [2023-03-10 11:33:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000038760_19845120.pth [2023-03-10 11:33:11,088][988492] Updated weights for policy 0, policy_version 39360 (0.0004) [2023-03-10 11:33:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 20185088. Throughput: 0: 9870.4. Samples: 20184292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:14,804][988181] Avg episode reward: [(0, '10.100')] [2023-03-10 11:33:15,414][988492] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-10 11:33:19,244][988492] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-10 11:33:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 20238336. Throughput: 0: 9819.8. Samples: 20213768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:33:23,458][988492] Updated weights for policy 0, policy_version 39600 (0.0004) [2023-03-10 11:33:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 20287488. Throughput: 0: 9851.9. Samples: 20274828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:24,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:33:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039624_20287488.pth... [2023-03-10 11:33:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039048_19992576.pth [2023-03-10 11:33:27,500][988492] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-10 11:33:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 20336640. Throughput: 0: 9860.3. Samples: 20333500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:33:31,328][988492] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-10 11:33:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 20385792. Throughput: 0: 9931.4. Samples: 20365824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:34,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:33:35,682][988492] Updated weights for policy 0, policy_version 39840 (0.0005) [2023-03-10 11:33:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 20434944. Throughput: 0: 9889.9. Samples: 20423224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:39,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:33:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039912_20434944.pth... [2023-03-10 11:33:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039328_20135936.pth [2023-03-10 11:33:39,962][988492] Updated weights for policy 0, policy_version 39920 (0.0004) [2023-03-10 11:33:44,247][988492] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-10 11:33:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 20484096. Throughput: 0: 9842.3. Samples: 20480600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:33:48,436][988492] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-10 11:33:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 20533248. Throughput: 0: 9860.0. Samples: 20510004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:49,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:33:52,717][988492] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-10 11:33:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 20582400. Throughput: 0: 9893.7. Samples: 20568752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:33:54,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:33:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040200_20582400.pth... [2023-03-10 11:33:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039624_20287488.pth [2023-03-10 11:33:56,941][988492] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-10 11:33:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 20627456. Throughput: 0: 9846.7. Samples: 20627392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:33:59,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:34:01,073][988492] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-10 11:34:04,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 20676608. Throughput: 0: 9827.3. Samples: 20655996. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:34:04,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:34:05,442][988492] Updated weights for policy 0, policy_version 40400 (0.0004) [2023-03-10 11:34:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 20721664. Throughput: 0: 9695.4. Samples: 20711120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:34:09,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:34:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040472_20721664.pth... [2023-03-10 11:34:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000039912_20434944.pth [2023-03-10 11:34:10,007][988492] Updated weights for policy 0, policy_version 40480 (0.0004) [2023-03-10 11:34:13,984][988492] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-10 11:34:14,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 20770816. Throughput: 0: 9715.3. Samples: 20770688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:34:14,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:34:17,967][988492] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-10 11:34:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 20824064. Throughput: 0: 9663.3. Samples: 20800672. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:34:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:34:22,038][988492] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-10 11:34:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 20873216. Throughput: 0: 9740.4. Samples: 20861540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:24,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:34:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040768_20873216.pth... [2023-03-10 11:34:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040200_20582400.pth [2023-03-10 11:34:26,236][988492] Updated weights for policy 0, policy_version 40800 (0.0006) [2023-03-10 11:34:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 20922368. Throughput: 0: 9776.4. Samples: 20920536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:29,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:34:30,337][988492] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-10 11:34:34,335][988492] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-10 11:34:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 20975616. Throughput: 0: 9798.4. Samples: 20950932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:34,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:34:38,582][988492] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-10 11:34:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 21020672. Throughput: 0: 9833.9. Samples: 21011276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:39,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:34:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041056_21020672.pth... [2023-03-10 11:34:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040472_20721664.pth [2023-03-10 11:34:43,052][988492] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-10 11:34:44,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 21069824. Throughput: 0: 9742.4. Samples: 21065800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:44,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:34:47,169][988492] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-10 11:34:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 21118976. Throughput: 0: 9772.8. Samples: 21095772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:34:49,804][988181] Avg episode reward: [(0, '10.104')] [2023-03-10 11:34:51,371][988492] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-10 11:34:54,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 21168128. Throughput: 0: 9862.9. Samples: 21154952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:34:54,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:34:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041344_21168128.pth... [2023-03-10 11:34:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000040768_20873216.pth [2023-03-10 11:34:55,624][988492] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-10 11:34:59,540][988492] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-10 11:34:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 21217280. Throughput: 0: 9870.4. Samples: 21214856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:34:59,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 11:35:03,391][988492] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-10 11:35:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.6, 300 sec: 9941.5). Total num frames: 21270528. Throughput: 0: 9872.9. Samples: 21244952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:35:04,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:35:07,544][988492] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-10 11:35:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 21319680. Throughput: 0: 9906.8. Samples: 21307344. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:35:09,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:35:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041640_21319680.pth... [2023-03-10 11:35:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041056_21020672.pth [2023-03-10 11:35:11,677][988492] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-10 11:35:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 21368832. Throughput: 0: 9871.5. Samples: 21364752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:35:14,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:35:16,026][988492] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-10 11:35:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 21417984. Throughput: 0: 9843.7. Samples: 21393896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:19,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:35:20,108][988492] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-10 11:35:24,135][988492] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-10 11:35:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 21467136. Throughput: 0: 9851.2. Samples: 21454580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:24,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:35:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041928_21467136.pth... [2023-03-10 11:35:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041344_21168128.pth [2023-03-10 11:35:27,935][988492] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-10 11:35:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9967.0, 300 sec: 9913.7). Total num frames: 21520384. Throughput: 0: 10092.0. Samples: 21519940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:29,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:35:31,919][988492] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-10 11:35:34,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 21573632. Throughput: 0: 10073.2. Samples: 21549064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:34,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:35:36,095][988492] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-10 11:35:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 21618688. Throughput: 0: 10054.3. Samples: 21607396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:35:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042224_21618688.pth... [2023-03-10 11:35:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041640_21319680.pth [2023-03-10 11:35:40,462][988492] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-10 11:35:44,799][988492] Updated weights for policy 0, policy_version 42320 (0.0004) [2023-03-10 11:35:44,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 21667840. Throughput: 0: 9976.7. Samples: 21663808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:44,805][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:35:48,755][988492] Updated weights for policy 0, policy_version 42400 (0.0006) [2023-03-10 11:35:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 21716992. Throughput: 0: 10010.5. Samples: 21695424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:49,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:35:52,840][988492] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-10 11:35:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 21766144. Throughput: 0: 9936.4. Samples: 21754480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:35:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042512_21766144.pth... [2023-03-10 11:35:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000041928_21467136.pth [2023-03-10 11:35:57,044][988492] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-10 11:35:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 21815296. Throughput: 0: 9988.4. Samples: 21814228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:35:59,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:36:01,289][988492] Updated weights for policy 0, policy_version 42640 (0.0004) [2023-03-10 11:36:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 21864448. Throughput: 0: 9980.2. Samples: 21843004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:04,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:36:05,524][988492] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-10 11:36:09,757][988492] Updated weights for policy 0, policy_version 42800 (0.0004) [2023-03-10 11:36:09,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 21913600. Throughput: 0: 9894.8. Samples: 21899848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:09,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:36:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042800_21913600.pth... [2023-03-10 11:36:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042224_21618688.pth [2023-03-10 11:36:13,838][988492] Updated weights for policy 0, policy_version 42880 (0.0004) [2023-03-10 11:36:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 21962752. Throughput: 0: 9758.0. Samples: 21959052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:14,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:36:18,208][988492] Updated weights for policy 0, policy_version 42960 (0.0004) [2023-03-10 11:36:19,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 22007808. Throughput: 0: 9735.9. Samples: 21987180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:19,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 11:36:22,538][988492] Updated weights for policy 0, policy_version 43040 (0.0006) [2023-03-10 11:36:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22056960. Throughput: 0: 9715.7. Samples: 22044600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:24,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:36:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043080_22056960.pth... [2023-03-10 11:36:24,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042512_21766144.pth [2023-03-10 11:36:26,703][988492] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-10 11:36:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 22106112. Throughput: 0: 9765.4. Samples: 22103252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:29,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:36:30,932][988492] Updated weights for policy 0, policy_version 43200 (0.0004) [2023-03-10 11:36:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 22155264. Throughput: 0: 9676.7. Samples: 22130876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:36:35,014][988492] Updated weights for policy 0, policy_version 43280 (0.0004) [2023-03-10 11:36:39,133][988492] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-10 11:36:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 22204416. Throughput: 0: 9733.3. Samples: 22192480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:39,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:36:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043368_22204416.pth... [2023-03-10 11:36:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000042800_21913600.pth [2023-03-10 11:36:43,513][988492] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-10 11:36:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 22253568. Throughput: 0: 9676.8. Samples: 22249684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:44,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:36:47,626][988492] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-10 11:36:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 22302720. Throughput: 0: 9697.2. Samples: 22279380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:49,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:36:51,433][988492] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-10 11:36:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22355968. Throughput: 0: 9851.0. Samples: 22343140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:54,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:36:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043664_22355968.pth... [2023-03-10 11:36:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043080_22056960.pth [2023-03-10 11:36:55,503][988492] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-10 11:36:59,684][988492] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-10 11:36:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22405120. Throughput: 0: 9823.0. Samples: 22401088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:36:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:37:03,833][988492] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-10 11:37:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22454272. Throughput: 0: 9862.0. Samples: 22430972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:37:07,860][988492] Updated weights for policy 0, policy_version 43920 (0.0004) [2023-03-10 11:37:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22503424. Throughput: 0: 9924.6. Samples: 22491208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:09,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 11:37:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043952_22503424.pth... [2023-03-10 11:37:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043368_22204416.pth [2023-03-10 11:37:12,188][988492] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-10 11:37:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 22552576. Throughput: 0: 9907.3. Samples: 22549080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:14,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:37:16,273][988492] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-10 11:37:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9858.2). Total num frames: 22601728. Throughput: 0: 9967.8. Samples: 22579428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:19,805][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:37:20,294][988492] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-10 11:37:24,360][988492] Updated weights for policy 0, policy_version 44240 (0.0004) [2023-03-10 11:37:24,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 22654976. Throughput: 0: 9944.2. Samples: 22639968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:24,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:37:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044248_22654976.pth... [2023-03-10 11:37:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043664_22355968.pth [2023-03-10 11:37:28,229][988492] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-10 11:37:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 22704128. Throughput: 0: 10096.5. Samples: 22704024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:29,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:37:32,462][988492] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-10 11:37:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 22753280. Throughput: 0: 10057.8. Samples: 22731980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:37:36,650][988492] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-10 11:37:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9872.0). Total num frames: 22802432. Throughput: 0: 9951.5. Samples: 22790956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:39,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:37:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044536_22802432.pth... [2023-03-10 11:37:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000043952_22503424.pth [2023-03-10 11:37:40,740][988492] Updated weights for policy 0, policy_version 44560 (0.0004) [2023-03-10 11:37:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 22851584. Throughput: 0: 9946.7. Samples: 22848688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:44,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:37:45,062][988492] Updated weights for policy 0, policy_version 44640 (0.0004) [2023-03-10 11:37:49,227][988492] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-10 11:37:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 22900736. Throughput: 0: 9940.1. Samples: 22878276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:49,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:37:53,435][988492] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-10 11:37:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 22945792. Throughput: 0: 9909.1. Samples: 22937116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:54,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:37:54,823][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044824_22949888.pth... [2023-03-10 11:37:54,825][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044248_22654976.pth [2023-03-10 11:37:57,747][988492] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-10 11:37:59,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 22994944. Throughput: 0: 9904.2. Samples: 22994768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:37:59,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:38:01,878][988492] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-10 11:38:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 23044096. Throughput: 0: 9871.0. Samples: 23023624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:04,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:38:06,174][988492] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-10 11:38:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 23093248. Throughput: 0: 9804.6. Samples: 23081172. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:09,804][988181] Avg episode reward: [(0, '10.106')] [2023-03-10 11:38:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045104_23093248.pth... [2023-03-10 11:38:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044536_22802432.pth [2023-03-10 11:38:10,362][988492] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-10 11:38:14,731][988492] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-10 11:38:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 23142400. Throughput: 0: 9659.1. Samples: 23138684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:14,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:38:18,691][988492] Updated weights for policy 0, policy_version 45280 (0.0004) [2023-03-10 11:38:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 23191552. Throughput: 0: 9709.2. Samples: 23168892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:19,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:38:22,830][988492] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-10 11:38:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9844.3). Total num frames: 23240704. Throughput: 0: 9731.9. Samples: 23228892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:24,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:38:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045392_23240704.pth... [2023-03-10 11:38:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000044824_22949888.pth [2023-03-10 11:38:26,928][988492] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-10 11:38:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23289856. Throughput: 0: 9759.4. Samples: 23287860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:38:29,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:38:31,349][988492] Updated weights for policy 0, policy_version 45520 (0.0006) [2023-03-10 11:38:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23339008. Throughput: 0: 9708.2. Samples: 23315148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:34,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:38:35,563][988492] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-10 11:38:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 23384064. Throughput: 0: 9697.2. Samples: 23373488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:39,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:38:39,812][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045680_23388160.pth... [2023-03-10 11:38:39,813][988492] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-10 11:38:39,814][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045104_23093248.pth [2023-03-10 11:38:44,044][988492] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-10 11:38:44,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 23433216. Throughput: 0: 9729.3. Samples: 23432588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:44,804][988181] Avg episode reward: [(0, '10.100')] [2023-03-10 11:38:48,287][988492] Updated weights for policy 0, policy_version 45840 (0.0006) [2023-03-10 11:38:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 23482368. Throughput: 0: 9739.1. Samples: 23461884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:49,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:38:52,655][988492] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-10 11:38:54,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23531520. Throughput: 0: 9732.4. Samples: 23519132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:54,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:38:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045960_23531520.pth... [2023-03-10 11:38:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045392_23240704.pth [2023-03-10 11:38:56,844][988492] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-10 11:38:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23580672. Throughput: 0: 9771.8. Samples: 23578416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:38:59,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:39:00,654][988492] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-10 11:39:04,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 23629824. Throughput: 0: 9787.8. Samples: 23609344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:04,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:39:05,010][988492] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-10 11:39:09,410][988492] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-10 11:39:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.8, 300 sec: 9844.3). Total num frames: 23674880. Throughput: 0: 9703.4. Samples: 23665548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:09,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:39:09,841][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046248_23678976.pth... [2023-03-10 11:39:09,843][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045680_23388160.pth [2023-03-10 11:39:13,698][988492] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-10 11:39:14,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 23724032. Throughput: 0: 9657.5. Samples: 23722448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:14,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:39:17,766][988492] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-10 11:39:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23777280. Throughput: 0: 9720.6. Samples: 23752576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:19,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:39:21,860][988492] Updated weights for policy 0, policy_version 46480 (0.0006) [2023-03-10 11:39:24,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 23826432. Throughput: 0: 9759.1. Samples: 23812648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:24,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:39:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046536_23826432.pth... [2023-03-10 11:39:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000045960_23531520.pth [2023-03-10 11:39:26,040][988492] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-10 11:39:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 23871488. Throughput: 0: 9732.1. Samples: 23870532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:29,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:39:30,265][988492] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-10 11:39:34,533][988492] Updated weights for policy 0, policy_version 46720 (0.0004) [2023-03-10 11:39:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 23920640. Throughput: 0: 9712.5. Samples: 23898948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:34,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:39:38,423][988492] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-10 11:39:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 23973888. Throughput: 0: 9827.1. Samples: 23961348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:39:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046824_23973888.pth... [2023-03-10 11:39:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046248_23678976.pth [2023-03-10 11:39:42,364][988492] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-10 11:39:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 24023040. Throughput: 0: 9882.0. Samples: 24023104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:44,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:39:46,283][988492] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-10 11:39:49,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 24080384. Throughput: 0: 9885.2. Samples: 24054180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:49,805][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:39:50,213][988492] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-10 11:39:54,407][988492] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-10 11:39:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 24125440. Throughput: 0: 10009.5. Samples: 24115976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:39:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:39:54,838][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047128_24129536.pth... [2023-03-10 11:39:54,840][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046536_23826432.pth [2023-03-10 11:39:58,597][988492] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-10 11:39:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24174592. Throughput: 0: 10037.3. Samples: 24174128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:39:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:40:02,716][988492] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-10 11:40:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24223744. Throughput: 0: 10021.9. Samples: 24203560. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:40:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:40:06,888][988492] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-10 11:40:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 24276992. Throughput: 0: 10006.9. Samples: 24262960. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:40:09,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:40:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047416_24276992.pth... [2023-03-10 11:40:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000046824_23973888.pth [2023-03-10 11:40:10,935][988492] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-10 11:40:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 24326144. Throughput: 0: 10070.5. Samples: 24323704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:40:14,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:40:15,077][988492] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-10 11:40:19,471][988492] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-10 11:40:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24371200. Throughput: 0: 10038.9. Samples: 24350700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:40:19,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:40:23,689][988492] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-10 11:40:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 24420352. Throughput: 0: 9931.2. Samples: 24408252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:40:24,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:40:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047696_24420352.pth... [2023-03-10 11:40:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047128_24129536.pth [2023-03-10 11:40:28,149][988492] Updated weights for policy 0, policy_version 47760 (0.0004) [2023-03-10 11:40:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9802.6). Total num frames: 24465408. Throughput: 0: 9827.5. Samples: 24465340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:29,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 11:40:32,320][988492] Updated weights for policy 0, policy_version 47840 (0.0006) [2023-03-10 11:40:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9830.4). Total num frames: 24518656. Throughput: 0: 9775.9. Samples: 24494096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:34,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:40:36,113][988492] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-10 11:40:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 24567808. Throughput: 0: 9769.4. Samples: 24555600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:39,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:40:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047984_24567808.pth... [2023-03-10 11:40:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047416_24276992.pth [2023-03-10 11:40:40,358][988492] Updated weights for policy 0, policy_version 48000 (0.0006) [2023-03-10 11:40:44,527][988492] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-10 11:40:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 24616960. Throughput: 0: 9810.8. Samples: 24615616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:44,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:40:48,549][988492] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-10 11:40:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 24670208. Throughput: 0: 9826.2. Samples: 24645740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:40:52,491][988492] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-10 11:40:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24719360. Throughput: 0: 9870.8. Samples: 24707144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:54,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:40:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048280_24719360.pth... [2023-03-10 11:40:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047696_24420352.pth [2023-03-10 11:40:56,625][988492] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-10 11:40:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24768512. Throughput: 0: 9845.6. Samples: 24766756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:40:59,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:41:00,835][988492] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-10 11:41:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 24817664. Throughput: 0: 9896.9. Samples: 24796060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:04,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:41:05,078][988492] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-10 11:41:09,103][988492] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-10 11:41:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 24866816. Throughput: 0: 9943.6. Samples: 24855716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:41:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048568_24866816.pth... [2023-03-10 11:41:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000047984_24567808.pth [2023-03-10 11:41:13,024][988492] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-10 11:41:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 24920064. Throughput: 0: 10022.5. Samples: 24916352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:14,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:41:17,164][988492] Updated weights for policy 0, policy_version 48720 (0.0004) [2023-03-10 11:41:19,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 24969216. Throughput: 0: 10053.0. Samples: 24946480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:41:21,156][988492] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-10 11:41:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 25018368. Throughput: 0: 10013.0. Samples: 25006184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:24,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:41:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048864_25018368.pth... [2023-03-10 11:41:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048280_24719360.pth [2023-03-10 11:41:25,303][988492] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-10 11:41:29,602][988492] Updated weights for policy 0, policy_version 48960 (0.0006) [2023-03-10 11:41:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9872.1). Total num frames: 25067520. Throughput: 0: 10008.2. Samples: 25065984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:29,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:41:33,710][988492] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-10 11:41:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 25116672. Throughput: 0: 9971.1. Samples: 25094440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:34,805][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:41:37,696][988492] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-10 11:41:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25169920. Throughput: 0: 9991.3. Samples: 25156752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:39,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:41:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049160_25169920.pth... [2023-03-10 11:41:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048568_24866816.pth [2023-03-10 11:41:41,797][988492] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-10 11:41:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25219072. Throughput: 0: 9988.5. Samples: 25216240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:44,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:41:46,072][988492] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-10 11:41:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 25268224. Throughput: 0: 9953.4. Samples: 25243964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:49,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:41:50,211][988492] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-10 11:41:54,381][988492] Updated weights for policy 0, policy_version 49440 (0.0005) [2023-03-10 11:41:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 25317376. Throughput: 0: 9957.3. Samples: 25303796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:41:54,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:41:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049448_25317376.pth... [2023-03-10 11:41:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000048864_25018368.pth [2023-03-10 11:41:58,109][988492] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-10 11:41:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25370624. Throughput: 0: 10005.3. Samples: 25366592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:41:59,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:42:02,121][988492] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-10 11:42:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25419776. Throughput: 0: 10024.0. Samples: 25397560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:04,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:42:06,204][988492] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-10 11:42:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25468928. Throughput: 0: 10065.9. Samples: 25459152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:09,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:42:09,815][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049752_25473024.pth... [2023-03-10 11:42:09,816][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049160_25169920.pth [2023-03-10 11:42:10,167][988492] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-10 11:42:14,090][988492] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-10 11:42:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 25522176. Throughput: 0: 10106.4. Samples: 25520772. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:14,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 11:42:18,175][988492] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-10 11:42:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 25571328. Throughput: 0: 10148.5. Samples: 25551120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:19,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:42:22,254][988492] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-10 11:42:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 25624576. Throughput: 0: 10124.4. Samples: 25612352. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:24,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:42:24,825][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050056_25628672.pth... [2023-03-10 11:42:24,827][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049448_25317376.pth [2023-03-10 11:42:26,061][988492] Updated weights for policy 0, policy_version 50080 (0.0005) [2023-03-10 11:42:29,804][988181] Fps is (10 sec: 10649.4, 60 sec: 10171.7, 300 sec: 9913.7). Total num frames: 25677824. Throughput: 0: 10165.2. Samples: 25673676. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:42:29,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 11:42:30,167][988492] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-10 11:42:34,171][988492] Updated weights for policy 0, policy_version 50240 (0.0004) [2023-03-10 11:42:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9913.7). Total num frames: 25726976. Throughput: 0: 10214.0. Samples: 25703596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:34,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:42:38,153][988492] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-10 11:42:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 25780224. Throughput: 0: 10270.2. Samples: 25765956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:39,805][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:42:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050352_25780224.pth... [2023-03-10 11:42:39,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000049752_25473024.pth [2023-03-10 11:42:42,293][988492] Updated weights for policy 0, policy_version 50400 (0.0004) [2023-03-10 11:42:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 25829376. Throughput: 0: 10193.1. Samples: 25825280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:44,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:42:46,225][988492] Updated weights for policy 0, policy_version 50480 (0.0005) [2023-03-10 11:42:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 9955.4). Total num frames: 25882624. Throughput: 0: 10219.6. Samples: 25857440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:49,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:42:49,958][988492] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-10 11:42:53,984][988492] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-10 11:42:54,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 9969.2). Total num frames: 25935872. Throughput: 0: 10253.1. Samples: 25920544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:54,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:42:54,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050656_25935872.pth... [2023-03-10 11:42:54,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050056_25628672.pth [2023-03-10 11:42:58,180][988492] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-10 11:42:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 25985024. Throughput: 0: 10225.7. Samples: 25980928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:42:59,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:43:02,102][988492] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-10 11:43:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 26034176. Throughput: 0: 10247.4. Samples: 26012256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:04,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:43:06,395][988492] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-10 11:43:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 26083328. Throughput: 0: 10180.3. Samples: 26070464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:09,815][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:43:09,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050944_26083328.pth... [2023-03-10 11:43:09,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050352_25780224.pth [2023-03-10 11:43:10,589][988492] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-10 11:43:14,661][988492] Updated weights for policy 0, policy_version 51040 (0.0004) [2023-03-10 11:43:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 9969.2). Total num frames: 26132480. Throughput: 0: 10106.8. Samples: 26128480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:14,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:43:18,971][988492] Updated weights for policy 0, policy_version 51120 (0.0006) [2023-03-10 11:43:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 26177536. Throughput: 0: 10078.5. Samples: 26157128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:19,815][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 11:43:23,249][988492] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-10 11:43:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 26226688. Throughput: 0: 9977.1. Samples: 26214924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:24,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 11:43:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051224_26226688.pth... [2023-03-10 11:43:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050656_25935872.pth [2023-03-10 11:43:27,373][988492] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-10 11:43:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 9955.4). Total num frames: 26275840. Throughput: 0: 10007.8. Samples: 26275628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:29,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:43:31,678][988492] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-10 11:43:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.3). Total num frames: 26324992. Throughput: 0: 9934.0. Samples: 26304468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:34,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:43:35,720][988492] Updated weights for policy 0, policy_version 51440 (0.0005) [2023-03-10 11:43:39,588][988492] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-10 11:43:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9967.0, 300 sec: 9983.1). Total num frames: 26378240. Throughput: 0: 9893.6. Samples: 26365756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:39,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:43:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051520_26378240.pth... [2023-03-10 11:43:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000050944_26083328.pth [2023-03-10 11:43:43,555][988492] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-10 11:43:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 26427392. Throughput: 0: 9914.5. Samples: 26427080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:44,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:43:47,682][988492] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-10 11:43:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 26480640. Throughput: 0: 9873.7. Samples: 26456572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:43:51,681][988492] Updated weights for policy 0, policy_version 51760 (0.0005) [2023-03-10 11:43:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 26529792. Throughput: 0: 9933.6. Samples: 26517476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:54,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:43:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051816_26529792.pth... [2023-03-10 11:43:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051224_26226688.pth [2023-03-10 11:43:55,720][988492] Updated weights for policy 0, policy_version 51840 (0.0004) [2023-03-10 11:43:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 26578944. Throughput: 0: 9979.9. Samples: 26577576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:43:59,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:43:59,981][988492] Updated weights for policy 0, policy_version 51920 (0.0005) [2023-03-10 11:44:04,040][988492] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-10 11:44:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 26628096. Throughput: 0: 10004.8. Samples: 26607344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:04,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:44:08,226][988492] Updated weights for policy 0, policy_version 52080 (0.0004) [2023-03-10 11:44:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 26677248. Throughput: 0: 10018.8. Samples: 26665768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:09,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:44:09,835][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052112_26681344.pth... [2023-03-10 11:44:09,836][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051520_26378240.pth [2023-03-10 11:44:12,224][988492] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-10 11:44:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 26730496. Throughput: 0: 10053.4. Samples: 26728032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:14,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:44:16,277][988492] Updated weights for policy 0, policy_version 52240 (0.0004) [2023-03-10 11:44:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 26779648. Throughput: 0: 10104.6. Samples: 26759176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:19,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:44:20,328][988492] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-10 11:44:24,383][988492] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-10 11:44:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.4, 300 sec: 10038.7). Total num frames: 26832896. Throughput: 0: 10073.5. Samples: 26819064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:24,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:44:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052408_26832896.pth... [2023-03-10 11:44:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000051816_26529792.pth [2023-03-10 11:44:28,693][988492] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-10 11:44:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 26877952. Throughput: 0: 9988.2. Samples: 26876548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:29,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:44:32,922][988492] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-10 11:44:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 26927104. Throughput: 0: 9964.1. Samples: 26904956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:34,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:44:36,902][988492] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-10 11:44:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 26980352. Throughput: 0: 9972.8. Samples: 26966252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:39,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:44:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052696_26980352.pth... [2023-03-10 11:44:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052112_26681344.pth [2023-03-10 11:44:40,915][988492] Updated weights for policy 0, policy_version 52720 (0.0005) [2023-03-10 11:44:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 27029504. Throughput: 0: 9952.1. Samples: 27025420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:44,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:44:45,134][988492] Updated weights for policy 0, policy_version 52800 (0.0005) [2023-03-10 11:44:49,368][988492] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-10 11:44:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 27078656. Throughput: 0: 9928.9. Samples: 27054144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:49,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:44:53,109][988492] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-10 11:44:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 27131904. Throughput: 0: 10059.8. Samples: 27118460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:54,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:44:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052992_27131904.pth... [2023-03-10 11:44:54,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052408_26832896.pth [2023-03-10 11:44:57,262][988492] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-10 11:44:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 27176960. Throughput: 0: 9974.7. Samples: 27176892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:44:59,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:45:01,678][988492] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-10 11:45:04,804][988181] Fps is (10 sec: 9011.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 27222016. Throughput: 0: 9870.3. Samples: 27203340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:45:04,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:45:06,052][988492] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-10 11:45:09,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 27275264. Throughput: 0: 9864.2. Samples: 27262952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:45:09,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:45:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053272_27275264.pth... [2023-03-10 11:45:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052696_26980352.pth [2023-03-10 11:45:09,973][988492] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-10 11:45:14,052][988492] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-10 11:45:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 27324416. Throughput: 0: 9942.5. Samples: 27323960. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:14,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:45:18,018][988492] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-10 11:45:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 27377664. Throughput: 0: 9976.9. Samples: 27353916. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:45:22,137][988492] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-10 11:45:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 27426816. Throughput: 0: 9960.0. Samples: 27414452. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:24,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:45:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053568_27426816.pth... [2023-03-10 11:45:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000052992_27131904.pth [2023-03-10 11:45:26,469][988492] Updated weights for policy 0, policy_version 53600 (0.0004) [2023-03-10 11:45:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 27475968. Throughput: 0: 9913.7. Samples: 27471536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:29,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:45:30,535][988492] Updated weights for policy 0, policy_version 53680 (0.0006) [2023-03-10 11:45:34,685][988492] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-10 11:45:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 27525120. Throughput: 0: 9921.6. Samples: 27500616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:34,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:45:38,758][988492] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-10 11:45:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 27574272. Throughput: 0: 9857.5. Samples: 27562048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:39,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:45:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053856_27574272.pth... [2023-03-10 11:45:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053272_27275264.pth [2023-03-10 11:45:42,806][988492] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-10 11:45:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 27623424. Throughput: 0: 9881.8. Samples: 27621572. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:45:44,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:45:46,893][988492] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-10 11:45:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 27676672. Throughput: 0: 9973.8. Samples: 27652160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:45:49,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:45:50,899][988492] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-10 11:45:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 27725824. Throughput: 0: 9977.1. Samples: 27711920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:45:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:45:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054152_27725824.pth... [2023-03-10 11:45:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053568_27426816.pth [2023-03-10 11:45:55,089][988492] Updated weights for policy 0, policy_version 54160 (0.0006) [2023-03-10 11:45:59,362][988492] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-10 11:45:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 27774976. Throughput: 0: 9931.0. Samples: 27770856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:45:59,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:46:03,557][988492] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-10 11:46:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 27824128. Throughput: 0: 9911.4. Samples: 27799928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:04,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:46:07,635][988492] Updated weights for policy 0, policy_version 54400 (0.0006) [2023-03-10 11:46:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 27869184. Throughput: 0: 9920.5. Samples: 27860872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:09,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:46:09,811][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054440_27873280.pth... [2023-03-10 11:46:09,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000053856_27574272.pth [2023-03-10 11:46:11,925][988492] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-10 11:46:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 27918336. Throughput: 0: 9890.3. Samples: 27916600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:14,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:46:16,298][988492] Updated weights for policy 0, policy_version 54560 (0.0004) [2023-03-10 11:46:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 27967488. Throughput: 0: 9860.6. Samples: 27944344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:19,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:46:20,672][988492] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-10 11:46:24,488][988492] Updated weights for policy 0, policy_version 54720 (0.0005) [2023-03-10 11:46:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 28016640. Throughput: 0: 9826.1. Samples: 28004224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:24,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:46:24,855][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054728_28020736.pth... [2023-03-10 11:46:24,858][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054152_27725824.pth [2023-03-10 11:46:28,494][988492] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-10 11:46:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 28065792. Throughput: 0: 9870.4. Samples: 28065740. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:29,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:46:32,731][988492] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-10 11:46:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 28119040. Throughput: 0: 9829.4. Samples: 28094484. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:46:36,903][988492] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-10 11:46:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9997.0). Total num frames: 28168192. Throughput: 0: 9857.3. Samples: 28155500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:39,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:46:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055016_28168192.pth... [2023-03-10 11:46:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054440_27873280.pth [2023-03-10 11:46:40,854][988492] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-10 11:46:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9997.0). Total num frames: 28217344. Throughput: 0: 9832.3. Samples: 28213312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:44,805][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:46:45,181][988492] Updated weights for policy 0, policy_version 55120 (0.0004) [2023-03-10 11:46:49,382][988492] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-10 11:46:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9983.1). Total num frames: 28262400. Throughput: 0: 9842.4. Samples: 28242836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:46:49,814][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:46:53,528][988492] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-10 11:46:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 28311552. Throughput: 0: 9794.8. Samples: 28301640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:54,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:46:54,842][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055304_28315648.pth... [2023-03-10 11:46:54,844][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000054728_28020736.pth [2023-03-10 11:46:57,707][988492] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-10 11:46:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 28360704. Throughput: 0: 9866.0. Samples: 28360568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:46:59,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:47:02,032][988492] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-10 11:47:04,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 28413952. Throughput: 0: 9885.5. Samples: 28389192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:04,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:47:06,055][988492] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-10 11:47:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9969.2). Total num frames: 28463104. Throughput: 0: 9907.0. Samples: 28450040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:09,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:47:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055592_28463104.pth... [2023-03-10 11:47:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055016_28168192.pth [2023-03-10 11:47:10,099][988492] Updated weights for policy 0, policy_version 55600 (0.0006) [2023-03-10 11:47:14,017][988492] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-10 11:47:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 28516352. Throughput: 0: 9922.6. Samples: 28512256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:14,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:47:18,103][988492] Updated weights for policy 0, policy_version 55760 (0.0004) [2023-03-10 11:47:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9969.3). Total num frames: 28565504. Throughput: 0: 9930.2. Samples: 28541344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:19,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:47:22,094][988492] Updated weights for policy 0, policy_version 55840 (0.0004) [2023-03-10 11:47:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 28614656. Throughput: 0: 9923.0. Samples: 28602036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:24,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:47:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055888_28614656.pth... [2023-03-10 11:47:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055304_28315648.pth [2023-03-10 11:47:26,245][988492] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-10 11:47:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 28663808. Throughput: 0: 9952.5. Samples: 28661172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:29,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 11:47:30,515][988492] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-10 11:47:34,312][988492] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-10 11:47:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 28717056. Throughput: 0: 9975.4. Samples: 28691732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:34,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:47:38,633][988492] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-10 11:47:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 28762112. Throughput: 0: 9992.9. Samples: 28751320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:39,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:47:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056176_28762112.pth... [2023-03-10 11:47:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055592_28463104.pth [2023-03-10 11:47:42,973][988492] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-10 11:47:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 28811264. Throughput: 0: 9964.7. Samples: 28808980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:44,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:47:47,153][988492] Updated weights for policy 0, policy_version 56320 (0.0004) [2023-03-10 11:47:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 28860416. Throughput: 0: 9971.5. Samples: 28837908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:49,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:47:51,370][988492] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-10 11:47:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 28909568. Throughput: 0: 9932.2. Samples: 28896988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:54,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:47:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056464_28909568.pth... [2023-03-10 11:47:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000055888_28614656.pth [2023-03-10 11:47:55,678][988492] Updated weights for policy 0, policy_version 56480 (0.0004) [2023-03-10 11:47:59,691][988492] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-10 11:47:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 28958720. Throughput: 0: 9840.2. Samples: 28955064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:47:59,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:48:03,829][988492] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-10 11:48:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 29007872. Throughput: 0: 9881.1. Samples: 28985996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:04,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:48:07,789][988492] Updated weights for policy 0, policy_version 56720 (0.0006) [2023-03-10 11:48:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 29057024. Throughput: 0: 9853.6. Samples: 29045448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 11:48:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056752_29057024.pth... [2023-03-10 11:48:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056176_28762112.pth [2023-03-10 11:48:12,109][988492] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-10 11:48:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 29106176. Throughput: 0: 9836.0. Samples: 29103792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:14,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:48:16,350][988492] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-10 11:48:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 29151232. Throughput: 0: 9769.1. Samples: 29131340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:19,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:48:20,836][988492] Updated weights for policy 0, policy_version 56960 (0.0006) [2023-03-10 11:48:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 29200384. Throughput: 0: 9714.9. Samples: 29188492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:24,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:48:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057032_29200384.pth... [2023-03-10 11:48:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056464_28909568.pth [2023-03-10 11:48:24,994][988492] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-10 11:48:29,227][988492] Updated weights for policy 0, policy_version 57120 (0.0005) [2023-03-10 11:48:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 29249536. Throughput: 0: 9714.4. Samples: 29246128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:29,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:48:33,392][988492] Updated weights for policy 0, policy_version 57200 (0.0006) [2023-03-10 11:48:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 29298688. Throughput: 0: 9738.0. Samples: 29276116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:34,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:48:37,499][988492] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-10 11:48:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 29347840. Throughput: 0: 9747.3. Samples: 29335616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:48:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057320_29347840.pth... [2023-03-10 11:48:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000056752_29057024.pth [2023-03-10 11:48:41,608][988492] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-10 11:48:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 29396992. Throughput: 0: 9792.9. Samples: 29395744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:44,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:48:45,690][988492] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-10 11:48:49,721][988492] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-10 11:48:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 29450240. Throughput: 0: 9769.5. Samples: 29425624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:48:53,940][988492] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-10 11:48:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9885.9). Total num frames: 29495296. Throughput: 0: 9791.0. Samples: 29486044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:54,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:48:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057616_29499392.pth... [2023-03-10 11:48:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057032_29200384.pth [2023-03-10 11:48:58,266][988492] Updated weights for policy 0, policy_version 57680 (0.0004) [2023-03-10 11:48:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 29544448. Throughput: 0: 9751.9. Samples: 29542628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:48:59,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:49:02,233][988492] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-10 11:49:04,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 29597696. Throughput: 0: 9836.2. Samples: 29573972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:49:06,388][988492] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-10 11:49:09,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 29646848. Throughput: 0: 9923.3. Samples: 29635040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:09,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:49:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057904_29646848.pth... [2023-03-10 11:49:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057320_29347840.pth [2023-03-10 11:49:10,343][988492] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-10 11:49:14,255][988492] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-10 11:49:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 29700096. Throughput: 0: 10009.0. Samples: 29696532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:14,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:49:18,355][988492] Updated weights for policy 0, policy_version 58080 (0.0006) [2023-03-10 11:49:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 29749248. Throughput: 0: 10018.6. Samples: 29726952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:19,804][988181] Avg episode reward: [(0, '10.111')] [2023-03-10 11:49:22,534][988492] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-10 11:49:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 29798400. Throughput: 0: 10009.3. Samples: 29786036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:24,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 11:49:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058200_29798400.pth... [2023-03-10 11:49:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057616_29499392.pth [2023-03-10 11:49:26,866][988492] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-10 11:49:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 29847552. Throughput: 0: 9955.4. Samples: 29843736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:29,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:49:30,920][988492] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-10 11:49:34,731][988492] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-10 11:49:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 29900800. Throughput: 0: 10013.5. Samples: 29876232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:34,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:49:38,653][988492] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-10 11:49:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 29949952. Throughput: 0: 10037.7. Samples: 29937740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:39,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 11:49:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058496_29949952.pth... [2023-03-10 11:49:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000057904_29646848.pth [2023-03-10 11:49:42,973][988492] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-10 11:49:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 29999104. Throughput: 0: 10066.8. Samples: 29995636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:44,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 11:49:47,289][988492] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-10 11:49:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 30048256. Throughput: 0: 9995.1. Samples: 30023752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:49,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:49:51,335][988492] Updated weights for policy 0, policy_version 58720 (0.0006) [2023-03-10 11:49:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 30097408. Throughput: 0: 9999.1. Samples: 30085000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:54,815][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:49:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058784_30097408.pth... [2023-03-10 11:49:54,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058200_29798400.pth [2023-03-10 11:49:55,410][988492] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-10 11:49:59,440][988492] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-10 11:49:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 30146560. Throughput: 0: 9995.6. Samples: 30146332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:49:59,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:50:03,340][988492] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-10 11:50:04,804][988181] Fps is (10 sec: 10649.8, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 30203904. Throughput: 0: 10017.1. Samples: 30177720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:50:04,804][988181] Avg episode reward: [(0, '10.100')] [2023-03-10 11:50:07,464][988492] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-10 11:50:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 30248960. Throughput: 0: 10015.6. Samples: 30236736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:50:09,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 11:50:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059080_30248960.pth... [2023-03-10 11:50:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058496_29949952.pth [2023-03-10 11:50:11,648][988492] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-10 11:50:14,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 30298112. Throughput: 0: 10046.4. Samples: 30295824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:50:14,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:50:15,764][988492] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-10 11:50:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 30347264. Throughput: 0: 9974.3. Samples: 30325072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:50:19,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 11:50:19,906][988492] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-10 11:50:24,025][988492] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-10 11:50:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 30396416. Throughput: 0: 9951.1. Samples: 30385540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:50:24,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:50:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059368_30396416.pth... [2023-03-10 11:50:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000058784_30097408.pth [2023-03-10 11:50:28,182][988492] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-10 11:50:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 30445568. Throughput: 0: 9967.9. Samples: 30444192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:29,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:50:32,507][988492] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-10 11:50:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 30494720. Throughput: 0: 9977.9. Samples: 30472756. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:34,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:50:36,816][988492] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-10 11:50:39,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 30543872. Throughput: 0: 9918.2. Samples: 30531320. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:39,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:50:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059656_30543872.pth... [2023-03-10 11:50:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059080_30248960.pth [2023-03-10 11:50:40,838][988492] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-10 11:50:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 30593024. Throughput: 0: 9843.4. Samples: 30589288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:44,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:50:45,162][988492] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-10 11:50:49,364][988492] Updated weights for policy 0, policy_version 59840 (0.0005) [2023-03-10 11:50:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 30638080. Throughput: 0: 9775.1. Samples: 30617600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:49,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 11:50:53,732][988492] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-10 11:50:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 30687232. Throughput: 0: 9740.6. Samples: 30675064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:54,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 11:50:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059936_30687232.pth... [2023-03-10 11:50:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059368_30396416.pth [2023-03-10 11:50:57,895][988492] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-10 11:50:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 30736384. Throughput: 0: 9741.9. Samples: 30734208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:50:59,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:51:02,143][988492] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-10 11:51:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 30785536. Throughput: 0: 9732.7. Samples: 30763044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 11:51:04,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:51:06,358][988492] Updated weights for policy 0, policy_version 60160 (0.0004) [2023-03-10 11:51:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 30834688. Throughput: 0: 9709.6. Samples: 30822472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:09,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:51:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060224_30834688.pth... [2023-03-10 11:51:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059656_30543872.pth [2023-03-10 11:51:10,460][988492] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-10 11:51:14,796][988492] Updated weights for policy 0, policy_version 60320 (0.0004) [2023-03-10 11:51:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 30883840. Throughput: 0: 9678.7. Samples: 30879736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:14,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:51:19,038][988492] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-10 11:51:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 30928896. Throughput: 0: 9664.7. Samples: 30907668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:51:23,401][988492] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-10 11:51:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 30978048. Throughput: 0: 9653.3. Samples: 30965716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:24,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:51:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060504_30978048.pth... [2023-03-10 11:51:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000059936_30687232.pth [2023-03-10 11:51:27,532][988492] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-10 11:51:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.8, 300 sec: 9858.2). Total num frames: 31027200. Throughput: 0: 9696.8. Samples: 31025644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:29,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:51:31,589][988492] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-10 11:51:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 31076352. Throughput: 0: 9734.1. Samples: 31055636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:34,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:51:35,747][988492] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-10 11:51:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 31125504. Throughput: 0: 9738.1. Samples: 31113280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:51:39,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:51:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060792_31125504.pth... [2023-03-10 11:51:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060224_30834688.pth [2023-03-10 11:51:39,909][988492] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-10 11:51:44,322][988492] Updated weights for policy 0, policy_version 60880 (0.0004) [2023-03-10 11:51:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9872.0). Total num frames: 31174656. Throughput: 0: 9697.0. Samples: 31170572. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:51:44,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:51:48,204][988492] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-10 11:51:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 31223808. Throughput: 0: 9775.7. Samples: 31202948. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:51:49,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:51:52,415][988492] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-10 11:51:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 31272960. Throughput: 0: 9740.9. Samples: 31260812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:51:54,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:51:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061080_31272960.pth... [2023-03-10 11:51:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060504_30978048.pth [2023-03-10 11:51:56,685][988492] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-10 11:51:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 31322112. Throughput: 0: 9774.3. Samples: 31319580. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:51:59,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:52:00,887][988492] Updated weights for policy 0, policy_version 61200 (0.0006) [2023-03-10 11:52:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 31367168. Throughput: 0: 9764.4. Samples: 31347064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:52:04,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:52:05,230][988492] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-10 11:52:09,393][988492] Updated weights for policy 0, policy_version 61360 (0.0006) [2023-03-10 11:52:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 31416320. Throughput: 0: 9798.5. Samples: 31406648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:52:09,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:52:09,841][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061368_31420416.pth... [2023-03-10 11:52:09,843][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000060792_31125504.pth [2023-03-10 11:52:13,571][988492] Updated weights for policy 0, policy_version 61440 (0.0006) [2023-03-10 11:52:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 31465472. Throughput: 0: 9771.2. Samples: 31465348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:52:14,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:52:17,709][988492] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-10 11:52:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 31518720. Throughput: 0: 9746.0. Samples: 31494208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:52:19,815][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:52:21,919][988492] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-10 11:52:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 31563776. Throughput: 0: 9771.8. Samples: 31553008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:24,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:52:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061648_31563776.pth... [2023-03-10 11:52:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061080_31272960.pth [2023-03-10 11:52:26,045][988492] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-10 11:52:29,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9762.2, 300 sec: 9816.5). Total num frames: 31612928. Throughput: 0: 9827.8. Samples: 31612820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:29,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 11:52:30,233][988492] Updated weights for policy 0, policy_version 61760 (0.0004) [2023-03-10 11:52:34,494][988492] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-10 11:52:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 31662080. Throughput: 0: 9745.4. Samples: 31641492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:52:38,472][988492] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-10 11:52:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9830.4). Total num frames: 31711232. Throughput: 0: 9813.1. Samples: 31702400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:39,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:52:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061936_31711232.pth... [2023-03-10 11:52:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061368_31420416.pth [2023-03-10 11:52:42,682][988492] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-10 11:52:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 31764480. Throughput: 0: 9803.6. Samples: 31760744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:52:46,742][988492] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-10 11:52:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 31813632. Throughput: 0: 9869.4. Samples: 31791184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:49,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 11:52:50,705][988492] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-10 11:52:54,555][988492] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-10 11:52:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 31866880. Throughput: 0: 9954.3. Samples: 31854592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:52:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062240_31866880.pth... [2023-03-10 11:52:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061648_31563776.pth [2023-03-10 11:52:58,713][988492] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-10 11:52:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 31916032. Throughput: 0: 9961.6. Samples: 31913620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:52:59,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 11:53:02,695][988492] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-10 11:53:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9872.1). Total num frames: 31969280. Throughput: 0: 10025.8. Samples: 31945368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:04,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:53:06,785][988492] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-10 11:53:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9872.1). Total num frames: 32018432. Throughput: 0: 10040.5. Samples: 32004832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:09,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:53:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062536_32018432.pth... [2023-03-10 11:53:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000061936_31711232.pth [2023-03-10 11:53:11,019][988492] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-10 11:53:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 32067584. Throughput: 0: 10085.8. Samples: 32066680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:14,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:53:14,936][988492] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-10 11:53:19,188][988492] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-10 11:53:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9885.9). Total num frames: 32116736. Throughput: 0: 10101.3. Samples: 32096048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:19,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 11:53:23,564][988492] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-10 11:53:24,804][988181] Fps is (10 sec: 9830.2, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 32165888. Throughput: 0: 9974.8. Samples: 32151268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:24,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 11:53:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062824_32165888.pth... [2023-03-10 11:53:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062240_31866880.pth [2023-03-10 11:53:27,473][988492] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-10 11:53:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 32215040. Throughput: 0: 10048.0. Samples: 32212904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:29,804][988181] Avg episode reward: [(0, '10.103')] [2023-03-10 11:53:31,620][988492] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-10 11:53:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 32268288. Throughput: 0: 10055.9. Samples: 32243700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:53:34,804][988181] Avg episode reward: [(0, '10.104')] [2023-03-10 11:53:35,413][988492] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-10 11:53:39,481][988492] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-10 11:53:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 32317440. Throughput: 0: 10034.7. Samples: 32306152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:53:39,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 11:53:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063120_32317440.pth... [2023-03-10 11:53:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062536_32018432.pth [2023-03-10 11:53:43,607][988492] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-10 11:53:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 32366592. Throughput: 0: 10061.0. Samples: 32366364. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:53:44,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:53:47,686][988492] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-10 11:53:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 32415744. Throughput: 0: 10002.4. Samples: 32395476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:53:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 11:53:52,091][988492] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-10 11:53:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 32464896. Throughput: 0: 9950.8. Samples: 32452616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:53:54,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:53:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063408_32464896.pth... [2023-03-10 11:53:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000062824_32165888.pth [2023-03-10 11:53:56,117][988492] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-10 11:53:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 32514048. Throughput: 0: 9908.1. Samples: 32512544. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:53:59,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:54:00,294][988492] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-10 11:54:04,382][988492] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-10 11:54:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 32563200. Throughput: 0: 9932.7. Samples: 32543020. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:54:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:54:08,525][988492] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-10 11:54:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 32612352. Throughput: 0: 10039.2. Samples: 32603032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:54:09,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:54:09,831][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063704_32616448.pth... [2023-03-10 11:54:09,833][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063120_32317440.pth [2023-03-10 11:54:12,792][988492] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-10 11:54:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 32661504. Throughput: 0: 9939.9. Samples: 32660200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 11:54:14,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:54:16,932][988492] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-10 11:54:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 32710656. Throughput: 0: 9921.7. Samples: 32690176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:19,814][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 11:54:21,031][988492] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-10 11:54:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 32763904. Throughput: 0: 9870.8. Samples: 32750340. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:24,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:54:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063992_32763904.pth... [2023-03-10 11:54:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063408_32464896.pth [2023-03-10 11:54:25,100][988492] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-10 11:54:29,102][988492] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-10 11:54:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9872.1). Total num frames: 32813056. Throughput: 0: 9893.3. Samples: 32811560. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:29,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:54:32,922][988492] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-10 11:54:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 32866304. Throughput: 0: 9955.5. Samples: 32843476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:34,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:54:37,026][988492] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-10 11:54:39,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 32915456. Throughput: 0: 10021.8. Samples: 32903596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:54:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064288_32915456.pth... [2023-03-10 11:54:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063704_32616448.pth [2023-03-10 11:54:41,216][988492] Updated weights for policy 0, policy_version 64320 (0.0006) [2023-03-10 11:54:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 32964608. Throughput: 0: 10028.7. Samples: 32963836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 11:54:45,207][988492] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-10 11:54:49,331][988492] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-10 11:54:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 33013760. Throughput: 0: 10033.7. Samples: 32994536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:49,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:54:53,767][988492] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-10 11:54:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 33062912. Throughput: 0: 9947.9. Samples: 33050688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:54:54,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 11:54:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064576_33062912.pth... [2023-03-10 11:54:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000063992_32763904.pth [2023-03-10 11:54:58,007][988492] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-10 11:54:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 33112064. Throughput: 0: 9982.0. Samples: 33109392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:54:59,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:55:01,762][988492] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-10 11:55:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 33165312. Throughput: 0: 10048.2. Samples: 33142344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:04,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:55:05,891][988492] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-10 11:55:09,687][988492] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-10 11:55:09,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 33218560. Throughput: 0: 10089.0. Samples: 33204344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:09,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:55:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064880_33218560.pth... [2023-03-10 11:55:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064288_32915456.pth [2023-03-10 11:55:13,618][988492] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-10 11:55:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 33267712. Throughput: 0: 10107.2. Samples: 33266384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:14,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 11:55:17,975][988492] Updated weights for policy 0, policy_version 65040 (0.0004) [2023-03-10 11:55:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9899.8). Total num frames: 33316864. Throughput: 0: 10028.1. Samples: 33294740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:19,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:55:22,205][988492] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-10 11:55:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 33366016. Throughput: 0: 9998.1. Samples: 33353508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:24,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:55:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065168_33366016.pth... [2023-03-10 11:55:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064576_33062912.pth [2023-03-10 11:55:26,491][988492] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-10 11:55:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 33411072. Throughput: 0: 9929.2. Samples: 33410652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:29,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:55:30,657][988492] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-10 11:55:34,738][988492] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-10 11:55:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 33464320. Throughput: 0: 9894.9. Samples: 33439808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:34,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:55:38,791][988492] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-10 11:55:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 33513472. Throughput: 0: 10011.0. Samples: 33501184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:39,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:55:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065456_33513472.pth... [2023-03-10 11:55:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000064880_33218560.pth [2023-03-10 11:55:42,640][988492] Updated weights for policy 0, policy_version 65520 (0.0005) [2023-03-10 11:55:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 33566720. Throughput: 0: 10093.4. Samples: 33563596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:44,804][988181] Avg episode reward: [(0, '10.108')] [2023-03-10 11:55:46,718][988492] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-10 11:55:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 33611776. Throughput: 0: 10000.3. Samples: 33592356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:49,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:55:51,050][988492] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-10 11:55:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 33665024. Throughput: 0: 9938.8. Samples: 33651592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:54,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:55:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065752_33665024.pth... [2023-03-10 11:55:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065168_33366016.pth [2023-03-10 11:55:55,224][988492] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-10 11:55:59,492][988492] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-10 11:55:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 33710080. Throughput: 0: 9834.8. Samples: 33708948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:55:59,804][988181] Avg episode reward: [(0, '10.106')] [2023-03-10 11:56:03,483][988492] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-10 11:56:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 33763328. Throughput: 0: 9886.8. Samples: 33739644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:04,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:56:07,568][988492] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-10 11:56:09,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 33812480. Throughput: 0: 9926.5. Samples: 33800200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:09,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 11:56:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066040_33812480.pth... [2023-03-10 11:56:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065456_33513472.pth [2023-03-10 11:56:11,467][988492] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-10 11:56:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 33861632. Throughput: 0: 10019.1. Samples: 33861512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:56:15,516][988492] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-10 11:56:19,636][988492] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-10 11:56:19,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 33914880. Throughput: 0: 10055.1. Samples: 33892288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:19,812][988181] Avg episode reward: [(0, '10.108')] [2023-03-10 11:56:23,668][988492] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-10 11:56:24,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 33964032. Throughput: 0: 10014.1. Samples: 33951816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:24,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:56:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066336_33964032.pth... [2023-03-10 11:56:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000065752_33665024.pth [2023-03-10 11:56:27,879][988492] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-10 11:56:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 34013184. Throughput: 0: 9958.3. Samples: 34011720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:29,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:56:32,238][988492] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-10 11:56:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 34058240. Throughput: 0: 9912.9. Samples: 34038436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:34,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:56:36,528][988492] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-10 11:56:39,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 34107392. Throughput: 0: 9857.3. Samples: 34095168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 11:56:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066616_34107392.pth... [2023-03-10 11:56:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066040_33812480.pth [2023-03-10 11:56:40,620][988492] Updated weights for policy 0, policy_version 66640 (0.0006) [2023-03-10 11:56:44,697][988492] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-10 11:56:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 34160640. Throughput: 0: 9946.7. Samples: 34156552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:44,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:56:48,705][988492] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-10 11:56:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 34209792. Throughput: 0: 9954.3. Samples: 34187588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:49,805][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 11:56:52,824][988492] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-10 11:56:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 34258944. Throughput: 0: 9932.2. Samples: 34247148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:54,804][988181] Avg episode reward: [(0, '10.104')] [2023-03-10 11:56:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066912_34258944.pth... [2023-03-10 11:56:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066336_33964032.pth [2023-03-10 11:56:56,925][988492] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-10 11:56:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 34312192. Throughput: 0: 9923.9. Samples: 34308088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:56:59,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 11:57:00,847][988492] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-10 11:57:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 34361344. Throughput: 0: 9953.7. Samples: 34340204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:04,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 11:57:04,984][988492] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-10 11:57:09,054][988492] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-10 11:57:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 34410496. Throughput: 0: 9933.2. Samples: 34398812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:09,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:57:09,844][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067216_34414592.pth... [2023-03-10 11:57:09,846][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066616_34107392.pth [2023-03-10 11:57:13,291][988492] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-10 11:57:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 34459648. Throughput: 0: 9911.0. Samples: 34457716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:14,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:57:17,430][988492] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-10 11:57:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 34508800. Throughput: 0: 9990.1. Samples: 34487992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:19,805][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:57:21,714][988492] Updated weights for policy 0, policy_version 67440 (0.0006) [2023-03-10 11:57:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9983.1). Total num frames: 34557952. Throughput: 0: 10011.0. Samples: 34545664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:24,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 11:57:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067496_34557952.pth... [2023-03-10 11:57:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000066912_34258944.pth [2023-03-10 11:57:25,807][988492] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-10 11:57:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 34607104. Throughput: 0: 9983.0. Samples: 34605788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:29,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:57:29,941][988492] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-10 11:57:34,341][988492] Updated weights for policy 0, policy_version 67680 (0.0004) [2023-03-10 11:57:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 34656256. Throughput: 0: 9876.0. Samples: 34632008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 11:57:38,842][988492] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-10 11:57:39,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.6, 300 sec: 9955.4). Total num frames: 34701312. Throughput: 0: 9819.0. Samples: 34689004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:57:39,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:57:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067776_34701312.pth... [2023-03-10 11:57:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067216_34414592.pth [2023-03-10 11:57:42,887][988492] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-10 11:57:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 34750464. Throughput: 0: 9805.7. Samples: 34749344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:57:44,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:57:47,070][988492] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-10 11:57:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 34799616. Throughput: 0: 9736.7. Samples: 34778356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:57:49,811][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:57:50,985][988492] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-10 11:57:54,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 34852864. Throughput: 0: 9822.1. Samples: 34840804. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:57:54,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 11:57:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068072_34852864.pth... [2023-03-10 11:57:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067496_34557952.pth [2023-03-10 11:57:54,933][988492] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-10 11:57:59,142][988492] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-10 11:57:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 34902016. Throughput: 0: 9825.7. Samples: 34899872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:57:59,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:58:03,456][988492] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-10 11:58:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 34951168. Throughput: 0: 9798.8. Samples: 34928940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:58:04,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:58:07,696][988492] Updated weights for policy 0, policy_version 68320 (0.0004) [2023-03-10 11:58:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 35000320. Throughput: 0: 9796.5. Samples: 34986504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:58:09,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:58:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068360_35000320.pth... [2023-03-10 11:58:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000067776_34701312.pth [2023-03-10 11:58:11,870][988492] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-10 11:58:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 35045376. Throughput: 0: 9765.7. Samples: 35045244. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:58:14,815][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 11:58:16,085][988492] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-10 11:58:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 35098624. Throughput: 0: 9842.0. Samples: 35074900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 11:58:19,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 11:58:20,058][988492] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-10 11:58:24,136][988492] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-10 11:58:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 35147776. Throughput: 0: 9923.5. Samples: 35135560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:24,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 11:58:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068656_35151872.pth... [2023-03-10 11:58:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068072_34852864.pth [2023-03-10 11:58:28,007][988492] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-10 11:58:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 35201024. Throughput: 0: 9981.8. Samples: 35198524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:29,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:58:31,922][988492] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-10 11:58:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 35250176. Throughput: 0: 10029.8. Samples: 35229696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:34,804][988181] Avg episode reward: [(0, '10.103')] [2023-03-10 11:58:36,245][988492] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-10 11:58:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35299328. Throughput: 0: 9917.7. Samples: 35287104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:39,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 11:58:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068944_35299328.pth... [2023-03-10 11:58:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068360_35000320.pth [2023-03-10 11:58:40,611][988492] Updated weights for policy 0, policy_version 68960 (0.0006) [2023-03-10 11:58:44,737][988492] Updated weights for policy 0, policy_version 69040 (0.0006) [2023-03-10 11:58:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35348480. Throughput: 0: 9879.5. Samples: 35344448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:44,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 11:58:48,788][988492] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-10 11:58:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35397632. Throughput: 0: 9933.9. Samples: 35375964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:49,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:58:52,774][988492] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-10 11:58:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 35450880. Throughput: 0: 9989.0. Samples: 35436012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:54,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 11:58:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069240_35450880.pth... [2023-03-10 11:58:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068656_35151872.pth [2023-03-10 11:58:56,791][988492] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-10 11:58:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 35500032. Throughput: 0: 10018.4. Samples: 35496072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:58:59,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 11:59:00,958][988492] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-10 11:59:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 35545088. Throughput: 0: 10003.4. Samples: 35525052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:59:04,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 11:59:05,367][988492] Updated weights for policy 0, policy_version 69440 (0.0004) [2023-03-10 11:59:09,330][988492] Updated weights for policy 0, policy_version 69520 (0.0006) [2023-03-10 11:59:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 35598336. Throughput: 0: 9966.3. Samples: 35584044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:09,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 11:59:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069528_35598336.pth... [2023-03-10 11:59:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000068944_35299328.pth [2023-03-10 11:59:13,287][988492] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-10 11:59:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 35647488. Throughput: 0: 9938.1. Samples: 35645740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:14,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 11:59:17,440][988492] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-10 11:59:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35696640. Throughput: 0: 9913.5. Samples: 35675804. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:19,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 11:59:21,561][988492] Updated weights for policy 0, policy_version 69760 (0.0006) [2023-03-10 11:59:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35745792. Throughput: 0: 9920.2. Samples: 35733512. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:24,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 11:59:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069816_35745792.pth... [2023-03-10 11:59:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069240_35450880.pth [2023-03-10 11:59:25,678][988492] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-10 11:59:29,559][988492] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-10 11:59:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 35799040. Throughput: 0: 10031.6. Samples: 35795872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:29,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 11:59:33,496][988492] Updated weights for policy 0, policy_version 70000 (0.0004) [2023-03-10 11:59:34,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 35852288. Throughput: 0: 10039.0. Samples: 35827720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:34,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 11:59:37,579][988492] Updated weights for policy 0, policy_version 70080 (0.0004) [2023-03-10 11:59:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 35901440. Throughput: 0: 10068.8. Samples: 35889108. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:39,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:59:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070120_35901440.pth... [2023-03-10 11:59:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069528_35598336.pth [2023-03-10 11:59:41,666][988492] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-10 11:59:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 35950592. Throughput: 0: 10052.0. Samples: 35948412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 11:59:44,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 11:59:45,755][988492] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-10 11:59:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 35999744. Throughput: 0: 10046.1. Samples: 35977128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:59:49,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 11:59:50,121][988492] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-10 11:59:53,951][988492] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-10 11:59:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 36052992. Throughput: 0: 10106.8. Samples: 36038848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:59:54,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 11:59:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070416_36052992.pth... [2023-03-10 11:59:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000069816_35745792.pth [2023-03-10 11:59:58,041][988492] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-10 11:59:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 36102144. Throughput: 0: 10065.8. Samples: 36098704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 11:59:59,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:00:02,152][988492] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-10 12:00:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 36151296. Throughput: 0: 10065.5. Samples: 36128752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:04,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:00:06,204][988492] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-10 12:00:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 36200448. Throughput: 0: 10104.7. Samples: 36188224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:09,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:00:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070704_36200448.pth... [2023-03-10 12:00:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070120_35901440.pth [2023-03-10 12:00:10,456][988492] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-10 12:00:14,384][988492] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-10 12:00:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 9955.4). Total num frames: 36253696. Throughput: 0: 10082.4. Samples: 36249580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:14,805][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:00:18,561][988492] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-10 12:00:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 36302848. Throughput: 0: 10046.2. Samples: 36279800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:19,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:00:22,661][988492] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-10 12:00:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 9969.2). Total num frames: 36352000. Throughput: 0: 9990.4. Samples: 36338676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:24,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:00:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071000_36352000.pth... [2023-03-10 12:00:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070416_36052992.pth [2023-03-10 12:00:26,947][988492] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-10 12:00:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 36397056. Throughput: 0: 9962.8. Samples: 36396740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:29,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:00:31,230][988492] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-10 12:00:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 36446208. Throughput: 0: 9947.7. Samples: 36424772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:34,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:00:35,357][988492] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-10 12:00:39,399][988492] Updated weights for policy 0, policy_version 71280 (0.0004) [2023-03-10 12:00:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 36495360. Throughput: 0: 9900.3. Samples: 36484360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:39,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:00:39,830][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071288_36499456.pth... [2023-03-10 12:00:39,832][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000070704_36200448.pth [2023-03-10 12:00:43,676][988492] Updated weights for policy 0, policy_version 71360 (0.0004) [2023-03-10 12:00:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 36548608. Throughput: 0: 9907.0. Samples: 36544520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:44,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:00:47,731][988492] Updated weights for policy 0, policy_version 71440 (0.0004) [2023-03-10 12:00:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 36593664. Throughput: 0: 9882.4. Samples: 36573460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:49,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 12:00:51,789][988492] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-10 12:00:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 36646912. Throughput: 0: 9892.4. Samples: 36633384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:54,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:00:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071576_36646912.pth... [2023-03-10 12:00:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071000_36352000.pth [2023-03-10 12:00:55,778][988492] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-10 12:00:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 36696064. Throughput: 0: 9892.2. Samples: 36694728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:00:59,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:00:59,911][988492] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-10 12:01:04,271][988492] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-10 12:01:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 36745216. Throughput: 0: 9869.0. Samples: 36723904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:04,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:01:08,434][988492] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-10 12:01:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 36794368. Throughput: 0: 9840.7. Samples: 36781504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:09,804][988181] Avg episode reward: [(0, '10.110')] [2023-03-10 12:01:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071864_36794368.pth... [2023-03-10 12:01:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071288_36499456.pth [2023-03-10 12:01:12,412][988492] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-10 12:01:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 36847616. Throughput: 0: 9958.7. Samples: 36844884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:14,804][988181] Avg episode reward: [(0, '10.108')] [2023-03-10 12:01:16,296][988492] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-10 12:01:19,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 36900864. Throughput: 0: 10033.9. Samples: 36876296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:19,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 12:01:19,999][988492] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-10 12:01:24,032][988492] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-10 12:01:24,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 36950016. Throughput: 0: 10121.7. Samples: 36939836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:24,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:01:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072176_36954112.pth... [2023-03-10 12:01:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071576_36646912.pth [2023-03-10 12:01:27,926][988492] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-10 12:01:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 37003264. Throughput: 0: 10105.9. Samples: 36999284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:29,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:01:32,140][988492] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-10 12:01:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 37052416. Throughput: 0: 10153.4. Samples: 37030360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:34,814][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:01:36,065][988492] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-10 12:01:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 37105664. Throughput: 0: 10213.1. Samples: 37092972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:39,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:01:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072472_37105664.pth... [2023-03-10 12:01:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000071864_36794368.pth [2023-03-10 12:01:40,159][988492] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-10 12:01:44,380][988492] Updated weights for policy 0, policy_version 72560 (0.0004) [2023-03-10 12:01:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 37154816. Throughput: 0: 10131.9. Samples: 37150664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:44,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:01:48,589][988492] Updated weights for policy 0, policy_version 72640 (0.0004) [2023-03-10 12:01:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 37203968. Throughput: 0: 10142.8. Samples: 37180328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:01:52,615][988492] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-10 12:01:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 37249024. Throughput: 0: 10176.8. Samples: 37239460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:54,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:01:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072752_37249024.pth... [2023-03-10 12:01:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072176_36954112.pth [2023-03-10 12:01:57,008][988492] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-10 12:01:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 9969.2). Total num frames: 37302272. Throughput: 0: 10073.3. Samples: 37298184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:01:59,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:02:00,938][988492] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-10 12:02:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 37347328. Throughput: 0: 10029.9. Samples: 37327640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:04,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:02:05,279][988492] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-10 12:02:09,229][988492] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-10 12:02:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 9969.2). Total num frames: 37400576. Throughput: 0: 9965.8. Samples: 37388300. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:09,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:02:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073048_37400576.pth... [2023-03-10 12:02:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072472_37105664.pth [2023-03-10 12:02:13,585][988492] Updated weights for policy 0, policy_version 73120 (0.0004) [2023-03-10 12:02:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9955.4). Total num frames: 37445632. Throughput: 0: 9904.6. Samples: 37444988. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:14,815][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:02:17,686][988492] Updated weights for policy 0, policy_version 73200 (0.0006) [2023-03-10 12:02:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.3). Total num frames: 37498880. Throughput: 0: 9871.2. Samples: 37474564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:19,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:02:21,759][988492] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-10 12:02:24,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 37548032. Throughput: 0: 9837.5. Samples: 37535660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:24,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:02:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073336_37548032.pth... [2023-03-10 12:02:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000072752_37249024.pth [2023-03-10 12:02:25,718][988492] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-10 12:02:29,547][988492] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-10 12:02:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 37601280. Throughput: 0: 9969.7. Samples: 37599300. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:29,804][988181] Avg episode reward: [(0, '10.110')] [2023-03-10 12:02:33,588][988492] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-10 12:02:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 37650432. Throughput: 0: 9989.3. Samples: 37629848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:02:37,846][988492] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-10 12:02:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 37699584. Throughput: 0: 9953.3. Samples: 37687360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:39,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:02:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073632_37699584.pth... [2023-03-10 12:02:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073048_37400576.pth [2023-03-10 12:02:41,909][988492] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-10 12:02:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 37748736. Throughput: 0: 10010.6. Samples: 37748660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:02:44,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:02:46,234][988492] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-10 12:02:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 37797888. Throughput: 0: 9986.3. Samples: 37777024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:02:49,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:02:50,387][988492] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-10 12:02:54,497][988492] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-10 12:02:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 37847040. Throughput: 0: 9953.0. Samples: 37836184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:02:54,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:02:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073920_37847040.pth... [2023-03-10 12:02:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073336_37548032.pth [2023-03-10 12:02:58,654][988492] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-10 12:02:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 37896192. Throughput: 0: 10013.0. Samples: 37895572. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:02:59,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:03:02,456][988492] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-10 12:03:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 37949440. Throughput: 0: 10063.9. Samples: 37927440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:04,815][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:03:06,561][988492] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-10 12:03:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 37998592. Throughput: 0: 10014.5. Samples: 37986312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:09,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:03:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074216_37998592.pth... [2023-03-10 12:03:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073632_37699584.pth [2023-03-10 12:03:10,763][988492] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-10 12:03:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 38047744. Throughput: 0: 9880.6. Samples: 38043928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:14,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:03:15,177][988492] Updated weights for policy 0, policy_version 74320 (0.0004) [2023-03-10 12:03:19,716][988492] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-10 12:03:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 38092800. Throughput: 0: 9819.2. Samples: 38071712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:19,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:03:23,575][988492] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-10 12:03:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 38141952. Throughput: 0: 9857.0. Samples: 38130924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:24,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:03:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074496_38141952.pth... [2023-03-10 12:03:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000073920_37847040.pth [2023-03-10 12:03:27,874][988492] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-10 12:03:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9969.3). Total num frames: 38191104. Throughput: 0: 9790.1. Samples: 38189212. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:03:29,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:03:32,006][988492] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-10 12:03:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9969.3). Total num frames: 38240256. Throughput: 0: 9834.4. Samples: 38219572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:34,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:03:35,935][988492] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-10 12:03:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 38289408. Throughput: 0: 9870.8. Samples: 38280368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:39,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:03:39,811][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074792_38293504.pth... [2023-03-10 12:03:39,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074216_37998592.pth [2023-03-10 12:03:40,271][988492] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-10 12:03:44,536][988492] Updated weights for policy 0, policy_version 74880 (0.0004) [2023-03-10 12:03:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 38338560. Throughput: 0: 9810.2. Samples: 38337032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:44,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:03:49,001][988492] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-10 12:03:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 38387712. Throughput: 0: 9721.1. Samples: 38364888. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:49,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:03:52,986][988492] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-10 12:03:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 38436864. Throughput: 0: 9736.1. Samples: 38424436. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:54,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:03:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075072_38436864.pth... [2023-03-10 12:03:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074496_38141952.pth [2023-03-10 12:03:56,849][988492] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-10 12:03:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 9983.1). Total num frames: 38490112. Throughput: 0: 9824.0. Samples: 38486008. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:03:59,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:04:00,964][988492] Updated weights for policy 0, policy_version 75200 (0.0006) [2023-03-10 12:04:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 38535168. Throughput: 0: 9845.3. Samples: 38514752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:04:04,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:04:05,189][988492] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-10 12:04:09,210][988492] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-10 12:04:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 38588416. Throughput: 0: 9881.7. Samples: 38575600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:04:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:04:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075368_38588416.pth... [2023-03-10 12:04:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000074792_38293504.pth [2023-03-10 12:04:13,516][988492] Updated weights for policy 0, policy_version 75440 (0.0004) [2023-03-10 12:04:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 38633472. Throughput: 0: 9870.4. Samples: 38633380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:04:14,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:04:17,728][988492] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-10 12:04:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 38686720. Throughput: 0: 9832.9. Samples: 38662052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:19,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:04:21,721][988492] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-10 12:04:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 38735872. Throughput: 0: 9846.6. Samples: 38723464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:24,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:04:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075656_38735872.pth... [2023-03-10 12:04:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075072_38436864.pth [2023-03-10 12:04:25,999][988492] Updated weights for policy 0, policy_version 75680 (0.0004) [2023-03-10 12:04:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 38785024. Throughput: 0: 9865.8. Samples: 38780992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:29,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 12:04:30,152][988492] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-10 12:04:34,335][988492] Updated weights for policy 0, policy_version 75840 (0.0004) [2023-03-10 12:04:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 38834176. Throughput: 0: 9920.8. Samples: 38811324. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:34,815][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:04:38,451][988492] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-10 12:04:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 38883328. Throughput: 0: 9891.0. Samples: 38869532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:39,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:04:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075944_38883328.pth... [2023-03-10 12:04:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075368_38588416.pth [2023-03-10 12:04:42,574][988492] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-10 12:04:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 38932480. Throughput: 0: 9868.5. Samples: 38930092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:44,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:04:46,464][988492] Updated weights for policy 0, policy_version 76080 (0.0005) [2023-03-10 12:04:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 38981632. Throughput: 0: 9925.6. Samples: 38961404. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:49,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:04:50,533][988492] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-10 12:04:54,694][988492] Updated weights for policy 0, policy_version 76240 (0.0006) [2023-03-10 12:04:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 39034880. Throughput: 0: 9909.2. Samples: 39021516. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:54,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:04:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076240_39034880.pth... [2023-03-10 12:04:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075656_38735872.pth [2023-03-10 12:04:58,746][988492] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-10 12:04:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 39084032. Throughput: 0: 9990.7. Samples: 39082960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:04:59,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:05:02,955][988492] Updated weights for policy 0, policy_version 76400 (0.0004) [2023-03-10 12:05:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 39133184. Throughput: 0: 9996.0. Samples: 39111872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:04,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:05:06,868][988492] Updated weights for policy 0, policy_version 76480 (0.0005) [2023-03-10 12:05:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9941.5). Total num frames: 39186432. Throughput: 0: 9985.3. Samples: 39172800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:09,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:05:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076536_39186432.pth... [2023-03-10 12:05:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000075944_38883328.pth [2023-03-10 12:05:10,991][988492] Updated weights for policy 0, policy_version 76560 (0.0006) [2023-03-10 12:05:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 39235584. Throughput: 0: 10033.8. Samples: 39232512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:14,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:05:15,059][988492] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-10 12:05:19,164][988492] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-10 12:05:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 39284736. Throughput: 0: 10052.1. Samples: 39263668. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:05:23,254][988492] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-10 12:05:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9955.4). Total num frames: 39333888. Throughput: 0: 10060.0. Samples: 39322232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:24,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:05:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076824_39333888.pth... [2023-03-10 12:05:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076240_39034880.pth [2023-03-10 12:05:27,440][988492] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-10 12:05:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 39383040. Throughput: 0: 10035.9. Samples: 39381708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:29,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:05:31,680][988492] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-10 12:05:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 39432192. Throughput: 0: 10005.8. Samples: 39411668. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:05:35,665][988492] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-10 12:05:39,727][988492] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-10 12:05:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 39485440. Throughput: 0: 10016.1. Samples: 39472240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:39,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:05:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077120_39485440.pth... [2023-03-10 12:05:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076536_39186432.pth [2023-03-10 12:05:43,776][988492] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-10 12:05:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 39534592. Throughput: 0: 9967.8. Samples: 39531512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:05:48,218][988492] Updated weights for policy 0, policy_version 77280 (0.0004) [2023-03-10 12:05:49,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 39579648. Throughput: 0: 9941.3. Samples: 39559232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:05:49,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:05:52,699][988492] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-10 12:05:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 39628800. Throughput: 0: 9815.1. Samples: 39614480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:05:54,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:05:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077400_39628800.pth... [2023-03-10 12:05:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000076824_39333888.pth [2023-03-10 12:05:56,934][988492] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-10 12:05:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 39673856. Throughput: 0: 9805.1. Samples: 39673740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:05:59,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:06:01,099][988492] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-10 12:06:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 39723008. Throughput: 0: 9749.3. Samples: 39702388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:04,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:06:05,453][988492] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-10 12:06:09,637][988492] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-10 12:06:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 39772160. Throughput: 0: 9724.8. Samples: 39759848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:09,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:06:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077680_39772160.pth... [2023-03-10 12:06:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077120_39485440.pth [2023-03-10 12:06:13,808][988492] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-10 12:06:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9899.8). Total num frames: 39821312. Throughput: 0: 9722.7. Samples: 39819228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:14,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:06:17,434][988492] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-10 12:06:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 39874560. Throughput: 0: 9809.4. Samples: 39853092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:19,804][988181] Avg episode reward: [(0, '10.108')] [2023-03-10 12:06:21,576][988492] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-10 12:06:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 39923712. Throughput: 0: 9761.2. Samples: 39911496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:24,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:06:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077976_39923712.pth... [2023-03-10 12:06:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077400_39628800.pth [2023-03-10 12:06:25,717][988492] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-10 12:06:29,594][988492] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-10 12:06:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 39976960. Throughput: 0: 9827.7. Samples: 39973760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:29,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:06:33,465][988492] Updated weights for policy 0, policy_version 78160 (0.0004) [2023-03-10 12:06:34,804][988181] Fps is (10 sec: 10649.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 40030208. Throughput: 0: 9958.0. Samples: 40007344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:06:34,805][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:06:37,494][988492] Updated weights for policy 0, policy_version 78240 (0.0005) [2023-03-10 12:06:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 40079360. Throughput: 0: 10065.8. Samples: 40067440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:06:39,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:06:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078280_40079360.pth... [2023-03-10 12:06:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077680_39772160.pth [2023-03-10 12:06:41,547][988492] Updated weights for policy 0, policy_version 78320 (0.0005) [2023-03-10 12:06:44,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 40128512. Throughput: 0: 10087.0. Samples: 40127656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:06:44,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:06:45,699][988492] Updated weights for policy 0, policy_version 78400 (0.0006) [2023-03-10 12:06:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 40177664. Throughput: 0: 10108.0. Samples: 40157248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:06:49,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:06:49,868][988492] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-10 12:06:53,493][988492] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-10 12:06:54,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 40235008. Throughput: 0: 10230.3. Samples: 40220212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:06:54,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:06:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078584_40235008.pth... [2023-03-10 12:06:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000077976_39923712.pth [2023-03-10 12:06:57,466][988492] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-10 12:06:59,804][988181] Fps is (10 sec: 10649.7, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 40284160. Throughput: 0: 10306.7. Samples: 40283032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:06:59,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:07:01,557][988492] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-10 12:07:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9941.5). Total num frames: 40333312. Throughput: 0: 10216.5. Samples: 40312832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:07:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:07:05,709][988492] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-10 12:07:09,754][988492] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-10 12:07:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 40386560. Throughput: 0: 10216.2. Samples: 40371224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:07:09,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:07:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078880_40386560.pth... [2023-03-10 12:07:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078280_40079360.pth [2023-03-10 12:07:14,022][988492] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-10 12:07:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9941.5). Total num frames: 40431616. Throughput: 0: 10170.8. Samples: 40431444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:07:14,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:07:18,078][988492] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-10 12:07:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 40484864. Throughput: 0: 10095.1. Samples: 40461624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:07:19,804][988181] Avg episode reward: [(0, '10.107')] [2023-03-10 12:07:22,259][988492] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-10 12:07:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 40529920. Throughput: 0: 10046.4. Samples: 40519528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:07:24,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 12:07:24,827][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079168_40534016.pth... [2023-03-10 12:07:24,830][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078584_40235008.pth [2023-03-10 12:07:26,726][988492] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-10 12:07:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 40579072. Throughput: 0: 9987.9. Samples: 40577112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:29,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:07:30,621][988492] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-10 12:07:34,717][988492] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-10 12:07:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 40632320. Throughput: 0: 10011.2. Samples: 40607752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:34,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:07:38,887][988492] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-10 12:07:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 40681472. Throughput: 0: 9929.6. Samples: 40667044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:39,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:07:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079456_40681472.pth... [2023-03-10 12:07:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000078880_40386560.pth [2023-03-10 12:07:42,996][988492] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-10 12:07:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 40730624. Throughput: 0: 9874.2. Samples: 40727372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:44,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:07:47,113][988492] Updated weights for policy 0, policy_version 79600 (0.0004) [2023-03-10 12:07:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 40779776. Throughput: 0: 9888.7. Samples: 40757824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:07:51,040][988492] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-10 12:07:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 40828928. Throughput: 0: 9958.3. Samples: 40819348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:54,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:07:54,839][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079752_40833024.pth... [2023-03-10 12:07:54,842][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079168_40534016.pth [2023-03-10 12:07:55,249][988492] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-10 12:07:59,113][988492] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-10 12:07:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 40882176. Throughput: 0: 9973.7. Samples: 40880260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:07:59,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:08:03,245][988492] Updated weights for policy 0, policy_version 79920 (0.0006) [2023-03-10 12:08:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 40931328. Throughput: 0: 9974.6. Samples: 40910480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:04,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:08:07,339][988492] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-10 12:08:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 40980480. Throughput: 0: 10018.9. Samples: 40970380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:09,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 12:08:09,810][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080048_40984576.pth... [2023-03-10 12:08:09,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079456_40681472.pth [2023-03-10 12:08:11,376][988492] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-10 12:08:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 41033728. Throughput: 0: 10057.4. Samples: 41029696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:14,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:08:15,331][988492] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-10 12:08:19,529][988492] Updated weights for policy 0, policy_version 80240 (0.0004) [2023-03-10 12:08:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 41082880. Throughput: 0: 10100.9. Samples: 41062292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:19,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:08:23,613][988492] Updated weights for policy 0, policy_version 80320 (0.0004) [2023-03-10 12:08:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 41132032. Throughput: 0: 10099.6. Samples: 41121524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:24,804][988181] Avg episode reward: [(0, '10.033')] [2023-03-10 12:08:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080336_41132032.pth... [2023-03-10 12:08:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000079752_40833024.pth [2023-03-10 12:08:27,823][988492] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-10 12:08:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 41181184. Throughput: 0: 10073.4. Samples: 41180672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:29,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:08:31,936][988492] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-10 12:08:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 41230336. Throughput: 0: 10045.3. Samples: 41209864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:08:36,077][988492] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-10 12:08:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 41279488. Throughput: 0: 9995.4. Samples: 41269140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:39,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:08:39,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080632_41283584.pth... [2023-03-10 12:08:39,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080048_40984576.pth [2023-03-10 12:08:40,230][988492] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-10 12:08:44,098][988492] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-10 12:08:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 41332736. Throughput: 0: 10026.9. Samples: 41331468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:44,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:08:48,209][988492] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-10 12:08:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 41381888. Throughput: 0: 10013.2. Samples: 41361076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:49,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:08:52,518][988492] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-10 12:08:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 41431040. Throughput: 0: 9965.4. Samples: 41418824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:54,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:08:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080920_41431040.pth... [2023-03-10 12:08:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080336_41132032.pth [2023-03-10 12:08:56,478][988492] Updated weights for policy 0, policy_version 80960 (0.0005) [2023-03-10 12:08:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 41484288. Throughput: 0: 10011.0. Samples: 41480192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:08:59,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:09:00,669][988492] Updated weights for policy 0, policy_version 81040 (0.0004) [2023-03-10 12:09:04,637][988492] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-10 12:09:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 41533440. Throughput: 0: 9971.8. Samples: 41511024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:04,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:09:08,896][988492] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-10 12:09:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 41582592. Throughput: 0: 9955.2. Samples: 41569508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:09,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:09:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081216_41582592.pth... [2023-03-10 12:09:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080632_41283584.pth [2023-03-10 12:09:13,097][988492] Updated weights for policy 0, policy_version 81280 (0.0006) [2023-03-10 12:09:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 41627648. Throughput: 0: 9932.8. Samples: 41627648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:14,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:09:17,468][988492] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-10 12:09:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9969.3). Total num frames: 41676800. Throughput: 0: 9911.1. Samples: 41655864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:19,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:09:21,705][988492] Updated weights for policy 0, policy_version 81440 (0.0004) [2023-03-10 12:09:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9969.2). Total num frames: 41725952. Throughput: 0: 9878.7. Samples: 41713680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:24,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:09:24,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081496_41725952.pth... [2023-03-10 12:09:24,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000080920_41431040.pth [2023-03-10 12:09:25,827][988492] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-10 12:09:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 41775104. Throughput: 0: 9800.1. Samples: 41772472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:29,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:09:29,994][988492] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-10 12:09:34,239][988492] Updated weights for policy 0, policy_version 81680 (0.0004) [2023-03-10 12:09:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 41824256. Throughput: 0: 9771.2. Samples: 41800780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:34,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:09:38,507][988492] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-10 12:09:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 41873408. Throughput: 0: 9804.8. Samples: 41860040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:39,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:09:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081784_41873408.pth... [2023-03-10 12:09:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081216_41582592.pth [2023-03-10 12:09:42,606][988492] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-10 12:09:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 41922560. Throughput: 0: 9740.8. Samples: 41918528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:44,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:09:46,734][988492] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-10 12:09:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 41971712. Throughput: 0: 9746.8. Samples: 41949628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:49,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:09:50,960][988492] Updated weights for policy 0, policy_version 82000 (0.0005) [2023-03-10 12:09:54,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 42020864. Throughput: 0: 9714.5. Samples: 42006664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:54,815][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:09:54,820][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082072_42020864.pth... [2023-03-10 12:09:54,822][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081496_41725952.pth [2023-03-10 12:09:55,090][988492] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-10 12:09:59,162][988492] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-10 12:09:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 42070016. Throughput: 0: 9777.4. Samples: 42067632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:09:59,815][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:10:03,183][988492] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-10 12:10:04,804][988181] Fps is (10 sec: 10240.3, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 42123264. Throughput: 0: 9840.1. Samples: 42098668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:04,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:10:07,102][988492] Updated weights for policy 0, policy_version 82320 (0.0006) [2023-03-10 12:10:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 42172416. Throughput: 0: 9922.5. Samples: 42160192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:09,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:10:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082368_42172416.pth... [2023-03-10 12:10:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000081784_41873408.pth [2023-03-10 12:10:11,239][988492] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-10 12:10:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 42221568. Throughput: 0: 9977.5. Samples: 42221460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:14,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:10:15,229][988492] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-10 12:10:19,630][988492] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-10 12:10:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 42270720. Throughput: 0: 9988.0. Samples: 42250240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:19,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:10:23,878][988492] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-10 12:10:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 42319872. Throughput: 0: 9941.1. Samples: 42307388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:24,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:10:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082656_42319872.pth... [2023-03-10 12:10:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082072_42020864.pth [2023-03-10 12:10:27,948][988492] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-10 12:10:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9955.4). Total num frames: 42369024. Throughput: 0: 9932.8. Samples: 42365504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:10:32,025][988492] Updated weights for policy 0, policy_version 82800 (0.0004) [2023-03-10 12:10:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 42418176. Throughput: 0: 9956.4. Samples: 42397664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:34,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:10:36,233][988492] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-10 12:10:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 42467328. Throughput: 0: 9949.1. Samples: 42454372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:39,805][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:10:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082944_42467328.pth... [2023-03-10 12:10:39,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082368_42172416.pth [2023-03-10 12:10:40,665][988492] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-10 12:10:44,249][988492] Updated weights for policy 0, policy_version 83040 (0.0004) [2023-03-10 12:10:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 42520576. Throughput: 0: 9988.9. Samples: 42517132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:10:44,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:10:48,304][988492] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-10 12:10:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9969.3). Total num frames: 42569728. Throughput: 0: 9969.8. Samples: 42547312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:10:49,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:10:52,677][988492] Updated weights for policy 0, policy_version 83200 (0.0004) [2023-03-10 12:10:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 9983.1). Total num frames: 42618880. Throughput: 0: 9889.7. Samples: 42605228. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:10:54,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:10:54,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083240_42618880.pth... [2023-03-10 12:10:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082656_42319872.pth [2023-03-10 12:10:56,846][988492] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-10 12:10:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9969.3). Total num frames: 42663936. Throughput: 0: 9831.9. Samples: 42663896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:10:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:11:00,949][988492] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-10 12:11:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 42717184. Throughput: 0: 9846.2. Samples: 42693320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:04,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:11:05,219][988492] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-10 12:11:09,433][988492] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-10 12:11:09,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 42766336. Throughput: 0: 9864.8. Samples: 42751304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:09,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:11:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083528_42766336.pth... [2023-03-10 12:11:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000082944_42467328.pth [2023-03-10 12:11:13,643][988492] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-10 12:11:14,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 42811392. Throughput: 0: 9879.6. Samples: 42810084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:14,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 12:11:17,905][988492] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-10 12:11:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 42860544. Throughput: 0: 9807.1. Samples: 42838984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:19,805][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:11:22,301][988492] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-10 12:11:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 42905600. Throughput: 0: 9775.8. Samples: 42894280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:24,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:11:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083800_42905600.pth... [2023-03-10 12:11:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083240_42618880.pth [2023-03-10 12:11:26,652][988492] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-10 12:11:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 42954752. Throughput: 0: 9701.3. Samples: 42953688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:29,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:11:30,682][988492] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-10 12:11:34,559][988492] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-10 12:11:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 43008000. Throughput: 0: 9704.8. Samples: 42984028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:11:34,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:11:38,692][988492] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-10 12:11:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 43057152. Throughput: 0: 9769.7. Samples: 43044864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:11:39,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:11:39,834][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084104_43061248.pth... [2023-03-10 12:11:39,835][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083528_42766336.pth [2023-03-10 12:11:42,835][988492] Updated weights for policy 0, policy_version 84160 (0.0004) [2023-03-10 12:11:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 43106304. Throughput: 0: 9819.3. Samples: 43105764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:11:44,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:11:46,944][988492] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-10 12:11:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 43155456. Throughput: 0: 9814.6. Samples: 43134976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:11:49,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:11:50,990][988492] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-10 12:11:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 43208704. Throughput: 0: 9853.9. Samples: 43194728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:11:54,805][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:11:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084392_43208704.pth... [2023-03-10 12:11:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000083800_42905600.pth [2023-03-10 12:11:55,038][988492] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-10 12:11:59,079][988492] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-10 12:11:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9913.7). Total num frames: 43257856. Throughput: 0: 9924.4. Samples: 43256684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:11:59,805][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:12:03,198][988492] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-10 12:12:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 43307008. Throughput: 0: 9944.5. Samples: 43286484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:04,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:12:07,455][988492] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-10 12:12:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 43356160. Throughput: 0: 10008.7. Samples: 43344672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:12:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084680_43356160.pth... [2023-03-10 12:12:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084104_43061248.pth [2023-03-10 12:12:11,267][988492] Updated weights for policy 0, policy_version 84720 (0.0006) [2023-03-10 12:12:14,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 43413504. Throughput: 0: 10127.4. Samples: 43409420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:12:15,184][988492] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-10 12:12:19,461][988492] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-10 12:12:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9967.0, 300 sec: 9927.6). Total num frames: 43458560. Throughput: 0: 10084.0. Samples: 43437808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:12:23,622][988492] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-10 12:12:24,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 43507712. Throughput: 0: 10044.8. Samples: 43496880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:24,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:12:24,816][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084984_43511808.pth... [2023-03-10 12:12:24,817][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084392_43208704.pth [2023-03-10 12:12:27,645][988492] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-10 12:12:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 43556864. Throughput: 0: 10023.2. Samples: 43556808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:29,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 12:12:32,038][988492] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-10 12:12:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 43606016. Throughput: 0: 9998.0. Samples: 43584888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:12:36,524][988492] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-10 12:12:39,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 43651072. Throughput: 0: 9883.9. Samples: 43639504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:39,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 12:12:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085256_43651072.pth... [2023-03-10 12:12:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084680_43356160.pth [2023-03-10 12:12:40,679][988492] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-10 12:12:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 43700224. Throughput: 0: 9798.6. Samples: 43697620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:44,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:12:45,034][988492] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-10 12:12:49,044][988492] Updated weights for policy 0, policy_version 85440 (0.0004) [2023-03-10 12:12:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 43749376. Throughput: 0: 9799.8. Samples: 43727476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:49,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:12:53,240][988492] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-10 12:12:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 43798528. Throughput: 0: 9825.9. Samples: 43786836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:54,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:12:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085544_43798528.pth... [2023-03-10 12:12:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000084984_43511808.pth [2023-03-10 12:12:57,529][988492] Updated weights for policy 0, policy_version 85600 (0.0004) [2023-03-10 12:12:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 43847680. Throughput: 0: 9686.0. Samples: 43845288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:12:59,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:13:01,869][988492] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-10 12:13:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 43892736. Throughput: 0: 9654.6. Samples: 43872264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:04,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:13:06,410][988492] Updated weights for policy 0, policy_version 85760 (0.0004) [2023-03-10 12:13:09,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 43937792. Throughput: 0: 9574.9. Samples: 43927752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:09,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:13:09,836][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085824_43941888.pth... [2023-03-10 12:13:09,838][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085256_43651072.pth [2023-03-10 12:13:10,687][988492] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-10 12:13:14,586][988492] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-10 12:13:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 43991040. Throughput: 0: 9593.6. Samples: 43988520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:14,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:13:18,954][988492] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-10 12:13:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 44040192. Throughput: 0: 9586.3. Samples: 44016272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:19,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:13:23,193][988492] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-10 12:13:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 44085248. Throughput: 0: 9662.9. Samples: 44074336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:24,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:13:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086112_44089344.pth... [2023-03-10 12:13:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085544_43798528.pth [2023-03-10 12:13:27,287][988492] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-10 12:13:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 44134400. Throughput: 0: 9705.2. Samples: 44134352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:13:31,455][988492] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-10 12:13:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 44187648. Throughput: 0: 9687.1. Samples: 44163396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:34,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:13:35,590][988492] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-10 12:13:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 44232704. Throughput: 0: 9664.4. Samples: 44221736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:39,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:13:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086392_44232704.pth... [2023-03-10 12:13:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000085824_43941888.pth [2023-03-10 12:13:39,945][988492] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-10 12:13:44,058][988492] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-10 12:13:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 44281856. Throughput: 0: 9680.8. Samples: 44280924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:44,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:13:48,057][988492] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-10 12:13:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.8, 300 sec: 9830.4). Total num frames: 44331008. Throughput: 0: 9731.0. Samples: 44310160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:49,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 12:13:52,281][988492] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-10 12:13:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 44380160. Throughput: 0: 9831.5. Samples: 44370168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:54,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:13:54,816][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086688_44384256.pth... [2023-03-10 12:13:54,818][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086112_44089344.pth [2023-03-10 12:13:56,485][988492] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-10 12:13:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 44429312. Throughput: 0: 9793.4. Samples: 44429224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:13:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:14:00,856][988492] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-10 12:14:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9816.5). Total num frames: 44478464. Throughput: 0: 9780.7. Samples: 44456404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:14:05,121][988492] Updated weights for policy 0, policy_version 86880 (0.0004) [2023-03-10 12:14:09,109][988492] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-10 12:14:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 44527616. Throughput: 0: 9817.5. Samples: 44516124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:09,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:14:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086968_44527616.pth... [2023-03-10 12:14:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086392_44232704.pth [2023-03-10 12:14:13,299][988492] Updated weights for policy 0, policy_version 87040 (0.0004) [2023-03-10 12:14:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 44576768. Throughput: 0: 9779.7. Samples: 44574436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:14,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:14:17,560][988492] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-10 12:14:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 44625920. Throughput: 0: 9767.7. Samples: 44602940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:19,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:14:21,640][988492] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-10 12:14:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 44675072. Throughput: 0: 9795.4. Samples: 44662528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:24,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 12:14:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087256_44675072.pth... [2023-03-10 12:14:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086688_44384256.pth [2023-03-10 12:14:25,965][988492] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-10 12:14:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 44724224. Throughput: 0: 9760.3. Samples: 44720136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:29,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:14:30,096][988492] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-10 12:14:34,631][988492] Updated weights for policy 0, policy_version 87440 (0.0006) [2023-03-10 12:14:34,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 44769280. Throughput: 0: 9743.5. Samples: 44748616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:34,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:14:38,588][988492] Updated weights for policy 0, policy_version 87520 (0.0005) [2023-03-10 12:14:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.2, 300 sec: 9816.5). Total num frames: 44818432. Throughput: 0: 9732.3. Samples: 44808120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:14:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087536_44818432.pth... [2023-03-10 12:14:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000086968_44527616.pth [2023-03-10 12:14:42,958][988492] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-10 12:14:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9816.5). Total num frames: 44867584. Throughput: 0: 9681.5. Samples: 44864892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:14:47,051][988492] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-10 12:14:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9816.5). Total num frames: 44916736. Throughput: 0: 9768.5. Samples: 44895984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:49,815][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 12:14:51,209][988492] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-10 12:14:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9816.5). Total num frames: 44965888. Throughput: 0: 9720.6. Samples: 44953552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:54,815][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:14:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087824_44965888.pth... [2023-03-10 12:14:54,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087256_44675072.pth [2023-03-10 12:14:55,395][988492] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-10 12:14:59,727][988492] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-10 12:14:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45015040. Throughput: 0: 9707.6. Samples: 45011280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:14:59,815][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:15:03,751][988492] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-10 12:15:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45064192. Throughput: 0: 9728.2. Samples: 45040708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:04,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:15:07,986][988492] Updated weights for policy 0, policy_version 88080 (0.0006) [2023-03-10 12:15:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45113344. Throughput: 0: 9742.4. Samples: 45100940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:15:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088112_45113344.pth... [2023-03-10 12:15:09,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087536_44818432.pth [2023-03-10 12:15:12,148][988492] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-10 12:15:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45162496. Throughput: 0: 9757.4. Samples: 45159220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:14,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:15:16,233][988492] Updated weights for policy 0, policy_version 88240 (0.0006) [2023-03-10 12:15:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45211648. Throughput: 0: 9818.4. Samples: 45190444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:19,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:15:20,342][988492] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-10 12:15:24,690][988492] Updated weights for policy 0, policy_version 88400 (0.0004) [2023-03-10 12:15:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9802.6). Total num frames: 45260800. Throughput: 0: 9775.0. Samples: 45247996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:24,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:15:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088400_45260800.pth... [2023-03-10 12:15:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000087824_44965888.pth [2023-03-10 12:15:29,167][988492] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-10 12:15:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 45305856. Throughput: 0: 9749.5. Samples: 45303620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:29,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:15:33,387][988492] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-10 12:15:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9788.8). Total num frames: 45355008. Throughput: 0: 9700.9. Samples: 45332524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:34,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:15:37,546][988492] Updated weights for policy 0, policy_version 88640 (0.0004) [2023-03-10 12:15:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 45404160. Throughput: 0: 9740.4. Samples: 45391872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:39,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:15:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088680_45404160.pth... [2023-03-10 12:15:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088112_45113344.pth [2023-03-10 12:15:41,721][988492] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-10 12:15:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 45453312. Throughput: 0: 9733.5. Samples: 45449288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:44,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:15:45,922][988492] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-10 12:15:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 45502464. Throughput: 0: 9745.6. Samples: 45479260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:49,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:15:50,092][988492] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-10 12:15:54,185][988492] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-10 12:15:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9788.7). Total num frames: 45551616. Throughput: 0: 9743.4. Samples: 45539392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:54,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:15:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088968_45551616.pth... [2023-03-10 12:15:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088400_45260800.pth [2023-03-10 12:15:58,408][988492] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-10 12:15:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9774.9). Total num frames: 45600768. Throughput: 0: 9739.6. Samples: 45597500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:15:59,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:16:02,487][988492] Updated weights for policy 0, policy_version 89120 (0.0006) [2023-03-10 12:16:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 45649920. Throughput: 0: 9747.4. Samples: 45629076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:04,804][988181] Avg episode reward: [(0, '10.108')] [2023-03-10 12:16:06,661][988492] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-10 12:16:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9788.7). Total num frames: 45699072. Throughput: 0: 9745.8. Samples: 45686556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:09,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:16:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089256_45699072.pth... [2023-03-10 12:16:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088680_45404160.pth [2023-03-10 12:16:11,081][988492] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-10 12:16:14,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 45744128. Throughput: 0: 9746.3. Samples: 45742204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:14,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:16:15,452][988492] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-10 12:16:19,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 45789184. Throughput: 0: 9729.8. Samples: 45770364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:19,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:16:19,853][988492] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-10 12:16:24,345][988492] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-10 12:16:24,804][988181] Fps is (10 sec: 9011.0, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 45834240. Throughput: 0: 9635.8. Samples: 45825484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:24,805][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:16:24,823][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089528_45838336.pth... [2023-03-10 12:16:24,825][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000088968_45551616.pth [2023-03-10 12:16:28,794][988492] Updated weights for policy 0, policy_version 89600 (0.0004) [2023-03-10 12:16:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 45883392. Throughput: 0: 9567.6. Samples: 45879828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:29,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:16:33,267][988492] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-10 12:16:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 45932544. Throughput: 0: 9526.6. Samples: 45907956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:16:37,223][988492] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-10 12:16:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 45981696. Throughput: 0: 9552.1. Samples: 45969236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:39,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:16:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089808_45981696.pth... [2023-03-10 12:16:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089256_45699072.pth [2023-03-10 12:16:41,404][988492] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-10 12:16:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 46030848. Throughput: 0: 9552.3. Samples: 46027356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:44,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:16:45,513][988492] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-10 12:16:49,644][988492] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-10 12:16:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 46080000. Throughput: 0: 9501.4. Samples: 46056640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:49,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 12:16:53,895][988492] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-10 12:16:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 46129152. Throughput: 0: 9552.3. Samples: 46116412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:54,805][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:16:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090096_46129152.pth... [2023-03-10 12:16:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089528_45838336.pth [2023-03-10 12:16:58,225][988492] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-10 12:16:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 46174208. Throughput: 0: 9572.2. Samples: 46172956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:16:59,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:17:02,417][988492] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-10 12:17:04,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 46223360. Throughput: 0: 9607.8. Samples: 46202716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:04,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 12:17:06,628][988492] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-10 12:17:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 46272512. Throughput: 0: 9659.6. Samples: 46260164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:09,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:17:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090376_46272512.pth... [2023-03-10 12:17:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000089808_45981696.pth [2023-03-10 12:17:10,855][988492] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-10 12:17:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 46321664. Throughput: 0: 9747.8. Samples: 46318480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:14,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:17:14,902][988492] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-10 12:17:19,159][988492] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-10 12:17:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 46370816. Throughput: 0: 9816.6. Samples: 46349700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:19,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:17:23,127][988492] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-10 12:17:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 46419968. Throughput: 0: 9790.9. Samples: 46409828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:24,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:17:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090672_46424064.pth... [2023-03-10 12:17:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090096_46129152.pth [2023-03-10 12:17:27,096][988492] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-10 12:17:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 46473216. Throughput: 0: 9848.2. Samples: 46470524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:29,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 12:17:31,159][988492] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-10 12:17:34,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 46526464. Throughput: 0: 9893.5. Samples: 46501848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:34,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:17:35,101][988492] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-10 12:17:39,231][988492] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-10 12:17:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 46575616. Throughput: 0: 9918.9. Samples: 46562764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:39,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:17:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090968_46575616.pth... [2023-03-10 12:17:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090376_46272512.pth [2023-03-10 12:17:43,175][988492] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-10 12:17:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 46624768. Throughput: 0: 10036.6. Samples: 46624604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:44,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 12:17:47,425][988492] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-10 12:17:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 46673920. Throughput: 0: 9987.5. Samples: 46652152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:49,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:17:51,504][988492] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-10 12:17:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9761.0). Total num frames: 46727168. Throughput: 0: 10100.7. Samples: 46714696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:54,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:17:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091264_46727168.pth... [2023-03-10 12:17:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090672_46424064.pth [2023-03-10 12:17:55,233][988492] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-10 12:17:59,444][988492] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-10 12:17:59,804][988181] Fps is (10 sec: 10649.4, 60 sec: 10103.5, 300 sec: 9788.7). Total num frames: 46780416. Throughput: 0: 10171.8. Samples: 46776212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:17:59,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:18:03,711][988492] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-10 12:18:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9788.7). Total num frames: 46825472. Throughput: 0: 10116.3. Samples: 46804936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:04,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:18:07,884][988492] Updated weights for policy 0, policy_version 91520 (0.0004) [2023-03-10 12:18:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9774.9). Total num frames: 46874624. Throughput: 0: 10076.3. Samples: 46863260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:09,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:18:09,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091560_46878720.pth... [2023-03-10 12:18:09,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000090968_46575616.pth [2023-03-10 12:18:11,974][988492] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-10 12:18:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9788.7). Total num frames: 46927872. Throughput: 0: 10139.8. Samples: 46926812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:14,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:18:15,787][988492] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-10 12:18:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.4, 300 sec: 9802.6). Total num frames: 46977024. Throughput: 0: 10076.4. Samples: 46955284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:19,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 12:18:20,107][988492] Updated weights for policy 0, policy_version 91760 (0.0004) [2023-03-10 12:18:24,252][988492] Updated weights for policy 0, policy_version 91840 (0.0006) [2023-03-10 12:18:24,804][988181] Fps is (10 sec: 9830.2, 60 sec: 10103.5, 300 sec: 9802.6). Total num frames: 47026176. Throughput: 0: 10021.2. Samples: 47013720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:24,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:18:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091848_47026176.pth... [2023-03-10 12:18:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091264_46727168.pth [2023-03-10 12:18:28,464][988492] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-10 12:18:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9788.7). Total num frames: 47075328. Throughput: 0: 9941.2. Samples: 47071956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:29,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:18:32,642][988492] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-10 12:18:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 47124480. Throughput: 0: 9977.8. Samples: 47101152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:34,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:18:36,807][988492] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-10 12:18:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 47169536. Throughput: 0: 9864.4. Samples: 47158592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:39,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:18:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092128_47169536.pth... [2023-03-10 12:18:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091560_46878720.pth [2023-03-10 12:18:41,177][988492] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-10 12:18:44,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 47218688. Throughput: 0: 9826.8. Samples: 47218416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:44,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:18:45,431][988492] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-10 12:18:49,722][988492] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-10 12:18:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 47267840. Throughput: 0: 9781.3. Samples: 47245096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:18:53,844][988492] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-10 12:18:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9788.7). Total num frames: 47316992. Throughput: 0: 9804.6. Samples: 47304464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:54,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:18:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092416_47316992.pth... [2023-03-10 12:18:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000091848_47026176.pth [2023-03-10 12:18:57,971][988492] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-10 12:18:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9788.7). Total num frames: 47366144. Throughput: 0: 9670.1. Samples: 47361968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:18:59,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:19:01,954][988492] Updated weights for policy 0, policy_version 92560 (0.0004) [2023-03-10 12:19:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9802.6). Total num frames: 47419392. Throughput: 0: 9768.8. Samples: 47394880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:04,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:19:05,893][988492] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-10 12:19:09,799][988492] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-10 12:19:09,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 47472640. Throughput: 0: 9874.3. Samples: 47458064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:19:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092720_47472640.pth... [2023-03-10 12:19:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092128_47169536.pth [2023-03-10 12:19:13,947][988492] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-10 12:19:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 47521792. Throughput: 0: 9905.7. Samples: 47517712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:14,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:19:18,079][988492] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-10 12:19:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 47570944. Throughput: 0: 9895.3. Samples: 47546440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:19,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:19:22,334][988492] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-10 12:19:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 47620096. Throughput: 0: 9910.0. Samples: 47604544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:24,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:19:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093008_47620096.pth... [2023-03-10 12:19:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092416_47316992.pth [2023-03-10 12:19:26,305][988492] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-10 12:19:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 47669248. Throughput: 0: 9935.6. Samples: 47665520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:29,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:19:30,429][988492] Updated weights for policy 0, policy_version 93120 (0.0005) [2023-03-10 12:19:34,449][988492] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-10 12:19:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 47718400. Throughput: 0: 10031.7. Samples: 47696524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:34,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:19:38,580][988492] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-10 12:19:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9830.4). Total num frames: 47767552. Throughput: 0: 10046.6. Samples: 47756560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:39,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:19:39,847][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093304_47771648.pth... [2023-03-10 12:19:39,849][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000092720_47472640.pth [2023-03-10 12:19:42,601][988492] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-10 12:19:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 47820800. Throughput: 0: 10164.4. Samples: 47819368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:44,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:19:46,445][988492] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-10 12:19:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 47869952. Throughput: 0: 10103.7. Samples: 47849544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:19:50,838][988492] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-10 12:19:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 47919104. Throughput: 0: 9993.1. Samples: 47907752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:54,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:19:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093592_47919104.pth... [2023-03-10 12:19:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093008_47620096.pth [2023-03-10 12:19:54,994][988492] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-10 12:19:58,796][988492] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-10 12:19:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9858.2). Total num frames: 47972352. Throughput: 0: 10070.2. Samples: 47970872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:19:59,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:20:02,747][988492] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-10 12:20:04,804][988181] Fps is (10 sec: 10649.7, 60 sec: 10103.5, 300 sec: 9872.1). Total num frames: 48025600. Throughput: 0: 10099.7. Samples: 48000928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:04,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:20:06,590][988492] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-10 12:20:09,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 9885.9). Total num frames: 48078848. Throughput: 0: 10211.1. Samples: 48064044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:09,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:20:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093904_48078848.pth... [2023-03-10 12:20:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093304_47771648.pth [2023-03-10 12:20:10,490][988492] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-10 12:20:14,519][988492] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-10 12:20:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9885.9). Total num frames: 48128000. Throughput: 0: 10251.4. Samples: 48126832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:14,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:20:18,593][988492] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-10 12:20:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9899.8). Total num frames: 48181248. Throughput: 0: 10226.9. Samples: 48156736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:20:22,549][988492] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-10 12:20:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9913.7). Total num frames: 48230400. Throughput: 0: 10254.0. Samples: 48217988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:24,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 12:20:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094200_48230400.pth... [2023-03-10 12:20:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093592_47919104.pth [2023-03-10 12:20:26,622][988492] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-10 12:20:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 9913.7). Total num frames: 48279552. Throughput: 0: 10184.6. Samples: 48277672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:29,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:20:30,774][988492] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-10 12:20:34,654][988492] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-10 12:20:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 9927.6). Total num frames: 48332800. Throughput: 0: 10191.2. Samples: 48308148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:34,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:20:38,882][988492] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-10 12:20:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 9927.6). Total num frames: 48381952. Throughput: 0: 10248.3. Samples: 48368924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:39,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:20:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094496_48381952.pth... [2023-03-10 12:20:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000093904_48078848.pth [2023-03-10 12:20:43,184][988492] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-10 12:20:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 48431104. Throughput: 0: 10137.8. Samples: 48427072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:44,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 12:20:47,150][988492] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-10 12:20:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 48480256. Throughput: 0: 10157.0. Samples: 48457992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:49,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:20:51,210][988492] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-10 12:20:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9941.5). Total num frames: 48533504. Throughput: 0: 10116.7. Samples: 48519296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:54,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:20:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094792_48533504.pth... [2023-03-10 12:20:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094200_48230400.pth [2023-03-10 12:20:55,193][988492] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-10 12:20:59,245][988492] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-10 12:20:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 9941.5). Total num frames: 48582656. Throughput: 0: 10052.8. Samples: 48579208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:20:59,804][988181] Avg episode reward: [(0, '9.740')] [2023-03-10 12:21:03,221][988492] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-10 12:21:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 48631808. Throughput: 0: 10096.3. Samples: 48611068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:04,804][988181] Avg episode reward: [(0, '9.848')] [2023-03-10 12:21:07,211][988492] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-10 12:21:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 48685056. Throughput: 0: 10106.4. Samples: 48672776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:09,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:21:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095088_48685056.pth... [2023-03-10 12:21:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094496_48381952.pth [2023-03-10 12:21:11,256][988492] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-10 12:21:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 48734208. Throughput: 0: 10095.9. Samples: 48731988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:14,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 12:21:15,347][988492] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-10 12:21:19,313][988492] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-10 12:21:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 48787456. Throughput: 0: 10100.5. Samples: 48762672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:21:23,495][988492] Updated weights for policy 0, policy_version 95360 (0.0004) [2023-03-10 12:21:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 10010.9). Total num frames: 48836608. Throughput: 0: 10098.9. Samples: 48823376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:24,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:21:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095384_48836608.pth... [2023-03-10 12:21:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000094792_48533504.pth [2023-03-10 12:21:27,552][988492] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-10 12:21:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 48885760. Throughput: 0: 10143.7. Samples: 48883536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:29,805][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:21:31,626][988492] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-10 12:21:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 48939008. Throughput: 0: 10129.7. Samples: 48913828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:21:35,519][988492] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-10 12:21:39,563][988492] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-10 12:21:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 48988160. Throughput: 0: 10146.2. Samples: 48975872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:21:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095680_48988160.pth... [2023-03-10 12:21:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095088_48685056.pth [2023-03-10 12:21:43,595][988492] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-10 12:21:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 49037312. Throughput: 0: 10177.0. Samples: 49037172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:44,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 12:21:47,778][988492] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-10 12:21:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 49086464. Throughput: 0: 10106.7. Samples: 49065868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:21:51,676][988492] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-10 12:21:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 49139712. Throughput: 0: 10118.0. Samples: 49128088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:54,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 12:21:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095976_49139712.pth... [2023-03-10 12:21:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095384_48836608.pth [2023-03-10 12:21:55,653][988492] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-10 12:21:59,773][988492] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-10 12:21:59,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10171.7, 300 sec: 10066.4). Total num frames: 49192960. Throughput: 0: 10152.8. Samples: 49188864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:21:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:22:04,074][988492] Updated weights for policy 0, policy_version 96160 (0.0004) [2023-03-10 12:22:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 49238016. Throughput: 0: 10108.3. Samples: 49217544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:22:08,277][988492] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-10 12:22:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 49287168. Throughput: 0: 10038.5. Samples: 49275108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:09,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:22:09,835][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096272_49291264.pth... [2023-03-10 12:22:09,838][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095680_48988160.pth [2023-03-10 12:22:12,494][988492] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-10 12:22:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 49336320. Throughput: 0: 10006.1. Samples: 49333812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:14,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:22:16,718][988492] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-10 12:22:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 49385472. Throughput: 0: 9999.8. Samples: 49363820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:19,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:22:20,842][988492] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-10 12:22:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 49430528. Throughput: 0: 9919.9. Samples: 49422268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:24,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:22:24,821][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096552_49434624.pth... [2023-03-10 12:22:24,823][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000095976_49139712.pth [2023-03-10 12:22:25,286][988492] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-10 12:22:29,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 49475584. Throughput: 0: 9741.9. Samples: 49475560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:22:29,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:22:29,859][988492] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-10 12:22:34,100][988492] Updated weights for policy 0, policy_version 96720 (0.0005) [2023-03-10 12:22:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9997.0). Total num frames: 49524736. Throughput: 0: 9720.2. Samples: 49503276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:34,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:22:38,322][988492] Updated weights for policy 0, policy_version 96800 (0.0005) [2023-03-10 12:22:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9997.0). Total num frames: 49573888. Throughput: 0: 9635.1. Samples: 49561664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:39,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:22:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096824_49573888.pth... [2023-03-10 12:22:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096272_49291264.pth [2023-03-10 12:22:42,387][988492] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-10 12:22:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 10010.9). Total num frames: 49627136. Throughput: 0: 9648.3. Samples: 49623040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:22:46,459][988492] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-10 12:22:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9983.1). Total num frames: 49672192. Throughput: 0: 9648.4. Samples: 49651720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:22:50,837][988492] Updated weights for policy 0, policy_version 97040 (0.0004) [2023-03-10 12:22:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9969.3). Total num frames: 49721344. Throughput: 0: 9653.5. Samples: 49709516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:54,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:22:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097112_49721344.pth... [2023-03-10 12:22:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096552_49434624.pth [2023-03-10 12:22:54,879][988492] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-10 12:22:58,692][988492] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-10 12:22:59,804][988181] Fps is (10 sec: 10649.7, 60 sec: 9762.1, 300 sec: 10010.9). Total num frames: 49778688. Throughput: 0: 9792.8. Samples: 49774488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:22:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:23:02,625][988492] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-10 12:23:04,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9830.4, 300 sec: 10010.9). Total num frames: 49827840. Throughput: 0: 9791.4. Samples: 49804432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:23:06,811][988492] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-10 12:23:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 49876992. Throughput: 0: 9831.9. Samples: 49864704. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:09,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:23:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097416_49876992.pth... [2023-03-10 12:23:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000096824_49573888.pth [2023-03-10 12:23:10,834][988492] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-10 12:23:14,647][988492] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-10 12:23:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 49930240. Throughput: 0: 10014.4. Samples: 49926208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:14,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:23:18,293][988492] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-10 12:23:19,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 49983488. Throughput: 0: 10196.2. Samples: 49962104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:19,805][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:23:22,503][988492] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-10 12:23:24,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 50032640. Throughput: 0: 10193.3. Samples: 50020364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:24,814][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:23:24,817][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097720_50032640.pth... [2023-03-10 12:23:24,818][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097112_49721344.pth [2023-03-10 12:23:26,502][988492] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-10 12:23:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 50081792. Throughput: 0: 10188.3. Samples: 50081512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:23:29,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:23:30,968][988492] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-10 12:23:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 50130944. Throughput: 0: 10116.4. Samples: 50106960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:34,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:23:35,176][988492] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-10 12:23:39,336][988492] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-10 12:23:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 10038.7). Total num frames: 50180096. Throughput: 0: 10174.5. Samples: 50167368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:39,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:23:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098008_50180096.pth... [2023-03-10 12:23:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097416_49876992.pth [2023-03-10 12:23:42,921][988492] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-10 12:23:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 50233344. Throughput: 0: 10160.7. Samples: 50231720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:44,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:23:46,957][988492] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-10 12:23:49,804][988181] Fps is (10 sec: 10649.8, 60 sec: 10240.0, 300 sec: 10066.4). Total num frames: 50286592. Throughput: 0: 10170.0. Samples: 50262080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:49,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:23:51,047][988492] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-10 12:23:54,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10066.4). Total num frames: 50335744. Throughput: 0: 10159.3. Samples: 50321872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:54,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:23:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098312_50335744.pth... [2023-03-10 12:23:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000097720_50032640.pth [2023-03-10 12:23:55,150][988492] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-10 12:23:59,306][988492] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-10 12:23:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 50384896. Throughput: 0: 10103.5. Samples: 50380864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:23:59,808][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:24:03,506][988492] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-10 12:24:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 50434048. Throughput: 0: 9977.4. Samples: 50411088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:24:07,368][988492] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-10 12:24:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 50483200. Throughput: 0: 10020.2. Samples: 50471276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:09,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:24:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098600_50483200.pth... [2023-03-10 12:24:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098008_50180096.pth [2023-03-10 12:24:11,577][988492] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-10 12:24:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 50532352. Throughput: 0: 9976.0. Samples: 50530432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:14,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:24:15,766][988492] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-10 12:24:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 50581504. Throughput: 0: 10055.9. Samples: 50559476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:19,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:24:19,849][988492] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-10 12:24:24,081][988492] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-10 12:24:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 50630656. Throughput: 0: 10034.0. Samples: 50618896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:24,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 12:24:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098888_50630656.pth... [2023-03-10 12:24:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098312_50335744.pth [2023-03-10 12:24:28,316][988492] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-10 12:24:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 10038.7). Total num frames: 50679808. Throughput: 0: 9930.7. Samples: 50678600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:24:29,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:24:32,441][988492] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-10 12:24:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 50728960. Throughput: 0: 9912.5. Samples: 50708144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:34,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:24:36,584][988492] Updated weights for policy 0, policy_version 99120 (0.0004) [2023-03-10 12:24:39,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 50782208. Throughput: 0: 9865.7. Samples: 50765832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:39,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 12:24:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099184_50782208.pth... [2023-03-10 12:24:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098600_50483200.pth [2023-03-10 12:24:40,536][988492] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-10 12:24:44,794][988492] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-10 12:24:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 50831360. Throughput: 0: 9918.7. Samples: 50827204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:44,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:24:49,259][988492] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-10 12:24:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 50876416. Throughput: 0: 9853.9. Samples: 50854512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:49,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 12:24:53,341][988492] Updated weights for policy 0, policy_version 99440 (0.0004) [2023-03-10 12:24:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10010.9). Total num frames: 50925568. Throughput: 0: 9822.6. Samples: 50913292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:54,815][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:24:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099464_50925568.pth... [2023-03-10 12:24:54,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000098888_50630656.pth [2023-03-10 12:24:57,361][988492] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-10 12:24:59,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 50974720. Throughput: 0: 9852.6. Samples: 50973800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:24:59,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 12:25:01,584][988492] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-10 12:25:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 51023872. Throughput: 0: 9853.9. Samples: 51002904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:04,804][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 12:25:05,926][988492] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-10 12:25:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 51073024. Throughput: 0: 9809.2. Samples: 51060308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:09,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 12:25:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099752_51073024.pth... [2023-03-10 12:25:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099184_50782208.pth [2023-03-10 12:25:10,172][988492] Updated weights for policy 0, policy_version 99760 (0.0005) [2023-03-10 12:25:14,437][988492] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-10 12:25:14,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 51118080. Throughput: 0: 9757.9. Samples: 51117704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:14,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:25:18,556][988492] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-10 12:25:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 51171328. Throughput: 0: 9745.4. Samples: 51146688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:19,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:25:22,522][988492] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-10 12:25:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 51220480. Throughput: 0: 9826.9. Samples: 51208044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:24,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:25:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100040_51220480.pth... [2023-03-10 12:25:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099464_50925568.pth [2023-03-10 12:25:26,889][988492] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-10 12:25:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 51265536. Throughput: 0: 9736.9. Samples: 51265364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:25:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:25:31,221][988492] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-10 12:25:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 51314688. Throughput: 0: 9765.7. Samples: 51293968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:34,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 12:25:35,271][988492] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-10 12:25:39,260][988492] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-10 12:25:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 51367936. Throughput: 0: 9799.2. Samples: 51354256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:39,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:25:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100328_51367936.pth... [2023-03-10 12:25:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000099752_51073024.pth [2023-03-10 12:25:43,361][988492] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-10 12:25:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 51417088. Throughput: 0: 9767.4. Samples: 51413336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:44,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:25:47,604][988492] Updated weights for policy 0, policy_version 100480 (0.0004) [2023-03-10 12:25:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 51466240. Throughput: 0: 9776.6. Samples: 51442852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:49,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:25:51,699][988492] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-10 12:25:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 51515392. Throughput: 0: 9840.1. Samples: 51503112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:54,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 12:25:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100616_51515392.pth... [2023-03-10 12:25:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100040_51220480.pth [2023-03-10 12:25:55,899][988492] Updated weights for policy 0, policy_version 100640 (0.0004) [2023-03-10 12:25:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 51564544. Throughput: 0: 9921.6. Samples: 51564176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:25:59,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:25:59,891][988492] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-10 12:26:03,932][988492] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-10 12:26:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 51617792. Throughput: 0: 9940.7. Samples: 51594020. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:04,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:26:07,948][988492] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-10 12:26:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 51666944. Throughput: 0: 9924.7. Samples: 51654656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:09,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:26:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100912_51666944.pth... [2023-03-10 12:26:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100328_51367936.pth [2023-03-10 12:26:12,087][988492] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-10 12:26:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 51720192. Throughput: 0: 10013.9. Samples: 51715988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:14,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 12:26:15,987][988492] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-10 12:26:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 51769344. Throughput: 0: 10062.1. Samples: 51746764. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:19,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 12:26:19,944][988492] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-10 12:26:24,339][988492] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-10 12:26:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 51818496. Throughput: 0: 10042.6. Samples: 51806172. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:24,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 12:26:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101208_51818496.pth... [2023-03-10 12:26:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100616_51515392.pth [2023-03-10 12:26:28,554][988492] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-10 12:26:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 51867648. Throughput: 0: 10001.5. Samples: 51863404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:26:29,804][988181] Avg episode reward: [(0, '10.106')] [2023-03-10 12:26:32,890][988492] Updated weights for policy 0, policy_version 101360 (0.0004) [2023-03-10 12:26:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 51912704. Throughput: 0: 9972.8. Samples: 51891628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:26:37,155][988492] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-10 12:26:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 51961856. Throughput: 0: 9919.4. Samples: 51949484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:39,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:26:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101488_51961856.pth... [2023-03-10 12:26:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000100912_51666944.pth [2023-03-10 12:26:41,166][988492] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-10 12:26:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 52011008. Throughput: 0: 9927.1. Samples: 52010896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:44,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 12:26:45,200][988492] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-10 12:26:49,122][988492] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-10 12:26:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 52064256. Throughput: 0: 9926.2. Samples: 52040696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:49,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:26:53,328][988492] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-10 12:26:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 52113408. Throughput: 0: 9921.6. Samples: 52101128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:54,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:26:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101784_52113408.pth... [2023-03-10 12:26:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101208_51818496.pth [2023-03-10 12:26:57,454][988492] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-10 12:26:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 52162560. Throughput: 0: 9843.2. Samples: 52158932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:26:59,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 12:27:01,998][988492] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-10 12:27:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 52207616. Throughput: 0: 9779.3. Samples: 52186832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:04,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:27:06,208][988492] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-10 12:27:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 52256768. Throughput: 0: 9772.3. Samples: 52245924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:09,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:27:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102064_52256768.pth... [2023-03-10 12:27:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101488_51961856.pth [2023-03-10 12:27:10,419][988492] Updated weights for policy 0, policy_version 102080 (0.0006) [2023-03-10 12:27:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 52301824. Throughput: 0: 9741.6. Samples: 52301776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:14,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:27:14,836][988492] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-10 12:27:18,735][988492] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-10 12:27:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 52355072. Throughput: 0: 9785.1. Samples: 52331956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:19,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:27:22,433][988492] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-10 12:27:24,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 52408320. Throughput: 0: 9929.6. Samples: 52396316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:24,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:27:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102360_52408320.pth... [2023-03-10 12:27:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000101784_52113408.pth [2023-03-10 12:27:26,747][988492] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-10 12:27:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 52457472. Throughput: 0: 9836.6. Samples: 52453544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:29,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:27:31,007][988492] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-10 12:27:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 52506624. Throughput: 0: 9839.7. Samples: 52483484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:34,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:27:35,125][988492] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-10 12:27:39,364][988492] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-10 12:27:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 52555776. Throughput: 0: 9815.7. Samples: 52542836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:39,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:27:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102648_52555776.pth... [2023-03-10 12:27:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102064_52256768.pth [2023-03-10 12:27:43,513][988492] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-10 12:27:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 52604928. Throughput: 0: 9833.8. Samples: 52601452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:44,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:27:47,394][988492] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-10 12:27:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 52654080. Throughput: 0: 9923.7. Samples: 52633400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:49,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:27:51,576][988492] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-10 12:27:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 52703232. Throughput: 0: 9889.3. Samples: 52690944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:54,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:27:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102936_52703232.pth... [2023-03-10 12:27:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102360_52408320.pth [2023-03-10 12:27:56,091][988492] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-10 12:27:59,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 52748288. Throughput: 0: 9886.7. Samples: 52746680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:27:59,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:28:00,332][988492] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-10 12:28:04,606][988492] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-10 12:28:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 52797440. Throughput: 0: 9877.0. Samples: 52776420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:28:08,818][988492] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-10 12:28:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 52846592. Throughput: 0: 9727.3. Samples: 52834044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:09,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:28:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103216_52846592.pth... [2023-03-10 12:28:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102648_52555776.pth [2023-03-10 12:28:13,061][988492] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-10 12:28:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 52895744. Throughput: 0: 9735.4. Samples: 52891636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:28:17,147][988492] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-10 12:28:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 52944896. Throughput: 0: 9752.2. Samples: 52922332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:28:20,893][988492] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-10 12:28:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 52998144. Throughput: 0: 9845.1. Samples: 52985864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:24,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:28:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103512_52998144.pth... [2023-03-10 12:28:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000102936_52703232.pth [2023-03-10 12:28:25,037][988492] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-10 12:28:29,240][988492] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-10 12:28:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 53047296. Throughput: 0: 9829.1. Samples: 53043760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:29,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:28:33,584][988492] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-10 12:28:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 53092352. Throughput: 0: 9751.2. Samples: 53072204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:28:34,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:28:37,735][988492] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-10 12:28:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 53141504. Throughput: 0: 9781.3. Samples: 53131100. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:28:39,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:28:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103792_53141504.pth... [2023-03-10 12:28:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103216_52846592.pth [2023-03-10 12:28:41,926][988492] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-10 12:28:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 53190656. Throughput: 0: 9810.6. Samples: 53188156. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:28:44,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:28:46,240][988492] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-10 12:28:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 53239808. Throughput: 0: 9780.9. Samples: 53216560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:28:49,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:28:50,619][988492] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-10 12:28:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 53284864. Throughput: 0: 9795.1. Samples: 53274824. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:28:54,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 12:28:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104072_53284864.pth... [2023-03-10 12:28:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103512_52998144.pth [2023-03-10 12:28:54,861][988492] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-10 12:28:59,225][988492] Updated weights for policy 0, policy_version 104160 (0.0006) [2023-03-10 12:28:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9830.4). Total num frames: 53334016. Throughput: 0: 9757.5. Samples: 53330724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:28:59,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:29:03,275][988492] Updated weights for policy 0, policy_version 104240 (0.0006) [2023-03-10 12:29:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 53383168. Throughput: 0: 9782.3. Samples: 53362536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:04,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:29:07,414][988492] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-10 12:29:09,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 53436416. Throughput: 0: 9728.8. Samples: 53423660. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:09,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:29:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104368_53436416.pth... [2023-03-10 12:29:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000103792_53141504.pth [2023-03-10 12:29:11,067][988492] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-10 12:29:14,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 53489664. Throughput: 0: 9818.3. Samples: 53485584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:14,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:29:15,135][988492] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-10 12:29:19,138][988492] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-10 12:29:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 9858.2). Total num frames: 53538816. Throughput: 0: 9889.1. Samples: 53517212. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:19,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:29:23,470][988492] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-10 12:29:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 53587968. Throughput: 0: 9864.1. Samples: 53574984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:24,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:29:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104664_53587968.pth... [2023-03-10 12:29:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104072_53284864.pth [2023-03-10 12:29:27,315][988492] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-10 12:29:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 53637120. Throughput: 0: 9957.1. Samples: 53636224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:29,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:29:31,523][988492] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-10 12:29:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 53686272. Throughput: 0: 9982.9. Samples: 53665788. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:29:34,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:29:35,857][988492] Updated weights for policy 0, policy_version 104880 (0.0005) [2023-03-10 12:29:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 53731328. Throughput: 0: 9946.3. Samples: 53722408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:29:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:29:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104944_53731328.pth... [2023-03-10 12:29:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104368_53436416.pth [2023-03-10 12:29:40,314][988492] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-10 12:29:44,421][988492] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-10 12:29:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 53780480. Throughput: 0: 9975.3. Samples: 53779612. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:29:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:29:48,820][988492] Updated weights for policy 0, policy_version 105120 (0.0004) [2023-03-10 12:29:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 53829632. Throughput: 0: 9884.0. Samples: 53807316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:29:49,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:29:52,845][988492] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-10 12:29:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 53878784. Throughput: 0: 9849.8. Samples: 53866900. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:29:54,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:29:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105232_53878784.pth... [2023-03-10 12:29:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104664_53587968.pth [2023-03-10 12:29:56,946][988492] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-10 12:29:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9844.3). Total num frames: 53927936. Throughput: 0: 9825.4. Samples: 53927728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:29:59,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:30:01,124][988492] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-10 12:30:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 53981184. Throughput: 0: 9764.5. Samples: 53956616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:04,805][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:30:05,192][988492] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-10 12:30:09,402][988492] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-10 12:30:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 54026240. Throughput: 0: 9810.3. Samples: 54016448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:09,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:30:09,838][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105528_54030336.pth... [2023-03-10 12:30:09,840][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000104944_53731328.pth [2023-03-10 12:30:13,594][988492] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-10 12:30:14,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9844.3). Total num frames: 54075392. Throughput: 0: 9754.5. Samples: 54075176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:14,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:30:17,829][988492] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-10 12:30:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9844.3). Total num frames: 54124544. Throughput: 0: 9738.5. Samples: 54104020. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:19,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:30:21,977][988492] Updated weights for policy 0, policy_version 105760 (0.0004) [2023-03-10 12:30:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 54177792. Throughput: 0: 9804.1. Samples: 54163592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:24,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:30:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105816_54177792.pth... [2023-03-10 12:30:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105232_53878784.pth [2023-03-10 12:30:26,066][988492] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-10 12:30:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 54226944. Throughput: 0: 9854.6. Samples: 54223072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:29,805][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:30:30,162][988492] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-10 12:30:34,325][988492] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-10 12:30:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 54276096. Throughput: 0: 9886.4. Samples: 54252204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:30:34,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:30:38,450][988492] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-10 12:30:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54325248. Throughput: 0: 9904.7. Samples: 54312612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:30:39,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:30:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106104_54325248.pth... [2023-03-10 12:30:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105528_54030336.pth [2023-03-10 12:30:42,528][988492] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-10 12:30:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9858.2). Total num frames: 54374400. Throughput: 0: 9912.4. Samples: 54373784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:30:44,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:30:46,527][988492] Updated weights for policy 0, policy_version 106240 (0.0004) [2023-03-10 12:30:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54423552. Throughput: 0: 9921.2. Samples: 54403068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:30:49,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:30:50,579][988492] Updated weights for policy 0, policy_version 106320 (0.0004) [2023-03-10 12:30:54,706][988492] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-10 12:30:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 54476800. Throughput: 0: 9911.1. Samples: 54462448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:30:54,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:30:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106400_54476800.pth... [2023-03-10 12:30:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000105816_54177792.pth [2023-03-10 12:30:59,030][988492] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-10 12:30:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 54521856. Throughput: 0: 9916.6. Samples: 54521424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:30:59,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:31:02,840][988492] Updated weights for policy 0, policy_version 106560 (0.0006) [2023-03-10 12:31:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54575104. Throughput: 0: 9971.6. Samples: 54552744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:04,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:31:06,938][988492] Updated weights for policy 0, policy_version 106640 (0.0006) [2023-03-10 12:31:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 54624256. Throughput: 0: 10014.3. Samples: 54614236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:09,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:31:09,846][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106696_54628352.pth... [2023-03-10 12:31:09,848][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106104_54325248.pth [2023-03-10 12:31:11,164][988492] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-10 12:31:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 54677504. Throughput: 0: 10007.7. Samples: 54673416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:14,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:31:15,170][988492] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-10 12:31:19,343][988492] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-10 12:31:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 54726656. Throughput: 0: 10013.1. Samples: 54702792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:19,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:31:23,672][988492] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-10 12:31:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 54771712. Throughput: 0: 9939.8. Samples: 54759904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:24,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:31:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106976_54771712.pth... [2023-03-10 12:31:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106400_54476800.pth [2023-03-10 12:31:27,912][988492] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-10 12:31:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54820864. Throughput: 0: 9886.1. Samples: 54818660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:31:32,157][988492] Updated weights for policy 0, policy_version 107120 (0.0004) [2023-03-10 12:31:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54870016. Throughput: 0: 9878.3. Samples: 54847592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:31:34,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:31:36,435][988492] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-10 12:31:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 54919168. Throughput: 0: 9898.8. Samples: 54907892. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:31:39,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:31:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107264_54919168.pth... [2023-03-10 12:31:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106696_54628352.pth [2023-03-10 12:31:40,314][988492] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-10 12:31:44,447][988492] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-10 12:31:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 54968320. Throughput: 0: 9903.5. Samples: 54967080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:31:44,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:31:48,707][988492] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-10 12:31:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 55017472. Throughput: 0: 9870.4. Samples: 54996912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:31:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:31:52,807][988492] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-10 12:31:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55066624. Throughput: 0: 9787.0. Samples: 55054652. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:31:54,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:31:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107552_55066624.pth... [2023-03-10 12:31:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000106976_54771712.pth [2023-03-10 12:31:57,188][988492] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-10 12:31:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 55115776. Throughput: 0: 9740.8. Samples: 55111752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:31:59,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:32:01,176][988492] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-10 12:32:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 55164928. Throughput: 0: 9814.6. Samples: 55144448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:04,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:32:05,316][988492] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-10 12:32:09,579][988492] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-10 12:32:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9872.0). Total num frames: 55214080. Throughput: 0: 9834.3. Samples: 55202448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:09,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 12:32:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107840_55214080.pth... [2023-03-10 12:32:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107264_54919168.pth [2023-03-10 12:32:13,781][988492] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-10 12:32:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 55263232. Throughput: 0: 9805.1. Samples: 55259888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:14,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:32:18,031][988492] Updated weights for policy 0, policy_version 108000 (0.0006) [2023-03-10 12:32:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 55312384. Throughput: 0: 9795.8. Samples: 55288404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:32:22,109][988492] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-10 12:32:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55361536. Throughput: 0: 9805.8. Samples: 55349152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:24,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:32:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108128_55361536.pth... [2023-03-10 12:32:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107552_55066624.pth [2023-03-10 12:32:26,253][988492] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-10 12:32:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55410688. Throughput: 0: 9796.8. Samples: 55407936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:29,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:32:30,476][988492] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-10 12:32:34,663][988492] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-10 12:32:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55459840. Throughput: 0: 9809.5. Samples: 55438340. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:32:34,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:32:38,772][988492] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-10 12:32:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55508992. Throughput: 0: 9822.5. Samples: 55496664. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:32:39,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:32:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108416_55508992.pth... [2023-03-10 12:32:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000107840_55214080.pth [2023-03-10 12:32:42,659][988492] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-10 12:32:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 55558144. Throughput: 0: 9920.0. Samples: 55558152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:32:44,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:32:46,645][988492] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-10 12:32:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 55611392. Throughput: 0: 9903.9. Samples: 55590124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:32:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:32:50,719][988492] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-10 12:32:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 55660544. Throughput: 0: 9924.8. Samples: 55649064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:32:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:32:54,848][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108720_55664640.pth... [2023-03-10 12:32:54,849][988492] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-10 12:32:54,850][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108128_55361536.pth [2023-03-10 12:32:59,164][988492] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-10 12:32:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 55709696. Throughput: 0: 9944.5. Samples: 55707392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:32:59,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:33:03,239][988492] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-10 12:33:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 55762944. Throughput: 0: 9989.2. Samples: 55737920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:04,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:33:07,123][988492] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-10 12:33:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 55812096. Throughput: 0: 10023.4. Samples: 55800204. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:09,815][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:33:09,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109008_55812096.pth... [2023-03-10 12:33:09,822][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108416_55508992.pth [2023-03-10 12:33:11,251][988492] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-10 12:33:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 55861248. Throughput: 0: 10051.2. Samples: 55860240. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:14,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:33:15,179][988492] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-10 12:33:19,381][988492] Updated weights for policy 0, policy_version 109200 (0.0004) [2023-03-10 12:33:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 55910400. Throughput: 0: 10043.3. Samples: 55890288. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:19,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:33:23,572][988492] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-10 12:33:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 55959552. Throughput: 0: 10046.3. Samples: 55948748. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:24,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:33:24,825][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109304_55963648.pth... [2023-03-10 12:33:24,826][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000108720_55664640.pth [2023-03-10 12:33:27,773][988492] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-10 12:33:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 56012800. Throughput: 0: 10012.2. Samples: 56008700. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:29,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:33:31,826][988492] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-10 12:33:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 56057856. Throughput: 0: 9941.5. Samples: 56037492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 12:33:34,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:33:36,084][988492] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-10 12:33:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 56107008. Throughput: 0: 9948.8. Samples: 56096760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:33:39,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:33:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109584_56107008.pth... [2023-03-10 12:33:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109008_55812096.pth [2023-03-10 12:33:40,305][988492] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-10 12:33:44,499][988492] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-10 12:33:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 56156160. Throughput: 0: 9962.4. Samples: 56155700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:33:44,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:33:48,556][988492] Updated weights for policy 0, policy_version 109760 (0.0004) [2023-03-10 12:33:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 56209408. Throughput: 0: 9923.5. Samples: 56184476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:33:49,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:33:52,522][988492] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-10 12:33:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 56258560. Throughput: 0: 9914.8. Samples: 56246368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:33:54,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:33:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109880_56258560.pth... [2023-03-10 12:33:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109304_55963648.pth [2023-03-10 12:33:56,509][988492] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-10 12:33:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 56311808. Throughput: 0: 9945.2. Samples: 56307776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:33:59,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:34:00,568][988492] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-10 12:34:04,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 56356864. Throughput: 0: 9940.8. Samples: 56337624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:04,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:34:04,807][988492] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-10 12:34:08,905][988492] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-10 12:34:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 56406016. Throughput: 0: 9933.8. Samples: 56395768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:09,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 12:34:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110168_56406016.pth... [2023-03-10 12:34:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109584_56107008.pth [2023-03-10 12:34:13,313][988492] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-10 12:34:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 56455168. Throughput: 0: 9855.3. Samples: 56452188. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:14,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:34:17,520][988492] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-10 12:34:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 56504320. Throughput: 0: 9868.2. Samples: 56481564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:34:21,944][988492] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-10 12:34:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 56549376. Throughput: 0: 9786.5. Samples: 56537152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:24,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:34:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110448_56549376.pth... [2023-03-10 12:34:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000109880_56258560.pth [2023-03-10 12:34:26,265][988492] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-10 12:34:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 56598528. Throughput: 0: 9759.8. Samples: 56594892. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:29,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:34:30,621][988492] Updated weights for policy 0, policy_version 110560 (0.0004) [2023-03-10 12:34:34,751][988492] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-10 12:34:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 56647680. Throughput: 0: 9749.0. Samples: 56623180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:34,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:34:38,841][988492] Updated weights for policy 0, policy_version 110720 (0.0004) [2023-03-10 12:34:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.0). Total num frames: 56692736. Throughput: 0: 9705.1. Samples: 56683100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:34:39,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:34:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110736_56696832.pth... [2023-03-10 12:34:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110168_56406016.pth [2023-03-10 12:34:43,251][988492] Updated weights for policy 0, policy_version 110800 (0.0005) [2023-03-10 12:34:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 56741888. Throughput: 0: 9590.3. Samples: 56739340. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:34:44,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:34:47,545][988492] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-10 12:34:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 56791040. Throughput: 0: 9587.5. Samples: 56769060. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:34:49,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:34:51,550][988492] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-10 12:34:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 56844288. Throughput: 0: 9677.8. Samples: 56831272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:34:54,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:34:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111024_56844288.pth... [2023-03-10 12:34:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110448_56549376.pth [2023-03-10 12:34:55,483][988492] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-10 12:34:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 56889344. Throughput: 0: 9714.4. Samples: 56889336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:34:59,815][988492] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-10 12:34:59,815][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:35:03,982][988492] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-10 12:35:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 56942592. Throughput: 0: 9700.4. Samples: 56918080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:35:08,384][988492] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-10 12:35:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.8, 300 sec: 9872.0). Total num frames: 56987648. Throughput: 0: 9736.3. Samples: 56975284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:09,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:35:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111304_56987648.pth... [2023-03-10 12:35:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000110736_56696832.pth [2023-03-10 12:35:12,536][988492] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-10 12:35:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 57036800. Throughput: 0: 9746.6. Samples: 57033488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:14,805][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:35:16,657][988492] Updated weights for policy 0, policy_version 111440 (0.0005) [2023-03-10 12:35:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 57085952. Throughput: 0: 9811.6. Samples: 57064700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:19,815][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:35:20,930][988492] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-10 12:35:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 57135104. Throughput: 0: 9757.0. Samples: 57122164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:24,815][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:35:24,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111592_57135104.pth... [2023-03-10 12:35:24,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111024_56844288.pth [2023-03-10 12:35:25,044][988492] Updated weights for policy 0, policy_version 111600 (0.0006) [2023-03-10 12:35:29,048][988492] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-10 12:35:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 57188352. Throughput: 0: 9881.3. Samples: 57183996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:29,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:35:32,596][988492] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-10 12:35:34,804][988181] Fps is (10 sec: 10649.8, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 57241600. Throughput: 0: 9992.1. Samples: 57218704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:34,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:35:36,709][988492] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-10 12:35:39,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 57290752. Throughput: 0: 9937.0. Samples: 57278436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:35:39,805][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:35:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111896_57290752.pth... [2023-03-10 12:35:39,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111304_56987648.pth [2023-03-10 12:35:40,967][988492] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-10 12:35:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 57339904. Throughput: 0: 9923.0. Samples: 57335872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:35:44,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:35:45,207][988492] Updated weights for policy 0, policy_version 112000 (0.0004) [2023-03-10 12:35:49,072][988492] Updated weights for policy 0, policy_version 112080 (0.0004) [2023-03-10 12:35:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 57389056. Throughput: 0: 9948.9. Samples: 57365780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:35:49,804][988181] Avg episode reward: [(0, '10.092')] [2023-03-10 12:35:53,534][988492] Updated weights for policy 0, policy_version 112160 (0.0006) [2023-03-10 12:35:54,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 57438208. Throughput: 0: 9980.6. Samples: 57424412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:35:54,815][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:35:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112184_57438208.pth... [2023-03-10 12:35:54,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111592_57135104.pth [2023-03-10 12:35:57,592][988492] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-10 12:35:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 57487360. Throughput: 0: 10027.5. Samples: 57484724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:35:59,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:36:01,681][988492] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-10 12:36:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 57536512. Throughput: 0: 10023.7. Samples: 57515768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:36:05,771][988492] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-10 12:36:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 57585664. Throughput: 0: 10028.4. Samples: 57573440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:09,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:36:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112472_57585664.pth... [2023-03-10 12:36:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000111896_57290752.pth [2023-03-10 12:36:09,983][988492] Updated weights for policy 0, policy_version 112480 (0.0004) [2023-03-10 12:36:14,113][988492] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-10 12:36:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 9858.2). Total num frames: 57634816. Throughput: 0: 9985.4. Samples: 57633340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:14,814][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:36:18,111][988492] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-10 12:36:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 57688064. Throughput: 0: 9893.8. Samples: 57663928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:19,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:36:22,225][988492] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-10 12:36:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 57733120. Throughput: 0: 9869.6. Samples: 57722568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:24,804][988181] Avg episode reward: [(0, '10.106')] [2023-03-10 12:36:24,829][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112768_57737216.pth... [2023-03-10 12:36:24,831][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112184_57438208.pth [2023-03-10 12:36:26,406][988492] Updated weights for policy 0, policy_version 112800 (0.0005) [2023-03-10 12:36:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 57786368. Throughput: 0: 9918.9. Samples: 57782224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:29,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:36:30,642][988492] Updated weights for policy 0, policy_version 112880 (0.0006) [2023-03-10 12:36:34,701][988492] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-10 12:36:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 9885.9). Total num frames: 57835520. Throughput: 0: 9894.1. Samples: 57811016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:36:39,109][988492] Updated weights for policy 0, policy_version 113040 (0.0004) [2023-03-10 12:36:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 57880576. Throughput: 0: 9910.9. Samples: 57870404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:39,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:36:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113048_57880576.pth... [2023-03-10 12:36:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112472_57585664.pth [2023-03-10 12:36:43,100][988492] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-10 12:36:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9885.9). Total num frames: 57933824. Throughput: 0: 9890.4. Samples: 57929792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:44,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:36:47,316][988492] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-10 12:36:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 57978880. Throughput: 0: 9837.7. Samples: 57958464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:49,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 12:36:51,504][988492] Updated weights for policy 0, policy_version 113280 (0.0004) [2023-03-10 12:36:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58032128. Throughput: 0: 9862.2. Samples: 58017240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:54,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:36:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113344_58032128.pth... [2023-03-10 12:36:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000112768_57737216.pth [2023-03-10 12:36:55,543][988492] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-10 12:36:59,635][988492] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-10 12:36:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58081280. Throughput: 0: 9882.9. Samples: 58078072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:36:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:37:03,748][988492] Updated weights for policy 0, policy_version 113520 (0.0005) [2023-03-10 12:37:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58130432. Throughput: 0: 9891.6. Samples: 58109052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:04,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:37:08,219][988492] Updated weights for policy 0, policy_version 113600 (0.0005) [2023-03-10 12:37:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 58175488. Throughput: 0: 9808.5. Samples: 58163948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:09,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:37:09,835][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113632_58179584.pth... [2023-03-10 12:37:09,837][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113048_57880576.pth [2023-03-10 12:37:12,202][988492] Updated weights for policy 0, policy_version 113680 (0.0004) [2023-03-10 12:37:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58228736. Throughput: 0: 9833.1. Samples: 58224712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:14,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:37:16,442][988492] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-10 12:37:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 58277888. Throughput: 0: 9860.2. Samples: 58254724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:19,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:37:20,544][988492] Updated weights for policy 0, policy_version 113840 (0.0004) [2023-03-10 12:37:24,650][988492] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-10 12:37:24,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58327040. Throughput: 0: 9874.4. Samples: 58314752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:24,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:37:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113920_58327040.pth... [2023-03-10 12:37:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113344_58032128.pth [2023-03-10 12:37:28,571][988492] Updated weights for policy 0, policy_version 114000 (0.0004) [2023-03-10 12:37:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 58376192. Throughput: 0: 9918.9. Samples: 58376144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:29,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:37:32,751][988492] Updated weights for policy 0, policy_version 114080 (0.0004) [2023-03-10 12:37:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 58425344. Throughput: 0: 9921.4. Samples: 58404928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:34,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:37:36,962][988492] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-10 12:37:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58474496. Throughput: 0: 9922.4. Samples: 58463748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:37:39,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:37:39,812][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114216_58478592.pth... [2023-03-10 12:37:39,814][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113632_58179584.pth [2023-03-10 12:37:41,020][988492] Updated weights for policy 0, policy_version 114240 (0.0006) [2023-03-10 12:37:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 58527744. Throughput: 0: 9898.5. Samples: 58523504. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:37:44,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:37:45,095][988492] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-10 12:37:49,562][988492] Updated weights for policy 0, policy_version 114400 (0.0004) [2023-03-10 12:37:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 58572800. Throughput: 0: 9851.8. Samples: 58552384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:37:49,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 12:37:53,979][988492] Updated weights for policy 0, policy_version 114480 (0.0005) [2023-03-10 12:37:54,804][988181] Fps is (10 sec: 9011.1, 60 sec: 9762.1, 300 sec: 9858.2). Total num frames: 58617856. Throughput: 0: 9867.5. Samples: 58607988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:37:54,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 12:37:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114488_58617856.pth... [2023-03-10 12:37:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000113920_58327040.pth [2023-03-10 12:37:58,204][988492] Updated weights for policy 0, policy_version 114560 (0.0005) [2023-03-10 12:37:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 58671104. Throughput: 0: 9830.2. Samples: 58667072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:37:59,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:38:02,205][988492] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-10 12:38:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 58720256. Throughput: 0: 9827.1. Samples: 58696944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:04,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:38:06,080][988492] Updated weights for policy 0, policy_version 114720 (0.0006) [2023-03-10 12:38:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 58769408. Throughput: 0: 9866.5. Samples: 58758744. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:09,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:38:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114784_58769408.pth... [2023-03-10 12:38:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114216_58478592.pth [2023-03-10 12:38:10,401][988492] Updated weights for policy 0, policy_version 114800 (0.0004) [2023-03-10 12:38:14,265][988492] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-10 12:38:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 58822656. Throughput: 0: 9840.5. Samples: 58818964. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:14,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:38:18,319][988492] Updated weights for policy 0, policy_version 114960 (0.0006) [2023-03-10 12:38:19,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 58875904. Throughput: 0: 9898.9. Samples: 58850380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:19,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:38:22,256][988492] Updated weights for policy 0, policy_version 115040 (0.0004) [2023-03-10 12:38:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 58925056. Throughput: 0: 9946.5. Samples: 58911340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:24,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:38:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115088_58925056.pth... [2023-03-10 12:38:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114488_58617856.pth [2023-03-10 12:38:26,447][988492] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-10 12:38:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 58974208. Throughput: 0: 9956.9. Samples: 58971564. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:29,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:38:30,438][988492] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-10 12:38:34,602][988492] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-10 12:38:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 59023360. Throughput: 0: 10000.1. Samples: 59002388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:34,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:38:38,699][988492] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-10 12:38:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 59072512. Throughput: 0: 10051.1. Samples: 59060288. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:39,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:38:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115376_59072512.pth... [2023-03-10 12:38:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000114784_58769408.pth [2023-03-10 12:38:42,871][988492] Updated weights for policy 0, policy_version 115440 (0.0005) [2023-03-10 12:38:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 59121664. Throughput: 0: 10073.3. Samples: 59120368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:44,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:38:46,927][988492] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-10 12:38:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 59174912. Throughput: 0: 10075.4. Samples: 59150336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:49,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:38:50,871][988492] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-10 12:38:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9872.1). Total num frames: 59224064. Throughput: 0: 10067.6. Samples: 59211784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:54,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:38:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115672_59224064.pth... [2023-03-10 12:38:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115088_58925056.pth [2023-03-10 12:38:55,038][988492] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-10 12:38:59,085][988492] Updated weights for policy 0, policy_version 115760 (0.0004) [2023-03-10 12:38:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 59273216. Throughput: 0: 10068.1. Samples: 59272028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:38:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:39:03,098][988492] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-10 12:39:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 59322368. Throughput: 0: 10033.0. Samples: 59301864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:04,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:39:07,356][988492] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-10 12:39:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 59371520. Throughput: 0: 9995.4. Samples: 59361132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:09,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 12:39:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115960_59371520.pth... [2023-03-10 12:39:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115376_59072512.pth [2023-03-10 12:39:11,374][988492] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-10 12:39:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 59424768. Throughput: 0: 10016.7. Samples: 59422316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:14,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:39:15,525][988492] Updated weights for policy 0, policy_version 116080 (0.0006) [2023-03-10 12:39:19,595][988492] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-10 12:39:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 59473920. Throughput: 0: 9965.2. Samples: 59450820. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:19,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:39:23,744][988492] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-10 12:39:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 59523072. Throughput: 0: 10013.1. Samples: 59510876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:24,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:39:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116256_59523072.pth... [2023-03-10 12:39:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115672_59224064.pth [2023-03-10 12:39:27,781][988492] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-10 12:39:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 59572224. Throughput: 0: 10035.5. Samples: 59571964. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:29,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:39:32,066][988492] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-10 12:39:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 59625472. Throughput: 0: 9993.6. Samples: 59600048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:34,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:39:35,934][988492] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-10 12:39:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 59674624. Throughput: 0: 10009.8. Samples: 59662224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:39,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:39:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116552_59674624.pth... [2023-03-10 12:39:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000115960_59371520.pth [2023-03-10 12:39:40,034][988492] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-10 12:39:44,142][988492] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-10 12:39:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 59723776. Throughput: 0: 9996.1. Samples: 59721852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:39:44,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:39:48,407][988492] Updated weights for policy 0, policy_version 116720 (0.0006) [2023-03-10 12:39:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 59772928. Throughput: 0: 9977.1. Samples: 59750832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:39:49,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:39:52,501][988492] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-10 12:39:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 59822080. Throughput: 0: 9981.8. Samples: 59810312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:39:54,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:39:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116840_59822080.pth... [2023-03-10 12:39:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116256_59523072.pth [2023-03-10 12:39:56,661][988492] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-10 12:39:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 59871232. Throughput: 0: 9963.0. Samples: 59870648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:39:59,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:40:00,618][988492] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-10 12:40:04,791][988492] Updated weights for policy 0, policy_version 117040 (0.0004) [2023-03-10 12:40:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 59924480. Throughput: 0: 9981.1. Samples: 59899968. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:04,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:40:09,052][988492] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-10 12:40:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 59969536. Throughput: 0: 9920.8. Samples: 59957312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:09,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:40:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117128_59969536.pth... [2023-03-10 12:40:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116552_59674624.pth [2023-03-10 12:40:13,205][988492] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-10 12:40:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 60018688. Throughput: 0: 9924.2. Samples: 60018552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:14,804][988181] Avg episode reward: [(0, '10.095')] [2023-03-10 12:40:17,425][988492] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-10 12:40:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9967.0, 300 sec: 9955.4). Total num frames: 60071936. Throughput: 0: 9938.3. Samples: 60047268. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:19,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:40:21,339][988492] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-10 12:40:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 60121088. Throughput: 0: 9923.6. Samples: 60108788. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:24,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:40:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117424_60121088.pth... [2023-03-10 12:40:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000116840_59822080.pth [2023-03-10 12:40:25,507][988492] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-10 12:40:29,697][988492] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-10 12:40:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 60170240. Throughput: 0: 9889.6. Samples: 60166884. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:29,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:40:33,841][988492] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-10 12:40:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60219392. Throughput: 0: 9881.4. Samples: 60195496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:34,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:40:37,920][988492] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-10 12:40:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60268544. Throughput: 0: 9909.9. Samples: 60256256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:39,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:40:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117712_60268544.pth... [2023-03-10 12:40:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117128_59969536.pth [2023-03-10 12:40:41,759][988492] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-10 12:40:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 60321792. Throughput: 0: 9934.4. Samples: 60317696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:40:44,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:40:46,013][988492] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-10 12:40:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 60370944. Throughput: 0: 9922.1. Samples: 60346464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:40:49,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:40:50,204][988492] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-10 12:40:54,417][988492] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-10 12:40:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60416000. Throughput: 0: 9957.2. Samples: 60405388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:40:54,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:40:54,848][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118008_60420096.pth... [2023-03-10 12:40:54,849][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117424_60121088.pth [2023-03-10 12:40:58,525][988492] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-10 12:40:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 60469248. Throughput: 0: 9926.1. Samples: 60465224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:40:59,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:41:02,720][988492] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-10 12:41:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 60514304. Throughput: 0: 9924.9. Samples: 60493888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:04,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:41:06,983][988492] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-10 12:41:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60563456. Throughput: 0: 9832.3. Samples: 60551240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:09,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:41:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118288_60563456.pth... [2023-03-10 12:41:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000117712_60268544.pth [2023-03-10 12:41:11,064][988492] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-10 12:41:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 60612608. Throughput: 0: 9905.0. Samples: 60612608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:14,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 12:41:15,241][988492] Updated weights for policy 0, policy_version 118400 (0.0005) [2023-03-10 12:41:19,336][988492] Updated weights for policy 0, policy_version 118480 (0.0005) [2023-03-10 12:41:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 9941.5). Total num frames: 60665856. Throughput: 0: 9907.7. Samples: 60641344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:19,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:41:23,516][988492] Updated weights for policy 0, policy_version 118560 (0.0005) [2023-03-10 12:41:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60715008. Throughput: 0: 9890.5. Samples: 60701328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:24,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:41:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118584_60715008.pth... [2023-03-10 12:41:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118008_60420096.pth [2023-03-10 12:41:27,615][988492] Updated weights for policy 0, policy_version 118640 (0.0004) [2023-03-10 12:41:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60764160. Throughput: 0: 9902.3. Samples: 60763296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:29,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:41:31,680][988492] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-10 12:41:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 60813312. Throughput: 0: 9907.7. Samples: 60792312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:34,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:41:35,913][988492] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-10 12:41:39,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 60862464. Throughput: 0: 9875.8. Samples: 60849800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:39,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:41:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118872_60862464.pth... [2023-03-10 12:41:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118288_60563456.pth [2023-03-10 12:41:40,061][988492] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-10 12:41:44,319][988492] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-10 12:41:44,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 60911616. Throughput: 0: 9830.2. Samples: 60907584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:44,805][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:41:48,309][988492] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-10 12:41:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 60960768. Throughput: 0: 9873.8. Samples: 60938208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:49,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:41:52,654][988492] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-10 12:41:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 61009920. Throughput: 0: 9876.1. Samples: 60995664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:54,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:41:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119160_61009920.pth... [2023-03-10 12:41:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118584_60715008.pth [2023-03-10 12:41:56,828][988492] Updated weights for policy 0, policy_version 119200 (0.0004) [2023-03-10 12:41:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61059072. Throughput: 0: 9830.6. Samples: 61054984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:41:59,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:42:01,051][988492] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-10 12:42:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 61108224. Throughput: 0: 9835.9. Samples: 61083960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:04,804][988181] Avg episode reward: [(0, '10.105')] [2023-03-10 12:42:05,105][988492] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-10 12:42:09,413][988492] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-10 12:42:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 61153280. Throughput: 0: 9857.7. Samples: 61144924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:09,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:42:09,865][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119448_61157376.pth... [2023-03-10 12:42:09,867][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000118872_60862464.pth [2023-03-10 12:42:13,641][988492] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-10 12:42:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 61202432. Throughput: 0: 9757.8. Samples: 61202396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:14,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:42:17,805][988492] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-10 12:42:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9913.7). Total num frames: 61251584. Throughput: 0: 9750.9. Samples: 61231104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:42:21,982][988492] Updated weights for policy 0, policy_version 119680 (0.0004) [2023-03-10 12:42:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61304832. Throughput: 0: 9815.6. Samples: 61291504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:24,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:42:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119736_61304832.pth... [2023-03-10 12:42:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119160_61009920.pth [2023-03-10 12:42:25,864][988492] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-10 12:42:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61353984. Throughput: 0: 9899.0. Samples: 61353036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:29,804][988181] Avg episode reward: [(0, '10.096')] [2023-03-10 12:42:29,885][988492] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-10 12:42:34,096][988492] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-10 12:42:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61403136. Throughput: 0: 9863.8. Samples: 61382080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:34,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:42:38,199][988492] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-10 12:42:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 61452288. Throughput: 0: 9901.8. Samples: 61441244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:39,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:42:39,861][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120032_61456384.pth... [2023-03-10 12:42:39,864][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119448_61157376.pth [2023-03-10 12:42:42,340][988492] Updated weights for policy 0, policy_version 120080 (0.0006) [2023-03-10 12:42:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61501440. Throughput: 0: 9915.3. Samples: 61501172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:42:46,771][988492] Updated weights for policy 0, policy_version 120160 (0.0004) [2023-03-10 12:42:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 61550592. Throughput: 0: 9839.5. Samples: 61526736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:49,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:42:51,030][988492] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-10 12:42:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 61599744. Throughput: 0: 9830.0. Samples: 61587272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:54,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:42:54,810][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120320_61603840.pth... [2023-03-10 12:42:54,810][988492] Updated weights for policy 0, policy_version 120320 (0.0004) [2023-03-10 12:42:54,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000119736_61304832.pth [2023-03-10 12:42:58,837][988492] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-10 12:42:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 61652992. Throughput: 0: 9973.0. Samples: 61651180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:42:59,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:43:02,826][988492] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-10 12:43:04,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 61706240. Throughput: 0: 10012.0. Samples: 61681644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:04,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:43:06,767][988492] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-10 12:43:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 61755392. Throughput: 0: 10037.0. Samples: 61743168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:43:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120616_61755392.pth... [2023-03-10 12:43:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120032_61456384.pth [2023-03-10 12:43:10,872][988492] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-10 12:43:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 61804544. Throughput: 0: 9942.5. Samples: 61800448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:14,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:43:15,114][988492] Updated weights for policy 0, policy_version 120720 (0.0004) [2023-03-10 12:43:19,137][988492] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-10 12:43:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 61853696. Throughput: 0: 9952.3. Samples: 61829932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:19,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:43:23,130][988492] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-10 12:43:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 61906944. Throughput: 0: 10036.7. Samples: 61892896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:24,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:43:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120912_61906944.pth... [2023-03-10 12:43:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120320_61603840.pth [2023-03-10 12:43:27,127][988492] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-10 12:43:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 61956096. Throughput: 0: 10033.6. Samples: 61952684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:29,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:43:31,215][988492] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-10 12:43:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 62005248. Throughput: 0: 10158.9. Samples: 61983888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:34,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:43:35,464][988492] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-10 12:43:39,423][988492] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-10 12:43:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 62058496. Throughput: 0: 10128.3. Samples: 62043048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:39,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:43:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121208_62058496.pth... [2023-03-10 12:43:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120616_61755392.pth [2023-03-10 12:43:43,401][988492] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-10 12:43:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.4, 300 sec: 9941.5). Total num frames: 62107648. Throughput: 0: 10058.8. Samples: 62103828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:44,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:43:47,667][988492] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-10 12:43:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 62152704. Throughput: 0: 10027.5. Samples: 62132880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:43:49,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:43:51,879][988492] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-10 12:43:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 62205952. Throughput: 0: 10005.7. Samples: 62193424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:43:54,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:43:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121496_62205952.pth... [2023-03-10 12:43:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000120912_61906944.pth [2023-03-10 12:43:55,961][988492] Updated weights for policy 0, policy_version 121520 (0.0006) [2023-03-10 12:43:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 62255104. Throughput: 0: 10041.6. Samples: 62252320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:43:59,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 12:44:00,038][988492] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-10 12:44:04,065][988492] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-10 12:44:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 62304256. Throughput: 0: 10083.2. Samples: 62283676. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:04,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:44:08,222][988492] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-10 12:44:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 62357504. Throughput: 0: 9981.7. Samples: 62342072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:09,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:44:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121792_62357504.pth... [2023-03-10 12:44:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121208_62058496.pth [2023-03-10 12:44:12,348][988492] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-10 12:44:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 62402560. Throughput: 0: 9985.5. Samples: 62402032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:14,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 12:44:16,660][988492] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-10 12:44:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 62451712. Throughput: 0: 9910.2. Samples: 62429848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:19,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:44:20,905][988492] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-10 12:44:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 62500864. Throughput: 0: 9904.8. Samples: 62488764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:24,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:44:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122072_62500864.pth... [2023-03-10 12:44:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121496_62205952.pth [2023-03-10 12:44:24,898][988492] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-10 12:44:28,971][988492] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-10 12:44:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 62550016. Throughput: 0: 9909.6. Samples: 62549760. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:29,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:44:33,175][988492] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-10 12:44:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 62599168. Throughput: 0: 9906.3. Samples: 62578664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:34,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:44:37,451][988492] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-10 12:44:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 62648320. Throughput: 0: 9837.3. Samples: 62636104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:39,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:44:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122360_62648320.pth... [2023-03-10 12:44:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000121792_62357504.pth [2023-03-10 12:44:41,721][988492] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-10 12:44:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 62697472. Throughput: 0: 9831.9. Samples: 62694756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:44,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:44:45,906][988492] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-10 12:44:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 62742528. Throughput: 0: 9785.1. Samples: 62724004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 12:44:49,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:44:50,266][988492] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-10 12:44:54,631][988492] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-10 12:44:54,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 62791680. Throughput: 0: 9730.3. Samples: 62779936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:44:54,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:44:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122640_62791680.pth... [2023-03-10 12:44:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122072_62500864.pth [2023-03-10 12:44:58,871][988492] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-10 12:44:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 62840832. Throughput: 0: 9661.5. Samples: 62836800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:44:59,805][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:45:03,114][988492] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-10 12:45:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 62885888. Throughput: 0: 9689.2. Samples: 62865864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:04,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:45:07,107][988492] Updated weights for policy 0, policy_version 122880 (0.0004) [2023-03-10 12:45:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 62939136. Throughput: 0: 9741.5. Samples: 62927132. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:09,804][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 12:45:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122928_62939136.pth... [2023-03-10 12:45:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122360_62648320.pth [2023-03-10 12:45:11,137][988492] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-10 12:45:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 62988288. Throughput: 0: 9668.0. Samples: 62984820. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:14,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:45:15,561][988492] Updated weights for policy 0, policy_version 123040 (0.0004) [2023-03-10 12:45:19,446][988492] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-10 12:45:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 63037440. Throughput: 0: 9655.2. Samples: 63013148. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:19,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:45:23,606][988492] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-10 12:45:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 63090688. Throughput: 0: 9777.7. Samples: 63076100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:24,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:45:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123224_63090688.pth... [2023-03-10 12:45:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122640_62791680.pth [2023-03-10 12:45:27,742][988492] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-10 12:45:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 63139840. Throughput: 0: 9799.9. Samples: 63135752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:29,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:45:31,828][988492] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-10 12:45:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 63188992. Throughput: 0: 9790.6. Samples: 63164580. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:34,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:45:36,031][988492] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-10 12:45:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.2, 300 sec: 9872.1). Total num frames: 63234048. Throughput: 0: 9874.0. Samples: 63224264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:39,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:45:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123504_63234048.pth... [2023-03-10 12:45:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000122928_62939136.pth [2023-03-10 12:45:40,280][988492] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-10 12:45:44,452][988492] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-10 12:45:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 63283200. Throughput: 0: 9907.2. Samples: 63282624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:44,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:45:48,481][988492] Updated weights for policy 0, policy_version 123680 (0.0004) [2023-03-10 12:45:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 63336448. Throughput: 0: 9926.8. Samples: 63312572. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:49,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:45:52,312][988492] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-10 12:45:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 63385600. Throughput: 0: 9943.2. Samples: 63374576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:45:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123800_63385600.pth... [2023-03-10 12:45:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123224_63090688.pth [2023-03-10 12:45:56,584][988492] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-10 12:45:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 63434752. Throughput: 0: 9944.6. Samples: 63432328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:45:59,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 12:46:00,744][988492] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-10 12:46:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 63479808. Throughput: 0: 9938.5. Samples: 63460380. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:04,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:46:05,273][988492] Updated weights for policy 0, policy_version 124000 (0.0004) [2023-03-10 12:46:09,429][988492] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-10 12:46:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 63528960. Throughput: 0: 9864.5. Samples: 63520000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:09,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:46:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124080_63528960.pth... [2023-03-10 12:46:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123504_63234048.pth [2023-03-10 12:46:13,425][988492] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-10 12:46:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 63582208. Throughput: 0: 9869.2. Samples: 63579868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:14,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:46:17,283][988492] Updated weights for policy 0, policy_version 124240 (0.0004) [2023-03-10 12:46:19,804][988181] Fps is (10 sec: 10649.7, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 63635456. Throughput: 0: 9920.6. Samples: 63611008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:19,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:46:21,411][988492] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-10 12:46:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 63680512. Throughput: 0: 9925.4. Samples: 63670908. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:24,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:46:24,850][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124384_63684608.pth... [2023-03-10 12:46:24,851][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000123800_63385600.pth [2023-03-10 12:46:25,801][988492] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-10 12:46:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 63729664. Throughput: 0: 9904.4. Samples: 63728320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:29,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:46:29,917][988492] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-10 12:46:34,369][988492] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-10 12:46:34,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 63774720. Throughput: 0: 9855.0. Samples: 63756048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:34,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 12:46:38,478][988492] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-10 12:46:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 63827968. Throughput: 0: 9789.6. Samples: 63815108. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:39,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:46:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124664_63827968.pth... [2023-03-10 12:46:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124080_63528960.pth [2023-03-10 12:46:42,470][988492] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-10 12:46:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 63877120. Throughput: 0: 9859.9. Samples: 63876024. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:44,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:46:46,530][988492] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-10 12:46:49,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.6, 300 sec: 9899.8). Total num frames: 63930368. Throughput: 0: 9899.6. Samples: 63905864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:49,805][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:46:50,584][988492] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-10 12:46:54,561][988492] Updated weights for policy 0, policy_version 124960 (0.0004) [2023-03-10 12:46:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 63979520. Throughput: 0: 9938.6. Samples: 63967240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:46:54,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:46:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124960_63979520.pth... [2023-03-10 12:46:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124384_63684608.pth [2023-03-10 12:46:58,586][988492] Updated weights for policy 0, policy_version 125040 (0.0004) [2023-03-10 12:46:59,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 64028672. Throughput: 0: 9964.9. Samples: 64028288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:46:59,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:47:02,840][988492] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-10 12:47:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 64077824. Throughput: 0: 9916.3. Samples: 64057244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:04,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:47:07,002][988492] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-10 12:47:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 64126976. Throughput: 0: 9876.2. Samples: 64115340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:09,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:47:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125248_64126976.pth... [2023-03-10 12:47:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124664_63827968.pth [2023-03-10 12:47:11,260][988492] Updated weights for policy 0, policy_version 125280 (0.0005) [2023-03-10 12:47:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 64176128. Throughput: 0: 9860.4. Samples: 64172040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:14,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:47:15,466][988492] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-10 12:47:19,638][988492] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-10 12:47:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 64225280. Throughput: 0: 9926.8. Samples: 64202752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:47:23,856][988492] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-10 12:47:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 64274432. Throughput: 0: 9924.2. Samples: 64261696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:24,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:47:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125536_64274432.pth... [2023-03-10 12:47:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000124960_63979520.pth [2023-03-10 12:47:27,924][988492] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-10 12:47:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9899.8). Total num frames: 64323584. Throughput: 0: 9897.4. Samples: 64321408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:29,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:47:31,928][988492] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-10 12:47:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 64372736. Throughput: 0: 9918.9. Samples: 64352212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:34,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 12:47:36,083][988492] Updated weights for policy 0, policy_version 125760 (0.0004) [2023-03-10 12:47:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 64425984. Throughput: 0: 9874.0. Samples: 64411568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:39,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 12:47:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125832_64425984.pth... [2023-03-10 12:47:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125248_64126976.pth [2023-03-10 12:47:40,176][988492] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-10 12:47:44,155][988492] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-10 12:47:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 64475136. Throughput: 0: 9878.6. Samples: 64472824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:44,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:47:48,160][988492] Updated weights for policy 0, policy_version 126000 (0.0006) [2023-03-10 12:47:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9967.0, 300 sec: 9927.6). Total num frames: 64528384. Throughput: 0: 9910.4. Samples: 64503212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:49,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:47:51,900][988492] Updated weights for policy 0, policy_version 126080 (0.0005) [2023-03-10 12:47:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9913.7). Total num frames: 64577536. Throughput: 0: 10044.0. Samples: 64567320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:54,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:47:54,865][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126136_64581632.pth... [2023-03-10 12:47:54,867][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125536_64274432.pth [2023-03-10 12:47:55,976][988492] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-10 12:47:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 64630784. Throughput: 0: 10138.0. Samples: 64628252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:47:59,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 12:48:00,001][988492] Updated weights for policy 0, policy_version 126240 (0.0005) [2023-03-10 12:48:04,075][988492] Updated weights for policy 0, policy_version 126320 (0.0005) [2023-03-10 12:48:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 64679936. Throughput: 0: 10145.9. Samples: 64659316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:04,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:48:08,420][988492] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-10 12:48:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 64729088. Throughput: 0: 10109.9. Samples: 64716644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:48:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126424_64729088.pth... [2023-03-10 12:48:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000125832_64425984.pth [2023-03-10 12:48:12,550][988492] Updated weights for policy 0, policy_version 126480 (0.0006) [2023-03-10 12:48:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 64778240. Throughput: 0: 10096.1. Samples: 64775732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:14,805][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:48:16,385][988492] Updated weights for policy 0, policy_version 126560 (0.0006) [2023-03-10 12:48:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9913.7). Total num frames: 64831488. Throughput: 0: 10110.1. Samples: 64807168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:19,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:48:20,481][988492] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-10 12:48:24,553][988492] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-10 12:48:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.4, 300 sec: 9913.7). Total num frames: 64880640. Throughput: 0: 10158.8. Samples: 64868716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:24,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:48:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126720_64880640.pth... [2023-03-10 12:48:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126136_64581632.pth [2023-03-10 12:48:28,640][988492] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-10 12:48:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 64933888. Throughput: 0: 10154.8. Samples: 64929792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:29,804][988181] Avg episode reward: [(0, '10.101')] [2023-03-10 12:48:32,034][988492] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-10 12:48:34,804][988181] Fps is (10 sec: 10649.7, 60 sec: 10240.0, 300 sec: 9927.6). Total num frames: 64987136. Throughput: 0: 10298.3. Samples: 64966636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:34,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:48:36,071][988492] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-10 12:48:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 65036288. Throughput: 0: 10175.3. Samples: 65025208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:39,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 12:48:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127024_65036288.pth... [2023-03-10 12:48:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126424_64729088.pth [2023-03-10 12:48:40,358][988492] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-10 12:48:44,383][988492] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-10 12:48:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9941.5). Total num frames: 65085440. Throughput: 0: 10158.3. Samples: 65085376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:44,804][988181] Avg episode reward: [(0, '10.104')] [2023-03-10 12:48:48,737][988492] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-10 12:48:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 9927.6). Total num frames: 65134592. Throughput: 0: 10092.1. Samples: 65113460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:48:52,838][988492] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-10 12:48:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 65183744. Throughput: 0: 10114.5. Samples: 65171796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:54,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:48:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127312_65183744.pth... [2023-03-10 12:48:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000126720_64880640.pth [2023-03-10 12:48:57,155][988492] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-10 12:48:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 65232896. Throughput: 0: 10084.9. Samples: 65229552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:48:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:49:01,302][988492] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-10 12:49:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 65282048. Throughput: 0: 10069.6. Samples: 65260300. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:04,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:49:05,478][988492] Updated weights for policy 0, policy_version 127520 (0.0004) [2023-03-10 12:49:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9913.7). Total num frames: 65327104. Throughput: 0: 9946.5. Samples: 65316308. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:09,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 12:49:09,816][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127600_65331200.pth... [2023-03-10 12:49:09,817][988492] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-10 12:49:09,818][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127024_65036288.pth [2023-03-10 12:49:13,981][988492] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-10 12:49:14,804][988181] Fps is (10 sec: 9830.2, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 65380352. Throughput: 0: 9921.2. Samples: 65376248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:14,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:49:18,196][988492] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-10 12:49:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 65425408. Throughput: 0: 9746.1. Samples: 65405208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:19,804][988181] Avg episode reward: [(0, '10.100')] [2023-03-10 12:49:22,377][988492] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-10 12:49:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 65474560. Throughput: 0: 9721.1. Samples: 65462660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:24,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:49:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127880_65474560.pth... [2023-03-10 12:49:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127312_65183744.pth [2023-03-10 12:49:26,668][988492] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-10 12:49:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 65523712. Throughput: 0: 9649.8. Samples: 65519616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:29,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 12:49:30,986][988492] Updated weights for policy 0, policy_version 128000 (0.0006) [2023-03-10 12:49:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 65572864. Throughput: 0: 9697.8. Samples: 65549860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:34,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 12:49:35,192][988492] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-10 12:49:39,126][988492] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-10 12:49:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 65622016. Throughput: 0: 9731.6. Samples: 65609720. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:39,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:49:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128168_65622016.pth... [2023-03-10 12:49:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127600_65331200.pth [2023-03-10 12:49:43,260][988492] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-10 12:49:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 65671168. Throughput: 0: 9786.8. Samples: 65669960. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:44,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:49:47,444][988492] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-10 12:49:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 65720320. Throughput: 0: 9744.1. Samples: 65698784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:49,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:49:51,602][988492] Updated weights for policy 0, policy_version 128400 (0.0006) [2023-03-10 12:49:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 65773568. Throughput: 0: 9830.8. Samples: 65758696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:54,805][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:49:54,810][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128464_65773568.pth... [2023-03-10 12:49:54,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000127880_65474560.pth [2023-03-10 12:49:55,550][988492] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-10 12:49:59,560][988492] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-10 12:49:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 65822720. Throughput: 0: 9849.1. Samples: 65819456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:49:59,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:50:03,621][988492] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-10 12:50:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 65871872. Throughput: 0: 9904.7. Samples: 65850920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:04,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:50:07,795][988492] Updated weights for policy 0, policy_version 128720 (0.0006) [2023-03-10 12:50:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9941.5). Total num frames: 65921024. Throughput: 0: 9929.7. Samples: 65909496. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:09,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 12:50:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128752_65921024.pth... [2023-03-10 12:50:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128168_65622016.pth [2023-03-10 12:50:12,315][988492] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-10 12:50:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 65966080. Throughput: 0: 9905.1. Samples: 65965344. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:14,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:50:16,429][988492] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-10 12:50:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 66019328. Throughput: 0: 9887.9. Samples: 65994816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:19,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:50:20,603][988492] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-10 12:50:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 66064384. Throughput: 0: 9873.4. Samples: 66054024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:24,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:50:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129032_66064384.pth... [2023-03-10 12:50:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128464_65773568.pth [2023-03-10 12:50:24,901][988492] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-10 12:50:29,085][988492] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-10 12:50:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 66117632. Throughput: 0: 9833.5. Samples: 66112468. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:29,805][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:50:33,002][988492] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-10 12:50:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 66166784. Throughput: 0: 9864.7. Samples: 66142696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:34,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:50:37,311][988492] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-10 12:50:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 66215936. Throughput: 0: 9852.7. Samples: 66202068. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:39,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:50:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129328_66215936.pth... [2023-03-10 12:50:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000128752_65921024.pth [2023-03-10 12:50:41,266][988492] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-10 12:50:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 66265088. Throughput: 0: 9895.7. Samples: 66264760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:44,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:50:45,267][988492] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-10 12:50:49,310][988492] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-10 12:50:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 66318336. Throughput: 0: 9881.0. Samples: 66295564. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:49,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:50:53,497][988492] Updated weights for policy 0, policy_version 129600 (0.0005) [2023-03-10 12:50:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 66363392. Throughput: 0: 9870.7. Samples: 66353676. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:50:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129616_66363392.pth... [2023-03-10 12:50:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129032_66064384.pth [2023-03-10 12:50:57,786][988492] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-10 12:50:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 66412544. Throughput: 0: 9877.5. Samples: 66409832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:50:59,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:51:02,018][988492] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-10 12:51:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 66461696. Throughput: 0: 9916.2. Samples: 66441044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 12:51:04,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 12:51:06,131][988492] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-10 12:51:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 66514944. Throughput: 0: 9972.4. Samples: 66502784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:09,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:51:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129912_66514944.pth... [2023-03-10 12:51:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129328_66215936.pth [2023-03-10 12:51:09,906][988492] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-10 12:51:14,191][988492] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-10 12:51:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 66564096. Throughput: 0: 9976.4. Samples: 66561404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:14,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:51:18,392][988492] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-10 12:51:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 66613248. Throughput: 0: 9944.5. Samples: 66590196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:19,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:51:22,384][988492] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-10 12:51:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 66662400. Throughput: 0: 9962.0. Samples: 66650356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:24,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:51:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130200_66662400.pth... [2023-03-10 12:51:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129616_66363392.pth [2023-03-10 12:51:26,494][988492] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-10 12:51:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9969.2). Total num frames: 66715648. Throughput: 0: 9928.7. Samples: 66711552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:29,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:51:30,631][988492] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-10 12:51:34,679][988492] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-10 12:51:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 66764800. Throughput: 0: 9907.4. Samples: 66741396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:34,804][988181] Avg episode reward: [(0, '10.094')] [2023-03-10 12:51:38,634][988492] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-10 12:51:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 66813952. Throughput: 0: 9956.9. Samples: 66801736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:39,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:51:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130496_66813952.pth... [2023-03-10 12:51:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000129912_66514944.pth [2023-03-10 12:51:42,956][988492] Updated weights for policy 0, policy_version 130560 (0.0004) [2023-03-10 12:51:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 66863104. Throughput: 0: 10012.3. Samples: 66860388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:44,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:51:46,977][988492] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-10 12:51:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 66912256. Throughput: 0: 10014.5. Samples: 66891696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:49,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:51:51,040][988492] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-10 12:51:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 66965504. Throughput: 0: 9958.7. Samples: 66950928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:54,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 12:51:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130792_66965504.pth... [2023-03-10 12:51:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130200_66662400.pth [2023-03-10 12:51:55,187][988492] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-10 12:51:59,289][988492] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-10 12:51:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 67014656. Throughput: 0: 9983.1. Samples: 67010644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:51:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:52:03,337][988492] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-10 12:52:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 67063808. Throughput: 0: 10066.2. Samples: 67043176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:04,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 12:52:07,356][988492] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-10 12:52:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 67112960. Throughput: 0: 10065.0. Samples: 67103280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:09,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:52:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131080_67112960.pth... [2023-03-10 12:52:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130496_66813952.pth [2023-03-10 12:52:11,479][988492] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-10 12:52:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 67166208. Throughput: 0: 10015.3. Samples: 67162240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:14,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:52:15,493][988492] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-10 12:52:19,722][988492] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-10 12:52:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 67215360. Throughput: 0: 10017.8. Samples: 67192196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:19,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:52:23,920][988492] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-10 12:52:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 67264512. Throughput: 0: 10009.9. Samples: 67252180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:24,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:52:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131376_67264512.pth... [2023-03-10 12:52:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000130792_66965504.pth [2023-03-10 12:52:28,077][988492] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-10 12:52:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 67313664. Throughput: 0: 9981.9. Samples: 67309576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:29,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 12:52:32,255][988492] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-10 12:52:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 67362816. Throughput: 0: 9932.8. Samples: 67338672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:34,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:52:36,014][988492] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-10 12:52:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 67416064. Throughput: 0: 10059.1. Samples: 67403588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:39,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:52:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131672_67416064.pth... [2023-03-10 12:52:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131080_67112960.pth [2023-03-10 12:52:40,052][988492] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-10 12:52:44,091][988492] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-10 12:52:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 67465216. Throughput: 0: 10076.4. Samples: 67464084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:44,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:52:47,911][988492] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-10 12:52:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 67518464. Throughput: 0: 10065.5. Samples: 67496124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:49,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 12:52:52,078][988492] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-10 12:52:54,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 67571712. Throughput: 0: 10080.4. Samples: 67556900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:54,804][988181] Avg episode reward: [(0, '10.089')] [2023-03-10 12:52:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131976_67571712.pth... [2023-03-10 12:52:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131376_67264512.pth [2023-03-10 12:52:55,983][988492] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-10 12:52:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 67620864. Throughput: 0: 10139.3. Samples: 67618508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:52:59,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:52:59,992][988492] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-10 12:53:03,889][988492] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-10 12:53:04,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10103.5, 300 sec: 9969.3). Total num frames: 67670016. Throughput: 0: 10194.5. Samples: 67650948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:04,804][988181] Avg episode reward: [(0, '10.098')] [2023-03-10 12:53:08,135][988492] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-10 12:53:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 67723264. Throughput: 0: 10149.5. Samples: 67708908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:09,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:53:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132272_67723264.pth... [2023-03-10 12:53:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131672_67416064.pth [2023-03-10 12:53:12,168][988492] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-10 12:53:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 9969.2). Total num frames: 67772416. Throughput: 0: 10198.6. Samples: 67768512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:14,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:53:16,329][988492] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-10 12:53:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 67821568. Throughput: 0: 10248.4. Samples: 67799848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:19,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:53:20,539][988492] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-10 12:53:24,793][988492] Updated weights for policy 0, policy_version 132560 (0.0004) [2023-03-10 12:53:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 67870720. Throughput: 0: 10031.2. Samples: 67854996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:24,805][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:53:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132560_67870720.pth... [2023-03-10 12:53:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000131976_67571712.pth [2023-03-10 12:53:29,104][988492] Updated weights for policy 0, policy_version 132640 (0.0004) [2023-03-10 12:53:29,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 67915776. Throughput: 0: 10010.9. Samples: 67914572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:29,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:53:33,284][988492] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-10 12:53:34,804][988181] Fps is (10 sec: 9421.0, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 67964928. Throughput: 0: 9957.2. Samples: 67944196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:34,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:53:37,320][988492] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-10 12:53:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 68018176. Throughput: 0: 9932.2. Samples: 68003848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:39,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:53:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132848_68018176.pth... [2023-03-10 12:53:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132272_67723264.pth [2023-03-10 12:53:41,427][988492] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-10 12:53:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 68067328. Throughput: 0: 9884.4. Samples: 68063304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:44,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:53:45,600][988492] Updated weights for policy 0, policy_version 132960 (0.0004) [2023-03-10 12:53:49,519][988492] Updated weights for policy 0, policy_version 133040 (0.0005) [2023-03-10 12:53:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 68116480. Throughput: 0: 9854.3. Samples: 68094392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:49,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:53:53,412][988492] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-10 12:53:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 68169728. Throughput: 0: 9962.4. Samples: 68157216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:53:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133144_68169728.pth... [2023-03-10 12:53:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132560_67870720.pth [2023-03-10 12:53:57,581][988492] Updated weights for policy 0, policy_version 133200 (0.0005) [2023-03-10 12:53:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 68218880. Throughput: 0: 9919.7. Samples: 68214900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:53:59,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 12:54:01,545][988492] Updated weights for policy 0, policy_version 133280 (0.0006) [2023-03-10 12:54:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 68272128. Throughput: 0: 9960.0. Samples: 68248048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:54:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:54:05,305][988492] Updated weights for policy 0, policy_version 133360 (0.0005) [2023-03-10 12:54:09,139][988492] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-10 12:54:09,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 68325376. Throughput: 0: 10189.3. Samples: 68313516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:54:09,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:54:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133448_68325376.pth... [2023-03-10 12:54:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000132848_68018176.pth [2023-03-10 12:54:13,191][988492] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-10 12:54:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 68374528. Throughput: 0: 10209.9. Samples: 68374016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:14,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:54:17,086][988492] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-10 12:54:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 68427776. Throughput: 0: 10258.6. Samples: 68405836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:19,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:54:21,341][988492] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-10 12:54:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 68476928. Throughput: 0: 10234.7. Samples: 68464408. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:24,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:54:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133744_68476928.pth... [2023-03-10 12:54:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133144_68169728.pth [2023-03-10 12:54:25,434][988492] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-10 12:54:29,566][988492] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-10 12:54:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 68526080. Throughput: 0: 10238.0. Samples: 68524012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:29,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:54:33,556][988492] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-10 12:54:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 68575232. Throughput: 0: 10228.8. Samples: 68554688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:34,804][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:54:37,705][988492] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-10 12:54:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 68624384. Throughput: 0: 10152.1. Samples: 68614060. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:39,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:54:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134032_68624384.pth... [2023-03-10 12:54:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133448_68325376.pth [2023-03-10 12:54:42,038][988492] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-10 12:54:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 68673536. Throughput: 0: 10154.7. Samples: 68671860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:44,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:54:46,337][988492] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-10 12:54:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.4, 300 sec: 9997.0). Total num frames: 68722688. Throughput: 0: 10012.9. Samples: 68698628. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:49,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:54:50,599][988492] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-10 12:54:54,579][988492] Updated weights for policy 0, policy_version 134320 (0.0004) [2023-03-10 12:54:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 68771840. Throughput: 0: 9910.7. Samples: 68759496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:54,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:54:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134320_68771840.pth... [2023-03-10 12:54:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000133744_68476928.pth [2023-03-10 12:54:58,491][988492] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-10 12:54:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 68825088. Throughput: 0: 9941.7. Samples: 68821392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:54:59,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:55:02,384][988492] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-10 12:55:04,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 68874240. Throughput: 0: 9953.8. Samples: 68853756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:55:04,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:55:06,663][988492] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-10 12:55:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 68923392. Throughput: 0: 9952.8. Samples: 68912284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:55:09,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:55:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134616_68923392.pth... [2023-03-10 12:55:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134032_68624384.pth [2023-03-10 12:55:10,773][988492] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-10 12:55:14,774][988492] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-10 12:55:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 68976640. Throughput: 0: 9942.5. Samples: 68971424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:55:14,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 12:55:18,921][988492] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-10 12:55:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 69021696. Throughput: 0: 9969.7. Samples: 69003324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:19,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:55:23,052][988492] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-10 12:55:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 69074944. Throughput: 0: 9955.4. Samples: 69062052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:24,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 12:55:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134912_69074944.pth... [2023-03-10 12:55:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134320_68771840.pth [2023-03-10 12:55:26,945][988492] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-10 12:55:29,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69128192. Throughput: 0: 10071.2. Samples: 69125064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:29,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:55:30,722][988492] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-10 12:55:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69177344. Throughput: 0: 10181.4. Samples: 69156792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:34,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:55:34,958][988492] Updated weights for policy 0, policy_version 135120 (0.0004) [2023-03-10 12:55:38,987][988492] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-10 12:55:39,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 69230592. Throughput: 0: 10147.8. Samples: 69216148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:39,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:55:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135216_69230592.pth... [2023-03-10 12:55:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134616_68923392.pth [2023-03-10 12:55:43,166][988492] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-10 12:55:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 69275648. Throughput: 0: 10066.3. Samples: 69274376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:44,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:55:47,397][988492] Updated weights for policy 0, policy_version 135360 (0.0005) [2023-03-10 12:55:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69324800. Throughput: 0: 10011.4. Samples: 69304268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:49,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 12:55:51,473][988492] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-10 12:55:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69373952. Throughput: 0: 10034.3. Samples: 69363828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:54,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 12:55:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135496_69373952.pth... [2023-03-10 12:55:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000134912_69074944.pth [2023-03-10 12:55:55,709][988492] Updated weights for policy 0, policy_version 135520 (0.0006) [2023-03-10 12:55:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 10038.7). Total num frames: 69423104. Throughput: 0: 10032.6. Samples: 69422892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:55:59,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:55:59,817][988492] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-10 12:56:03,881][988492] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-10 12:56:04,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69476352. Throughput: 0: 9965.3. Samples: 69451764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:56:04,804][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 12:56:07,903][988492] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-10 12:56:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69525504. Throughput: 0: 10037.9. Samples: 69513756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:56:09,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:56:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135792_69525504.pth... [2023-03-10 12:56:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135216_69230592.pth [2023-03-10 12:56:12,092][988492] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-10 12:56:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 69574656. Throughput: 0: 9917.3. Samples: 69571340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 12:56:14,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:56:16,344][988492] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-10 12:56:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 69623808. Throughput: 0: 9869.9. Samples: 69600936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:19,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 12:56:20,576][988492] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-10 12:56:24,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 69668864. Throughput: 0: 9843.2. Samples: 69659092. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:24,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:56:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136072_69668864.pth... [2023-03-10 12:56:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135496_69373952.pth [2023-03-10 12:56:24,865][988492] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-10 12:56:28,852][988492] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-10 12:56:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 69722112. Throughput: 0: 9866.5. Samples: 69718368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:29,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 12:56:32,932][988492] Updated weights for policy 0, policy_version 136240 (0.0004) [2023-03-10 12:56:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 69771264. Throughput: 0: 9873.5. Samples: 69748576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:34,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:56:36,918][988492] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-10 12:56:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 69824512. Throughput: 0: 9905.6. Samples: 69809580. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:39,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:56:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136376_69824512.pth... [2023-03-10 12:56:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000135792_69525504.pth [2023-03-10 12:56:41,062][988492] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-10 12:56:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 69873664. Throughput: 0: 9927.5. Samples: 69869632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:44,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:56:45,036][988492] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-10 12:56:49,171][988492] Updated weights for policy 0, policy_version 136560 (0.0004) [2023-03-10 12:56:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 69922816. Throughput: 0: 9969.1. Samples: 69900372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:49,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:56:53,191][988492] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-10 12:56:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 69971968. Throughput: 0: 9945.1. Samples: 69961284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:54,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:56:54,820][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136672_69976064.pth... [2023-03-10 12:56:54,822][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136072_69668864.pth [2023-03-10 12:56:57,241][988492] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-10 12:56:59,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 70029312. Throughput: 0: 10066.3. Samples: 70024324. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:56:59,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:57:01,037][988492] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-10 12:57:04,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 70074368. Throughput: 0: 10061.7. Samples: 70053712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:57:04,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 12:57:05,310][988492] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-10 12:57:09,466][988492] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-10 12:57:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 10024.8). Total num frames: 70123520. Throughput: 0: 10049.0. Samples: 70111296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:57:09,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:57:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136960_70123520.pth... [2023-03-10 12:57:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136376_69824512.pth [2023-03-10 12:57:13,517][988492] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-10 12:57:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 70176768. Throughput: 0: 10094.0. Samples: 70172596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:57:14,805][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:57:17,596][988492] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-10 12:57:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 70225920. Throughput: 0: 10111.6. Samples: 70203600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 12:57:19,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 12:57:21,426][988492] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-10 12:57:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 70279168. Throughput: 0: 10128.3. Samples: 70265352. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:24,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 12:57:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137264_70279168.pth... [2023-03-10 12:57:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136672_69976064.pth [2023-03-10 12:57:25,648][988492] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-10 12:57:29,700][988492] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-10 12:57:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 70328320. Throughput: 0: 10103.5. Samples: 70324288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:29,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 12:57:33,791][988492] Updated weights for policy 0, policy_version 137440 (0.0004) [2023-03-10 12:57:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 70377472. Throughput: 0: 10092.4. Samples: 70354528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:57:37,936][988492] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-10 12:57:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 70426624. Throughput: 0: 10079.0. Samples: 70414840. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:57:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137552_70426624.pth... [2023-03-10 12:57:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000136960_70123520.pth [2023-03-10 12:57:42,040][988492] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-10 12:57:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 70475776. Throughput: 0: 9997.1. Samples: 70474192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:44,804][988181] Avg episode reward: [(0, '10.101')] [2023-03-10 12:57:46,185][988492] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-10 12:57:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 70524928. Throughput: 0: 10016.4. Samples: 70504448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:49,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 12:57:50,386][988492] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-10 12:57:54,580][988492] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-10 12:57:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 70574080. Throughput: 0: 10011.2. Samples: 70561800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:54,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 12:57:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137840_70574080.pth... [2023-03-10 12:57:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137264_70279168.pth [2023-03-10 12:57:58,750][988492] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-10 12:57:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 70623232. Throughput: 0: 9944.1. Samples: 70620080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:57:59,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:58:02,923][988492] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-10 12:58:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 70672384. Throughput: 0: 9928.8. Samples: 70650396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:58:04,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:58:07,081][988492] Updated weights for policy 0, policy_version 138080 (0.0004) [2023-03-10 12:58:09,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 70721536. Throughput: 0: 9879.6. Samples: 70709932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:58:09,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:58:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138128_70721536.pth... [2023-03-10 12:58:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137552_70426624.pth [2023-03-10 12:58:11,150][988492] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-10 12:58:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 70774784. Throughput: 0: 9920.3. Samples: 70770700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:58:14,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 12:58:15,155][988492] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-10 12:58:19,463][988492] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-10 12:58:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 70819840. Throughput: 0: 9882.0. Samples: 70799216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 12:58:19,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:58:23,505][988492] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-10 12:58:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 70873088. Throughput: 0: 9878.9. Samples: 70859392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:24,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 12:58:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138424_70873088.pth... [2023-03-10 12:58:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000137840_70574080.pth [2023-03-10 12:58:27,613][988492] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-10 12:58:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 70922240. Throughput: 0: 9893.1. Samples: 70919380. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:29,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:58:31,693][988492] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-10 12:58:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 10010.9). Total num frames: 70971392. Throughput: 0: 9891.5. Samples: 70949568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:34,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 12:58:35,896][988492] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-10 12:58:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 71020544. Throughput: 0: 9915.9. Samples: 71008016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:39,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 12:58:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138712_71020544.pth... [2023-03-10 12:58:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138128_70721536.pth [2023-03-10 12:58:39,991][988492] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-10 12:58:44,090][988492] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-10 12:58:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 71069696. Throughput: 0: 9960.1. Samples: 71068284. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 12:58:48,366][988492] Updated weights for policy 0, policy_version 138880 (0.0004) [2023-03-10 12:58:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 71118848. Throughput: 0: 9948.3. Samples: 71098072. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:49,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 12:58:52,524][988492] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-10 12:58:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 71168000. Throughput: 0: 9903.4. Samples: 71155584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:54,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:58:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139000_71168000.pth... [2023-03-10 12:58:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138424_70873088.pth [2023-03-10 12:58:56,722][988492] Updated weights for policy 0, policy_version 139040 (0.0004) [2023-03-10 12:58:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 71217152. Throughput: 0: 9847.6. Samples: 71213840. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:58:59,804][988181] Avg episode reward: [(0, '10.087')] [2023-03-10 12:59:00,950][988492] Updated weights for policy 0, policy_version 139120 (0.0004) [2023-03-10 12:59:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 71262208. Throughput: 0: 9839.5. Samples: 71241992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:59:04,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 12:59:05,317][988492] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-10 12:59:09,683][988492] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-10 12:59:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 71311360. Throughput: 0: 9764.4. Samples: 71298792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:59:09,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 12:59:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139280_71311360.pth... [2023-03-10 12:59:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000138712_71020544.pth [2023-03-10 12:59:14,005][988492] Updated weights for policy 0, policy_version 139360 (0.0004) [2023-03-10 12:59:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 71360512. Throughput: 0: 9710.8. Samples: 71356368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:59:14,805][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 12:59:18,186][988492] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-10 12:59:19,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 71405568. Throughput: 0: 9678.2. Samples: 71385088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:59:19,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 12:59:22,496][988492] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-10 12:59:24,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 71454720. Throughput: 0: 9655.3. Samples: 71442504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 12:59:24,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 12:59:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139560_71454720.pth... [2023-03-10 12:59:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139000_71168000.pth [2023-03-10 12:59:26,777][988492] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-10 12:59:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 71503872. Throughput: 0: 9588.7. Samples: 71499776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:29,804][988181] Avg episode reward: [(0, '10.063')] [2023-03-10 12:59:31,041][988492] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-10 12:59:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 71553024. Throughput: 0: 9568.0. Samples: 71528632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:34,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 12:59:35,209][988492] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-10 12:59:39,638][988492] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-10 12:59:39,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9913.7). Total num frames: 71598080. Throughput: 0: 9560.4. Samples: 71585804. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:39,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 12:59:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139840_71598080.pth... [2023-03-10 12:59:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139280_71311360.pth [2023-03-10 12:59:43,922][988492] Updated weights for policy 0, policy_version 139920 (0.0005) [2023-03-10 12:59:44,804][988181] Fps is (10 sec: 9420.6, 60 sec: 9625.6, 300 sec: 9913.7). Total num frames: 71647232. Throughput: 0: 9554.9. Samples: 71643812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:44,805][988181] Avg episode reward: [(0, '10.084')] [2023-03-10 12:59:47,597][988492] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-10 12:59:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 71700480. Throughput: 0: 9657.5. Samples: 71676580. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:49,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 12:59:51,681][988492] Updated weights for policy 0, policy_version 140080 (0.0004) [2023-03-10 12:59:54,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 71749632. Throughput: 0: 9745.8. Samples: 71737352. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:54,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 12:59:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140136_71749632.pth... [2023-03-10 12:59:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139560_71454720.pth [2023-03-10 12:59:56,043][988492] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-10 12:59:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 71798784. Throughput: 0: 9743.6. Samples: 71794828. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 12:59:59,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 13:00:00,103][988492] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-10 13:00:04,321][988492] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-10 13:00:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 71847936. Throughput: 0: 9745.2. Samples: 71823620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:00:04,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 13:00:08,448][988492] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-10 13:00:09,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 71892992. Throughput: 0: 9821.5. Samples: 71884472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:00:09,804][988181] Avg episode reward: [(0, '10.028')] [2023-03-10 13:00:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140424_71897088.pth... [2023-03-10 13:00:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000139840_71598080.pth [2023-03-10 13:00:12,902][988492] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-10 13:00:14,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 71942144. Throughput: 0: 9768.5. Samples: 71939356. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:00:14,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:00:17,035][988492] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-10 13:00:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 71991296. Throughput: 0: 9818.0. Samples: 71970444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:00:19,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 13:00:21,266][988492] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-10 13:00:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 72044544. Throughput: 0: 9880.4. Samples: 72030424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:00:24,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:00:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140712_72044544.pth... [2023-03-10 13:00:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140136_71749632.pth [2023-03-10 13:00:25,114][988492] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-10 13:00:29,091][988492] Updated weights for policy 0, policy_version 140800 (0.0004) [2023-03-10 13:00:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 72093696. Throughput: 0: 9968.0. Samples: 72092368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:29,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:00:33,396][988492] Updated weights for policy 0, policy_version 140880 (0.0004) [2023-03-10 13:00:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 72142848. Throughput: 0: 9867.8. Samples: 72120632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:34,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:00:37,644][988492] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-10 13:00:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 72192000. Throughput: 0: 9816.4. Samples: 72179088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:39,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 13:00:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141000_72192000.pth... [2023-03-10 13:00:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140424_71897088.pth [2023-03-10 13:00:41,823][988492] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-10 13:00:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 72241152. Throughput: 0: 9828.7. Samples: 72237120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:00:45,941][988492] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-10 13:00:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 72290304. Throughput: 0: 9826.0. Samples: 72265792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:49,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 13:00:49,988][988492] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-10 13:00:54,084][988492] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-10 13:00:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 72339456. Throughput: 0: 9837.8. Samples: 72327176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:54,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:00:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141288_72339456.pth... [2023-03-10 13:00:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000140712_72044544.pth [2023-03-10 13:00:58,264][988492] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-10 13:00:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 72388608. Throughput: 0: 9939.9. Samples: 72386652. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:00:59,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 13:01:02,528][988492] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-10 13:01:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9872.1). Total num frames: 72437760. Throughput: 0: 9906.9. Samples: 72416252. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:04,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:01:06,405][988492] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-10 13:01:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 72486912. Throughput: 0: 9912.5. Samples: 72476488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:09,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:01:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141576_72486912.pth... [2023-03-10 13:01:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141000_72192000.pth [2023-03-10 13:01:10,767][988492] Updated weights for policy 0, policy_version 141600 (0.0004) [2023-03-10 13:01:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 72536064. Throughput: 0: 9780.1. Samples: 72532472. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:14,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 13:01:14,971][988492] Updated weights for policy 0, policy_version 141680 (0.0004) [2023-03-10 13:01:19,148][988492] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-10 13:01:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 72585216. Throughput: 0: 9860.4. Samples: 72564348. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:19,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 13:01:23,064][988492] Updated weights for policy 0, policy_version 141840 (0.0005) [2023-03-10 13:01:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 72638464. Throughput: 0: 9916.7. Samples: 72625340. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:24,804][988181] Avg episode reward: [(0, '10.041')] [2023-03-10 13:01:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141872_72638464.pth... [2023-03-10 13:01:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141288_72339456.pth [2023-03-10 13:01:27,244][988492] Updated weights for policy 0, policy_version 141920 (0.0004) [2023-03-10 13:01:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 72687616. Throughput: 0: 9920.0. Samples: 72683520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:01:29,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 13:01:31,377][988492] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-10 13:01:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 72732672. Throughput: 0: 9930.3. Samples: 72712656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:34,804][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 13:01:35,625][988492] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-10 13:01:39,776][988492] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-10 13:01:39,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9898.6, 300 sec: 9872.0). Total num frames: 72785920. Throughput: 0: 9872.1. Samples: 72771424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:39,805][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:01:39,810][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142160_72785920.pth... [2023-03-10 13:01:39,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141576_72486912.pth [2023-03-10 13:01:44,180][988492] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-10 13:01:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 72830976. Throughput: 0: 9810.7. Samples: 72828132. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:44,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 13:01:48,447][988492] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-10 13:01:49,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 72880128. Throughput: 0: 9789.2. Samples: 72856768. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:49,804][988181] Avg episode reward: [(0, '10.015')] [2023-03-10 13:01:52,805][988492] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-10 13:01:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9816.5). Total num frames: 72925184. Throughput: 0: 9713.5. Samples: 72913596. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:54,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:01:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142432_72925184.pth... [2023-03-10 13:01:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000141872_72638464.pth [2023-03-10 13:01:57,250][988492] Updated weights for policy 0, policy_version 142480 (0.0006) [2023-03-10 13:01:59,804][988181] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 72970240. Throughput: 0: 9702.3. Samples: 72969076. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:01:59,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:02:01,624][988492] Updated weights for policy 0, policy_version 142560 (0.0004) [2023-03-10 13:02:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9816.5). Total num frames: 73019392. Throughput: 0: 9649.7. Samples: 72998584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:04,804][988181] Avg episode reward: [(0, '10.025')] [2023-03-10 13:02:05,851][988492] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-10 13:02:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9802.6). Total num frames: 73068544. Throughput: 0: 9574.4. Samples: 73056188. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:09,804][988181] Avg episode reward: [(0, '10.028')] [2023-03-10 13:02:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142712_73068544.pth... [2023-03-10 13:02:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142160_72785920.pth [2023-03-10 13:02:10,130][988492] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-10 13:02:14,414][988492] Updated weights for policy 0, policy_version 142800 (0.0005) [2023-03-10 13:02:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9788.7). Total num frames: 73113600. Throughput: 0: 9555.1. Samples: 73113500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:14,804][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 13:02:18,487][988492] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-10 13:02:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 73166848. Throughput: 0: 9548.4. Samples: 73142336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:19,804][988181] Avg episode reward: [(0, '10.027')] [2023-03-10 13:02:22,784][988492] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-10 13:02:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9774.9). Total num frames: 73211904. Throughput: 0: 9538.5. Samples: 73200656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:24,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:02:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142992_73211904.pth... [2023-03-10 13:02:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142432_72925184.pth [2023-03-10 13:02:26,894][988492] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-10 13:02:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9788.7). Total num frames: 73265152. Throughput: 0: 9626.4. Samples: 73261320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:29,804][988181] Avg episode reward: [(0, '10.008')] [2023-03-10 13:02:30,901][988492] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-10 13:02:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 73314304. Throughput: 0: 9663.6. Samples: 73291628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:02:34,804][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 13:02:35,040][988492] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-10 13:02:39,232][988492] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-10 13:02:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9788.7). Total num frames: 73363456. Throughput: 0: 9722.1. Samples: 73351092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:02:39,805][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:02:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143288_73363456.pth... [2023-03-10 13:02:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142712_73068544.pth [2023-03-10 13:02:43,300][988492] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-10 13:02:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 73412608. Throughput: 0: 9780.1. Samples: 73409180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:02:44,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 13:02:47,705][988492] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-10 13:02:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 73457664. Throughput: 0: 9757.9. Samples: 73437688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:02:49,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:02:51,868][988492] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-10 13:02:54,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 73506816. Throughput: 0: 9759.9. Samples: 73495384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:02:54,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 13:02:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143568_73506816.pth... [2023-03-10 13:02:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000142992_73211904.pth [2023-03-10 13:02:55,996][988492] Updated weights for policy 0, policy_version 143600 (0.0006) [2023-03-10 13:02:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9788.7). Total num frames: 73560064. Throughput: 0: 9859.5. Samples: 73557176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:02:59,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:02:59,938][988492] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-10 13:03:03,999][988492] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-10 13:03:04,804][988181] Fps is (10 sec: 10649.7, 60 sec: 9898.7, 300 sec: 9802.6). Total num frames: 73613312. Throughput: 0: 9915.4. Samples: 73588528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:04,805][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:03:07,495][988492] Updated weights for policy 0, policy_version 143840 (0.0006) [2023-03-10 13:03:09,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 73666560. Throughput: 0: 10079.4. Samples: 73654228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:09,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:03:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143880_73666560.pth... [2023-03-10 13:03:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143288_73363456.pth [2023-03-10 13:03:11,751][988492] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-10 13:03:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 73715712. Throughput: 0: 10041.2. Samples: 73713172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:14,804][988181] Avg episode reward: [(0, '10.034')] [2023-03-10 13:03:15,651][988492] Updated weights for policy 0, policy_version 144000 (0.0006) [2023-03-10 13:03:19,418][988492] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-10 13:03:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 73768960. Throughput: 0: 10102.7. Samples: 73746248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:19,804][988181] Avg episode reward: [(0, '10.020')] [2023-03-10 13:03:23,693][988492] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-10 13:03:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9816.5). Total num frames: 73818112. Throughput: 0: 10117.1. Samples: 73806360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:24,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:03:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144176_73818112.pth... [2023-03-10 13:03:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143568_73506816.pth [2023-03-10 13:03:27,794][988492] Updated weights for policy 0, policy_version 144240 (0.0006) [2023-03-10 13:03:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 73867264. Throughput: 0: 10173.6. Samples: 73866992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:29,804][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:03:31,833][988492] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-10 13:03:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9830.4). Total num frames: 73920512. Throughput: 0: 10194.1. Samples: 73896424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:03:34,804][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:03:36,008][988492] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-10 13:03:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9830.4). Total num frames: 73969664. Throughput: 0: 10275.1. Samples: 73957764. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:03:39,804][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:03:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144472_73969664.pth... [2023-03-10 13:03:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000143880_73666560.pth [2023-03-10 13:03:39,949][988492] Updated weights for policy 0, policy_version 144480 (0.0005) [2023-03-10 13:03:43,993][988492] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-10 13:03:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9844.3). Total num frames: 74022912. Throughput: 0: 10258.0. Samples: 74018784. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:03:44,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 13:03:48,144][988492] Updated weights for policy 0, policy_version 144640 (0.0006) [2023-03-10 13:03:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9844.3). Total num frames: 74072064. Throughput: 0: 10200.7. Samples: 74047560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:03:49,804][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 13:03:51,994][988492] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-10 13:03:54,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10240.0, 300 sec: 9844.3). Total num frames: 74121216. Throughput: 0: 10131.9. Samples: 74110160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:03:54,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 13:03:54,827][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144776_74125312.pth... [2023-03-10 13:03:54,829][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144176_73818112.pth [2023-03-10 13:03:55,980][988492] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-10 13:03:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 9872.1). Total num frames: 74174464. Throughput: 0: 10169.8. Samples: 74170812. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:03:59,804][988181] Avg episode reward: [(0, '10.033')] [2023-03-10 13:04:00,037][988492] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-10 13:04:04,176][988492] Updated weights for policy 0, policy_version 144960 (0.0004) [2023-03-10 13:04:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9872.1). Total num frames: 74223616. Throughput: 0: 10075.1. Samples: 74199628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:04,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 13:04:08,124][988492] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-10 13:04:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.8, 300 sec: 9885.9). Total num frames: 74276864. Throughput: 0: 10150.9. Samples: 74263148. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:09,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:04:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145072_74276864.pth... [2023-03-10 13:04:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144472_73969664.pth [2023-03-10 13:04:12,233][988492] Updated weights for policy 0, policy_version 145120 (0.0006) [2023-03-10 13:04:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 9899.8). Total num frames: 74326016. Throughput: 0: 10110.9. Samples: 74321984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:14,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:04:16,474][988492] Updated weights for policy 0, policy_version 145200 (0.0006) [2023-03-10 13:04:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 74371072. Throughput: 0: 10092.6. Samples: 74350592. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:19,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:04:20,808][988492] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-10 13:04:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 74420224. Throughput: 0: 10005.3. Samples: 74408000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:24,804][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:04:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145352_74420224.pth... [2023-03-10 13:04:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000144776_74125312.pth [2023-03-10 13:04:24,953][988492] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-10 13:04:29,010][988492] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-10 13:04:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 74469376. Throughput: 0: 10005.7. Samples: 74469040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:29,804][988181] Avg episode reward: [(0, '10.028')] [2023-03-10 13:04:33,082][988492] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-10 13:04:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 74522624. Throughput: 0: 10012.3. Samples: 74498112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:34,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:04:37,142][988492] Updated weights for policy 0, policy_version 145600 (0.0005) [2023-03-10 13:04:39,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 74571776. Throughput: 0: 9983.1. Samples: 74559400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:04:39,804][988181] Avg episode reward: [(0, '10.002')] [2023-03-10 13:04:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145648_74571776.pth... [2023-03-10 13:04:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145072_74276864.pth [2023-03-10 13:04:41,323][988492] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-10 13:04:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 74620928. Throughput: 0: 9978.8. Samples: 74619860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:04:44,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 13:04:45,148][988492] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-10 13:04:48,993][988492] Updated weights for policy 0, policy_version 145840 (0.0004) [2023-03-10 13:04:49,804][988181] Fps is (10 sec: 10240.2, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 74674176. Throughput: 0: 10052.7. Samples: 74652000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:04:49,804][988181] Avg episode reward: [(0, '10.022')] [2023-03-10 13:04:53,211][988492] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-10 13:04:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 74723328. Throughput: 0: 9973.0. Samples: 74711932. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:04:54,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:04:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145944_74723328.pth... [2023-03-10 13:04:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145352_74420224.pth [2023-03-10 13:04:57,466][988492] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-10 13:04:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 74772480. Throughput: 0: 9954.0. Samples: 74769916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:04:59,804][988181] Avg episode reward: [(0, '10.024')] [2023-03-10 13:05:01,825][988492] Updated weights for policy 0, policy_version 146080 (0.0004) [2023-03-10 13:05:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 74821632. Throughput: 0: 9939.5. Samples: 74797872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:04,804][988181] Avg episode reward: [(0, '10.006')] [2023-03-10 13:05:05,924][988492] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-10 13:05:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 74870784. Throughput: 0: 10008.7. Samples: 74858392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:09,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:05:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146232_74870784.pth... [2023-03-10 13:05:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145648_74571776.pth [2023-03-10 13:05:09,921][988492] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-10 13:05:13,970][988492] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-10 13:05:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 74919936. Throughput: 0: 10019.1. Samples: 74919900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:14,804][988181] Avg episode reward: [(0, '10.020')] [2023-03-10 13:05:17,899][988492] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-10 13:05:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 74973184. Throughput: 0: 10031.3. Samples: 74949520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:19,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 13:05:22,185][988492] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-10 13:05:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 75022336. Throughput: 0: 9980.1. Samples: 75008504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:24,804][988181] Avg episode reward: [(0, '10.021')] [2023-03-10 13:05:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146528_75022336.pth... [2023-03-10 13:05:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000145944_74723328.pth [2023-03-10 13:05:26,478][988492] Updated weights for policy 0, policy_version 146560 (0.0006) [2023-03-10 13:05:29,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 75067392. Throughput: 0: 9939.1. Samples: 75067120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:29,804][988181] Avg episode reward: [(0, '9.989')] [2023-03-10 13:05:30,753][988492] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-10 13:05:34,795][988492] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-10 13:05:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 75120640. Throughput: 0: 9868.5. Samples: 75096084. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:34,804][988181] Avg episode reward: [(0, '10.017')] [2023-03-10 13:05:38,940][988492] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-10 13:05:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 75169792. Throughput: 0: 9872.9. Samples: 75156212. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:39,805][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 13:05:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146816_75169792.pth... [2023-03-10 13:05:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146232_74870784.pth [2023-03-10 13:05:43,069][988492] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-10 13:05:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 75218944. Throughput: 0: 9889.9. Samples: 75214960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:05:44,804][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 13:05:47,252][988492] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-10 13:05:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 75268096. Throughput: 0: 9914.5. Samples: 75244024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:05:49,804][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:05:51,251][988492] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-10 13:05:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.6, 300 sec: 9927.6). Total num frames: 75317248. Throughput: 0: 9926.1. Samples: 75305068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:05:54,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:05:54,825][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147112_75321344.pth... [2023-03-10 13:05:54,827][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146528_75022336.pth [2023-03-10 13:05:55,254][988492] Updated weights for policy 0, policy_version 147120 (0.0004) [2023-03-10 13:05:59,216][988492] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-10 13:05:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 75370496. Throughput: 0: 9946.1. Samples: 75367476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:05:59,804][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 13:06:03,134][988492] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-10 13:06:04,804][988181] Fps is (10 sec: 10649.8, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 75423744. Throughput: 0: 9993.6. Samples: 75399232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:04,804][988181] Avg episode reward: [(0, '9.991')] [2023-03-10 13:06:07,212][988492] Updated weights for policy 0, policy_version 147360 (0.0004) [2023-03-10 13:06:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 75472896. Throughput: 0: 10046.3. Samples: 75460588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:09,804][988181] Avg episode reward: [(0, '9.999')] [2023-03-10 13:06:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147408_75472896.pth... [2023-03-10 13:06:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000146816_75169792.pth [2023-03-10 13:06:11,009][988492] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-10 13:06:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 75526144. Throughput: 0: 10111.3. Samples: 75522128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:14,815][988181] Avg episode reward: [(0, '9.958')] [2023-03-10 13:06:15,187][988492] Updated weights for policy 0, policy_version 147520 (0.0004) [2023-03-10 13:06:19,120][988492] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-10 13:06:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 75575296. Throughput: 0: 10115.1. Samples: 75551264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:19,804][988181] Avg episode reward: [(0, '10.034')] [2023-03-10 13:06:23,121][988492] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-10 13:06:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 75624448. Throughput: 0: 10185.9. Samples: 75614576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:24,804][988181] Avg episode reward: [(0, '9.983')] [2023-03-10 13:06:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147704_75624448.pth... [2023-03-10 13:06:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147112_75321344.pth [2023-03-10 13:06:27,499][988492] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-10 13:06:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 75673600. Throughput: 0: 10142.4. Samples: 75671368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:29,804][988181] Avg episode reward: [(0, '10.012')] [2023-03-10 13:06:31,837][988492] Updated weights for policy 0, policy_version 147840 (0.0004) [2023-03-10 13:06:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 75722752. Throughput: 0: 10105.5. Samples: 75698772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:34,804][988181] Avg episode reward: [(0, '10.013')] [2023-03-10 13:06:36,021][988492] Updated weights for policy 0, policy_version 147920 (0.0004) [2023-03-10 13:06:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 75771904. Throughput: 0: 10091.9. Samples: 75759204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:39,804][988181] Avg episode reward: [(0, '9.998')] [2023-03-10 13:06:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147992_75771904.pth... [2023-03-10 13:06:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147408_75472896.pth [2023-03-10 13:06:40,137][988492] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-10 13:06:44,350][988492] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-10 13:06:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 75821056. Throughput: 0: 9988.7. Samples: 75816968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:06:44,804][988181] Avg episode reward: [(0, '10.005')] [2023-03-10 13:06:48,590][988492] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-10 13:06:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 75866112. Throughput: 0: 9921.6. Samples: 75845704. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:06:49,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:06:52,993][988492] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-10 13:06:54,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9983.1). Total num frames: 75915264. Throughput: 0: 9825.9. Samples: 75902752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:06:54,804][988181] Avg episode reward: [(0, '10.022')] [2023-03-10 13:06:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148272_75915264.pth... [2023-03-10 13:06:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147704_75624448.pth [2023-03-10 13:06:57,210][988492] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-10 13:06:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 75964416. Throughput: 0: 9747.6. Samples: 75960772. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:06:59,804][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 13:07:01,366][988492] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-10 13:07:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 76013568. Throughput: 0: 9735.2. Samples: 75989348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:04,804][988181] Avg episode reward: [(0, '10.001')] [2023-03-10 13:07:05,547][988492] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-10 13:07:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9983.1). Total num frames: 76058624. Throughput: 0: 9638.7. Samples: 76048316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:09,804][988181] Avg episode reward: [(0, '10.009')] [2023-03-10 13:07:09,839][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148560_76062720.pth... [2023-03-10 13:07:09,839][988492] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-10 13:07:09,841][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000147992_75771904.pth [2023-03-10 13:07:14,281][988492] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-10 13:07:14,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9969.2). Total num frames: 76107776. Throughput: 0: 9610.2. Samples: 76103828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:14,805][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 13:07:18,473][988492] Updated weights for policy 0, policy_version 148720 (0.0004) [2023-03-10 13:07:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9983.1). Total num frames: 76156928. Throughput: 0: 9643.5. Samples: 76132728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:19,815][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 13:07:22,417][988492] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-10 13:07:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9969.3). Total num frames: 76206080. Throughput: 0: 9670.3. Samples: 76194368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:24,815][988181] Avg episode reward: [(0, '10.012')] [2023-03-10 13:07:24,825][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148848_76210176.pth... [2023-03-10 13:07:24,827][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148272_75915264.pth [2023-03-10 13:07:26,331][988492] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-10 13:07:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9983.1). Total num frames: 76259328. Throughput: 0: 9754.8. Samples: 76255932. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:29,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:07:30,462][988492] Updated weights for policy 0, policy_version 148960 (0.0006) [2023-03-10 13:07:34,374][988492] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-10 13:07:34,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 76312576. Throughput: 0: 9817.2. Samples: 76287480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:34,804][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 13:07:38,539][988492] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-10 13:07:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 76361728. Throughput: 0: 9882.5. Samples: 76347464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:39,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:07:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149144_76361728.pth... [2023-03-10 13:07:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148560_76062720.pth [2023-03-10 13:07:42,623][988492] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-10 13:07:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9997.0). Total num frames: 76406784. Throughput: 0: 9907.6. Samples: 76406612. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:44,804][988181] Avg episode reward: [(0, '10.002')] [2023-03-10 13:07:46,992][988492] Updated weights for policy 0, policy_version 149280 (0.0004) [2023-03-10 13:07:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 76455936. Throughput: 0: 9906.7. Samples: 76435152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:07:49,804][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 13:07:51,403][988492] Updated weights for policy 0, policy_version 149360 (0.0004) [2023-03-10 13:07:54,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 76500992. Throughput: 0: 9845.9. Samples: 76491384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:07:54,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 13:07:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149416_76500992.pth... [2023-03-10 13:07:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000148848_76210176.pth [2023-03-10 13:07:55,596][988492] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-10 13:07:59,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 76550144. Throughput: 0: 9894.2. Samples: 76549068. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:07:59,815][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:07:59,819][988492] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-10 13:08:03,847][988492] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-10 13:08:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 76603392. Throughput: 0: 9928.1. Samples: 76579492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:04,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 13:08:07,902][988492] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-10 13:08:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9955.4). Total num frames: 76652544. Throughput: 0: 9913.8. Samples: 76640492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:09,805][988181] Avg episode reward: [(0, '10.042')] [2023-03-10 13:08:09,810][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149712_76652544.pth... [2023-03-10 13:08:09,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149144_76361728.pth [2023-03-10 13:08:12,162][988492] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-10 13:08:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 76701696. Throughput: 0: 9825.3. Samples: 76698072. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:14,815][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:08:16,323][988492] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-10 13:08:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 76750848. Throughput: 0: 9792.4. Samples: 76728136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:19,815][988181] Avg episode reward: [(0, '10.021')] [2023-03-10 13:08:20,501][988492] Updated weights for policy 0, policy_version 149920 (0.0004) [2023-03-10 13:08:24,556][988492] Updated weights for policy 0, policy_version 150000 (0.0004) [2023-03-10 13:08:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 76800000. Throughput: 0: 9775.1. Samples: 76787344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:24,804][988181] Avg episode reward: [(0, '10.017')] [2023-03-10 13:08:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150000_76800000.pth... [2023-03-10 13:08:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149416_76500992.pth [2023-03-10 13:08:28,596][988492] Updated weights for policy 0, policy_version 150080 (0.0004) [2023-03-10 13:08:29,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9830.4, 300 sec: 9927.6). Total num frames: 76849152. Throughput: 0: 9834.2. Samples: 76849152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:29,804][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 13:08:32,741][988492] Updated weights for policy 0, policy_version 150160 (0.0006) [2023-03-10 13:08:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 76898304. Throughput: 0: 9838.7. Samples: 76877896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:34,805][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 13:08:36,949][988492] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-10 13:08:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9913.7). Total num frames: 76947456. Throughput: 0: 9891.1. Samples: 76936484. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:39,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:08:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150288_76947456.pth... [2023-03-10 13:08:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000149712_76652544.pth [2023-03-10 13:08:41,171][988492] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-10 13:08:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 77000704. Throughput: 0: 9958.9. Samples: 76997220. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:44,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 13:08:45,083][988492] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-10 13:08:49,232][988492] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-10 13:08:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 77049856. Throughput: 0: 9950.6. Samples: 77027268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:49,804][988181] Avg episode reward: [(0, '10.041')] [2023-03-10 13:08:53,289][988492] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-10 13:08:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77099008. Throughput: 0: 9917.8. Samples: 77086792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-10 13:08:54,804][988181] Avg episode reward: [(0, '10.025')] [2023-03-10 13:08:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150584_77099008.pth... [2023-03-10 13:08:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150000_76800000.pth [2023-03-10 13:08:57,322][988492] Updated weights for policy 0, policy_version 150640 (0.0006) [2023-03-10 13:08:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 77152256. Throughput: 0: 10002.2. Samples: 77148172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:08:59,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:09:01,338][988492] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-10 13:09:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77201408. Throughput: 0: 10037.1. Samples: 77179808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:04,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:09:05,271][988492] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-10 13:09:09,518][988492] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-10 13:09:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77250560. Throughput: 0: 10050.9. Samples: 77239636. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:09,804][988181] Avg episode reward: [(0, '10.022')] [2023-03-10 13:09:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150880_77250560.pth... [2023-03-10 13:09:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150288_76947456.pth [2023-03-10 13:09:13,810][988492] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-10 13:09:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 77299712. Throughput: 0: 9943.9. Samples: 77296628. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:14,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 13:09:17,984][988492] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-10 13:09:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 77348864. Throughput: 0: 9988.1. Samples: 77327360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:19,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 13:09:22,258][988492] Updated weights for policy 0, policy_version 151120 (0.0004) [2023-03-10 13:09:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 77398016. Throughput: 0: 9928.1. Samples: 77383248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:24,804][988181] Avg episode reward: [(0, '10.019')] [2023-03-10 13:09:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151168_77398016.pth... [2023-03-10 13:09:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150584_77099008.pth [2023-03-10 13:09:26,336][988492] Updated weights for policy 0, policy_version 151200 (0.0005) [2023-03-10 13:09:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 77451264. Throughput: 0: 9972.6. Samples: 77445988. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:29,805][988181] Avg episode reward: [(0, '10.034')] [2023-03-10 13:09:30,224][988492] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-10 13:09:34,333][988492] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-10 13:09:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 77500416. Throughput: 0: 9969.9. Samples: 77475912. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:34,815][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:09:38,493][988492] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-10 13:09:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 77549568. Throughput: 0: 9993.7. Samples: 77536508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:39,804][988181] Avg episode reward: [(0, '10.020')] [2023-03-10 13:09:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151464_77549568.pth... [2023-03-10 13:09:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000150880_77250560.pth [2023-03-10 13:09:42,738][988492] Updated weights for policy 0, policy_version 151520 (0.0004) [2023-03-10 13:09:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77598720. Throughput: 0: 9919.6. Samples: 77594552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:44,804][988181] Avg episode reward: [(0, '10.038')] [2023-03-10 13:09:46,856][988492] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-10 13:09:49,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 77643776. Throughput: 0: 9856.7. Samples: 77623360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:49,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:09:51,043][988492] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-10 13:09:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77697024. Throughput: 0: 9866.9. Samples: 77683648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:54,805][988181] Avg episode reward: [(0, '10.024')] [2023-03-10 13:09:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151752_77697024.pth... [2023-03-10 13:09:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151168_77398016.pth [2023-03-10 13:09:55,161][988492] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-10 13:09:59,307][988492] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-10 13:09:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 77746176. Throughput: 0: 9900.4. Samples: 77742144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:09:59,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:10:03,489][988492] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-10 13:10:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 77795328. Throughput: 0: 9871.1. Samples: 77771560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:04,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 13:10:07,369][988492] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-10 13:10:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 77844480. Throughput: 0: 9990.2. Samples: 77832808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:09,804][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 13:10:09,853][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152048_77848576.pth... [2023-03-10 13:10:09,855][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151464_77549568.pth [2023-03-10 13:10:11,574][988492] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-10 13:10:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77897728. Throughput: 0: 9947.5. Samples: 77893624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:14,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:10:15,659][988492] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-10 13:10:19,740][988492] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-10 13:10:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 77946880. Throughput: 0: 9929.2. Samples: 77922728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:19,815][988181] Avg episode reward: [(0, '10.041')] [2023-03-10 13:10:23,913][988492] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-10 13:10:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 77996032. Throughput: 0: 9905.4. Samples: 77982252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:24,805][988181] Avg episode reward: [(0, '10.004')] [2023-03-10 13:10:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152336_77996032.pth... [2023-03-10 13:10:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000151752_77697024.pth [2023-03-10 13:10:27,844][988492] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-10 13:10:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 78045184. Throughput: 0: 10008.7. Samples: 78044940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:29,804][988181] Avg episode reward: [(0, '10.014')] [2023-03-10 13:10:31,953][988492] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-10 13:10:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9913.7). Total num frames: 78094336. Throughput: 0: 10010.2. Samples: 78073816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:34,804][988181] Avg episode reward: [(0, '10.034')] [2023-03-10 13:10:36,069][988492] Updated weights for policy 0, policy_version 152560 (0.0006) [2023-03-10 13:10:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 78147584. Throughput: 0: 10036.8. Samples: 78135304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:39,815][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 13:10:39,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152632_78147584.pth... [2023-03-10 13:10:39,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152048_77848576.pth [2023-03-10 13:10:40,003][988492] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-10 13:10:44,097][988492] Updated weights for policy 0, policy_version 152720 (0.0004) [2023-03-10 13:10:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 78196736. Throughput: 0: 10075.6. Samples: 78195544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:44,804][988181] Avg episode reward: [(0, '10.013')] [2023-03-10 13:10:48,095][988492] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-10 13:10:49,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 78249984. Throughput: 0: 10085.4. Samples: 78225404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:49,804][988181] Avg episode reward: [(0, '10.002')] [2023-03-10 13:10:52,156][988492] Updated weights for policy 0, policy_version 152880 (0.0004) [2023-03-10 13:10:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 78299136. Throughput: 0: 10087.0. Samples: 78286724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:54,804][988181] Avg episode reward: [(0, '9.999')] [2023-03-10 13:10:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152928_78299136.pth... [2023-03-10 13:10:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152336_77996032.pth [2023-03-10 13:10:56,450][988492] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-10 13:10:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78352384. Throughput: 0: 10100.7. Samples: 78348156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:10:59,804][988181] Avg episode reward: [(0, '9.995')] [2023-03-10 13:11:00,137][988492] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-10 13:11:04,125][988492] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-10 13:11:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78401536. Throughput: 0: 10151.4. Samples: 78379540. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:04,804][988181] Avg episode reward: [(0, '9.998')] [2023-03-10 13:11:08,100][988492] Updated weights for policy 0, policy_version 153200 (0.0005) [2023-03-10 13:11:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9927.6). Total num frames: 78454784. Throughput: 0: 10197.7. Samples: 78441148. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:09,804][988181] Avg episode reward: [(0, '9.987')] [2023-03-10 13:11:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153232_78454784.pth... [2023-03-10 13:11:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152632_78147584.pth [2023-03-10 13:11:12,066][988492] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-10 13:11:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78503936. Throughput: 0: 10148.7. Samples: 78501632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:14,804][988181] Avg episode reward: [(0, '9.950')] [2023-03-10 13:11:16,238][988492] Updated weights for policy 0, policy_version 153360 (0.0005) [2023-03-10 13:11:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78553088. Throughput: 0: 10178.4. Samples: 78531844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:19,804][988181] Avg episode reward: [(0, '9.955')] [2023-03-10 13:11:20,467][988492] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-10 13:11:24,742][988492] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-10 13:11:24,804][988181] Fps is (10 sec: 9830.2, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78602240. Throughput: 0: 10070.1. Samples: 78588460. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:24,804][988181] Avg episode reward: [(0, '9.931')] [2023-03-10 13:11:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153520_78602240.pth... [2023-03-10 13:11:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000152928_78299136.pth [2023-03-10 13:11:28,676][988492] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-10 13:11:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78651392. Throughput: 0: 10120.9. Samples: 78650984. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:29,804][988181] Avg episode reward: [(0, '9.807')] [2023-03-10 13:11:32,872][988492] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-10 13:11:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 78700544. Throughput: 0: 10101.0. Samples: 78679948. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:34,804][988181] Avg episode reward: [(0, '9.403')] [2023-03-10 13:11:37,103][988492] Updated weights for policy 0, policy_version 153760 (0.0006) [2023-03-10 13:11:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 78749696. Throughput: 0: 10016.6. Samples: 78737472. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:39,804][988181] Avg episode reward: [(0, '9.521')] [2023-03-10 13:11:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153808_78749696.pth... [2023-03-10 13:11:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153232_78454784.pth [2023-03-10 13:11:41,143][988492] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-10 13:11:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 78798848. Throughput: 0: 9976.9. Samples: 78797116. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:44,804][988181] Avg episode reward: [(0, '9.553')] [2023-03-10 13:11:45,410][988492] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-10 13:11:49,407][988492] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-10 13:11:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 78848000. Throughput: 0: 9943.7. Samples: 78827008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:49,804][988181] Avg episode reward: [(0, '9.390')] [2023-03-10 13:11:53,476][988492] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-10 13:11:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 78901248. Throughput: 0: 9929.1. Samples: 78887956. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:54,804][988181] Avg episode reward: [(0, '9.551')] [2023-03-10 13:11:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154104_78901248.pth... [2023-03-10 13:11:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153520_78602240.pth [2023-03-10 13:11:57,695][988492] Updated weights for policy 0, policy_version 154160 (0.0004) [2023-03-10 13:11:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 78946304. Throughput: 0: 9878.9. Samples: 78946184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:11:59,804][988181] Avg episode reward: [(0, '9.467')] [2023-03-10 13:12:01,955][988492] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-10 13:12:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 78995456. Throughput: 0: 9846.0. Samples: 78974916. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:12:04,804][988181] Avg episode reward: [(0, '9.547')] [2023-03-10 13:12:06,285][988492] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-10 13:12:09,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 79044608. Throughput: 0: 9857.1. Samples: 79032032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:09,805][988181] Avg episode reward: [(0, '9.257')] [2023-03-10 13:12:09,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154384_79044608.pth... [2023-03-10 13:12:09,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000153808_78749696.pth [2023-03-10 13:12:10,628][988492] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-10 13:12:14,345][988492] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-10 13:12:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 9969.2). Total num frames: 79097856. Throughput: 0: 9839.6. Samples: 79093768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:14,806][988181] Avg episode reward: [(0, '8.975')] [2023-03-10 13:12:18,300][988492] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-10 13:12:19,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 79147008. Throughput: 0: 9867.4. Samples: 79123980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:19,815][988181] Avg episode reward: [(0, '8.751')] [2023-03-10 13:12:22,467][988492] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-10 13:12:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 79196160. Throughput: 0: 9921.4. Samples: 79183936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:24,814][988181] Avg episode reward: [(0, '8.864')] [2023-03-10 13:12:24,817][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154680_79196160.pth... [2023-03-10 13:12:24,819][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154104_78901248.pth [2023-03-10 13:12:26,809][988492] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-10 13:12:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.6, 300 sec: 9941.5). Total num frames: 79245312. Throughput: 0: 9933.2. Samples: 79244108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:29,804][988181] Avg episode reward: [(0, '8.991')] [2023-03-10 13:12:30,765][988492] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-10 13:12:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 79294464. Throughput: 0: 9906.1. Samples: 79272780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:34,804][988181] Avg episode reward: [(0, '9.138')] [2023-03-10 13:12:35,021][988492] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-10 13:12:39,202][988492] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-10 13:12:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 79343616. Throughput: 0: 9853.0. Samples: 79331340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:39,804][988181] Avg episode reward: [(0, '8.801')] [2023-03-10 13:12:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154968_79343616.pth... [2023-03-10 13:12:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154384_79044608.pth [2023-03-10 13:12:43,266][988492] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-10 13:12:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 79392768. Throughput: 0: 9904.3. Samples: 79391880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:44,804][988181] Avg episode reward: [(0, '9.390')] [2023-03-10 13:12:47,355][988492] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-10 13:12:49,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9967.0, 300 sec: 9983.1). Total num frames: 79446016. Throughput: 0: 9922.8. Samples: 79421440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:49,804][988181] Avg episode reward: [(0, '9.107')] [2023-03-10 13:12:51,272][988492] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-10 13:12:54,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 79499264. Throughput: 0: 10088.0. Samples: 79485992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:54,804][988181] Avg episode reward: [(0, '9.358')] [2023-03-10 13:12:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155272_79499264.pth... [2023-03-10 13:12:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154680_79196160.pth [2023-03-10 13:12:55,129][988492] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-10 13:12:59,248][988492] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-10 13:12:59,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 79548416. Throughput: 0: 10025.2. Samples: 79544904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:12:59,805][988181] Avg episode reward: [(0, '9.730')] [2023-03-10 13:13:03,158][988492] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-10 13:13:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 79601664. Throughput: 0: 10065.9. Samples: 79576944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:04,804][988181] Avg episode reward: [(0, '9.821')] [2023-03-10 13:13:07,168][988492] Updated weights for policy 0, policy_version 155520 (0.0006) [2023-03-10 13:13:09,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 79650816. Throughput: 0: 10092.9. Samples: 79638120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:09,815][988181] Avg episode reward: [(0, '9.860')] [2023-03-10 13:13:09,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155568_79650816.pth... [2023-03-10 13:13:09,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000154968_79343616.pth [2023-03-10 13:13:10,925][988492] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-10 13:13:14,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 79704064. Throughput: 0: 10220.6. Samples: 79704036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:14,815][988181] Avg episode reward: [(0, '9.860')] [2023-03-10 13:13:14,870][988492] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-10 13:13:19,121][988492] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-10 13:13:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 79753216. Throughput: 0: 10214.2. Samples: 79732420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:19,815][988181] Avg episode reward: [(0, '9.887')] [2023-03-10 13:13:23,235][988492] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-10 13:13:24,804][988181] Fps is (10 sec: 9830.1, 60 sec: 10103.4, 300 sec: 10010.9). Total num frames: 79802368. Throughput: 0: 10211.2. Samples: 79790844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:24,805][988181] Avg episode reward: [(0, '9.882')] [2023-03-10 13:13:24,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155864_79802368.pth... [2023-03-10 13:13:24,813][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155272_79499264.pth [2023-03-10 13:13:27,471][988492] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-10 13:13:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 79851520. Throughput: 0: 10162.7. Samples: 79849200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:29,804][988181] Avg episode reward: [(0, '9.867')] [2023-03-10 13:13:31,713][988492] Updated weights for policy 0, policy_version 156000 (0.0004) [2023-03-10 13:13:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 79900672. Throughput: 0: 10145.6. Samples: 79877992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:34,815][988181] Avg episode reward: [(0, '9.885')] [2023-03-10 13:13:35,994][988492] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-10 13:13:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 79949824. Throughput: 0: 9982.9. Samples: 79935224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:39,804][988181] Avg episode reward: [(0, '9.895')] [2023-03-10 13:13:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156152_79949824.pth... [2023-03-10 13:13:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155568_79650816.pth [2023-03-10 13:13:40,156][988492] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-10 13:13:44,293][988492] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-10 13:13:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 79998976. Throughput: 0: 10001.1. Samples: 79994952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:44,804][988181] Avg episode reward: [(0, '9.891')] [2023-03-10 13:13:48,434][988492] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-10 13:13:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 80048128. Throughput: 0: 9946.2. Samples: 80024524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:49,804][988181] Avg episode reward: [(0, '9.915')] [2023-03-10 13:13:52,358][988492] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-10 13:13:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 80097280. Throughput: 0: 10018.4. Samples: 80088948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:54,804][988181] Avg episode reward: [(0, '9.899')] [2023-03-10 13:13:54,866][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156448_80101376.pth... [2023-03-10 13:13:54,869][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000155864_79802368.pth [2023-03-10 13:13:56,527][988492] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-10 13:13:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 80150528. Throughput: 0: 9838.6. Samples: 80146772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:13:59,804][988181] Avg episode reward: [(0, '9.925')] [2023-03-10 13:14:00,420][988492] Updated weights for policy 0, policy_version 156560 (0.0004) [2023-03-10 13:14:04,432][988492] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-10 13:14:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 80199680. Throughput: 0: 9923.3. Samples: 80178968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:04,804][988181] Avg episode reward: [(0, '9.868')] [2023-03-10 13:14:08,516][988492] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-10 13:14:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 80248832. Throughput: 0: 9970.0. Samples: 80239492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:09,804][988181] Avg episode reward: [(0, '9.898')] [2023-03-10 13:14:09,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156744_80252928.pth... [2023-03-10 13:14:09,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156152_79949824.pth [2023-03-10 13:14:12,516][988492] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-10 13:14:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 80302080. Throughput: 0: 9991.3. Samples: 80298808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:14,804][988181] Avg episode reward: [(0, '9.908')] [2023-03-10 13:14:16,562][988492] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-10 13:14:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 80351232. Throughput: 0: 10057.7. Samples: 80330588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:19,815][988181] Avg episode reward: [(0, '9.868')] [2023-03-10 13:14:20,857][988492] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-10 13:14:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 9997.0). Total num frames: 80400384. Throughput: 0: 10042.9. Samples: 80387156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:24,804][988181] Avg episode reward: [(0, '9.898')] [2023-03-10 13:14:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157032_80400384.pth... [2023-03-10 13:14:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156448_80101376.pth [2023-03-10 13:14:25,098][988492] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-10 13:14:28,967][988492] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-10 13:14:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 80453632. Throughput: 0: 10103.5. Samples: 80449608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:29,804][988181] Avg episode reward: [(0, '9.860')] [2023-03-10 13:14:33,031][988492] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-10 13:14:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 80502784. Throughput: 0: 10102.6. Samples: 80479140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:34,815][988181] Avg episode reward: [(0, '9.913')] [2023-03-10 13:14:37,184][988492] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-10 13:14:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 80551936. Throughput: 0: 10006.9. Samples: 80539260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:39,815][988181] Avg episode reward: [(0, '9.920')] [2023-03-10 13:14:39,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157328_80551936.pth... [2023-03-10 13:14:39,822][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000156744_80252928.pth [2023-03-10 13:14:41,230][988492] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-10 13:14:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 80601088. Throughput: 0: 10039.3. Samples: 80598540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:44,804][988181] Avg episode reward: [(0, '9.880')] [2023-03-10 13:14:45,384][988492] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-10 13:14:49,453][988492] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-10 13:14:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 80650240. Throughput: 0: 10019.0. Samples: 80629824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:49,804][988181] Avg episode reward: [(0, '9.860')] [2023-03-10 13:14:53,543][988492] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-10 13:14:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 80703488. Throughput: 0: 9997.0. Samples: 80689356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:54,804][988181] Avg episode reward: [(0, '9.916')] [2023-03-10 13:14:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157624_80703488.pth... [2023-03-10 13:14:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157032_80400384.pth [2023-03-10 13:14:57,615][988492] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-10 13:14:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 80752640. Throughput: 0: 10005.7. Samples: 80749064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:14:59,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 13:15:01,764][988492] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-10 13:15:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 80801792. Throughput: 0: 9964.2. Samples: 80778976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:15:04,804][988181] Avg episode reward: [(0, '9.939')] [2023-03-10 13:15:05,693][988492] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-10 13:15:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 80850944. Throughput: 0: 10031.2. Samples: 80838560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:15:09,804][988181] Avg episode reward: [(0, '9.912')] [2023-03-10 13:15:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157912_80850944.pth... [2023-03-10 13:15:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157328_80551936.pth [2023-03-10 13:15:10,028][988492] Updated weights for policy 0, policy_version 157920 (0.0004) [2023-03-10 13:15:13,951][988492] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-10 13:15:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 80900096. Throughput: 0: 10009.7. Samples: 80900044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:15:14,804][988181] Avg episode reward: [(0, '9.899')] [2023-03-10 13:15:18,275][988492] Updated weights for policy 0, policy_version 158080 (0.0004) [2023-03-10 13:15:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 80949248. Throughput: 0: 9988.0. Samples: 80928600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:15:19,804][988181] Avg episode reward: [(0, '9.915')] [2023-03-10 13:15:22,444][988492] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-10 13:15:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 80998400. Throughput: 0: 9930.1. Samples: 80986112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:24,804][988181] Avg episode reward: [(0, '9.940')] [2023-03-10 13:15:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158200_80998400.pth... [2023-03-10 13:15:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157624_80703488.pth [2023-03-10 13:15:26,740][988492] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-10 13:15:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 81047552. Throughput: 0: 9888.6. Samples: 81043528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:29,804][988181] Avg episode reward: [(0, '9.888')] [2023-03-10 13:15:30,905][988492] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-10 13:15:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 81096704. Throughput: 0: 9898.7. Samples: 81075264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:34,804][988181] Avg episode reward: [(0, '9.883')] [2023-03-10 13:15:35,016][988492] Updated weights for policy 0, policy_version 158400 (0.0004) [2023-03-10 13:15:38,873][988492] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-10 13:15:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 81149952. Throughput: 0: 9925.2. Samples: 81135992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:39,804][988181] Avg episode reward: [(0, '9.915')] [2023-03-10 13:15:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158496_81149952.pth... [2023-03-10 13:15:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000157912_80850944.pth [2023-03-10 13:15:42,967][988492] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-10 13:15:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 81199104. Throughput: 0: 9975.7. Samples: 81197972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:44,804][988181] Avg episode reward: [(0, '9.848')] [2023-03-10 13:15:47,115][988492] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-10 13:15:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 81248256. Throughput: 0: 9939.8. Samples: 81226268. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:49,804][988181] Avg episode reward: [(0, '9.904')] [2023-03-10 13:15:51,062][988492] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-10 13:15:54,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 81301504. Throughput: 0: 9983.9. Samples: 81287836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:54,804][988181] Avg episode reward: [(0, '9.912')] [2023-03-10 13:15:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158792_81301504.pth... [2023-03-10 13:15:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158200_80998400.pth [2023-03-10 13:15:55,055][988492] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-10 13:15:59,096][988492] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-10 13:15:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 81350656. Throughput: 0: 9989.1. Samples: 81349556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:15:59,804][988181] Avg episode reward: [(0, '9.858')] [2023-03-10 13:16:03,060][988492] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-10 13:16:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 81403904. Throughput: 0: 10018.9. Samples: 81379452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:16:04,804][988181] Avg episode reward: [(0, '9.949')] [2023-03-10 13:16:07,074][988492] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-10 13:16:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 81453056. Throughput: 0: 10103.7. Samples: 81440780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:16:09,815][988181] Avg episode reward: [(0, '9.895')] [2023-03-10 13:16:09,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159088_81453056.pth... [2023-03-10 13:16:09,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158496_81149952.pth [2023-03-10 13:16:11,298][988492] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-10 13:16:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 81502208. Throughput: 0: 10182.5. Samples: 81501740. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:16:14,815][988181] Avg episode reward: [(0, '9.877')] [2023-03-10 13:16:15,156][988492] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-10 13:16:19,255][988492] Updated weights for policy 0, policy_version 159280 (0.0006) [2023-03-10 13:16:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 10010.9). Total num frames: 81555456. Throughput: 0: 10170.2. Samples: 81532924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:16:19,815][988181] Avg episode reward: [(0, '9.922')] [2023-03-10 13:16:23,526][988492] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-10 13:16:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 81600512. Throughput: 0: 10101.6. Samples: 81590564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:24,815][988181] Avg episode reward: [(0, '9.845')] [2023-03-10 13:16:24,859][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159384_81604608.pth... [2023-03-10 13:16:24,861][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000158792_81301504.pth [2023-03-10 13:16:27,682][988492] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-10 13:16:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 81653760. Throughput: 0: 10039.2. Samples: 81649736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:29,804][988181] Avg episode reward: [(0, '9.902')] [2023-03-10 13:16:31,594][988492] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-10 13:16:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 81702912. Throughput: 0: 10121.0. Samples: 81681716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:34,815][988181] Avg episode reward: [(0, '9.840')] [2023-03-10 13:16:35,914][988492] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-10 13:16:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 81752064. Throughput: 0: 10038.3. Samples: 81739560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:39,804][988181] Avg episode reward: [(0, '9.910')] [2023-03-10 13:16:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159672_81752064.pth... [2023-03-10 13:16:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159088_81453056.pth [2023-03-10 13:16:40,027][988492] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-10 13:16:43,985][988492] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-10 13:16:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 81801216. Throughput: 0: 10036.1. Samples: 81801180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:44,804][988181] Avg episode reward: [(0, '9.926')] [2023-03-10 13:16:48,008][988492] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-10 13:16:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 81854464. Throughput: 0: 10009.5. Samples: 81829880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:49,804][988181] Avg episode reward: [(0, '9.881')] [2023-03-10 13:16:52,059][988492] Updated weights for policy 0, policy_version 159920 (0.0004) [2023-03-10 13:16:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 81903616. Throughput: 0: 10009.0. Samples: 81891188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:54,804][988181] Avg episode reward: [(0, '9.868')] [2023-03-10 13:16:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159968_81903616.pth... [2023-03-10 13:16:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159384_81604608.pth [2023-03-10 13:16:56,271][988492] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-10 13:16:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 81956864. Throughput: 0: 10008.2. Samples: 81952108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:16:59,804][988181] Avg episode reward: [(0, '9.890')] [2023-03-10 13:17:00,144][988492] Updated weights for policy 0, policy_version 160080 (0.0004) [2023-03-10 13:17:04,278][988492] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-10 13:17:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 82006016. Throughput: 0: 10014.8. Samples: 81983588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:17:04,804][988181] Avg episode reward: [(0, '9.887')] [2023-03-10 13:17:08,355][988492] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-10 13:17:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 82055168. Throughput: 0: 10051.5. Samples: 82042880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:17:09,804][988181] Avg episode reward: [(0, '9.849')] [2023-03-10 13:17:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160264_82055168.pth... [2023-03-10 13:17:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159672_81752064.pth [2023-03-10 13:17:12,570][988492] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-10 13:17:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 82104320. Throughput: 0: 10044.7. Samples: 82101748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:17:14,815][988181] Avg episode reward: [(0, '9.862')] [2023-03-10 13:17:16,668][988492] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-10 13:17:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 82157568. Throughput: 0: 10004.8. Samples: 82131932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:17:19,804][988181] Avg episode reward: [(0, '9.856')] [2023-03-10 13:17:20,470][988492] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-10 13:17:24,663][988492] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-10 13:17:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 82206720. Throughput: 0: 10104.7. Samples: 82194272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:17:24,804][988181] Avg episode reward: [(0, '9.879')] [2023-03-10 13:17:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160560_82206720.pth... [2023-03-10 13:17:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000159968_81903616.pth [2023-03-10 13:17:28,629][988492] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-10 13:17:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 82255872. Throughput: 0: 10099.9. Samples: 82255676. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:29,804][988181] Avg episode reward: [(0, '9.847')] [2023-03-10 13:17:32,739][988492] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-10 13:17:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 82309120. Throughput: 0: 10103.0. Samples: 82284516. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:34,804][988181] Avg episode reward: [(0, '9.871')] [2023-03-10 13:17:36,756][988492] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-10 13:17:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 82358272. Throughput: 0: 10098.9. Samples: 82345640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:39,804][988181] Avg episode reward: [(0, '9.820')] [2023-03-10 13:17:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160856_82358272.pth... [2023-03-10 13:17:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160264_82055168.pth [2023-03-10 13:17:40,849][988492] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-10 13:17:44,685][988492] Updated weights for policy 0, policy_version 160960 (0.0005) [2023-03-10 13:17:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 82411520. Throughput: 0: 10119.7. Samples: 82407496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:44,804][988181] Avg episode reward: [(0, '9.816')] [2023-03-10 13:17:48,900][988492] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-10 13:17:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 82460672. Throughput: 0: 10083.6. Samples: 82437348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:49,804][988181] Avg episode reward: [(0, '9.831')] [2023-03-10 13:17:52,804][988492] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-10 13:17:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 82513920. Throughput: 0: 10141.8. Samples: 82499260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:54,804][988181] Avg episode reward: [(0, '9.869')] [2023-03-10 13:17:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161160_82513920.pth... [2023-03-10 13:17:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160560_82206720.pth [2023-03-10 13:17:56,732][988492] Updated weights for policy 0, policy_version 161200 (0.0004) [2023-03-10 13:17:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 82563072. Throughput: 0: 10208.0. Samples: 82561108. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:17:59,804][988181] Avg episode reward: [(0, '9.876')] [2023-03-10 13:18:00,862][988492] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-10 13:18:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 82612224. Throughput: 0: 10186.3. Samples: 82590312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:04,804][988181] Avg episode reward: [(0, '9.850')] [2023-03-10 13:18:05,115][988492] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-10 13:18:09,126][988492] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-10 13:18:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 82661376. Throughput: 0: 10107.0. Samples: 82649088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:09,815][988181] Avg episode reward: [(0, '9.827')] [2023-03-10 13:18:09,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161448_82661376.pth... [2023-03-10 13:18:09,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000160856_82358272.pth [2023-03-10 13:18:13,459][988492] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-10 13:18:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 82710528. Throughput: 0: 10022.4. Samples: 82706684. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:14,815][988181] Avg episode reward: [(0, '9.794')] [2023-03-10 13:18:17,333][988492] Updated weights for policy 0, policy_version 161600 (0.0004) [2023-03-10 13:18:19,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 82759680. Throughput: 0: 10104.5. Samples: 82739216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:19,814][988181] Avg episode reward: [(0, '9.844')] [2023-03-10 13:18:21,425][988492] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-10 13:18:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 82808832. Throughput: 0: 10084.7. Samples: 82799452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:24,815][988181] Avg episode reward: [(0, '9.866')] [2023-03-10 13:18:24,830][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161744_82812928.pth... [2023-03-10 13:18:24,833][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161160_82513920.pth [2023-03-10 13:18:25,680][988492] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-10 13:18:29,728][988492] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-10 13:18:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 82862080. Throughput: 0: 10009.5. Samples: 82857924. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:18:29,804][988181] Avg episode reward: [(0, '9.808')] [2023-03-10 13:18:33,773][988492] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-10 13:18:34,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 82911232. Throughput: 0: 10044.0. Samples: 82889328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:34,804][988181] Avg episode reward: [(0, '9.758')] [2023-03-10 13:18:37,691][988492] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-10 13:18:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 82960384. Throughput: 0: 10043.9. Samples: 82951236. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:39,804][988181] Avg episode reward: [(0, '9.814')] [2023-03-10 13:18:39,843][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162040_82964480.pth... [2023-03-10 13:18:39,844][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161448_82661376.pth [2023-03-10 13:18:41,994][988492] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-10 13:18:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 83013632. Throughput: 0: 9965.2. Samples: 83009544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:44,804][988181] Avg episode reward: [(0, '9.772')] [2023-03-10 13:18:45,866][988492] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-10 13:18:49,712][988492] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-10 13:18:49,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 83066880. Throughput: 0: 10033.7. Samples: 83041828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:49,804][988181] Avg episode reward: [(0, '9.687')] [2023-03-10 13:18:53,518][988492] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-10 13:18:54,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 83120128. Throughput: 0: 10172.5. Samples: 83106852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:54,804][988181] Avg episode reward: [(0, '9.703')] [2023-03-10 13:18:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162344_83120128.pth... [2023-03-10 13:18:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000161744_82812928.pth [2023-03-10 13:18:57,499][988492] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-10 13:18:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 83169280. Throughput: 0: 10217.9. Samples: 83166488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:18:59,804][988181] Avg episode reward: [(0, '9.688')] [2023-03-10 13:19:01,721][988492] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-10 13:19:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 83218432. Throughput: 0: 10154.2. Samples: 83196156. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:04,804][988181] Avg episode reward: [(0, '9.446')] [2023-03-10 13:19:05,856][988492] Updated weights for policy 0, policy_version 162560 (0.0006) [2023-03-10 13:19:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 83267584. Throughput: 0: 10131.6. Samples: 83255372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:09,804][988181] Avg episode reward: [(0, '8.361')] [2023-03-10 13:19:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162632_83267584.pth... [2023-03-10 13:19:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162040_82964480.pth [2023-03-10 13:19:09,918][988492] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-10 13:19:14,022][988492] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-10 13:19:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10066.4). Total num frames: 83320832. Throughput: 0: 10192.8. Samples: 83316600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:14,815][988181] Avg episode reward: [(0, '8.609')] [2023-03-10 13:19:18,009][988492] Updated weights for policy 0, policy_version 162800 (0.0004) [2023-03-10 13:19:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10066.4). Total num frames: 83369984. Throughput: 0: 10192.9. Samples: 83348008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:19,815][988181] Avg episode reward: [(0, '9.238')] [2023-03-10 13:19:22,144][988492] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-10 13:19:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 83419136. Throughput: 0: 10142.4. Samples: 83407644. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:24,815][988181] Avg episode reward: [(0, '8.912')] [2023-03-10 13:19:24,817][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162928_83419136.pth... [2023-03-10 13:19:24,819][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162344_83120128.pth [2023-03-10 13:19:26,208][988492] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-10 13:19:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 83468288. Throughput: 0: 10136.8. Samples: 83465700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:29,804][988181] Avg episode reward: [(0, '9.381')] [2023-03-10 13:19:30,199][988492] Updated weights for policy 0, policy_version 163040 (0.0004) [2023-03-10 13:19:34,380][988492] Updated weights for policy 0, policy_version 163120 (0.0004) [2023-03-10 13:19:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 83517440. Throughput: 0: 10162.8. Samples: 83499152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:34,815][988181] Avg episode reward: [(0, '8.916')] [2023-03-10 13:19:38,519][988492] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-10 13:19:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10066.4). Total num frames: 83570688. Throughput: 0: 9997.0. Samples: 83556716. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:39,805][988181] Avg episode reward: [(0, '9.363')] [2023-03-10 13:19:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163224_83570688.pth... [2023-03-10 13:19:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162632_83267584.pth [2023-03-10 13:19:42,580][988492] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-10 13:19:44,805][988181] Fps is (10 sec: 10238.9, 60 sec: 10103.3, 300 sec: 10066.4). Total num frames: 83619840. Throughput: 0: 9984.8. Samples: 83615816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:44,806][988181] Avg episode reward: [(0, '9.480')] [2023-03-10 13:19:46,718][988492] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-10 13:19:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 83668992. Throughput: 0: 10004.4. Samples: 83646352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:49,804][988181] Avg episode reward: [(0, '9.419')] [2023-03-10 13:19:50,902][988492] Updated weights for policy 0, policy_version 163440 (0.0004) [2023-03-10 13:19:54,804][988181] Fps is (10 sec: 9831.4, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 83718144. Throughput: 0: 10001.6. Samples: 83705444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:54,804][988181] Avg episode reward: [(0, '9.645')] [2023-03-10 13:19:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163512_83718144.pth... [2023-03-10 13:19:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000162928_83419136.pth [2023-03-10 13:19:54,996][988492] Updated weights for policy 0, policy_version 163520 (0.0004) [2023-03-10 13:19:58,972][988492] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-10 13:19:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 83771392. Throughput: 0: 10024.9. Samples: 83767720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:19:59,804][988181] Avg episode reward: [(0, '9.782')] [2023-03-10 13:20:02,698][988492] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-10 13:20:04,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 10080.3). Total num frames: 83824640. Throughput: 0: 10044.9. Samples: 83800028. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:04,804][988181] Avg episode reward: [(0, '9.695')] [2023-03-10 13:20:06,777][988492] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-10 13:20:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10080.3). Total num frames: 83873792. Throughput: 0: 10085.8. Samples: 83861504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:09,804][988181] Avg episode reward: [(0, '9.720')] [2023-03-10 13:20:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163816_83873792.pth... [2023-03-10 13:20:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163224_83570688.pth [2023-03-10 13:20:10,801][988492] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-10 13:20:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 83922944. Throughput: 0: 10108.5. Samples: 83920584. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:14,804][988181] Avg episode reward: [(0, '9.889')] [2023-03-10 13:20:14,985][988492] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-10 13:20:19,014][988492] Updated weights for policy 0, policy_version 164000 (0.0004) [2023-03-10 13:20:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 83972096. Throughput: 0: 10054.8. Samples: 83951616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:19,804][988181] Avg episode reward: [(0, '9.936')] [2023-03-10 13:20:23,137][988492] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-10 13:20:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 84021248. Throughput: 0: 10101.7. Samples: 84011292. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:24,804][988181] Avg episode reward: [(0, '9.984')] [2023-03-10 13:20:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164104_84021248.pth... [2023-03-10 13:20:24,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163512_83718144.pth [2023-03-10 13:20:27,458][988492] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-10 13:20:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 84070400. Throughput: 0: 10064.5. Samples: 84068708. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:29,804][988181] Avg episode reward: [(0, '9.979')] [2023-03-10 13:20:31,607][988492] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-10 13:20:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 84119552. Throughput: 0: 10044.5. Samples: 84098356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:34,804][988181] Avg episode reward: [(0, '10.004')] [2023-03-10 13:20:35,810][988492] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-10 13:20:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10066.4). Total num frames: 84168704. Throughput: 0: 10023.0. Samples: 84156480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-10 13:20:39,804][988181] Avg episode reward: [(0, '9.993')] [2023-03-10 13:20:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164392_84168704.pth... [2023-03-10 13:20:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000163816_83873792.pth [2023-03-10 13:20:40,153][988492] Updated weights for policy 0, policy_version 164400 (0.0004) [2023-03-10 13:20:44,156][988492] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-10 13:20:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9967.1, 300 sec: 10066.4). Total num frames: 84217856. Throughput: 0: 9956.1. Samples: 84215744. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:20:44,804][988181] Avg episode reward: [(0, '9.988')] [2023-03-10 13:20:48,165][988492] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-10 13:20:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 84267008. Throughput: 0: 9923.7. Samples: 84246592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:20:49,804][988181] Avg episode reward: [(0, '9.991')] [2023-03-10 13:20:52,203][988492] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-10 13:20:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 84316160. Throughput: 0: 9888.5. Samples: 84306484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:20:54,804][988181] Avg episode reward: [(0, '10.002')] [2023-03-10 13:20:54,838][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164688_84320256.pth... [2023-03-10 13:20:54,840][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164104_84021248.pth [2023-03-10 13:20:56,512][988492] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-10 13:20:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 84365312. Throughput: 0: 9879.8. Samples: 84365176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:20:59,804][988181] Avg episode reward: [(0, '9.975')] [2023-03-10 13:21:00,759][988492] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-10 13:21:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10038.7). Total num frames: 84414464. Throughput: 0: 9823.4. Samples: 84393668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:04,804][988181] Avg episode reward: [(0, '9.995')] [2023-03-10 13:21:04,942][988492] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-10 13:21:09,284][988492] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-10 13:21:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 10038.7). Total num frames: 84463616. Throughput: 0: 9773.3. Samples: 84451092. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:09,804][988181] Avg episode reward: [(0, '9.983')] [2023-03-10 13:21:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164968_84463616.pth... [2023-03-10 13:21:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164392_84168704.pth [2023-03-10 13:21:13,325][988492] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-10 13:21:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 84512768. Throughput: 0: 9805.6. Samples: 84509960. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:14,804][988181] Avg episode reward: [(0, '10.007')] [2023-03-10 13:21:17,301][988492] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-10 13:21:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 84566016. Throughput: 0: 9847.7. Samples: 84541504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:19,804][988181] Avg episode reward: [(0, '9.989')] [2023-03-10 13:21:21,593][988492] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-10 13:21:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 84611072. Throughput: 0: 9837.3. Samples: 84599160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:24,804][988181] Avg episode reward: [(0, '9.981')] [2023-03-10 13:21:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165256_84611072.pth... [2023-03-10 13:21:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164688_84320256.pth [2023-03-10 13:21:25,906][988492] Updated weights for policy 0, policy_version 165280 (0.0004) [2023-03-10 13:21:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 84660224. Throughput: 0: 9787.9. Samples: 84656200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:29,805][988181] Avg episode reward: [(0, '9.989')] [2023-03-10 13:21:30,184][988492] Updated weights for policy 0, policy_version 165360 (0.0004) [2023-03-10 13:21:34,068][988492] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-10 13:21:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.6, 300 sec: 10038.7). Total num frames: 84713472. Throughput: 0: 9771.8. Samples: 84686324. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:34,804][988181] Avg episode reward: [(0, '10.017')] [2023-03-10 13:21:38,235][988492] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-10 13:21:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 84758528. Throughput: 0: 9789.4. Samples: 84747008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:39,804][988181] Avg episode reward: [(0, '9.996')] [2023-03-10 13:21:39,835][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165552_84762624.pth... [2023-03-10 13:21:39,838][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000164968_84463616.pth [2023-03-10 13:21:42,182][988492] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-10 13:21:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 84811776. Throughput: 0: 9837.7. Samples: 84807872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:21:44,804][988181] Avg episode reward: [(0, '10.020')] [2023-03-10 13:21:46,309][988492] Updated weights for policy 0, policy_version 165680 (0.0005) [2023-03-10 13:21:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 84860928. Throughput: 0: 9869.5. Samples: 84837796. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:21:49,804][988181] Avg episode reward: [(0, '10.001')] [2023-03-10 13:21:50,372][988492] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-10 13:21:54,342][988492] Updated weights for policy 0, policy_version 165840 (0.0006) [2023-03-10 13:21:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 84914176. Throughput: 0: 9957.2. Samples: 84899168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:21:54,804][988181] Avg episode reward: [(0, '9.999')] [2023-03-10 13:21:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165848_84914176.pth... [2023-03-10 13:21:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165256_84611072.pth [2023-03-10 13:21:58,443][988492] Updated weights for policy 0, policy_version 165920 (0.0005) [2023-03-10 13:21:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 84963328. Throughput: 0: 9985.2. Samples: 84959296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:21:59,804][988181] Avg episode reward: [(0, '9.995')] [2023-03-10 13:22:02,672][988492] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-10 13:22:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 85012480. Throughput: 0: 9936.1. Samples: 84988628. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:04,804][988181] Avg episode reward: [(0, '10.008')] [2023-03-10 13:22:06,852][988492] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-10 13:22:09,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 85057536. Throughput: 0: 9962.3. Samples: 85047464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:09,804][988181] Avg episode reward: [(0, '10.005')] [2023-03-10 13:22:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166128_85057536.pth... [2023-03-10 13:22:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165552_84762624.pth [2023-03-10 13:22:11,073][988492] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-10 13:22:14,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 85106688. Throughput: 0: 9950.2. Samples: 85103960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:14,804][988181] Avg episode reward: [(0, '10.021')] [2023-03-10 13:22:15,568][988492] Updated weights for policy 0, policy_version 166240 (0.0004) [2023-03-10 13:22:19,615][988492] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-10 13:22:19,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 85155840. Throughput: 0: 9914.9. Samples: 85132496. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:19,804][988181] Avg episode reward: [(0, '10.006')] [2023-03-10 13:22:23,909][988492] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-10 13:22:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 85204992. Throughput: 0: 9882.8. Samples: 85191732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:24,804][988181] Avg episode reward: [(0, '10.000')] [2023-03-10 13:22:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166416_85204992.pth... [2023-03-10 13:22:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000165848_84914176.pth [2023-03-10 13:22:28,005][988492] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-10 13:22:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 85254144. Throughput: 0: 9839.2. Samples: 85250636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:29,804][988181] Avg episode reward: [(0, '9.997')] [2023-03-10 13:22:32,015][988492] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-10 13:22:34,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 85303296. Throughput: 0: 9886.0. Samples: 85282664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:34,804][988181] Avg episode reward: [(0, '9.995')] [2023-03-10 13:22:36,123][988492] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-10 13:22:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 85356544. Throughput: 0: 9857.3. Samples: 85342744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:39,804][988181] Avg episode reward: [(0, '10.008')] [2023-03-10 13:22:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166712_85356544.pth... [2023-03-10 13:22:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166128_85057536.pth [2023-03-10 13:22:40,149][988492] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-10 13:22:44,034][988492] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-10 13:22:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 85405696. Throughput: 0: 9907.9. Samples: 85405152. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:44,804][988181] Avg episode reward: [(0, '9.973')] [2023-03-10 13:22:48,329][988492] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-10 13:22:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9969.3). Total num frames: 85454848. Throughput: 0: 9875.0. Samples: 85433004. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:22:49,804][988181] Avg episode reward: [(0, '9.991')] [2023-03-10 13:22:52,332][988492] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-10 13:22:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 85508096. Throughput: 0: 9949.5. Samples: 85495192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:22:54,815][988181] Avg episode reward: [(0, '10.000')] [2023-03-10 13:22:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167008_85508096.pth... [2023-03-10 13:22:54,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166416_85204992.pth [2023-03-10 13:22:56,267][988492] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-10 13:22:59,804][988181] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 85561344. Throughput: 0: 10056.6. Samples: 85556508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:22:59,815][988181] Avg episode reward: [(0, '9.988')] [2023-03-10 13:23:00,141][988492] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-10 13:23:04,024][988492] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-10 13:23:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 85610496. Throughput: 0: 10147.7. Samples: 85589140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:04,804][988181] Avg episode reward: [(0, '10.000')] [2023-03-10 13:23:08,095][988492] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-10 13:23:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 85659648. Throughput: 0: 10185.5. Samples: 85650080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:09,804][988181] Avg episode reward: [(0, '9.974')] [2023-03-10 13:23:09,838][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167312_85663744.pth... [2023-03-10 13:23:09,839][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000166712_85356544.pth [2023-03-10 13:23:12,244][988492] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-10 13:23:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 85712896. Throughput: 0: 10183.0. Samples: 85708872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:14,804][988181] Avg episode reward: [(0, '9.963')] [2023-03-10 13:23:16,358][988492] Updated weights for policy 0, policy_version 167440 (0.0004) [2023-03-10 13:23:19,804][988181] Fps is (10 sec: 10649.7, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 85766144. Throughput: 0: 10153.3. Samples: 85739560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:19,804][988181] Avg episode reward: [(0, '9.934')] [2023-03-10 13:23:20,087][988492] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-10 13:23:23,952][988492] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-10 13:23:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 85815296. Throughput: 0: 10229.7. Samples: 85803080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:24,804][988181] Avg episode reward: [(0, '9.969')] [2023-03-10 13:23:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167608_85815296.pth... [2023-03-10 13:23:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167008_85508096.pth [2023-03-10 13:23:28,165][988492] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-10 13:23:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 85864448. Throughput: 0: 10205.8. Samples: 85864416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:29,804][988181] Avg episode reward: [(0, '9.950')] [2023-03-10 13:23:32,119][988492] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-10 13:23:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10024.8). Total num frames: 85917696. Throughput: 0: 10280.9. Samples: 85895644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:34,804][988181] Avg episode reward: [(0, '9.955')] [2023-03-10 13:23:36,124][988492] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-10 13:23:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 85966848. Throughput: 0: 10214.3. Samples: 85954836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:39,804][988181] Avg episode reward: [(0, '9.930')] [2023-03-10 13:23:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167904_85966848.pth... [2023-03-10 13:23:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167312_85663744.pth [2023-03-10 13:23:40,428][988492] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-10 13:23:44,531][988492] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-10 13:23:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 86016000. Throughput: 0: 10152.9. Samples: 86013388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:44,804][988181] Avg episode reward: [(0, '9.966')] [2023-03-10 13:23:48,609][988492] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-10 13:23:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 86065152. Throughput: 0: 10121.1. Samples: 86044588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:49,804][988181] Avg episode reward: [(0, '9.956')] [2023-03-10 13:23:52,920][988492] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-10 13:23:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 86114304. Throughput: 0: 10044.4. Samples: 86102080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:23:54,804][988181] Avg episode reward: [(0, '9.958')] [2023-03-10 13:23:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168192_86114304.pth... [2023-03-10 13:23:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167608_85815296.pth [2023-03-10 13:23:56,997][988492] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-10 13:23:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 86163456. Throughput: 0: 10097.1. Samples: 86163240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:23:59,804][988181] Avg episode reward: [(0, '9.989')] [2023-03-10 13:24:01,024][988492] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-10 13:24:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 86216704. Throughput: 0: 10085.2. Samples: 86193392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:04,805][988181] Avg episode reward: [(0, '9.967')] [2023-03-10 13:24:05,033][988492] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-10 13:24:08,901][988492] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-10 13:24:09,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 86269952. Throughput: 0: 10056.5. Samples: 86255624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:09,804][988181] Avg episode reward: [(0, '9.986')] [2023-03-10 13:24:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168496_86269952.pth... [2023-03-10 13:24:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000167904_85966848.pth [2023-03-10 13:24:13,265][988492] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-10 13:24:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 86315008. Throughput: 0: 9955.5. Samples: 86312416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:14,805][988181] Avg episode reward: [(0, '9.967')] [2023-03-10 13:24:17,284][988492] Updated weights for policy 0, policy_version 168640 (0.0004) [2023-03-10 13:24:19,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 86364160. Throughput: 0: 9958.7. Samples: 86343784. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:19,804][988181] Avg episode reward: [(0, '9.939')] [2023-03-10 13:24:21,646][988492] Updated weights for policy 0, policy_version 168720 (0.0004) [2023-03-10 13:24:24,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 86413312. Throughput: 0: 9943.8. Samples: 86402308. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:24,804][988181] Avg episode reward: [(0, '9.959')] [2023-03-10 13:24:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168776_86413312.pth... [2023-03-10 13:24:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168192_86114304.pth [2023-03-10 13:24:25,719][988492] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-10 13:24:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 86462464. Throughput: 0: 9933.7. Samples: 86460404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:29,804][988181] Avg episode reward: [(0, '9.934')] [2023-03-10 13:24:30,023][988492] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-10 13:24:34,278][988492] Updated weights for policy 0, policy_version 168960 (0.0004) [2023-03-10 13:24:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 86511616. Throughput: 0: 9883.7. Samples: 86489356. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:34,804][988181] Avg episode reward: [(0, '9.960')] [2023-03-10 13:24:38,555][988492] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-10 13:24:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9969.3). Total num frames: 86560768. Throughput: 0: 9898.7. Samples: 86547520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:39,804][988181] Avg episode reward: [(0, '9.941')] [2023-03-10 13:24:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169064_86560768.pth... [2023-03-10 13:24:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168496_86269952.pth [2023-03-10 13:24:42,873][988492] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-10 13:24:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 86605824. Throughput: 0: 9802.3. Samples: 86604344. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:44,804][988181] Avg episode reward: [(0, '9.948')] [2023-03-10 13:24:47,166][988492] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-10 13:24:49,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 86654976. Throughput: 0: 9747.4. Samples: 86632024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:49,804][988181] Avg episode reward: [(0, '9.922')] [2023-03-10 13:24:51,138][988492] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-10 13:24:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 86708224. Throughput: 0: 9731.4. Samples: 86693536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:54,804][988181] Avg episode reward: [(0, '9.924')] [2023-03-10 13:24:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169352_86708224.pth... [2023-03-10 13:24:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000168776_86413312.pth [2023-03-10 13:24:55,231][988492] Updated weights for policy 0, policy_version 169360 (0.0006) [2023-03-10 13:24:59,358][988492] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-10 13:24:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 9941.5). Total num frames: 86757376. Throughput: 0: 9797.3. Samples: 86753292. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:24:59,804][988181] Avg episode reward: [(0, '9.869')] [2023-03-10 13:25:03,560][988492] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-10 13:25:04,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9927.6). Total num frames: 86802432. Throughput: 0: 9737.1. Samples: 86781952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:04,804][988181] Avg episode reward: [(0, '9.927')] [2023-03-10 13:25:07,710][988492] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-10 13:25:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9941.5). Total num frames: 86855680. Throughput: 0: 9773.0. Samples: 86842096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:09,804][988181] Avg episode reward: [(0, '9.934')] [2023-03-10 13:25:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169640_86855680.pth... [2023-03-10 13:25:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169064_86560768.pth [2023-03-10 13:25:11,899][988492] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-10 13:25:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9927.6). Total num frames: 86900736. Throughput: 0: 9766.4. Samples: 86899892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:14,804][988181] Avg episode reward: [(0, '9.896')] [2023-03-10 13:25:15,942][988492] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-10 13:25:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 86953984. Throughput: 0: 9806.7. Samples: 86930656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:19,804][988181] Avg episode reward: [(0, '9.971')] [2023-03-10 13:25:20,090][988492] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-10 13:25:24,255][988492] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-10 13:25:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9941.5). Total num frames: 87003136. Throughput: 0: 9848.0. Samples: 86990680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:24,804][988181] Avg episode reward: [(0, '9.956')] [2023-03-10 13:25:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169928_87003136.pth... [2023-03-10 13:25:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169352_86708224.pth [2023-03-10 13:25:27,953][988492] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-10 13:25:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 87056384. Throughput: 0: 10014.0. Samples: 87054972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:29,804][988181] Avg episode reward: [(0, '9.935')] [2023-03-10 13:25:32,210][988492] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-10 13:25:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 87105536. Throughput: 0: 10002.6. Samples: 87082144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:34,804][988181] Avg episode reward: [(0, '9.909')] [2023-03-10 13:25:36,393][988492] Updated weights for policy 0, policy_version 170160 (0.0004) [2023-03-10 13:25:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 87154688. Throughput: 0: 9936.7. Samples: 87140688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:39,804][988181] Avg episode reward: [(0, '9.896')] [2023-03-10 13:25:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170224_87154688.pth... [2023-03-10 13:25:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169640_86855680.pth [2023-03-10 13:25:40,544][988492] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-10 13:25:44,647][988492] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-10 13:25:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 87203840. Throughput: 0: 9928.0. Samples: 87200052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:44,804][988181] Avg episode reward: [(0, '9.873')] [2023-03-10 13:25:48,663][988492] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-10 13:25:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 87252992. Throughput: 0: 10012.6. Samples: 87232520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:49,804][988181] Avg episode reward: [(0, '9.675')] [2023-03-10 13:25:52,601][988492] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-10 13:25:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 87306240. Throughput: 0: 10040.5. Samples: 87293916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:54,804][988181] Avg episode reward: [(0, '9.614')] [2023-03-10 13:25:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170520_87306240.pth... [2023-03-10 13:25:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000169928_87003136.pth [2023-03-10 13:25:56,780][988492] Updated weights for policy 0, policy_version 170560 (0.0006) [2023-03-10 13:25:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 87355392. Throughput: 0: 10071.0. Samples: 87353088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:25:59,805][988181] Avg episode reward: [(0, '9.517')] [2023-03-10 13:26:00,626][988492] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-10 13:26:04,667][988492] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-10 13:26:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9983.1). Total num frames: 87408640. Throughput: 0: 10156.3. Samples: 87387688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:26:04,804][988181] Avg episode reward: [(0, '9.488')] [2023-03-10 13:26:08,679][988492] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-10 13:26:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 87457792. Throughput: 0: 10113.8. Samples: 87445800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:09,804][988181] Avg episode reward: [(0, '9.581')] [2023-03-10 13:26:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170816_87457792.pth... [2023-03-10 13:26:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170224_87154688.pth [2023-03-10 13:26:12,571][988492] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-10 13:26:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 87511040. Throughput: 0: 10065.9. Samples: 87507936. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:14,804][988181] Avg episode reward: [(0, '9.798')] [2023-03-10 13:26:16,785][988492] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-10 13:26:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 87560192. Throughput: 0: 10102.7. Samples: 87536764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:19,804][988181] Avg episode reward: [(0, '9.624')] [2023-03-10 13:26:20,920][988492] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-10 13:26:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 87609344. Throughput: 0: 10153.7. Samples: 87597604. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:24,804][988181] Avg episode reward: [(0, '9.709')] [2023-03-10 13:26:24,862][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171120_87613440.pth... [2023-03-10 13:26:24,863][988492] Updated weights for policy 0, policy_version 171120 (0.0005) [2023-03-10 13:26:24,864][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170520_87306240.pth [2023-03-10 13:26:29,228][988492] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-10 13:26:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 87658496. Throughput: 0: 10115.7. Samples: 87655256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:29,804][988181] Avg episode reward: [(0, '9.944')] [2023-03-10 13:26:33,316][988492] Updated weights for policy 0, policy_version 171280 (0.0005) [2023-03-10 13:26:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 87707648. Throughput: 0: 10100.0. Samples: 87687020. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:34,804][988181] Avg episode reward: [(0, '9.867')] [2023-03-10 13:26:37,264][988492] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-10 13:26:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 87756800. Throughput: 0: 10066.0. Samples: 87746888. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:39,804][988181] Avg episode reward: [(0, '9.746')] [2023-03-10 13:26:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171400_87756800.pth... [2023-03-10 13:26:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000170816_87457792.pth [2023-03-10 13:26:41,697][988492] Updated weights for policy 0, policy_version 171440 (0.0006) [2023-03-10 13:26:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 87805952. Throughput: 0: 9987.4. Samples: 87802520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:44,804][988181] Avg episode reward: [(0, '9.949')] [2023-03-10 13:26:45,792][988492] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-10 13:26:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 87855104. Throughput: 0: 9930.7. Samples: 87834572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:49,805][988181] Avg episode reward: [(0, '9.829')] [2023-03-10 13:26:49,964][988492] Updated weights for policy 0, policy_version 171600 (0.0004) [2023-03-10 13:26:54,028][988492] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-10 13:26:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 87904256. Throughput: 0: 9932.0. Samples: 87892740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:54,804][988181] Avg episode reward: [(0, '9.845')] [2023-03-10 13:26:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171688_87904256.pth... [2023-03-10 13:26:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171120_87613440.pth [2023-03-10 13:26:58,254][988492] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-10 13:26:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 87953408. Throughput: 0: 9843.9. Samples: 87950912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:26:59,804][988181] Avg episode reward: [(0, '9.904')] [2023-03-10 13:27:02,550][988492] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-10 13:27:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 88002560. Throughput: 0: 9847.8. Samples: 87979916. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:27:04,804][988181] Avg episode reward: [(0, '9.948')] [2023-03-10 13:27:06,643][988492] Updated weights for policy 0, policy_version 171920 (0.0004) [2023-03-10 13:27:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 88051712. Throughput: 0: 9819.7. Samples: 88039488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-10 13:27:09,804][988181] Avg episode reward: [(0, '9.959')] [2023-03-10 13:27:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171976_88051712.pth... [2023-03-10 13:27:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171400_87756800.pth [2023-03-10 13:27:10,678][988492] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-10 13:27:14,722][988492] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-10 13:27:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 88104960. Throughput: 0: 9902.6. Samples: 88100876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:14,804][988181] Avg episode reward: [(0, '9.934')] [2023-03-10 13:27:19,074][988492] Updated weights for policy 0, policy_version 172160 (0.0005) [2023-03-10 13:27:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 88150016. Throughput: 0: 9839.4. Samples: 88129796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:19,804][988181] Avg episode reward: [(0, '9.928')] [2023-03-10 13:27:23,181][988492] Updated weights for policy 0, policy_version 172240 (0.0004) [2023-03-10 13:27:24,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 88199168. Throughput: 0: 9811.5. Samples: 88188408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:24,804][988181] Avg episode reward: [(0, '9.934')] [2023-03-10 13:27:24,836][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172272_88203264.pth... [2023-03-10 13:27:24,838][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171688_87904256.pth [2023-03-10 13:27:27,167][988492] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-10 13:27:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 88252416. Throughput: 0: 9936.8. Samples: 88249676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:29,804][988181] Avg episode reward: [(0, '9.923')] [2023-03-10 13:27:31,249][988492] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-10 13:27:34,804][988181] Fps is (10 sec: 10649.7, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 88305664. Throughput: 0: 9902.7. Samples: 88280192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:34,804][988181] Avg episode reward: [(0, '9.945')] [2023-03-10 13:27:34,995][988492] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-10 13:27:38,887][988492] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-10 13:27:39,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 88358912. Throughput: 0: 10067.6. Samples: 88345780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:39,804][988181] Avg episode reward: [(0, '9.941')] [2023-03-10 13:27:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172576_88358912.pth... [2023-03-10 13:27:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000171976_88051712.pth [2023-03-10 13:27:42,962][988492] Updated weights for policy 0, policy_version 172640 (0.0005) [2023-03-10 13:27:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 88408064. Throughput: 0: 10080.3. Samples: 88404524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:44,804][988181] Avg episode reward: [(0, '9.918')] [2023-03-10 13:27:47,030][988492] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-10 13:27:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 88457216. Throughput: 0: 10143.7. Samples: 88436384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:49,804][988181] Avg episode reward: [(0, '9.874')] [2023-03-10 13:27:51,368][988492] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-10 13:27:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 88506368. Throughput: 0: 10102.0. Samples: 88494076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:54,804][988181] Avg episode reward: [(0, '9.884')] [2023-03-10 13:27:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172864_88506368.pth... [2023-03-10 13:27:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172272_88203264.pth [2023-03-10 13:27:55,450][988492] Updated weights for policy 0, policy_version 172880 (0.0005) [2023-03-10 13:27:59,387][988492] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-10 13:27:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 88555520. Throughput: 0: 10103.2. Samples: 88555520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:27:59,804][988181] Avg episode reward: [(0, '9.879')] [2023-03-10 13:28:03,135][988492] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-10 13:28:04,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 88612864. Throughput: 0: 10168.0. Samples: 88587356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:04,804][988181] Avg episode reward: [(0, '9.883')] [2023-03-10 13:28:07,002][988492] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-10 13:28:09,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 88662016. Throughput: 0: 10274.4. Samples: 88650756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:09,804][988181] Avg episode reward: [(0, '9.891')] [2023-03-10 13:28:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173168_88662016.pth... [2023-03-10 13:28:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172576_88358912.pth [2023-03-10 13:28:10,876][988492] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-10 13:28:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 88715264. Throughput: 0: 10281.9. Samples: 88712360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:14,804][988181] Avg episode reward: [(0, '9.901')] [2023-03-10 13:28:15,145][988492] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-10 13:28:19,306][988492] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-10 13:28:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9997.0). Total num frames: 88764416. Throughput: 0: 10249.7. Samples: 88741428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:19,804][988181] Avg episode reward: [(0, '9.884')] [2023-03-10 13:28:23,174][988492] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-10 13:28:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 10010.9). Total num frames: 88817664. Throughput: 0: 10163.7. Samples: 88803148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:24,804][988181] Avg episode reward: [(0, '9.893')] [2023-03-10 13:28:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173472_88817664.pth... [2023-03-10 13:28:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000172864_88506368.pth [2023-03-10 13:28:27,084][988492] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-10 13:28:29,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 9997.0). Total num frames: 88866816. Throughput: 0: 10212.9. Samples: 88864104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:29,804][988181] Avg episode reward: [(0, '9.908')] [2023-03-10 13:28:31,237][988492] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-10 13:28:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10010.9). Total num frames: 88920064. Throughput: 0: 10200.3. Samples: 88895396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:34,804][988181] Avg episode reward: [(0, '9.915')] [2023-03-10 13:28:35,099][988492] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-10 13:28:38,951][988492] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-10 13:28:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 88969216. Throughput: 0: 10295.0. Samples: 88957352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:39,804][988181] Avg episode reward: [(0, '9.904')] [2023-03-10 13:28:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173776_88973312.pth... [2023-03-10 13:28:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173168_88662016.pth [2023-03-10 13:28:43,020][988492] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-10 13:28:44,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10024.8). Total num frames: 89022464. Throughput: 0: 10303.6. Samples: 89019180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:44,804][988181] Avg episode reward: [(0, '9.907')] [2023-03-10 13:28:47,190][988492] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-10 13:28:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10024.8). Total num frames: 89071616. Throughput: 0: 10238.9. Samples: 89048108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:49,804][988181] Avg episode reward: [(0, '9.902')] [2023-03-10 13:28:51,263][988492] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-10 13:28:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 10024.8). Total num frames: 89120768. Throughput: 0: 10171.8. Samples: 89108488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:54,804][988181] Avg episode reward: [(0, '9.901')] [2023-03-10 13:28:54,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174064_89120768.pth... [2023-03-10 13:28:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173472_88817664.pth [2023-03-10 13:28:55,429][988492] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-10 13:28:59,522][988492] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-10 13:28:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10010.9). Total num frames: 89169920. Throughput: 0: 10120.4. Samples: 89167780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:28:59,804][988181] Avg episode reward: [(0, '9.894')] [2023-03-10 13:29:03,549][988492] Updated weights for policy 0, policy_version 174240 (0.0005) [2023-03-10 13:29:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 89223168. Throughput: 0: 10162.3. Samples: 89198732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:04,804][988181] Avg episode reward: [(0, '9.920')] [2023-03-10 13:29:07,571][988492] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-10 13:29:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 89272320. Throughput: 0: 10147.2. Samples: 89259772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:09,804][988181] Avg episode reward: [(0, '9.924')] [2023-03-10 13:29:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174360_89272320.pth... [2023-03-10 13:29:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000173776_88973312.pth [2023-03-10 13:29:11,569][988492] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-10 13:29:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 89321472. Throughput: 0: 10138.8. Samples: 89320348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:14,804][988181] Avg episode reward: [(0, '9.900')] [2023-03-10 13:29:15,861][988492] Updated weights for policy 0, policy_version 174480 (0.0004) [2023-03-10 13:29:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 89370624. Throughput: 0: 10097.1. Samples: 89349764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:19,804][988181] Avg episode reward: [(0, '9.905')] [2023-03-10 13:29:20,040][988492] Updated weights for policy 0, policy_version 174560 (0.0004) [2023-03-10 13:29:24,267][988492] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-10 13:29:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 89419776. Throughput: 0: 10001.5. Samples: 89407420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:24,804][988181] Avg episode reward: [(0, '9.910')] [2023-03-10 13:29:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174648_89419776.pth... [2023-03-10 13:29:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174064_89120768.pth [2023-03-10 13:29:28,319][988492] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-10 13:29:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 89468928. Throughput: 0: 9964.7. Samples: 89467592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:29,804][988181] Avg episode reward: [(0, '9.899')] [2023-03-10 13:29:32,323][988492] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-10 13:29:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 89522176. Throughput: 0: 9990.2. Samples: 89497664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:34,804][988181] Avg episode reward: [(0, '9.905')] [2023-03-10 13:29:36,441][988492] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-10 13:29:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 89571328. Throughput: 0: 9998.1. Samples: 89558404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:39,804][988181] Avg episode reward: [(0, '9.891')] [2023-03-10 13:29:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174944_89571328.pth... [2023-03-10 13:29:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174360_89272320.pth [2023-03-10 13:29:40,600][988492] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-10 13:29:44,789][988492] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-10 13:29:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 89620480. Throughput: 0: 9955.2. Samples: 89615764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:44,804][988181] Avg episode reward: [(0, '9.920')] [2023-03-10 13:29:48,806][988492] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-10 13:29:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 89669632. Throughput: 0: 9958.7. Samples: 89646872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:49,804][988181] Avg episode reward: [(0, '9.917')] [2023-03-10 13:29:53,201][988492] Updated weights for policy 0, policy_version 175200 (0.0004) [2023-03-10 13:29:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 89718784. Throughput: 0: 9864.7. Samples: 89703684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:54,804][988181] Avg episode reward: [(0, '9.941')] [2023-03-10 13:29:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175232_89718784.pth... [2023-03-10 13:29:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174648_89419776.pth [2023-03-10 13:29:57,126][988492] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-10 13:29:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 89763840. Throughput: 0: 9852.8. Samples: 89763724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:29:59,804][988181] Avg episode reward: [(0, '9.939')] [2023-03-10 13:30:01,584][988492] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-10 13:30:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 89812992. Throughput: 0: 9833.4. Samples: 89792264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:04,804][988181] Avg episode reward: [(0, '9.924')] [2023-03-10 13:30:05,687][988492] Updated weights for policy 0, policy_version 175440 (0.0004) [2023-03-10 13:30:09,717][988492] Updated weights for policy 0, policy_version 175520 (0.0006) [2023-03-10 13:30:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 89866240. Throughput: 0: 9885.4. Samples: 89852264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:09,804][988181] Avg episode reward: [(0, '9.933')] [2023-03-10 13:30:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175520_89866240.pth... [2023-03-10 13:30:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000174944_89571328.pth [2023-03-10 13:30:13,878][988492] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-10 13:30:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.6, 300 sec: 10038.7). Total num frames: 89915392. Throughput: 0: 9865.8. Samples: 89911552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:14,804][988181] Avg episode reward: [(0, '9.912')] [2023-03-10 13:30:17,890][988492] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-10 13:30:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 89968640. Throughput: 0: 9882.4. Samples: 89942372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:19,804][988181] Avg episode reward: [(0, '9.933')] [2023-03-10 13:30:21,885][988492] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-10 13:30:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90017792. Throughput: 0: 9914.0. Samples: 90004532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:24,804][988181] Avg episode reward: [(0, '9.959')] [2023-03-10 13:30:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175816_90017792.pth... [2023-03-10 13:30:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175232_89718784.pth [2023-03-10 13:30:25,921][988492] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-10 13:30:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90066944. Throughput: 0: 9937.0. Samples: 90062928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:29,804][988181] Avg episode reward: [(0, '9.956')] [2023-03-10 13:30:30,175][988492] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-10 13:30:34,239][988492] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-10 13:30:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 90116096. Throughput: 0: 9895.8. Samples: 90092184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:34,804][988181] Avg episode reward: [(0, '9.954')] [2023-03-10 13:30:38,252][988492] Updated weights for policy 0, policy_version 176080 (0.0006) [2023-03-10 13:30:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 90169344. Throughput: 0: 9994.7. Samples: 90153448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:39,805][988181] Avg episode reward: [(0, '9.972')] [2023-03-10 13:30:39,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176112_90169344.pth... [2023-03-10 13:30:39,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175520_89866240.pth [2023-03-10 13:30:42,191][988492] Updated weights for policy 0, policy_version 176160 (0.0005) [2023-03-10 13:30:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 10052.6). Total num frames: 90218496. Throughput: 0: 10024.5. Samples: 90214828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:44,804][988181] Avg episode reward: [(0, '9.959')] [2023-03-10 13:30:46,400][988492] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-10 13:30:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90267648. Throughput: 0: 10037.1. Samples: 90243936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:49,804][988181] Avg episode reward: [(0, '9.962')] [2023-03-10 13:30:50,394][988492] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-10 13:30:54,454][988492] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-10 13:30:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90316800. Throughput: 0: 10057.7. Samples: 90304860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:54,804][988181] Avg episode reward: [(0, '9.951')] [2023-03-10 13:30:54,840][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176408_90320896.pth... [2023-03-10 13:30:54,842][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000175816_90017792.pth [2023-03-10 13:30:58,410][988492] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-10 13:30:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 90370048. Throughput: 0: 10099.4. Samples: 90366024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:30:59,804][988181] Avg episode reward: [(0, '9.986')] [2023-03-10 13:31:02,627][988492] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-10 13:31:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 90415104. Throughput: 0: 10065.8. Samples: 90395332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:04,804][988181] Avg episode reward: [(0, '9.988')] [2023-03-10 13:31:07,149][988492] Updated weights for policy 0, policy_version 176640 (0.0004) [2023-03-10 13:31:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 90464256. Throughput: 0: 9944.5. Samples: 90452032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:09,804][988181] Avg episode reward: [(0, '9.992')] [2023-03-10 13:31:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176688_90464256.pth... [2023-03-10 13:31:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176112_90169344.pth [2023-03-10 13:31:11,235][988492] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-10 13:31:14,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 90513408. Throughput: 0: 9978.3. Samples: 90511952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:14,804][988181] Avg episode reward: [(0, '10.001')] [2023-03-10 13:31:15,262][988492] Updated weights for policy 0, policy_version 176800 (0.0004) [2023-03-10 13:31:19,406][988492] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-10 13:31:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 90562560. Throughput: 0: 9997.9. Samples: 90542088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:19,804][988181] Avg episode reward: [(0, '10.015')] [2023-03-10 13:31:23,344][988492] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-10 13:31:24,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 90619904. Throughput: 0: 10001.9. Samples: 90603536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:24,805][988181] Avg episode reward: [(0, '9.998')] [2023-03-10 13:31:24,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176992_90619904.pth... [2023-03-10 13:31:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176408_90320896.pth [2023-03-10 13:31:27,263][988492] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-10 13:31:29,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 90669056. Throughput: 0: 10003.1. Samples: 90664968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:29,804][988181] Avg episode reward: [(0, '9.985')] [2023-03-10 13:31:31,367][988492] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-10 13:31:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 90718208. Throughput: 0: 10020.7. Samples: 90694868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:34,804][988181] Avg episode reward: [(0, '9.994')] [2023-03-10 13:31:35,414][988492] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-10 13:31:39,515][988492] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-10 13:31:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9967.0, 300 sec: 10038.7). Total num frames: 90767360. Throughput: 0: 10006.3. Samples: 90755144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:39,804][988181] Avg episode reward: [(0, '10.009')] [2023-03-10 13:31:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177280_90767360.pth... [2023-03-10 13:31:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176688_90464256.pth [2023-03-10 13:31:43,779][988492] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-10 13:31:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90816512. Throughput: 0: 9959.6. Samples: 90814208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:44,804][988181] Avg episode reward: [(0, '10.019')] [2023-03-10 13:31:47,748][988492] Updated weights for policy 0, policy_version 177440 (0.0004) [2023-03-10 13:31:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 90865664. Throughput: 0: 9996.7. Samples: 90845184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:49,804][988181] Avg episode reward: [(0, '10.008')] [2023-03-10 13:31:52,002][988492] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-10 13:31:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 90918912. Throughput: 0: 10018.3. Samples: 90902856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:54,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 13:31:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177576_90918912.pth... [2023-03-10 13:31:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000176992_90619904.pth [2023-03-10 13:31:56,069][988492] Updated weights for policy 0, policy_version 177600 (0.0004) [2023-03-10 13:31:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 90968064. Throughput: 0: 10060.3. Samples: 90964664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:31:59,804][988181] Avg episode reward: [(0, '10.020')] [2023-03-10 13:32:00,055][988492] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-10 13:32:04,257][988492] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-10 13:32:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 91017216. Throughput: 0: 10067.2. Samples: 90995112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:04,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:32:08,363][988492] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-10 13:32:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 91066368. Throughput: 0: 10007.7. Samples: 91053880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:09,804][988181] Avg episode reward: [(0, '10.014')] [2023-03-10 13:32:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177864_91066368.pth... [2023-03-10 13:32:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177280_90767360.pth [2023-03-10 13:32:12,596][988492] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-10 13:32:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 91115520. Throughput: 0: 9926.5. Samples: 91111660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:14,804][988181] Avg episode reward: [(0, '10.011')] [2023-03-10 13:32:16,710][988492] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-10 13:32:19,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 91164672. Throughput: 0: 9951.0. Samples: 91142664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:19,804][988181] Avg episode reward: [(0, '10.031')] [2023-03-10 13:32:20,771][988492] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-10 13:32:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 91213824. Throughput: 0: 9973.4. Samples: 91203948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:24,804][988181] Avg episode reward: [(0, '10.013')] [2023-03-10 13:32:24,805][988492] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-10 13:32:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178160_91217920.pth... [2023-03-10 13:32:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177576_90918912.pth [2023-03-10 13:32:29,099][988492] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-10 13:32:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 91262976. Throughput: 0: 9938.2. Samples: 91261428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:29,804][988181] Avg episode reward: [(0, '10.001')] [2023-03-10 13:32:33,280][988492] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-10 13:32:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 91312128. Throughput: 0: 9915.1. Samples: 91291364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:34,804][988181] Avg episode reward: [(0, '10.019')] [2023-03-10 13:32:37,368][988492] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-10 13:32:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 91365376. Throughput: 0: 9988.9. Samples: 91352356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:39,804][988181] Avg episode reward: [(0, '10.022')] [2023-03-10 13:32:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178448_91365376.pth... [2023-03-10 13:32:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000177864_91066368.pth [2023-03-10 13:32:41,477][988492] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-10 13:32:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 91410432. Throughput: 0: 9894.7. Samples: 91409924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:44,804][988181] Avg episode reward: [(0, '10.040')] [2023-03-10 13:32:45,539][988492] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-10 13:32:49,747][988492] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-10 13:32:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 91463680. Throughput: 0: 9891.0. Samples: 91440208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:49,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:32:53,932][988492] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-10 13:32:54,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 91512832. Throughput: 0: 9868.4. Samples: 91497960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:54,805][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:32:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178736_91512832.pth... [2023-03-10 13:32:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178160_91217920.pth [2023-03-10 13:32:57,809][988492] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-10 13:32:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 91561984. Throughput: 0: 10006.7. Samples: 91561960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:32:59,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 13:33:01,883][988492] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-10 13:33:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 91615232. Throughput: 0: 9957.0. Samples: 91590728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:04,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 13:33:06,061][988492] Updated weights for policy 0, policy_version 178960 (0.0004) [2023-03-10 13:33:09,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 91664384. Throughput: 0: 9957.7. Samples: 91652044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:09,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 13:33:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179032_91664384.pth... [2023-03-10 13:33:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178448_91365376.pth [2023-03-10 13:33:10,129][988492] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-10 13:33:14,077][988492] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-10 13:33:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 91713536. Throughput: 0: 10021.2. Samples: 91712380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:14,804][988181] Avg episode reward: [(0, '10.032')] [2023-03-10 13:33:18,234][988492] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-10 13:33:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 91766784. Throughput: 0: 10017.8. Samples: 91742164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:19,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 13:33:22,236][988492] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-10 13:33:24,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 91815936. Throughput: 0: 10008.9. Samples: 91802756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:24,805][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:33:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179328_91815936.pth... [2023-03-10 13:33:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000178736_91512832.pth [2023-03-10 13:33:26,523][988492] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-10 13:33:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 91865088. Throughput: 0: 10023.9. Samples: 91861000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:29,804][988181] Avg episode reward: [(0, '10.012')] [2023-03-10 13:33:30,581][988492] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-10 13:33:34,500][988492] Updated weights for policy 0, policy_version 179520 (0.0005) [2023-03-10 13:33:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 91914240. Throughput: 0: 10049.2. Samples: 91892420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:34,804][988181] Avg episode reward: [(0, '10.010')] [2023-03-10 13:33:38,643][988492] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-10 13:33:39,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 91963392. Throughput: 0: 10071.5. Samples: 91951176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:39,804][988181] Avg episode reward: [(0, '10.016')] [2023-03-10 13:33:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179616_91963392.pth... [2023-03-10 13:33:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179032_91664384.pth [2023-03-10 13:33:42,828][988492] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-10 13:33:44,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.4, 300 sec: 9983.1). Total num frames: 92016640. Throughput: 0: 10018.7. Samples: 92012804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:44,804][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 13:33:46,648][988492] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-10 13:33:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 92065792. Throughput: 0: 10081.4. Samples: 92044392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:49,804][988181] Avg episode reward: [(0, '10.033')] [2023-03-10 13:33:50,701][988492] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-10 13:33:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 92114944. Throughput: 0: 10033.6. Samples: 92103556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:54,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:33:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179912_92114944.pth... [2023-03-10 13:33:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179328_91815936.pth [2023-03-10 13:33:54,924][988492] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-10 13:33:59,108][988492] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-10 13:33:59,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9969.3). Total num frames: 92164096. Throughput: 0: 10003.9. Samples: 92162556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:33:59,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:34:03,287][988492] Updated weights for policy 0, policy_version 180080 (0.0004) [2023-03-10 13:34:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 92213248. Throughput: 0: 10005.4. Samples: 92192408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:04,804][988181] Avg episode reward: [(0, '10.014')] [2023-03-10 13:34:07,227][988492] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-10 13:34:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 92266496. Throughput: 0: 10004.4. Samples: 92252952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:09,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 13:34:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180208_92266496.pth... [2023-03-10 13:34:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179616_91963392.pth [2023-03-10 13:34:11,384][988492] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-10 13:34:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 92315648. Throughput: 0: 10016.2. Samples: 92311728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:14,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:34:15,480][988492] Updated weights for policy 0, policy_version 180320 (0.0004) [2023-03-10 13:34:19,619][988492] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-10 13:34:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 92364800. Throughput: 0: 10009.7. Samples: 92342856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:19,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:34:23,945][988492] Updated weights for policy 0, policy_version 180480 (0.0005) [2023-03-10 13:34:24,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9969.2). Total num frames: 92409856. Throughput: 0: 9996.1. Samples: 92401000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:24,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:34:24,853][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180496_92413952.pth... [2023-03-10 13:34:24,854][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000179912_92114944.pth [2023-03-10 13:34:27,953][988492] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-10 13:34:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 92463104. Throughput: 0: 9967.5. Samples: 92461340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:29,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 13:34:31,959][988492] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-10 13:34:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 92512256. Throughput: 0: 9939.6. Samples: 92491672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:34,804][988181] Avg episode reward: [(0, '10.018')] [2023-03-10 13:34:36,232][988492] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-10 13:34:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 92561408. Throughput: 0: 9903.4. Samples: 92549208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:39,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:34:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180784_92561408.pth... [2023-03-10 13:34:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180208_92266496.pth [2023-03-10 13:34:40,359][988492] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-10 13:34:44,024][988492] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-10 13:34:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 92614656. Throughput: 0: 10034.6. Samples: 92614112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:34:44,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:34:48,241][988492] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-10 13:34:49,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9967.0, 300 sec: 9983.1). Total num frames: 92663808. Throughput: 0: 10020.1. Samples: 92643312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:34:49,804][988181] Avg episode reward: [(0, '10.048')] [2023-03-10 13:34:52,511][988492] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-10 13:34:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 92712960. Throughput: 0: 9949.7. Samples: 92700688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:34:54,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:34:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181080_92712960.pth... [2023-03-10 13:34:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180496_92413952.pth [2023-03-10 13:34:56,749][988492] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-10 13:34:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 92762112. Throughput: 0: 9967.2. Samples: 92760252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:34:59,804][988181] Avg episode reward: [(0, '10.044')] [2023-03-10 13:35:00,699][988492] Updated weights for policy 0, policy_version 181200 (0.0006) [2023-03-10 13:35:04,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 92811264. Throughput: 0: 9936.2. Samples: 92789984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:04,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:35:05,090][988492] Updated weights for policy 0, policy_version 181280 (0.0004) [2023-03-10 13:35:09,048][988492] Updated weights for policy 0, policy_version 181360 (0.0004) [2023-03-10 13:35:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 92860416. Throughput: 0: 9961.9. Samples: 92849288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:09,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 13:35:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181368_92860416.pth... [2023-03-10 13:35:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000180784_92561408.pth [2023-03-10 13:35:12,995][988492] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-10 13:35:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 92913664. Throughput: 0: 9978.7. Samples: 92910380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:14,804][988181] Avg episode reward: [(0, '10.035')] [2023-03-10 13:35:17,209][988492] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-10 13:35:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 92962816. Throughput: 0: 9947.4. Samples: 92939304. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:19,804][988181] Avg episode reward: [(0, '10.026')] [2023-03-10 13:35:21,373][988492] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-10 13:35:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 93011968. Throughput: 0: 9969.9. Samples: 92997852. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:24,804][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:35:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181664_93011968.pth... [2023-03-10 13:35:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181080_92712960.pth [2023-03-10 13:35:25,444][988492] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-10 13:35:29,539][988492] Updated weights for policy 0, policy_version 181760 (0.0004) [2023-03-10 13:35:29,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 93061120. Throughput: 0: 9896.0. Samples: 93059432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:29,804][988181] Avg episode reward: [(0, '10.039')] [2023-03-10 13:35:33,708][988492] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-10 13:35:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9967.0, 300 sec: 9969.3). Total num frames: 93110272. Throughput: 0: 9919.7. Samples: 93089700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:34,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 13:35:37,874][988492] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-10 13:35:39,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 93163520. Throughput: 0: 9943.8. Samples: 93148160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:39,804][988181] Avg episode reward: [(0, '10.030')] [2023-03-10 13:35:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181960_93163520.pth... [2023-03-10 13:35:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181368_92860416.pth [2023-03-10 13:35:41,659][988492] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-10 13:35:44,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 93216768. Throughput: 0: 10134.6. Samples: 93216308. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:44,804][988181] Avg episode reward: [(0, '10.041')] [2023-03-10 13:35:45,316][988492] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-10 13:35:49,595][988492] Updated weights for policy 0, policy_version 182160 (0.0006) [2023-03-10 13:35:49,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 93265920. Throughput: 0: 10117.1. Samples: 93245256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-10 13:35:49,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 13:35:53,787][988492] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-10 13:35:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 93315072. Throughput: 0: 10073.9. Samples: 93302616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:35:54,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:35:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182256_93315072.pth... [2023-03-10 13:35:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181664_93011968.pth [2023-03-10 13:35:57,878][988492] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-10 13:35:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 93364224. Throughput: 0: 10072.1. Samples: 93363624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:35:59,804][988181] Avg episode reward: [(0, '10.041')] [2023-03-10 13:36:01,909][988492] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-10 13:36:04,804][988181] Fps is (10 sec: 10239.4, 60 sec: 10103.3, 300 sec: 10010.9). Total num frames: 93417472. Throughput: 0: 10079.9. Samples: 93392908. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:04,805][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:36:05,814][988492] Updated weights for policy 0, policy_version 182480 (0.0006) [2023-03-10 13:36:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10010.9). Total num frames: 93466624. Throughput: 0: 10145.7. Samples: 93454408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:09,804][988181] Avg episode reward: [(0, '10.023')] [2023-03-10 13:36:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182552_93466624.pth... [2023-03-10 13:36:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000181960_93163520.pth [2023-03-10 13:36:09,938][988492] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-10 13:36:13,845][988492] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-10 13:36:14,804][988181] Fps is (10 sec: 10240.7, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 93519872. Throughput: 0: 10145.4. Samples: 93515976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:14,804][988181] Avg episode reward: [(0, '10.024')] [2023-03-10 13:36:17,858][988492] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-10 13:36:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 93569024. Throughput: 0: 10191.5. Samples: 93548320. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:19,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 13:36:22,102][988492] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-10 13:36:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9997.0). Total num frames: 93618176. Throughput: 0: 10171.7. Samples: 93605888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:24,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 13:36:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182848_93618176.pth... [2023-03-10 13:36:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182256_93315072.pth [2023-03-10 13:36:26,481][988492] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-10 13:36:29,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 93663232. Throughput: 0: 9922.1. Samples: 93662800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:29,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 13:36:30,790][988492] Updated weights for policy 0, policy_version 182960 (0.0004) [2023-03-10 13:36:34,804][988181] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 93712384. Throughput: 0: 9911.8. Samples: 93691288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:34,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 13:36:34,880][988492] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-10 13:36:39,128][988492] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-10 13:36:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 93761536. Throughput: 0: 9941.7. Samples: 93749992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:39,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:36:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183128_93761536.pth... [2023-03-10 13:36:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182552_93466624.pth [2023-03-10 13:36:43,058][988492] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-10 13:36:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 93814784. Throughput: 0: 9948.5. Samples: 93811308. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:44,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:36:47,173][988492] Updated weights for policy 0, policy_version 183280 (0.0004) [2023-03-10 13:36:49,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 93863936. Throughput: 0: 9954.5. Samples: 93840852. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:49,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:36:51,271][988492] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-10 13:36:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 93913088. Throughput: 0: 9915.7. Samples: 93900616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:36:54,804][988181] Avg episode reward: [(0, '10.029')] [2023-03-10 13:36:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183424_93913088.pth... [2023-03-10 13:36:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000182848_93618176.pth [2023-03-10 13:36:55,463][988492] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-10 13:36:59,798][988492] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-10 13:36:59,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9983.1). Total num frames: 93962240. Throughput: 0: 9825.9. Samples: 93958144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:36:59,805][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 13:37:03,689][988492] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-10 13:37:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.8, 300 sec: 9983.1). Total num frames: 94011392. Throughput: 0: 9745.8. Samples: 93986880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:04,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 13:37:07,594][988492] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-10 13:37:09,804][988181] Fps is (10 sec: 10240.2, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 94064640. Throughput: 0: 9917.4. Samples: 94052168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:09,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:37:09,813][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183728_94068736.pth... [2023-03-10 13:37:09,815][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183128_93761536.pth [2023-03-10 13:37:11,601][988492] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-10 13:37:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 94113792. Throughput: 0: 9977.0. Samples: 94111764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:14,804][988181] Avg episode reward: [(0, '10.036')] [2023-03-10 13:37:15,741][988492] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-10 13:37:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 94162944. Throughput: 0: 10023.2. Samples: 94142332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:19,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:37:19,813][988492] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-10 13:37:23,975][988492] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-10 13:37:24,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 94216192. Throughput: 0: 10052.3. Samples: 94202348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:24,805][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 13:37:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184016_94216192.pth... [2023-03-10 13:37:24,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183424_93913088.pth [2023-03-10 13:37:27,998][988492] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-10 13:37:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 94265344. Throughput: 0: 10052.7. Samples: 94263680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:29,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:37:31,869][988492] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-10 13:37:34,804][988181] Fps is (10 sec: 9830.6, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 94314496. Throughput: 0: 10071.9. Samples: 94294088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:34,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 13:37:36,060][988492] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-10 13:37:39,770][988492] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-10 13:37:39,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 94371840. Throughput: 0: 10107.6. Samples: 94355456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:39,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:37:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184320_94371840.pth... [2023-03-10 13:37:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000183728_94068736.pth [2023-03-10 13:37:43,943][988492] Updated weights for policy 0, policy_version 184400 (0.0006) [2023-03-10 13:37:44,804][988181] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 94420992. Throughput: 0: 10194.8. Samples: 94416908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:44,804][988181] Avg episode reward: [(0, '10.072')] [2023-03-10 13:37:48,056][988492] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-10 13:37:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 94470144. Throughput: 0: 10208.4. Samples: 94446260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:49,804][988181] Avg episode reward: [(0, '10.061')] [2023-03-10 13:37:51,931][988492] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-10 13:37:54,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 94523392. Throughput: 0: 10147.9. Samples: 94508824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:54,815][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:37:54,819][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184616_94523392.pth... [2023-03-10 13:37:54,821][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184016_94216192.pth [2023-03-10 13:37:56,088][988492] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-10 13:37:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.8, 300 sec: 10024.8). Total num frames: 94572544. Throughput: 0: 10154.7. Samples: 94568724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:37:59,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 13:38:00,013][988492] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-10 13:38:04,202][988492] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-10 13:38:04,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 94621696. Throughput: 0: 10157.1. Samples: 94599400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:04,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 13:38:08,185][988492] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-10 13:38:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 94670848. Throughput: 0: 10169.3. Samples: 94659964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:09,804][988181] Avg episode reward: [(0, '10.043')] [2023-03-10 13:38:09,824][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184912_94674944.pth... [2023-03-10 13:38:09,826][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184320_94371840.pth [2023-03-10 13:38:12,295][988492] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-10 13:38:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 94724096. Throughput: 0: 10176.4. Samples: 94721620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:14,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:38:16,263][988492] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-10 13:38:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 94773248. Throughput: 0: 10172.7. Samples: 94751860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:19,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:38:20,428][988492] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-10 13:38:24,431][988492] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-10 13:38:24,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10024.8). Total num frames: 94822400. Throughput: 0: 10101.4. Samples: 94810020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:24,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:38:24,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185200_94822400.pth... [2023-03-10 13:38:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184616_94523392.pth [2023-03-10 13:38:28,569][988492] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-10 13:38:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 94875648. Throughput: 0: 10100.7. Samples: 94871440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:29,804][988181] Avg episode reward: [(0, '10.056')] [2023-03-10 13:38:32,680][988492] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-10 13:38:34,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 94924800. Throughput: 0: 10109.2. Samples: 94901176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:34,804][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 13:38:36,800][988492] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-10 13:38:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 94973952. Throughput: 0: 10063.1. Samples: 94961664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:39,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:38:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185496_94973952.pth... [2023-03-10 13:38:39,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000184912_94674944.pth [2023-03-10 13:38:40,901][988492] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-10 13:38:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 95023104. Throughput: 0: 10006.3. Samples: 95019008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:44,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:38:45,170][988492] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-10 13:38:49,286][988492] Updated weights for policy 0, policy_version 185680 (0.0004) [2023-03-10 13:38:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 95072256. Throughput: 0: 9995.3. Samples: 95049188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:49,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:38:53,326][988492] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-10 13:38:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95121408. Throughput: 0: 9982.7. Samples: 95109184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:54,815][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 13:38:54,817][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185784_95121408.pth... [2023-03-10 13:38:54,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185200_94822400.pth [2023-03-10 13:38:57,433][988492] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-10 13:38:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95170560. Throughput: 0: 9914.8. Samples: 95167788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:38:59,815][988181] Avg episode reward: [(0, '10.052')] [2023-03-10 13:39:01,691][988492] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-10 13:39:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 95219712. Throughput: 0: 9914.3. Samples: 95198004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:39:04,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:39:05,828][988492] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-10 13:39:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 95268864. Throughput: 0: 9923.5. Samples: 95256576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:39:09,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 13:39:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186072_95268864.pth... [2023-03-10 13:39:09,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185496_94973952.pth [2023-03-10 13:39:09,998][988492] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-10 13:39:14,171][988492] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-10 13:39:14,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 95318016. Throughput: 0: 9870.9. Samples: 95315632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:14,804][988181] Avg episode reward: [(0, '10.034')] [2023-03-10 13:39:18,360][988492] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-10 13:39:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 95367168. Throughput: 0: 9846.2. Samples: 95344256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:19,804][988181] Avg episode reward: [(0, '10.057')] [2023-03-10 13:39:22,183][988492] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-10 13:39:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95420416. Throughput: 0: 9921.4. Samples: 95408128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:24,804][988181] Avg episode reward: [(0, '10.051')] [2023-03-10 13:39:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186368_95420416.pth... [2023-03-10 13:39:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000185784_95121408.pth [2023-03-10 13:39:26,487][988492] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-10 13:39:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 95469568. Throughput: 0: 9992.4. Samples: 95468664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:29,804][988181] Avg episode reward: [(0, '10.037')] [2023-03-10 13:39:30,351][988492] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-10 13:39:34,320][988492] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-10 13:39:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 95522816. Throughput: 0: 9980.4. Samples: 95498304. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:34,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:39:38,460][988492] Updated weights for policy 0, policy_version 186640 (0.0005) [2023-03-10 13:39:39,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95571968. Throughput: 0: 10003.2. Samples: 95559328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:39,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:39:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186664_95571968.pth... [2023-03-10 13:39:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186072_95268864.pth [2023-03-10 13:39:42,718][988492] Updated weights for policy 0, policy_version 186720 (0.0004) [2023-03-10 13:39:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95621120. Throughput: 0: 10015.4. Samples: 95618480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:44,804][988181] Avg episode reward: [(0, '10.058')] [2023-03-10 13:39:46,569][988492] Updated weights for policy 0, policy_version 186800 (0.0005) [2023-03-10 13:39:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95670272. Throughput: 0: 10038.0. Samples: 95649712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:49,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:39:50,711][988492] Updated weights for policy 0, policy_version 186880 (0.0005) [2023-03-10 13:39:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10024.8). Total num frames: 95719424. Throughput: 0: 10017.8. Samples: 95707376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:54,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:39:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186952_95719424.pth... [2023-03-10 13:39:54,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186368_95420416.pth [2023-03-10 13:39:54,958][988492] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-10 13:39:58,889][988492] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-10 13:39:59,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 95772672. Throughput: 0: 10065.6. Samples: 95768584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:39:59,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:40:03,019][988492] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-10 13:40:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 95821824. Throughput: 0: 10089.0. Samples: 95798260. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:40:04,804][988181] Avg episode reward: [(0, '10.049')] [2023-03-10 13:40:07,038][988492] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-10 13:40:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 95870976. Throughput: 0: 10016.4. Samples: 95858868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:40:09,804][988181] Avg episode reward: [(0, '10.055')] [2023-03-10 13:40:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187248_95870976.pth... [2023-03-10 13:40:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186664_95571968.pth [2023-03-10 13:40:11,167][988492] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-10 13:40:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 95924224. Throughput: 0: 10034.1. Samples: 95920200. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-10 13:40:14,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 13:40:15,032][988492] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-10 13:40:18,984][988492] Updated weights for policy 0, policy_version 187440 (0.0004) [2023-03-10 13:40:19,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 95973376. Throughput: 0: 10100.2. Samples: 95952812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:19,804][988181] Avg episode reward: [(0, '10.045')] [2023-03-10 13:40:23,137][988492] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-10 13:40:24,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 96026624. Throughput: 0: 10071.4. Samples: 96012540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:24,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 13:40:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187552_96026624.pth... [2023-03-10 13:40:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000186952_95719424.pth [2023-03-10 13:40:27,099][988492] Updated weights for policy 0, policy_version 187600 (0.0006) [2023-03-10 13:40:29,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 96075776. Throughput: 0: 10118.6. Samples: 96073816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:29,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 13:40:31,182][988492] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-10 13:40:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 96129024. Throughput: 0: 10106.7. Samples: 96104512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 13:40:35,123][988492] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-10 13:40:39,281][988492] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-10 13:40:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 96178176. Throughput: 0: 10167.0. Samples: 96164892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:39,804][988181] Avg episode reward: [(0, '10.047')] [2023-03-10 13:40:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187848_96178176.pth... [2023-03-10 13:40:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187248_95870976.pth [2023-03-10 13:40:43,822][988492] Updated weights for policy 0, policy_version 187920 (0.0004) [2023-03-10 13:40:44,804][988181] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 96223232. Throughput: 0: 10043.3. Samples: 96220532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:44,804][988181] Avg episode reward: [(0, '10.053')] [2023-03-10 13:40:47,838][988492] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-10 13:40:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10038.7). Total num frames: 96276480. Throughput: 0: 10078.6. Samples: 96251800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:49,805][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 13:40:51,890][988492] Updated weights for policy 0, policy_version 188080 (0.0004) [2023-03-10 13:40:54,804][988181] Fps is (10 sec: 10239.8, 60 sec: 10103.4, 300 sec: 10038.7). Total num frames: 96325632. Throughput: 0: 10047.4. Samples: 96311004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:54,805][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 13:40:54,809][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188136_96325632.pth... [2023-03-10 13:40:54,812][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187552_96026624.pth [2023-03-10 13:40:56,124][988492] Updated weights for policy 0, policy_version 188160 (0.0004) [2023-03-10 13:40:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 96370688. Throughput: 0: 10007.2. Samples: 96370524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:40:59,804][988181] Avg episode reward: [(0, '10.059')] [2023-03-10 13:41:00,244][988492] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-10 13:41:04,563][988492] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-10 13:41:04,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 96419840. Throughput: 0: 9920.8. Samples: 96399248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:04,804][988181] Avg episode reward: [(0, '10.085')] [2023-03-10 13:41:08,624][988492] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-10 13:41:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9997.0). Total num frames: 96468992. Throughput: 0: 9901.8. Samples: 96458124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:09,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:41:09,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188416_96468992.pth... [2023-03-10 13:41:09,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000187848_96178176.pth [2023-03-10 13:41:12,640][988492] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-10 13:41:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 96522240. Throughput: 0: 9876.3. Samples: 96518252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:14,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:41:16,611][988492] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-10 13:41:19,804][988181] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 96575488. Throughput: 0: 9897.0. Samples: 96549876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:19,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 13:41:20,425][988492] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-10 13:41:24,436][988492] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-10 13:41:24,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 96624640. Throughput: 0: 9956.9. Samples: 96612952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:24,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 13:41:24,838][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188728_96628736.pth... [2023-03-10 13:41:24,840][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188136_96325632.pth [2023-03-10 13:41:28,382][988492] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-10 13:41:29,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 96677888. Throughput: 0: 10101.3. Samples: 96675092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:29,804][988181] Avg episode reward: [(0, '10.097')] [2023-03-10 13:41:32,439][988492] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-10 13:41:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 96727040. Throughput: 0: 10087.6. Samples: 96705740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:34,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 13:41:36,542][988492] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-10 13:41:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 96776192. Throughput: 0: 10093.7. Samples: 96765216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:39,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 13:41:39,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189016_96776192.pth... [2023-03-10 13:41:39,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188416_96468992.pth [2023-03-10 13:41:40,708][988492] Updated weights for policy 0, policy_version 189040 (0.0004) [2023-03-10 13:41:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 96825344. Throughput: 0: 10094.9. Samples: 96824796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:44,804][988181] Avg episode reward: [(0, '10.071')] [2023-03-10 13:41:44,851][988492] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-10 13:41:48,930][988492] Updated weights for policy 0, policy_version 189200 (0.0004) [2023-03-10 13:41:49,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 96874496. Throughput: 0: 10113.6. Samples: 96854360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:49,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:41:53,004][988492] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-10 13:41:54,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 96927744. Throughput: 0: 10162.9. Samples: 96915456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:54,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 13:41:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189312_96927744.pth... [2023-03-10 13:41:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000188728_96628736.pth [2023-03-10 13:41:57,069][988492] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-10 13:41:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 96976896. Throughput: 0: 10169.7. Samples: 96975888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:41:59,815][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 13:42:01,055][988492] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-10 13:42:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 97030144. Throughput: 0: 10135.3. Samples: 97005964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:04,804][988181] Avg episode reward: [(0, '10.099')] [2023-03-10 13:42:05,154][988492] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-10 13:42:09,072][988492] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-10 13:42:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10171.8, 300 sec: 10052.6). Total num frames: 97079296. Throughput: 0: 10132.2. Samples: 97068900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:09,804][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 13:42:09,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189608_97079296.pth... [2023-03-10 13:42:09,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189016_96776192.pth [2023-03-10 13:42:13,132][988492] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-10 13:42:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10052.6). Total num frames: 97128448. Throughput: 0: 10052.4. Samples: 97127448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:14,804][988181] Avg episode reward: [(0, '10.068')] [2023-03-10 13:42:17,514][988492] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-10 13:42:19,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 97177600. Throughput: 0: 10003.0. Samples: 97155876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:19,815][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 13:42:21,605][988492] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-10 13:42:24,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10038.7). Total num frames: 97226752. Throughput: 0: 10017.1. Samples: 97215988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:24,814][988181] Avg episode reward: [(0, '10.090')] [2023-03-10 13:42:24,877][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189904_97230848.pth... [2023-03-10 13:42:24,879][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189312_96927744.pth [2023-03-10 13:42:25,752][988492] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-10 13:42:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10038.7). Total num frames: 97275904. Throughput: 0: 10021.7. Samples: 97275772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:42:29,811][988492] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-10 13:42:29,815][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 13:42:33,869][988492] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-10 13:42:34,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 97329152. Throughput: 0: 10006.2. Samples: 97304640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:34,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 13:42:38,006][988492] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-10 13:42:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 97378304. Throughput: 0: 10010.8. Samples: 97365940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:39,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 13:42:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190192_97378304.pth... [2023-03-10 13:42:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189608_97079296.pth [2023-03-10 13:42:42,002][988492] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-10 13:42:44,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 97427456. Throughput: 0: 9990.6. Samples: 97425468. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:44,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 13:42:46,285][988492] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-10 13:42:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10010.9). Total num frames: 97476608. Throughput: 0: 9983.2. Samples: 97455208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:49,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:42:50,307][988492] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-10 13:42:54,694][988492] Updated weights for policy 0, policy_version 190480 (0.0005) [2023-03-10 13:42:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10010.9). Total num frames: 97525760. Throughput: 0: 9877.3. Samples: 97513380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:54,815][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 13:42:54,818][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190480_97525760.pth... [2023-03-10 13:42:54,820][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000189904_97230848.pth [2023-03-10 13:42:59,164][988492] Updated weights for policy 0, policy_version 190560 (0.0006) [2023-03-10 13:42:59,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 97570816. Throughput: 0: 9799.3. Samples: 97568416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:42:59,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 13:43:03,170][988492] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-10 13:43:04,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 97619968. Throughput: 0: 9858.0. Samples: 97599484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:04,804][988181] Avg episode reward: [(0, '10.091')] [2023-03-10 13:43:07,370][988492] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-10 13:43:09,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9983.1). Total num frames: 97669120. Throughput: 0: 9822.0. Samples: 97657976. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:09,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:43:09,839][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190768_97673216.pth... [2023-03-10 13:43:09,841][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190192_97378304.pth [2023-03-10 13:43:11,477][988492] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-10 13:43:14,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 97722368. Throughput: 0: 9852.8. Samples: 97719148. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:14,805][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 13:43:15,417][988492] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-10 13:43:19,675][988492] Updated weights for policy 0, policy_version 190960 (0.0004) [2023-03-10 13:43:19,804][988181] Fps is (10 sec: 10239.8, 60 sec: 9898.6, 300 sec: 9997.0). Total num frames: 97771520. Throughput: 0: 9850.7. Samples: 97747924. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:19,805][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:43:23,921][988492] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-10 13:43:24,804][988181] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9969.2). Total num frames: 97816576. Throughput: 0: 9817.1. Samples: 97807708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:24,815][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:43:24,846][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191056_97820672.pth... [2023-03-10 13:43:24,847][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190480_97525760.pth [2023-03-10 13:43:28,336][988492] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-10 13:43:29,804][988181] Fps is (10 sec: 9421.0, 60 sec: 9830.4, 300 sec: 9969.3). Total num frames: 97865728. Throughput: 0: 9783.0. Samples: 97865700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:29,815][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:43:32,269][988492] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-10 13:43:34,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 97914880. Throughput: 0: 9766.8. Samples: 97894712. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-10 13:43:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:43:36,735][988492] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-10 13:43:39,804][988181] Fps is (10 sec: 9830.2, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 97964032. Throughput: 0: 9740.7. Samples: 97951712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:43:39,805][988181] Avg episode reward: [(0, '10.093')] [2023-03-10 13:43:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191336_97964032.pth... [2023-03-10 13:43:39,811][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000190768_97673216.pth [2023-03-10 13:43:40,929][988492] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-10 13:43:44,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9969.3). Total num frames: 98013184. Throughput: 0: 9798.1. Samples: 98009332. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:43:44,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:43:45,110][988492] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-10 13:43:49,307][988492] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-10 13:43:49,804][988181] Fps is (10 sec: 9830.6, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 98062336. Throughput: 0: 9761.2. Samples: 98038740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:43:49,804][988181] Avg episode reward: [(0, '10.086')] [2023-03-10 13:43:53,432][988492] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-10 13:43:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9969.2). Total num frames: 98111488. Throughput: 0: 9803.8. Samples: 98099148. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:43:54,804][988181] Avg episode reward: [(0, '10.101')] [2023-03-10 13:43:54,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191624_98111488.pth... [2023-03-10 13:43:54,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191056_97820672.pth [2023-03-10 13:43:57,425][988492] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-10 13:43:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9969.3). Total num frames: 98160640. Throughput: 0: 9778.6. Samples: 98159184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:43:59,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 13:44:01,480][988492] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-10 13:44:04,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9898.6, 300 sec: 9983.1). Total num frames: 98213888. Throughput: 0: 9810.1. Samples: 98189376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:04,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 13:44:05,436][988492] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-10 13:44:09,398][988492] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-10 13:44:09,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 98263040. Throughput: 0: 9871.9. Samples: 98251944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:09,804][988181] Avg episode reward: [(0, '10.062')] [2023-03-10 13:44:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191928_98267136.pth... [2023-03-10 13:44:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191336_97964032.pth [2023-03-10 13:44:13,532][988492] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-10 13:44:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9997.0). Total num frames: 98316288. Throughput: 0: 9927.4. Samples: 98312436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:14,804][988181] Avg episode reward: [(0, '10.088')] [2023-03-10 13:44:17,744][988492] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-10 13:44:19,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 98365440. Throughput: 0: 9912.2. Samples: 98340760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:19,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 13:44:21,771][988492] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-10 13:44:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9997.0). Total num frames: 98418688. Throughput: 0: 10013.4. Samples: 98402312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:24,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 13:44:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192224_98418688.pth... [2023-03-10 13:44:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191624_98111488.pth [2023-03-10 13:44:25,529][988492] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-10 13:44:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 98463744. Throughput: 0: 10089.5. Samples: 98463360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:29,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:44:29,928][988492] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-10 13:44:34,175][988492] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-10 13:44:34,804][988181] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9969.3). Total num frames: 98512896. Throughput: 0: 10068.6. Samples: 98491828. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:34,804][988181] Avg episode reward: [(0, '10.066')] [2023-03-10 13:44:38,289][988492] Updated weights for policy 0, policy_version 192480 (0.0006) [2023-03-10 13:44:39,804][988181] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 98566144. Throughput: 0: 10015.2. Samples: 98549832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-10 13:44:39,804][988181] Avg episode reward: [(0, '10.080')] [2023-03-10 13:44:39,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192512_98566144.pth... [2023-03-10 13:44:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000191928_98267136.pth [2023-03-10 13:44:42,217][988492] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-10 13:44:44,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 98615296. Throughput: 0: 10043.2. Samples: 98611128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:44:44,804][988181] Avg episode reward: [(0, '10.079')] [2023-03-10 13:44:46,399][988492] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-10 13:44:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 98664448. Throughput: 0: 10011.2. Samples: 98639880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:44:49,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 13:44:50,472][988492] Updated weights for policy 0, policy_version 192720 (0.0004) [2023-03-10 13:44:54,427][988492] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-10 13:44:54,804][988181] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 98713600. Throughput: 0: 10007.2. Samples: 98702268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:44:54,815][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 13:44:54,841][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192808_98717696.pth... [2023-03-10 13:44:54,843][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192224_98418688.pth [2023-03-10 13:44:58,632][988492] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-10 13:44:59,804][988181] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 98762752. Throughput: 0: 9994.5. Samples: 98762188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:44:59,804][988181] Avg episode reward: [(0, '10.046')] [2023-03-10 13:45:02,764][988492] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-10 13:45:04,804][988181] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9983.1). Total num frames: 98816000. Throughput: 0: 10015.0. Samples: 98791436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:04,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:45:06,873][988492] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-10 13:45:09,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 98861056. Throughput: 0: 9945.9. Samples: 98849880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:09,804][988181] Avg episode reward: [(0, '10.065')] [2023-03-10 13:45:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193088_98861056.pth... [2023-03-10 13:45:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192512_98566144.pth [2023-03-10 13:45:11,141][988492] Updated weights for policy 0, policy_version 193120 (0.0004) [2023-03-10 13:45:14,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 98914304. Throughput: 0: 9923.4. Samples: 98909916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:14,804][988181] Avg episode reward: [(0, '10.064')] [2023-03-10 13:45:15,186][988492] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-10 13:45:19,166][988492] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-10 13:45:19,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 98963456. Throughput: 0: 9957.1. Samples: 98939896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:19,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:45:23,304][988492] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-10 13:45:24,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 99012608. Throughput: 0: 10012.4. Samples: 99000392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:24,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:45:24,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193384_99012608.pth... [2023-03-10 13:45:24,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000192808_98717696.pth [2023-03-10 13:45:27,510][988492] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-10 13:45:29,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99061760. Throughput: 0: 9971.4. Samples: 99059840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:29,804][988181] Avg episode reward: [(0, '10.082')] [2023-03-10 13:45:31,541][988492] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-10 13:45:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99110912. Throughput: 0: 10004.3. Samples: 99090072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:34,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 13:45:35,901][988492] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-10 13:45:39,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 99160064. Throughput: 0: 9899.4. Samples: 99147740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:39,804][988181] Avg episode reward: [(0, '10.076')] [2023-03-10 13:45:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193672_99160064.pth... [2023-03-10 13:45:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193088_98861056.pth [2023-03-10 13:45:40,100][988492] Updated weights for policy 0, policy_version 193680 (0.0005) [2023-03-10 13:45:44,172][988492] Updated weights for policy 0, policy_version 193760 (0.0004) [2023-03-10 13:45:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 99209216. Throughput: 0: 9888.1. Samples: 99207152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:44,804][988181] Avg episode reward: [(0, '10.054')] [2023-03-10 13:45:48,188][988492] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-10 13:45:49,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 99258368. Throughput: 0: 9908.3. Samples: 99237308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:49,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:45:52,299][988492] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-10 13:45:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 99307520. Throughput: 0: 9944.8. Samples: 99297396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:54,804][988181] Avg episode reward: [(0, '10.070')] [2023-03-10 13:45:54,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193960_99307520.pth... [2023-03-10 13:45:54,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193384_99012608.pth [2023-03-10 13:45:56,492][988492] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-10 13:45:59,804][988181] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9969.2). Total num frames: 99360768. Throughput: 0: 9926.6. Samples: 99356612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:45:59,804][988181] Avg episode reward: [(0, '10.050')] [2023-03-10 13:46:00,688][988492] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-10 13:46:04,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9955.4). Total num frames: 99405824. Throughput: 0: 9899.0. Samples: 99385352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:04,804][988181] Avg episode reward: [(0, '10.083')] [2023-03-10 13:46:04,931][988492] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-10 13:46:09,127][988492] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-10 13:46:09,804][988181] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 99454976. Throughput: 0: 9830.2. Samples: 99442752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:09,804][988181] Avg episode reward: [(0, '10.077')] [2023-03-10 13:46:09,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194248_99454976.pth... [2023-03-10 13:46:09,809][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193672_99160064.pth [2023-03-10 13:46:13,024][988492] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-10 13:46:14,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9941.5). Total num frames: 99508224. Throughput: 0: 9921.5. Samples: 99506308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:14,804][988181] Avg episode reward: [(0, '10.073')] [2023-03-10 13:46:16,938][988492] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-10 13:46:19,804][988181] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 99561472. Throughput: 0: 9930.8. Samples: 99536960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:19,804][988181] Avg episode reward: [(0, '10.074')] [2023-03-10 13:46:20,952][988492] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-10 13:46:24,804][988181] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99610624. Throughput: 0: 10004.5. Samples: 99597944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:24,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 13:46:24,808][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194552_99610624.pth... [2023-03-10 13:46:24,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000193960_99307520.pth [2023-03-10 13:46:25,058][988492] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-10 13:46:29,130][988492] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-10 13:46:29,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99659776. Throughput: 0: 10020.2. Samples: 99658060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:29,804][988181] Avg episode reward: [(0, '10.069')] [2023-03-10 13:46:33,229][988492] Updated weights for policy 0, policy_version 194720 (0.0006) [2023-03-10 13:46:34,804][988181] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99708928. Throughput: 0: 10022.7. Samples: 99688328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:34,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:46:37,360][988492] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-10 13:46:39,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99758080. Throughput: 0: 9982.8. Samples: 99746620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:39,804][988181] Avg episode reward: [(0, '10.075')] [2023-03-10 13:46:39,807][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194840_99758080.pth... [2023-03-10 13:46:39,810][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194248_99454976.pth [2023-03-10 13:46:41,572][988492] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-10 13:46:44,804][988181] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9941.5). Total num frames: 99807232. Throughput: 0: 9967.2. Samples: 99805136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:44,804][988181] Avg episode reward: [(0, '10.067')] [2023-03-10 13:46:45,919][988492] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-10 13:46:49,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 99856384. Throughput: 0: 9969.3. Samples: 99833972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:49,804][988181] Avg episode reward: [(0, '10.078')] [2023-03-10 13:46:50,072][988492] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-10 13:46:54,066][988492] Updated weights for policy 0, policy_version 195120 (0.0005) [2023-03-10 13:46:54,804][988181] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 99905536. Throughput: 0: 10030.9. Samples: 99894140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:54,804][988181] Avg episode reward: [(0, '10.060')] [2023-03-10 13:46:54,806][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000195128_99905536.pth... [2023-03-10 13:46:54,808][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194552_99610624.pth [2023-03-10 13:46:58,065][988492] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-10 13:46:59,804][988181] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9927.6). Total num frames: 99958784. Throughput: 0: 9983.8. Samples: 99955576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-10 13:46:59,804][988181] Avg episode reward: [(0, '10.081')] [2023-03-10 13:47:02,183][988492] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-10 13:47:04,230][988448] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-10 13:47:04,664][988448] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-10 13:47:04,665][988592] Stopping RolloutWorker_w6... [2023-03-10 13:47:04,665][988496] Stopping RolloutWorker_w3... [2023-03-10 13:47:04,665][988592] Loop rollout_proc6_evt_loop terminating... [2023-03-10 13:47:04,665][988495] Stopping RolloutWorker_w2... [2023-03-10 13:47:04,665][988626] Stopping RolloutWorker_w7... [2023-03-10 13:47:04,665][988496] Loop rollout_proc3_evt_loop terminating... [2023-03-10 13:47:04,665][988493] Stopping RolloutWorker_w0... [2023-03-10 13:47:04,665][988528] Stopping RolloutWorker_w4... [2023-03-10 13:47:04,665][988560] Stopping RolloutWorker_w5... [2023-03-10 13:47:04,665][988448] Stopping Batcher_0... [2023-03-10 13:47:04,665][988495] Loop rollout_proc2_evt_loop terminating... [2023-03-10 13:47:04,665][988626] Loop rollout_proc7_evt_loop terminating... [2023-03-10 13:47:04,665][988528] Loop rollout_proc4_evt_loop terminating... [2023-03-10 13:47:04,665][988181] Component RolloutWorker_w6 stopped! [2023-03-10 13:47:04,665][988560] Loop rollout_proc5_evt_loop terminating... [2023-03-10 13:47:04,665][988493] Loop rollout_proc0_evt_loop terminating... [2023-03-10 13:47:04,665][988448] Loop batcher_evt_loop terminating... [2023-03-10 13:47:04,665][988494] Stopping RolloutWorker_w1... [2023-03-10 13:47:04,665][988494] Loop rollout_proc1_evt_loop terminating... [2023-03-10 13:47:04,665][988181] Component RolloutWorker_w3 stopped! [2023-03-10 13:47:04,666][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-10 13:47:04,666][988181] Component RolloutWorker_w4 stopped! [2023-03-10 13:47:04,666][988181] Component RolloutWorker_w0 stopped! [2023-03-10 13:47:04,666][988181] Component RolloutWorker_w2 stopped! [2023-03-10 13:47:04,666][988181] Component RolloutWorker_w5 stopped! [2023-03-10 13:47:04,666][988181] Component RolloutWorker_w7 stopped! [2023-03-10 13:47:04,667][988181] Component Batcher_0 stopped! [2023-03-10 13:47:04,667][988181] Component RolloutWorker_w1 stopped! [2023-03-10 13:47:04,668][988448] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000194840_99758080.pth [2023-03-10 13:47:04,669][988448] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/push-back-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-10 13:47:04,671][988448] Stopping LearnerWorker_p0... [2023-03-10 13:47:04,671][988448] Loop learner_proc0_evt_loop terminating... [2023-03-10 13:47:04,671][988181] Component LearnerWorker_p0 stopped! [2023-03-10 13:47:04,718][988492] Weights refcount: 2 0 [2023-03-10 13:47:04,719][988492] Stopping InferenceWorker_p0-w0... [2023-03-10 13:47:04,719][988492] Loop inference_proc0-0_evt_loop terminating... [2023-03-10 13:47:04,720][988181] Component InferenceWorker_p0-w0 stopped! [2023-03-10 13:47:04,720][988181] Waiting for process learner_proc0 to stop... [2023-03-10 13:47:05,189][988181] Waiting for process inference_proc0-0 to join... [2023-03-10 13:47:05,198][988181] Waiting for process rollout_proc0 to join... [2023-03-10 13:47:05,199][988181] Waiting for process rollout_proc1 to join... [2023-03-10 13:47:05,199][988181] Waiting for process rollout_proc2 to join... [2023-03-10 13:47:05,201][988181] Waiting for process rollout_proc3 to join... [2023-03-10 13:47:05,201][988181] Waiting for process rollout_proc4 to join... [2023-03-10 13:47:05,202][988181] Waiting for process rollout_proc5 to join... [2023-03-10 13:47:05,202][988181] Waiting for process rollout_proc6 to join... [2023-03-10 13:47:05,202][988181] Waiting for process rollout_proc7 to join... [2023-03-10 13:47:05,202][988181] Batcher 0 profile tree view: batching: 17.5223, releasing_batches: 15.1399 [2023-03-10 13:47:05,203][988181] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 3624.0249 update_model: 111.6452 weight_update: 0.0005 one_step: 0.0014 handle_policy_step: 5655.7141 deserialize: 236.4984, stack: 60.1022, obs_to_device_normalize: 999.2113, forward: 2815.8527, send_messages: 438.8400 prepare_outputs: 612.3243 to_cpu: 95.9391 [2023-03-10 13:47:05,203][988181] Learner 0 profile tree view: misc: 0.0932, prepare_batch: 80.6722 train: 1033.2596 epoch_init: 0.3425, minibatch_init: 11.1638, losses_postprocess: 12.5083, kl_divergence: 3.9978, after_optimizer: 5.6565 calculate_losses: 420.1182 losses_init: 0.2825, forward_head: 201.9160, bptt_initial: 1.1468, bptt: 1.1953, tail: 104.1192, advantages_returns: 8.4247, losses: 90.3805 update: 564.7839 clip: 51.5027 [2023-03-10 13:47:05,203][988181] RolloutWorker_w0 profile tree view: wait_for_trajectories: 4.4341, enqueue_policy_requests: 159.1474, env_step: 5735.5647, overhead: 340.5222, complete_rollouts: 3.9024 save_policy_outputs: 375.3855 split_output_tensors: 182.8861 [2023-03-10 13:47:05,203][988181] RolloutWorker_w7 profile tree view: wait_for_trajectories: 4.2301, enqueue_policy_requests: 161.0777, env_step: 5708.4695, overhead: 339.5135, complete_rollouts: 3.7672 save_policy_outputs: 368.5677 split_output_tensors: 180.6898 [2023-03-10 13:47:05,204][988181] Loop Runner_EvtLoop terminating... [2023-03-10 13:47:05,204][988181] Runner profile tree view: main_loop: 10088.0631 [2023-03-10 13:47:05,204][988181] Collected {0: 100007936}, FPS: 9913.5