[2023-03-09 20:33:00,813][820373] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/config.json... [2023-03-09 20:33:00,829][820373] Rollout worker 0 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 1 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 2 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 3 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 4 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 5 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 6 uses device cpu [2023-03-09 20:33:00,830][820373] Rollout worker 7 uses device cpu [2023-03-09 20:33:00,831][820373] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-09 20:33:00,843][820373] InferenceWorker_p0-w0: min num requests: 2 [2023-03-09 20:33:00,862][820373] Starting all processes... [2023-03-09 20:33:00,862][820373] Starting process learner_proc0 [2023-03-09 20:33:00,912][820373] Starting all processes... [2023-03-09 20:33:00,956][820373] Starting process inference_proc0-0 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc0 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc1 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc2 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc3 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc4 [2023-03-09 20:33:00,956][820373] Starting process rollout_proc5 [2023-03-09 20:33:00,957][820373] Starting process rollout_proc6 [2023-03-09 20:33:00,957][820373] Starting process rollout_proc7 [2023-03-09 20:33:02,530][820631] Starting seed is not provided [2023-03-09 20:33:02,531][820631] Initializing actor-critic model on device cpu [2023-03-09 20:33:02,531][820631] RunningMeanStd input shape: (39,) [2023-03-09 20:33:02,532][820631] RunningMeanStd input shape: (1,) [2023-03-09 20:33:02,595][820678] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-09 20:33:02,599][820631] Created Actor Critic model with architecture: [2023-03-09 20:33:02,599][820631] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-09 20:33:02,659][820676] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-09 20:33:02,932][820631] Using optimizer [2023-03-09 20:33:02,933][820631] No checkpoints found [2023-03-09 20:33:02,933][820631] Did not load from checkpoint, starting from scratch! [2023-03-09 20:33:02,933][820631] Initialized policy 0 weights for model version 0 [2023-03-09 20:33:02,934][820631] LearnerWorker_p0 finished initialization! [2023-03-09 20:33:02,936][820675] RunningMeanStd input shape: (39,) [2023-03-09 20:33:02,936][820675] RunningMeanStd input shape: (1,) [2023-03-09 20:33:02,945][820677] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-09 20:33:02,987][820743] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-09 20:33:03,013][820373] Inference worker 0-0 is ready! [2023-03-09 20:33:03,014][820373] All inference workers are ready! Signal rollout workers to start! [2023-03-09 20:33:03,119][820680] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-09 20:33:03,143][820679] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-09 20:33:03,215][820806] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-09 20:33:03,362][820807] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-09 20:33:03,539][820373] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-09 20:33:06,949][820743] Decorrelating experience for 0 frames... [2023-03-09 20:33:06,961][820743] Decorrelating experience for 64 frames... [2023-03-09 20:33:06,985][820677] Decorrelating experience for 0 frames... [2023-03-09 20:33:06,988][820678] Decorrelating experience for 0 frames... [2023-03-09 20:33:06,997][820677] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,000][820678] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,001][820743] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,037][820677] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,040][820678] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,069][820743] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,104][820677] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,107][820678] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,132][820680] Decorrelating experience for 0 frames... [2023-03-09 20:33:07,144][820680] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,161][820679] Decorrelating experience for 0 frames... [2023-03-09 20:33:07,173][820679] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,178][820806] Decorrelating experience for 0 frames... [2023-03-09 20:33:07,184][820680] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,190][820806] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,214][820679] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,230][820806] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,252][820680] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,274][820807] Decorrelating experience for 0 frames... [2023-03-09 20:33:07,285][820679] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,287][820807] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,300][820806] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,327][820807] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,394][820807] Decorrelating experience for 192 frames... [2023-03-09 20:33:07,483][820676] Decorrelating experience for 0 frames... [2023-03-09 20:33:07,496][820676] Decorrelating experience for 64 frames... [2023-03-09 20:33:07,536][820676] Decorrelating experience for 128 frames... [2023-03-09 20:33:07,604][820676] Decorrelating experience for 192 frames... [2023-03-09 20:33:08,539][820373] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-09 20:33:10,976][820678] Decorrelating experience for 256 frames... [2023-03-09 20:33:10,984][820743] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,013][820677] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,102][820678] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,106][820743] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,127][820680] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,138][820677] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,181][820679] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,183][820806] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,250][820680] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,256][820678] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,257][820743] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,267][820807] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,291][820677] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,306][820679] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,307][820806] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,393][820807] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,403][820680] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,436][820743] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,436][820678] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,456][820806] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,457][820679] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,469][820677] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,495][820676] Decorrelating experience for 256 frames... [2023-03-09 20:33:11,542][820807] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,578][820680] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,620][820676] Decorrelating experience for 320 frames... [2023-03-09 20:33:11,635][820806] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,636][820679] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,721][820807] Decorrelating experience for 448 frames... [2023-03-09 20:33:11,803][820676] Decorrelating experience for 384 frames... [2023-03-09 20:33:11,979][820676] Decorrelating experience for 448 frames... [2023-03-09 20:33:13,539][820373] Fps is (10 sec: 819.2, 60 sec: 819.2, 300 sec: 819.2). Total num frames: 8192. Throughput: 0: 102.0. Samples: 1020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:33:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:33:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000016_8192.pth... [2023-03-09 20:33:16,942][820675] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-09 20:33:18,539][820373] Fps is (10 sec: 5324.9, 60 sec: 3549.9, 300 sec: 3549.9). Total num frames: 53248. Throughput: 0: 3435.0. Samples: 51524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:33:18,539][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 20:33:20,838][820373] Heartbeat connected on Batcher_0 [2023-03-09 20:33:20,840][820373] Heartbeat connected on LearnerWorker_p0 [2023-03-09 20:33:20,844][820373] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-09 20:33:20,848][820373] Heartbeat connected on RolloutWorker_w0 [2023-03-09 20:33:20,851][820373] Heartbeat connected on RolloutWorker_w1 [2023-03-09 20:33:20,853][820373] Heartbeat connected on RolloutWorker_w2 [2023-03-09 20:33:20,855][820373] Heartbeat connected on RolloutWorker_w3 [2023-03-09 20:33:20,858][820373] Heartbeat connected on RolloutWorker_w4 [2023-03-09 20:33:20,859][820373] Heartbeat connected on RolloutWorker_w5 [2023-03-09 20:33:20,863][820373] Heartbeat connected on RolloutWorker_w6 [2023-03-09 20:33:20,864][820373] Heartbeat connected on RolloutWorker_w7 [2023-03-09 20:33:21,095][820675] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-09 20:33:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 5120.0, 300 sec: 5120.0). Total num frames: 102400. Throughput: 0: 4096.0. Samples: 81920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:33:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:33:23,540][820631] Saving new best policy, reward=0.000! [2023-03-09 20:33:25,688][820675] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-09 20:33:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 5898.2, 300 sec: 5898.2). Total num frames: 147456. Throughput: 0: 5431.4. Samples: 135784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:33:28,540][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 20:33:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000288_147456.pth... [2023-03-09 20:33:28,545][820631] Saving new best policy, reward=0.005! [2023-03-09 20:33:30,228][820675] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-09 20:33:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 6553.6, 300 sec: 6553.6). Total num frames: 196608. Throughput: 0: 6416.9. Samples: 192508. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:33:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:33:34,391][820675] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-09 20:33:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 6904.7, 300 sec: 6904.7). Total num frames: 241664. Throughput: 0: 6286.1. Samples: 220012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:33:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:33:38,791][820675] Updated weights for policy 0, policy_version 480 (0.0006) [2023-03-09 20:33:43,073][820675] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-09 20:33:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 7270.4, 300 sec: 7270.4). Total num frames: 290816. Throughput: 0: 6939.9. Samples: 277596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:33:43,539][820373] Avg episode reward: [(0, '0.011')] [2023-03-09 20:33:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000568_290816.pth... [2023-03-09 20:33:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000016_8192.pth [2023-03-09 20:33:43,546][820631] Saving new best policy, reward=0.011! [2023-03-09 20:33:47,692][820675] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-09 20:33:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 7463.8, 300 sec: 7463.8). Total num frames: 335872. Throughput: 0: 7371.9. Samples: 331736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:33:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:33:51,809][820675] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-09 20:33:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 7700.5, 300 sec: 7700.5). Total num frames: 385024. Throughput: 0: 8045.1. Samples: 362028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:33:53,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 20:33:56,092][820675] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-09 20:33:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 7819.6, 300 sec: 7819.6). Total num frames: 430080. Throughput: 0: 9263.5. Samples: 417880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:33:58,540][820373] Avg episode reward: [(0, '0.013')] [2023-03-09 20:33:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000840_430080.pth... [2023-03-09 20:33:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000288_147456.pth [2023-03-09 20:33:58,547][820631] Saving new best policy, reward=0.013! [2023-03-09 20:34:00,597][820675] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-09 20:34:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 7918.9, 300 sec: 7918.9). Total num frames: 475136. Throughput: 0: 9324.6. Samples: 471132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:03,539][820373] Avg episode reward: [(0, '0.024')] [2023-03-09 20:34:03,540][820631] Saving new best policy, reward=0.024! [2023-03-09 20:34:05,213][820675] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-09 20:34:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 8738.1, 300 sec: 8066.0). Total num frames: 524288. Throughput: 0: 9285.7. Samples: 499776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:08,540][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 20:34:09,391][820675] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-09 20:34:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 8133.5). Total num frames: 569344. Throughput: 0: 9412.7. Samples: 559356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001112_569344.pth... [2023-03-09 20:34:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000568_290816.pth [2023-03-09 20:34:13,668][820675] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-09 20:34:17,925][820675] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-09 20:34:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8246.6). Total num frames: 618496. Throughput: 0: 9397.6. Samples: 615400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:34:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:22,357][820675] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-09 20:34:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 8294.4). Total num frames: 663552. Throughput: 0: 9402.8. Samples: 643136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:34:23,539][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 20:34:23,540][820631] Saving new best policy, reward=0.081! [2023-03-09 20:34:26,540][820675] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-09 20:34:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 8384.7). Total num frames: 712704. Throughput: 0: 9406.1. Samples: 700872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:28,540][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 20:34:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001392_712704.pth... [2023-03-09 20:34:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000000840_430080.pth [2023-03-09 20:34:31,018][820675] Updated weights for policy 0, policy_version 1440 (0.0006) [2023-03-09 20:34:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 8465.1). Total num frames: 761856. Throughput: 0: 9497.9. Samples: 759144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:34,933][820675] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-09 20:34:38,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 8536.9). Total num frames: 811008. Throughput: 0: 9469.2. Samples: 788144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:34:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:39,359][820675] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-09 20:34:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 8560.6). Total num frames: 856064. Throughput: 0: 9502.8. Samples: 845504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:34:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:43,567][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001680_860160.pth... [2023-03-09 20:34:43,567][820675] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-09 20:34:43,568][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001112_569344.pth [2023-03-09 20:34:47,626][820675] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-09 20:34:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 8660.1). Total num frames: 909312. Throughput: 0: 9656.0. Samples: 905652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:51,758][820675] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-09 20:34:53,539][820373] Fps is (10 sec: 10239.9, 60 sec: 9557.3, 300 sec: 8713.3). Total num frames: 958464. Throughput: 0: 9681.2. Samples: 935432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:34:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:56,204][820675] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-09 20:34:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 8726.3). Total num frames: 1003520. Throughput: 0: 9598.6. Samples: 991296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:34:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:34:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001960_1003520.pth... [2023-03-09 20:34:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001392_712704.pth [2023-03-09 20:35:00,752][820675] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-09 20:35:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 8738.1). Total num frames: 1048576. Throughput: 0: 9551.6. Samples: 1045220. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:35:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:05,248][820675] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-09 20:35:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 8749.1). Total num frames: 1093632. Throughput: 0: 9547.2. Samples: 1072760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:35:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:09,806][820675] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-09 20:35:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 8759.1). Total num frames: 1138688. Throughput: 0: 9474.0. Samples: 1127200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:35:13,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:35:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002224_1138688.pth... [2023-03-09 20:35:13,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001680_860160.pth [2023-03-09 20:35:14,199][820675] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-09 20:35:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 8768.5). Total num frames: 1183744. Throughput: 0: 9388.3. Samples: 1181616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:35:18,539][820373] Avg episode reward: [(0, '0.209')] [2023-03-09 20:35:18,540][820631] Saving new best policy, reward=0.209! [2023-03-09 20:35:18,752][820675] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-09 20:35:23,102][820675] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-09 20:35:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 8777.1). Total num frames: 1228800. Throughput: 0: 9362.1. Samples: 1209436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:35:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:27,611][820675] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-09 20:35:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8813.5). Total num frames: 1277952. Throughput: 0: 9328.7. Samples: 1265296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:35:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002496_1277952.pth... [2023-03-09 20:35:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000001960_1003520.pth [2023-03-09 20:35:32,105][820675] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-09 20:35:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 8820.1). Total num frames: 1323008. Throughput: 0: 9185.0. Samples: 1318976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:35:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:36,710][820675] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-09 20:35:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 8826.2). Total num frames: 1368064. Throughput: 0: 9138.0. Samples: 1346644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:35:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:41,056][820675] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-09 20:35:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 8857.6). Total num frames: 1417216. Throughput: 0: 9137.2. Samples: 1402468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:35:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002768_1417216.pth... [2023-03-09 20:35:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002224_1138688.pth [2023-03-09 20:35:45,283][820675] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-09 20:35:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 8862.3). Total num frames: 1462272. Throughput: 0: 9230.4. Samples: 1460588. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:35:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:49,557][820675] Updated weights for policy 0, policy_version 2880 (0.0005) [2023-03-09 20:35:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8890.7). Total num frames: 1511424. Throughput: 0: 9256.9. Samples: 1489320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:35:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:53,707][820675] Updated weights for policy 0, policy_version 2960 (0.0004) [2023-03-09 20:35:57,850][820675] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-09 20:35:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 8917.6). Total num frames: 1560576. Throughput: 0: 9359.7. Samples: 1548388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:35:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:35:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003048_1560576.pth... [2023-03-09 20:35:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002496_1277952.pth [2023-03-09 20:36:01,988][820675] Updated weights for policy 0, policy_version 3120 (0.0004) [2023-03-09 20:36:03,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 8942.9). Total num frames: 1609728. Throughput: 0: 9460.7. Samples: 1607348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:36:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:06,176][820675] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-09 20:36:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 8966.9). Total num frames: 1658880. Throughput: 0: 9528.3. Samples: 1638212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:36:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:10,453][820675] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-09 20:36:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8968.1). Total num frames: 1703936. Throughput: 0: 9546.0. Samples: 1694864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:36:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003336_1708032.pth... [2023-03-09 20:36:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000002768_1417216.pth [2023-03-09 20:36:14,930][820675] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-09 20:36:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 8990.2). Total num frames: 1753088. Throughput: 0: 9582.1. Samples: 1750172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:19,267][820675] Updated weights for policy 0, policy_version 3440 (0.0004) [2023-03-09 20:36:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 8970.2). Total num frames: 1794048. Throughput: 0: 9564.4. Samples: 1777040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:24,065][820675] Updated weights for policy 0, policy_version 3520 (0.0006) [2023-03-09 20:36:28,539][820373] Fps is (10 sec: 8601.5, 60 sec: 9352.5, 300 sec: 8971.2). Total num frames: 1839104. Throughput: 0: 9510.4. Samples: 1830436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:28,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003600_1843200.pth... [2023-03-09 20:36:28,574][820675] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-09 20:36:28,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003048_1560576.pth [2023-03-09 20:36:33,050][820675] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-09 20:36:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8991.7). Total num frames: 1888256. Throughput: 0: 9414.1. Samples: 1884224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:37,500][820675] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-09 20:36:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 8992.1). Total num frames: 1933312. Throughput: 0: 9410.2. Samples: 1912780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:41,964][820675] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-09 20:36:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 8992.6). Total num frames: 1978368. Throughput: 0: 9298.1. Samples: 1966804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003864_1978368.pth... [2023-03-09 20:36:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003336_1708032.pth [2023-03-09 20:36:46,179][820675] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-09 20:36:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9011.2). Total num frames: 2027520. Throughput: 0: 9279.8. Samples: 2024940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:50,358][820675] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-09 20:36:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9029.0). Total num frames: 2076672. Throughput: 0: 9274.7. Samples: 2055572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:54,834][820675] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-09 20:36:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9028.6). Total num frames: 2121728. Throughput: 0: 9211.6. Samples: 2109388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:36:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:36:58,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004144_2121728.pth... [2023-03-09 20:36:58,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003600_1843200.pth [2023-03-09 20:36:59,479][820675] Updated weights for policy 0, policy_version 4160 (0.0006) [2023-03-09 20:37:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9028.3). Total num frames: 2166784. Throughput: 0: 9168.6. Samples: 2162760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:37:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:03,716][820675] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-09 20:37:08,165][820675] Updated weights for policy 0, policy_version 4320 (0.0004) [2023-03-09 20:37:08,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9216.0, 300 sec: 9027.9). Total num frames: 2211840. Throughput: 0: 9218.9. Samples: 2191888. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:37:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:12,844][820675] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-09 20:37:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9027.6). Total num frames: 2256896. Throughput: 0: 9217.6. Samples: 2245228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:37:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004408_2256896.pth... [2023-03-09 20:37:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000003864_1978368.pth [2023-03-09 20:37:17,554][820675] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-09 20:37:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9027.3). Total num frames: 2301952. Throughput: 0: 9193.4. Samples: 2297928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:37:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:22,391][820675] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-09 20:37:23,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 2342912. Throughput: 0: 9153.1. Samples: 2324668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:37:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:27,002][820675] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-09 20:37:28,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9147.8, 300 sec: 9011.2). Total num frames: 2387968. Throughput: 0: 9089.3. Samples: 2375824. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:37:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004664_2387968.pth... [2023-03-09 20:37:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004144_2121728.pth [2023-03-09 20:37:31,643][820675] Updated weights for policy 0, policy_version 4720 (0.0004) [2023-03-09 20:37:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 2433024. Throughput: 0: 9017.8. Samples: 2430740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:37:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:35,802][820675] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-09 20:37:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 2478080. Throughput: 0: 8998.1. Samples: 2460488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:37:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:40,282][820675] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-09 20:37:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9025.8). Total num frames: 2527232. Throughput: 0: 9010.9. Samples: 2514880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:37:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004936_2527232.pth... [2023-03-09 20:37:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004408_2256896.pth [2023-03-09 20:37:44,840][820675] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-09 20:37:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 2568192. Throughput: 0: 9009.4. Samples: 2568180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:37:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:49,422][820675] Updated weights for policy 0, policy_version 5040 (0.0004) [2023-03-09 20:37:53,539][820373] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 2613248. Throughput: 0: 8959.0. Samples: 2595044. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:37:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:53,992][820675] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-09 20:37:58,525][820675] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-09 20:37:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 2662400. Throughput: 0: 8976.5. Samples: 2649172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:37:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:37:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005200_2662400.pth... [2023-03-09 20:37:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004664_2387968.pth [2023-03-09 20:38:02,882][820675] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-09 20:38:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 2707456. Throughput: 0: 9044.8. Samples: 2704944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:07,372][820675] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-09 20:38:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9302.8). Total num frames: 2752512. Throughput: 0: 9051.9. Samples: 2732004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:11,669][820675] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-09 20:38:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 2801664. Throughput: 0: 9190.5. Samples: 2789396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005472_2801664.pth... [2023-03-09 20:38:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000004936_2527232.pth [2023-03-09 20:38:16,053][820675] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-09 20:38:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9302.8). Total num frames: 2846720. Throughput: 0: 9163.9. Samples: 2843116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:20,345][820675] Updated weights for policy 0, policy_version 5600 (0.0006) [2023-03-09 20:38:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 2895872. Throughput: 0: 9215.8. Samples: 2875200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:24,864][820675] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-09 20:38:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 2940928. Throughput: 0: 9212.4. Samples: 2929436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005744_2940928.pth... [2023-03-09 20:38:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005200_2662400.pth [2023-03-09 20:38:29,225][820675] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-09 20:38:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 2985984. Throughput: 0: 9258.3. Samples: 2984804. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:38:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:33,712][820675] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-09 20:38:37,948][820675] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-09 20:38:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 3035136. Throughput: 0: 9272.9. Samples: 3012324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:42,564][820675] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-09 20:38:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 3080192. Throughput: 0: 9304.1. Samples: 3067856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006016_3080192.pth... [2023-03-09 20:38:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005472_2801664.pth [2023-03-09 20:38:47,147][820675] Updated weights for policy 0, policy_version 6080 (0.0004) [2023-03-09 20:38:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 3125248. Throughput: 0: 9250.7. Samples: 3121224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:38:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:51,583][820675] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-09 20:38:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 3170304. Throughput: 0: 9284.9. Samples: 3149824. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:38:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:38:55,818][820675] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-09 20:38:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 3215360. Throughput: 0: 9250.7. Samples: 3205680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:38:58,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 20:38:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006280_3215360.pth... [2023-03-09 20:38:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000005744_2940928.pth [2023-03-09 20:39:00,542][820675] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-09 20:39:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 3260416. Throughput: 0: 9241.9. Samples: 3259000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:39:03,539][820373] Avg episode reward: [(0, '8.560')] [2023-03-09 20:39:03,540][820631] Saving new best policy, reward=8.560! [2023-03-09 20:39:05,118][820675] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-09 20:39:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 3305472. Throughput: 0: 9107.9. Samples: 3285056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:09,415][820675] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-09 20:39:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 3354624. Throughput: 0: 9177.0. Samples: 3342400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006552_3354624.pth... [2023-03-09 20:39:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006016_3080192.pth [2023-03-09 20:39:13,809][820675] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-09 20:39:17,986][820675] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-09 20:39:18,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 3403776. Throughput: 0: 9227.4. Samples: 3400036. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:39:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:22,295][820675] Updated weights for policy 0, policy_version 6720 (0.0004) [2023-03-09 20:39:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 3448832. Throughput: 0: 9252.1. Samples: 3428668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:26,497][820675] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-09 20:39:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 3497984. Throughput: 0: 9330.0. Samples: 3487708. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:39:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:28,580][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006840_3502080.pth... [2023-03-09 20:39:28,581][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006280_3215360.pth [2023-03-09 20:39:30,703][820675] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-09 20:39:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 3547136. Throughput: 0: 9412.4. Samples: 3544784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:35,148][820675] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-09 20:39:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 3592192. Throughput: 0: 9380.9. Samples: 3571964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:39,675][820675] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-09 20:39:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 3637248. Throughput: 0: 9362.2. Samples: 3626980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007104_3637248.pth... [2023-03-09 20:39:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006552_3354624.pth [2023-03-09 20:39:43,931][820675] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-09 20:39:48,358][820675] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-09 20:39:48,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 3686400. Throughput: 0: 9442.8. Samples: 3683928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:39:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:52,776][820675] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-09 20:39:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 3731456. Throughput: 0: 9466.5. Samples: 3711048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:57,235][820675] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-09 20:39:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 3780608. Throughput: 0: 9446.0. Samples: 3767472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:39:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:39:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007384_3780608.pth... [2023-03-09 20:39:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000006840_3502080.pth [2023-03-09 20:40:01,642][820675] Updated weights for policy 0, policy_version 7440 (0.0004) [2023-03-09 20:40:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 3825664. Throughput: 0: 9369.0. Samples: 3821640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:06,250][820675] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-09 20:40:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 3870720. Throughput: 0: 9342.8. Samples: 3849092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:10,692][820675] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-09 20:40:13,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 3915776. Throughput: 0: 9238.4. Samples: 3903436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007648_3915776.pth... [2023-03-09 20:40:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007104_3637248.pth [2023-03-09 20:40:15,209][820675] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-09 20:40:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 3960832. Throughput: 0: 9201.8. Samples: 3958864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:19,526][820675] Updated weights for policy 0, policy_version 7760 (0.0004) [2023-03-09 20:40:23,539][820373] Fps is (10 sec: 9421.1, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 4009984. Throughput: 0: 9277.5. Samples: 3989452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:23,612][820675] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-09 20:40:28,095][820675] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-09 20:40:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 4055040. Throughput: 0: 9322.8. Samples: 4046508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:28,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007928_4059136.pth... [2023-03-09 20:40:28,574][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007384_3780608.pth [2023-03-09 20:40:32,523][820675] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-09 20:40:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 4104192. Throughput: 0: 9256.5. Samples: 4100468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:36,931][820675] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-09 20:40:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 4149248. Throughput: 0: 9282.8. Samples: 4128776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:41,309][820675] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-09 20:40:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 4198400. Throughput: 0: 9285.1. Samples: 4185300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008200_4198400.pth... [2023-03-09 20:40:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007648_3915776.pth [2023-03-09 20:40:45,640][820675] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-09 20:40:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 4243456. Throughput: 0: 9312.1. Samples: 4240684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:40:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:49,923][820675] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-09 20:40:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 4292608. Throughput: 0: 9354.0. Samples: 4270024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:40:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:54,272][820675] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-09 20:40:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 4337664. Throughput: 0: 9377.9. Samples: 4325440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:40:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:40:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008472_4337664.pth... [2023-03-09 20:40:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000007928_4059136.pth [2023-03-09 20:40:58,804][820675] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-09 20:41:03,295][820675] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-09 20:41:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 4382720. Throughput: 0: 9347.1. Samples: 4379484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:07,640][820675] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-09 20:41:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 4431872. Throughput: 0: 9316.2. Samples: 4408680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:41:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:11,886][820675] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-09 20:41:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9233.4). Total num frames: 4476928. Throughput: 0: 9326.6. Samples: 4466204. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:41:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008744_4476928.pth... [2023-03-09 20:41:13,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008200_4198400.pth [2023-03-09 20:41:16,124][820675] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-09 20:41:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 4526080. Throughput: 0: 9395.0. Samples: 4523244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:41:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:20,666][820675] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-09 20:41:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 4571136. Throughput: 0: 9374.3. Samples: 4550620. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:41:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:25,322][820675] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-09 20:41:28,539][820373] Fps is (10 sec: 8601.5, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 4612096. Throughput: 0: 9298.1. Samples: 4603716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:41:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:28,580][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009016_4616192.pth... [2023-03-09 20:41:28,583][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008472_4337664.pth [2023-03-09 20:41:29,960][820675] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-09 20:41:33,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 4657152. Throughput: 0: 9227.8. Samples: 4655936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:34,590][820675] Updated weights for policy 0, policy_version 9120 (0.0006) [2023-03-09 20:41:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 4702208. Throughput: 0: 9183.6. Samples: 4683284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:39,087][820675] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-09 20:41:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 4747264. Throughput: 0: 9128.4. Samples: 4736220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009272_4747264.pth... [2023-03-09 20:41:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000008744_4476928.pth [2023-03-09 20:41:43,847][820675] Updated weights for policy 0, policy_version 9280 (0.0004) [2023-03-09 20:41:48,075][820675] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-09 20:41:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 4796416. Throughput: 0: 9174.3. Samples: 4792328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:52,546][820675] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-09 20:41:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 4841472. Throughput: 0: 9128.0. Samples: 4819440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:41:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:56,954][820675] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-09 20:41:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 4890624. Throughput: 0: 9085.0. Samples: 4875028. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:41:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:41:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009552_4890624.pth... [2023-03-09 20:41:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009016_4616192.pth [2023-03-09 20:42:01,248][820675] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-09 20:42:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 4931584. Throughput: 0: 9074.4. Samples: 4931592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:42:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:05,746][820675] Updated weights for policy 0, policy_version 9680 (0.0004) [2023-03-09 20:42:08,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 4980736. Throughput: 0: 9087.3. Samples: 4959548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:42:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:10,231][820675] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-09 20:42:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 5025792. Throughput: 0: 9115.5. Samples: 5013916. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:42:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009816_5025792.pth... [2023-03-09 20:42:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009272_4747264.pth [2023-03-09 20:42:14,563][820675] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-09 20:42:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 5074944. Throughput: 0: 9221.7. Samples: 5070912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:42:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:18,990][820675] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-09 20:42:23,416][820675] Updated weights for policy 0, policy_version 10000 (0.0006) [2023-03-09 20:42:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 5120000. Throughput: 0: 9222.3. Samples: 5098288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:42:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:27,684][820675] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-09 20:42:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 5169152. Throughput: 0: 9295.6. Samples: 5154520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:42:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010096_5169152.pth... [2023-03-09 20:42:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009552_4890624.pth [2023-03-09 20:42:32,006][820675] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-09 20:42:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 5214208. Throughput: 0: 9366.4. Samples: 5213816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:42:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:36,070][820675] Updated weights for policy 0, policy_version 10240 (0.0005) [2023-03-09 20:42:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 5263360. Throughput: 0: 9410.1. Samples: 5242892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:42:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:40,248][820675] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-09 20:42:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 5312512. Throughput: 0: 9496.0. Samples: 5302348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:42:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010376_5312512.pth... [2023-03-09 20:42:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000009816_5025792.pth [2023-03-09 20:42:44,666][820675] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-09 20:42:48,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 5361664. Throughput: 0: 9467.7. Samples: 5357640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:42:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:48,905][820675] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-09 20:42:53,482][820675] Updated weights for policy 0, policy_version 10560 (0.0004) [2023-03-09 20:42:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 5406720. Throughput: 0: 9453.2. Samples: 5384944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:42:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:57,668][820675] Updated weights for policy 0, policy_version 10640 (0.0004) [2023-03-09 20:42:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 5455872. Throughput: 0: 9542.5. Samples: 5443328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:42:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:42:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010656_5455872.pth... [2023-03-09 20:42:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010096_5169152.pth [2023-03-09 20:43:01,969][820675] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-09 20:43:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 5500928. Throughput: 0: 9513.2. Samples: 5499004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:43:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:06,390][820675] Updated weights for policy 0, policy_version 10800 (0.0004) [2023-03-09 20:43:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 5545984. Throughput: 0: 9523.0. Samples: 5526820. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:43:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:10,856][820675] Updated weights for policy 0, policy_version 10880 (0.0004) [2023-03-09 20:43:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 5591040. Throughput: 0: 9505.2. Samples: 5582256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:43:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010920_5591040.pth... [2023-03-09 20:43:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010376_5312512.pth [2023-03-09 20:43:15,710][820675] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-09 20:43:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 5636096. Throughput: 0: 9342.7. Samples: 5634240. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:43:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:20,114][820675] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-09 20:43:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 5681152. Throughput: 0: 9280.9. Samples: 5660532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:43:23,539][820373] Avg episode reward: [(0, '6.984')] [2023-03-09 20:43:24,602][820675] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-09 20:43:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 5726208. Throughput: 0: 9203.5. Samples: 5716504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:43:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011184_5726208.pth... [2023-03-09 20:43:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010656_5455872.pth [2023-03-09 20:43:29,080][820675] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-09 20:43:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 5771264. Throughput: 0: 9157.0. Samples: 5769704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:43:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:33,749][820675] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-09 20:43:38,127][820675] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-09 20:43:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 5820416. Throughput: 0: 9132.6. Samples: 5795912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:43:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:42,459][820675] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-09 20:43:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 5865472. Throughput: 0: 9109.3. Samples: 5853248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:43:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011456_5865472.pth... [2023-03-09 20:43:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000010920_5591040.pth [2023-03-09 20:43:47,116][820675] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-09 20:43:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 5910528. Throughput: 0: 9081.2. Samples: 5907656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:43:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:51,625][820675] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-09 20:43:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 5955584. Throughput: 0: 9067.8. Samples: 5934872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:43:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:55,983][820675] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-09 20:43:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9288.9). Total num frames: 6000640. Throughput: 0: 9070.8. Samples: 5990440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:43:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:43:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011720_6000640.pth... [2023-03-09 20:43:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011184_5726208.pth [2023-03-09 20:44:00,405][820675] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-09 20:44:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 6049792. Throughput: 0: 9143.7. Samples: 6045704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:44:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:04,779][820675] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-09 20:44:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 6094848. Throughput: 0: 9204.0. Samples: 6074712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:44:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:09,026][820675] Updated weights for policy 0, policy_version 11920 (0.0004) [2023-03-09 20:44:13,432][820675] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-09 20:44:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 6144000. Throughput: 0: 9228.2. Samples: 6131776. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:44:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012000_6144000.pth... [2023-03-09 20:44:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011456_5865472.pth [2023-03-09 20:44:17,759][820675] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-09 20:44:18,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 6189056. Throughput: 0: 9304.8. Samples: 6188420. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:44:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:22,405][820675] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-09 20:44:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 6234112. Throughput: 0: 9282.0. Samples: 6213600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:44:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:26,817][820675] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-09 20:44:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 6279168. Throughput: 0: 9246.7. Samples: 6269348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:44:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:28,591][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012272_6283264.pth... [2023-03-09 20:44:28,593][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000011720_6000640.pth [2023-03-09 20:44:31,182][820675] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-09 20:44:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6328320. Throughput: 0: 9280.4. Samples: 6325272. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:44:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:35,465][820675] Updated weights for policy 0, policy_version 12400 (0.0004) [2023-03-09 20:44:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 6373376. Throughput: 0: 9306.0. Samples: 6353640. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:44:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:39,969][820675] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-09 20:44:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 6418432. Throughput: 0: 9303.9. Samples: 6409116. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:44:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012536_6418432.pth... [2023-03-09 20:44:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012000_6144000.pth [2023-03-09 20:44:44,582][820675] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-09 20:44:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6467584. Throughput: 0: 9283.9. Samples: 6463480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:44:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:48,931][820675] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-09 20:44:53,279][820675] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-09 20:44:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 6512640. Throughput: 0: 9235.2. Samples: 6490296. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:44:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:57,895][820675] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-09 20:44:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 6557696. Throughput: 0: 9199.7. Samples: 6545760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:44:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:44:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012808_6557696.pth... [2023-03-09 20:44:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012272_6283264.pth [2023-03-09 20:45:02,297][820675] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-09 20:45:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 6602752. Throughput: 0: 9181.2. Samples: 6601576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:06,828][820675] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-09 20:45:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6651904. Throughput: 0: 9225.1. Samples: 6628728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:11,134][820675] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-09 20:45:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 6696960. Throughput: 0: 9231.6. Samples: 6684772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013080_6696960.pth... [2023-03-09 20:45:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012536_6418432.pth [2023-03-09 20:45:15,467][820675] Updated weights for policy 0, policy_version 13120 (0.0005) [2023-03-09 20:45:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 6742016. Throughput: 0: 9260.3. Samples: 6741984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:45:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:19,788][820675] Updated weights for policy 0, policy_version 13200 (0.0005) [2023-03-09 20:45:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6791168. Throughput: 0: 9271.1. Samples: 6770840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:45:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:23,961][820675] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-09 20:45:28,337][820675] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-09 20:45:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 6840320. Throughput: 0: 9323.7. Samples: 6828684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013360_6840320.pth... [2023-03-09 20:45:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000012808_6557696.pth [2023-03-09 20:45:32,845][820675] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-09 20:45:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6885376. Throughput: 0: 9335.5. Samples: 6883576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:37,198][820675] Updated weights for policy 0, policy_version 13520 (0.0004) [2023-03-09 20:45:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 6930432. Throughput: 0: 9362.1. Samples: 6911592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:41,592][820675] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-09 20:45:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 6979584. Throughput: 0: 9368.9. Samples: 6967360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:45:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013632_6979584.pth... [2023-03-09 20:45:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013080_6696960.pth [2023-03-09 20:45:46,001][820675] Updated weights for policy 0, policy_version 13680 (0.0004) [2023-03-09 20:45:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 7028736. Throughput: 0: 9398.6. Samples: 7024512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:45:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:50,392][820675] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-09 20:45:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 7073792. Throughput: 0: 9400.3. Samples: 7051740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:45:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:54,541][820675] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-09 20:45:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 7118848. Throughput: 0: 9428.5. Samples: 7109056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:45:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:45:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013904_7118848.pth... [2023-03-09 20:45:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013360_6840320.pth [2023-03-09 20:45:59,169][820675] Updated weights for policy 0, policy_version 13920 (0.0004) [2023-03-09 20:46:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9261.1). Total num frames: 7163904. Throughput: 0: 9373.9. Samples: 7163808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:03,565][820675] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-09 20:46:07,727][820675] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-09 20:46:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 7213056. Throughput: 0: 9371.5. Samples: 7192560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:12,399][820675] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-09 20:46:13,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 7258112. Throughput: 0: 9297.1. Samples: 7247052. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:46:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014176_7258112.pth... [2023-03-09 20:46:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013632_6979584.pth [2023-03-09 20:46:16,854][820675] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-09 20:46:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 7303168. Throughput: 0: 9313.5. Samples: 7302684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:46:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:21,381][820675] Updated weights for policy 0, policy_version 14320 (0.0006) [2023-03-09 20:46:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 7348224. Throughput: 0: 9284.1. Samples: 7329376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:46:23,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 20:46:25,574][820675] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-09 20:46:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 7401472. Throughput: 0: 9348.5. Samples: 7388044. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:46:28,540][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 20:46:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014456_7401472.pth... [2023-03-09 20:46:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000013904_7118848.pth [2023-03-09 20:46:29,826][820675] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-09 20:46:33,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 7450624. Throughput: 0: 9379.7. Samples: 7446600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:33,540][820373] Avg episode reward: [(0, '0.053')] [2023-03-09 20:46:33,887][820675] Updated weights for policy 0, policy_version 14560 (0.0004) [2023-03-09 20:46:38,282][820675] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-09 20:46:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 7495680. Throughput: 0: 9409.7. Samples: 7475176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:42,776][820675] Updated weights for policy 0, policy_version 14720 (0.0004) [2023-03-09 20:46:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 7540736. Throughput: 0: 9331.0. Samples: 7528952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:43,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:46:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014728_7540736.pth... [2023-03-09 20:46:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014176_7258112.pth [2023-03-09 20:46:47,347][820675] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-09 20:46:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 7585792. Throughput: 0: 9340.8. Samples: 7584144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:46:48,540][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 20:46:51,774][820675] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-09 20:46:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 7634944. Throughput: 0: 9316.9. Samples: 7611820. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:46:53,539][820373] Avg episode reward: [(0, '0.165')] [2023-03-09 20:46:56,480][820675] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-09 20:46:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 7675904. Throughput: 0: 9301.1. Samples: 7665600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:46:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:46:58,571][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015000_7680000.pth... [2023-03-09 20:46:58,573][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014456_7401472.pth [2023-03-09 20:47:00,817][820675] Updated weights for policy 0, policy_version 15040 (0.0006) [2023-03-09 20:47:03,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9284.2, 300 sec: 9288.9). Total num frames: 7720960. Throughput: 0: 9274.9. Samples: 7720056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:47:03,539][820373] Avg episode reward: [(0, '0.133')] [2023-03-09 20:47:05,576][820675] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-09 20:47:08,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 7766016. Throughput: 0: 9250.0. Samples: 7745628. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:47:08,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 20:47:10,187][820675] Updated weights for policy 0, policy_version 15200 (0.0004) [2023-03-09 20:47:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 7811072. Throughput: 0: 9153.0. Samples: 7799928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:47:13,539][820373] Avg episode reward: [(0, '0.139')] [2023-03-09 20:47:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015256_7811072.pth... [2023-03-09 20:47:13,548][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000014728_7540736.pth [2023-03-09 20:47:14,611][820675] Updated weights for policy 0, policy_version 15280 (0.0004) [2023-03-09 20:47:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 7860224. Throughput: 0: 9100.6. Samples: 7856128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:47:18,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 20:47:18,828][820675] Updated weights for policy 0, policy_version 15360 (0.0004) [2023-03-09 20:47:23,389][820675] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-09 20:47:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 7905280. Throughput: 0: 9097.7. Samples: 7884572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:47:23,540][820373] Avg episode reward: [(0, '8.158')] [2023-03-09 20:47:27,665][820675] Updated weights for policy 0, policy_version 15520 (0.0004) [2023-03-09 20:47:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 7950336. Throughput: 0: 9170.7. Samples: 7941632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:47:28,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 20:47:28,565][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015536_7954432.pth... [2023-03-09 20:47:28,567][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015000_7680000.pth [2023-03-09 20:47:32,170][820675] Updated weights for policy 0, policy_version 15600 (0.0004) [2023-03-09 20:47:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 7999488. Throughput: 0: 9140.5. Samples: 7995464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:47:33,539][820373] Avg episode reward: [(0, '0.259')] [2023-03-09 20:47:36,613][820675] Updated weights for policy 0, policy_version 15680 (0.0004) [2023-03-09 20:47:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 8044544. Throughput: 0: 9148.1. Samples: 8023484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:47:38,539][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 20:47:40,820][820675] Updated weights for policy 0, policy_version 15760 (0.0005) [2023-03-09 20:47:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 8093696. Throughput: 0: 9236.9. Samples: 8081260. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:47:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:47:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015808_8093696.pth... [2023-03-09 20:47:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015256_7811072.pth [2023-03-09 20:47:45,248][820675] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-09 20:47:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 8138752. Throughput: 0: 9220.1. Samples: 8134960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:47:48,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:47:49,831][820675] Updated weights for policy 0, policy_version 15920 (0.0004) [2023-03-09 20:47:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 8183808. Throughput: 0: 9249.1. Samples: 8161836. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:47:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:47:54,219][820675] Updated weights for policy 0, policy_version 16000 (0.0004) [2023-03-09 20:47:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 8228864. Throughput: 0: 9279.8. Samples: 8217520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:47:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:47:58,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016072_8228864.pth... [2023-03-09 20:47:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015536_7954432.pth [2023-03-09 20:47:58,633][820675] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-09 20:48:02,930][820675] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-09 20:48:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 8278016. Throughput: 0: 9306.0. Samples: 8274896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:48:03,539][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 20:48:07,336][820675] Updated weights for policy 0, policy_version 16240 (0.0004) [2023-03-09 20:48:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 8323072. Throughput: 0: 9311.6. Samples: 8303592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:48:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:11,431][820675] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-09 20:48:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 8372224. Throughput: 0: 9331.8. Samples: 8361564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:13,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 20:48:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016352_8372224.pth... [2023-03-09 20:48:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000015808_8093696.pth [2023-03-09 20:48:15,898][820675] Updated weights for policy 0, policy_version 16400 (0.0004) [2023-03-09 20:48:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 8421376. Throughput: 0: 9375.1. Samples: 8417344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 20:48:20,204][820675] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-09 20:48:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 8470528. Throughput: 0: 9387.8. Samples: 8445936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:23,539][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 20:48:24,273][820675] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-09 20:48:28,285][820675] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-09 20:48:28,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 8519680. Throughput: 0: 9451.6. Samples: 8506580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016640_8519680.pth... [2023-03-09 20:48:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016072_8228864.pth [2023-03-09 20:48:32,609][820675] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-09 20:48:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 8568832. Throughput: 0: 9552.0. Samples: 8564800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:36,975][820675] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-09 20:48:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 8613888. Throughput: 0: 9587.2. Samples: 8593260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:38,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:48:41,546][820675] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-09 20:48:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 8663040. Throughput: 0: 9562.6. Samples: 8647840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016920_8663040.pth... [2023-03-09 20:48:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016352_8372224.pth [2023-03-09 20:48:45,705][820675] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-09 20:48:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 8708096. Throughput: 0: 9566.6. Samples: 8705392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:50,045][820675] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-09 20:48:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 8757248. Throughput: 0: 9592.8. Samples: 8735268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:54,420][820675] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-09 20:48:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9557.3, 300 sec: 9330.5). Total num frames: 8802304. Throughput: 0: 9519.3. Samples: 8789932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:48:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:48:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017192_8802304.pth... [2023-03-09 20:48:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016640_8519680.pth [2023-03-09 20:48:58,996][820675] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-09 20:49:03,443][820675] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-09 20:49:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 8847360. Throughput: 0: 9471.4. Samples: 8843556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:07,809][820675] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-09 20:49:08,539][820373] Fps is (10 sec: 9011.5, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 8892416. Throughput: 0: 9466.9. Samples: 8871944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:08,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 20:49:12,222][820675] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-09 20:49:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 8941568. Throughput: 0: 9370.2. Samples: 8928240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:13,540][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 20:49:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017464_8941568.pth... [2023-03-09 20:49:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000016920_8663040.pth [2023-03-09 20:49:16,608][820675] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-09 20:49:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 8986624. Throughput: 0: 9346.6. Samples: 8985396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:21,096][820675] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-09 20:49:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 9031680. Throughput: 0: 9287.0. Samples: 9011176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:49:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:25,414][820675] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-09 20:49:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 9080832. Throughput: 0: 9344.3. Samples: 9068336. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:49:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017736_9080832.pth... [2023-03-09 20:49:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017192_8802304.pth [2023-03-09 20:49:29,688][820675] Updated weights for policy 0, policy_version 17760 (0.0004) [2023-03-09 20:49:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 9129984. Throughput: 0: 9344.6. Samples: 9125900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:49:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:33,922][820675] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-09 20:49:38,266][820675] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-09 20:49:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 9175040. Throughput: 0: 9314.4. Samples: 9154416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:49:38,540][820373] Avg episode reward: [(0, '0.071')] [2023-03-09 20:49:42,632][820675] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-09 20:49:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 9220096. Throughput: 0: 9340.3. Samples: 9210244. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:49:43,539][820373] Avg episode reward: [(0, '4.676')] [2023-03-09 20:49:43,547][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018016_9224192.pth... [2023-03-09 20:49:43,548][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017464_8941568.pth [2023-03-09 20:49:46,934][820675] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-09 20:49:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 9269248. Throughput: 0: 9441.0. Samples: 9268400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:51,313][820675] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-09 20:49:53,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 9318400. Throughput: 0: 9423.7. Samples: 9296012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:55,603][820675] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-09 20:49:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 9367552. Throughput: 0: 9485.2. Samples: 9355072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:49:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:49:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018296_9367552.pth... [2023-03-09 20:49:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000017736_9080832.pth [2023-03-09 20:49:59,820][820675] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-09 20:50:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 9412608. Throughput: 0: 9430.7. Samples: 9409776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:50:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:04,231][820675] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-09 20:50:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 9457664. Throughput: 0: 9468.3. Samples: 9437248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:50:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:08,706][820675] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-09 20:50:13,237][820675] Updated weights for policy 0, policy_version 18560 (0.0005) [2023-03-09 20:50:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 9502720. Throughput: 0: 9438.5. Samples: 9493068. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:50:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018560_9502720.pth... [2023-03-09 20:50:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018016_9224192.pth [2023-03-09 20:50:17,654][820675] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-09 20:50:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 9551872. Throughput: 0: 9374.9. Samples: 9547768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:50:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:22,159][820675] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-09 20:50:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 9592832. Throughput: 0: 9336.4. Samples: 9574552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:50:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:26,696][820675] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-09 20:50:28,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 9641984. Throughput: 0: 9317.4. Samples: 9629528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:50:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018832_9641984.pth... [2023-03-09 20:50:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018296_9367552.pth [2023-03-09 20:50:31,154][820675] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-09 20:50:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 9687040. Throughput: 0: 9213.5. Samples: 9683008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:50:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:35,620][820675] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-09 20:50:38,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 9732096. Throughput: 0: 9235.9. Samples: 9711624. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:50:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:39,933][820675] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-09 20:50:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 9781248. Throughput: 0: 9197.5. Samples: 9768960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:50:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019104_9781248.pth... [2023-03-09 20:50:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018560_9502720.pth [2023-03-09 20:50:44,215][820675] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-09 20:50:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 9826304. Throughput: 0: 9246.6. Samples: 9825872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:50:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:48,632][820675] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-09 20:50:52,901][820675] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-09 20:50:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 9875456. Throughput: 0: 9282.6. Samples: 9854964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:50:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:57,371][820675] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-09 20:50:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 9920512. Throughput: 0: 9265.5. Samples: 9910016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:50:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:50:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019376_9920512.pth... [2023-03-09 20:50:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000018832_9641984.pth [2023-03-09 20:51:01,818][820675] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-09 20:51:03,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 9965568. Throughput: 0: 9272.9. Samples: 9965048. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:51:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:51:06,278][820675] Updated weights for policy 0, policy_version 19520 (0.0006) [2023-03-09 20:51:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9344.4). Total num frames: 10014720. Throughput: 0: 9285.9. Samples: 9992420. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:51:08,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:51:10,700][820675] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-09 20:51:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 10059776. Throughput: 0: 9288.0. Samples: 10047488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:51:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019648_10059776.pth... [2023-03-09 20:51:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019104_9781248.pth [2023-03-09 20:51:15,219][820675] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-09 20:51:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 10104832. Throughput: 0: 9313.9. Samples: 10102132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:51:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:19,387][820675] Updated weights for policy 0, policy_version 19760 (0.0004) [2023-03-09 20:51:23,493][820675] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-09 20:51:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 10158080. Throughput: 0: 9373.3. Samples: 10133424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:51:23,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:51:27,833][820675] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-09 20:51:28,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 10203136. Throughput: 0: 9402.8. Samples: 10192088. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:51:28,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:51:28,568][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019936_10207232.pth... [2023-03-09 20:51:28,570][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019376_9920512.pth [2023-03-09 20:51:32,265][820675] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-09 20:51:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 10248192. Throughput: 0: 9378.5. Samples: 10247904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:51:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:36,697][820675] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-09 20:51:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 10297344. Throughput: 0: 9341.7. Samples: 10275340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:51:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:41,048][820675] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-09 20:51:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 10342400. Throughput: 0: 9340.7. Samples: 10330348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:51:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020200_10342400.pth... [2023-03-09 20:51:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019648_10059776.pth [2023-03-09 20:51:45,448][820675] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-09 20:51:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 10391552. Throughput: 0: 9426.0. Samples: 10389216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:51:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:49,592][820675] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-09 20:51:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 10440704. Throughput: 0: 9418.1. Samples: 10416236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:51:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:51:53,891][820675] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-09 20:51:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 10481664. Throughput: 0: 9457.3. Samples: 10473064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:51:58,539][820373] Avg episode reward: [(0, '0.916')] [2023-03-09 20:51:58,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020480_10485760.pth... [2023-03-09 20:51:58,554][820675] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-09 20:51:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000019936_10207232.pth [2023-03-09 20:52:02,829][820675] Updated weights for policy 0, policy_version 20560 (0.0004) [2023-03-09 20:52:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 10530816. Throughput: 0: 9488.6. Samples: 10529120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:52:07,059][820675] Updated weights for policy 0, policy_version 20640 (0.0004) [2023-03-09 20:52:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 10579968. Throughput: 0: 9454.4. Samples: 10558872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:08,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:52:11,589][820675] Updated weights for policy 0, policy_version 20720 (0.0004) [2023-03-09 20:52:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 10625024. Throughput: 0: 9349.3. Samples: 10612808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:13,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:52:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020752_10625024.pth... [2023-03-09 20:52:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020200_10342400.pth [2023-03-09 20:52:15,933][820675] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-09 20:52:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9386.1). Total num frames: 10674176. Throughput: 0: 9383.1. Samples: 10670144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:52:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:52:20,255][820675] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-09 20:52:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 10719232. Throughput: 0: 9410.6. Samples: 10698816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:52:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:52:24,622][820675] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-09 20:52:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 10764288. Throughput: 0: 9437.8. Samples: 10755048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:52:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:52:28,613][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021032_10768384.pth... [2023-03-09 20:52:28,615][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020480_10485760.pth [2023-03-09 20:52:29,052][820675] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-09 20:52:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 10809344. Throughput: 0: 9337.6. Samples: 10809408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:52:33,539][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 20:52:33,563][820675] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-09 20:52:37,988][820675] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-09 20:52:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9372.2). Total num frames: 10858496. Throughput: 0: 9372.9. Samples: 10838016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:52:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:52:42,379][820675] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-09 20:52:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 10903552. Throughput: 0: 9305.3. Samples: 10891804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:52:43,539][820373] Avg episode reward: [(0, '0.138')] [2023-03-09 20:52:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021296_10903552.pth... [2023-03-09 20:52:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000020752_10625024.pth [2023-03-09 20:52:46,719][820675] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-09 20:52:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 10948608. Throughput: 0: 9319.7. Samples: 10948504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:48,539][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 20:52:51,102][820675] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-09 20:52:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 10997760. Throughput: 0: 9297.1. Samples: 10977240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 20:52:55,569][820675] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-09 20:52:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 11046912. Throughput: 0: 9317.6. Samples: 11032100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:52:58,540][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 20:52:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021576_11046912.pth... [2023-03-09 20:52:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021032_10768384.pth [2023-03-09 20:52:59,949][820675] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-09 20:53:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 11087872. Throughput: 0: 9282.9. Samples: 11087872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:53:04,497][820675] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-09 20:53:08,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 11132928. Throughput: 0: 9205.3. Samples: 11113052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:08,539][820373] Avg episode reward: [(0, '4.532')] [2023-03-09 20:53:09,073][820675] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-09 20:53:13,458][820675] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-09 20:53:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 11182080. Throughput: 0: 9218.2. Samples: 11169868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:13,540][820373] Avg episode reward: [(0, '5.355')] [2023-03-09 20:53:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021840_11182080.pth... [2023-03-09 20:53:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021296_10903552.pth [2023-03-09 20:53:17,590][820675] Updated weights for policy 0, policy_version 21920 (0.0006) [2023-03-09 20:53:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 11227136. Throughput: 0: 9282.9. Samples: 11227136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:18,539][820373] Avg episode reward: [(0, '0.010')] [2023-03-09 20:53:21,990][820675] Updated weights for policy 0, policy_version 22000 (0.0004) [2023-03-09 20:53:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 11276288. Throughput: 0: 9250.5. Samples: 11254288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:23,539][820373] Avg episode reward: [(0, '0.021')] [2023-03-09 20:53:26,385][820675] Updated weights for policy 0, policy_version 22080 (0.0004) [2023-03-09 20:53:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 11325440. Throughput: 0: 9331.3. Samples: 11311712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:28,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 20:53:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022120_11325440.pth... [2023-03-09 20:53:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021576_11046912.pth [2023-03-09 20:53:30,784][820675] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-09 20:53:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 11370496. Throughput: 0: 9286.6. Samples: 11366400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:53:33,539][820373] Avg episode reward: [(0, '0.069')] [2023-03-09 20:53:35,328][820675] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-09 20:53:38,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 11411456. Throughput: 0: 9251.7. Samples: 11393568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:53:38,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:53:39,871][820675] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-09 20:53:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 11460608. Throughput: 0: 9250.8. Samples: 11448384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 20:53:43,539][820373] Avg episode reward: [(0, '0.071')] [2023-03-09 20:53:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022384_11460608.pth... [2023-03-09 20:53:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000021840_11182080.pth [2023-03-09 20:53:44,296][820675] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-09 20:53:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 11505664. Throughput: 0: 9232.6. Samples: 11503340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:48,539][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 20:53:48,690][820675] Updated weights for policy 0, policy_version 22480 (0.0004) [2023-03-09 20:53:53,173][820675] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-09 20:53:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 11550720. Throughput: 0: 9317.9. Samples: 11532360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:53,539][820373] Avg episode reward: [(0, '0.012')] [2023-03-09 20:53:57,333][820675] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-09 20:53:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 11599872. Throughput: 0: 9310.5. Samples: 11588840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:53:58,539][820373] Avg episode reward: [(0, '0.183')] [2023-03-09 20:53:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022656_11599872.pth... [2023-03-09 20:53:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022120_11325440.pth [2023-03-09 20:54:01,890][820675] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-09 20:54:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 11644928. Throughput: 0: 9283.5. Samples: 11644892. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:54:03,539][820373] Avg episode reward: [(0, '0.053')] [2023-03-09 20:54:06,289][820675] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-09 20:54:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 11694080. Throughput: 0: 9278.3. Samples: 11671812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:54:08,539][820373] Avg episode reward: [(0, '0.067')] [2023-03-09 20:54:10,699][820675] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-09 20:54:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 11739136. Throughput: 0: 9225.1. Samples: 11726840. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 20:54:13,539][820373] Avg episode reward: [(0, '0.229')] [2023-03-09 20:54:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022928_11739136.pth... [2023-03-09 20:54:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022384_11460608.pth [2023-03-09 20:54:15,106][820675] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-09 20:54:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 11784192. Throughput: 0: 9257.3. Samples: 11782976. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:54:18,539][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 20:54:19,546][820675] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-09 20:54:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 11833344. Throughput: 0: 9272.0. Samples: 11810808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:54:23,539][820373] Avg episode reward: [(0, '0.100')] [2023-03-09 20:54:24,026][820675] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-09 20:54:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 11874304. Throughput: 0: 9266.2. Samples: 11865364. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:54:28,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 20:54:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023192_11874304.pth... [2023-03-09 20:54:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022656_11599872.pth [2023-03-09 20:54:28,581][820675] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-09 20:54:33,244][820675] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-09 20:54:33,539][820373] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 11919360. Throughput: 0: 9207.9. Samples: 11917696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:54:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:54:37,541][820675] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-09 20:54:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 11968512. Throughput: 0: 9228.8. Samples: 11947656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:54:38,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:54:41,921][820675] Updated weights for policy 0, policy_version 23440 (0.0004) [2023-03-09 20:54:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 12013568. Throughput: 0: 9195.2. Samples: 12002624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:54:43,539][820373] Avg episode reward: [(0, '0.036')] [2023-03-09 20:54:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023464_12013568.pth... [2023-03-09 20:54:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000022928_11739136.pth [2023-03-09 20:54:46,170][820675] Updated weights for policy 0, policy_version 23520 (0.0004) [2023-03-09 20:54:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12062720. Throughput: 0: 9235.8. Samples: 12060504. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:54:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:54:50,496][820675] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-09 20:54:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 12107776. Throughput: 0: 9260.3. Samples: 12088524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:54:53,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 20:54:55,106][820675] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-09 20:54:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 12152832. Throughput: 0: 9205.8. Samples: 12141100. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:54:58,540][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 20:54:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023736_12152832.pth... [2023-03-09 20:54:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023192_11874304.pth [2023-03-09 20:54:59,675][820675] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-09 20:55:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12201984. Throughput: 0: 9225.7. Samples: 12198132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:55:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:03,816][820675] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-09 20:55:08,238][820675] Updated weights for policy 0, policy_version 23920 (0.0004) [2023-03-09 20:55:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 12247040. Throughput: 0: 9247.0. Samples: 12226924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:55:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:12,662][820675] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-09 20:55:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12296192. Throughput: 0: 9277.8. Samples: 12282864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:55:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024016_12296192.pth... [2023-03-09 20:55:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023464_12013568.pth [2023-03-09 20:55:16,685][820675] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-09 20:55:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 12345344. Throughput: 0: 9417.7. Samples: 12341492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 20:55:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:21,147][820675] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-09 20:55:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 12390400. Throughput: 0: 9382.6. Samples: 12369872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:55:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:25,654][820675] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-09 20:55:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12435456. Throughput: 0: 9377.0. Samples: 12424588. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:55:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024288_12435456.pth... [2023-03-09 20:55:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000023736_12152832.pth [2023-03-09 20:55:30,041][820675] Updated weights for policy 0, policy_version 24320 (0.0004) [2023-03-09 20:55:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 12484608. Throughput: 0: 9335.6. Samples: 12480608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 20:55:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:34,443][820675] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-09 20:55:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12529664. Throughput: 0: 9303.5. Samples: 12507184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:55:38,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 20:55:38,999][820675] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-09 20:55:43,019][820675] Updated weights for policy 0, policy_version 24560 (0.0004) [2023-03-09 20:55:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 12578816. Throughput: 0: 9364.5. Samples: 12562504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:55:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024568_12578816.pth... [2023-03-09 20:55:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024016_12296192.pth [2023-03-09 20:55:47,423][820675] Updated weights for policy 0, policy_version 24640 (0.0004) [2023-03-09 20:55:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12623872. Throughput: 0: 9412.0. Samples: 12621672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:55:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:51,886][820675] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-09 20:55:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12668928. Throughput: 0: 9372.2. Samples: 12648672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:55:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:56,684][820675] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-09 20:55:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12713984. Throughput: 0: 9303.6. Samples: 12701528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:55:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:55:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024832_12713984.pth... [2023-03-09 20:55:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024288_12435456.pth [2023-03-09 20:56:01,088][820675] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-09 20:56:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12759040. Throughput: 0: 9216.5. Samples: 12756236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:05,585][820675] Updated weights for policy 0, policy_version 24960 (0.0004) [2023-03-09 20:56:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12808192. Throughput: 0: 9195.7. Samples: 12783680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:09,759][820675] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-09 20:56:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 12853248. Throughput: 0: 9298.5. Samples: 12843020. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:56:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:13,547][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025112_12857344.pth... [2023-03-09 20:56:13,549][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024568_12578816.pth [2023-03-09 20:56:13,955][820675] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-09 20:56:18,308][820675] Updated weights for policy 0, policy_version 25200 (0.0004) [2023-03-09 20:56:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12902400. Throughput: 0: 9310.9. Samples: 12899596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:56:18,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 20:56:22,747][820675] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-09 20:56:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 12947456. Throughput: 0: 9333.9. Samples: 12927212. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:56:23,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 20:56:27,076][820675] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-09 20:56:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 12996608. Throughput: 0: 9373.7. Samples: 12984320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:28,540][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 20:56:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025384_12996608.pth... [2023-03-09 20:56:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000024832_12713984.pth [2023-03-09 20:56:31,534][820675] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-09 20:56:33,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 13045760. Throughput: 0: 9321.1. Samples: 13041120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:35,604][820675] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-09 20:56:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 13094912. Throughput: 0: 9371.7. Samples: 13070400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:39,452][820675] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-09 20:56:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 13144064. Throughput: 0: 9583.0. Samples: 13132764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:56:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025672_13144064.pth... [2023-03-09 20:56:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025112_12857344.pth [2023-03-09 20:56:43,589][820675] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-09 20:56:48,115][820675] Updated weights for policy 0, policy_version 25760 (0.0004) [2023-03-09 20:56:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 13189120. Throughput: 0: 9616.6. Samples: 13188984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:56:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:56:52,454][820675] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-09 20:56:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 13238272. Throughput: 0: 9621.6. Samples: 13216652. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:56:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:56,878][820675] Updated weights for policy 0, policy_version 25920 (0.0004) [2023-03-09 20:56:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 13283328. Throughput: 0: 9549.6. Samples: 13272752. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:56:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:56:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025944_13283328.pth... [2023-03-09 20:56:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025384_12996608.pth [2023-03-09 20:57:01,487][820675] Updated weights for policy 0, policy_version 26000 (0.0004) [2023-03-09 20:57:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 13328384. Throughput: 0: 9512.5. Samples: 13327660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:57:03,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 20:57:05,916][820675] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-09 20:57:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 13373440. Throughput: 0: 9493.9. Samples: 13354436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:57:08,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 20:57:10,387][820675] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-09 20:57:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 13422592. Throughput: 0: 9466.9. Samples: 13410328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:57:13,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 20:57:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026216_13422592.pth... [2023-03-09 20:57:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025672_13144064.pth [2023-03-09 20:57:14,657][820675] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-09 20:57:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 13467648. Throughput: 0: 9461.9. Samples: 13466908. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 20:57:18,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:57:18,999][820675] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-09 20:57:23,449][820675] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-09 20:57:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 13516800. Throughput: 0: 9446.2. Samples: 13495480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:57:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:57:28,037][820675] Updated weights for policy 0, policy_version 26480 (0.0004) [2023-03-09 20:57:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 13561856. Throughput: 0: 9263.7. Samples: 13549632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:57:28,540][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 20:57:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026488_13561856.pth... [2023-03-09 20:57:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000025944_13283328.pth [2023-03-09 20:57:32,473][820675] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-09 20:57:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 13606912. Throughput: 0: 9206.3. Samples: 13603268. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:57:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:57:36,954][820675] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-09 20:57:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 13651968. Throughput: 0: 9218.5. Samples: 13631484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:57:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:57:41,214][820675] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-09 20:57:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 13701120. Throughput: 0: 9244.4. Samples: 13688752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:57:43,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 20:57:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026760_13701120.pth... [2023-03-09 20:57:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026216_13422592.pth [2023-03-09 20:57:45,693][820675] Updated weights for policy 0, policy_version 26800 (0.0005) [2023-03-09 20:57:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 13746176. Throughput: 0: 9271.3. Samples: 13744868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:57:48,539][820373] Avg episode reward: [(0, '4.367')] [2023-03-09 20:57:50,047][820675] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-09 20:57:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 13795328. Throughput: 0: 9285.8. Samples: 13772296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:57:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:57:54,298][820675] Updated weights for policy 0, policy_version 26960 (0.0005) [2023-03-09 20:57:58,348][820675] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-09 20:57:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 13844480. Throughput: 0: 9376.2. Samples: 13832256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:57:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:57:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027040_13844480.pth... [2023-03-09 20:57:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026488_13561856.pth [2023-03-09 20:58:02,450][820675] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-09 20:58:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 13893632. Throughput: 0: 9420.9. Samples: 13890848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:06,658][820675] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-09 20:58:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 13942784. Throughput: 0: 9440.8. Samples: 13920316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:10,772][820675] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-09 20:58:13,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 13991936. Throughput: 0: 9557.5. Samples: 13979720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027328_13991936.pth... [2023-03-09 20:58:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000026760_13701120.pth [2023-03-09 20:58:14,908][820675] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-09 20:58:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 14041088. Throughput: 0: 9678.9. Samples: 14038816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:19,212][820675] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-09 20:58:23,186][820675] Updated weights for policy 0, policy_version 27520 (0.0006) [2023-03-09 20:58:23,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 14094336. Throughput: 0: 9739.7. Samples: 14069768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:27,431][820675] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-09 20:58:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 14139392. Throughput: 0: 9759.0. Samples: 14127908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027616_14139392.pth... [2023-03-09 20:58:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027040_13844480.pth [2023-03-09 20:58:31,789][820675] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-09 20:58:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 14188544. Throughput: 0: 9769.9. Samples: 14184512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:33,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 20:58:36,106][820675] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-09 20:58:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 14233600. Throughput: 0: 9794.4. Samples: 14213044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:40,382][820675] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-09 20:58:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 14282752. Throughput: 0: 9729.6. Samples: 14270088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:43,539][820373] Avg episode reward: [(0, '0.579')] [2023-03-09 20:58:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027896_14282752.pth... [2023-03-09 20:58:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027328_13991936.pth [2023-03-09 20:58:44,824][820675] Updated weights for policy 0, policy_version 27920 (0.0005) [2023-03-09 20:58:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 14327808. Throughput: 0: 9619.0. Samples: 14323704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:58:48,539][820373] Avg episode reward: [(0, '0.380')] [2023-03-09 20:58:49,379][820675] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-09 20:58:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 14372864. Throughput: 0: 9591.0. Samples: 14351912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:58:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:58:53,836][820675] Updated weights for policy 0, policy_version 28080 (0.0005) [2023-03-09 20:58:58,175][820675] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-09 20:58:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 14417920. Throughput: 0: 9534.2. Samples: 14408760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:58:58,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 20:58:58,561][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028168_14422016.pth... [2023-03-09 20:58:58,563][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027616_14139392.pth [2023-03-09 20:59:02,575][820675] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-09 20:59:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.4, 300 sec: 9400.0). Total num frames: 14467072. Throughput: 0: 9426.1. Samples: 14462988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:59:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:06,797][820675] Updated weights for policy 0, policy_version 28320 (0.0005) [2023-03-09 20:59:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 14516224. Throughput: 0: 9375.3. Samples: 14491656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 20:59:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:10,933][820675] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-09 20:59:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9413.9). Total num frames: 14561280. Throughput: 0: 9405.9. Samples: 14551172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028440_14561280.pth... [2023-03-09 20:59:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000027896_14282752.pth [2023-03-09 20:59:15,321][820675] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-09 20:59:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 14606336. Throughput: 0: 9372.4. Samples: 14606272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:20,019][820675] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-09 20:59:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 14651392. Throughput: 0: 9293.9. Samples: 14631268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:24,363][820675] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-09 20:59:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 14700544. Throughput: 0: 9292.8. Samples: 14688264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028712_14700544.pth... [2023-03-09 20:59:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028168_14422016.pth [2023-03-09 20:59:28,698][820675] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-09 20:59:32,813][820675] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-09 20:59:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 14749696. Throughput: 0: 9440.9. Samples: 14748544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:59:33,539][820373] Avg episode reward: [(0, '3.864')] [2023-03-09 20:59:37,218][820675] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-09 20:59:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 14794752. Throughput: 0: 9435.3. Samples: 14776500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:59:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:41,782][820675] Updated weights for policy 0, policy_version 28960 (0.0005) [2023-03-09 20:59:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 14839808. Throughput: 0: 9379.9. Samples: 14830856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 20:59:43,539][820373] Avg episode reward: [(0, '4.679')] [2023-03-09 20:59:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028984_14839808.pth... [2023-03-09 20:59:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028440_14561280.pth [2023-03-09 20:59:46,188][820675] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-09 20:59:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 14888960. Throughput: 0: 9444.6. Samples: 14887996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:48,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 20:59:50,180][820675] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-09 20:59:53,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 14938112. Throughput: 0: 9466.1. Samples: 14917632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 20:59:54,602][820675] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-09 20:59:58,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9489.0, 300 sec: 9441.6). Total num frames: 14987264. Throughput: 0: 9417.9. Samples: 14974976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 20:59:58,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 20:59:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029272_14987264.pth... [2023-03-09 20:59:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028712_14700544.pth [2023-03-09 20:59:58,835][820675] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-09 21:00:03,242][820675] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-09 21:00:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 15032320. Throughput: 0: 9439.2. Samples: 15031036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:00:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:07,618][820675] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-09 21:00:08,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 15077376. Throughput: 0: 9513.1. Samples: 15059356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:00:08,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:00:12,148][820675] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-09 21:00:13,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 15126528. Throughput: 0: 9464.8. Samples: 15114180. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:00:13,550][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:00:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029544_15126528.pth... [2023-03-09 21:00:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000028984_14839808.pth [2023-03-09 21:00:16,450][820675] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-09 21:00:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 15171584. Throughput: 0: 9384.0. Samples: 15170824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:00:18,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:00:20,818][820675] Updated weights for policy 0, policy_version 29680 (0.0004) [2023-03-09 21:00:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 15216640. Throughput: 0: 9384.6. Samples: 15198808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:00:23,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:00:25,467][820675] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-09 21:00:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 15261696. Throughput: 0: 9338.7. Samples: 15251100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:00:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029808_15261696.pth... [2023-03-09 21:00:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029272_14987264.pth [2023-03-09 21:00:30,088][820675] Updated weights for policy 0, policy_version 29840 (0.0004) [2023-03-09 21:00:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 15310848. Throughput: 0: 9328.1. Samples: 15307760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:00:33,539][820373] Avg episode reward: [(0, '0.043')] [2023-03-09 21:00:34,155][820675] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-09 21:00:38,391][820675] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-09 21:00:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 15360000. Throughput: 0: 9308.1. Samples: 15336496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:00:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:42,979][820675] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-09 21:00:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 15405056. Throughput: 0: 9285.9. Samples: 15392840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:00:43,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:00:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030088_15405056.pth... [2023-03-09 21:00:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029544_15126528.pth [2023-03-09 21:00:47,258][820675] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-09 21:00:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 15454208. Throughput: 0: 9287.2. Samples: 15448960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:00:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:51,668][820675] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-09 21:00:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 15499264. Throughput: 0: 9302.2. Samples: 15477956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:00:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:55,822][820675] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-09 21:00:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 15548416. Throughput: 0: 9378.1. Samples: 15536192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:00:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:00:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030368_15548416.pth... [2023-03-09 21:00:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000029808_15261696.pth [2023-03-09 21:01:00,082][820675] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-09 21:01:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 15593472. Throughput: 0: 9390.5. Samples: 15593396. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:01:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:04,494][820675] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-09 21:01:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 15638528. Throughput: 0: 9368.1. Samples: 15620372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:09,003][820675] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-09 21:01:13,451][820675] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-09 21:01:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 15687680. Throughput: 0: 9427.3. Samples: 15675328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030640_15687680.pth... [2023-03-09 21:01:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030088_15405056.pth [2023-03-09 21:01:17,863][820675] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-09 21:01:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 15732736. Throughput: 0: 9399.2. Samples: 15730724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:22,397][820675] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-09 21:01:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 15777792. Throughput: 0: 9392.8. Samples: 15759172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:26,884][820675] Updated weights for policy 0, policy_version 30880 (0.0004) [2023-03-09 21:01:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.6, 300 sec: 9413.9). Total num frames: 15822848. Throughput: 0: 9313.1. Samples: 15811928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030904_15822848.pth... [2023-03-09 21:01:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030368_15548416.pth [2023-03-09 21:01:31,085][820675] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-09 21:01:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 15872000. Throughput: 0: 9373.6. Samples: 15870772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:35,573][820675] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-09 21:01:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 15917056. Throughput: 0: 9302.9. Samples: 15896584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:40,052][820675] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-09 21:01:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 15966208. Throughput: 0: 9282.9. Samples: 15953920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031184_15966208.pth... [2023-03-09 21:01:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030640_15687680.pth [2023-03-09 21:01:44,305][820675] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-09 21:01:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 16011264. Throughput: 0: 9280.5. Samples: 16011020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:48,597][820675] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-09 21:01:53,201][820675] Updated weights for policy 0, policy_version 31360 (0.0004) [2023-03-09 21:01:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 16056320. Throughput: 0: 9268.5. Samples: 16037456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:57,581][820675] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-09 21:01:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 16105472. Throughput: 0: 9283.0. Samples: 16093060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:01:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:01:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031456_16105472.pth... [2023-03-09 21:01:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000030904_15822848.pth [2023-03-09 21:02:01,731][820675] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-09 21:02:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 16154624. Throughput: 0: 9330.4. Samples: 16150592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:06,147][820675] Updated weights for policy 0, policy_version 31600 (0.0005) [2023-03-09 21:02:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 16199680. Throughput: 0: 9331.6. Samples: 16179096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:10,669][820675] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-09 21:02:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 16244736. Throughput: 0: 9346.5. Samples: 16232520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031728_16244736.pth... [2023-03-09 21:02:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031184_15966208.pth [2023-03-09 21:02:15,158][820675] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-09 21:02:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.2, 300 sec: 9400.0). Total num frames: 16289792. Throughput: 0: 9288.2. Samples: 16288744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:19,563][820675] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-09 21:02:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 16338944. Throughput: 0: 9346.3. Samples: 16317168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:23,908][820675] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-09 21:02:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 16379904. Throughput: 0: 9276.0. Samples: 16371340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032000_16384000.pth... [2023-03-09 21:02:28,543][820675] Updated weights for policy 0, policy_version 32000 (0.0006) [2023-03-09 21:02:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031456_16105472.pth [2023-03-09 21:02:32,727][820675] Updated weights for policy 0, policy_version 32080 (0.0006) [2023-03-09 21:02:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 16429056. Throughput: 0: 9278.3. Samples: 16428544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:37,062][820675] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-09 21:02:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 16478208. Throughput: 0: 9333.4. Samples: 16457460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:41,451][820675] Updated weights for policy 0, policy_version 32240 (0.0004) [2023-03-09 21:02:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 16523264. Throughput: 0: 9311.1. Samples: 16512060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:43,596][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032280_16527360.pth... [2023-03-09 21:02:43,598][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000031728_16244736.pth [2023-03-09 21:02:45,654][820675] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-09 21:02:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 16572416. Throughput: 0: 9353.9. Samples: 16571516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:02:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:50,031][820675] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-09 21:02:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 16617472. Throughput: 0: 9305.8. Samples: 16597856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:02:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:54,508][820675] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-09 21:02:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 16666624. Throughput: 0: 9427.8. Samples: 16656772. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:02:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:02:58,580][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032560_16670720.pth... [2023-03-09 21:02:58,581][820675] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-09 21:02:58,582][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032000_16384000.pth [2023-03-09 21:03:02,776][820675] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-09 21:03:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 16715776. Throughput: 0: 9462.5. Samples: 16714556. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:03:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:07,005][820675] Updated weights for policy 0, policy_version 32720 (0.0004) [2023-03-09 21:03:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 16764928. Throughput: 0: 9495.1. Samples: 16744448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:03:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:11,152][820675] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-09 21:03:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 16814080. Throughput: 0: 9567.0. Samples: 16801856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:13,540][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 21:03:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032840_16814080.pth... [2023-03-09 21:03:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032280_16527360.pth [2023-03-09 21:03:15,388][820675] Updated weights for policy 0, policy_version 32880 (0.0004) [2023-03-09 21:03:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 16863232. Throughput: 0: 9580.8. Samples: 16859680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:19,603][820675] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-09 21:03:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 16912384. Throughput: 0: 9593.4. Samples: 16889164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:23,685][820675] Updated weights for policy 0, policy_version 33040 (0.0004) [2023-03-09 21:03:27,792][820675] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-09 21:03:28,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9413.9). Total num frames: 16965632. Throughput: 0: 9723.7. Samples: 16949628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033136_16965632.pth... [2023-03-09 21:03:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032560_16670720.pth [2023-03-09 21:03:31,948][820675] Updated weights for policy 0, policy_version 33200 (0.0004) [2023-03-09 21:03:33,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 17010688. Throughput: 0: 9753.2. Samples: 17010408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:36,250][820675] Updated weights for policy 0, policy_version 33280 (0.0004) [2023-03-09 21:03:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 17059840. Throughput: 0: 9773.4. Samples: 17037660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:40,267][820675] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-09 21:03:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 17108992. Throughput: 0: 9811.7. Samples: 17098296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033416_17108992.pth... [2023-03-09 21:03:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000032840_16814080.pth [2023-03-09 21:03:44,326][820675] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-09 21:03:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9441.6). Total num frames: 17158144. Throughput: 0: 9815.1. Samples: 17156236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:48,683][820675] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-09 21:03:52,789][820675] Updated weights for policy 0, policy_version 33600 (0.0004) [2023-03-09 21:03:53,539][820373] Fps is (10 sec: 10239.7, 60 sec: 9898.6, 300 sec: 9469.4). Total num frames: 17211392. Throughput: 0: 9829.8. Samples: 17186792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:56,987][820675] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-09 21:03:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9455.5). Total num frames: 17256448. Throughput: 0: 9836.3. Samples: 17244488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:03:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:03:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033704_17256448.pth... [2023-03-09 21:03:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033136_16965632.pth [2023-03-09 21:04:01,130][820675] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-09 21:04:03,539][820373] Fps is (10 sec: 9830.6, 60 sec: 9898.7, 300 sec: 9469.4). Total num frames: 17309696. Throughput: 0: 9909.3. Samples: 17305600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:05,174][820675] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-09 21:04:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9469.4). Total num frames: 17354752. Throughput: 0: 9891.5. Samples: 17334280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:09,522][820675] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-09 21:04:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9483.3). Total num frames: 17403904. Throughput: 0: 9814.0. Samples: 17391256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:13,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:04:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033992_17403904.pth... [2023-03-09 21:04:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033416_17108992.pth [2023-03-09 21:04:13,736][820675] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-09 21:04:18,193][820675] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-09 21:04:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 17448960. Throughput: 0: 9741.7. Samples: 17448784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:22,403][820675] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-09 21:04:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 17498112. Throughput: 0: 9777.2. Samples: 17477632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:26,837][820675] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-09 21:04:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 17543168. Throughput: 0: 9656.3. Samples: 17532832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:28,539][820373] Avg episode reward: [(0, '0.028')] [2023-03-09 21:04:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034264_17543168.pth... [2023-03-09 21:04:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033704_17256448.pth [2023-03-09 21:04:31,521][820675] Updated weights for policy 0, policy_version 34320 (0.0006) [2023-03-09 21:04:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 17588224. Throughput: 0: 9591.1. Samples: 17587832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:35,814][820675] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-09 21:04:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 17637376. Throughput: 0: 9526.6. Samples: 17615488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:04:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:39,874][820675] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-09 21:04:43,539][820373] Fps is (10 sec: 10239.8, 60 sec: 9693.8, 300 sec: 9497.2). Total num frames: 17690624. Throughput: 0: 9579.5. Samples: 17675568. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:04:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034552_17690624.pth... [2023-03-09 21:04:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000033992_17403904.pth [2023-03-09 21:04:43,896][820675] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-09 21:04:48,265][820675] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-09 21:04:48,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 17735680. Throughput: 0: 9536.3. Samples: 17734732. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:04:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:52,688][820675] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-09 21:04:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 17780736. Throughput: 0: 9469.3. Samples: 17760400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:04:53,540][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 21:04:57,141][820675] Updated weights for policy 0, policy_version 34800 (0.0004) [2023-03-09 21:04:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9483.3). Total num frames: 17829888. Throughput: 0: 9472.5. Samples: 17817516. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:04:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:04:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034824_17829888.pth... [2023-03-09 21:04:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034264_17543168.pth [2023-03-09 21:05:01,337][820675] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-09 21:05:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 17879040. Throughput: 0: 9471.8. Samples: 17875016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:05,615][820675] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-09 21:05:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 17924096. Throughput: 0: 9466.5. Samples: 17903624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:09,970][820675] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-09 21:05:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 17969152. Throughput: 0: 9497.9. Samples: 17960236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035096_17969152.pth... [2023-03-09 21:05:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034552_17690624.pth [2023-03-09 21:05:14,454][820675] Updated weights for policy 0, policy_version 35120 (0.0004) [2023-03-09 21:05:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 18018304. Throughput: 0: 9543.9. Samples: 18017308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:18,710][820675] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-09 21:05:23,042][820675] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-09 21:05:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9511.1). Total num frames: 18067456. Throughput: 0: 9515.3. Samples: 18043676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:27,553][820675] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-09 21:05:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 18112512. Throughput: 0: 9435.1. Samples: 18100148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:28,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:05:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035376_18112512.pth... [2023-03-09 21:05:28,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000034824_17829888.pth [2023-03-09 21:05:32,214][820675] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-09 21:05:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.0, 300 sec: 9483.3). Total num frames: 18157568. Throughput: 0: 9306.9. Samples: 18153544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:36,669][820675] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-09 21:05:38,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 18198528. Throughput: 0: 9338.4. Samples: 18180628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:41,269][820675] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-09 21:05:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 18247680. Throughput: 0: 9287.7. Samples: 18235464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035640_18247680.pth... [2023-03-09 21:05:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035096_17969152.pth [2023-03-09 21:05:45,493][820675] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-09 21:05:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18296832. Throughput: 0: 9295.6. Samples: 18293316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:49,751][820675] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-09 21:05:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 18341888. Throughput: 0: 9291.2. Samples: 18321728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:05:54,084][820675] Updated weights for policy 0, policy_version 35840 (0.0004) [2023-03-09 21:05:58,387][820675] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-09 21:05:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18391040. Throughput: 0: 9296.0. Samples: 18378556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:05:58,540][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:05:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035920_18391040.pth... [2023-03-09 21:05:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035376_18112512.pth [2023-03-09 21:06:02,876][820675] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-09 21:06:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 18436096. Throughput: 0: 9257.5. Samples: 18433896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:07,100][820675] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-09 21:06:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18485248. Throughput: 0: 9333.0. Samples: 18463660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:11,692][820675] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-09 21:06:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18530304. Throughput: 0: 9276.6. Samples: 18517596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036192_18530304.pth... [2023-03-09 21:06:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035640_18247680.pth [2023-03-09 21:06:15,799][820675] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-09 21:06:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 18575360. Throughput: 0: 9370.3. Samples: 18575208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:20,387][820675] Updated weights for policy 0, policy_version 36320 (0.0004) [2023-03-09 21:06:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 18624512. Throughput: 0: 9356.5. Samples: 18601672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:24,974][820675] Updated weights for policy 0, policy_version 36400 (0.0004) [2023-03-09 21:06:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 18669568. Throughput: 0: 9375.3. Samples: 18657352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036464_18669568.pth... [2023-03-09 21:06:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000035920_18391040.pth [2023-03-09 21:06:29,175][820675] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-09 21:06:33,523][820675] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-09 21:06:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 18718720. Throughput: 0: 9326.0. Samples: 18712988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:37,721][820675] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-09 21:06:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 18763776. Throughput: 0: 9380.5. Samples: 18743848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:42,214][820675] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-09 21:06:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18808832. Throughput: 0: 9366.0. Samples: 18800024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:43,589][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036744_18812928.pth... [2023-03-09 21:06:43,591][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036192_18530304.pth [2023-03-09 21:06:46,581][820675] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-09 21:06:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 18857984. Throughput: 0: 9373.4. Samples: 18855700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:48,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:06:51,031][820675] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-09 21:06:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18903040. Throughput: 0: 9310.3. Samples: 18882624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:55,228][820675] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-09 21:06:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9483.3). Total num frames: 18952192. Throughput: 0: 9413.4. Samples: 18941196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:06:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:06:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037016_18952192.pth... [2023-03-09 21:06:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036464_18669568.pth [2023-03-09 21:06:59,559][820675] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-09 21:07:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 18997248. Throughput: 0: 9378.2. Samples: 18997228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:03,986][820675] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-09 21:07:08,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 19042304. Throughput: 0: 9397.3. Samples: 19024552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:08,549][820675] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-03-09 21:07:12,776][820675] Updated weights for policy 0, policy_version 37280 (0.0005) [2023-03-09 21:07:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 19095552. Throughput: 0: 9412.4. Samples: 19080912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:13,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 21:07:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037296_19095552.pth... [2023-03-09 21:07:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000036744_18812928.pth [2023-03-09 21:07:17,086][820675] Updated weights for policy 0, policy_version 37360 (0.0004) [2023-03-09 21:07:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 19140608. Throughput: 0: 9411.8. Samples: 19136520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:18,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:07:21,390][820675] Updated weights for policy 0, policy_version 37440 (0.0004) [2023-03-09 21:07:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 19189760. Throughput: 0: 9397.8. Samples: 19166748. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:07:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:25,784][820675] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-09 21:07:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9511.0). Total num frames: 19234816. Throughput: 0: 9389.0. Samples: 19222528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:07:28,540][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:07:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037568_19234816.pth... [2023-03-09 21:07:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037016_18952192.pth [2023-03-09 21:07:30,063][820675] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-09 21:07:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 19279872. Throughput: 0: 9383.6. Samples: 19277960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:07:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:07:34,460][820675] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-09 21:07:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 19329024. Throughput: 0: 9441.4. Samples: 19307488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:07:38,540][820373] Avg episode reward: [(0, '0.076')] [2023-03-09 21:07:38,914][820675] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-09 21:07:43,369][820675] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-09 21:07:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 19374080. Throughput: 0: 9352.0. Samples: 19362036. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:07:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037840_19374080.pth... [2023-03-09 21:07:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037296_19095552.pth [2023-03-09 21:07:47,582][820675] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-09 21:07:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 19423232. Throughput: 0: 9386.6. Samples: 19419624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:48,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:07:51,910][820675] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-09 21:07:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 19468288. Throughput: 0: 9405.3. Samples: 19447792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:56,336][820675] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-09 21:07:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 19517440. Throughput: 0: 9409.2. Samples: 19504328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:07:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:07:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038120_19517440.pth... [2023-03-09 21:07:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037568_19234816.pth [2023-03-09 21:08:00,620][820675] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-09 21:08:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 19562496. Throughput: 0: 9450.9. Samples: 19561812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:08:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:04,951][820675] Updated weights for policy 0, policy_version 38240 (0.0005) [2023-03-09 21:08:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 19611648. Throughput: 0: 9399.9. Samples: 19589744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:08:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:09,036][820675] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-09 21:08:13,211][820675] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-09 21:08:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 19660800. Throughput: 0: 9493.5. Samples: 19649736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:08:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038400_19660800.pth... [2023-03-09 21:08:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000037840_19374080.pth [2023-03-09 21:08:17,555][820675] Updated weights for policy 0, policy_version 38480 (0.0006) [2023-03-09 21:08:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 19709952. Throughput: 0: 9536.2. Samples: 19707088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:08:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:08:22,100][820675] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-09 21:08:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 19755008. Throughput: 0: 9467.4. Samples: 19733520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:08:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:26,296][820675] Updated weights for policy 0, policy_version 38640 (0.0004) [2023-03-09 21:08:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 19804160. Throughput: 0: 9541.4. Samples: 19791400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:08:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038680_19804160.pth... [2023-03-09 21:08:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038120_19517440.pth [2023-03-09 21:08:30,303][820675] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-09 21:08:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 19853312. Throughput: 0: 9588.2. Samples: 19851092. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:08:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:34,627][820675] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-09 21:08:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 19902464. Throughput: 0: 9594.7. Samples: 19879556. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:08:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:38,929][820675] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-09 21:08:43,136][820675] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-09 21:08:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 19947520. Throughput: 0: 9629.1. Samples: 19937636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:08:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:43,550][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038968_19951616.pth... [2023-03-09 21:08:43,552][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038400_19660800.pth [2023-03-09 21:08:47,465][820675] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-09 21:08:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 19996672. Throughput: 0: 9614.5. Samples: 19994464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:08:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:51,998][820675] Updated weights for policy 0, policy_version 39120 (0.0004) [2023-03-09 21:08:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 20041728. Throughput: 0: 9588.6. Samples: 20021232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:08:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:08:56,551][820675] Updated weights for policy 0, policy_version 39200 (0.0005) [2023-03-09 21:08:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 20086784. Throughput: 0: 9448.3. Samples: 20074912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:08:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:08:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039232_20086784.pth... [2023-03-09 21:08:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038680_19804160.pth [2023-03-09 21:09:00,992][820675] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-09 21:09:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 20131840. Throughput: 0: 9424.6. Samples: 20131192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:09:05,478][820675] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-09 21:09:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 20176896. Throughput: 0: 9408.5. Samples: 20156900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:08,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:09:10,010][820675] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-09 21:09:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 20226048. Throughput: 0: 9373.4. Samples: 20213204. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039504_20226048.pth... [2023-03-09 21:09:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000038968_19951616.pth [2023-03-09 21:09:14,394][820675] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-09 21:09:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 20271104. Throughput: 0: 9297.7. Samples: 20269488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:18,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:09:18,705][820675] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-09 21:09:22,876][820675] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-09 21:09:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 20320256. Throughput: 0: 9327.1. Samples: 20299276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:27,235][820675] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-09 21:09:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 20369408. Throughput: 0: 9311.7. Samples: 20356664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:28,540][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:09:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039784_20369408.pth... [2023-03-09 21:09:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039232_20086784.pth [2023-03-09 21:09:31,580][820675] Updated weights for policy 0, policy_version 39840 (0.0005) [2023-03-09 21:09:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 20414464. Throughput: 0: 9242.7. Samples: 20410388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:36,045][820675] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-09 21:09:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 20459520. Throughput: 0: 9286.0. Samples: 20439104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:40,495][820675] Updated weights for policy 0, policy_version 40000 (0.0004) [2023-03-09 21:09:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 20508672. Throughput: 0: 9334.9. Samples: 20494980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:43,539][820373] Avg episode reward: [(0, '1.370')] [2023-03-09 21:09:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040056_20508672.pth... [2023-03-09 21:09:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039504_20226048.pth [2023-03-09 21:09:44,802][820675] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-09 21:09:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 20553728. Throughput: 0: 9335.0. Samples: 20551268. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:09:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:49,248][820675] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-09 21:09:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 20598784. Throughput: 0: 9363.4. Samples: 20578252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:09:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:53,856][820675] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-09 21:09:58,386][820675] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-09 21:09:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 20643840. Throughput: 0: 9309.6. Samples: 20632136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:09:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:09:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040320_20643840.pth... [2023-03-09 21:09:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000039784_20369408.pth [2023-03-09 21:10:02,837][820675] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-09 21:10:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 20688896. Throughput: 0: 9282.3. Samples: 20687192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:07,236][820675] Updated weights for policy 0, policy_version 40480 (0.0004) [2023-03-09 21:10:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 20738048. Throughput: 0: 9251.6. Samples: 20715596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:08,539][820373] Avg episode reward: [(0, '2.053')] [2023-03-09 21:10:11,757][820675] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-09 21:10:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 20783104. Throughput: 0: 9194.3. Samples: 20770408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:13,550][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 21:10:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040592_20783104.pth... [2023-03-09 21:10:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040056_20508672.pth [2023-03-09 21:10:16,067][820675] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-09 21:10:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 20828160. Throughput: 0: 9259.2. Samples: 20827052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:18,539][820373] Avg episode reward: [(0, '0.044')] [2023-03-09 21:10:20,477][820675] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-09 21:10:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 20877312. Throughput: 0: 9235.8. Samples: 20854716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:24,606][820675] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-09 21:10:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 20922368. Throughput: 0: 9299.8. Samples: 20913472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040864_20922368.pth... [2023-03-09 21:10:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040320_20643840.pth [2023-03-09 21:10:29,010][820675] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-09 21:10:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 20967424. Throughput: 0: 9243.7. Samples: 20967236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:33,606][820675] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-09 21:10:38,019][820675] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-09 21:10:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 21016576. Throughput: 0: 9252.8. Samples: 20994628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:38,540][820373] Avg episode reward: [(0, '8.133')] [2023-03-09 21:10:42,652][820675] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-09 21:10:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9358.3). Total num frames: 21057536. Throughput: 0: 9269.1. Samples: 21049244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:43,539][820373] Avg episode reward: [(0, '1.584')] [2023-03-09 21:10:43,574][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041136_21061632.pth... [2023-03-09 21:10:43,576][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040592_20783104.pth [2023-03-09 21:10:47,109][820675] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-09 21:10:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 21106688. Throughput: 0: 9232.7. Samples: 21102664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:51,598][820675] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-09 21:10:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 21151744. Throughput: 0: 9224.7. Samples: 21130708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:53,539][820373] Avg episode reward: [(0, '5.879')] [2023-03-09 21:10:55,948][820675] Updated weights for policy 0, policy_version 41360 (0.0004) [2023-03-09 21:10:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 21196800. Throughput: 0: 9259.1. Samples: 21187068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:10:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:10:58,549][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041408_21200896.pth... [2023-03-09 21:10:58,552][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000040864_20922368.pth [2023-03-09 21:11:00,474][820675] Updated weights for policy 0, policy_version 41440 (0.0004) [2023-03-09 21:11:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 21245952. Throughput: 0: 9243.5. Samples: 21243008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:11:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:04,702][820675] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-09 21:11:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 21291008. Throughput: 0: 9240.3. Samples: 21270528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:08,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:11:09,257][820675] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-09 21:11:13,519][820675] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-09 21:11:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 21340160. Throughput: 0: 9177.5. Samples: 21326460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041680_21340160.pth... [2023-03-09 21:11:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041136_21061632.pth [2023-03-09 21:11:17,846][820675] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-09 21:11:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 21385216. Throughput: 0: 9244.8. Samples: 21383252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:18,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:11:22,154][820675] Updated weights for policy 0, policy_version 41840 (0.0004) [2023-03-09 21:11:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 21430272. Throughput: 0: 9286.9. Samples: 21412540. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:23,539][820373] Avg episode reward: [(0, '0.044')] [2023-03-09 21:11:26,761][820675] Updated weights for policy 0, policy_version 41920 (0.0006) [2023-03-09 21:11:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 21475328. Throughput: 0: 9270.5. Samples: 21466416. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041952_21479424.pth... [2023-03-09 21:11:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041408_21200896.pth [2023-03-09 21:11:31,179][820675] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-09 21:11:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 21524480. Throughput: 0: 9358.7. Samples: 21523804. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:11:33,539][820373] Avg episode reward: [(0, '0.103')] [2023-03-09 21:11:35,322][820675] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-09 21:11:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 21573632. Throughput: 0: 9354.6. Samples: 21551664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:11:38,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:11:39,770][820675] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-09 21:11:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 21622784. Throughput: 0: 9408.5. Samples: 21610452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:11:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042232_21622784.pth... [2023-03-09 21:11:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041680_21340160.pth [2023-03-09 21:11:43,911][820675] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-09 21:11:48,258][820675] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-09 21:11:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9372.2). Total num frames: 21667840. Throughput: 0: 9402.2. Samples: 21666108. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:11:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:52,821][820675] Updated weights for policy 0, policy_version 42400 (0.0004) [2023-03-09 21:11:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 21712896. Throughput: 0: 9375.5. Samples: 21692424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:11:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:11:57,217][820675] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-09 21:11:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 21757952. Throughput: 0: 9388.6. Samples: 21748948. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:11:58,540][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 21:11:58,564][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042504_21762048.pth... [2023-03-09 21:11:58,566][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000041952_21479424.pth [2023-03-09 21:12:01,687][820675] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-09 21:12:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 21807104. Throughput: 0: 9353.5. Samples: 21804160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:12:03,539][820373] Avg episode reward: [(0, '2.062')] [2023-03-09 21:12:05,855][820675] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-09 21:12:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 21856256. Throughput: 0: 9366.4. Samples: 21834028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:12:08,539][820373] Avg episode reward: [(0, '1.798')] [2023-03-09 21:12:09,968][820675] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-09 21:12:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 21905408. Throughput: 0: 9479.6. Samples: 21893000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:12:13,540][820373] Avg episode reward: [(0, '1.768')] [2023-03-09 21:12:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042784_21905408.pth... [2023-03-09 21:12:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042232_21622784.pth [2023-03-09 21:12:14,244][820675] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-09 21:12:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 21950464. Throughput: 0: 9480.8. Samples: 21950440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:12:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:18,605][820675] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-09 21:12:23,188][820675] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-09 21:12:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 21995520. Throughput: 0: 9470.8. Samples: 21977848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:12:23,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 21:12:27,589][820675] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-09 21:12:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 22044672. Throughput: 0: 9374.3. Samples: 22032296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043056_22044672.pth... [2023-03-09 21:12:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042504_21762048.pth [2023-03-09 21:12:32,002][820675] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-09 21:12:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 22089728. Throughput: 0: 9342.2. Samples: 22086508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:33,539][820373] Avg episode reward: [(0, '2.861')] [2023-03-09 21:12:36,582][820675] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-09 21:12:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 22134784. Throughput: 0: 9375.1. Samples: 22114304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:41,020][820675] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-09 21:12:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 22179840. Throughput: 0: 9388.7. Samples: 22171440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:43,574][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043328_22183936.pth... [2023-03-09 21:12:43,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000042784_21905408.pth [2023-03-09 21:12:45,327][820675] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-09 21:12:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 22228992. Throughput: 0: 9351.9. Samples: 22224996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:49,762][820675] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-09 21:12:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 22274048. Throughput: 0: 9323.3. Samples: 22253576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:54,181][820675] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-09 21:12:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 22319104. Throughput: 0: 9235.7. Samples: 22308608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:12:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:12:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043592_22319104.pth... [2023-03-09 21:12:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043056_22044672.pth [2023-03-09 21:12:58,603][820675] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-09 21:13:02,948][820675] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-09 21:13:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 22368256. Throughput: 0: 9213.6. Samples: 22365052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:07,480][820675] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-09 21:13:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 22413312. Throughput: 0: 9214.8. Samples: 22392516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:11,985][820675] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-09 21:13:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 22462464. Throughput: 0: 9205.1. Samples: 22446524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043872_22462464.pth... [2023-03-09 21:13:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043328_22183936.pth [2023-03-09 21:13:16,106][820675] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-09 21:13:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 22507520. Throughput: 0: 9338.7. Samples: 22506748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:20,574][820675] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-09 21:13:23,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 22552576. Throughput: 0: 9285.7. Samples: 22532160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:23,539][820373] Avg episode reward: [(0, '2.669')] [2023-03-09 21:13:25,062][820675] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-09 21:13:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 22597632. Throughput: 0: 9253.4. Samples: 22587844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044136_22597632.pth... [2023-03-09 21:13:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043592_22319104.pth [2023-03-09 21:13:29,474][820675] Updated weights for policy 0, policy_version 44160 (0.0006) [2023-03-09 21:13:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 22646784. Throughput: 0: 9304.8. Samples: 22643712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:33,540][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 21:13:33,728][820675] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-09 21:13:38,062][820675] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-09 21:13:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 22695936. Throughput: 0: 9313.9. Samples: 22672704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:42,166][820675] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-09 21:13:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 22745088. Throughput: 0: 9419.4. Samples: 22732480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044424_22745088.pth... [2023-03-09 21:13:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000043872_22462464.pth [2023-03-09 21:13:46,742][820675] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-09 21:13:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 22790144. Throughput: 0: 9356.9. Samples: 22786112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:51,105][820675] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-09 21:13:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 22835200. Throughput: 0: 9380.8. Samples: 22814652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:55,443][820675] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-09 21:13:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 22880256. Throughput: 0: 9427.5. Samples: 22870760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:13:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:13:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044688_22880256.pth... [2023-03-09 21:13:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044136_22597632.pth [2023-03-09 21:13:59,881][820675] Updated weights for policy 0, policy_version 44720 (0.0005) [2023-03-09 21:14:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 22925312. Throughput: 0: 9284.1. Samples: 22924532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:14:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:04,374][820675] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-09 21:14:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 22974464. Throughput: 0: 9357.9. Samples: 22953268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:14:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:08,789][820675] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-09 21:14:12,966][820675] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-09 21:14:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 23023616. Throughput: 0: 9412.2. Samples: 23011392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:14:13,540][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 21:14:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044968_23023616.pth... [2023-03-09 21:14:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044424_22745088.pth [2023-03-09 21:14:17,374][820675] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-09 21:14:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 23068672. Throughput: 0: 9441.9. Samples: 23068596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:14:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:21,718][820675] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-09 21:14:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 23113728. Throughput: 0: 9409.4. Samples: 23096128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:14:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:26,206][820675] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-09 21:14:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 23162880. Throughput: 0: 9278.8. Samples: 23150028. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:14:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045240_23162880.pth... [2023-03-09 21:14:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044688_22880256.pth [2023-03-09 21:14:30,845][820675] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-09 21:14:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 23207936. Throughput: 0: 9284.3. Samples: 23203904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:14:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:35,084][820675] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-09 21:14:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 23257088. Throughput: 0: 9330.2. Samples: 23234512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:14:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:39,344][820675] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-09 21:14:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23302144. Throughput: 0: 9332.5. Samples: 23290724. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:14:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045512_23302144.pth... [2023-03-09 21:14:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000044968_23023616.pth [2023-03-09 21:14:43,960][820675] Updated weights for policy 0, policy_version 45520 (0.0006) [2023-03-09 21:14:48,479][820675] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-09 21:14:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23347200. Throughput: 0: 9304.5. Samples: 23343232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:14:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:53,055][820675] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-09 21:14:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23392256. Throughput: 0: 9268.8. Samples: 23370364. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:14:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:57,306][820675] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-09 21:14:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23437312. Throughput: 0: 9232.6. Samples: 23426860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:14:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:14:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045776_23437312.pth... [2023-03-09 21:14:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045240_23162880.pth [2023-03-09 21:15:01,911][820675] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-09 21:15:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 23482368. Throughput: 0: 9191.6. Samples: 23482220. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:15:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:06,234][820675] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-09 21:15:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23531520. Throughput: 0: 9190.1. Samples: 23509684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:15:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:10,484][820675] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-09 21:15:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 23576576. Throughput: 0: 9250.8. Samples: 23566316. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:15:13,540][820373] Avg episode reward: [(0, '0.075')] [2023-03-09 21:15:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046056_23580672.pth... [2023-03-09 21:15:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045512_23302144.pth [2023-03-09 21:15:14,861][820675] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-09 21:15:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23625728. Throughput: 0: 9284.4. Samples: 23621704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:18,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:19,229][820675] Updated weights for policy 0, policy_version 46160 (0.0004) [2023-03-09 21:15:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 23670784. Throughput: 0: 9236.6. Samples: 23650160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:23,676][820675] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-09 21:15:28,139][820675] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-09 21:15:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 23715840. Throughput: 0: 9232.4. Samples: 23706180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:28,574][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046328_23719936.pth... [2023-03-09 21:15:28,576][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000045776_23437312.pth [2023-03-09 21:15:32,175][820675] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-09 21:15:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 23769088. Throughput: 0: 9377.3. Samples: 23765212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:33,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:15:36,614][820675] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-09 21:15:38,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 23814144. Throughput: 0: 9403.8. Samples: 23793532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:41,040][820675] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-09 21:15:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 23859200. Throughput: 0: 9347.4. Samples: 23847492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:43,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:15:43,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046608_23863296.pth... [2023-03-09 21:15:43,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046056_23580672.pth [2023-03-09 21:15:45,277][820675] Updated weights for policy 0, policy_version 46640 (0.0006) [2023-03-09 21:15:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 23908352. Throughput: 0: 9435.2. Samples: 23906804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:49,619][820675] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-09 21:15:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 23953408. Throughput: 0: 9406.8. Samples: 23932992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:53,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:15:54,287][820675] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-09 21:15:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 23998464. Throughput: 0: 9351.3. Samples: 23987124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:15:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:15:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046872_23998464.pth... [2023-03-09 21:15:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046328_23719936.pth [2023-03-09 21:15:58,795][820675] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-09 21:16:03,097][820675] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-09 21:16:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 24047616. Throughput: 0: 9373.7. Samples: 24043520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:07,495][820675] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-09 21:16:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 24092672. Throughput: 0: 9372.9. Samples: 24071940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:12,003][820675] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-09 21:16:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 24137728. Throughput: 0: 9320.4. Samples: 24125596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047144_24137728.pth... [2023-03-09 21:16:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046608_23863296.pth [2023-03-09 21:16:16,784][820675] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-09 21:16:18,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 24178688. Throughput: 0: 9186.6. Samples: 24178608. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:18,539][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 21:16:21,050][820675] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-09 21:16:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 24227840. Throughput: 0: 9196.4. Samples: 24207368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:25,452][820675] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-09 21:16:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 24272896. Throughput: 0: 9228.8. Samples: 24262788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:28,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:28,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047416_24276992.pth... [2023-03-09 21:16:28,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000046872_23998464.pth [2023-03-09 21:16:29,704][820675] Updated weights for policy 0, policy_version 47440 (0.0006) [2023-03-09 21:16:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 24322048. Throughput: 0: 9140.9. Samples: 24318144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:33,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:34,363][820675] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-09 21:16:38,497][820675] Updated weights for policy 0, policy_version 47600 (0.0004) [2023-03-09 21:16:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 24371200. Throughput: 0: 9191.3. Samples: 24346600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:38,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:16:42,791][820675] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-09 21:16:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9316.7). Total num frames: 24416256. Throughput: 0: 9296.2. Samples: 24405452. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:16:43,540][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 21:16:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047688_24416256.pth... [2023-03-09 21:16:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047144_24137728.pth [2023-03-09 21:16:47,023][820675] Updated weights for policy 0, policy_version 47760 (0.0004) [2023-03-09 21:16:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 24465408. Throughput: 0: 9352.3. Samples: 24464372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:48,540][820373] Avg episode reward: [(0, '4.735')] [2023-03-09 21:16:51,284][820675] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-09 21:16:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 24514560. Throughput: 0: 9346.7. Samples: 24492540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:16:55,753][820675] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-09 21:16:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 24559616. Throughput: 0: 9375.2. Samples: 24547480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:16:58,540][820373] Avg episode reward: [(0, '4.581')] [2023-03-09 21:16:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047968_24559616.pth... [2023-03-09 21:16:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047416_24276992.pth [2023-03-09 21:16:59,969][820675] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-09 21:17:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 24608768. Throughput: 0: 9557.4. Samples: 24608692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:03,550][820373] Avg episode reward: [(0, '0.095')] [2023-03-09 21:17:03,918][820675] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-09 21:17:08,127][820675] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-09 21:17:08,539][820373] Fps is (10 sec: 9830.6, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 24657920. Throughput: 0: 9586.1. Samples: 24638744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:08,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:12,451][820675] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-09 21:17:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 24707072. Throughput: 0: 9601.6. Samples: 24694860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048256_24707072.pth... [2023-03-09 21:17:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047688_24416256.pth [2023-03-09 21:17:17,024][820675] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-09 21:17:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 24752128. Throughput: 0: 9568.1. Samples: 24748708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:21,394][820675] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-09 21:17:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 24797184. Throughput: 0: 9559.3. Samples: 24776768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:25,860][820675] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-09 21:17:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 24846336. Throughput: 0: 9520.2. Samples: 24833860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:28,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:28,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048528_24846336.pth... [2023-03-09 21:17:28,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000047968_24559616.pth [2023-03-09 21:17:30,262][820675] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-09 21:17:33,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 24891392. Throughput: 0: 9402.9. Samples: 24887500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:34,690][820675] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-09 21:17:38,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 24936448. Throughput: 0: 9409.0. Samples: 24915944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:39,310][820675] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-09 21:17:43,539][820675] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-09 21:17:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 24985600. Throughput: 0: 9437.6. Samples: 24972172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:17:43,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:17:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048800_24985600.pth... [2023-03-09 21:17:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048256_24707072.pth [2023-03-09 21:17:47,913][820675] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-09 21:17:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 25030656. Throughput: 0: 9310.1. Samples: 25027648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:17:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:51,961][820675] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-09 21:17:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 25079808. Throughput: 0: 9325.7. Samples: 25058400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:17:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:17:56,274][820675] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-09 21:17:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 25124864. Throughput: 0: 9357.1. Samples: 25115928. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:17:58,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:17:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049072_25124864.pth... [2023-03-09 21:17:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048528_24846336.pth [2023-03-09 21:18:00,847][820675] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-09 21:18:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 25174016. Throughput: 0: 9360.3. Samples: 25169920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:18:03,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:18:05,142][820675] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-09 21:18:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 25223168. Throughput: 0: 9408.2. Samples: 25200136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:18:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:09,327][820675] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-09 21:18:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25268224. Throughput: 0: 9379.4. Samples: 25255936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:18:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049352_25268224.pth... [2023-03-09 21:18:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000048800_24985600.pth [2023-03-09 21:18:14,005][820675] Updated weights for policy 0, policy_version 49360 (0.0004) [2023-03-09 21:18:18,365][820675] Updated weights for policy 0, policy_version 49440 (0.0005) [2023-03-09 21:18:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25313280. Throughput: 0: 9386.6. Samples: 25309900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:18:22,924][820675] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-09 21:18:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25358336. Throughput: 0: 9373.1. Samples: 25337732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:27,534][820675] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-09 21:18:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 25403392. Throughput: 0: 9308.2. Samples: 25391044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049616_25403392.pth... [2023-03-09 21:18:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049072_25124864.pth [2023-03-09 21:18:31,911][820675] Updated weights for policy 0, policy_version 49680 (0.0004) [2023-03-09 21:18:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 25448448. Throughput: 0: 9346.9. Samples: 25448256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:35,824][820675] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-09 21:18:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 25501696. Throughput: 0: 9361.0. Samples: 25479644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:40,318][820675] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-09 21:18:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9330.5). Total num frames: 25542656. Throughput: 0: 9282.1. Samples: 25533624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:43,555][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049896_25546752.pth... [2023-03-09 21:18:43,558][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049352_25268224.pth [2023-03-09 21:18:44,836][820675] Updated weights for policy 0, policy_version 49920 (0.0004) [2023-03-09 21:18:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 25591808. Throughput: 0: 9345.7. Samples: 25590476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:49,171][820675] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-09 21:18:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 25636864. Throughput: 0: 9287.7. Samples: 25618084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:53,606][820675] Updated weights for policy 0, policy_version 50080 (0.0005) [2023-03-09 21:18:57,985][820675] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-09 21:18:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25686016. Throughput: 0: 9284.5. Samples: 25673736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:18:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:18:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050168_25686016.pth... [2023-03-09 21:18:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049616_25403392.pth [2023-03-09 21:19:02,204][820675] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-09 21:19:03,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25735168. Throughput: 0: 9359.6. Samples: 25731084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:19:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:06,315][820675] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-09 21:19:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 25780224. Throughput: 0: 9410.9. Samples: 25761220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:19:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:10,397][820675] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-09 21:19:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 25829376. Throughput: 0: 9525.9. Samples: 25819708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:19:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:13,545][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050456_25833472.pth... [2023-03-09 21:19:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000049896_25546752.pth [2023-03-09 21:19:14,898][820675] Updated weights for policy 0, policy_version 50480 (0.0005) [2023-03-09 21:19:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 25878528. Throughput: 0: 9470.7. Samples: 25874440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:19:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:19:19,260][820675] Updated weights for policy 0, policy_version 50560 (0.0004) [2023-03-09 21:19:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 25923584. Throughput: 0: 9432.8. Samples: 25904120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:23,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:19:23,798][820675] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-09 21:19:28,230][820675] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-09 21:19:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 25968640. Throughput: 0: 9409.5. Samples: 25957052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:28,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:28,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050720_25968640.pth... [2023-03-09 21:19:28,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050168_25686016.pth [2023-03-09 21:19:32,702][820675] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-09 21:19:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 26013696. Throughput: 0: 9402.9. Samples: 26013608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:37,093][820675] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-09 21:19:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 26062848. Throughput: 0: 9423.1. Samples: 26042124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:41,817][820675] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-09 21:19:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 26103808. Throughput: 0: 9347.2. Samples: 26094360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:43,562][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050992_26107904.pth... [2023-03-09 21:19:43,563][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050456_25833472.pth [2023-03-09 21:19:45,803][820675] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-09 21:19:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 26157056. Throughput: 0: 9402.8. Samples: 26154212. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:48,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 21:19:50,065][820675] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-09 21:19:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 26202112. Throughput: 0: 9379.1. Samples: 26183280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:54,554][820675] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-09 21:19:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 26247168. Throughput: 0: 9260.4. Samples: 26236424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:19:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:19:58,568][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051272_26251264.pth... [2023-03-09 21:19:58,570][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050720_25968640.pth [2023-03-09 21:19:59,042][820675] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-09 21:20:03,530][820675] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-09 21:20:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 26296320. Throughput: 0: 9283.4. Samples: 26292192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:20:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:08,142][820675] Updated weights for policy 0, policy_version 51440 (0.0004) [2023-03-09 21:20:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 26337280. Throughput: 0: 9187.9. Samples: 26317572. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:20:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:12,646][820675] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-09 21:20:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 26386432. Throughput: 0: 9247.4. Samples: 26373184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:20:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051536_26386432.pth... [2023-03-09 21:20:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000050992_26107904.pth [2023-03-09 21:20:17,006][820675] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-09 21:20:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 26431488. Throughput: 0: 9260.3. Samples: 26430320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:20:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:21,252][820675] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-09 21:20:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 26480640. Throughput: 0: 9258.8. Samples: 26458768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:20:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:25,492][820675] Updated weights for policy 0, policy_version 51760 (0.0004) [2023-03-09 21:20:28,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 26529792. Throughput: 0: 9396.2. Samples: 26517192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:28,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:28,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051816_26529792.pth... [2023-03-09 21:20:28,557][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051272_26251264.pth [2023-03-09 21:20:29,763][820675] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-09 21:20:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 26574848. Throughput: 0: 9289.8. Samples: 26572252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:34,132][820675] Updated weights for policy 0, policy_version 51920 (0.0004) [2023-03-09 21:20:38,513][820675] Updated weights for policy 0, policy_version 52000 (0.0006) [2023-03-09 21:20:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 26624000. Throughput: 0: 9270.7. Samples: 26600464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:42,982][820675] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-09 21:20:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 26669056. Throughput: 0: 9339.5. Samples: 26656700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:43,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 21:20:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052088_26669056.pth... [2023-03-09 21:20:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051536_26386432.pth [2023-03-09 21:20:47,357][820675] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-09 21:20:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 26714112. Throughput: 0: 9371.9. Samples: 26713928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:51,590][820675] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-09 21:20:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 26763264. Throughput: 0: 9446.7. Samples: 26742676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:56,083][820675] Updated weights for policy 0, policy_version 52320 (0.0004) [2023-03-09 21:20:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 26808320. Throughput: 0: 9398.3. Samples: 26796104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:20:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:20:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052360_26808320.pth... [2023-03-09 21:20:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000051816_26529792.pth [2023-03-09 21:21:00,625][820675] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-09 21:21:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 26853376. Throughput: 0: 9385.5. Samples: 26852668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:05,030][820675] Updated weights for policy 0, policy_version 52480 (0.0006) [2023-03-09 21:21:08,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 26898432. Throughput: 0: 9346.9. Samples: 26879380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:08,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:09,494][820675] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-09 21:21:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 26947584. Throughput: 0: 9273.0. Samples: 26934476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:13,550][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:21:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052632_26947584.pth... [2023-03-09 21:21:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052088_26669056.pth [2023-03-09 21:21:13,914][820675] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-09 21:21:18,351][820675] Updated weights for policy 0, policy_version 52720 (0.0004) [2023-03-09 21:21:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 26992640. Throughput: 0: 9289.5. Samples: 26990280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:22,603][820675] Updated weights for policy 0, policy_version 52800 (0.0005) [2023-03-09 21:21:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 27037696. Throughput: 0: 9331.5. Samples: 27020380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:26,919][820675] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-09 21:21:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 27086848. Throughput: 0: 9313.2. Samples: 27075796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:21:28,550][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 21:21:28,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052904_27086848.pth... [2023-03-09 21:21:28,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052360_26808320.pth [2023-03-09 21:21:31,334][820675] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-09 21:21:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 27136000. Throughput: 0: 9287.9. Samples: 27131884. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:35,500][820675] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-09 21:21:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 27181056. Throughput: 0: 9321.7. Samples: 27162152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:38,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 21:21:39,995][820675] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-09 21:21:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 27230208. Throughput: 0: 9368.4. Samples: 27217684. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053184_27230208.pth... [2023-03-09 21:21:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052632_26947584.pth [2023-03-09 21:21:44,201][820675] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-09 21:21:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 27275264. Throughput: 0: 9390.3. Samples: 27275232. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:48,564][820675] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-09 21:21:53,200][820675] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-09 21:21:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 27320320. Throughput: 0: 9401.1. Samples: 27302428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:57,635][820675] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-09 21:21:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 27369472. Throughput: 0: 9357.5. Samples: 27355564. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:21:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:21:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053456_27369472.pth... [2023-03-09 21:21:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000052904_27086848.pth [2023-03-09 21:22:02,087][820675] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-09 21:22:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27414528. Throughput: 0: 9340.9. Samples: 27410620. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:22:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:06,523][820675] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-09 21:22:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 27459584. Throughput: 0: 9306.4. Samples: 27439168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:10,910][820675] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-09 21:22:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 27504640. Throughput: 0: 9319.0. Samples: 27495148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053720_27504640.pth... [2023-03-09 21:22:13,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053184_27230208.pth [2023-03-09 21:22:15,410][820675] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-09 21:22:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27553792. Throughput: 0: 9282.9. Samples: 27549616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:19,839][820675] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-09 21:22:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 27598848. Throughput: 0: 9231.2. Samples: 27577556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:24,151][820675] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-09 21:22:28,505][820675] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-09 21:22:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27648000. Throughput: 0: 9280.2. Samples: 27635292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054000_27648000.pth... [2023-03-09 21:22:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053456_27369472.pth [2023-03-09 21:22:32,660][820675] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-09 21:22:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 27693056. Throughput: 0: 9279.0. Samples: 27692784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:37,055][820675] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-09 21:22:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27742208. Throughput: 0: 9313.8. Samples: 27721548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:41,508][820675] Updated weights for policy 0, policy_version 54240 (0.0004) [2023-03-09 21:22:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 27787264. Throughput: 0: 9362.0. Samples: 27776856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:43,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:22:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054272_27787264.pth... [2023-03-09 21:22:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000053720_27504640.pth [2023-03-09 21:22:45,830][820675] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-09 21:22:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27836416. Throughput: 0: 9392.5. Samples: 27833284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:50,120][820675] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-09 21:22:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27881472. Throughput: 0: 9394.7. Samples: 27861928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:53,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:22:54,490][820675] Updated weights for policy 0, policy_version 54480 (0.0004) [2023-03-09 21:22:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 27930624. Throughput: 0: 9398.7. Samples: 27918092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:22:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:22:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054552_27930624.pth... [2023-03-09 21:22:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054000_27648000.pth [2023-03-09 21:22:58,854][820675] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-09 21:23:03,283][820675] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-09 21:23:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 27975680. Throughput: 0: 9427.5. Samples: 27973852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:23:03,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:07,710][820675] Updated weights for policy 0, policy_version 54720 (0.0005) [2023-03-09 21:23:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 28020736. Throughput: 0: 9434.4. Samples: 28002104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:23:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:12,194][820675] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-09 21:23:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 28069888. Throughput: 0: 9373.2. Samples: 28057084. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054824_28069888.pth... [2023-03-09 21:23:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054272_27787264.pth [2023-03-09 21:23:16,023][820675] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-09 21:23:18,539][820373] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 28123136. Throughput: 0: 9488.2. Samples: 28119752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:19,980][820675] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-09 21:23:23,539][820373] Fps is (10 sec: 10240.1, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 28172288. Throughput: 0: 9546.3. Samples: 28151132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:23,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:23:24,356][820675] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-09 21:23:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 28217344. Throughput: 0: 9522.2. Samples: 28205352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:28,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:28,552][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055112_28217344.pth... [2023-03-09 21:23:28,554][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054552_27930624.pth [2023-03-09 21:23:28,606][820675] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-09 21:23:32,836][820675] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-09 21:23:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 28266496. Throughput: 0: 9580.6. Samples: 28264412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:23:37,110][820675] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-09 21:23:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 28315648. Throughput: 0: 9626.4. Samples: 28295116. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:38,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:23:41,428][820675] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-09 21:23:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 28360704. Throughput: 0: 9587.8. Samples: 28349544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:23:43,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 21:23:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055392_28360704.pth... [2023-03-09 21:23:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000054824_28069888.pth [2023-03-09 21:23:45,953][820675] Updated weights for policy 0, policy_version 55440 (0.0004) [2023-03-09 21:23:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 28409856. Throughput: 0: 9597.6. Samples: 28405744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:23:48,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 21:23:50,309][820675] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-09 21:23:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 28454912. Throughput: 0: 9585.0. Samples: 28433432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:23:53,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 21:23:54,478][820675] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-09 21:23:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 28499968. Throughput: 0: 9641.0. Samples: 28490928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:23:58,539][820373] Avg episode reward: [(0, '0.111')] [2023-03-09 21:23:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055664_28499968.pth... [2023-03-09 21:23:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055112_28217344.pth [2023-03-09 21:23:59,037][820675] Updated weights for policy 0, policy_version 55680 (0.0006) [2023-03-09 21:24:03,290][820675] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-09 21:24:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 28549120. Throughput: 0: 9494.6. Samples: 28547008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:24:03,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 21:24:07,810][820675] Updated weights for policy 0, policy_version 55840 (0.0005) [2023-03-09 21:24:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 28594176. Throughput: 0: 9391.7. Samples: 28573760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:24:08,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:24:12,315][820675] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-09 21:24:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 28639232. Throughput: 0: 9395.4. Samples: 28628144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:24:13,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:24:13,578][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055944_28643328.pth... [2023-03-09 21:24:13,580][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055392_28360704.pth [2023-03-09 21:24:16,531][820675] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-09 21:24:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 28688384. Throughput: 0: 9391.0. Samples: 28687008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:24:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:24:20,876][820675] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-09 21:24:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 28733440. Throughput: 0: 9324.2. Samples: 28714704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:24:25,403][820675] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-09 21:24:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 28778496. Throughput: 0: 9336.2. Samples: 28769672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:24:28,558][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056216_28782592.pth... [2023-03-09 21:24:28,559][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055664_28499968.pth [2023-03-09 21:24:30,040][820675] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-09 21:24:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 28823552. Throughput: 0: 9284.4. Samples: 28823540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:24:34,419][820675] Updated weights for policy 0, policy_version 56320 (0.0006) [2023-03-09 21:24:38,512][820675] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-09 21:24:38,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 28876800. Throughput: 0: 9323.6. Samples: 28852996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:38,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:24:42,739][820675] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-09 21:24:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 28921856. Throughput: 0: 9357.7. Samples: 28912024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:43,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 21:24:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056488_28921856.pth... [2023-03-09 21:24:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000055944_28643328.pth [2023-03-09 21:24:46,981][820675] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-09 21:24:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 28971008. Throughput: 0: 9347.8. Samples: 28967660. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:48,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 21:24:51,492][820675] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-09 21:24:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29016064. Throughput: 0: 9375.5. Samples: 28995656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:24:53,539][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 21:24:55,818][820675] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-09 21:24:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 29061120. Throughput: 0: 9415.1. Samples: 29051824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:24:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:24:58,576][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056768_29065216.pth... [2023-03-09 21:24:58,578][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056216_28782592.pth [2023-03-09 21:25:00,342][820675] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-09 21:25:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9400.0). Total num frames: 29110272. Throughput: 0: 9403.0. Samples: 29110144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:03,539][820373] Avg episode reward: [(0, '0.187')] [2023-03-09 21:25:04,668][820675] Updated weights for policy 0, policy_version 56880 (0.0004) [2023-03-09 21:25:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29155328. Throughput: 0: 9338.0. Samples: 29134912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:08,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 21:25:09,095][820675] Updated weights for policy 0, policy_version 56960 (0.0004) [2023-03-09 21:25:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29200384. Throughput: 0: 9356.5. Samples: 29190716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:13,539][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 21:25:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057032_29200384.pth... [2023-03-09 21:25:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056488_28921856.pth [2023-03-09 21:25:13,741][820675] Updated weights for policy 0, policy_version 57040 (0.0004) [2023-03-09 21:25:18,406][820675] Updated weights for policy 0, policy_version 57120 (0.0005) [2023-03-09 21:25:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 29245440. Throughput: 0: 9304.0. Samples: 29242220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:18,539][820373] Avg episode reward: [(0, '0.055')] [2023-03-09 21:25:22,592][820675] Updated weights for policy 0, policy_version 57200 (0.0005) [2023-03-09 21:25:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 29290496. Throughput: 0: 9280.6. Samples: 29270624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:23,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 21:25:26,826][820675] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-09 21:25:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 29339648. Throughput: 0: 9283.5. Samples: 29329780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:28,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 21:25:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057304_29339648.pth... [2023-03-09 21:25:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000056768_29065216.pth [2023-03-09 21:25:30,970][820675] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-09 21:25:33,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 29392896. Throughput: 0: 9353.1. Samples: 29388548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:33,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:25:35,197][820675] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-09 21:25:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29437952. Throughput: 0: 9375.3. Samples: 29417544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:38,539][820373] Avg episode reward: [(0, '0.117')] [2023-03-09 21:25:39,754][820675] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-09 21:25:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29483008. Throughput: 0: 9333.5. Samples: 29471832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:43,540][820373] Avg episode reward: [(0, '0.069')] [2023-03-09 21:25:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057584_29483008.pth... [2023-03-09 21:25:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057032_29200384.pth [2023-03-09 21:25:44,078][820675] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-09 21:25:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 29528064. Throughput: 0: 9285.3. Samples: 29527984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:48,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:25:48,544][820675] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-09 21:25:52,769][820675] Updated weights for policy 0, policy_version 57760 (0.0004) [2023-03-09 21:25:53,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29577216. Throughput: 0: 9374.1. Samples: 29556744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:25:57,202][820675] Updated weights for policy 0, policy_version 57840 (0.0004) [2023-03-09 21:25:58,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 29626368. Throughput: 0: 9398.8. Samples: 29613664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:25:58,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:25:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057864_29626368.pth... [2023-03-09 21:25:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057304_29339648.pth [2023-03-09 21:26:01,513][820675] Updated weights for policy 0, policy_version 57920 (0.0004) [2023-03-09 21:26:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 29671424. Throughput: 0: 9477.6. Samples: 29668712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:26:03,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:26:06,124][820675] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-09 21:26:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29716480. Throughput: 0: 9451.0. Samples: 29695920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:08,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:26:10,465][820675] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-09 21:26:13,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 29765632. Throughput: 0: 9394.3. Samples: 29752524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:26:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058136_29765632.pth... [2023-03-09 21:26:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057584_29483008.pth [2023-03-09 21:26:14,658][820675] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-09 21:26:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 29810688. Throughput: 0: 9369.7. Samples: 29810184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:18,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 21:26:19,171][820675] Updated weights for policy 0, policy_version 58240 (0.0004) [2023-03-09 21:26:23,492][820675] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-09 21:26:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 29859840. Throughput: 0: 9304.5. Samples: 29836248. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:23,539][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 21:26:27,898][820675] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-09 21:26:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 29904896. Throughput: 0: 9368.1. Samples: 29893396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:28,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:26:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058408_29904896.pth... [2023-03-09 21:26:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000057864_29626368.pth [2023-03-09 21:26:32,121][820675] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-09 21:26:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 29954048. Throughput: 0: 9376.9. Samples: 29949944. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:33,539][820373] Avg episode reward: [(0, '0.086')] [2023-03-09 21:26:36,482][820675] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-09 21:26:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 29999104. Throughput: 0: 9374.6. Samples: 29978600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:38,539][820373] Avg episode reward: [(0, '0.069')] [2023-03-09 21:26:40,655][820675] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-09 21:26:43,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 30048256. Throughput: 0: 9398.9. Samples: 30036616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:26:43,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:26:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058688_30048256.pth... [2023-03-09 21:26:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058136_29765632.pth [2023-03-09 21:26:45,265][820675] Updated weights for policy 0, policy_version 58720 (0.0004) [2023-03-09 21:26:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 30093312. Throughput: 0: 9344.7. Samples: 30089224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:26:48,540][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 21:26:49,971][820675] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-09 21:26:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 30138368. Throughput: 0: 9372.6. Samples: 30117688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:26:53,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:26:54,250][820675] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-09 21:26:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 30183424. Throughput: 0: 9320.7. Samples: 30171956. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:26:58,540][820373] Avg episode reward: [(0, '0.042')] [2023-03-09 21:26:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058952_30183424.pth... [2023-03-09 21:26:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058408_29904896.pth [2023-03-09 21:26:58,771][820675] Updated weights for policy 0, policy_version 58960 (0.0004) [2023-03-09 21:27:03,281][820675] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-09 21:27:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 30228480. Throughput: 0: 9257.2. Samples: 30226756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:27:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:07,607][820675] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-09 21:27:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 30277632. Throughput: 0: 9311.7. Samples: 30255276. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:27:08,539][820373] Avg episode reward: [(0, '0.079')] [2023-03-09 21:27:11,521][820675] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-09 21:27:13,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9352.6, 300 sec: 9400.0). Total num frames: 30326784. Throughput: 0: 9365.5. Samples: 30314844. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:27:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:27:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059232_30326784.pth... [2023-03-09 21:27:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058688_30048256.pth [2023-03-09 21:27:15,818][820675] Updated weights for policy 0, policy_version 59280 (0.0004) [2023-03-09 21:27:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 30371840. Throughput: 0: 9369.7. Samples: 30371580. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:27:18,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:27:20,551][820675] Updated weights for policy 0, policy_version 59360 (0.0004) [2023-03-09 21:27:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 30416896. Throughput: 0: 9293.5. Samples: 30396808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:24,810][820675] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-09 21:27:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 30470144. Throughput: 0: 9317.3. Samples: 30455896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:28,539][820373] Avg episode reward: [(0, '0.090')] [2023-03-09 21:27:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059512_30470144.pth... [2023-03-09 21:27:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000058952_30183424.pth [2023-03-09 21:27:28,904][820675] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-09 21:27:33,279][820675] Updated weights for policy 0, policy_version 59600 (0.0006) [2023-03-09 21:27:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 30515200. Throughput: 0: 9421.6. Samples: 30513196. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:33,539][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 21:27:37,906][820675] Updated weights for policy 0, policy_version 59680 (0.0004) [2023-03-09 21:27:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 30560256. Throughput: 0: 9379.9. Samples: 30539784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:42,399][820675] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-09 21:27:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 30605312. Throughput: 0: 9384.9. Samples: 30594276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:43,563][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059784_30609408.pth... [2023-03-09 21:27:43,565][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059232_30326784.pth [2023-03-09 21:27:46,540][820675] Updated weights for policy 0, policy_version 59840 (0.0005) [2023-03-09 21:27:48,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 30658560. Throughput: 0: 9469.8. Samples: 30652900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:50,667][820675] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-09 21:27:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 30703616. Throughput: 0: 9505.4. Samples: 30683020. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:27:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:54,927][820675] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-09 21:27:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 30752768. Throughput: 0: 9456.1. Samples: 30740368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:27:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:27:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060064_30752768.pth... [2023-03-09 21:27:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059512_30470144.pth [2023-03-09 21:27:59,096][820675] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-09 21:28:03,220][820675] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-09 21:28:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 30801920. Throughput: 0: 9521.6. Samples: 30800052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:07,529][820675] Updated weights for policy 0, policy_version 60240 (0.0004) [2023-03-09 21:28:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 30851072. Throughput: 0: 9577.7. Samples: 30827804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:08,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:28:11,884][820675] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-09 21:28:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 30896128. Throughput: 0: 9552.3. Samples: 30885748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:13,575][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060352_30900224.pth... [2023-03-09 21:28:13,577][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000059784_30609408.pth [2023-03-09 21:28:16,392][820675] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-09 21:28:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 30941184. Throughput: 0: 9474.9. Samples: 30939568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:20,862][820675] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-09 21:28:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 30990336. Throughput: 0: 9512.3. Samples: 30967836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:25,295][820675] Updated weights for policy 0, policy_version 60560 (0.0004) [2023-03-09 21:28:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 31035392. Throughput: 0: 9532.1. Samples: 31023220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060616_31035392.pth... [2023-03-09 21:28:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060064_30752768.pth [2023-03-09 21:28:29,662][820675] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-09 21:28:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9386.1). Total num frames: 31084544. Throughput: 0: 9501.0. Samples: 31080448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:28:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:34,036][820675] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-09 21:28:38,209][820675] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-09 21:28:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 31129600. Throughput: 0: 9463.1. Samples: 31108860. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:28:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:42,502][820675] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-09 21:28:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 31178752. Throughput: 0: 9468.8. Samples: 31166464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:28:43,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:28:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060896_31178752.pth... [2023-03-09 21:28:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060352_30900224.pth [2023-03-09 21:28:46,967][820675] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-09 21:28:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 31223808. Throughput: 0: 9380.0. Samples: 31222152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:28:48,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 21:28:51,379][820675] Updated weights for policy 0, policy_version 61040 (0.0004) [2023-03-09 21:28:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 31268864. Throughput: 0: 9369.2. Samples: 31249416. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:28:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:55,707][820675] Updated weights for policy 0, policy_version 61120 (0.0004) [2023-03-09 21:28:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 31318016. Throughput: 0: 9358.5. Samples: 31306880. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:28:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:28:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061168_31318016.pth... [2023-03-09 21:28:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060616_31035392.pth [2023-03-09 21:28:59,864][820675] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-09 21:29:03,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31367168. Throughput: 0: 9426.8. Samples: 31363772. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:29:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:04,352][820675] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-09 21:29:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 31412224. Throughput: 0: 9421.9. Samples: 31391820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:29:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:08,657][820675] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-09 21:29:12,911][820675] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-09 21:29:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31461376. Throughput: 0: 9470.8. Samples: 31449404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:29:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061448_31461376.pth... [2023-03-09 21:29:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000060896_31178752.pth [2023-03-09 21:29:17,281][820675] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-09 21:29:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31506432. Throughput: 0: 9459.7. Samples: 31506132. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:18,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 21:29:21,536][820675] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-09 21:29:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 31555584. Throughput: 0: 9456.9. Samples: 31534420. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:25,780][820675] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-09 21:29:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 31600640. Throughput: 0: 9467.9. Samples: 31592520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061728_31604736.pth... [2023-03-09 21:29:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061168_31318016.pth [2023-03-09 21:29:30,253][820675] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-09 21:29:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31649792. Throughput: 0: 9441.5. Samples: 31647020. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:34,746][820675] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-09 21:29:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31694848. Throughput: 0: 9447.4. Samples: 31674548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:39,064][820675] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-09 21:29:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 31739904. Throughput: 0: 9398.8. Samples: 31729824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:43,540][820373] Avg episode reward: [(0, '0.060')] [2023-03-09 21:29:43,564][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062000_31744000.pth... [2023-03-09 21:29:43,565][820675] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-09 21:29:43,566][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061448_31461376.pth [2023-03-09 21:29:47,661][820675] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-09 21:29:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31789056. Throughput: 0: 9450.1. Samples: 31789024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:29:52,142][820675] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-09 21:29:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 31838208. Throughput: 0: 9456.9. Samples: 31817380. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:56,541][820675] Updated weights for policy 0, policy_version 62240 (0.0006) [2023-03-09 21:29:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 31883264. Throughput: 0: 9369.9. Samples: 31871048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:29:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:29:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062272_31883264.pth... [2023-03-09 21:29:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000061728_31604736.pth [2023-03-09 21:30:00,738][820675] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-09 21:30:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 31932416. Throughput: 0: 9405.9. Samples: 31929400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:30:05,271][820675] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-09 21:30:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 31981568. Throughput: 0: 9390.5. Samples: 31956992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:08,539][820373] Avg episode reward: [(0, '0.084')] [2023-03-09 21:30:09,321][820675] Updated weights for policy 0, policy_version 62480 (0.0006) [2023-03-09 21:30:13,523][820675] Updated weights for policy 0, policy_version 62560 (0.0005) [2023-03-09 21:30:13,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9489.0, 300 sec: 9441.6). Total num frames: 32030720. Throughput: 0: 9457.0. Samples: 32018088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:13,540][820373] Avg episode reward: [(0, '0.121')] [2023-03-09 21:30:13,545][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062560_32030720.pth... [2023-03-09 21:30:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062000_31744000.pth [2023-03-09 21:30:17,731][820675] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-09 21:30:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 32079872. Throughput: 0: 9524.3. Samples: 32075616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:18,550][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 21:30:21,966][820675] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-09 21:30:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 32124928. Throughput: 0: 9553.5. Samples: 32104456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:23,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:30:26,505][820675] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-09 21:30:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 32169984. Throughput: 0: 9526.2. Samples: 32158504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 21:30:28,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 21:30:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062832_32169984.pth... [2023-03-09 21:30:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062272_31883264.pth [2023-03-09 21:30:30,746][820675] Updated weights for policy 0, policy_version 62880 (0.0006) [2023-03-09 21:30:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 32219136. Throughput: 0: 9466.9. Samples: 32215036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:33,540][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 21:30:35,358][820675] Updated weights for policy 0, policy_version 62960 (0.0006) [2023-03-09 21:30:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 32264192. Throughput: 0: 9451.6. Samples: 32242704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:38,540][820373] Avg episode reward: [(0, '4.621')] [2023-03-09 21:30:39,840][820675] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-09 21:30:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 32309248. Throughput: 0: 9522.6. Samples: 32299564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:43,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 21:30:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063104_32309248.pth... [2023-03-09 21:30:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062560_32030720.pth [2023-03-09 21:30:44,064][820675] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-09 21:30:48,319][820675] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-09 21:30:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 32358400. Throughput: 0: 9471.4. Samples: 32355612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:30:52,712][820675] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-09 21:30:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 32407552. Throughput: 0: 9499.5. Samples: 32384468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:53,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:30:56,889][820675] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-09 21:30:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 32456704. Throughput: 0: 9418.6. Samples: 32441924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:30:58,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:30:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063392_32456704.pth... [2023-03-09 21:30:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000062832_32169984.pth [2023-03-09 21:31:01,173][820675] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-09 21:31:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 32501760. Throughput: 0: 9380.4. Samples: 32497736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:31:03,540][820373] Avg episode reward: [(0, '0.135')] [2023-03-09 21:31:05,468][820675] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-09 21:31:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 32550912. Throughput: 0: 9433.2. Samples: 32528952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:31:08,539][820373] Avg episode reward: [(0, '0.117')] [2023-03-09 21:31:09,796][820675] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-09 21:31:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 32595968. Throughput: 0: 9481.3. Samples: 32585164. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:31:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063664_32595968.pth... [2023-03-09 21:31:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063104_32309248.pth [2023-03-09 21:31:14,303][820675] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-09 21:31:18,434][820675] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-09 21:31:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 32645120. Throughput: 0: 9467.8. Samples: 32641088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:31:22,851][820675] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-09 21:31:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 32690176. Throughput: 0: 9479.1. Samples: 32669264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:31:27,139][820675] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-09 21:31:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9441.6). Total num frames: 32739328. Throughput: 0: 9494.5. Samples: 32726816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:31:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063944_32739328.pth... [2023-03-09 21:31:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063392_32456704.pth [2023-03-09 21:31:31,466][820675] Updated weights for policy 0, policy_version 64000 (0.0006) [2023-03-09 21:31:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 32784384. Throughput: 0: 9477.4. Samples: 32782096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:33,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:31:35,632][820675] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-09 21:31:38,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 32833536. Throughput: 0: 9525.6. Samples: 32813120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:38,539][820373] Avg episode reward: [(0, '0.090')] [2023-03-09 21:31:40,148][820675] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-09 21:31:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 32882688. Throughput: 0: 9479.7. Samples: 32868512. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:31:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:31:43,545][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064224_32882688.pth... [2023-03-09 21:31:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063664_32595968.pth [2023-03-09 21:31:44,501][820675] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-09 21:31:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 32927744. Throughput: 0: 9466.3. Samples: 32923720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:31:48,539][820373] Avg episode reward: [(0, '0.083')] [2023-03-09 21:31:48,940][820675] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-09 21:31:53,093][820675] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-09 21:31:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 32976896. Throughput: 0: 9405.9. Samples: 32952216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:31:53,539][820373] Avg episode reward: [(0, '0.106')] [2023-03-09 21:31:57,354][820675] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-09 21:31:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 33021952. Throughput: 0: 9444.0. Samples: 33010144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:31:58,550][820373] Avg episode reward: [(0, '0.075')] [2023-03-09 21:31:58,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064496_33021952.pth... [2023-03-09 21:31:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000063944_32739328.pth [2023-03-09 21:32:01,585][820675] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-09 21:32:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 33071104. Throughput: 0: 9468.6. Samples: 33067176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:32:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:06,078][820675] Updated weights for policy 0, policy_version 64640 (0.0004) [2023-03-09 21:32:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 33116160. Throughput: 0: 9476.3. Samples: 33095696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:32:08,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:32:10,602][820675] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-09 21:32:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 33161216. Throughput: 0: 9388.9. Samples: 33149316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:32:13,539][820373] Avg episode reward: [(0, '0.221')] [2023-03-09 21:32:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064768_33161216.pth... [2023-03-09 21:32:13,548][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064224_32882688.pth [2023-03-09 21:32:15,004][820675] Updated weights for policy 0, policy_version 64800 (0.0004) [2023-03-09 21:32:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 33210368. Throughput: 0: 9426.0. Samples: 33206268. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:32:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:19,416][820675] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-09 21:32:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 33251328. Throughput: 0: 9364.2. Samples: 33234508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:32:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:23,992][820675] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-09 21:32:28,331][820675] Updated weights for policy 0, policy_version 65040 (0.0004) [2023-03-09 21:32:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 33300480. Throughput: 0: 9310.5. Samples: 33287484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065040_33300480.pth... [2023-03-09 21:32:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064496_33021952.pth [2023-03-09 21:32:32,693][820675] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-09 21:32:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 33345536. Throughput: 0: 9373.7. Samples: 33345536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:36,797][820675] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-09 21:32:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 33394688. Throughput: 0: 9377.9. Samples: 33374220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:38,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 21:32:41,320][820675] Updated weights for policy 0, policy_version 65280 (0.0004) [2023-03-09 21:32:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 33439744. Throughput: 0: 9344.3. Samples: 33430636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:43,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 21:32:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065312_33439744.pth... [2023-03-09 21:32:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000064768_33161216.pth [2023-03-09 21:32:45,811][820675] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-09 21:32:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 33488896. Throughput: 0: 9280.8. Samples: 33484812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:50,345][820675] Updated weights for policy 0, policy_version 65440 (0.0004) [2023-03-09 21:32:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 33533952. Throughput: 0: 9282.9. Samples: 33513424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:32:54,567][820675] Updated weights for policy 0, policy_version 65520 (0.0005) [2023-03-09 21:32:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 33583104. Throughput: 0: 9366.9. Samples: 33570828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:32:58,539][820373] Avg episode reward: [(0, '0.060')] [2023-03-09 21:32:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065592_33583104.pth... [2023-03-09 21:32:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065040_33300480.pth [2023-03-09 21:32:58,604][820675] Updated weights for policy 0, policy_version 65600 (0.0005) [2023-03-09 21:33:02,921][820675] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-09 21:33:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 33632256. Throughput: 0: 9400.7. Samples: 33629300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:07,489][820675] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-09 21:33:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 33677312. Throughput: 0: 9384.9. Samples: 33656828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:11,688][820675] Updated weights for policy 0, policy_version 65840 (0.0004) [2023-03-09 21:33:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 33726464. Throughput: 0: 9482.2. Samples: 33714184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:33:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065872_33726464.pth... [2023-03-09 21:33:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065312_33439744.pth [2023-03-09 21:33:15,907][820675] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-09 21:33:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 33775616. Throughput: 0: 9495.8. Samples: 33772848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:20,143][820675] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-09 21:33:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 33820672. Throughput: 0: 9464.6. Samples: 33800128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:24,557][820675] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-09 21:33:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 33865728. Throughput: 0: 9445.3. Samples: 33855676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:28,539][820373] Avg episode reward: [(0, '0.059')] [2023-03-09 21:33:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066144_33865728.pth... [2023-03-09 21:33:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065592_33583104.pth [2023-03-09 21:33:29,007][820675] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-09 21:33:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 33910784. Throughput: 0: 9466.1. Samples: 33910784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:33,539][820373] Avg episode reward: [(0, '0.043')] [2023-03-09 21:33:33,562][820675] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-09 21:33:38,026][820675] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-09 21:33:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 33959936. Throughput: 0: 9423.8. Samples: 33937496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:42,273][820675] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-09 21:33:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 34004992. Throughput: 0: 9420.0. Samples: 33994728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:43,539][820373] Avg episode reward: [(0, '0.074')] [2023-03-09 21:33:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066416_34004992.pth... [2023-03-09 21:33:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000065872_33726464.pth [2023-03-09 21:33:46,182][820675] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-09 21:33:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 34058240. Throughput: 0: 9442.6. Samples: 34054216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:33:48,540][820373] Avg episode reward: [(0, '0.054')] [2023-03-09 21:33:50,652][820675] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-09 21:33:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34103296. Throughput: 0: 9465.9. Samples: 34082792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:33:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:54,887][820675] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-09 21:33:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34152448. Throughput: 0: 9466.4. Samples: 34140172. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:33:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:33:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066704_34152448.pth... [2023-03-09 21:33:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066144_33865728.pth [2023-03-09 21:33:59,229][820675] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-09 21:34:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 34197504. Throughput: 0: 9387.6. Samples: 34195288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:34:03,657][820675] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-09 21:34:08,123][820675] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-09 21:34:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34246656. Throughput: 0: 9378.1. Samples: 34222144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:34:12,573][820675] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-09 21:34:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 34291712. Throughput: 0: 9416.6. Samples: 34279424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:34:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066976_34291712.pth... [2023-03-09 21:34:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066416_34004992.pth [2023-03-09 21:34:16,835][820675] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-09 21:34:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 34336768. Throughput: 0: 9440.7. Samples: 34335616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:18,539][820373] Avg episode reward: [(0, '1.530')] [2023-03-09 21:34:21,239][820675] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-09 21:34:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 34385920. Throughput: 0: 9454.6. Samples: 34362952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:23,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 21:34:25,466][820675] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-09 21:34:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34435072. Throughput: 0: 9497.4. Samples: 34422108. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:34:28,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:34:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067256_34435072.pth... [2023-03-09 21:34:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066704_34152448.pth [2023-03-09 21:34:29,756][820675] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-09 21:34:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 34484224. Throughput: 0: 9464.7. Samples: 34480128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:34:33,869][820675] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-09 21:34:38,433][820675] Updated weights for policy 0, policy_version 67440 (0.0006) [2023-03-09 21:34:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 34529280. Throughput: 0: 9465.9. Samples: 34508760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:34:42,627][820675] Updated weights for policy 0, policy_version 67520 (0.0006) [2023-03-09 21:34:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34574336. Throughput: 0: 9452.2. Samples: 34565520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:34:43,560][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067536_34578432.pth... [2023-03-09 21:34:43,562][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000066976_34291712.pth [2023-03-09 21:34:46,821][820675] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-09 21:34:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 34623488. Throughput: 0: 9490.1. Samples: 34622344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:48,540][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 21:34:51,250][820675] Updated weights for policy 0, policy_version 67680 (0.0004) [2023-03-09 21:34:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 34672640. Throughput: 0: 9498.8. Samples: 34649588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:53,550][820373] Avg episode reward: [(0, '1.411')] [2023-03-09 21:34:55,563][820675] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-09 21:34:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 34717696. Throughput: 0: 9492.9. Samples: 34706604. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:34:58,539][820373] Avg episode reward: [(0, '0.378')] [2023-03-09 21:34:58,552][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067808_34717696.pth... [2023-03-09 21:34:58,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067256_34435072.pth [2023-03-09 21:34:59,882][820675] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-09 21:35:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 34766848. Throughput: 0: 9497.8. Samples: 34763016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:35:03,540][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 21:35:04,323][820675] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-09 21:35:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 34811904. Throughput: 0: 9521.6. Samples: 34791424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:35:08,539][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 21:35:08,847][820675] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-09 21:35:13,316][820675] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-09 21:35:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 34856960. Throughput: 0: 9426.3. Samples: 34846292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:13,540][820373] Avg episode reward: [(0, '0.629')] [2023-03-09 21:35:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068080_34856960.pth... [2023-03-09 21:35:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067536_34578432.pth [2023-03-09 21:35:17,425][820675] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-09 21:35:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 34906112. Throughput: 0: 9416.3. Samples: 34903860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:18,539][820373] Avg episode reward: [(0, '4.110')] [2023-03-09 21:35:21,767][820675] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-09 21:35:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.0, 300 sec: 9441.6). Total num frames: 34955264. Throughput: 0: 9395.6. Samples: 34931560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:23,539][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 21:35:26,272][820675] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-09 21:35:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35000320. Throughput: 0: 9388.4. Samples: 34988000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:35:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068360_35000320.pth... [2023-03-09 21:35:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000067808_34717696.pth [2023-03-09 21:35:30,642][820675] Updated weights for policy 0, policy_version 68400 (0.0004) [2023-03-09 21:35:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 35045376. Throughput: 0: 9336.4. Samples: 35042480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:35:35,005][820675] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-09 21:35:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 35090432. Throughput: 0: 9376.9. Samples: 35071548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:38,539][820373] Avg episode reward: [(0, '5.093')] [2023-03-09 21:35:39,455][820675] Updated weights for policy 0, policy_version 68560 (0.0006) [2023-03-09 21:35:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35139584. Throughput: 0: 9347.4. Samples: 35127240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:43,539][820373] Avg episode reward: [(0, '0.027')] [2023-03-09 21:35:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068632_35139584.pth... [2023-03-09 21:35:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068080_34856960.pth [2023-03-09 21:35:43,810][820675] Updated weights for policy 0, policy_version 68640 (0.0006) [2023-03-09 21:35:47,974][820675] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-09 21:35:48,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35188736. Throughput: 0: 9381.8. Samples: 35185196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:48,539][820373] Avg episode reward: [(0, '0.803')] [2023-03-09 21:35:52,316][820675] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-09 21:35:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35237888. Throughput: 0: 9375.3. Samples: 35213312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:53,539][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 21:35:56,507][820675] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-09 21:35:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35282944. Throughput: 0: 9449.8. Samples: 35271532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:35:58,539][820373] Avg episode reward: [(0, '0.220')] [2023-03-09 21:35:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068912_35282944.pth... [2023-03-09 21:35:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068360_35000320.pth [2023-03-09 21:36:00,836][820675] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-09 21:36:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35332096. Throughput: 0: 9431.8. Samples: 35328292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:05,136][820675] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-09 21:36:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35377152. Throughput: 0: 9448.4. Samples: 35356736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:09,574][820675] Updated weights for policy 0, policy_version 69120 (0.0004) [2023-03-09 21:36:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 35426304. Throughput: 0: 9487.5. Samples: 35414936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:13,561][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069200_35430400.pth... [2023-03-09 21:36:13,562][820675] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-09 21:36:13,563][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068632_35139584.pth [2023-03-09 21:36:18,021][820675] Updated weights for policy 0, policy_version 69280 (0.0004) [2023-03-09 21:36:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 35475456. Throughput: 0: 9532.3. Samples: 35471432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:22,475][820675] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-09 21:36:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35520512. Throughput: 0: 9519.7. Samples: 35499936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:26,906][820675] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-09 21:36:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35565568. Throughput: 0: 9500.3. Samples: 35554752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:28,539][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 21:36:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069464_35565568.pth... [2023-03-09 21:36:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000068912_35282944.pth [2023-03-09 21:36:31,379][820675] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-09 21:36:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 35610624. Throughput: 0: 9407.7. Samples: 35608544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:35,818][820675] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-09 21:36:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 35659776. Throughput: 0: 9433.9. Samples: 35637840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:39,932][820675] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-09 21:36:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 35708928. Throughput: 0: 9447.0. Samples: 35696648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069744_35708928.pth... [2023-03-09 21:36:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069200_35430400.pth [2023-03-09 21:36:44,436][820675] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-09 21:36:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 35753984. Throughput: 0: 9426.5. Samples: 35752484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:48,597][820675] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-09 21:36:52,535][820675] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-09 21:36:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 35807232. Throughput: 0: 9529.5. Samples: 35785564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:53,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:56,890][820675] Updated weights for policy 0, policy_version 70000 (0.0004) [2023-03-09 21:36:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.0, 300 sec: 9427.7). Total num frames: 35852288. Throughput: 0: 9484.6. Samples: 35841744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:36:58,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:36:58,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070024_35852288.pth... [2023-03-09 21:36:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069464_35565568.pth [2023-03-09 21:37:01,374][820675] Updated weights for policy 0, policy_version 70080 (0.0004) [2023-03-09 21:37:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 35897344. Throughput: 0: 9464.2. Samples: 35897320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:37:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:05,664][820675] Updated weights for policy 0, policy_version 70160 (0.0004) [2023-03-09 21:37:08,539][820373] Fps is (10 sec: 9830.6, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 35950592. Throughput: 0: 9468.7. Samples: 35926024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:37:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:09,837][820675] Updated weights for policy 0, policy_version 70240 (0.0004) [2023-03-09 21:37:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 35995648. Throughput: 0: 9524.6. Samples: 35983360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:37:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070304_35995648.pth... [2023-03-09 21:37:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000069744_35708928.pth [2023-03-09 21:37:14,374][820675] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-09 21:37:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 36040704. Throughput: 0: 9581.7. Samples: 36039720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:37:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:18,669][820675] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-09 21:37:23,090][820675] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-09 21:37:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 36089856. Throughput: 0: 9500.3. Samples: 36065352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:27,467][820675] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-09 21:37:28,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 36134912. Throughput: 0: 9466.3. Samples: 36122632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070576_36134912.pth... [2023-03-09 21:37:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070024_35852288.pth [2023-03-09 21:37:32,003][820675] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-09 21:37:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 36179968. Throughput: 0: 9447.8. Samples: 36177636. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:36,395][820675] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-09 21:37:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 36229120. Throughput: 0: 9312.3. Samples: 36204616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:40,573][820675] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-09 21:37:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 36274176. Throughput: 0: 9350.8. Samples: 36262532. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:43,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 21:37:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070848_36274176.pth... [2023-03-09 21:37:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070304_35995648.pth [2023-03-09 21:37:45,073][820675] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-09 21:37:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 36323328. Throughput: 0: 9387.6. Samples: 36319764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:48,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:49,379][820675] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-09 21:37:53,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9352.6, 300 sec: 9441.6). Total num frames: 36368384. Throughput: 0: 9375.3. Samples: 36347912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:53,737][820675] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-09 21:37:58,051][820675] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-09 21:37:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 36417536. Throughput: 0: 9332.4. Samples: 36403320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:37:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:37:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071128_36417536.pth... [2023-03-09 21:37:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070576_36134912.pth [2023-03-09 21:38:02,367][820675] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-09 21:38:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 36462592. Throughput: 0: 9368.8. Samples: 36461316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:38:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:06,711][820675] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-09 21:38:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 36511744. Throughput: 0: 9418.4. Samples: 36489180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:10,805][820675] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-09 21:38:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 36560896. Throughput: 0: 9454.4. Samples: 36548080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:13,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:38:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071408_36560896.pth... [2023-03-09 21:38:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000070848_36274176.pth [2023-03-09 21:38:15,302][820675] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-09 21:38:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 36605952. Throughput: 0: 9428.7. Samples: 36601928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:18,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:38:19,552][820675] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-09 21:38:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 36651008. Throughput: 0: 9466.3. Samples: 36630600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:24,058][820675] Updated weights for policy 0, policy_version 71600 (0.0004) [2023-03-09 21:38:28,488][820675] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-09 21:38:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 36700160. Throughput: 0: 9451.1. Samples: 36687832. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:28,539][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 21:38:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071680_36700160.pth... [2023-03-09 21:38:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071128_36417536.pth [2023-03-09 21:38:32,808][820675] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-09 21:38:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 36749312. Throughput: 0: 9424.9. Samples: 36743884. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:37,108][820675] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-09 21:38:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 36794368. Throughput: 0: 9404.9. Samples: 36771132. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:41,511][820675] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-09 21:38:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 36839424. Throughput: 0: 9424.4. Samples: 36827420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:38:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071952_36839424.pth... [2023-03-09 21:38:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071408_36560896.pth [2023-03-09 21:38:45,966][820675] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-09 21:38:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 36884480. Throughput: 0: 9335.8. Samples: 36881428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:38:48,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:50,491][820675] Updated weights for policy 0, policy_version 72080 (0.0004) [2023-03-09 21:38:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 36933632. Throughput: 0: 9342.1. Samples: 36909576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:38:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:38:54,832][820675] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-09 21:38:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 36974592. Throughput: 0: 9294.0. Samples: 36966308. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:38:58,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:38:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072216_36974592.pth... [2023-03-09 21:38:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071680_36700160.pth [2023-03-09 21:38:59,456][820675] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-09 21:39:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 37023744. Throughput: 0: 9373.7. Samples: 37023744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:03,554][820675] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-09 21:39:07,605][820675] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-09 21:39:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 37072896. Throughput: 0: 9414.0. Samples: 37054232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:12,140][820675] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-09 21:39:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 37117952. Throughput: 0: 9373.7. Samples: 37109648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:13,558][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072504_37122048.pth... [2023-03-09 21:39:13,559][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000071952_36839424.pth [2023-03-09 21:39:16,633][820675] Updated weights for policy 0, policy_version 72560 (0.0004) [2023-03-09 21:39:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 37167104. Throughput: 0: 9371.3. Samples: 37165592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:20,885][820675] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-09 21:39:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 37212160. Throughput: 0: 9380.2. Samples: 37193240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:25,421][820675] Updated weights for policy 0, policy_version 72720 (0.0004) [2023-03-09 21:39:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 37261312. Throughput: 0: 9363.6. Samples: 37248780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:39:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072776_37261312.pth... [2023-03-09 21:39:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072216_36974592.pth [2023-03-09 21:39:29,828][820675] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-09 21:39:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 37306368. Throughput: 0: 9353.7. Samples: 37302344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:34,327][820675] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-09 21:39:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 37351424. Throughput: 0: 9367.0. Samples: 37331088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:38,539][820373] Avg episode reward: [(0, '0.218')] [2023-03-09 21:39:38,557][820675] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-09 21:39:42,834][820675] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-09 21:39:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 37400576. Throughput: 0: 9390.0. Samples: 37388860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073048_37400576.pth... [2023-03-09 21:39:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072504_37122048.pth [2023-03-09 21:39:47,383][820675] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-09 21:39:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 37445632. Throughput: 0: 9339.0. Samples: 37444000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:48,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:39:51,934][820675] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-09 21:39:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 37490688. Throughput: 0: 9248.6. Samples: 37470420. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:53,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:39:56,442][820675] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-09 21:39:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 37535744. Throughput: 0: 9235.9. Samples: 37525264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:39:58,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:39:58,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073312_37535744.pth... [2023-03-09 21:39:58,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000072776_37261312.pth [2023-03-09 21:40:00,760][820675] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-09 21:40:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 37584896. Throughput: 0: 9229.1. Samples: 37580900. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:40:03,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:40:05,321][820675] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-09 21:40:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 37629952. Throughput: 0: 9224.2. Samples: 37608328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:40:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:09,679][820675] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-09 21:40:13,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9284.2, 300 sec: 9386.1). Total num frames: 37675008. Throughput: 0: 9207.0. Samples: 37663096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:40:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073584_37675008.pth... [2023-03-09 21:40:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073048_37400576.pth [2023-03-09 21:40:14,342][820675] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-09 21:40:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 37720064. Throughput: 0: 9222.1. Samples: 37717340. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:18,864][820675] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-09 21:40:23,289][820675] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-09 21:40:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 37765120. Throughput: 0: 9189.5. Samples: 37744616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:27,979][820675] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-09 21:40:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9372.2). Total num frames: 37810176. Throughput: 0: 9094.3. Samples: 37798104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073848_37810176.pth... [2023-03-09 21:40:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073312_37535744.pth [2023-03-09 21:40:32,549][820675] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-09 21:40:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9372.2). Total num frames: 37855232. Throughput: 0: 9048.9. Samples: 37851200. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:36,962][820675] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-09 21:40:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9358.3). Total num frames: 37900288. Throughput: 0: 9097.5. Samples: 37879808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:41,453][820675] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-09 21:40:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9344.4). Total num frames: 37945344. Throughput: 0: 9123.7. Samples: 37935832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:43,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:40:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074112_37945344.pth... [2023-03-09 21:40:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073584_37675008.pth [2023-03-09 21:40:45,945][820675] Updated weights for policy 0, policy_version 74160 (0.0006) [2023-03-09 21:40:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 37994496. Throughput: 0: 9099.6. Samples: 37990384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:48,539][820373] Avg episode reward: [(0, '0.354')] [2023-03-09 21:40:50,267][820675] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-09 21:40:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 38039552. Throughput: 0: 9125.2. Samples: 38018960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:53,539][820373] Avg episode reward: [(0, '0.354')] [2023-03-09 21:40:54,644][820675] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-09 21:40:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 38084608. Throughput: 0: 9152.0. Samples: 38074936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:40:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:40:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074384_38084608.pth... [2023-03-09 21:40:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000073848_37810176.pth [2023-03-09 21:40:59,093][820675] Updated weights for policy 0, policy_version 74400 (0.0006) [2023-03-09 21:41:03,505][820675] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-09 21:41:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 38133760. Throughput: 0: 9164.2. Samples: 38129728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:07,908][820675] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-09 21:41:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 38178816. Throughput: 0: 9193.8. Samples: 38158336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:12,324][820675] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-09 21:41:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.8, 300 sec: 9316.7). Total num frames: 38223872. Throughput: 0: 9239.6. Samples: 38213884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074664_38227968.pth... [2023-03-09 21:41:13,554][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074112_37945344.pth [2023-03-09 21:41:16,618][820675] Updated weights for policy 0, policy_version 74720 (0.0004) [2023-03-09 21:41:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 38273024. Throughput: 0: 9313.4. Samples: 38270304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:20,828][820675] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-09 21:41:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 38322176. Throughput: 0: 9338.1. Samples: 38300024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:25,233][820675] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-09 21:41:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 38371328. Throughput: 0: 9384.4. Samples: 38358128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074944_38371328.pth... [2023-03-09 21:41:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074384_38084608.pth [2023-03-09 21:41:29,294][820675] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-09 21:41:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 38416384. Throughput: 0: 9448.3. Samples: 38415556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:33,623][820675] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-09 21:41:38,190][820675] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-09 21:41:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 38461440. Throughput: 0: 9411.2. Samples: 38442464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:42,616][820675] Updated weights for policy 0, policy_version 75200 (0.0004) [2023-03-09 21:41:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 38510592. Throughput: 0: 9401.1. Samples: 38497984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075216_38510592.pth... [2023-03-09 21:41:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074664_38227968.pth [2023-03-09 21:41:46,585][820675] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-09 21:41:48,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 38559744. Throughput: 0: 9470.3. Samples: 38555892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:41:48,550][820373] Avg episode reward: [(0, '2.127')] [2023-03-09 21:41:51,152][820675] Updated weights for policy 0, policy_version 75360 (0.0004) [2023-03-09 21:41:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 38604800. Throughput: 0: 9460.9. Samples: 38584076. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:41:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:55,384][820675] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-09 21:41:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 38653952. Throughput: 0: 9505.6. Samples: 38641636. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:41:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:41:58,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075496_38653952.pth... [2023-03-09 21:41:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000074944_38371328.pth [2023-03-09 21:41:59,816][820675] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-09 21:42:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 38699008. Throughput: 0: 9437.1. Samples: 38694976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:03,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:42:04,289][820675] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-09 21:42:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 38744064. Throughput: 0: 9416.1. Samples: 38723748. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:08,745][820675] Updated weights for policy 0, policy_version 75680 (0.0005) [2023-03-09 21:42:13,141][820675] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-09 21:42:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 38789120. Throughput: 0: 9365.9. Samples: 38779592. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075760_38789120.pth... [2023-03-09 21:42:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075216_38510592.pth [2023-03-09 21:42:17,477][820675] Updated weights for policy 0, policy_version 75840 (0.0005) [2023-03-09 21:42:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 38838272. Throughput: 0: 9320.5. Samples: 38834980. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:21,846][820675] Updated weights for policy 0, policy_version 75920 (0.0004) [2023-03-09 21:42:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 38887424. Throughput: 0: 9345.2. Samples: 38862996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:23,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:42:26,179][820675] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-09 21:42:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 38932480. Throughput: 0: 9383.8. Samples: 38920256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:28,540][820373] Avg episode reward: [(0, '0.197')] [2023-03-09 21:42:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076040_38932480.pth... [2023-03-09 21:42:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075496_38653952.pth [2023-03-09 21:42:30,744][820675] Updated weights for policy 0, policy_version 76080 (0.0005) [2023-03-09 21:42:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 38977536. Throughput: 0: 9279.1. Samples: 38973452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:42:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:35,342][820675] Updated weights for policy 0, policy_version 76160 (0.0004) [2023-03-09 21:42:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39022592. Throughput: 0: 9285.3. Samples: 39001916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:42:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:39,652][820675] Updated weights for policy 0, policy_version 76240 (0.0004) [2023-03-09 21:42:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39071744. Throughput: 0: 9286.3. Samples: 39059520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:42:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076312_39071744.pth... [2023-03-09 21:42:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000075760_38789120.pth [2023-03-09 21:42:43,873][820675] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-09 21:42:48,122][820675] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-09 21:42:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 39116800. Throughput: 0: 9362.7. Samples: 39116296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:42:48,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:52,317][820675] Updated weights for policy 0, policy_version 76480 (0.0005) [2023-03-09 21:42:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39165952. Throughput: 0: 9369.4. Samples: 39145372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:42:53,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:56,838][820675] Updated weights for policy 0, policy_version 76560 (0.0005) [2023-03-09 21:42:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 39211008. Throughput: 0: 9361.9. Samples: 39200876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:42:58,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:42:58,552][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076584_39211008.pth... [2023-03-09 21:42:58,554][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076040_38932480.pth [2023-03-09 21:43:01,322][820675] Updated weights for policy 0, policy_version 76640 (0.0004) [2023-03-09 21:43:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39260160. Throughput: 0: 9379.3. Samples: 39257048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:43:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:05,514][820675] Updated weights for policy 0, policy_version 76720 (0.0004) [2023-03-09 21:43:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 39305216. Throughput: 0: 9379.8. Samples: 39285088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:43:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:10,020][820675] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-09 21:43:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 39354368. Throughput: 0: 9368.6. Samples: 39341840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:43:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076864_39354368.pth... [2023-03-09 21:43:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076312_39071744.pth [2023-03-09 21:43:14,231][820675] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-09 21:43:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39399424. Throughput: 0: 9446.9. Samples: 39398564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:43:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:18,639][820675] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-09 21:43:22,907][820675] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-09 21:43:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39448576. Throughput: 0: 9453.2. Samples: 39427312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:23,540][820373] Avg episode reward: [(0, '0.043')] [2023-03-09 21:43:27,391][820675] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-09 21:43:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9302.8). Total num frames: 39493632. Throughput: 0: 9399.8. Samples: 39482508. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:28,540][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 21:43:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077136_39493632.pth... [2023-03-09 21:43:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076584_39211008.pth [2023-03-09 21:43:31,546][820675] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-09 21:43:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 39542784. Throughput: 0: 9410.8. Samples: 39539780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:35,820][820675] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-09 21:43:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 39591936. Throughput: 0: 9435.8. Samples: 39569984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:40,155][820675] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-09 21:43:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 39636992. Throughput: 0: 9434.9. Samples: 39625444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077416_39636992.pth... [2023-03-09 21:43:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000076864_39354368.pth [2023-03-09 21:43:44,681][820675] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-09 21:43:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 39682048. Throughput: 0: 9390.8. Samples: 39679632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:49,296][820675] Updated weights for policy 0, policy_version 77520 (0.0004) [2023-03-09 21:43:53,487][820675] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-09 21:43:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 39731200. Throughput: 0: 9387.5. Samples: 39707524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:57,933][820675] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-09 21:43:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 39776256. Throughput: 0: 9380.4. Samples: 39763960. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:43:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:43:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077688_39776256.pth... [2023-03-09 21:43:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077136_39493632.pth [2023-03-09 21:44:02,315][820675] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-09 21:44:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39821312. Throughput: 0: 9375.7. Samples: 39820472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:44:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:06,609][820675] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-09 21:44:08,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39866368. Throughput: 0: 9384.9. Samples: 39849632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:44:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:11,155][820675] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-09 21:44:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39915520. Throughput: 0: 9348.7. Samples: 39903200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077960_39915520.pth... [2023-03-09 21:44:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077416_39636992.pth [2023-03-09 21:44:15,648][820675] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-09 21:44:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 39960576. Throughput: 0: 9284.9. Samples: 39957600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:20,051][820675] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-09 21:44:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 40009728. Throughput: 0: 9307.8. Samples: 39988836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:24,158][820675] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-09 21:44:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 40054784. Throughput: 0: 9292.5. Samples: 40043608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:28,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 21:44:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078232_40054784.pth... [2023-03-09 21:44:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077688_39776256.pth [2023-03-09 21:44:28,658][820675] Updated weights for policy 0, policy_version 78240 (0.0006) [2023-03-09 21:44:33,040][820675] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-09 21:44:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 40103936. Throughput: 0: 9339.4. Samples: 40099904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:33,539][820373] Avg episode reward: [(0, '0.075')] [2023-03-09 21:44:37,088][820675] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-09 21:44:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 40153088. Throughput: 0: 9374.6. Samples: 40129380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:41,568][820675] Updated weights for policy 0, policy_version 78480 (0.0004) [2023-03-09 21:44:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 40198144. Throughput: 0: 9389.8. Samples: 40186500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:43,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:44:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078512_40198144.pth... [2023-03-09 21:44:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000077960_39915520.pth [2023-03-09 21:44:46,074][820675] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-09 21:44:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 40243200. Throughput: 0: 9360.3. Samples: 40241684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:48,539][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 21:44:50,564][820675] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-09 21:44:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 40288256. Throughput: 0: 9316.8. Samples: 40268888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:44:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:54,948][820675] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-09 21:44:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 40333312. Throughput: 0: 9370.8. Samples: 40324888. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:44:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:44:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078776_40333312.pth... [2023-03-09 21:44:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078232_40054784.pth [2023-03-09 21:44:59,481][820675] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-09 21:45:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 40382464. Throughput: 0: 9372.1. Samples: 40379344. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:03,775][820675] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-09 21:45:08,399][820675] Updated weights for policy 0, policy_version 78960 (0.0004) [2023-03-09 21:45:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 40427520. Throughput: 0: 9295.9. Samples: 40407152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:12,808][820675] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-09 21:45:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 40472576. Throughput: 0: 9293.1. Samples: 40461800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079048_40472576.pth... [2023-03-09 21:45:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078512_40198144.pth [2023-03-09 21:45:16,944][820675] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-09 21:45:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 40521728. Throughput: 0: 9318.8. Samples: 40519252. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:18,540][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:45:21,563][820675] Updated weights for policy 0, policy_version 79200 (0.0004) [2023-03-09 21:45:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 40566784. Throughput: 0: 9265.2. Samples: 40546312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:25,871][820675] Updated weights for policy 0, policy_version 79280 (0.0006) [2023-03-09 21:45:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 40615936. Throughput: 0: 9264.2. Samples: 40603388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:28,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:45:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079328_40615936.pth... [2023-03-09 21:45:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000078776_40333312.pth [2023-03-09 21:45:30,194][820675] Updated weights for policy 0, policy_version 79360 (0.0006) [2023-03-09 21:45:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 40660992. Throughput: 0: 9306.9. Samples: 40660496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:34,457][820675] Updated weights for policy 0, policy_version 79440 (0.0006) [2023-03-09 21:45:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 40710144. Throughput: 0: 9360.6. Samples: 40690116. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:38,661][820675] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-09 21:45:42,985][820675] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-09 21:45:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 40759296. Throughput: 0: 9382.5. Samples: 40747100. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 21:45:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079608_40759296.pth... [2023-03-09 21:45:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079048_40472576.pth [2023-03-09 21:45:47,377][820675] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-09 21:45:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 40804352. Throughput: 0: 9403.3. Samples: 40802492. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:45:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:52,027][820675] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-09 21:45:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 40849408. Throughput: 0: 9373.0. Samples: 40828936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:45:53,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:45:56,350][820675] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-09 21:45:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 40898560. Throughput: 0: 9401.4. Samples: 40884864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:45:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:45:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079880_40898560.pth... [2023-03-09 21:45:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079328_40615936.pth [2023-03-09 21:46:00,738][820675] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-09 21:46:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 40943616. Throughput: 0: 9359.1. Samples: 40940412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:05,188][820675] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-09 21:46:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 40988672. Throughput: 0: 9376.5. Samples: 40968256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:09,560][820675] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-09 21:46:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 41033728. Throughput: 0: 9372.1. Samples: 41025132. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:13,571][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080152_41037824.pth... [2023-03-09 21:46:13,573][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079608_40759296.pth [2023-03-09 21:46:13,967][820675] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-09 21:46:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 41078784. Throughput: 0: 9291.7. Samples: 41078620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:46:18,651][820675] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-09 21:46:22,996][820675] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-09 21:46:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 41127936. Throughput: 0: 9202.2. Samples: 41104212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:27,329][820675] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-09 21:46:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 41172992. Throughput: 0: 9236.0. Samples: 41162720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080416_41172992.pth... [2023-03-09 21:46:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000079880_40898560.pth [2023-03-09 21:46:31,964][820675] Updated weights for policy 0, policy_version 80480 (0.0004) [2023-03-09 21:46:33,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 41218048. Throughput: 0: 9193.1. Samples: 41216180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 21:46:33,540][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 21:46:36,547][820675] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-09 21:46:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 41263104. Throughput: 0: 9194.5. Samples: 41242688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:46:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:40,896][820675] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-09 21:46:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 41308160. Throughput: 0: 9180.9. Samples: 41298004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:46:43,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:46:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080680_41308160.pth... [2023-03-09 21:46:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080152_41037824.pth [2023-03-09 21:46:45,480][820675] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-09 21:46:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 41353216. Throughput: 0: 9170.8. Samples: 41353100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:46:48,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 21:46:49,961][820675] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-09 21:46:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 41398272. Throughput: 0: 9132.3. Samples: 41379208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:46:53,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:46:54,648][820675] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-09 21:46:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 41447424. Throughput: 0: 9105.9. Samples: 41434900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:46:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:46:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080952_41447424.pth... [2023-03-09 21:46:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080416_41172992.pth [2023-03-09 21:46:58,885][820675] Updated weights for policy 0, policy_version 80960 (0.0004) [2023-03-09 21:47:03,285][820675] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-09 21:47:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 41492480. Throughput: 0: 9140.1. Samples: 41489924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:47:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:07,225][820675] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-09 21:47:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 41545728. Throughput: 0: 9284.2. Samples: 41522000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:47:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:11,404][820675] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-09 21:47:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 41590784. Throughput: 0: 9277.3. Samples: 41580200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:47:13,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:47:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081232_41590784.pth... [2023-03-09 21:47:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080680_41308160.pth [2023-03-09 21:47:15,955][820675] Updated weights for policy 0, policy_version 81280 (0.0004) [2023-03-09 21:47:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 41635840. Throughput: 0: 9324.9. Samples: 41635800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:47:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:20,315][820675] Updated weights for policy 0, policy_version 81360 (0.0004) [2023-03-09 21:47:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9330.6). Total num frames: 41684992. Throughput: 0: 9348.0. Samples: 41663348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:47:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:24,703][820675] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-09 21:47:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 41730048. Throughput: 0: 9348.5. Samples: 41718688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:28,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:47:28,590][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081512_41734144.pth... [2023-03-09 21:47:28,591][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000080952_41447424.pth [2023-03-09 21:47:29,059][820675] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-09 21:47:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 41775104. Throughput: 0: 9378.1. Samples: 41775112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:33,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:47:33,558][820675] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-09 21:47:38,026][820675] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-09 21:47:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 41824256. Throughput: 0: 9383.5. Samples: 41801464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:38,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:47:42,431][820675] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-09 21:47:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 41869312. Throughput: 0: 9380.7. Samples: 41857032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:43,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:47:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081776_41869312.pth... [2023-03-09 21:47:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081232_41590784.pth [2023-03-09 21:47:46,924][820675] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-09 21:47:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 41914368. Throughput: 0: 9375.9. Samples: 41911840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:51,318][820675] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-09 21:47:53,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.6, 300 sec: 9316.7). Total num frames: 41959424. Throughput: 0: 9282.1. Samples: 41939692. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:53,539][820373] Avg episode reward: [(0, '0.043')] [2023-03-09 21:47:55,915][820675] Updated weights for policy 0, policy_version 82000 (0.0004) [2023-03-09 21:47:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 42004480. Throughput: 0: 9231.4. Samples: 41995612. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:47:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:47:58,577][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082048_42008576.pth... [2023-03-09 21:47:58,578][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081512_41734144.pth [2023-03-09 21:48:00,205][820675] Updated weights for policy 0, policy_version 82080 (0.0004) [2023-03-09 21:48:03,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 42053632. Throughput: 0: 9210.1. Samples: 42050256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:48:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:04,769][820675] Updated weights for policy 0, policy_version 82160 (0.0004) [2023-03-09 21:48:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 42098688. Throughput: 0: 9224.5. Samples: 42078448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:48:08,539][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 21:48:09,054][820675] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-09 21:48:13,515][820675] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-09 21:48:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 42147840. Throughput: 0: 9256.9. Samples: 42135248. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:48:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082320_42147840.pth... [2023-03-09 21:48:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000081776_41869312.pth [2023-03-09 21:48:17,864][820675] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-09 21:48:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 42192896. Throughput: 0: 9242.7. Samples: 42191032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:22,252][820675] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-09 21:48:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 42242048. Throughput: 0: 9280.3. Samples: 42219080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:26,749][820675] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-09 21:48:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 42283008. Throughput: 0: 9267.1. Samples: 42274048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082584_42283008.pth... [2023-03-09 21:48:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082048_42008576.pth [2023-03-09 21:48:31,487][820675] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-09 21:48:33,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 42328064. Throughput: 0: 9186.8. Samples: 42325248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:36,229][820675] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-09 21:48:38,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 42373120. Throughput: 0: 9160.1. Samples: 42351896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:40,621][820675] Updated weights for policy 0, policy_version 82800 (0.0004) [2023-03-09 21:48:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 42418176. Throughput: 0: 9185.1. Samples: 42408944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:43,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:48:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082848_42418176.pth... [2023-03-09 21:48:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082320_42147840.pth [2023-03-09 21:48:45,006][820675] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-09 21:48:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 42467328. Throughput: 0: 9200.3. Samples: 42464268. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:49,381][820675] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-09 21:48:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 42512384. Throughput: 0: 9177.1. Samples: 42491420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:53,540][820373] Avg episode reward: [(0, '0.043')] [2023-03-09 21:48:53,932][820675] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-09 21:48:58,398][820675] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-09 21:48:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 42557440. Throughput: 0: 9107.0. Samples: 42545064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:48:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:48:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083120_42557440.pth... [2023-03-09 21:48:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082584_42283008.pth [2023-03-09 21:49:02,837][820675] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-09 21:49:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 42602496. Throughput: 0: 9102.6. Samples: 42600652. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:49:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:06,801][820675] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-09 21:49:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.2, 300 sec: 9288.9). Total num frames: 42655744. Throughput: 0: 9159.1. Samples: 42631240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:08,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 21:49:11,068][820675] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-09 21:49:13,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 42700800. Throughput: 0: 9240.7. Samples: 42689880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083400_42700800.pth... [2023-03-09 21:49:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000082848_42418176.pth [2023-03-09 21:49:15,494][820675] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-09 21:49:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 42745856. Throughput: 0: 9344.5. Samples: 42745752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:19,765][820675] Updated weights for policy 0, policy_version 83520 (0.0006) [2023-03-09 21:49:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 42795008. Throughput: 0: 9392.2. Samples: 42774544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:24,046][820675] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-09 21:49:28,442][820675] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-09 21:49:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 42844160. Throughput: 0: 9397.5. Samples: 42831832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083680_42844160.pth... [2023-03-09 21:49:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083120_42557440.pth [2023-03-09 21:49:32,920][820675] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-09 21:49:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 42889216. Throughput: 0: 9381.3. Samples: 42886424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:33,539][820373] Avg episode reward: [(0, '0.131')] [2023-03-09 21:49:37,407][820675] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-09 21:49:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 42934272. Throughput: 0: 9389.0. Samples: 42913924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:38,539][820373] Avg episode reward: [(0, '0.286')] [2023-03-09 21:49:41,806][820675] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-09 21:49:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 42979328. Throughput: 0: 9439.6. Samples: 42969848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083944_42979328.pth... [2023-03-09 21:49:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083400_42700800.pth [2023-03-09 21:49:46,474][820675] Updated weights for policy 0, policy_version 84000 (0.0006) [2023-03-09 21:49:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 43028480. Throughput: 0: 9416.2. Samples: 43024384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:50,525][820675] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-09 21:49:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 43073536. Throughput: 0: 9387.7. Samples: 43053688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:49:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:49:55,033][820675] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-09 21:49:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 43122688. Throughput: 0: 9344.9. Samples: 43110400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:49:58,539][820373] Avg episode reward: [(0, '0.070')] [2023-03-09 21:49:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084224_43122688.pth... [2023-03-09 21:49:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083680_42844160.pth [2023-03-09 21:49:59,405][820675] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-09 21:50:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 43167744. Throughput: 0: 9337.0. Samples: 43165916. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:03,703][820675] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-09 21:50:08,128][820675] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-09 21:50:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 43216896. Throughput: 0: 9332.1. Samples: 43194488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:12,559][820675] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-09 21:50:13,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 43261952. Throughput: 0: 9282.8. Samples: 43249560. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:13,547][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:13,550][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084496_43261952.pth... [2023-03-09 21:50:13,552][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000083944_42979328.pth [2023-03-09 21:50:16,966][820675] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-09 21:50:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 43307008. Throughput: 0: 9280.8. Samples: 43304060. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:21,526][820675] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-09 21:50:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 43352064. Throughput: 0: 9274.7. Samples: 43331284. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:23,539][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 21:50:26,016][820675] Updated weights for policy 0, policy_version 84720 (0.0005) [2023-03-09 21:50:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 43397120. Throughput: 0: 9244.5. Samples: 43385852. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084760_43397120.pth... [2023-03-09 21:50:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084224_43122688.pth [2023-03-09 21:50:30,588][820675] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-09 21:50:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 43446272. Throughput: 0: 9302.2. Samples: 43442980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:34,571][820675] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-09 21:50:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 43491328. Throughput: 0: 9272.0. Samples: 43470928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:39,007][820675] Updated weights for policy 0, policy_version 84960 (0.0006) [2023-03-09 21:50:43,216][820675] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-09 21:50:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9275.0). Total num frames: 43540480. Throughput: 0: 9308.8. Samples: 43529296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:50:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085040_43540480.pth... [2023-03-09 21:50:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084496_43261952.pth [2023-03-09 21:50:47,754][820675] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-09 21:50:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 43585536. Throughput: 0: 9309.9. Samples: 43584864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:50:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:52,352][820675] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-09 21:50:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 43630592. Throughput: 0: 9253.2. Samples: 43610880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:50:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:56,598][820675] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-09 21:50:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 43679744. Throughput: 0: 9286.6. Samples: 43667456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:50:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:50:58,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085312_43679744.pth... [2023-03-09 21:50:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000084760_43397120.pth [2023-03-09 21:51:00,976][820675] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-09 21:51:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 43724800. Throughput: 0: 9337.0. Samples: 43724224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:05,170][820675] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-09 21:51:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 43773952. Throughput: 0: 9383.5. Samples: 43753544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:09,443][820675] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-09 21:51:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 43823104. Throughput: 0: 9468.6. Samples: 43811940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085592_43823104.pth... [2023-03-09 21:51:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085040_43540480.pth [2023-03-09 21:51:13,664][820675] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-09 21:51:18,000][820675] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-09 21:51:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 43872256. Throughput: 0: 9452.9. Samples: 43868360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:51:22,530][820675] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-09 21:51:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 43917312. Throughput: 0: 9464.4. Samples: 43896828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:26,867][820675] Updated weights for policy 0, policy_version 85840 (0.0004) [2023-03-09 21:51:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 43962368. Throughput: 0: 9391.5. Samples: 43951916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:28,583][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085872_43966464.pth... [2023-03-09 21:51:28,585][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085312_43679744.pth [2023-03-09 21:51:31,231][820675] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-09 21:51:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 44011520. Throughput: 0: 9390.4. Samples: 44007432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:35,684][820675] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-09 21:51:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 44056576. Throughput: 0: 9449.2. Samples: 44036096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:51:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:40,130][820675] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-09 21:51:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44101632. Throughput: 0: 9420.6. Samples: 44091384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:51:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086136_44101632.pth... [2023-03-09 21:51:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085592_43823104.pth [2023-03-09 21:51:44,571][820675] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-09 21:51:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44146688. Throughput: 0: 9381.6. Samples: 44146396. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:51:48,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:51:49,075][820675] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-09 21:51:53,287][820675] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-09 21:51:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 44195840. Throughput: 0: 9374.0. Samples: 44175372. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:51:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:57,751][820675] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-09 21:51:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9316.7). Total num frames: 44240896. Throughput: 0: 9302.1. Samples: 44230536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:51:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:51:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086408_44240896.pth... [2023-03-09 21:51:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000085872_43966464.pth [2023-03-09 21:52:02,402][820675] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-09 21:52:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 44285952. Throughput: 0: 9234.7. Samples: 44283920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:06,685][820675] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-09 21:52:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 44335104. Throughput: 0: 9281.3. Samples: 44314484. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:11,201][820675] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-09 21:52:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 44380160. Throughput: 0: 9241.9. Samples: 44367800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086680_44380160.pth... [2023-03-09 21:52:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086136_44101632.pth [2023-03-09 21:52:15,748][820675] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-09 21:52:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 44425216. Throughput: 0: 9226.9. Samples: 44422644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:52:20,221][820675] Updated weights for policy 0, policy_version 86800 (0.0006) [2023-03-09 21:52:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 44470272. Throughput: 0: 9187.4. Samples: 44449528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:24,519][820675] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-09 21:52:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 44519424. Throughput: 0: 9238.1. Samples: 44507100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 21:52:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086952_44519424.pth... [2023-03-09 21:52:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086408_44240896.pth [2023-03-09 21:52:28,829][820675] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-09 21:52:33,291][820675] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-09 21:52:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 44564480. Throughput: 0: 9248.8. Samples: 44562592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:37,779][820675] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-09 21:52:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 44609536. Throughput: 0: 9194.4. Samples: 44589120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:42,423][820675] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-09 21:52:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 44654592. Throughput: 0: 9159.8. Samples: 44642728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087216_44654592.pth... [2023-03-09 21:52:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086680_44380160.pth [2023-03-09 21:52:46,474][820675] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-09 21:52:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44707840. Throughput: 0: 9336.2. Samples: 44704048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:52:50,606][820675] Updated weights for policy 0, policy_version 87360 (0.0004) [2023-03-09 21:52:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 44752896. Throughput: 0: 9287.8. Samples: 44732432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:53,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:52:55,044][820675] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-09 21:52:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44802048. Throughput: 0: 9358.6. Samples: 44788936. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:52:58,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:52:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087504_44802048.pth... [2023-03-09 21:52:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000086952_44519424.pth [2023-03-09 21:52:59,267][820675] Updated weights for policy 0, policy_version 87520 (0.0005) [2023-03-09 21:53:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44847104. Throughput: 0: 9398.7. Samples: 44845584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:03,655][820675] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-09 21:53:07,938][820675] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-09 21:53:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44896256. Throughput: 0: 9460.6. Samples: 44875256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:12,458][820675] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-09 21:53:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 44941312. Throughput: 0: 9387.2. Samples: 44929524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087776_44941312.pth... [2023-03-09 21:53:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087216_44654592.pth [2023-03-09 21:53:16,862][820675] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-09 21:53:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 44986368. Throughput: 0: 9414.0. Samples: 44986220. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:53:21,133][820675] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-09 21:53:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 45035520. Throughput: 0: 9460.4. Samples: 45014840. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:25,475][820675] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-09 21:53:28,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 45080576. Throughput: 0: 9499.0. Samples: 45070184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:28,588][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088056_45084672.pth... [2023-03-09 21:53:28,591][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087504_44802048.pth [2023-03-09 21:53:30,044][820675] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-09 21:53:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 45125632. Throughput: 0: 9358.2. Samples: 45125164. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:34,541][820675] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-09 21:53:38,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 45170688. Throughput: 0: 9314.7. Samples: 45151596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:39,116][820675] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-09 21:53:43,302][820675] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-09 21:53:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 45219840. Throughput: 0: 9301.4. Samples: 45207496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088320_45219840.pth... [2023-03-09 21:53:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000087776_44941312.pth [2023-03-09 21:53:47,147][820675] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-09 21:53:48,539][820373] Fps is (10 sec: 10239.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 45273088. Throughput: 0: 9410.5. Samples: 45269056. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:48,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 21:53:51,520][820675] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-09 21:53:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 45318144. Throughput: 0: 9386.9. Samples: 45297664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:55,601][820675] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-09 21:53:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 45371392. Throughput: 0: 9543.7. Samples: 45358992. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:53:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:53:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088616_45371392.pth... [2023-03-09 21:53:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088056_45084672.pth [2023-03-09 21:53:59,669][820675] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-09 21:54:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 45416448. Throughput: 0: 9499.9. Samples: 45413716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:54:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:04,158][820675] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-09 21:54:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 45461504. Throughput: 0: 9484.3. Samples: 45441632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:54:08,539][820373] Avg episode reward: [(0, '0.194')] [2023-03-09 21:54:08,658][820675] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-09 21:54:12,937][820675] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-09 21:54:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 45510656. Throughput: 0: 9518.6. Samples: 45498520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:54:13,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:54:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088888_45510656.pth... [2023-03-09 21:54:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088320_45219840.pth [2023-03-09 21:54:17,187][820675] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-09 21:54:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 45559808. Throughput: 0: 9588.4. Samples: 45556644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:54:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:21,441][820675] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-09 21:54:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 45604864. Throughput: 0: 9618.9. Samples: 45584448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:25,740][820675] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-09 21:54:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.4, 300 sec: 9372.2). Total num frames: 45654016. Throughput: 0: 9649.6. Samples: 45641728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089168_45654016.pth... [2023-03-09 21:54:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088616_45371392.pth [2023-03-09 21:54:30,120][820675] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-09 21:54:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 45699072. Throughput: 0: 9529.8. Samples: 45697896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:54:34,541][820675] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-09 21:54:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 45748224. Throughput: 0: 9509.8. Samples: 45725604. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:38,970][820675] Updated weights for policy 0, policy_version 89360 (0.0004) [2023-03-09 21:54:43,451][820675] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-09 21:54:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 45793280. Throughput: 0: 9371.8. Samples: 45780724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089440_45793280.pth... [2023-03-09 21:54:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000088888_45510656.pth [2023-03-09 21:54:47,955][820675] Updated weights for policy 0, policy_version 89520 (0.0004) [2023-03-09 21:54:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 45838336. Throughput: 0: 9359.5. Samples: 45834896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:54:52,459][820675] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-09 21:54:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 45883392. Throughput: 0: 9359.7. Samples: 45862820. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:53,540][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 21:54:56,942][820675] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-09 21:54:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 45928448. Throughput: 0: 9300.3. Samples: 45917036. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:54:58,539][820373] Avg episode reward: [(0, '0.132')] [2023-03-09 21:54:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089704_45928448.pth... [2023-03-09 21:54:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089168_45654016.pth [2023-03-09 21:55:01,503][820675] Updated weights for policy 0, policy_version 89760 (0.0006) [2023-03-09 21:55:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 45973504. Throughput: 0: 9213.1. Samples: 45971232. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:55:03,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:55:05,949][820675] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-09 21:55:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 46018560. Throughput: 0: 9211.1. Samples: 45998948. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:55:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:10,534][820675] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-09 21:55:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 46067712. Throughput: 0: 9143.2. Samples: 46053172. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 21:55:13,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 21:55:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089976_46067712.pth... [2023-03-09 21:55:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089440_45793280.pth [2023-03-09 21:55:14,877][820675] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-09 21:55:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 46112768. Throughput: 0: 9194.3. Samples: 46111640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:19,170][820675] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-09 21:55:23,500][820675] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-09 21:55:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9372.2). Total num frames: 46161920. Throughput: 0: 9197.6. Samples: 46139496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:23,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:55:27,915][820675] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-09 21:55:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 46206976. Throughput: 0: 9199.4. Samples: 46194696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090248_46206976.pth... [2023-03-09 21:55:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089704_45928448.pth [2023-03-09 21:55:32,381][820675] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-09 21:55:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 46252032. Throughput: 0: 9219.1. Samples: 46249756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:36,892][820675] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-09 21:55:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 46297088. Throughput: 0: 9192.9. Samples: 46276500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:41,419][820675] Updated weights for policy 0, policy_version 90480 (0.0004) [2023-03-09 21:55:43,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 46346240. Throughput: 0: 9219.0. Samples: 46331892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090520_46346240.pth... [2023-03-09 21:55:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000089976_46067712.pth [2023-03-09 21:55:45,770][820675] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-09 21:55:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 46387200. Throughput: 0: 9243.9. Samples: 46387208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:50,130][820675] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-09 21:55:53,539][820373] Fps is (10 sec: 9421.1, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 46440448. Throughput: 0: 9309.8. Samples: 46417888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:54,376][820675] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-09 21:55:58,441][820675] Updated weights for policy 0, policy_version 90800 (0.0004) [2023-03-09 21:55:58,539][820373] Fps is (10 sec: 10239.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 46489600. Throughput: 0: 9417.2. Samples: 46476944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:55:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:55:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090800_46489600.pth... [2023-03-09 21:55:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090248_46206976.pth [2023-03-09 21:56:02,694][820675] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-09 21:56:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 46534656. Throughput: 0: 9400.2. Samples: 46534652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:07,039][820675] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-09 21:56:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 46583808. Throughput: 0: 9414.1. Samples: 46563132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:11,665][820675] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-09 21:56:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 46628864. Throughput: 0: 9372.5. Samples: 46616460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:13,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 21:56:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091072_46628864.pth... [2023-03-09 21:56:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090520_46346240.pth [2023-03-09 21:56:15,807][820675] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-09 21:56:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 46678016. Throughput: 0: 9430.6. Samples: 46674132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:20,158][820675] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-09 21:56:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 46723072. Throughput: 0: 9470.1. Samples: 46702656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:24,528][820675] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-09 21:56:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 46772224. Throughput: 0: 9490.2. Samples: 46758948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091352_46772224.pth... [2023-03-09 21:56:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000090800_46489600.pth [2023-03-09 21:56:28,907][820675] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-09 21:56:33,419][820675] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-09 21:56:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 46817280. Throughput: 0: 9491.6. Samples: 46814332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:56:37,886][820675] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-09 21:56:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 46862336. Throughput: 0: 9406.4. Samples: 46841176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:42,098][820675] Updated weights for policy 0, policy_version 91600 (0.0006) [2023-03-09 21:56:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 46911488. Throughput: 0: 9383.5. Samples: 46899200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091624_46911488.pth... [2023-03-09 21:56:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091072_46628864.pth [2023-03-09 21:56:46,346][820675] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-09 21:56:48,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 46960640. Throughput: 0: 9418.9. Samples: 46958504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:48,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:56:50,281][820675] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-09 21:56:53,539][820373] Fps is (10 sec: 9830.6, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 47009792. Throughput: 0: 9472.3. Samples: 46989384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:54,337][820675] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-09 21:56:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47058944. Throughput: 0: 9604.1. Samples: 47048644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:56:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:56:58,564][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091920_47063040.pth... [2023-03-09 21:56:58,565][820675] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-09 21:56:58,566][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091352_46772224.pth [2023-03-09 21:57:02,846][820675] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-09 21:57:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.4, 300 sec: 9400.0). Total num frames: 47108096. Throughput: 0: 9611.4. Samples: 47106644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:06,941][820675] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-09 21:57:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 47157248. Throughput: 0: 9629.3. Samples: 47135976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:11,392][820675] Updated weights for policy 0, policy_version 92160 (0.0004) [2023-03-09 21:57:13,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 47206400. Throughput: 0: 9629.2. Samples: 47192260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:57:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092200_47206400.pth... [2023-03-09 21:57:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091624_46911488.pth [2023-03-09 21:57:15,525][820675] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-09 21:57:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 47255552. Throughput: 0: 9736.9. Samples: 47252492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:19,670][820675] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-09 21:57:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 47300608. Throughput: 0: 9757.5. Samples: 47280264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:24,219][820675] Updated weights for policy 0, policy_version 92400 (0.0004) [2023-03-09 21:57:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 47345664. Throughput: 0: 9652.4. Samples: 47333556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:28,539][820373] Avg episode reward: [(0, '0.124')] [2023-03-09 21:57:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092472_47345664.pth... [2023-03-09 21:57:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000091920_47063040.pth [2023-03-09 21:57:28,680][820675] Updated weights for policy 0, policy_version 92480 (0.0004) [2023-03-09 21:57:32,926][820675] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-09 21:57:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 47394816. Throughput: 0: 9629.0. Samples: 47391808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:37,425][820675] Updated weights for policy 0, policy_version 92640 (0.0004) [2023-03-09 21:57:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 47439872. Throughput: 0: 9556.0. Samples: 47419404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:38,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:57:41,831][820675] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-09 21:57:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 47489024. Throughput: 0: 9477.3. Samples: 47475124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092752_47489024.pth... [2023-03-09 21:57:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092200_47206400.pth [2023-03-09 21:57:46,116][820675] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-09 21:57:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 47534080. Throughput: 0: 9455.6. Samples: 47532148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:50,198][820675] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-09 21:57:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 47583232. Throughput: 0: 9477.9. Samples: 47562480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:57:54,661][820675] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-09 21:57:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 47632384. Throughput: 0: 9507.6. Samples: 47620104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:57:58,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:57:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093032_47632384.pth... [2023-03-09 21:57:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092472_47345664.pth [2023-03-09 21:57:58,775][820675] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-09 21:58:02,782][820675] Updated weights for policy 0, policy_version 93120 (0.0004) [2023-03-09 21:58:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 47681536. Throughput: 0: 9514.1. Samples: 47680624. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:06,950][820675] Updated weights for policy 0, policy_version 93200 (0.0004) [2023-03-09 21:58:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 47730688. Throughput: 0: 9511.5. Samples: 47708284. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:11,338][820675] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-09 21:58:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 47775744. Throughput: 0: 9604.7. Samples: 47765768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093312_47775744.pth... [2023-03-09 21:58:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000092752_47489024.pth [2023-03-09 21:58:15,967][820675] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-09 21:58:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 47820800. Throughput: 0: 9499.6. Samples: 47819288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:18,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 21:58:20,274][820675] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-09 21:58:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9455.5). Total num frames: 47869952. Throughput: 0: 9532.5. Samples: 47848364. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:58:24,868][820675] Updated weights for policy 0, policy_version 93520 (0.0004) [2023-03-09 21:58:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 47915008. Throughput: 0: 9500.8. Samples: 47902660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:28,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:58:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093584_47915008.pth... [2023-03-09 21:58:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093032_47632384.pth [2023-03-09 21:58:29,314][820675] Updated weights for policy 0, policy_version 93600 (0.0004) [2023-03-09 21:58:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 47960064. Throughput: 0: 9481.3. Samples: 47958808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:33,614][820675] Updated weights for policy 0, policy_version 93680 (0.0004) [2023-03-09 21:58:37,621][820675] Updated weights for policy 0, policy_version 93760 (0.0004) [2023-03-09 21:58:38,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 48013312. Throughput: 0: 9473.7. Samples: 47988800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:41,997][820675] Updated weights for policy 0, policy_version 93840 (0.0004) [2023-03-09 21:58:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 48058368. Throughput: 0: 9470.9. Samples: 48046296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:43,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:58:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093864_48058368.pth... [2023-03-09 21:58:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093312_47775744.pth [2023-03-09 21:58:46,378][820675] Updated weights for policy 0, policy_version 93920 (0.0004) [2023-03-09 21:58:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.0, 300 sec: 9441.6). Total num frames: 48103424. Throughput: 0: 9361.2. Samples: 48101880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:48,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 21:58:50,886][820675] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-09 21:58:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 48152576. Throughput: 0: 9367.4. Samples: 48129816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:55,094][820675] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-09 21:58:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 48197632. Throughput: 0: 9376.1. Samples: 48187692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 21:58:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:58:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094136_48197632.pth... [2023-03-09 21:58:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093584_47915008.pth [2023-03-09 21:58:59,518][820675] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-09 21:59:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 48246784. Throughput: 0: 9410.3. Samples: 48242752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:03,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:59:03,940][820675] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-09 21:59:08,277][820675] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-09 21:59:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 48291840. Throughput: 0: 9370.2. Samples: 48270024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:08,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 21:59:12,759][820675] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-09 21:59:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 48336896. Throughput: 0: 9458.1. Samples: 48328276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:13,600][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094416_48340992.pth... [2023-03-09 21:59:13,602][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000093864_48058368.pth [2023-03-09 21:59:16,959][820675] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-09 21:59:18,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 48386048. Throughput: 0: 9423.5. Samples: 48382868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:21,261][820675] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-09 21:59:23,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 48435200. Throughput: 0: 9428.6. Samples: 48413084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:25,648][820675] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-09 21:59:28,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 48484352. Throughput: 0: 9402.7. Samples: 48469416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:28,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 21:59:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094696_48484352.pth... [2023-03-09 21:59:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094136_48197632.pth [2023-03-09 21:59:29,778][820675] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-09 21:59:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9427.7). Total num frames: 48529408. Throughput: 0: 9433.9. Samples: 48526404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:34,174][820675] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-09 21:59:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9427.7). Total num frames: 48574464. Throughput: 0: 9432.0. Samples: 48554256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:38,556][820675] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-09 21:59:43,003][820675] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-09 21:59:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 48623616. Throughput: 0: 9414.0. Samples: 48611320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:43,539][820373] Avg episode reward: [(0, '2.600')] [2023-03-09 21:59:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094968_48623616.pth... [2023-03-09 21:59:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094416_48340992.pth [2023-03-09 21:59:47,175][820675] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-09 21:59:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 48668672. Throughput: 0: 9463.5. Samples: 48668608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 21:59:51,343][820675] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-09 21:59:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48717824. Throughput: 0: 9518.9. Samples: 48698376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 21:59:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 21:59:55,816][820675] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-09 21:59:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48762880. Throughput: 0: 9449.6. Samples: 48753508. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 21:59:58,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 21:59:58,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095240_48762880.pth... [2023-03-09 21:59:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094696_48484352.pth [2023-03-09 22:00:00,482][820675] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-09 22:00:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 48807936. Throughput: 0: 9446.0. Samples: 48807936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:04,860][820675] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-09 22:00:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48857088. Throughput: 0: 9387.3. Samples: 48835516. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:08,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:00:09,466][820675] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-09 22:00:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48902144. Throughput: 0: 9345.0. Samples: 48889940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095512_48902144.pth... [2023-03-09 22:00:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000094968_48623616.pth [2023-03-09 22:00:13,821][820675] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-09 22:00:18,251][820675] Updated weights for policy 0, policy_version 95600 (0.0006) [2023-03-09 22:00:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9441.6). Total num frames: 48947200. Throughput: 0: 9342.4. Samples: 48946812. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:18,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:00:22,635][820675] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-09 22:00:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 48996352. Throughput: 0: 9284.7. Samples: 48972068. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:23,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:26,692][820675] Updated weights for policy 0, policy_version 95760 (0.0006) [2023-03-09 22:00:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 49045504. Throughput: 0: 9373.4. Samples: 49033124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095792_49045504.pth... [2023-03-09 22:00:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095240_48762880.pth [2023-03-09 22:00:31,086][820675] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-09 22:00:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 49090560. Throughput: 0: 9305.5. Samples: 49087356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:35,569][820675] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-09 22:00:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 49135616. Throughput: 0: 9261.5. Samples: 49115144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:40,035][820675] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-09 22:00:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 49184768. Throughput: 0: 9280.4. Samples: 49171124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:00:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096064_49184768.pth... [2023-03-09 22:00:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095512_48902144.pth [2023-03-09 22:00:44,316][820675] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-09 22:00:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 49229824. Throughput: 0: 9301.1. Samples: 49226484. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:48,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:00:48,818][820675] Updated weights for policy 0, policy_version 96160 (0.0004) [2023-03-09 22:00:53,504][820675] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-09 22:00:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 49274880. Throughput: 0: 9307.3. Samples: 49254344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:00:53,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:00:58,140][820675] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-09 22:00:58,539][820373] Fps is (10 sec: 8601.4, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 49315840. Throughput: 0: 9271.3. Samples: 49307148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:00:58,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:00:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096328_49319936.pth... [2023-03-09 22:00:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000095792_49045504.pth [2023-03-09 22:01:02,642][820675] Updated weights for policy 0, policy_version 96400 (0.0006) [2023-03-09 22:01:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 49364992. Throughput: 0: 9202.0. Samples: 49360904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:07,217][820675] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-09 22:01:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9413.9). Total num frames: 49405952. Throughput: 0: 9264.4. Samples: 49388964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:11,412][820675] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-09 22:01:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9427.7). Total num frames: 49459200. Throughput: 0: 9155.6. Samples: 49445128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096600_49459200.pth... [2023-03-09 22:01:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096064_49184768.pth [2023-03-09 22:01:15,718][820675] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-09 22:01:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 49504256. Throughput: 0: 9190.7. Samples: 49500936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:20,385][820675] Updated weights for policy 0, policy_version 96720 (0.0004) [2023-03-09 22:01:23,539][820373] Fps is (10 sec: 8601.8, 60 sec: 9147.7, 300 sec: 9400.0). Total num frames: 49545216. Throughput: 0: 9166.1. Samples: 49527616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:23,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:01:24,922][820675] Updated weights for policy 0, policy_version 96800 (0.0005) [2023-03-09 22:01:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9413.9). Total num frames: 49594368. Throughput: 0: 9101.7. Samples: 49580700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:28,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:01:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096864_49594368.pth... [2023-03-09 22:01:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096328_49319936.pth [2023-03-09 22:01:29,454][820675] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-09 22:01:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9400.0). Total num frames: 49635328. Throughput: 0: 9083.5. Samples: 49635244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:34,056][820675] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-09 22:01:38,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9386.1). Total num frames: 49680384. Throughput: 0: 9052.7. Samples: 49661716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:38,562][820675] Updated weights for policy 0, policy_version 97040 (0.0004) [2023-03-09 22:01:42,922][820675] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-09 22:01:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9386.1). Total num frames: 49729536. Throughput: 0: 9114.9. Samples: 49717320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:43,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:01:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097128_49729536.pth... [2023-03-09 22:01:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096600_49459200.pth [2023-03-09 22:01:47,558][820675] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-09 22:01:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9372.2). Total num frames: 49774592. Throughput: 0: 9110.6. Samples: 49770880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:48,539][820373] Avg episode reward: [(0, '8.800')] [2023-03-09 22:01:48,540][820631] Saving new best policy, reward=8.800! [2023-03-09 22:01:51,926][820675] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-09 22:01:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9358.3). Total num frames: 49819648. Throughput: 0: 9124.1. Samples: 49799548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:56,533][820675] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-09 22:01:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 49864704. Throughput: 0: 9052.3. Samples: 49852480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:01:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:01:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097392_49864704.pth... [2023-03-09 22:01:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000096864_49594368.pth [2023-03-09 22:02:01,174][820675] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-09 22:02:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9330.5). Total num frames: 49909760. Throughput: 0: 9031.1. Samples: 49907336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:03,540][820373] Avg episode reward: [(0, '0.094')] [2023-03-09 22:02:05,617][820675] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-09 22:02:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 49954816. Throughput: 0: 9039.8. Samples: 49934408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:10,164][820675] Updated weights for policy 0, policy_version 97600 (0.0006) [2023-03-09 22:02:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9302.8). Total num frames: 49999872. Throughput: 0: 9058.6. Samples: 49988336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097656_49999872.pth... [2023-03-09 22:02:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097128_49729536.pth [2023-03-09 22:02:14,661][820675] Updated weights for policy 0, policy_version 97680 (0.0004) [2023-03-09 22:02:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9302.8). Total num frames: 50044928. Throughput: 0: 9072.9. Samples: 50043524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:19,136][820675] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-09 22:02:23,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9302.8). Total num frames: 50089984. Throughput: 0: 9079.5. Samples: 50070296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:23,665][820675] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-09 22:02:27,739][820675] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-09 22:02:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9302.8). Total num frames: 50139136. Throughput: 0: 9100.1. Samples: 50126824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097928_50139136.pth... [2023-03-09 22:02:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097392_49864704.pth [2023-03-09 22:02:31,964][820675] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-09 22:02:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 50188288. Throughput: 0: 9220.4. Samples: 50185800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:02:36,544][820675] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-09 22:02:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 50233344. Throughput: 0: 9184.8. Samples: 50212864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:38,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:02:40,792][820675] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-09 22:02:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 50282496. Throughput: 0: 9282.9. Samples: 50270208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:43,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:02:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098208_50282496.pth... [2023-03-09 22:02:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097656_49999872.pth [2023-03-09 22:02:45,224][820675] Updated weights for policy 0, policy_version 98240 (0.0006) [2023-03-09 22:02:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 50331648. Throughput: 0: 9314.1. Samples: 50326472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:02:49,423][820675] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-09 22:02:53,486][820675] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-09 22:02:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 50380800. Throughput: 0: 9354.0. Samples: 50355336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:53,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 22:02:58,206][820675] Updated weights for policy 0, policy_version 98480 (0.0004) [2023-03-09 22:02:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 50421760. Throughput: 0: 9442.2. Samples: 50413236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:02:58,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 22:02:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098480_50421760.pth... [2023-03-09 22:02:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000097928_50139136.pth [2023-03-09 22:03:02,547][820675] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-09 22:03:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 50470912. Throughput: 0: 9407.9. Samples: 50466880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:03,539][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 22:03:06,969][820675] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-09 22:03:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 50515968. Throughput: 0: 9446.2. Samples: 50495376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:11,492][820675] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-09 22:03:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 50561024. Throughput: 0: 9387.6. Samples: 50549268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098752_50561024.pth... [2023-03-09 22:03:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098208_50282496.pth [2023-03-09 22:03:15,778][820675] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-09 22:03:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 50610176. Throughput: 0: 9341.0. Samples: 50606144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:20,125][820675] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-09 22:03:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 50655232. Throughput: 0: 9393.2. Samples: 50635556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:24,458][820675] Updated weights for policy 0, policy_version 98960 (0.0004) [2023-03-09 22:03:28,451][820675] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-09 22:03:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 50708480. Throughput: 0: 9452.4. Samples: 50695568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:28,540][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:03:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099040_50708480.pth... [2023-03-09 22:03:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098480_50421760.pth [2023-03-09 22:03:32,839][820675] Updated weights for policy 0, policy_version 99120 (0.0004) [2023-03-09 22:03:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 50753536. Throughput: 0: 9453.8. Samples: 50751892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:37,178][820675] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-09 22:03:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9302.8). Total num frames: 50802688. Throughput: 0: 9455.4. Samples: 50780828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:41,567][820675] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-09 22:03:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 50847744. Throughput: 0: 9414.8. Samples: 50836900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:43,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:03:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099312_50847744.pth... [2023-03-09 22:03:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000098752_50561024.pth [2023-03-09 22:03:45,864][820675] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-09 22:03:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 50892800. Throughput: 0: 9461.1. Samples: 50892628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:03:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:50,442][820675] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-09 22:03:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 50937856. Throughput: 0: 9395.2. Samples: 50918160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:03:53,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 22:03:54,819][820675] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-09 22:03:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 50987008. Throughput: 0: 9473.5. Samples: 50975576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:03:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:03:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099584_50987008.pth... [2023-03-09 22:03:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099040_50708480.pth [2023-03-09 22:03:59,195][820675] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-09 22:04:03,450][820675] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-09 22:04:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 51036160. Throughput: 0: 9466.5. Samples: 51032136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:03,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:04:08,076][820675] Updated weights for policy 0, policy_version 99760 (0.0005) [2023-03-09 22:04:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 51081216. Throughput: 0: 9419.7. Samples: 51059444. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:04:12,328][820675] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-09 22:04:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9302.8). Total num frames: 51130368. Throughput: 0: 9315.3. Samples: 51114756. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:13,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:04:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099864_51130368.pth... [2023-03-09 22:04:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099312_50847744.pth [2023-03-09 22:04:16,366][820675] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-09 22:04:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 51175424. Throughput: 0: 9402.8. Samples: 51175016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:18,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:04:20,841][820675] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-09 22:04:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 51224576. Throughput: 0: 9372.8. Samples: 51202604. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:04:25,220][820675] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-09 22:04:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51269632. Throughput: 0: 9342.3. Samples: 51257304. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:04:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100136_51269632.pth... [2023-03-09 22:04:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099584_50987008.pth [2023-03-09 22:04:29,682][820675] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-09 22:04:33,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 51318784. Throughput: 0: 9380.5. Samples: 51314752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:33,540][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 22:04:33,987][820675] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-09 22:04:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 51359744. Throughput: 0: 9393.3. Samples: 51340860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:04:38,643][820675] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-09 22:04:42,789][820675] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-09 22:04:43,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51408896. Throughput: 0: 9394.1. Samples: 51398308. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:43,539][820373] Avg episode reward: [(0, '0.042')] [2023-03-09 22:04:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100408_51408896.pth... [2023-03-09 22:04:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000099864_51130368.pth [2023-03-09 22:04:47,295][820675] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-09 22:04:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 51453952. Throughput: 0: 9365.9. Samples: 51453600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:04:48,539][820373] Avg episode reward: [(0, '0.281')] [2023-03-09 22:04:51,947][820675] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-09 22:04:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 51499008. Throughput: 0: 9310.8. Samples: 51478432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:04:53,540][820373] Avg episode reward: [(0, '0.296')] [2023-03-09 22:04:56,461][820675] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-09 22:04:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 51544064. Throughput: 0: 9303.5. Samples: 51533416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:04:58,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:04:58,548][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100680_51548160.pth... [2023-03-09 22:04:58,550][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100136_51269632.pth [2023-03-09 22:05:00,927][820675] Updated weights for policy 0, policy_version 100720 (0.0004) [2023-03-09 22:05:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 51593216. Throughput: 0: 9203.9. Samples: 51589192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:03,540][820373] Avg episode reward: [(0, '0.136')] [2023-03-09 22:05:05,111][820675] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-09 22:05:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 51638272. Throughput: 0: 9227.8. Samples: 51617856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:08,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:05:09,482][820675] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-09 22:05:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 51687424. Throughput: 0: 9296.0. Samples: 51675624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:13,541][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:05:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100952_51687424.pth... [2023-03-09 22:05:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100408_51408896.pth [2023-03-09 22:05:13,734][820675] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-09 22:05:17,708][820675] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-09 22:05:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51736576. Throughput: 0: 9371.9. Samples: 51736488. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:18,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:05:22,108][820675] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-09 22:05:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51785728. Throughput: 0: 9372.7. Samples: 51762632. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:05:26,364][820675] Updated weights for policy 0, policy_version 101200 (0.0006) [2023-03-09 22:05:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51830784. Throughput: 0: 9402.5. Samples: 51821420. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:28,540][820373] Avg episode reward: [(0, '0.107')] [2023-03-09 22:05:28,548][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101240_51834880.pth... [2023-03-09 22:05:28,550][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100680_51548160.pth [2023-03-09 22:05:30,801][820675] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-09 22:05:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 51875840. Throughput: 0: 9383.1. Samples: 51875840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:05:35,392][820675] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-09 22:05:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 51924992. Throughput: 0: 9435.3. Samples: 51903020. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:38,539][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 22:05:39,729][820675] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-09 22:05:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 51970048. Throughput: 0: 9431.5. Samples: 51957832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:43,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:05:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101504_51970048.pth... [2023-03-09 22:05:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000100952_51687424.pth [2023-03-09 22:05:44,087][820675] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-09 22:05:48,447][820675] Updated weights for policy 0, policy_version 101600 (0.0004) [2023-03-09 22:05:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 52019200. Throughput: 0: 9466.3. Samples: 52015176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:05:48,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:05:52,864][820675] Updated weights for policy 0, policy_version 101680 (0.0004) [2023-03-09 22:05:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 52064256. Throughput: 0: 9462.4. Samples: 52043664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:05:53,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:05:57,322][820675] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-09 22:05:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 52109312. Throughput: 0: 9391.9. Samples: 52098260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:05:58,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:05:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101776_52109312.pth... [2023-03-09 22:05:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101240_51834880.pth [2023-03-09 22:06:02,045][820675] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-09 22:06:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 52154368. Throughput: 0: 9196.6. Samples: 52150336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:03,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:06:06,629][820675] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-09 22:06:08,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 52195328. Throughput: 0: 9244.6. Samples: 52178636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:08,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:06:11,253][820675] Updated weights for policy 0, policy_version 102000 (0.0004) [2023-03-09 22:06:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 52244480. Throughput: 0: 9128.0. Samples: 52232180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:06:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102040_52244480.pth... [2023-03-09 22:06:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101504_51970048.pth [2023-03-09 22:06:15,607][820675] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-09 22:06:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 52289536. Throughput: 0: 9156.0. Samples: 52287860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:06:19,951][820675] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-09 22:06:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 52338688. Throughput: 0: 9165.9. Samples: 52315488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:23,539][820373] Avg episode reward: [(0, '0.076')] [2023-03-09 22:06:24,407][820675] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-09 22:06:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 52383744. Throughput: 0: 9197.5. Samples: 52371720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:28,539][820373] Avg episode reward: [(0, '5.248')] [2023-03-09 22:06:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102312_52383744.pth... [2023-03-09 22:06:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000101776_52109312.pth [2023-03-09 22:06:28,691][820675] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-09 22:06:32,906][820675] Updated weights for policy 0, policy_version 102400 (0.0004) [2023-03-09 22:06:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 52432896. Throughput: 0: 9224.3. Samples: 52430272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:06:37,195][820675] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-09 22:06:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 52482048. Throughput: 0: 9238.4. Samples: 52459392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:06:41,717][820675] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-09 22:06:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 52527104. Throughput: 0: 9252.3. Samples: 52514616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:43,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:06:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102592_52527104.pth... [2023-03-09 22:06:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102040_52244480.pth [2023-03-09 22:06:46,278][820675] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-09 22:06:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 52572160. Throughput: 0: 9283.2. Samples: 52568080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:48,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:06:50,860][820675] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-09 22:06:53,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 52613120. Throughput: 0: 9245.9. Samples: 52594704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:53,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:06:55,425][820675] Updated weights for policy 0, policy_version 102800 (0.0004) [2023-03-09 22:06:58,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 52658176. Throughput: 0: 9273.4. Samples: 52649484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:06:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:06:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102856_52662272.pth... [2023-03-09 22:06:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102312_52383744.pth [2023-03-09 22:06:59,862][820675] Updated weights for policy 0, policy_version 102880 (0.0004) [2023-03-09 22:07:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 52707328. Throughput: 0: 9320.6. Samples: 52707288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:03,539][820373] Avg episode reward: [(0, '0.084')] [2023-03-09 22:07:03,956][820675] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-09 22:07:08,145][820675] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-09 22:07:08,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 52760576. Throughput: 0: 9360.4. Samples: 52736704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:08,539][820373] Avg episode reward: [(0, '0.044')] [2023-03-09 22:07:12,503][820675] Updated weights for policy 0, policy_version 103120 (0.0004) [2023-03-09 22:07:13,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 52805632. Throughput: 0: 9370.9. Samples: 52793408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:13,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:07:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103136_52805632.pth... [2023-03-09 22:07:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102592_52527104.pth [2023-03-09 22:07:16,711][820675] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-09 22:07:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52854784. Throughput: 0: 9362.8. Samples: 52851596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:18,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:07:20,909][820675] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-09 22:07:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 52899840. Throughput: 0: 9354.6. Samples: 52880348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:23,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 22:07:25,513][820675] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-09 22:07:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 52944896. Throughput: 0: 9319.6. Samples: 52933996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:28,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:07:28,546][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103416_52948992.pth... [2023-03-09 22:07:28,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000102856_52662272.pth [2023-03-09 22:07:29,734][820675] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-09 22:07:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 52994048. Throughput: 0: 9433.5. Samples: 52992588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:33,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:07:34,219][820675] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-09 22:07:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 53039104. Throughput: 0: 9438.3. Samples: 53019428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:07:38,586][820675] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-09 22:07:43,164][820675] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-09 22:07:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 53084160. Throughput: 0: 9454.7. Samples: 53074944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:43,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:07:43,555][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103688_53088256.pth... [2023-03-09 22:07:43,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103136_52805632.pth [2023-03-09 22:07:47,505][820675] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-09 22:07:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 53133312. Throughput: 0: 9391.7. Samples: 53129916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:48,539][820373] Avg episode reward: [(0, '0.158')] [2023-03-09 22:07:51,811][820675] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-09 22:07:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 53178368. Throughput: 0: 9380.8. Samples: 53158840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:07:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:07:56,166][820675] Updated weights for policy 0, policy_version 103920 (0.0006) [2023-03-09 22:07:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 53227520. Throughput: 0: 9406.7. Samples: 53216712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:07:58,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:07:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103960_53227520.pth... [2023-03-09 22:07:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103416_52948992.pth [2023-03-09 22:08:00,425][820675] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-09 22:08:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 53276672. Throughput: 0: 9354.8. Samples: 53272564. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:03,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:08:04,637][820675] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-09 22:08:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 53325824. Throughput: 0: 9364.2. Samples: 53301736. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:08,539][820373] Avg episode reward: [(0, '0.101')] [2023-03-09 22:08:08,905][820675] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-09 22:08:13,276][820675] Updated weights for policy 0, policy_version 104240 (0.0005) [2023-03-09 22:08:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 53370880. Throughput: 0: 9459.9. Samples: 53359692. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:13,540][820373] Avg episode reward: [(0, '0.173')] [2023-03-09 22:08:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104240_53370880.pth... [2023-03-09 22:08:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103688_53088256.pth [2023-03-09 22:08:17,841][820675] Updated weights for policy 0, policy_version 104320 (0.0006) [2023-03-09 22:08:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 53415936. Throughput: 0: 9370.2. Samples: 53414248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:08:22,234][820675] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-09 22:08:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 53460992. Throughput: 0: 9373.1. Samples: 53441216. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:23,539][820373] Avg episode reward: [(0, '0.130')] [2023-03-09 22:08:26,399][820675] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-09 22:08:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 53510144. Throughput: 0: 9437.5. Samples: 53499632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:08:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104512_53510144.pth... [2023-03-09 22:08:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000103960_53227520.pth [2023-03-09 22:08:30,859][820675] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-09 22:08:33,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 53559296. Throughput: 0: 9496.9. Samples: 53557276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:33,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:08:34,985][820675] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-09 22:08:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 53608448. Throughput: 0: 9516.5. Samples: 53587084. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:38,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:08:39,298][820675] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-09 22:08:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 53653504. Throughput: 0: 9450.2. Samples: 53641972. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:43,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 22:08:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104792_53653504.pth... [2023-03-09 22:08:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104240_53370880.pth [2023-03-09 22:08:43,746][820675] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-09 22:08:48,157][820675] Updated weights for policy 0, policy_version 104880 (0.0005) [2023-03-09 22:08:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 53698560. Throughput: 0: 9462.8. Samples: 53698392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:48,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:08:52,324][820675] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-09 22:08:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 53747712. Throughput: 0: 9455.3. Samples: 53727224. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:08:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:08:56,533][820675] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-09 22:08:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 53796864. Throughput: 0: 9451.8. Samples: 53785024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:08:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:08:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105072_53796864.pth... [2023-03-09 22:08:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104512_53510144.pth [2023-03-09 22:09:00,843][820675] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-09 22:09:03,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 53846016. Throughput: 0: 9526.4. Samples: 53842936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:03,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:09:05,010][820675] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-09 22:09:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 53895168. Throughput: 0: 9597.8. Samples: 53873116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:08,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:09:09,268][820675] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-09 22:09:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 53940224. Throughput: 0: 9551.9. Samples: 53929468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105360_53944320.pth... [2023-03-09 22:09:13,544][820675] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-09 22:09:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000104792_53653504.pth [2023-03-09 22:09:17,990][820675] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-09 22:09:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 53989376. Throughput: 0: 9516.9. Samples: 53985536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:18,540][820373] Avg episode reward: [(0, '0.068')] [2023-03-09 22:09:22,359][820675] Updated weights for policy 0, policy_version 105520 (0.0004) [2023-03-09 22:09:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 54034432. Throughput: 0: 9484.0. Samples: 54013864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:23,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:09:26,896][820675] Updated weights for policy 0, policy_version 105600 (0.0004) [2023-03-09 22:09:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 54079488. Throughput: 0: 9483.5. Samples: 54068728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105624_54079488.pth... [2023-03-09 22:09:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105072_53796864.pth [2023-03-09 22:09:31,457][820675] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-09 22:09:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 54124544. Throughput: 0: 9433.6. Samples: 54122904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:35,981][820675] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-09 22:09:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 54169600. Throughput: 0: 9384.6. Samples: 54149532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:40,238][820675] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-09 22:09:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 54218752. Throughput: 0: 9377.7. Samples: 54207020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:43,540][820373] Avg episode reward: [(0, '3.200')] [2023-03-09 22:09:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105896_54218752.pth... [2023-03-09 22:09:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105360_53944320.pth [2023-03-09 22:09:44,600][820675] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-09 22:09:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 54263808. Throughput: 0: 9346.1. Samples: 54263512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:49,028][820675] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-09 22:09:53,207][820675] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-09 22:09:53,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 54312960. Throughput: 0: 9317.7. Samples: 54292412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:57,475][820675] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-09 22:09:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 54362112. Throughput: 0: 9340.9. Samples: 54349808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:09:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:09:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106176_54362112.pth... [2023-03-09 22:09:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105624_54079488.pth [2023-03-09 22:10:01,675][820675] Updated weights for policy 0, policy_version 106240 (0.0004) [2023-03-09 22:10:03,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 54411264. Throughput: 0: 9406.8. Samples: 54408844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:05,926][820675] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-09 22:10:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 54456320. Throughput: 0: 9399.6. Samples: 54436844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:10,427][820675] Updated weights for policy 0, policy_version 106400 (0.0006) [2023-03-09 22:10:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 54501376. Throughput: 0: 9415.2. Samples: 54492412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:13,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106456_54505472.pth... [2023-03-09 22:10:13,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000105896_54218752.pth [2023-03-09 22:10:14,758][820675] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-09 22:10:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 54550528. Throughput: 0: 9486.7. Samples: 54549804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:18,539][820373] Avg episode reward: [(0, '1.770')] [2023-03-09 22:10:19,152][820675] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-09 22:10:23,233][820675] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-09 22:10:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 54599680. Throughput: 0: 9515.4. Samples: 54577724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:27,523][820675] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-09 22:10:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 54648832. Throughput: 0: 9545.0. Samples: 54636544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:28,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:10:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106736_54648832.pth... [2023-03-09 22:10:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106176_54362112.pth [2023-03-09 22:10:31,860][820675] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-09 22:10:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 54693888. Throughput: 0: 9546.8. Samples: 54693120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:33,539][820373] Avg episode reward: [(0, '0.058')] [2023-03-09 22:10:36,211][820675] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-09 22:10:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 54743040. Throughput: 0: 9524.2. Samples: 54721004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:38,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:40,614][820675] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-09 22:10:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 54788096. Throughput: 0: 9513.1. Samples: 54777896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:43,539][820373] Avg episode reward: [(0, '0.044')] [2023-03-09 22:10:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107008_54788096.pth... [2023-03-09 22:10:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106456_54505472.pth [2023-03-09 22:10:45,132][820675] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-09 22:10:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 54837248. Throughput: 0: 9430.7. Samples: 54833224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:48,539][820373] Avg episode reward: [(0, '0.176')] [2023-03-09 22:10:49,297][820675] Updated weights for policy 0, policy_version 107120 (0.0006) [2023-03-09 22:10:53,461][820675] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-09 22:10:53,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 54886400. Throughput: 0: 9481.7. Samples: 54863524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:57,781][820675] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-09 22:10:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 54931456. Throughput: 0: 9511.9. Samples: 54920448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:10:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:10:58,559][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107296_54935552.pth... [2023-03-09 22:10:58,561][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000106736_54648832.pth [2023-03-09 22:11:01,956][820675] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-09 22:11:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 54980608. Throughput: 0: 9535.3. Samples: 54978892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:06,131][820675] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-09 22:11:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 55029760. Throughput: 0: 9588.2. Samples: 55009192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:10,468][820675] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-09 22:11:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 55078912. Throughput: 0: 9518.7. Samples: 55064884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:13,540][820373] Avg episode reward: [(0, '0.060')] [2023-03-09 22:11:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107576_55078912.pth... [2023-03-09 22:11:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107008_54788096.pth [2023-03-09 22:11:14,861][820675] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-09 22:11:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 55123968. Throughput: 0: 9501.3. Samples: 55120680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:18,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:11:19,121][820675] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-09 22:11:23,057][820675] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-09 22:11:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 55173120. Throughput: 0: 9583.7. Samples: 55152268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:27,535][820675] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-09 22:11:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 55222272. Throughput: 0: 9603.5. Samples: 55210056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107856_55222272.pth... [2023-03-09 22:11:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107296_54935552.pth [2023-03-09 22:11:32,109][820675] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-09 22:11:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 55267328. Throughput: 0: 9557.2. Samples: 55263296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:33,539][820373] Avg episode reward: [(0, '4.000')] [2023-03-09 22:11:36,379][820675] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-09 22:11:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 55312384. Throughput: 0: 9534.0. Samples: 55292552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:40,761][820675] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-09 22:11:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 55361536. Throughput: 0: 9530.3. Samples: 55349312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:43,540][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:11:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108128_55361536.pth... [2023-03-09 22:11:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107576_55078912.pth [2023-03-09 22:11:45,129][820675] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-09 22:11:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 55406592. Throughput: 0: 9501.1. Samples: 55406440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:48,539][820373] Avg episode reward: [(0, '0.107')] [2023-03-09 22:11:49,433][820675] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-09 22:11:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 55455744. Throughput: 0: 9451.1. Samples: 55434492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:11:53,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:11:53,924][820675] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-09 22:11:58,470][820675] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-09 22:11:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 55500800. Throughput: 0: 9403.4. Samples: 55488036. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:11:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:11:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108400_55500800.pth... [2023-03-09 22:11:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000107856_55222272.pth [2023-03-09 22:12:02,648][820675] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-09 22:12:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9455.5). Total num frames: 55549952. Throughput: 0: 9448.3. Samples: 55545856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:12:06,952][820675] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-09 22:12:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 55595008. Throughput: 0: 9385.2. Samples: 55574600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:08,539][820373] Avg episode reward: [(0, '0.667')] [2023-03-09 22:12:11,309][820675] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-09 22:12:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 55644160. Throughput: 0: 9373.9. Samples: 55631880. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:12:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108680_55644160.pth... [2023-03-09 22:12:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108128_55361536.pth [2023-03-09 22:12:15,669][820675] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-09 22:12:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 55689216. Throughput: 0: 9461.4. Samples: 55689060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:18,539][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 22:12:20,119][820675] Updated weights for policy 0, policy_version 108800 (0.0006) [2023-03-09 22:12:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 55734272. Throughput: 0: 9376.1. Samples: 55714476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:23,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:12:24,454][820675] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-09 22:12:28,481][820675] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-09 22:12:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 55787520. Throughput: 0: 9433.5. Samples: 55773820. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:28,540][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:12:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108960_55787520.pth... [2023-03-09 22:12:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108400_55500800.pth [2023-03-09 22:12:32,630][820675] Updated weights for policy 0, policy_version 109040 (0.0006) [2023-03-09 22:12:33,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 55836672. Throughput: 0: 9477.2. Samples: 55832912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:12:37,065][820675] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-09 22:12:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 55881728. Throughput: 0: 9464.4. Samples: 55860392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:12:41,568][820675] Updated weights for policy 0, policy_version 109200 (0.0005) [2023-03-09 22:12:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 55926784. Throughput: 0: 9499.8. Samples: 55915528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:43,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:12:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109232_55926784.pth... [2023-03-09 22:12:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108680_55644160.pth [2023-03-09 22:12:45,970][820675] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-09 22:12:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 55971840. Throughput: 0: 9452.7. Samples: 55971228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:12:50,621][820675] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-09 22:12:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 56016896. Throughput: 0: 9373.9. Samples: 55996424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:12:53,539][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 22:12:55,001][820675] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-09 22:12:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 56066048. Throughput: 0: 9363.7. Samples: 56053248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:12:58,540][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:12:58,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109504_56066048.pth... [2023-03-09 22:12:58,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000108960_55787520.pth [2023-03-09 22:12:59,476][820675] Updated weights for policy 0, policy_version 109520 (0.0004) [2023-03-09 22:13:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 56111104. Throughput: 0: 9368.3. Samples: 56110632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:03,552][820675] Updated weights for policy 0, policy_version 109600 (0.0004) [2023-03-09 22:13:07,945][820675] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-09 22:13:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 56160256. Throughput: 0: 9451.1. Samples: 56139776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:12,387][820675] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-09 22:13:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 56205312. Throughput: 0: 9345.7. Samples: 56194376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:13,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:13:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109784_56209408.pth... [2023-03-09 22:13:13,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109232_55926784.pth [2023-03-09 22:13:16,695][820675] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-09 22:13:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 56254464. Throughput: 0: 9280.6. Samples: 56250540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:13:21,165][820675] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-09 22:13:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 56295424. Throughput: 0: 9299.2. Samples: 56278856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:25,836][820675] Updated weights for policy 0, policy_version 110000 (0.0006) [2023-03-09 22:13:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 56344576. Throughput: 0: 9262.7. Samples: 56332352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:28,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:13:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110048_56344576.pth... [2023-03-09 22:13:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109504_56066048.pth [2023-03-09 22:13:30,224][820675] Updated weights for policy 0, policy_version 110080 (0.0006) [2023-03-09 22:13:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 56389632. Throughput: 0: 9206.8. Samples: 56385536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:34,827][820675] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-09 22:13:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 56434688. Throughput: 0: 9283.9. Samples: 56414200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:38,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:13:39,153][820675] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-09 22:13:43,324][820675] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-09 22:13:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 56483840. Throughput: 0: 9275.3. Samples: 56470636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:43,539][820373] Avg episode reward: [(0, '0.115')] [2023-03-09 22:13:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110320_56483840.pth... [2023-03-09 22:13:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000109784_56209408.pth [2023-03-09 22:13:47,785][820675] Updated weights for policy 0, policy_version 110400 (0.0006) [2023-03-09 22:13:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 56528896. Throughput: 0: 9269.5. Samples: 56527760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:52,159][820675] Updated weights for policy 0, policy_version 110480 (0.0006) [2023-03-09 22:13:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 56573952. Throughput: 0: 9270.0. Samples: 56556924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:13:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:13:56,503][820675] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-09 22:13:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 56623104. Throughput: 0: 9262.4. Samples: 56611184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:13:58,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:13:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110592_56623104.pth... [2023-03-09 22:13:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110048_56344576.pth [2023-03-09 22:14:00,913][820675] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-09 22:14:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 56672256. Throughput: 0: 9289.0. Samples: 56668544. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:03,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:14:05,129][820675] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-09 22:14:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 56717312. Throughput: 0: 9325.0. Samples: 56698480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:09,716][820675] Updated weights for policy 0, policy_version 110800 (0.0005) [2023-03-09 22:14:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 56762368. Throughput: 0: 9297.3. Samples: 56750728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:13,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:14:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110864_56762368.pth... [2023-03-09 22:14:13,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110320_56483840.pth [2023-03-09 22:14:14,146][820675] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-09 22:14:18,287][820675] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-09 22:14:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 56811520. Throughput: 0: 9431.7. Samples: 56809964. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:18,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:14:22,250][820675] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-09 22:14:23,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 56860672. Throughput: 0: 9467.9. Samples: 56840256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:26,787][820675] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-09 22:14:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 56909824. Throughput: 0: 9469.2. Samples: 56896748. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111152_56909824.pth... [2023-03-09 22:14:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110592_56623104.pth [2023-03-09 22:14:31,216][820675] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-09 22:14:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 56954880. Throughput: 0: 9406.8. Samples: 56951068. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:35,702][820675] Updated weights for policy 0, policy_version 111280 (0.0006) [2023-03-09 22:14:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 56999936. Throughput: 0: 9383.5. Samples: 56979180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:38,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:14:40,102][820675] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-09 22:14:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 57044992. Throughput: 0: 9418.7. Samples: 57035028. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:43,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:14:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111416_57044992.pth... [2023-03-09 22:14:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000110864_56762368.pth [2023-03-09 22:14:44,498][820675] Updated weights for policy 0, policy_version 111440 (0.0005) [2023-03-09 22:14:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 57094144. Throughput: 0: 9377.9. Samples: 57090548. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:48,921][820675] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-09 22:14:53,453][820675] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-09 22:14:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 57139200. Throughput: 0: 9325.8. Samples: 57118144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:14:57,788][820675] Updated weights for policy 0, policy_version 111680 (0.0004) [2023-03-09 22:14:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 57184256. Throughput: 0: 9392.3. Samples: 57173384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:14:58,539][820373] Avg episode reward: [(0, '0.075')] [2023-03-09 22:14:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111688_57184256.pth... [2023-03-09 22:14:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111152_56909824.pth [2023-03-09 22:15:02,321][820675] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-09 22:15:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 57229312. Throughput: 0: 9300.4. Samples: 57228484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:03,539][820373] Avg episode reward: [(0, '3.041')] [2023-03-09 22:15:06,691][820675] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-09 22:15:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 57278464. Throughput: 0: 9238.0. Samples: 57255964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:10,987][820675] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-09 22:15:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 57323520. Throughput: 0: 9241.4. Samples: 57312612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111960_57323520.pth... [2023-03-09 22:15:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111416_57044992.pth [2023-03-09 22:15:15,294][820675] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-09 22:15:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 57372672. Throughput: 0: 9322.3. Samples: 57370572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:18,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:19,610][820675] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-09 22:15:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 57417728. Throughput: 0: 9292.0. Samples: 57397320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:23,539][820373] Avg episode reward: [(0, '0.008')] [2023-03-09 22:15:24,225][820675] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-09 22:15:27,987][820675] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-09 22:15:28,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 57470976. Throughput: 0: 9362.6. Samples: 57456344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:28,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:15:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112248_57470976.pth... [2023-03-09 22:15:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111688_57184256.pth [2023-03-09 22:15:32,468][820675] Updated weights for policy 0, policy_version 112320 (0.0004) [2023-03-09 22:15:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.6, 300 sec: 9400.0). Total num frames: 57516032. Throughput: 0: 9402.0. Samples: 57513640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:33,539][820373] Avg episode reward: [(0, '0.036')] [2023-03-09 22:15:36,727][820675] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-09 22:15:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 57565184. Throughput: 0: 9429.6. Samples: 57542476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:41,028][820675] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-09 22:15:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 57614336. Throughput: 0: 9482.9. Samples: 57600116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112528_57614336.pth... [2023-03-09 22:15:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000111960_57323520.pth [2023-03-09 22:15:45,133][820675] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-09 22:15:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 57659392. Throughput: 0: 9575.7. Samples: 57659392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:15:49,417][820675] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-09 22:15:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 57708544. Throughput: 0: 9594.1. Samples: 57687700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:53,540][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 22:15:53,891][820675] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-09 22:15:58,188][820675] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-09 22:15:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 57753600. Throughput: 0: 9558.5. Samples: 57742744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:15:58,539][820373] Avg episode reward: [(0, '0.130')] [2023-03-09 22:15:58,545][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112808_57757696.pth... [2023-03-09 22:15:58,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112248_57470976.pth [2023-03-09 22:16:02,298][820675] Updated weights for policy 0, policy_version 112880 (0.0005) [2023-03-09 22:16:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 57802752. Throughput: 0: 9601.0. Samples: 57802616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:03,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:16:06,725][820675] Updated weights for policy 0, policy_version 112960 (0.0004) [2023-03-09 22:16:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 57851904. Throughput: 0: 9615.6. Samples: 57830024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:08,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:16:11,054][820675] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-09 22:16:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 57896960. Throughput: 0: 9562.5. Samples: 57886656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:13,539][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 22:16:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113080_57896960.pth... [2023-03-09 22:16:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112528_57614336.pth [2023-03-09 22:16:15,493][820675] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-09 22:16:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 57946112. Throughput: 0: 9534.3. Samples: 57942684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:16:19,567][820675] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-09 22:16:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 57991168. Throughput: 0: 9537.5. Samples: 57971664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:23,540][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 22:16:24,076][820675] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-09 22:16:28,349][820675] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-09 22:16:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 58040320. Throughput: 0: 9521.8. Samples: 58028596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:28,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:16:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113360_58040320.pth... [2023-03-09 22:16:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000112808_57757696.pth [2023-03-09 22:16:32,702][820675] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-09 22:16:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 58089472. Throughput: 0: 9461.4. Samples: 58085156. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:16:37,078][820675] Updated weights for policy 0, policy_version 113520 (0.0005) [2023-03-09 22:16:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 58134528. Throughput: 0: 9467.9. Samples: 58113756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:16:41,312][820675] Updated weights for policy 0, policy_version 113600 (0.0005) [2023-03-09 22:16:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 58183680. Throughput: 0: 9497.7. Samples: 58170140. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:43,540][820373] Avg episode reward: [(0, '0.059')] [2023-03-09 22:16:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113640_58183680.pth... [2023-03-09 22:16:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113080_57896960.pth [2023-03-09 22:16:45,515][820675] Updated weights for policy 0, policy_version 113680 (0.0004) [2023-03-09 22:16:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 58228736. Throughput: 0: 9452.8. Samples: 58227992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:16:50,016][820675] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-09 22:16:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 58277888. Throughput: 0: 9425.3. Samples: 58254160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:53,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 22:16:54,149][820675] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-09 22:16:58,458][820675] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-09 22:16:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 58327040. Throughput: 0: 9510.8. Samples: 58314644. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:16:58,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:16:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113920_58327040.pth... [2023-03-09 22:16:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113360_58040320.pth [2023-03-09 22:17:02,539][820675] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-09 22:17:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 58376192. Throughput: 0: 9586.7. Samples: 58374084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:06,353][820675] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-09 22:17:08,539][820373] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 58429440. Throughput: 0: 9668.6. Samples: 58406748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:08,539][820373] Avg episode reward: [(0, '0.427')] [2023-03-09 22:17:10,823][820675] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-09 22:17:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 58474496. Throughput: 0: 9637.3. Samples: 58462272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:13,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:17:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114208_58474496.pth... [2023-03-09 22:17:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113640_58183680.pth [2023-03-09 22:17:15,183][820675] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-09 22:17:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 58523648. Throughput: 0: 9655.1. Samples: 58519632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:19,160][820675] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-09 22:17:23,290][820675] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-09 22:17:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 58572800. Throughput: 0: 9674.5. Samples: 58549108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:27,465][820675] Updated weights for policy 0, policy_version 114480 (0.0005) [2023-03-09 22:17:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 58621952. Throughput: 0: 9770.3. Samples: 58609804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:28,540][820373] Avg episode reward: [(0, '12.400')] [2023-03-09 22:17:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114496_58621952.pth... [2023-03-09 22:17:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000113920_58327040.pth [2023-03-09 22:17:28,546][820631] Saving new best policy, reward=12.400! [2023-03-09 22:17:31,840][820675] Updated weights for policy 0, policy_version 114560 (0.0005) [2023-03-09 22:17:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 58667008. Throughput: 0: 9754.6. Samples: 58666948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:35,854][820675] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-09 22:17:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 58720256. Throughput: 0: 9857.3. Samples: 58697740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:38,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:17:40,230][820675] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-09 22:17:43,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 58765312. Throughput: 0: 9767.4. Samples: 58754176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:43,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:17:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114776_58765312.pth... [2023-03-09 22:17:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114208_58474496.pth [2023-03-09 22:17:44,582][820675] Updated weights for policy 0, policy_version 114800 (0.0006) [2023-03-09 22:17:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 58810368. Throughput: 0: 9650.7. Samples: 58808368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:17:49,064][820675] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-09 22:17:53,218][820675] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-09 22:17:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 58859520. Throughput: 0: 9581.8. Samples: 58837928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:57,524][820675] Updated weights for policy 0, policy_version 115040 (0.0004) [2023-03-09 22:17:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 58908672. Throughput: 0: 9647.1. Samples: 58896392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:17:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:17:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115056_58908672.pth... [2023-03-09 22:17:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114496_58621952.pth [2023-03-09 22:18:01,934][820675] Updated weights for policy 0, policy_version 115120 (0.0004) [2023-03-09 22:18:03,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9693.8, 300 sec: 9483.3). Total num frames: 58957824. Throughput: 0: 9661.5. Samples: 58954400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:18:05,885][820675] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-09 22:18:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 59006976. Throughput: 0: 9664.1. Samples: 58983992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:08,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:18:10,302][820675] Updated weights for policy 0, policy_version 115280 (0.0004) [2023-03-09 22:18:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 59052032. Throughput: 0: 9554.2. Samples: 59039744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:13,540][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:18:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115336_59052032.pth... [2023-03-09 22:18:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000114776_58765312.pth [2023-03-09 22:18:14,870][820675] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-09 22:18:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 59097088. Throughput: 0: 9509.7. Samples: 59094884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:18,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 22:18:19,210][820675] Updated weights for policy 0, policy_version 115440 (0.0006) [2023-03-09 22:18:23,508][820675] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-09 22:18:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 59146240. Throughput: 0: 9483.9. Samples: 59124516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:23,540][820373] Avg episode reward: [(0, '4.300')] [2023-03-09 22:18:28,108][820675] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-09 22:18:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 59191296. Throughput: 0: 9437.6. Samples: 59178868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:18:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115608_59191296.pth... [2023-03-09 22:18:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115056_58908672.pth [2023-03-09 22:18:32,280][820675] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-09 22:18:33,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 59236352. Throughput: 0: 9485.3. Samples: 59235204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:33,539][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 22:18:36,914][820675] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-09 22:18:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 59281408. Throughput: 0: 9399.6. Samples: 59260912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:38,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:18:41,323][820675] Updated weights for policy 0, policy_version 115840 (0.0004) [2023-03-09 22:18:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 59326464. Throughput: 0: 9369.1. Samples: 59318000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:18:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115872_59326464.pth... [2023-03-09 22:18:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115336_59052032.pth [2023-03-09 22:18:45,853][820675] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-09 22:18:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 59371520. Throughput: 0: 9268.2. Samples: 59371468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:48,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:18:50,298][820675] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-09 22:18:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 59420672. Throughput: 0: 9240.5. Samples: 59399816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:53,539][820373] Avg episode reward: [(0, '0.011')] [2023-03-09 22:18:54,734][820675] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-09 22:18:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 59465728. Throughput: 0: 9262.3. Samples: 59456548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:18:58,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:18:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116144_59465728.pth... [2023-03-09 22:18:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115608_59191296.pth [2023-03-09 22:18:59,007][820675] Updated weights for policy 0, policy_version 116160 (0.0006) [2023-03-09 22:19:03,385][820675] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-09 22:19:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 59514880. Throughput: 0: 9258.5. Samples: 59511516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:03,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:19:07,667][820675] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-09 22:19:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 59559936. Throughput: 0: 9224.3. Samples: 59539608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:19:12,197][820675] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-09 22:19:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 59604992. Throughput: 0: 9261.5. Samples: 59595636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:13,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:19:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116424_59609088.pth... [2023-03-09 22:19:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000115872_59326464.pth [2023-03-09 22:19:16,690][820675] Updated weights for policy 0, policy_version 116480 (0.0006) [2023-03-09 22:19:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 59654144. Throughput: 0: 9218.4. Samples: 59650032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:19:21,199][820675] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-09 22:19:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 59699200. Throughput: 0: 9274.7. Samples: 59678272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:23,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:19:25,574][820675] Updated weights for policy 0, policy_version 116640 (0.0006) [2023-03-09 22:19:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 59744256. Throughput: 0: 9227.7. Samples: 59733244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:19:28,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116696_59748352.pth... [2023-03-09 22:19:28,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116144_59465728.pth [2023-03-09 22:19:29,771][820675] Updated weights for policy 0, policy_version 116720 (0.0004) [2023-03-09 22:19:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 59793408. Throughput: 0: 9372.5. Samples: 59793232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:33,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:19:33,971][820675] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-09 22:19:38,475][820675] Updated weights for policy 0, policy_version 116880 (0.0004) [2023-03-09 22:19:38,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9352.6, 300 sec: 9483.3). Total num frames: 59842560. Throughput: 0: 9336.8. Samples: 59819972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:38,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:19:42,545][820675] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-09 22:19:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 59891712. Throughput: 0: 9395.4. Samples: 59879344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:43,540][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:19:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116976_59891712.pth... [2023-03-09 22:19:43,548][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116424_59609088.pth [2023-03-09 22:19:46,771][820675] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-09 22:19:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 59936768. Throughput: 0: 9447.5. Samples: 59936656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:19:51,273][820675] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-09 22:19:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 59985920. Throughput: 0: 9438.4. Samples: 59964336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:53,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:19:55,569][820675] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-09 22:19:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 60030976. Throughput: 0: 9467.0. Samples: 60021652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:19:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:19:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117248_60030976.pth... [2023-03-09 22:19:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116696_59748352.pth [2023-03-09 22:20:00,024][820675] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-09 22:20:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 60076032. Throughput: 0: 9465.3. Samples: 60075972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:20:03,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:20:04,369][820675] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-09 22:20:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 60125184. Throughput: 0: 9476.2. Samples: 60104700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:08,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:20:08,676][820675] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-09 22:20:13,206][820675] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-09 22:20:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 60170240. Throughput: 0: 9503.6. Samples: 60160908. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:13,539][820373] Avg episode reward: [(0, '0.278')] [2023-03-09 22:20:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117520_60170240.pth... [2023-03-09 22:20:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000116976_59891712.pth [2023-03-09 22:20:17,837][820675] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-09 22:20:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 60215296. Throughput: 0: 9337.6. Samples: 60213424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:18,550][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 22:20:22,299][820675] Updated weights for policy 0, policy_version 117680 (0.0004) [2023-03-09 22:20:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 60264448. Throughput: 0: 9347.7. Samples: 60240620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:20:26,770][820675] Updated weights for policy 0, policy_version 117760 (0.0004) [2023-03-09 22:20:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 60309504. Throughput: 0: 9272.5. Samples: 60296604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:28,539][820373] Avg episode reward: [(0, '0.024')] [2023-03-09 22:20:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117792_60309504.pth... [2023-03-09 22:20:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117248_60030976.pth [2023-03-09 22:20:31,142][820675] Updated weights for policy 0, policy_version 117840 (0.0004) [2023-03-09 22:20:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 60354560. Throughput: 0: 9230.2. Samples: 60352016. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:33,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 22:20:35,516][820675] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-09 22:20:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 60403712. Throughput: 0: 9224.6. Samples: 60379444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:38,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:20:39,548][820675] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-09 22:20:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.6, 300 sec: 9469.4). Total num frames: 60452864. Throughput: 0: 9305.3. Samples: 60440392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:43,539][820373] Avg episode reward: [(0, '0.091')] [2023-03-09 22:20:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118072_60452864.pth... [2023-03-09 22:20:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117520_60170240.pth [2023-03-09 22:20:43,757][820675] Updated weights for policy 0, policy_version 118080 (0.0006) [2023-03-09 22:20:48,164][820675] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-09 22:20:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 60502016. Throughput: 0: 9346.7. Samples: 60496572. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:48,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:20:52,266][820675] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-09 22:20:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 60551168. Throughput: 0: 9382.7. Samples: 60526924. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:53,539][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 22:20:56,573][820675] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-09 22:20:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 60596224. Throughput: 0: 9402.1. Samples: 60584000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:20:58,539][820373] Avg episode reward: [(0, '0.074')] [2023-03-09 22:20:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118352_60596224.pth... [2023-03-09 22:20:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000117792_60309504.pth [2023-03-09 22:21:00,998][820675] Updated weights for policy 0, policy_version 118400 (0.0005) [2023-03-09 22:21:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 60641280. Throughput: 0: 9467.7. Samples: 60639472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:21:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:21:05,397][820675] Updated weights for policy 0, policy_version 118480 (0.0004) [2023-03-09 22:21:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 60690432. Throughput: 0: 9489.3. Samples: 60667640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:08,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:21:09,555][820675] Updated weights for policy 0, policy_version 118560 (0.0005) [2023-03-09 22:21:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 60739584. Throughput: 0: 9553.1. Samples: 60726496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:21:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118632_60739584.pth... [2023-03-09 22:21:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118072_60452864.pth [2023-03-09 22:21:13,970][820675] Updated weights for policy 0, policy_version 118640 (0.0004) [2023-03-09 22:21:18,266][820675] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-09 22:21:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 60784640. Throughput: 0: 9590.8. Samples: 60783600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:18,539][820373] Avg episode reward: [(0, '0.079')] [2023-03-09 22:21:22,525][820675] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-09 22:21:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 60833792. Throughput: 0: 9606.0. Samples: 60811716. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:21:26,843][820675] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-09 22:21:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 60878848. Throughput: 0: 9517.0. Samples: 60868656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:21:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118904_60878848.pth... [2023-03-09 22:21:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118352_60596224.pth [2023-03-09 22:21:31,315][820675] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-09 22:21:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 60928000. Throughput: 0: 9528.7. Samples: 60925364. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:21:35,525][820675] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-09 22:21:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 60977152. Throughput: 0: 9506.8. Samples: 60954728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:38,539][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 22:21:39,604][820675] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-09 22:21:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 61022208. Throughput: 0: 9549.5. Samples: 61013728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:43,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:21:43,566][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119192_61026304.pth... [2023-03-09 22:21:43,568][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118632_60739584.pth [2023-03-09 22:21:43,996][820675] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-09 22:21:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 61067264. Throughput: 0: 9505.5. Samples: 61067220. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:48,539][820373] Avg episode reward: [(0, '0.008')] [2023-03-09 22:21:48,594][820675] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-09 22:21:52,993][820675] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-09 22:21:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 61116416. Throughput: 0: 9449.1. Samples: 61092852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:53,539][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 22:21:57,518][820675] Updated weights for policy 0, policy_version 119440 (0.0004) [2023-03-09 22:21:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 61161472. Throughput: 0: 9396.0. Samples: 61149316. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:21:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:21:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119456_61161472.pth... [2023-03-09 22:21:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000118904_60878848.pth [2023-03-09 22:22:01,828][820675] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-09 22:22:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 61210624. Throughput: 0: 9400.0. Samples: 61206600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:22:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:22:05,888][820675] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-09 22:22:08,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 61255680. Throughput: 0: 9447.5. Samples: 61236852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:22:08,539][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 22:22:10,412][820675] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-09 22:22:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 61304832. Throughput: 0: 9377.6. Samples: 61290648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:22:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119736_61304832.pth... [2023-03-09 22:22:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119192_61026304.pth [2023-03-09 22:22:14,968][820675] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-09 22:22:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 61349888. Throughput: 0: 9357.9. Samples: 61346468. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:18,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:22:19,281][820675] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-09 22:22:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 61394944. Throughput: 0: 9329.1. Samples: 61374536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:22:23,926][820675] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-09 22:22:28,062][820675] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-09 22:22:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 61444096. Throughput: 0: 9250.8. Samples: 61430012. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:28,539][820373] Avg episode reward: [(0, '0.496')] [2023-03-09 22:22:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120008_61444096.pth... [2023-03-09 22:22:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119456_61161472.pth [2023-03-09 22:22:32,407][820675] Updated weights for policy 0, policy_version 120080 (0.0005) [2023-03-09 22:22:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 61489152. Throughput: 0: 9339.4. Samples: 61487492. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:33,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:22:36,879][820675] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-09 22:22:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 61534208. Throughput: 0: 9363.1. Samples: 61514192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:38,539][820373] Avg episode reward: [(0, '0.110')] [2023-03-09 22:22:41,204][820675] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-09 22:22:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 61583360. Throughput: 0: 9379.2. Samples: 61571380. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:43,539][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 22:22:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120280_61583360.pth... [2023-03-09 22:22:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000119736_61304832.pth [2023-03-09 22:22:45,519][820675] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-09 22:22:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 61628416. Throughput: 0: 9373.7. Samples: 61628416. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:48,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:22:49,747][820675] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-09 22:22:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 61681664. Throughput: 0: 9369.3. Samples: 61658472. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:53,539][820373] Avg episode reward: [(0, '0.069')] [2023-03-09 22:22:53,901][820675] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-09 22:22:58,265][820675] Updated weights for policy 0, policy_version 120560 (0.0004) [2023-03-09 22:22:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 61726720. Throughput: 0: 9458.7. Samples: 61716288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:22:58,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:22:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120560_61726720.pth... [2023-03-09 22:22:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120008_61444096.pth [2023-03-09 22:23:02,663][820675] Updated weights for policy 0, policy_version 120640 (0.0004) [2023-03-09 22:23:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.6, 300 sec: 9372.2). Total num frames: 61771776. Throughput: 0: 9450.2. Samples: 61771724. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:23:07,151][820675] Updated weights for policy 0, policy_version 120720 (0.0004) [2023-03-09 22:23:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 61820928. Throughput: 0: 9447.5. Samples: 61799676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:08,539][820373] Avg episode reward: [(0, '2.631')] [2023-03-09 22:23:11,251][820675] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-09 22:23:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 61870080. Throughput: 0: 9494.5. Samples: 61857264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:13,540][820373] Avg episode reward: [(0, '2.661')] [2023-03-09 22:23:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120840_61870080.pth... [2023-03-09 22:23:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120280_61583360.pth [2023-03-09 22:23:15,871][820675] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-09 22:23:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 61911040. Throughput: 0: 9412.5. Samples: 61911052. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:23:20,252][820675] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-09 22:23:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 61960192. Throughput: 0: 9466.5. Samples: 61940184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:23,539][820373] Avg episode reward: [(0, '0.021')] [2023-03-09 22:23:24,664][820675] Updated weights for policy 0, policy_version 121040 (0.0004) [2023-03-09 22:23:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 62005248. Throughput: 0: 9433.6. Samples: 61995892. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:28,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:23:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121104_62005248.pth... [2023-03-09 22:23:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120560_61726720.pth [2023-03-09 22:23:29,008][820675] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-09 22:23:33,422][820675] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-09 22:23:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 62054400. Throughput: 0: 9376.7. Samples: 62050368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:23:37,958][820675] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-09 22:23:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 62099456. Throughput: 0: 9344.5. Samples: 62078976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:38,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:23:42,700][820675] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-09 22:23:43,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 62140416. Throughput: 0: 9224.5. Samples: 62131392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:43,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:23:43,556][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121376_62144512.pth... [2023-03-09 22:23:43,558][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000120840_61870080.pth [2023-03-09 22:23:47,077][820675] Updated weights for policy 0, policy_version 121440 (0.0006) [2023-03-09 22:23:48,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 62189568. Throughput: 0: 9195.8. Samples: 62185536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:48,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:23:51,397][820675] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-09 22:23:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 62234624. Throughput: 0: 9226.5. Samples: 62214868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:23:55,699][820675] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-09 22:23:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 62283776. Throughput: 0: 9205.2. Samples: 62271500. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:23:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:23:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121648_62283776.pth... [2023-03-09 22:23:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121104_62005248.pth [2023-03-09 22:24:00,231][820675] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-09 22:24:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 62328832. Throughput: 0: 9224.7. Samples: 62326164. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:24:03,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:24:04,733][820675] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-09 22:24:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 62373888. Throughput: 0: 9182.8. Samples: 62353408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:24:08,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:24:09,194][820675] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-09 22:24:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9372.2). Total num frames: 62418944. Throughput: 0: 9167.0. Samples: 62408408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:13,539][820373] Avg episode reward: [(0, '0.382')] [2023-03-09 22:24:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121912_62418944.pth... [2023-03-09 22:24:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121376_62144512.pth [2023-03-09 22:24:13,617][820675] Updated weights for policy 0, policy_version 121920 (0.0004) [2023-03-09 22:24:17,786][820675] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-09 22:24:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 62468096. Throughput: 0: 9259.8. Samples: 62467060. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:18,539][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 22:24:22,290][820675] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-09 22:24:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 62517248. Throughput: 0: 9228.2. Samples: 62494244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:23,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 22:24:26,712][820675] Updated weights for policy 0, policy_version 122160 (0.0004) [2023-03-09 22:24:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9386.1). Total num frames: 62562304. Throughput: 0: 9304.2. Samples: 62550080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:28,540][820373] Avg episode reward: [(0, '0.095')] [2023-03-09 22:24:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122192_62562304.pth... [2023-03-09 22:24:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121648_62283776.pth [2023-03-09 22:24:30,982][820675] Updated weights for policy 0, policy_version 122240 (0.0004) [2023-03-09 22:24:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 62611456. Throughput: 0: 9351.8. Samples: 62606368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:33,539][820373] Avg episode reward: [(0, '0.523')] [2023-03-09 22:24:35,199][820675] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-09 22:24:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 62656512. Throughput: 0: 9357.9. Samples: 62635972. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:38,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:24:39,521][820675] Updated weights for policy 0, policy_version 122400 (0.0004) [2023-03-09 22:24:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 62705664. Throughput: 0: 9375.0. Samples: 62693376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:43,539][820373] Avg episode reward: [(0, '0.217')] [2023-03-09 22:24:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122472_62705664.pth... [2023-03-09 22:24:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000121912_62418944.pth [2023-03-09 22:24:43,952][820675] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-09 22:24:48,118][820675] Updated weights for policy 0, policy_version 122560 (0.0004) [2023-03-09 22:24:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 62750720. Throughput: 0: 9421.0. Samples: 62750108. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:24:52,507][820675] Updated weights for policy 0, policy_version 122640 (0.0004) [2023-03-09 22:24:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 62799872. Throughput: 0: 9458.5. Samples: 62779040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:53,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:24:56,908][820675] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-09 22:24:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9386.1). Total num frames: 62844928. Throughput: 0: 9460.3. Samples: 62834120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:24:58,539][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 22:24:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122744_62844928.pth... [2023-03-09 22:24:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122192_62562304.pth [2023-03-09 22:25:01,244][820675] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-09 22:25:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 62894080. Throughput: 0: 9399.9. Samples: 62890056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:25:03,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:25:05,539][820675] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-09 22:25:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 62943232. Throughput: 0: 9438.8. Samples: 62918992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:25:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:25:09,936][820675] Updated weights for policy 0, policy_version 122960 (0.0004) [2023-03-09 22:25:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9400.0). Total num frames: 62988288. Throughput: 0: 9464.1. Samples: 62975964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:13,540][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:25:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123024_62988288.pth... [2023-03-09 22:25:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122472_62705664.pth [2023-03-09 22:25:14,373][820675] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-09 22:25:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63033344. Throughput: 0: 9474.3. Samples: 63032712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:18,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:25:18,637][820675] Updated weights for policy 0, policy_version 123120 (0.0004) [2023-03-09 22:25:22,914][820675] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-09 22:25:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 63082496. Throughput: 0: 9463.7. Samples: 63061840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:25:27,371][820675] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-09 22:25:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 63127552. Throughput: 0: 9403.0. Samples: 63116512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:25:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123296_63127552.pth... [2023-03-09 22:25:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000122744_62844928.pth [2023-03-09 22:25:31,850][820675] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-09 22:25:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 63172608. Throughput: 0: 9377.7. Samples: 63172104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:33,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:25:36,289][820675] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-09 22:25:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63221760. Throughput: 0: 9341.7. Samples: 63199420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:38,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:25:40,585][820675] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-09 22:25:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 63266816. Throughput: 0: 9378.5. Samples: 63256152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:43,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 22:25:43,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123576_63270912.pth... [2023-03-09 22:25:43,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123024_62988288.pth [2023-03-09 22:25:44,815][820675] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-09 22:25:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63315968. Throughput: 0: 9403.8. Samples: 63313228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:48,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:25:49,260][820675] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-09 22:25:53,326][820675] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-09 22:25:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63365120. Throughput: 0: 9369.4. Samples: 63340616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:25:57,791][820675] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-09 22:25:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63410176. Throughput: 0: 9428.1. Samples: 63400228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:25:58,540][820373] Avg episode reward: [(0, '0.624')] [2023-03-09 22:25:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123848_63410176.pth... [2023-03-09 22:25:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123296_63127552.pth [2023-03-09 22:26:01,957][820675] Updated weights for policy 0, policy_version 123920 (0.0006) [2023-03-09 22:26:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63459328. Throughput: 0: 9426.4. Samples: 63456900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:06,545][820675] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-09 22:26:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 63504384. Throughput: 0: 9379.2. Samples: 63483904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:08,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:26:10,846][820675] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-09 22:26:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 63553536. Throughput: 0: 9424.8. Samples: 63540628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:13,540][820373] Avg episode reward: [(0, '0.245')] [2023-03-09 22:26:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124128_63553536.pth... [2023-03-09 22:26:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123576_63270912.pth [2023-03-09 22:26:15,313][820675] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-09 22:26:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63598592. Throughput: 0: 9413.7. Samples: 63595720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:19,735][820675] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-09 22:26:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 63643648. Throughput: 0: 9418.1. Samples: 63623232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:24,156][820675] Updated weights for policy 0, policy_version 124320 (0.0004) [2023-03-09 22:26:28,514][820675] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-09 22:26:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63692800. Throughput: 0: 9417.1. Samples: 63679924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124400_63692800.pth... [2023-03-09 22:26:28,548][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000123848_63410176.pth [2023-03-09 22:26:32,912][820675] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-09 22:26:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 63737856. Throughput: 0: 9373.5. Samples: 63735036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:33,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:26:37,359][820675] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-09 22:26:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 63782912. Throughput: 0: 9373.7. Samples: 63762432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:41,491][820675] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-09 22:26:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63832064. Throughput: 0: 9369.2. Samples: 63821840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124672_63832064.pth... [2023-03-09 22:26:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124128_63553536.pth [2023-03-09 22:26:45,853][820675] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-09 22:26:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63881216. Throughput: 0: 9371.4. Samples: 63878612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:50,313][820675] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-09 22:26:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 63926272. Throughput: 0: 9347.7. Samples: 63904552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:54,788][820675] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-09 22:26:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 63975424. Throughput: 0: 9383.0. Samples: 63962864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:26:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:26:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124952_63975424.pth... [2023-03-09 22:26:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124400_63692800.pth [2023-03-09 22:26:58,896][820675] Updated weights for policy 0, policy_version 124960 (0.0005) [2023-03-09 22:27:03,293][820675] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-09 22:27:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 64020480. Throughput: 0: 9391.7. Samples: 64018348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:03,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:27:07,551][820675] Updated weights for policy 0, policy_version 125120 (0.0005) [2023-03-09 22:27:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 64069632. Throughput: 0: 9411.3. Samples: 64046740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:08,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:27:11,852][820675] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-09 22:27:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 64114688. Throughput: 0: 9435.9. Samples: 64104540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:13,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:27:13,564][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125232_64118784.pth... [2023-03-09 22:27:13,567][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124672_63832064.pth [2023-03-09 22:27:16,055][820675] Updated weights for policy 0, policy_version 125280 (0.0005) [2023-03-09 22:27:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 64163840. Throughput: 0: 9468.0. Samples: 64161096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:18,539][820373] Avg episode reward: [(0, '0.156')] [2023-03-09 22:27:20,372][820675] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-09 22:27:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 64212992. Throughput: 0: 9533.1. Samples: 64191420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:27:24,716][820675] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-09 22:27:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 64258048. Throughput: 0: 9466.0. Samples: 64247812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:28,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:27:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125504_64258048.pth... [2023-03-09 22:27:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000124952_63975424.pth [2023-03-09 22:27:29,065][820675] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-09 22:27:33,435][820675] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-09 22:27:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 64307200. Throughput: 0: 9433.5. Samples: 64303120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:27:37,834][820675] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-09 22:27:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 64352256. Throughput: 0: 9493.0. Samples: 64331736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:38,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:27:42,428][820675] Updated weights for policy 0, policy_version 125760 (0.0004) [2023-03-09 22:27:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 64397312. Throughput: 0: 9404.4. Samples: 64386060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:43,540][820373] Avg episode reward: [(0, '0.208')] [2023-03-09 22:27:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125776_64397312.pth... [2023-03-09 22:27:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125232_64118784.pth [2023-03-09 22:27:47,079][820675] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-09 22:27:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 64442368. Throughput: 0: 9366.4. Samples: 64439836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:48,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:27:51,571][820675] Updated weights for policy 0, policy_version 125920 (0.0005) [2023-03-09 22:27:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 64487424. Throughput: 0: 9336.5. Samples: 64466884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:27:56,103][820675] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-09 22:27:58,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 64532480. Throughput: 0: 9238.1. Samples: 64520256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:27:58,540][820373] Avg episode reward: [(0, '0.112')] [2023-03-09 22:27:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126040_64532480.pth... [2023-03-09 22:27:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125504_64258048.pth [2023-03-09 22:28:00,593][820675] Updated weights for policy 0, policy_version 126080 (0.0005) [2023-03-09 22:28:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 64577536. Throughput: 0: 9202.9. Samples: 64575224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:28:05,122][820675] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-09 22:28:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 64626688. Throughput: 0: 9157.0. Samples: 64603484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:28:09,412][820675] Updated weights for policy 0, policy_version 126240 (0.0005) [2023-03-09 22:28:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 64667648. Throughput: 0: 9147.0. Samples: 64659428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:13,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:28:13,558][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126312_64671744.pth... [2023-03-09 22:28:13,559][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000125776_64397312.pth [2023-03-09 22:28:14,033][820675] Updated weights for policy 0, policy_version 126320 (0.0006) [2023-03-09 22:28:18,360][820675] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-09 22:28:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 64716800. Throughput: 0: 9120.7. Samples: 64713552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:28:22,828][820675] Updated weights for policy 0, policy_version 126480 (0.0005) [2023-03-09 22:28:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 64761856. Throughput: 0: 9104.7. Samples: 64741448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:23,539][820373] Avg episode reward: [(0, '0.076')] [2023-03-09 22:28:27,484][820675] Updated weights for policy 0, policy_version 126560 (0.0005) [2023-03-09 22:28:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 64806912. Throughput: 0: 9080.8. Samples: 64794696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:28:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126576_64806912.pth... [2023-03-09 22:28:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126040_64532480.pth [2023-03-09 22:28:31,902][820675] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-09 22:28:33,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9079.4, 300 sec: 9330.5). Total num frames: 64851968. Throughput: 0: 9145.3. Samples: 64851376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:33,540][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:28:36,322][820675] Updated weights for policy 0, policy_version 126720 (0.0004) [2023-03-09 22:28:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9344.4). Total num frames: 64897024. Throughput: 0: 9139.6. Samples: 64878164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:28:40,868][820675] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-09 22:28:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 64946176. Throughput: 0: 9190.1. Samples: 64933812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:43,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:28:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126848_64946176.pth... [2023-03-09 22:28:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126312_64671744.pth [2023-03-09 22:28:45,305][820675] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-09 22:28:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 64991232. Throughput: 0: 9155.8. Samples: 64987236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:48,539][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 22:28:49,709][820675] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-09 22:28:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9330.6). Total num frames: 65036288. Throughput: 0: 9162.8. Samples: 65015808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:53,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:28:53,909][820675] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-09 22:28:58,198][820675] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-09 22:28:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 65085440. Throughput: 0: 9222.2. Samples: 65074428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:28:58,539][820373] Avg episode reward: [(0, '0.094')] [2023-03-09 22:28:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127120_65085440.pth... [2023-03-09 22:28:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126576_64806912.pth [2023-03-09 22:29:02,403][820675] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-09 22:29:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 65134592. Throughput: 0: 9331.2. Samples: 65133456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:29:06,742][820675] Updated weights for policy 0, policy_version 127280 (0.0004) [2023-03-09 22:29:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 65183744. Throughput: 0: 9328.3. Samples: 65161220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:29:11,330][820675] Updated weights for policy 0, policy_version 127360 (0.0006) [2023-03-09 22:29:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 65228800. Throughput: 0: 9360.2. Samples: 65215904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:13,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:29:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127400_65228800.pth... [2023-03-09 22:29:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000126848_64946176.pth [2023-03-09 22:29:15,410][820675] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-09 22:29:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 65277952. Throughput: 0: 9389.9. Samples: 65273920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:18,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:29:19,904][820675] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-09 22:29:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 65323008. Throughput: 0: 9421.6. Samples: 65302136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:23,539][820373] Avg episode reward: [(0, '0.099')] [2023-03-09 22:29:24,176][820675] Updated weights for policy 0, policy_version 127600 (0.0006) [2023-03-09 22:29:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 65368064. Throughput: 0: 9420.9. Samples: 65357752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:28,539][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 22:29:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127672_65368064.pth... [2023-03-09 22:29:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127120_65085440.pth [2023-03-09 22:29:28,628][820675] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-09 22:29:33,132][820675] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-09 22:29:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 65417216. Throughput: 0: 9463.4. Samples: 65413092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:33,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:29:37,030][820675] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-09 22:29:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 65466368. Throughput: 0: 9548.3. Samples: 65445484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:29:41,431][820675] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-09 22:29:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 65515520. Throughput: 0: 9504.8. Samples: 65502144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:43,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:29:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127960_65515520.pth... [2023-03-09 22:29:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127400_65228800.pth [2023-03-09 22:29:45,765][820675] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-09 22:29:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9358.3). Total num frames: 65560576. Throughput: 0: 9410.1. Samples: 65556912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:48,540][820373] Avg episode reward: [(0, '7.101')] [2023-03-09 22:29:50,301][820675] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-09 22:29:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 65605632. Throughput: 0: 9402.8. Samples: 65584348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:53,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:29:54,572][820675] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-09 22:29:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 65650688. Throughput: 0: 9417.1. Samples: 65639672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:29:58,540][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 22:29:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128224_65650688.pth... [2023-03-09 22:29:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127672_65368064.pth [2023-03-09 22:29:59,060][820675] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-09 22:30:03,354][820675] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-09 22:30:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 65699840. Throughput: 0: 9402.2. Samples: 65697020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:03,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:30:07,760][820675] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-09 22:30:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 65748992. Throughput: 0: 9384.0. Samples: 65724416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:08,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:30:11,894][820675] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-09 22:30:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 65794048. Throughput: 0: 9461.9. Samples: 65783540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:30:13,552][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128504_65794048.pth... [2023-03-09 22:30:13,554][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000127960_65515520.pth [2023-03-09 22:30:16,441][820675] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-09 22:30:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 65839104. Throughput: 0: 9421.5. Samples: 65837060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:18,550][820373] Avg episode reward: [(0, '0.086')] [2023-03-09 22:30:21,064][820675] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-09 22:30:23,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 65884160. Throughput: 0: 9293.4. Samples: 65863688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:30:25,610][820675] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-09 22:30:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 65929216. Throughput: 0: 9230.5. Samples: 65917516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:30:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128768_65929216.pth... [2023-03-09 22:30:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128224_65650688.pth [2023-03-09 22:30:30,056][820675] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-09 22:30:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 65978368. Throughput: 0: 9277.6. Samples: 65974404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:30:34,377][820675] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-09 22:30:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 66023424. Throughput: 0: 9301.9. Samples: 66002932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:38,540][820373] Avg episode reward: [(0, '0.117')] [2023-03-09 22:30:38,748][820675] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-09 22:30:42,910][820675] Updated weights for policy 0, policy_version 129040 (0.0004) [2023-03-09 22:30:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 66072576. Throughput: 0: 9353.5. Samples: 66060580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:43,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:30:43,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129048_66072576.pth... [2023-03-09 22:30:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128504_65794048.pth [2023-03-09 22:30:47,496][820675] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-09 22:30:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 66117632. Throughput: 0: 9257.5. Samples: 66113608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:48,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:30:52,171][820675] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-09 22:30:53,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 66162688. Throughput: 0: 9235.7. Samples: 66140020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:30:56,559][820675] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-09 22:30:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 66207744. Throughput: 0: 9162.5. Samples: 66195852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:30:58,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:30:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129312_66207744.pth... [2023-03-09 22:30:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000128768_65929216.pth [2023-03-09 22:31:00,851][820675] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-09 22:31:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 66256896. Throughput: 0: 9243.8. Samples: 66253028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:03,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:31:04,929][820675] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-09 22:31:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 66306048. Throughput: 0: 9312.7. Samples: 66282760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:08,547][820373] Avg episode reward: [(0, '0.025')] [2023-03-09 22:31:09,284][820675] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-09 22:31:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9330.5). Total num frames: 66351104. Throughput: 0: 9375.0. Samples: 66339392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:13,550][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:31:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129592_66351104.pth... [2023-03-09 22:31:13,557][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129048_66072576.pth [2023-03-09 22:31:13,763][820675] Updated weights for policy 0, policy_version 129600 (0.0005) [2023-03-09 22:31:18,358][820675] Updated weights for policy 0, policy_version 129680 (0.0004) [2023-03-09 22:31:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 66396160. Throughput: 0: 9295.5. Samples: 66392700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:18,539][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 22:31:22,866][820675] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-09 22:31:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 66441216. Throughput: 0: 9280.2. Samples: 66420540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:23,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:31:27,220][820675] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-09 22:31:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 66490368. Throughput: 0: 9263.4. Samples: 66477432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:28,539][820373] Avg episode reward: [(0, '0.038')] [2023-03-09 22:31:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129864_66490368.pth... [2023-03-09 22:31:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129312_66207744.pth [2023-03-09 22:31:31,245][820675] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-09 22:31:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 66539520. Throughput: 0: 9375.1. Samples: 66535488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:33,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:31:35,549][820675] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-09 22:31:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9330.6). Total num frames: 66584576. Throughput: 0: 9430.8. Samples: 66564408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:31:40,048][820675] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-09 22:31:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 66633728. Throughput: 0: 9425.1. Samples: 66619980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:31:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130144_66633728.pth... [2023-03-09 22:31:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129592_66351104.pth [2023-03-09 22:31:44,325][820675] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-09 22:31:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 66678784. Throughput: 0: 9373.1. Samples: 66674816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:48,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:31:48,847][820675] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-09 22:31:53,297][820675] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-09 22:31:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 66723840. Throughput: 0: 9345.4. Samples: 66703304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:53,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:31:57,449][820675] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-09 22:31:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 66772992. Throughput: 0: 9374.0. Samples: 66761220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:31:58,540][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 22:31:58,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130416_66772992.pth... [2023-03-09 22:31:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000129864_66490368.pth [2023-03-09 22:32:01,749][820675] Updated weights for policy 0, policy_version 130480 (0.0006) [2023-03-09 22:32:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 66822144. Throughput: 0: 9453.8. Samples: 66818120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:03,539][820373] Avg episode reward: [(0, '0.008')] [2023-03-09 22:32:06,115][820675] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-09 22:32:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 66867200. Throughput: 0: 9470.4. Samples: 66846708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:08,550][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 22:32:10,505][820675] Updated weights for policy 0, policy_version 130640 (0.0004) [2023-03-09 22:32:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 66916352. Throughput: 0: 9457.8. Samples: 66903032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:13,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:32:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130696_66916352.pth... [2023-03-09 22:32:13,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130144_66633728.pth [2023-03-09 22:32:14,892][820675] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-09 22:32:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 66957312. Throughput: 0: 9364.9. Samples: 66956908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:32:19,473][820675] Updated weights for policy 0, policy_version 130800 (0.0004) [2023-03-09 22:32:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 67006464. Throughput: 0: 9312.3. Samples: 66983464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:23,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:32:23,933][820675] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-09 22:32:28,040][820675] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-09 22:32:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 67055616. Throughput: 0: 9375.9. Samples: 67041896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:28,540][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 22:32:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130968_67055616.pth... [2023-03-09 22:32:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130416_66772992.pth [2023-03-09 22:32:32,453][820675] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-09 22:32:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 67100672. Throughput: 0: 9404.4. Samples: 67098012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:33,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 22:32:36,945][820675] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-09 22:32:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 67145728. Throughput: 0: 9377.9. Samples: 67125312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:38,539][820373] Avg episode reward: [(0, '0.156')] [2023-03-09 22:32:41,468][820675] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-09 22:32:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 67190784. Throughput: 0: 9294.2. Samples: 67179460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:43,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:32:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131232_67190784.pth... [2023-03-09 22:32:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130696_66916352.pth [2023-03-09 22:32:45,850][820675] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-09 22:32:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 67239936. Throughput: 0: 9277.3. Samples: 67235600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:48,539][820373] Avg episode reward: [(0, '0.074')] [2023-03-09 22:32:50,255][820675] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-09 22:32:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 67289088. Throughput: 0: 9282.7. Samples: 67264428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:53,539][820373] Avg episode reward: [(0, '0.123')] [2023-03-09 22:32:54,376][820675] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-09 22:32:58,507][820675] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-09 22:32:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 67338240. Throughput: 0: 9328.5. Samples: 67322816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:32:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:32:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131520_67338240.pth... [2023-03-09 22:32:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000130968_67055616.pth [2023-03-09 22:33:02,727][820675] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-09 22:33:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 67383296. Throughput: 0: 9468.8. Samples: 67383004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:03,539][820373] Avg episode reward: [(0, '0.108')] [2023-03-09 22:33:07,066][820675] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-09 22:33:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 67432448. Throughput: 0: 9489.3. Samples: 67410480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:08,550][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 22:33:11,528][820675] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-09 22:33:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 67477504. Throughput: 0: 9414.4. Samples: 67465544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:13,539][820373] Avg episode reward: [(0, '0.138')] [2023-03-09 22:33:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131792_67477504.pth... [2023-03-09 22:33:13,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131232_67190784.pth [2023-03-09 22:33:15,852][820675] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-09 22:33:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 67522560. Throughput: 0: 9423.0. Samples: 67522048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:18,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:33:20,544][820675] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-09 22:33:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 67567616. Throughput: 0: 9386.5. Samples: 67547704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:23,550][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 22:33:25,018][820675] Updated weights for policy 0, policy_version 132000 (0.0006) [2023-03-09 22:33:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 67612672. Throughput: 0: 9426.1. Samples: 67603632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:33:28,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 22:33:28,581][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132064_67616768.pth... [2023-03-09 22:33:28,583][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131520_67338240.pth [2023-03-09 22:33:29,433][820675] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-09 22:33:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 67657728. Throughput: 0: 9348.2. Samples: 67656268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:33,550][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 22:33:34,206][820675] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-09 22:33:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 67702784. Throughput: 0: 9321.4. Samples: 67683892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:38,539][820373] Avg episode reward: [(0, '5.549')] [2023-03-09 22:33:38,555][820675] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-09 22:33:43,076][820675] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-09 22:33:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 67751936. Throughput: 0: 9259.6. Samples: 67739496. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:43,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:33:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132328_67751936.pth... [2023-03-09 22:33:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000131792_67477504.pth [2023-03-09 22:33:47,682][820675] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-09 22:33:48,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 67792896. Throughput: 0: 9107.7. Samples: 67792852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:48,539][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 22:33:52,159][820675] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-09 22:33:53,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 67842048. Throughput: 0: 9119.5. Samples: 67820856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:53,539][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 22:33:56,719][820675] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-09 22:33:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 67887104. Throughput: 0: 9091.4. Samples: 67874656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:33:58,540][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 22:33:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132592_67887104.pth... [2023-03-09 22:33:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132064_67616768.pth [2023-03-09 22:34:00,917][820675] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-09 22:34:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 67932160. Throughput: 0: 9090.6. Samples: 67931124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:03,539][820373] Avg episode reward: [(0, '0.159')] [2023-03-09 22:34:05,589][820675] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-09 22:34:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 67977216. Throughput: 0: 9091.2. Samples: 67956808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:08,550][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 22:34:09,913][820675] Updated weights for policy 0, policy_version 132800 (0.0004) [2023-03-09 22:34:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 68026368. Throughput: 0: 9118.5. Samples: 68013964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:13,550][820373] Avg episode reward: [(0, '0.267')] [2023-03-09 22:34:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132864_68026368.pth... [2023-03-09 22:34:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132328_67751936.pth [2023-03-09 22:34:14,269][820675] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-09 22:34:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 68071424. Throughput: 0: 9223.0. Samples: 68071304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:18,539][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 22:34:18,593][820675] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-09 22:34:22,899][820675] Updated weights for policy 0, policy_version 133040 (0.0006) [2023-03-09 22:34:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 68120576. Throughput: 0: 9240.9. Samples: 68099732. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:34:27,325][820675] Updated weights for policy 0, policy_version 133120 (0.0006) [2023-03-09 22:34:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 68165632. Throughput: 0: 9236.5. Samples: 68155140. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:28,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:34:28,548][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133144_68169728.pth... [2023-03-09 22:34:28,549][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132592_67887104.pth [2023-03-09 22:34:31,536][820675] Updated weights for policy 0, policy_version 133200 (0.0005) [2023-03-09 22:34:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 68214784. Throughput: 0: 9339.6. Samples: 68213132. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:34:33,550][820373] Avg episode reward: [(0, '1.117')] [2023-03-09 22:34:35,865][820675] Updated weights for policy 0, policy_version 133280 (0.0005) [2023-03-09 22:34:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 68259840. Throughput: 0: 9339.7. Samples: 68241140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:34:38,539][820373] Avg episode reward: [(0, '0.050')] [2023-03-09 22:34:40,390][820675] Updated weights for policy 0, policy_version 133360 (0.0005) [2023-03-09 22:34:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9316.7). Total num frames: 68308992. Throughput: 0: 9376.0. Samples: 68296576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:34:43,540][820373] Avg episode reward: [(0, '0.101')] [2023-03-09 22:34:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133416_68308992.pth... [2023-03-09 22:34:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000132864_68026368.pth [2023-03-09 22:34:44,727][820675] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-09 22:34:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 68354048. Throughput: 0: 9365.8. Samples: 68352584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:34:48,539][820373] Avg episode reward: [(0, '0.131')] [2023-03-09 22:34:49,068][820675] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-09 22:34:53,422][820675] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-09 22:34:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 68403200. Throughput: 0: 9436.8. Samples: 68381464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:34:53,539][820373] Avg episode reward: [(0, '0.114')] [2023-03-09 22:34:57,691][820675] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-09 22:34:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 68448256. Throughput: 0: 9431.9. Samples: 68438400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:34:58,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 22:34:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133688_68448256.pth... [2023-03-09 22:34:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133144_68169728.pth [2023-03-09 22:35:02,020][820675] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-09 22:35:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 68497408. Throughput: 0: 9426.5. Samples: 68495496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:06,413][820675] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-09 22:35:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 68542464. Throughput: 0: 9392.5. Samples: 68522392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:08,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:35:10,773][820675] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-09 22:35:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 68587520. Throughput: 0: 9414.3. Samples: 68578784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:13,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:35:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133960_68587520.pth... [2023-03-09 22:35:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133416_68308992.pth [2023-03-09 22:35:15,201][820675] Updated weights for policy 0, policy_version 134000 (0.0004) [2023-03-09 22:35:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 68636672. Throughput: 0: 9359.1. Samples: 68634292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:18,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 22:35:19,602][820675] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-09 22:35:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 68681728. Throughput: 0: 9337.3. Samples: 68661320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:23,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:35:24,067][820675] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-09 22:35:28,156][820675] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-09 22:35:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 68730880. Throughput: 0: 9421.7. Samples: 68720552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134240_68730880.pth... [2023-03-09 22:35:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133688_68448256.pth [2023-03-09 22:35:32,737][820675] Updated weights for policy 0, policy_version 134320 (0.0004) [2023-03-09 22:35:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 68775936. Throughput: 0: 9400.2. Samples: 68775592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:35:33,550][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:35:36,839][820675] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-09 22:35:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 68825088. Throughput: 0: 9404.6. Samples: 68804672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:35:38,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:41,017][820675] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-09 22:35:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 68874240. Throughput: 0: 9443.5. Samples: 68863356. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:35:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134520_68874240.pth... [2023-03-09 22:35:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000133960_68587520.pth [2023-03-09 22:35:45,551][820675] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-09 22:35:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 68919296. Throughput: 0: 9402.2. Samples: 68918596. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:35:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:49,829][820675] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-09 22:35:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 68968448. Throughput: 0: 9456.9. Samples: 68947952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:35:53,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:35:54,037][820675] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-09 22:35:58,033][820675] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-09 22:35:58,539][820373] Fps is (10 sec: 10239.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 69021696. Throughput: 0: 9522.7. Samples: 69007308. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:35:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:35:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134808_69021696.pth... [2023-03-09 22:35:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134240_68730880.pth [2023-03-09 22:36:02,367][820675] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-09 22:36:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 69066752. Throughput: 0: 9582.9. Samples: 69065524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:36:06,486][820675] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-09 22:36:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 69115904. Throughput: 0: 9629.4. Samples: 69094644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:36:10,611][820675] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-09 22:36:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 69165056. Throughput: 0: 9625.8. Samples: 69153712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:13,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:36:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135088_69165056.pth... [2023-03-09 22:36:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134520_68874240.pth [2023-03-09 22:36:15,165][820675] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-09 22:36:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 69210112. Throughput: 0: 9650.3. Samples: 69209856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:36:19,388][820675] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-09 22:36:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 69259264. Throughput: 0: 9622.2. Samples: 69237672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:36:23,906][820675] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-09 22:36:28,363][820675] Updated weights for policy 0, policy_version 135360 (0.0006) [2023-03-09 22:36:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 69304320. Throughput: 0: 9531.1. Samples: 69292256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:28,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:36:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135360_69304320.pth... [2023-03-09 22:36:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000134808_69021696.pth [2023-03-09 22:36:32,804][820675] Updated weights for policy 0, policy_version 135440 (0.0006) [2023-03-09 22:36:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 69349376. Throughput: 0: 9549.9. Samples: 69348340. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:33,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:36:37,035][820675] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-09 22:36:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 69398528. Throughput: 0: 9523.2. Samples: 69376496. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:36:38,540][820373] Avg episode reward: [(0, '0.096')] [2023-03-09 22:36:41,175][820675] Updated weights for policy 0, policy_version 135600 (0.0006) [2023-03-09 22:36:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 69447680. Throughput: 0: 9511.4. Samples: 69435320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:36:43,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:36:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135640_69447680.pth... [2023-03-09 22:36:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135088_69165056.pth [2023-03-09 22:36:45,626][820675] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-09 22:36:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 69492736. Throughput: 0: 9468.2. Samples: 69491592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:36:48,540][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:36:49,990][820675] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-09 22:36:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 69541888. Throughput: 0: 9440.0. Samples: 69519444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:36:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:36:54,312][820675] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-09 22:36:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 69586944. Throughput: 0: 9354.0. Samples: 69574640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:36:58,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 22:36:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135912_69586944.pth... [2023-03-09 22:36:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135360_69304320.pth [2023-03-09 22:36:58,773][820675] Updated weights for policy 0, policy_version 135920 (0.0006) [2023-03-09 22:37:02,750][820675] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-09 22:37:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 69636096. Throughput: 0: 9466.2. Samples: 69635836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:37:07,117][820675] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-09 22:37:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 69685248. Throughput: 0: 9470.3. Samples: 69663836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:08,550][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:37:11,194][820675] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-09 22:37:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 69734400. Throughput: 0: 9582.5. Samples: 69723468. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:13,539][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 22:37:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136200_69734400.pth... [2023-03-09 22:37:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135640_69447680.pth [2023-03-09 22:37:15,484][820675] Updated weights for policy 0, policy_version 136240 (0.0005) [2023-03-09 22:37:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 69779456. Throughput: 0: 9569.4. Samples: 69778964. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:18,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:37:19,899][820675] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-09 22:37:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 69828608. Throughput: 0: 9574.2. Samples: 69807336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:23,539][820373] Avg episode reward: [(0, '0.138')] [2023-03-09 22:37:24,284][820675] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-09 22:37:28,505][820675] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-09 22:37:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 69877760. Throughput: 0: 9518.4. Samples: 69863648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:37:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136480_69877760.pth... [2023-03-09 22:37:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000135912_69586944.pth [2023-03-09 22:37:32,727][820675] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-09 22:37:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 69922816. Throughput: 0: 9577.5. Samples: 69922580. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:33,539][820373] Avg episode reward: [(0, '0.038')] [2023-03-09 22:37:37,191][820675] Updated weights for policy 0, policy_version 136640 (0.0004) [2023-03-09 22:37:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 69971968. Throughput: 0: 9540.2. Samples: 69948756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:37:38,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:37:41,511][820675] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-09 22:37:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 70017024. Throughput: 0: 9564.0. Samples: 70005020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:37:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:37:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136752_70017024.pth... [2023-03-09 22:37:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136200_69734400.pth [2023-03-09 22:37:46,135][820675] Updated weights for policy 0, policy_version 136800 (0.0004) [2023-03-09 22:37:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 70062080. Throughput: 0: 9432.6. Samples: 70060304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:37:48,539][820373] Avg episode reward: [(0, '0.094')] [2023-03-09 22:37:50,462][820675] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-09 22:37:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 70111232. Throughput: 0: 9434.2. Samples: 70088376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:37:53,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:37:54,807][820675] Updated weights for policy 0, policy_version 136960 (0.0006) [2023-03-09 22:37:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 70160384. Throughput: 0: 9399.8. Samples: 70146460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:37:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:37:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137032_70160384.pth... [2023-03-09 22:37:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136480_69877760.pth [2023-03-09 22:37:58,839][820675] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-09 22:38:03,248][820675] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-09 22:38:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 70205440. Throughput: 0: 9446.7. Samples: 70204068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:07,407][820675] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-09 22:38:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 70254592. Throughput: 0: 9480.4. Samples: 70233952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:08,550][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:38:11,670][820675] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-09 22:38:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 70303744. Throughput: 0: 9499.2. Samples: 70291112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:13,550][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:38:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137312_70303744.pth... [2023-03-09 22:38:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000136752_70017024.pth [2023-03-09 22:38:16,029][820675] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-09 22:38:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 70348800. Throughput: 0: 9459.1. Samples: 70348240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:18,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:38:20,488][820675] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-09 22:38:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 70397952. Throughput: 0: 9444.8. Samples: 70373772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:24,655][820675] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-09 22:38:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 70443008. Throughput: 0: 9477.3. Samples: 70431500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137584_70443008.pth... [2023-03-09 22:38:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137032_70160384.pth [2023-03-09 22:38:29,000][820675] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-09 22:38:33,278][820675] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-09 22:38:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 70492160. Throughput: 0: 9563.4. Samples: 70490656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:33,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:37,832][820675] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-09 22:38:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 70537216. Throughput: 0: 9520.5. Samples: 70516800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:38,540][820373] Avg episode reward: [(0, '0.141')] [2023-03-09 22:38:42,000][820675] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-09 22:38:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 70586368. Throughput: 0: 9507.3. Samples: 70574288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137864_70586368.pth... [2023-03-09 22:38:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137312_70303744.pth [2023-03-09 22:38:46,380][820675] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-09 22:38:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 70631424. Throughput: 0: 9496.8. Samples: 70631424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:48,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:38:50,768][820675] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-09 22:38:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 70680576. Throughput: 0: 9456.3. Samples: 70659484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:53,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:38:54,971][820675] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-09 22:38:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 70729728. Throughput: 0: 9503.4. Samples: 70718764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:38:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:38:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138144_70729728.pth... [2023-03-09 22:38:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137584_70443008.pth [2023-03-09 22:38:59,091][820675] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-09 22:39:03,483][820675] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-09 22:39:03,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 70778880. Throughput: 0: 9480.2. Samples: 70774848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:03,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:39:07,862][820675] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-09 22:39:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 70823936. Throughput: 0: 9545.1. Samples: 70803300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:08,550][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:39:12,367][820675] Updated weights for policy 0, policy_version 138400 (0.0004) [2023-03-09 22:39:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 70868992. Throughput: 0: 9482.5. Samples: 70858212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:39:13,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138416_70868992.pth... [2023-03-09 22:39:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000137864_70586368.pth [2023-03-09 22:39:16,872][820675] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-09 22:39:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 70914048. Throughput: 0: 9405.1. Samples: 70913884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:39:21,519][820675] Updated weights for policy 0, policy_version 138560 (0.0006) [2023-03-09 22:39:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 70959104. Throughput: 0: 9375.3. Samples: 70938688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:23,540][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:39:26,116][820675] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-09 22:39:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 71004160. Throughput: 0: 9296.4. Samples: 70992628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:28,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:39:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138680_71004160.pth... [2023-03-09 22:39:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138144_70729728.pth [2023-03-09 22:39:30,521][820675] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-09 22:39:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 71049216. Throughput: 0: 9281.4. Samples: 71049088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:33,550][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:39:34,904][820675] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-09 22:39:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 71098368. Throughput: 0: 9298.0. Samples: 71077896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:38,539][820373] Avg episode reward: [(0, '0.307')] [2023-03-09 22:39:39,186][820675] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-09 22:39:43,409][820675] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-09 22:39:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 71147520. Throughput: 0: 9252.5. Samples: 71135128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:39:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138960_71147520.pth... [2023-03-09 22:39:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138416_70868992.pth [2023-03-09 22:39:47,780][820675] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-09 22:39:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 71192576. Throughput: 0: 9256.5. Samples: 71191388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:48,539][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 22:39:51,998][820675] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-09 22:39:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 71241728. Throughput: 0: 9259.8. Samples: 71219992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:53,539][820373] Avg episode reward: [(0, '0.102')] [2023-03-09 22:39:56,230][820675] Updated weights for policy 0, policy_version 139200 (0.0004) [2023-03-09 22:39:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 71290880. Throughput: 0: 9337.4. Samples: 71278396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:39:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:39:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139240_71290880.pth... [2023-03-09 22:39:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138680_71004160.pth [2023-03-09 22:40:00,434][820675] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-09 22:40:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 71335936. Throughput: 0: 9355.5. Samples: 71334880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:03,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:40:05,094][820675] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-09 22:40:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 71380992. Throughput: 0: 9374.1. Samples: 71360524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:08,539][820373] Avg episode reward: [(0, '5.611')] [2023-03-09 22:40:09,565][820675] Updated weights for policy 0, policy_version 139440 (0.0004) [2023-03-09 22:40:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 71430144. Throughput: 0: 9449.7. Samples: 71417864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:13,540][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 22:40:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139512_71430144.pth... [2023-03-09 22:40:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000138960_71147520.pth [2023-03-09 22:40:13,656][820675] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-09 22:40:18,022][820675] Updated weights for policy 0, policy_version 139600 (0.0006) [2023-03-09 22:40:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 71479296. Throughput: 0: 9470.7. Samples: 71475272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:18,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:40:22,712][820675] Updated weights for policy 0, policy_version 139680 (0.0006) [2023-03-09 22:40:23,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9352.6, 300 sec: 9455.5). Total num frames: 71520256. Throughput: 0: 9413.7. Samples: 71501512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:40:27,245][820675] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-09 22:40:28,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 71565312. Throughput: 0: 9357.8. Samples: 71556228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:28,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:40:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139776_71565312.pth... [2023-03-09 22:40:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139240_71290880.pth [2023-03-09 22:40:31,613][820675] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-09 22:40:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 71614464. Throughput: 0: 9382.6. Samples: 71613604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:40:35,737][820675] Updated weights for policy 0, policy_version 139920 (0.0005) [2023-03-09 22:40:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 71663616. Throughput: 0: 9392.5. Samples: 71642656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:38,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:40:39,900][820675] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-09 22:40:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 71712768. Throughput: 0: 9389.0. Samples: 71700900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:43,540][820373] Avg episode reward: [(0, '0.169')] [2023-03-09 22:40:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140064_71712768.pth... [2023-03-09 22:40:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139512_71430144.pth [2023-03-09 22:40:44,239][820675] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-09 22:40:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 71757824. Throughput: 0: 9350.4. Samples: 71755648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:48,539][820373] Avg episode reward: [(0, '0.169')] [2023-03-09 22:40:48,855][820675] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-09 22:40:53,197][820675] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-09 22:40:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 71802880. Throughput: 0: 9371.7. Samples: 71782248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:40:57,681][820675] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-09 22:40:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 71847936. Throughput: 0: 9351.1. Samples: 71838664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:40:58,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:40:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140328_71847936.pth... [2023-03-09 22:40:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000139776_71565312.pth [2023-03-09 22:41:02,265][820675] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-09 22:41:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 71892992. Throughput: 0: 9269.3. Samples: 71892392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:03,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:41:06,854][820675] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-09 22:41:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 71938048. Throughput: 0: 9251.7. Samples: 71917840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:08,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:41:11,436][820675] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-09 22:41:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9400.0). Total num frames: 71983104. Throughput: 0: 9247.3. Samples: 71972356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:13,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:41:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140592_71983104.pth... [2023-03-09 22:41:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140064_71712768.pth [2023-03-09 22:41:15,971][820675] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-09 22:41:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9386.1). Total num frames: 72028160. Throughput: 0: 9190.8. Samples: 72027192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:18,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:41:20,389][820675] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-09 22:41:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9400.0). Total num frames: 72077312. Throughput: 0: 9160.4. Samples: 72054876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:41:24,426][820675] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-09 22:41:28,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9413.8). Total num frames: 72126464. Throughput: 0: 9135.5. Samples: 72112000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:41:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140872_72126464.pth... [2023-03-09 22:41:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140328_71847936.pth [2023-03-09 22:41:28,934][820675] Updated weights for policy 0, policy_version 140880 (0.0004) [2023-03-09 22:41:33,358][820675] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-09 22:41:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 72171520. Throughput: 0: 9189.7. Samples: 72169184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:33,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:41:37,510][820675] Updated weights for policy 0, policy_version 141040 (0.0004) [2023-03-09 22:41:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 72220672. Throughput: 0: 9214.7. Samples: 72196908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:38,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:41:41,737][820675] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-09 22:41:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 72269824. Throughput: 0: 9299.7. Samples: 72257152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:43,539][820373] Avg episode reward: [(0, '1.739')] [2023-03-09 22:41:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141152_72269824.pth... [2023-03-09 22:41:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140592_71983104.pth [2023-03-09 22:41:46,267][820675] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-09 22:41:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 72314880. Throughput: 0: 9323.7. Samples: 72311956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:41:48,539][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 22:41:50,538][820675] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-09 22:41:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 72364032. Throughput: 0: 9370.8. Samples: 72339528. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:41:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:41:54,703][820675] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-09 22:41:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 72409088. Throughput: 0: 9515.9. Samples: 72400572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:41:58,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:41:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141424_72409088.pth... [2023-03-09 22:41:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000140872_72126464.pth [2023-03-09 22:41:59,086][820675] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-09 22:42:03,475][820675] Updated weights for policy 0, policy_version 141520 (0.0004) [2023-03-09 22:42:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 72458240. Throughput: 0: 9490.3. Samples: 72454256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:03,539][820373] Avg episode reward: [(0, '0.619')] [2023-03-09 22:42:07,827][820675] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-09 22:42:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 72503296. Throughput: 0: 9511.2. Samples: 72482880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:42:12,234][820675] Updated weights for policy 0, policy_version 141680 (0.0004) [2023-03-09 22:42:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 72552448. Throughput: 0: 9502.5. Samples: 72539612. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:13,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:42:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141704_72552448.pth... [2023-03-09 22:42:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141152_72269824.pth [2023-03-09 22:42:16,539][820675] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-09 22:42:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 72597504. Throughput: 0: 9482.5. Samples: 72595896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:18,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:42:20,785][820675] Updated weights for policy 0, policy_version 141840 (0.0005) [2023-03-09 22:42:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 72642560. Throughput: 0: 9516.7. Samples: 72625160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:23,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:42:25,186][820675] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-09 22:42:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 72691712. Throughput: 0: 9399.6. Samples: 72680136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:42:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141976_72691712.pth... [2023-03-09 22:42:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141424_72409088.pth [2023-03-09 22:42:29,708][820675] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-09 22:42:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 72736768. Throughput: 0: 9417.0. Samples: 72735720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:42:33,966][820675] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-09 22:42:38,117][820675] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-09 22:42:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 72785920. Throughput: 0: 9466.3. Samples: 72765512. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:42:42,475][820675] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-09 22:42:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 72835072. Throughput: 0: 9386.7. Samples: 72822972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:43,540][820373] Avg episode reward: [(0, '0.220')] [2023-03-09 22:42:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142256_72835072.pth... [2023-03-09 22:42:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141704_72552448.pth [2023-03-09 22:42:47,058][820675] Updated weights for policy 0, policy_version 142320 (0.0004) [2023-03-09 22:42:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 72880128. Throughput: 0: 9411.5. Samples: 72877772. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:48,540][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 22:42:51,725][820675] Updated weights for policy 0, policy_version 142400 (0.0004) [2023-03-09 22:42:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 72925184. Throughput: 0: 9356.1. Samples: 72903904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 22:42:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:42:56,057][820675] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-09 22:42:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9372.2). Total num frames: 72970240. Throughput: 0: 9296.6. Samples: 72957960. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:42:58,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:42:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142520_72970240.pth... [2023-03-09 22:42:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000141976_72691712.pth [2023-03-09 22:43:00,720][820675] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-09 22:43:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 73015296. Throughput: 0: 9269.9. Samples: 73013044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:03,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 22:43:05,090][820675] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-09 22:43:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 73064448. Throughput: 0: 9234.7. Samples: 73040724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:08,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:43:09,360][820675] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-09 22:43:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 73109504. Throughput: 0: 9297.9. Samples: 73098540. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:13,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:43:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142792_73109504.pth... [2023-03-09 22:43:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142256_72835072.pth [2023-03-09 22:43:13,638][820675] Updated weights for policy 0, policy_version 142800 (0.0005) [2023-03-09 22:43:18,138][820675] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-09 22:43:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 73154560. Throughput: 0: 9306.1. Samples: 73154492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:18,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:43:22,428][820675] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-09 22:43:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 73203712. Throughput: 0: 9282.7. Samples: 73183232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:43:26,690][820675] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-09 22:43:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 73252864. Throughput: 0: 9276.4. Samples: 73240408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:28,539][820373] Avg episode reward: [(0, '0.202')] [2023-03-09 22:43:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143072_73252864.pth... [2023-03-09 22:43:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142520_72970240.pth [2023-03-09 22:43:30,759][820675] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-09 22:43:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 73302016. Throughput: 0: 9372.1. Samples: 73299516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:33,539][820373] Avg episode reward: [(0, '0.592')] [2023-03-09 22:43:35,185][820675] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-09 22:43:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 73351168. Throughput: 0: 9390.2. Samples: 73326464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:38,539][820373] Avg episode reward: [(0, '3.204')] [2023-03-09 22:43:39,458][820675] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-09 22:43:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 73392128. Throughput: 0: 9447.9. Samples: 73383116. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:43,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:43:43,559][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143352_73396224.pth... [2023-03-09 22:43:43,561][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000142792_73109504.pth [2023-03-09 22:43:44,003][820675] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-09 22:43:48,209][820675] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-09 22:43:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 73441280. Throughput: 0: 9482.1. Samples: 73439736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:43:52,541][820675] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-09 22:43:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 73490432. Throughput: 0: 9514.7. Samples: 73468884. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:53,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:43:56,978][820675] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-09 22:43:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 73535488. Throughput: 0: 9446.3. Samples: 73523624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:43:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:43:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143624_73535488.pth... [2023-03-09 22:43:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143072_73252864.pth [2023-03-09 22:44:01,433][820675] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-09 22:44:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 73584640. Throughput: 0: 9466.1. Samples: 73580464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:44:05,797][820675] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-09 22:44:08,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 73629696. Throughput: 0: 9434.3. Samples: 73607776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:08,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:44:10,272][820675] Updated weights for policy 0, policy_version 143840 (0.0004) [2023-03-09 22:44:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 73674752. Throughput: 0: 9418.8. Samples: 73664256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:13,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:44:13,565][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143904_73678848.pth... [2023-03-09 22:44:13,567][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143352_73396224.pth [2023-03-09 22:44:14,363][820675] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-09 22:44:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 73723904. Throughput: 0: 9357.7. Samples: 73720612. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:44:18,826][820675] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-09 22:44:23,232][820675] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-09 22:44:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 73768960. Throughput: 0: 9359.9. Samples: 73747660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:44:27,511][820675] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-09 22:44:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 73818112. Throughput: 0: 9386.8. Samples: 73805520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:44:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144176_73818112.pth... [2023-03-09 22:44:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143624_73535488.pth [2023-03-09 22:44:31,772][820675] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-09 22:44:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 73863168. Throughput: 0: 9409.0. Samples: 73863140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:44:36,228][820675] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-09 22:44:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 73912320. Throughput: 0: 9378.3. Samples: 73890908. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:44:40,372][820675] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-09 22:44:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 73961472. Throughput: 0: 9454.5. Samples: 73949076. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:43,540][820373] Avg episode reward: [(0, '1.200')] [2023-03-09 22:44:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144456_73961472.pth... [2023-03-09 22:44:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000143904_73678848.pth [2023-03-09 22:44:44,725][820675] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-09 22:44:48,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.0, 300 sec: 9386.1). Total num frames: 74010624. Throughput: 0: 9468.3. Samples: 74006540. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:48,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:44:48,873][820675] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-09 22:44:53,434][820675] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-09 22:44:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 74055680. Throughput: 0: 9497.1. Samples: 74035148. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:44:58,096][820675] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-09 22:44:58,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 74096640. Throughput: 0: 9409.5. Samples: 74087684. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:44:58,539][820373] Avg episode reward: [(0, '0.021')] [2023-03-09 22:44:58,593][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144728_74100736.pth... [2023-03-09 22:44:58,595][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144176_73818112.pth [2023-03-09 22:45:02,293][820675] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-09 22:45:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 74149888. Throughput: 0: 9449.9. Samples: 74145856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:03,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:45:06,522][820675] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-09 22:45:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 74194944. Throughput: 0: 9486.0. Samples: 74174528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:08,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 22:45:10,739][820675] Updated weights for policy 0, policy_version 144960 (0.0004) [2023-03-09 22:45:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9372.2). Total num frames: 74244096. Throughput: 0: 9486.9. Samples: 74232432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:13,540][820373] Avg episode reward: [(0, '0.096')] [2023-03-09 22:45:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145008_74244096.pth... [2023-03-09 22:45:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144456_73961472.pth [2023-03-09 22:45:15,205][820675] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-09 22:45:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 74293248. Throughput: 0: 9466.6. Samples: 74289136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:18,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:45:19,289][820675] Updated weights for policy 0, policy_version 145120 (0.0005) [2023-03-09 22:45:23,434][820675] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-09 22:45:23,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 74342400. Throughput: 0: 9487.0. Samples: 74317824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:23,539][820373] Avg episode reward: [(0, '0.312')] [2023-03-09 22:45:27,888][820675] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-09 22:45:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 74387456. Throughput: 0: 9486.6. Samples: 74375972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:28,539][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 22:45:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145288_74387456.pth... [2023-03-09 22:45:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000144728_74100736.pth [2023-03-09 22:45:32,197][820675] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-09 22:45:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 74436608. Throughput: 0: 9467.8. Samples: 74432592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:33,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:45:36,409][820675] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-09 22:45:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 74485760. Throughput: 0: 9469.1. Samples: 74461256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:38,540][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:45:40,533][820675] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-09 22:45:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 74530816. Throughput: 0: 9633.1. Samples: 74521172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:43,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:45:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145568_74530816.pth... [2023-03-09 22:45:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145008_74244096.pth [2023-03-09 22:45:45,022][820675] Updated weights for policy 0, policy_version 145600 (0.0005) [2023-03-09 22:45:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 74575872. Throughput: 0: 9555.7. Samples: 74575864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:48,539][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 22:45:49,453][820675] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-09 22:45:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 74620928. Throughput: 0: 9481.0. Samples: 74601172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:45:54,248][820675] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-09 22:45:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9489.0, 300 sec: 9400.0). Total num frames: 74665984. Throughput: 0: 9363.0. Samples: 74653768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:45:58,539][820373] Avg episode reward: [(0, '0.125')] [2023-03-09 22:45:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145832_74665984.pth... [2023-03-09 22:45:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145288_74387456.pth [2023-03-09 22:45:58,734][820675] Updated weights for policy 0, policy_version 145840 (0.0005) [2023-03-09 22:46:03,026][820675] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-09 22:46:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 74715136. Throughput: 0: 9377.3. Samples: 74711112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:03,539][820373] Avg episode reward: [(0, '0.134')] [2023-03-09 22:46:07,385][820675] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-09 22:46:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 74760192. Throughput: 0: 9371.4. Samples: 74739536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:46:11,812][820675] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-09 22:46:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 74809344. Throughput: 0: 9324.3. Samples: 74795568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:13,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 22:46:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146112_74809344.pth... [2023-03-09 22:46:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145568_74530816.pth [2023-03-09 22:46:16,077][820675] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-09 22:46:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9413.9). Total num frames: 74854400. Throughput: 0: 9329.2. Samples: 74852404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:46:20,540][820675] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-09 22:46:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 74899456. Throughput: 0: 9288.4. Samples: 74879232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:23,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:46:24,860][820675] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-09 22:46:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 74948608. Throughput: 0: 9227.1. Samples: 74936392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:28,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:46:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146384_74948608.pth... [2023-03-09 22:46:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000145832_74665984.pth [2023-03-09 22:46:29,084][820675] Updated weights for policy 0, policy_version 146400 (0.0004) [2023-03-09 22:46:33,233][820675] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-09 22:46:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 74997760. Throughput: 0: 9325.5. Samples: 74995512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:46:37,620][820675] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-09 22:46:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 75046912. Throughput: 0: 9395.3. Samples: 75023960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:38,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 22:46:42,019][820675] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-09 22:46:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 75091968. Throughput: 0: 9466.3. Samples: 75079752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:43,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 22:46:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146664_75091968.pth... [2023-03-09 22:46:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146112_74809344.pth [2023-03-09 22:46:46,177][820675] Updated weights for policy 0, policy_version 146720 (0.0004) [2023-03-09 22:46:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75141120. Throughput: 0: 9466.1. Samples: 75137088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:48,539][820373] Avg episode reward: [(0, '0.141')] [2023-03-09 22:46:50,413][820675] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-09 22:46:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75186176. Throughput: 0: 9493.8. Samples: 75166756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:53,550][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 22:46:54,808][820675] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-09 22:46:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 75235328. Throughput: 0: 9554.5. Samples: 75225520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:46:58,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:46:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146944_75235328.pth... [2023-03-09 22:46:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146384_74948608.pth [2023-03-09 22:46:59,091][820675] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-09 22:47:03,517][820675] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-09 22:47:03,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 75284480. Throughput: 0: 9512.1. Samples: 75280448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:47:03,550][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 22:47:08,069][820675] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-09 22:47:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 75329536. Throughput: 0: 9515.6. Samples: 75307436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:08,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:47:12,609][820675] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-09 22:47:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9413.8). Total num frames: 75374592. Throughput: 0: 9462.8. Samples: 75362220. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:47:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147216_75374592.pth... [2023-03-09 22:47:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146664_75091968.pth [2023-03-09 22:47:16,855][820675] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-09 22:47:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75419648. Throughput: 0: 9400.7. Samples: 75418544. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:18,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:47:21,333][820675] Updated weights for policy 0, policy_version 147360 (0.0004) [2023-03-09 22:47:23,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 75464704. Throughput: 0: 9369.3. Samples: 75445580. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:23,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 22:47:25,778][820675] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-09 22:47:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75513856. Throughput: 0: 9371.5. Samples: 75501472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:28,540][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 22:47:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147488_75513856.pth... [2023-03-09 22:47:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000146944_75235328.pth [2023-03-09 22:47:29,945][820675] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-09 22:47:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75563008. Throughput: 0: 9438.9. Samples: 75561840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:47:34,044][820675] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-09 22:47:38,521][820675] Updated weights for policy 0, policy_version 147680 (0.0004) [2023-03-09 22:47:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75612160. Throughput: 0: 9402.1. Samples: 75589852. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:38,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:47:42,857][820675] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-09 22:47:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 75657216. Throughput: 0: 9320.4. Samples: 75644940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:43,539][820373] Avg episode reward: [(0, '0.185')] [2023-03-09 22:47:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147768_75657216.pth... [2023-03-09 22:47:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147216_75374592.pth [2023-03-09 22:47:47,400][820675] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-09 22:47:48,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 75702272. Throughput: 0: 9322.3. Samples: 75699952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:48,540][820373] Avg episode reward: [(0, '0.267')] [2023-03-09 22:47:51,843][820675] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-09 22:47:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 75747328. Throughput: 0: 9351.4. Samples: 75728248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:53,539][820373] Avg episode reward: [(0, '0.036')] [2023-03-09 22:47:56,289][820675] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-09 22:47:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 75796480. Throughput: 0: 9371.6. Samples: 75783940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:47:58,540][820373] Avg episode reward: [(0, '0.146')] [2023-03-09 22:47:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148040_75796480.pth... [2023-03-09 22:47:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147488_75513856.pth [2023-03-09 22:48:00,662][820675] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-09 22:48:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 75845632. Throughput: 0: 9399.8. Samples: 75841536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:48:03,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:48:04,753][820675] Updated weights for policy 0, policy_version 148160 (0.0004) [2023-03-09 22:48:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 75890688. Throughput: 0: 9437.6. Samples: 75870272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 22:48:08,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:48:09,120][820675] Updated weights for policy 0, policy_version 148240 (0.0004) [2023-03-09 22:48:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9427.7). Total num frames: 75935744. Throughput: 0: 9444.0. Samples: 75926452. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:48:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148312_75935744.pth... [2023-03-09 22:48:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000147768_75657216.pth [2023-03-09 22:48:13,593][820675] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-09 22:48:17,851][820675] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-09 22:48:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 75984896. Throughput: 0: 9360.2. Samples: 75983048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:18,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:48:22,253][820675] Updated weights for policy 0, policy_version 148480 (0.0006) [2023-03-09 22:48:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76029952. Throughput: 0: 9355.1. Samples: 76010832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:23,539][820373] Avg episode reward: [(0, '0.024')] [2023-03-09 22:48:26,619][820675] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-09 22:48:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76079104. Throughput: 0: 9374.9. Samples: 76066812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:28,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 22:48:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148592_76079104.pth... [2023-03-09 22:48:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148040_75796480.pth [2023-03-09 22:48:30,601][820675] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-09 22:48:33,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76128256. Throughput: 0: 9495.0. Samples: 76127224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:48:35,156][820675] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-09 22:48:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 76173312. Throughput: 0: 9443.5. Samples: 76153204. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:38,539][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 22:48:39,530][820675] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-09 22:48:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 76222464. Throughput: 0: 9471.9. Samples: 76210176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:43,540][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:48:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148872_76222464.pth... [2023-03-09 22:48:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148312_75935744.pth [2023-03-09 22:48:43,819][820675] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-09 22:48:48,150][820675] Updated weights for policy 0, policy_version 148960 (0.0006) [2023-03-09 22:48:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76267520. Throughput: 0: 9465.5. Samples: 76267484. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:48:52,580][820675] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-09 22:48:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 76316672. Throughput: 0: 9424.3. Samples: 76294364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:53,550][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:48:56,865][820675] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-09 22:48:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76361728. Throughput: 0: 9442.2. Samples: 76351352. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:48:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:48:58,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149144_76361728.pth... [2023-03-09 22:48:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148592_76079104.pth [2023-03-09 22:49:01,300][820675] Updated weights for policy 0, policy_version 149200 (0.0004) [2023-03-09 22:49:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 76410880. Throughput: 0: 9436.7. Samples: 76407700. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:49:03,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:49:05,366][820675] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-09 22:49:08,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 76460032. Throughput: 0: 9524.5. Samples: 76439432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:49:08,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 22:49:09,447][820675] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-09 22:49:13,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 76509184. Throughput: 0: 9507.1. Samples: 76494628. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:49:13,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:49:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149432_76509184.pth... [2023-03-09 22:49:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000148872_76222464.pth [2023-03-09 22:49:13,885][820675] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-09 22:49:18,049][820675] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-09 22:49:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 76558336. Throughput: 0: 9490.6. Samples: 76554304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:49:22,515][820675] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-09 22:49:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 76603392. Throughput: 0: 9507.4. Samples: 76581036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:23,540][820373] Avg episode reward: [(0, '0.089')] [2023-03-09 22:49:27,127][820675] Updated weights for policy 0, policy_version 149680 (0.0004) [2023-03-09 22:49:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 76648448. Throughput: 0: 9465.6. Samples: 76636128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:28,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:49:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149704_76648448.pth... [2023-03-09 22:49:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149144_76361728.pth [2023-03-09 22:49:31,366][820675] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-09 22:49:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 76693504. Throughput: 0: 9464.9. Samples: 76693404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:33,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 22:49:35,970][820675] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-09 22:49:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76738560. Throughput: 0: 9428.7. Samples: 76718656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:38,539][820373] Avg episode reward: [(0, '0.023')] [2023-03-09 22:49:40,146][820675] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-09 22:49:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76787712. Throughput: 0: 9438.4. Samples: 76776080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:49:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149976_76787712.pth... [2023-03-09 22:49:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149432_76509184.pth [2023-03-09 22:49:44,562][820675] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-09 22:49:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76832768. Throughput: 0: 9435.2. Samples: 76832284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:48,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:49:49,075][820675] Updated weights for policy 0, policy_version 150080 (0.0004) [2023-03-09 22:49:53,535][820675] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-09 22:49:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 76881920. Throughput: 0: 9352.4. Samples: 76860292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:53,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:49:57,968][820675] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-09 22:49:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 76926976. Throughput: 0: 9336.1. Samples: 76914752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:49:58,539][820373] Avg episode reward: [(0, '10.435')] [2023-03-09 22:49:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150248_76926976.pth... [2023-03-09 22:49:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149704_76648448.pth [2023-03-09 22:50:02,354][820675] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-09 22:50:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9413.9). Total num frames: 76972032. Throughput: 0: 9270.7. Samples: 76971484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:03,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:50:06,662][820675] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-09 22:50:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 77021184. Throughput: 0: 9292.5. Samples: 76999196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:08,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 22:50:11,081][820675] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-09 22:50:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 77066240. Throughput: 0: 9286.6. Samples: 77054024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:13,539][820373] Avg episode reward: [(0, '0.142')] [2023-03-09 22:50:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150520_77066240.pth... [2023-03-09 22:50:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000149976_76787712.pth [2023-03-09 22:50:15,579][820675] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-09 22:50:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 77111296. Throughput: 0: 9221.3. Samples: 77108364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:18,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:50:20,005][820675] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-09 22:50:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 77160448. Throughput: 0: 9301.2. Samples: 77137208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:23,539][820373] Avg episode reward: [(0, '0.056')] [2023-03-09 22:50:24,466][820675] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-09 22:50:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 77201408. Throughput: 0: 9243.3. Samples: 77192028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:28,540][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:50:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150784_77201408.pth... [2023-03-09 22:50:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150248_76926976.pth [2023-03-09 22:50:29,225][820675] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-09 22:50:33,520][820675] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-09 22:50:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 77250560. Throughput: 0: 9203.6. Samples: 77246444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:33,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:50:37,591][820675] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-09 22:50:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 77299712. Throughput: 0: 9220.4. Samples: 77275212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:38,539][820373] Avg episode reward: [(0, '0.138')] [2023-03-09 22:50:41,882][820675] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-09 22:50:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 77344768. Throughput: 0: 9320.4. Samples: 77334172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:50:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151064_77344768.pth... [2023-03-09 22:50:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150520_77066240.pth [2023-03-09 22:50:46,189][820675] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-09 22:50:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 77393920. Throughput: 0: 9332.5. Samples: 77391448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:48,540][820373] Avg episode reward: [(0, '0.014')] [2023-03-09 22:50:50,497][820675] Updated weights for policy 0, policy_version 151200 (0.0005) [2023-03-09 22:50:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 77438976. Throughput: 0: 9340.2. Samples: 77419504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:50:55,038][820675] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-09 22:50:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 77484032. Throughput: 0: 9355.5. Samples: 77475020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:50:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:50:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151336_77484032.pth... [2023-03-09 22:50:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000150784_77201408.pth [2023-03-09 22:50:59,438][820675] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-09 22:51:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 77533184. Throughput: 0: 9351.0. Samples: 77529160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:51:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:51:03,799][820675] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-09 22:51:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 77574144. Throughput: 0: 9347.0. Samples: 77557824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:51:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:51:08,545][820675] Updated weights for policy 0, policy_version 151520 (0.0005) [2023-03-09 22:51:12,804][820675] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-09 22:51:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 77623296. Throughput: 0: 9324.1. Samples: 77611612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:51:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:51:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151608_77623296.pth... [2023-03-09 22:51:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151064_77344768.pth [2023-03-09 22:51:17,178][820675] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-09 22:51:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 77672448. Throughput: 0: 9375.1. Samples: 77668324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:51:18,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 22:51:21,687][820675] Updated weights for policy 0, policy_version 151760 (0.0004) [2023-03-09 22:51:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 77717504. Throughput: 0: 9371.2. Samples: 77696916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:23,539][820373] Avg episode reward: [(0, '0.104')] [2023-03-09 22:51:26,062][820675] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-09 22:51:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 77762560. Throughput: 0: 9246.8. Samples: 77750280. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:28,540][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:51:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151880_77762560.pth... [2023-03-09 22:51:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151336_77484032.pth [2023-03-09 22:51:30,574][820675] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-09 22:51:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 77811712. Throughput: 0: 9249.6. Samples: 77807680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:33,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 22:51:34,860][820675] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-09 22:51:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 77856768. Throughput: 0: 9248.6. Samples: 77835692. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:38,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 22:51:39,208][820675] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-09 22:51:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.2, 300 sec: 9358.3). Total num frames: 77901824. Throughput: 0: 9261.3. Samples: 77891780. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:43,540][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:51:43,575][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152160_77905920.pth... [2023-03-09 22:51:43,576][820675] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-09 22:51:43,577][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151608_77623296.pth [2023-03-09 22:51:48,012][820675] Updated weights for policy 0, policy_version 152240 (0.0004) [2023-03-09 22:51:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 77950976. Throughput: 0: 9284.8. Samples: 77946976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:51:52,385][820675] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-09 22:51:53,539][820373] Fps is (10 sec: 9421.1, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 77996032. Throughput: 0: 9283.0. Samples: 77975560. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:53,550][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:51:56,829][820675] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-09 22:51:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78041088. Throughput: 0: 9328.0. Samples: 78031372. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:51:58,550][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:51:58,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152432_78045184.pth... [2023-03-09 22:51:58,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000151880_77762560.pth [2023-03-09 22:52:01,018][820675] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-09 22:52:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 78090240. Throughput: 0: 9344.0. Samples: 78088804. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:52:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:52:05,318][820675] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-09 22:52:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 78139392. Throughput: 0: 9363.7. Samples: 78118284. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:52:08,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:52:09,778][820675] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-09 22:52:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 78184448. Throughput: 0: 9379.7. Samples: 78172364. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:52:13,540][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:52:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152704_78184448.pth... [2023-03-09 22:52:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152160_77905920.pth [2023-03-09 22:52:14,358][820675] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-09 22:52:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 78229504. Throughput: 0: 9310.4. Samples: 78226648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:52:18,539][820373] Avg episode reward: [(0, '0.117')] [2023-03-09 22:52:18,813][820675] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-09 22:52:23,183][820675] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-09 22:52:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 78274560. Throughput: 0: 9297.2. Samples: 78254064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:52:23,539][820373] Avg episode reward: [(0, '0.243')] [2023-03-09 22:52:27,516][820675] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-09 22:52:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 78323712. Throughput: 0: 9325.5. Samples: 78311424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:28,539][820373] Avg episode reward: [(0, '0.054')] [2023-03-09 22:52:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152976_78323712.pth... [2023-03-09 22:52:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152432_78045184.pth [2023-03-09 22:52:31,858][820675] Updated weights for policy 0, policy_version 153040 (0.0004) [2023-03-09 22:52:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78368768. Throughput: 0: 9361.9. Samples: 78368260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:33,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:52:36,406][820675] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-09 22:52:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78413824. Throughput: 0: 9302.9. Samples: 78394192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:38,539][820373] Avg episode reward: [(0, '0.095')] [2023-03-09 22:52:41,033][820675] Updated weights for policy 0, policy_version 153200 (0.0005) [2023-03-09 22:52:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78458880. Throughput: 0: 9249.7. Samples: 78447608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:43,539][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 22:52:43,584][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153248_78462976.pth... [2023-03-09 22:52:43,586][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152704_78184448.pth [2023-03-09 22:52:45,273][820675] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-09 22:52:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 78508032. Throughput: 0: 9225.3. Samples: 78503944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:48,539][820373] Avg episode reward: [(0, '0.119')] [2023-03-09 22:52:49,620][820675] Updated weights for policy 0, policy_version 153360 (0.0005) [2023-03-09 22:52:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78553088. Throughput: 0: 9266.9. Samples: 78535292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:53,550][820373] Avg episode reward: [(0, '1.150')] [2023-03-09 22:52:54,002][820675] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-09 22:52:58,374][820675] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-09 22:52:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 78602240. Throughput: 0: 9279.9. Samples: 78589960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:52:58,550][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:52:58,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153520_78602240.pth... [2023-03-09 22:52:58,557][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000152976_78323712.pth [2023-03-09 22:53:02,605][820675] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-09 22:53:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78647296. Throughput: 0: 9347.7. Samples: 78647292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:03,539][820373] Avg episode reward: [(0, '0.137')] [2023-03-09 22:53:07,262][820675] Updated weights for policy 0, policy_version 153680 (0.0004) [2023-03-09 22:53:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 78696448. Throughput: 0: 9331.7. Samples: 78673992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:08,540][820373] Avg episode reward: [(0, '0.029')] [2023-03-09 22:53:11,577][820675] Updated weights for policy 0, policy_version 153760 (0.0005) [2023-03-09 22:53:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78741504. Throughput: 0: 9285.9. Samples: 78729288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:13,540][820373] Avg episode reward: [(0, '0.088')] [2023-03-09 22:53:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153792_78741504.pth... [2023-03-09 22:53:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153248_78462976.pth [2023-03-09 22:53:15,934][820675] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-09 22:53:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 78786560. Throughput: 0: 9238.5. Samples: 78783992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:18,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:53:20,568][820675] Updated weights for policy 0, policy_version 153920 (0.0004) [2023-03-09 22:53:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 78835712. Throughput: 0: 9265.6. Samples: 78811144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:23,539][820373] Avg episode reward: [(0, '0.152')] [2023-03-09 22:53:24,844][820675] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-09 22:53:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 78884864. Throughput: 0: 9385.4. Samples: 78869952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:28,540][820373] Avg episode reward: [(0, '0.187')] [2023-03-09 22:53:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154072_78884864.pth... [2023-03-09 22:53:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153520_78602240.pth [2023-03-09 22:53:28,900][820675] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-09 22:53:33,137][820675] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-09 22:53:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 78929920. Throughput: 0: 9462.4. Samples: 78929752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:33,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:53:37,634][820675] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-09 22:53:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 78979072. Throughput: 0: 9366.5. Samples: 78956784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:38,539][820373] Avg episode reward: [(0, '0.027')] [2023-03-09 22:53:42,116][820675] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-09 22:53:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 79024128. Throughput: 0: 9370.7. Samples: 79011640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:43,539][820373] Avg episode reward: [(0, '0.042')] [2023-03-09 22:53:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154344_79024128.pth... [2023-03-09 22:53:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000153792_78741504.pth [2023-03-09 22:53:46,570][820675] Updated weights for policy 0, policy_version 154400 (0.0006) [2023-03-09 22:53:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 79069184. Throughput: 0: 9344.3. Samples: 79067788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:48,539][820373] Avg episode reward: [(0, '0.013')] [2023-03-09 22:53:51,144][820675] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-09 22:53:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 79114240. Throughput: 0: 9327.2. Samples: 79093716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:53,540][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 22:53:55,587][820675] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-09 22:53:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 79159296. Throughput: 0: 9291.9. Samples: 79147424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:53:58,539][820373] Avg episode reward: [(0, '0.137')] [2023-03-09 22:53:58,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154608_79159296.pth... [2023-03-09 22:53:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154072_78884864.pth [2023-03-09 22:54:00,088][820675] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-09 22:54:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 79208448. Throughput: 0: 9385.8. Samples: 79206352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:03,539][820373] Avg episode reward: [(0, '0.078')] [2023-03-09 22:54:04,198][820675] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-09 22:54:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 79253504. Throughput: 0: 9375.5. Samples: 79233040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:54:08,825][820675] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-09 22:54:13,224][820675] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-09 22:54:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 79298560. Throughput: 0: 9279.3. Samples: 79287520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:13,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 22:54:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154880_79298560.pth... [2023-03-09 22:54:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154344_79024128.pth [2023-03-09 22:54:17,751][820675] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-09 22:54:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 79343616. Throughput: 0: 9179.0. Samples: 79342808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:18,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 22:54:21,963][820675] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-09 22:54:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 79392768. Throughput: 0: 9230.3. Samples: 79372148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:23,540][820373] Avg episode reward: [(0, '0.089')] [2023-03-09 22:54:26,307][820675] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-09 22:54:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 79437824. Throughput: 0: 9262.9. Samples: 79428472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:28,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:54:28,568][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155160_79441920.pth... [2023-03-09 22:54:28,570][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154608_79159296.pth [2023-03-09 22:54:30,848][820675] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-09 22:54:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 79486976. Throughput: 0: 9231.6. Samples: 79483208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:33,539][820373] Avg episode reward: [(0, '0.084')] [2023-03-09 22:54:35,168][820675] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-09 22:54:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 79532032. Throughput: 0: 9285.6. Samples: 79511568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:38,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 22:54:39,439][820675] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-09 22:54:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 79581184. Throughput: 0: 9423.7. Samples: 79571492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:43,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 22:54:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155432_79581184.pth... [2023-03-09 22:54:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000154880_79298560.pth [2023-03-09 22:54:43,613][820675] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-09 22:54:47,937][820675] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-09 22:54:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 79630336. Throughput: 0: 9351.4. Samples: 79627164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:48,539][820373] Avg episode reward: [(0, '11.819')] [2023-03-09 22:54:52,258][820675] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-09 22:54:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 79675392. Throughput: 0: 9376.5. Samples: 79654984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:53,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:54:56,807][820675] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-09 22:54:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 79724544. Throughput: 0: 9414.3. Samples: 79711164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:54:58,539][820373] Avg episode reward: [(0, '0.036')] [2023-03-09 22:54:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155712_79724544.pth... [2023-03-09 22:54:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155160_79441920.pth [2023-03-09 22:55:00,898][820675] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-09 22:55:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 79769600. Throughput: 0: 9484.3. Samples: 79769600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:03,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 22:55:05,319][820675] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-09 22:55:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 79818752. Throughput: 0: 9468.1. Samples: 79798212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:08,539][820373] Avg episode reward: [(0, '7.996')] [2023-03-09 22:55:09,795][820675] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-09 22:55:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 79863808. Throughput: 0: 9420.8. Samples: 79852408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:13,539][820373] Avg episode reward: [(0, '0.055')] [2023-03-09 22:55:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155984_79863808.pth... [2023-03-09 22:55:13,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155432_79581184.pth [2023-03-09 22:55:14,123][820675] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-09 22:55:18,378][820675] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-09 22:55:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 79912960. Throughput: 0: 9500.0. Samples: 79910708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:18,539][820373] Avg episode reward: [(0, '0.118')] [2023-03-09 22:55:22,814][820675] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-09 22:55:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 79958016. Throughput: 0: 9472.6. Samples: 79937832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:23,539][820373] Avg episode reward: [(0, '0.242')] [2023-03-09 22:55:27,231][820675] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-09 22:55:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 80007168. Throughput: 0: 9390.7. Samples: 79994072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:28,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:55:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156264_80007168.pth... [2023-03-09 22:55:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155712_79724544.pth [2023-03-09 22:55:31,582][820675] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-09 22:55:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 80052224. Throughput: 0: 9390.9. Samples: 80049756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:33,539][820373] Avg episode reward: [(0, '0.079')] [2023-03-09 22:55:35,874][820675] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-09 22:55:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 80101376. Throughput: 0: 9416.8. Samples: 80078740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:38,539][820373] Avg episode reward: [(0, '0.067')] [2023-03-09 22:55:40,129][820675] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-09 22:55:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 80146432. Throughput: 0: 9401.2. Samples: 80134216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:43,539][820373] Avg episode reward: [(0, '0.024')] [2023-03-09 22:55:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156536_80146432.pth... [2023-03-09 22:55:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000155984_79863808.pth [2023-03-09 22:55:44,584][820675] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-09 22:55:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 80195584. Throughput: 0: 9380.2. Samples: 80191708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:48,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:55:48,916][820675] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-09 22:55:53,501][820675] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-09 22:55:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 80240640. Throughput: 0: 9341.0. Samples: 80218556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:53,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:55:57,996][820675] Updated weights for policy 0, policy_version 156800 (0.0004) [2023-03-09 22:55:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 80285696. Throughput: 0: 9357.0. Samples: 80273472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:55:58,540][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 22:55:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156808_80285696.pth... [2023-03-09 22:55:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156264_80007168.pth [2023-03-09 22:56:02,574][820675] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-09 22:56:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 80330752. Throughput: 0: 9255.7. Samples: 80327212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:56:06,941][820675] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-09 22:56:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 80375808. Throughput: 0: 9277.9. Samples: 80355336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:56:11,240][820675] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-09 22:56:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 80424960. Throughput: 0: 9300.6. Samples: 80412600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:13,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:56:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157080_80424960.pth... [2023-03-09 22:56:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156536_80146432.pth [2023-03-09 22:56:15,601][820675] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-09 22:56:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 80470016. Throughput: 0: 9331.2. Samples: 80469660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:18,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:56:19,904][820675] Updated weights for policy 0, policy_version 157200 (0.0004) [2023-03-09 22:56:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 80519168. Throughput: 0: 9299.9. Samples: 80497236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:23,539][820373] Avg episode reward: [(0, '0.096')] [2023-03-09 22:56:24,466][820675] Updated weights for policy 0, policy_version 157280 (0.0004) [2023-03-09 22:56:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 80564224. Throughput: 0: 9289.0. Samples: 80552224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:28,540][820373] Avg episode reward: [(0, '0.153')] [2023-03-09 22:56:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157352_80564224.pth... [2023-03-09 22:56:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000156808_80285696.pth [2023-03-09 22:56:28,818][820675] Updated weights for policy 0, policy_version 157360 (0.0004) [2023-03-09 22:56:33,232][820675] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-09 22:56:33,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 80609280. Throughput: 0: 9256.6. Samples: 80608256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:56:37,619][820675] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-09 22:56:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9344.4). Total num frames: 80658432. Throughput: 0: 9274.1. Samples: 80635892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 22:56:38,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 22:56:42,081][820675] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-09 22:56:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9330.5). Total num frames: 80703488. Throughput: 0: 9283.1. Samples: 80691212. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:56:43,540][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 22:56:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157624_80703488.pth... [2023-03-09 22:56:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157080_80424960.pth [2023-03-09 22:56:46,662][820675] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-09 22:56:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 80748544. Throughput: 0: 9275.3. Samples: 80744600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:56:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:56:51,246][820675] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-09 22:56:53,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 80789504. Throughput: 0: 9270.3. Samples: 80772500. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:56:53,539][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 22:56:55,794][820675] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-09 22:56:58,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 80834560. Throughput: 0: 9179.0. Samples: 80825656. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:56:58,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:56:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157880_80834560.pth... [2023-03-09 22:56:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157352_80564224.pth [2023-03-09 22:57:00,470][820675] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-09 22:57:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 80883712. Throughput: 0: 9105.7. Samples: 80879416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:03,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 22:57:04,809][820675] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-09 22:57:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 80928768. Throughput: 0: 9132.4. Samples: 80908192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:57:09,035][820675] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-09 22:57:13,439][820675] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-09 22:57:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 80977920. Throughput: 0: 9183.4. Samples: 80965476. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:13,539][820373] Avg episode reward: [(0, '0.129')] [2023-03-09 22:57:13,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158160_80977920.pth... [2023-03-09 22:57:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157624_80703488.pth [2023-03-09 22:57:18,060][820675] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-09 22:57:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 81022976. Throughput: 0: 9125.2. Samples: 81018888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:18,539][820373] Avg episode reward: [(0, '0.089')] [2023-03-09 22:57:22,395][820675] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-09 22:57:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 81068032. Throughput: 0: 9147.0. Samples: 81047504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:23,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 22:57:26,976][820675] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-09 22:57:28,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 81113088. Throughput: 0: 9111.1. Samples: 81101212. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:28,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:57:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158424_81113088.pth... [2023-03-09 22:57:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000157880_80834560.pth [2023-03-09 22:57:31,702][820675] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-09 22:57:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 81158144. Throughput: 0: 9153.8. Samples: 81156520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:33,539][820373] Avg episode reward: [(0, '0.070')] [2023-03-09 22:57:35,876][820675] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-09 22:57:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 81207296. Throughput: 0: 9156.1. Samples: 81184524. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:38,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:57:40,015][820675] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-09 22:57:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 81256448. Throughput: 0: 9299.0. Samples: 81244112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 22:57:43,540][820373] Avg episode reward: [(0, '24.993')] [2023-03-09 22:57:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158704_81256448.pth... [2023-03-09 22:57:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158160_80977920.pth [2023-03-09 22:57:43,546][820631] Saving new best policy, reward=24.993! [2023-03-09 22:57:44,252][820675] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-09 22:57:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 81301504. Throughput: 0: 9378.6. Samples: 81301452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:57:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:57:48,594][820675] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-09 22:57:52,615][820675] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-09 22:57:53,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 81354752. Throughput: 0: 9375.8. Samples: 81330104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:57:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 22:57:57,074][820675] Updated weights for policy 0, policy_version 158960 (0.0004) [2023-03-09 22:57:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 81399808. Throughput: 0: 9378.7. Samples: 81387520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:57:58,539][820373] Avg episode reward: [(0, '0.115')] [2023-03-09 22:57:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158984_81399808.pth... [2023-03-09 22:57:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158424_81113088.pth [2023-03-09 22:58:01,541][820675] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-09 22:58:03,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 81444864. Throughput: 0: 9392.5. Samples: 81441552. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:03,540][820373] Avg episode reward: [(0, '0.292')] [2023-03-09 22:58:06,122][820675] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-09 22:58:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 81489920. Throughput: 0: 9373.5. Samples: 81469312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:08,539][820373] Avg episode reward: [(0, '0.208')] [2023-03-09 22:58:10,493][820675] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-09 22:58:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.2, 300 sec: 9316.7). Total num frames: 81534976. Throughput: 0: 9423.7. Samples: 81525280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:13,539][820373] Avg episode reward: [(0, '0.147')] [2023-03-09 22:58:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159248_81534976.pth... [2023-03-09 22:58:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158704_81256448.pth [2023-03-09 22:58:14,997][820675] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-09 22:58:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 81584128. Throughput: 0: 9473.2. Samples: 81582812. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:18,539][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 22:58:19,173][820675] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-09 22:58:23,238][820675] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-09 22:58:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 81633280. Throughput: 0: 9441.9. Samples: 81609408. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:58:27,481][820675] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-09 22:58:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 81682432. Throughput: 0: 9467.6. Samples: 81670152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:28,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 22:58:28,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159536_81682432.pth... [2023-03-09 22:58:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000158984_81399808.pth [2023-03-09 22:58:31,751][820675] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-09 22:58:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9330.5). Total num frames: 81731584. Throughput: 0: 9523.3. Samples: 81730000. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:33,540][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 22:58:35,863][820675] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-09 22:58:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 81780736. Throughput: 0: 9516.8. Samples: 81758360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:58:40,279][820675] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-09 22:58:43,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 81825792. Throughput: 0: 9464.6. Samples: 81813424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:43,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 22:58:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159816_81825792.pth... [2023-03-09 22:58:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159248_81534976.pth [2023-03-09 22:58:44,785][820675] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-09 22:58:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.0, 300 sec: 9344.4). Total num frames: 81870848. Throughput: 0: 9498.8. Samples: 81868996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:58:49,159][820675] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-09 22:58:53,497][820675] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-09 22:58:53,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 81920000. Throughput: 0: 9516.2. Samples: 81897544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:53,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:58:57,887][820675] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-09 22:58:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 81965056. Throughput: 0: 9507.0. Samples: 81953096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:58:58,539][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 22:58:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160088_81965056.pth... [2023-03-09 22:58:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159536_81682432.pth [2023-03-09 22:59:02,391][820675] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-09 22:59:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 82010112. Throughput: 0: 9440.5. Samples: 82007636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:03,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 22:59:06,703][820675] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-09 22:59:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 82055168. Throughput: 0: 9487.9. Samples: 82036364. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:59:11,135][820675] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-09 22:59:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 82104320. Throughput: 0: 9376.5. Samples: 82092096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:13,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 22:59:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160360_82104320.pth... [2023-03-09 22:59:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000159816_81825792.pth [2023-03-09 22:59:15,502][820675] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-09 22:59:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 82149376. Throughput: 0: 9260.0. Samples: 82146700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 22:59:20,175][820675] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-09 22:59:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 82194432. Throughput: 0: 9235.0. Samples: 82173936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:23,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:59:24,635][820675] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-09 22:59:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 82239488. Throughput: 0: 9244.7. Samples: 82229436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:28,539][820373] Avg episode reward: [(0, '0.138')] [2023-03-09 22:59:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160624_82239488.pth... [2023-03-09 22:59:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160088_81965056.pth [2023-03-09 22:59:29,150][820675] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-09 22:59:33,374][820675] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-09 22:59:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 82288640. Throughput: 0: 9261.2. Samples: 82285748. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:33,539][820373] Avg episode reward: [(0, '0.139')] [2023-03-09 22:59:37,632][820675] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-09 22:59:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 82337792. Throughput: 0: 9236.7. Samples: 82313196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:38,540][820373] Avg episode reward: [(0, '0.050')] [2023-03-09 22:59:41,800][820675] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-09 22:59:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 82386944. Throughput: 0: 9341.9. Samples: 82373480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:43,539][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 22:59:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160912_82386944.pth... [2023-03-09 22:59:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160360_82104320.pth [2023-03-09 22:59:46,172][820675] Updated weights for policy 0, policy_version 160960 (0.0005) [2023-03-09 22:59:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 82432000. Throughput: 0: 9357.1. Samples: 82428704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 22:59:50,676][820675] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-09 22:59:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 82477056. Throughput: 0: 9337.4. Samples: 82456548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 22:59:53,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 22:59:55,237][820675] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-09 22:59:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 82522112. Throughput: 0: 9284.3. Samples: 82509888. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 22:59:58,540][820373] Avg episode reward: [(0, '0.175')] [2023-03-09 22:59:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161176_82522112.pth... [2023-03-09 22:59:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160624_82239488.pth [2023-03-09 22:59:59,754][820675] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-09 23:00:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 82567168. Throughput: 0: 9268.9. Samples: 82563800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:03,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 23:00:04,262][820675] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-09 23:00:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 82612224. Throughput: 0: 9284.0. Samples: 82591716. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:08,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:00:08,815][820675] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-09 23:00:13,434][820675] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-09 23:00:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 82657280. Throughput: 0: 9234.6. Samples: 82644992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:13,550][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 23:00:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161440_82657280.pth... [2023-03-09 23:00:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000160912_82386944.pth [2023-03-09 23:00:18,007][820675] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-09 23:00:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 82702336. Throughput: 0: 9169.1. Samples: 82698356. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:18,550][820373] Avg episode reward: [(0, '0.045')] [2023-03-09 23:00:22,433][820675] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-09 23:00:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 82747392. Throughput: 0: 9192.4. Samples: 82726852. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:23,550][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 23:00:26,937][820675] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-09 23:00:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 82792448. Throughput: 0: 9059.9. Samples: 82781176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:28,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 23:00:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161704_82792448.pth... [2023-03-09 23:00:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161176_82522112.pth [2023-03-09 23:00:31,247][820675] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-09 23:00:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 82841600. Throughput: 0: 9087.8. Samples: 82837656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:33,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 23:00:35,609][820675] Updated weights for policy 0, policy_version 161840 (0.0004) [2023-03-09 23:00:38,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 82886656. Throughput: 0: 9104.4. Samples: 82866248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:38,539][820373] Avg episode reward: [(0, '0.123')] [2023-03-09 23:00:39,986][820675] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-09 23:00:43,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 82931712. Throughput: 0: 9191.4. Samples: 82923500. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:00:43,563][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161984_82935808.pth... [2023-03-09 23:00:43,565][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161440_82657280.pth [2023-03-09 23:00:44,472][820675] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-09 23:00:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 82980864. Throughput: 0: 9203.5. Samples: 82977956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:48,539][820373] Avg episode reward: [(0, '0.297')] [2023-03-09 23:00:48,805][820675] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-09 23:00:53,393][820675] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-09 23:00:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.8, 300 sec: 9288.9). Total num frames: 83025920. Throughput: 0: 9193.4. Samples: 83005420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:53,539][820373] Avg episode reward: [(0, '0.238')] [2023-03-09 23:00:57,944][820675] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-09 23:00:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 83070976. Throughput: 0: 9200.1. Samples: 83058996. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:00:58,539][820373] Avg episode reward: [(0, '0.064')] [2023-03-09 23:00:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162248_83070976.pth... [2023-03-09 23:00:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161704_82792448.pth [2023-03-09 23:01:02,479][820675] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-09 23:01:03,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 83116032. Throughput: 0: 9213.2. Samples: 83112948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:01:06,789][820675] Updated weights for policy 0, policy_version 162400 (0.0004) [2023-03-09 23:01:08,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 83161088. Throughput: 0: 9210.2. Samples: 83141312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:08,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 23:01:11,435][820675] Updated weights for policy 0, policy_version 162480 (0.0004) [2023-03-09 23:01:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 83210240. Throughput: 0: 9206.8. Samples: 83195484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:13,539][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 23:01:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162520_83210240.pth... [2023-03-09 23:01:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000161984_82935808.pth [2023-03-09 23:01:15,535][820675] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-09 23:01:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 83259392. Throughput: 0: 9295.9. Samples: 83255972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:18,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:01:19,797][820675] Updated weights for policy 0, policy_version 162640 (0.0004) [2023-03-09 23:01:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 83304448. Throughput: 0: 9283.0. Samples: 83283980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:23,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:01:24,115][820675] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-09 23:01:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 83349504. Throughput: 0: 9256.1. Samples: 83340024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:28,539][820373] Avg episode reward: [(0, '0.142')] [2023-03-09 23:01:28,549][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162800_83353600.pth... [2023-03-09 23:01:28,550][820675] Updated weights for policy 0, policy_version 162800 (0.0004) [2023-03-09 23:01:28,551][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162248_83070976.pth [2023-03-09 23:01:32,756][820675] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-09 23:01:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 83398656. Throughput: 0: 9339.6. Samples: 83398236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:33,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 23:01:37,096][820675] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-09 23:01:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 83447808. Throughput: 0: 9366.5. Samples: 83426912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:38,540][820373] Avg episode reward: [(0, '0.091')] [2023-03-09 23:01:41,478][820675] Updated weights for policy 0, policy_version 163040 (0.0004) [2023-03-09 23:01:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 83492864. Throughput: 0: 9388.2. Samples: 83481464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:01:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163072_83492864.pth... [2023-03-09 23:01:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162520_83210240.pth [2023-03-09 23:01:46,193][820675] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-09 23:01:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 83537920. Throughput: 0: 9379.5. Samples: 83535024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:48,539][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:01:50,488][820675] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-09 23:01:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 83582976. Throughput: 0: 9382.2. Samples: 83563512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:53,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:01:54,864][820675] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-09 23:01:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 83632128. Throughput: 0: 9430.3. Samples: 83619848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:01:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:01:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163344_83632128.pth... [2023-03-09 23:01:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000162800_83353600.pth [2023-03-09 23:01:59,291][820675] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-09 23:02:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 83677184. Throughput: 0: 9306.8. Samples: 83674780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:03,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:02:03,738][820675] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-09 23:02:08,134][820675] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-09 23:02:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 83722240. Throughput: 0: 9299.3. Samples: 83702448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:02:12,825][820675] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-09 23:02:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 83767296. Throughput: 0: 9250.2. Samples: 83756284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:13,540][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 23:02:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163608_83767296.pth... [2023-03-09 23:02:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163072_83492864.pth [2023-03-09 23:02:17,409][820675] Updated weights for policy 0, policy_version 163680 (0.0004) [2023-03-09 23:02:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 83812352. Throughput: 0: 9153.7. Samples: 83810152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:18,539][820373] Avg episode reward: [(0, '0.143')] [2023-03-09 23:02:22,019][820675] Updated weights for policy 0, policy_version 163760 (0.0004) [2023-03-09 23:02:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 83857408. Throughput: 0: 9111.7. Samples: 83836936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:02:26,357][820675] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-09 23:02:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9316.7). Total num frames: 83906560. Throughput: 0: 9146.3. Samples: 83893048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:28,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:02:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163880_83906560.pth... [2023-03-09 23:02:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163344_83632128.pth [2023-03-09 23:02:30,798][820675] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-09 23:02:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 83951616. Throughput: 0: 9183.7. Samples: 83948292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:33,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 23:02:35,279][820675] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-09 23:02:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 83996672. Throughput: 0: 9147.1. Samples: 83975132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:38,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:02:39,707][820675] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-09 23:02:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 84045824. Throughput: 0: 9176.7. Samples: 84032800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:43,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 23:02:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164152_84045824.pth... [2023-03-09 23:02:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163608_83767296.pth [2023-03-09 23:02:43,885][820675] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-09 23:02:48,386][820675] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-09 23:02:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 84090880. Throughput: 0: 9173.7. Samples: 84087596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:02:52,803][820675] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-09 23:02:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 84135936. Throughput: 0: 9190.1. Samples: 84116004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:53,539][820373] Avg episode reward: [(0, '0.125')] [2023-03-09 23:02:57,156][820675] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-09 23:02:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 84185088. Throughput: 0: 9245.3. Samples: 84172324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:02:58,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:02:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164424_84185088.pth... [2023-03-09 23:02:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000163880_83906560.pth [2023-03-09 23:03:01,244][820675] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-09 23:03:03,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 84234240. Throughput: 0: 9339.8. Samples: 84230444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:03:03,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 23:03:05,588][820675] Updated weights for policy 0, policy_version 164560 (0.0004) [2023-03-09 23:03:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 84279296. Throughput: 0: 9384.9. Samples: 84259256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:03:08,539][820373] Avg episode reward: [(0, '0.076')] [2023-03-09 23:03:09,978][820675] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-09 23:03:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 84324352. Throughput: 0: 9355.2. Samples: 84314032. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:13,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:03:13,587][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164704_84328448.pth... [2023-03-09 23:03:13,588][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164152_84045824.pth [2023-03-09 23:03:14,514][820675] Updated weights for policy 0, policy_version 164720 (0.0004) [2023-03-09 23:03:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 84373504. Throughput: 0: 9387.3. Samples: 84370720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:18,539][820373] Avg episode reward: [(0, '0.126')] [2023-03-09 23:03:18,769][820675] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-09 23:03:23,012][820675] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-09 23:03:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 84422656. Throughput: 0: 9435.2. Samples: 84399716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:03:27,444][820675] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-09 23:03:28,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84467712. Throughput: 0: 9391.6. Samples: 84455424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:28,540][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 23:03:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164976_84467712.pth... [2023-03-09 23:03:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164424_84185088.pth [2023-03-09 23:03:31,958][820675] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-09 23:03:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9261.1). Total num frames: 84512768. Throughput: 0: 9382.5. Samples: 84509808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:03:36,433][820675] Updated weights for policy 0, policy_version 165120 (0.0004) [2023-03-09 23:03:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 84557824. Throughput: 0: 9364.7. Samples: 84537416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:38,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:03:40,830][820675] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-09 23:03:43,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 84602880. Throughput: 0: 9359.0. Samples: 84593476. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:43,539][820373] Avg episode reward: [(0, '0.883')] [2023-03-09 23:03:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165240_84602880.pth... [2023-03-09 23:03:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164704_84328448.pth [2023-03-09 23:03:45,362][820675] Updated weights for policy 0, policy_version 165280 (0.0004) [2023-03-09 23:03:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 84652032. Throughput: 0: 9331.8. Samples: 84650376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:48,540][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 23:03:49,537][820675] Updated weights for policy 0, policy_version 165360 (0.0004) [2023-03-09 23:03:53,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 84701184. Throughput: 0: 9281.0. Samples: 84676900. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:53,540][820373] Avg episode reward: [(0, '0.036')] [2023-03-09 23:03:53,898][820675] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-09 23:03:58,326][820675] Updated weights for policy 0, policy_version 165520 (0.0004) [2023-03-09 23:03:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84746240. Throughput: 0: 9333.1. Samples: 84734024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:03:58,550][820373] Avg episode reward: [(0, '0.010')] [2023-03-09 23:03:58,553][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165520_84746240.pth... [2023-03-09 23:03:58,555][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000164976_84467712.pth [2023-03-09 23:04:02,505][820675] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-09 23:04:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 84795392. Throughput: 0: 9360.1. Samples: 84791924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:04:03,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 23:04:06,887][820675] Updated weights for policy 0, policy_version 165680 (0.0005) [2023-03-09 23:04:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84840448. Throughput: 0: 9340.5. Samples: 84820040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 23:04:08,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 23:04:11,194][820675] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-09 23:04:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 84889600. Throughput: 0: 9375.6. Samples: 84877324. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:13,539][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 23:04:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165800_84889600.pth... [2023-03-09 23:04:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165240_84602880.pth [2023-03-09 23:04:15,499][820675] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-09 23:04:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 84934656. Throughput: 0: 9393.7. Samples: 84932524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:18,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 23:04:20,138][820675] Updated weights for policy 0, policy_version 165920 (0.0004) [2023-03-09 23:04:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 84979712. Throughput: 0: 9375.1. Samples: 84959296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:23,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:04:24,653][820675] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-09 23:04:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85024768. Throughput: 0: 9359.3. Samples: 85014644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:04:28,582][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166072_85028864.pth... [2023-03-09 23:04:28,584][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165520_84746240.pth [2023-03-09 23:04:29,025][820675] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-09 23:04:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 85069824. Throughput: 0: 9298.7. Samples: 85068816. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:33,539][820373] Avg episode reward: [(0, '0.013')] [2023-03-09 23:04:33,679][820675] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-09 23:04:37,764][820675] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-09 23:04:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 85118976. Throughput: 0: 9369.0. Samples: 85098504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:38,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:04:42,176][820675] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-09 23:04:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 85168128. Throughput: 0: 9362.9. Samples: 85155356. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:43,540][820373] Avg episode reward: [(0, '0.060')] [2023-03-09 23:04:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166344_85168128.pth... [2023-03-09 23:04:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000165800_84889600.pth [2023-03-09 23:04:46,569][820675] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-09 23:04:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 85213184. Throughput: 0: 9338.6. Samples: 85212160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:48,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:04:50,659][820675] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-09 23:04:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 85262336. Throughput: 0: 9373.7. Samples: 85241856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:04:55,198][820675] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-09 23:04:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 85307392. Throughput: 0: 9295.7. Samples: 85295632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:04:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:04:58,559][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166624_85311488.pth... [2023-03-09 23:04:58,562][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166072_85028864.pth [2023-03-09 23:04:59,450][820675] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-09 23:05:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 85352448. Throughput: 0: 9330.7. Samples: 85352404. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:05:03,540][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 23:05:04,047][820675] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-09 23:05:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 85397504. Throughput: 0: 9316.8. Samples: 85378552. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:05:08,539][820373] Avg episode reward: [(0, '0.113')] [2023-03-09 23:05:08,577][820675] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-09 23:05:12,969][820675] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-09 23:05:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 85446656. Throughput: 0: 9320.9. Samples: 85434084. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:05:13,540][820373] Avg episode reward: [(0, '0.017')] [2023-03-09 23:05:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166888_85446656.pth... [2023-03-09 23:05:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166344_85168128.pth [2023-03-09 23:05:17,583][820675] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-09 23:05:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 85491712. Throughput: 0: 9306.7. Samples: 85487616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:05:21,935][820675] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-09 23:05:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 85536768. Throughput: 0: 9286.3. Samples: 85516388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:23,539][820373] Avg episode reward: [(0, '0.146')] [2023-03-09 23:05:26,625][820675] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-09 23:05:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 85581824. Throughput: 0: 9203.5. Samples: 85569512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:05:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167152_85581824.pth... [2023-03-09 23:05:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166624_85311488.pth [2023-03-09 23:05:30,926][820675] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-09 23:05:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 85630976. Throughput: 0: 9243.4. Samples: 85628112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:33,539][820373] Avg episode reward: [(0, '0.378')] [2023-03-09 23:05:35,035][820675] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-09 23:05:38,539][820373] Fps is (10 sec: 10239.9, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 85684224. Throughput: 0: 9207.1. Samples: 85656176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:38,540][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 23:05:38,975][820675] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-09 23:05:43,398][820675] Updated weights for policy 0, policy_version 167440 (0.0004) [2023-03-09 23:05:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 85729280. Throughput: 0: 9363.8. Samples: 85717004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:43,540][820373] Avg episode reward: [(0, '0.188')] [2023-03-09 23:05:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167440_85729280.pth... [2023-03-09 23:05:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000166888_85446656.pth [2023-03-09 23:05:47,871][820675] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-09 23:05:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 85774336. Throughput: 0: 9324.4. Samples: 85772000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:48,539][820373] Avg episode reward: [(0, '0.099')] [2023-03-09 23:05:52,363][820675] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-09 23:05:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 85819392. Throughput: 0: 9353.9. Samples: 85799480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:05:56,656][820675] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-09 23:05:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 85868544. Throughput: 0: 9383.0. Samples: 85856320. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:05:58,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:05:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167712_85868544.pth... [2023-03-09 23:05:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167152_85581824.pth [2023-03-09 23:06:00,855][820675] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-09 23:06:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 85917696. Throughput: 0: 9466.5. Samples: 85913608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:06:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:06:05,276][820675] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-09 23:06:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 85962752. Throughput: 0: 9464.3. Samples: 85942280. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:06:08,539][820373] Avg episode reward: [(0, '0.794')] [2023-03-09 23:06:09,644][820675] Updated weights for policy 0, policy_version 167920 (0.0004) [2023-03-09 23:06:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9316.7). Total num frames: 86007808. Throughput: 0: 9528.1. Samples: 85998276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:06:13,539][820373] Avg episode reward: [(0, '0.068')] [2023-03-09 23:06:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167984_86007808.pth... [2023-03-09 23:06:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167440_85729280.pth [2023-03-09 23:06:14,072][820675] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-09 23:06:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 86052864. Throughput: 0: 9428.7. Samples: 86052404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:06:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:06:18,633][820675] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-09 23:06:23,149][820675] Updated weights for policy 0, policy_version 168160 (0.0004) [2023-03-09 23:06:23,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 86097920. Throughput: 0: 9415.6. Samples: 86079876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:06:27,608][820675] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-09 23:06:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 86142976. Throughput: 0: 9277.3. Samples: 86134480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:28,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:06:28,566][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168256_86147072.pth... [2023-03-09 23:06:28,568][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167712_85868544.pth [2023-03-09 23:06:31,791][820675] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-09 23:06:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9302.8). Total num frames: 86192128. Throughput: 0: 9334.1. Samples: 86192032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:33,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 23:06:36,345][820675] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-09 23:06:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 86241280. Throughput: 0: 9277.0. Samples: 86216944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:38,539][820373] Avg episode reward: [(0, '0.096')] [2023-03-09 23:06:40,564][820675] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-09 23:06:43,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 86286336. Throughput: 0: 9296.7. Samples: 86274672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:43,539][820373] Avg episode reward: [(0, '0.079')] [2023-03-09 23:06:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168528_86286336.pth... [2023-03-09 23:06:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000167984_86007808.pth [2023-03-09 23:06:45,273][820675] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-09 23:06:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 86331392. Throughput: 0: 9254.0. Samples: 86330040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:48,540][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 23:06:49,552][820675] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-09 23:06:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 86376448. Throughput: 0: 9198.6. Samples: 86356216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:53,540][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 23:06:54,168][820675] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-09 23:06:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 86421504. Throughput: 0: 9168.0. Samples: 86410836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:06:58,539][820373] Avg episode reward: [(0, '0.180')] [2023-03-09 23:06:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168792_86421504.pth... [2023-03-09 23:06:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168256_86147072.pth [2023-03-09 23:06:58,654][820675] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-09 23:07:03,040][820675] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-09 23:07:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 86470656. Throughput: 0: 9204.9. Samples: 86466624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:07:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:07:07,461][820675] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-09 23:07:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 86515712. Throughput: 0: 9226.0. Samples: 86495048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:07:08,540][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:07:11,986][820675] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-09 23:07:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 86560768. Throughput: 0: 9208.8. Samples: 86548876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:07:13,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:07:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169064_86560768.pth... [2023-03-09 23:07:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168528_86286336.pth [2023-03-09 23:07:16,178][820675] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-09 23:07:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 86609920. Throughput: 0: 9199.7. Samples: 86606020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:07:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:07:20,708][820675] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-09 23:07:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 86654976. Throughput: 0: 9272.6. Samples: 86634212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:07:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:07:25,189][820675] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-09 23:07:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 86700032. Throughput: 0: 9204.7. Samples: 86688884. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:07:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169336_86700032.pth... [2023-03-09 23:07:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000168792_86421504.pth [2023-03-09 23:07:29,495][820675] Updated weights for policy 0, policy_version 169360 (0.0005) [2023-03-09 23:07:33,462][820675] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-09 23:07:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 86753280. Throughput: 0: 9316.8. Samples: 86749296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:33,539][820373] Avg episode reward: [(0, '0.121')] [2023-03-09 23:07:37,896][820675] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-09 23:07:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 86798336. Throughput: 0: 9370.0. Samples: 86777864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:38,539][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 23:07:42,126][820675] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-09 23:07:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 86847488. Throughput: 0: 9424.4. Samples: 86834936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:43,540][820373] Avg episode reward: [(0, '0.072')] [2023-03-09 23:07:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169624_86847488.pth... [2023-03-09 23:07:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169064_86560768.pth [2023-03-09 23:07:46,618][820675] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-09 23:07:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 86892544. Throughput: 0: 9397.1. Samples: 86889496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:48,540][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 23:07:51,141][820675] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-09 23:07:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 86937600. Throughput: 0: 9374.1. Samples: 86916880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:53,539][820373] Avg episode reward: [(0, '0.046')] [2023-03-09 23:07:55,437][820675] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-09 23:07:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 86986752. Throughput: 0: 9425.0. Samples: 86973000. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:07:58,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:07:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169896_86986752.pth... [2023-03-09 23:07:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169336_86700032.pth [2023-03-09 23:07:59,674][820675] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-09 23:08:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 87031808. Throughput: 0: 9431.0. Samples: 87030416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:03,539][820373] Avg episode reward: [(0, '0.111')] [2023-03-09 23:08:04,095][820675] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-09 23:08:08,473][820675] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-09 23:08:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87080960. Throughput: 0: 9431.9. Samples: 87058648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:08,539][820373] Avg episode reward: [(0, '0.290')] [2023-03-09 23:08:13,094][820675] Updated weights for policy 0, policy_version 170160 (0.0004) [2023-03-09 23:08:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 87126016. Throughput: 0: 9431.5. Samples: 87113304. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:13,540][820373] Avg episode reward: [(0, '0.181')] [2023-03-09 23:08:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170168_87126016.pth... [2023-03-09 23:08:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169624_86847488.pth [2023-03-09 23:08:17,411][820675] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-09 23:08:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 87171072. Throughput: 0: 9323.8. Samples: 87168868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:18,540][820373] Avg episode reward: [(0, '0.010')] [2023-03-09 23:08:21,936][820675] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-09 23:08:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 87216128. Throughput: 0: 9284.3. Samples: 87195660. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:23,539][820373] Avg episode reward: [(0, '0.026')] [2023-03-09 23:08:26,430][820675] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-09 23:08:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 87265280. Throughput: 0: 9241.0. Samples: 87250780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 23:08:28,539][820373] Avg episode reward: [(0, '0.012')] [2023-03-09 23:08:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170440_87265280.pth... [2023-03-09 23:08:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000169896_86986752.pth [2023-03-09 23:08:30,856][820675] Updated weights for policy 0, policy_version 170480 (0.0004) [2023-03-09 23:08:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 87310336. Throughput: 0: 9298.1. Samples: 87307912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:33,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:08:34,939][820675] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-09 23:08:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 87359488. Throughput: 0: 9377.9. Samples: 87338884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:38,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:08:39,261][820675] Updated weights for policy 0, policy_version 170640 (0.0004) [2023-03-09 23:08:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 87404544. Throughput: 0: 9365.6. Samples: 87394452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:43,539][820373] Avg episode reward: [(0, '0.113')] [2023-03-09 23:08:43,545][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170720_87408640.pth... [2023-03-09 23:08:43,546][820675] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-09 23:08:43,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170168_87126016.pth [2023-03-09 23:08:47,675][820675] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-09 23:08:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9330.6). Total num frames: 87453696. Throughput: 0: 9402.0. Samples: 87453508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:08:52,071][820675] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-09 23:08:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87502848. Throughput: 0: 9414.9. Samples: 87482320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:53,539][820373] Avg episode reward: [(0, '0.134')] [2023-03-09 23:08:56,448][820675] Updated weights for policy 0, policy_version 170960 (0.0004) [2023-03-09 23:08:58,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87552000. Throughput: 0: 9443.2. Samples: 87538248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:08:58,539][820373] Avg episode reward: [(0, '5.983')] [2023-03-09 23:08:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171000_87552000.pth... [2023-03-09 23:08:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170440_87265280.pth [2023-03-09 23:09:00,584][820675] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-09 23:09:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87597056. Throughput: 0: 9491.6. Samples: 87595988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:03,539][820373] Avg episode reward: [(0, '0.010')] [2023-03-09 23:09:05,038][820675] Updated weights for policy 0, policy_version 171120 (0.0005) [2023-03-09 23:09:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87646208. Throughput: 0: 9489.3. Samples: 87622680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:08,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:09:09,149][820675] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-09 23:09:13,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87691264. Throughput: 0: 9563.1. Samples: 87681120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:13,540][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 23:09:13,572][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171280_87695360.pth... [2023-03-09 23:09:13,573][820675] Updated weights for policy 0, policy_version 171280 (0.0006) [2023-03-09 23:09:13,574][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000170720_87408640.pth [2023-03-09 23:09:17,947][820675] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-09 23:09:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 87740416. Throughput: 0: 9542.2. Samples: 87737312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:09:22,300][820675] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-09 23:09:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 87785472. Throughput: 0: 9470.7. Samples: 87765064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:23,539][820373] Avg episode reward: [(0, '0.214')] [2023-03-09 23:09:26,908][820675] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-09 23:09:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 87834624. Throughput: 0: 9448.6. Samples: 87819640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:28,540][820373] Avg episode reward: [(0, '0.921')] [2023-03-09 23:09:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171552_87834624.pth... [2023-03-09 23:09:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171000_87552000.pth [2023-03-09 23:09:30,898][820675] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-09 23:09:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 87883776. Throughput: 0: 9500.2. Samples: 87881020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:33,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:09:35,208][820675] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-09 23:09:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 87928832. Throughput: 0: 9464.9. Samples: 87908240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:38,539][820373] Avg episode reward: [(0, '0.107')] [2023-03-09 23:09:39,562][820675] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-09 23:09:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 87973888. Throughput: 0: 9423.2. Samples: 87962292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:43,540][820373] Avg episode reward: [(0, '0.091')] [2023-03-09 23:09:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171824_87973888.pth... [2023-03-09 23:09:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171280_87695360.pth [2023-03-09 23:09:44,177][820675] Updated weights for policy 0, policy_version 171840 (0.0006) [2023-03-09 23:09:48,441][820675] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-09 23:09:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 88023040. Throughput: 0: 9417.7. Samples: 88019784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:48,539][820373] Avg episode reward: [(0, '0.110')] [2023-03-09 23:09:53,059][820675] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-09 23:09:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 88068096. Throughput: 0: 9441.5. Samples: 88047548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:53,539][820373] Avg episode reward: [(0, '0.134')] [2023-03-09 23:09:57,135][820675] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-09 23:09:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 88117248. Throughput: 0: 9416.4. Samples: 88104856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:09:58,539][820373] Avg episode reward: [(0, '0.056')] [2023-03-09 23:09:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172104_88117248.pth... [2023-03-09 23:09:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171552_87834624.pth [2023-03-09 23:10:01,640][820675] Updated weights for policy 0, policy_version 172160 (0.0006) [2023-03-09 23:10:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 88162304. Throughput: 0: 9360.4. Samples: 88158532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:03,539][820373] Avg episode reward: [(0, '0.087')] [2023-03-09 23:10:05,850][820675] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-09 23:10:08,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 88207360. Throughput: 0: 9423.1. Samples: 88189104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:08,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 23:10:10,343][820675] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-09 23:10:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 88256512. Throughput: 0: 9434.4. Samples: 88244188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:13,540][820373] Avg episode reward: [(0, '0.151')] [2023-03-09 23:10:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172376_88256512.pth... [2023-03-09 23:10:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000171824_87973888.pth [2023-03-09 23:10:14,533][820675] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-09 23:10:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 88301568. Throughput: 0: 9342.8. Samples: 88301444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:18,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:10:18,986][820675] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-09 23:10:23,264][820675] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-09 23:10:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 88350720. Throughput: 0: 9375.9. Samples: 88330156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:23,539][820373] Avg episode reward: [(0, '0.325')] [2023-03-09 23:10:27,713][820675] Updated weights for policy 0, policy_version 172640 (0.0005) [2023-03-09 23:10:28,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 88399872. Throughput: 0: 9387.6. Samples: 88384732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:28,539][820373] Avg episode reward: [(0, '0.083')] [2023-03-09 23:10:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172656_88399872.pth... [2023-03-09 23:10:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172104_88117248.pth [2023-03-09 23:10:32,191][820675] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-09 23:10:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 88444928. Throughput: 0: 9355.9. Samples: 88440800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:33,540][820373] Avg episode reward: [(0, '0.256')] [2023-03-09 23:10:36,756][820675] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-09 23:10:38,539][820373] Fps is (10 sec: 8601.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 88485888. Throughput: 0: 9314.8. Samples: 88466712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:38,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:10:41,237][820675] Updated weights for policy 0, policy_version 172880 (0.0005) [2023-03-09 23:10:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 88535040. Throughput: 0: 9268.5. Samples: 88521940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:43,540][820373] Avg episode reward: [(0, '0.016')] [2023-03-09 23:10:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172920_88535040.pth... [2023-03-09 23:10:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172376_88256512.pth [2023-03-09 23:10:45,880][820675] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-09 23:10:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 88576000. Throughput: 0: 9277.0. Samples: 88575996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:48,539][820373] Avg episode reward: [(0, '0.052')] [2023-03-09 23:10:50,513][820675] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-09 23:10:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 88625152. Throughput: 0: 9165.2. Samples: 88601536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:53,539][820373] Avg episode reward: [(0, '0.087')] [2023-03-09 23:10:54,819][820675] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-09 23:10:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 88670208. Throughput: 0: 9196.7. Samples: 88658036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:10:58,539][820373] Avg episode reward: [(0, '0.010')] [2023-03-09 23:10:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173184_88670208.pth... [2023-03-09 23:10:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172656_88399872.pth [2023-03-09 23:10:59,200][820675] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-09 23:11:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 88715264. Throughput: 0: 9192.7. Samples: 88715116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:11:03,658][820675] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-09 23:11:08,086][820675] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-09 23:11:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 88764416. Throughput: 0: 9159.7. Samples: 88742344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:08,540][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 23:11:12,387][820675] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-09 23:11:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 88809472. Throughput: 0: 9166.0. Samples: 88797200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:13,539][820373] Avg episode reward: [(0, '0.037')] [2023-03-09 23:11:13,572][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173464_88813568.pth... [2023-03-09 23:11:13,573][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000172920_88535040.pth [2023-03-09 23:11:16,836][820675] Updated weights for policy 0, policy_version 173520 (0.0004) [2023-03-09 23:11:18,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 88854528. Throughput: 0: 9182.2. Samples: 88854000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:18,539][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 23:11:21,245][820675] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-09 23:11:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 88903680. Throughput: 0: 9234.8. Samples: 88882280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:23,540][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:11:25,654][820675] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-09 23:11:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 88948736. Throughput: 0: 9211.3. Samples: 88936448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:28,539][820373] Avg episode reward: [(0, '15.140')] [2023-03-09 23:11:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173728_88948736.pth... [2023-03-09 23:11:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173184_88670208.pth [2023-03-09 23:11:30,158][820675] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-09 23:11:33,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9330.6). Total num frames: 88993792. Throughput: 0: 9273.2. Samples: 88993292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:33,539][820373] Avg episode reward: [(0, '0.174')] [2023-03-09 23:11:34,535][820675] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-09 23:11:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 89042944. Throughput: 0: 9343.9. Samples: 89022012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:38,539][820373] Avg episode reward: [(0, '0.378')] [2023-03-09 23:11:38,851][820675] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-09 23:11:43,344][820675] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-09 23:11:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 89088000. Throughput: 0: 9283.6. Samples: 89075800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:11:43,539][820373] Avg episode reward: [(0, '0.122')] [2023-03-09 23:11:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174000_89088000.pth... [2023-03-09 23:11:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173464_88813568.pth [2023-03-09 23:11:47,735][820675] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-09 23:11:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 89133056. Throughput: 0: 9280.9. Samples: 89132756. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:11:48,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:11:52,172][820675] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-09 23:11:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 89178112. Throughput: 0: 9272.0. Samples: 89159584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:11:53,539][820373] Avg episode reward: [(0, '0.118')] [2023-03-09 23:11:56,801][820675] Updated weights for policy 0, policy_version 174240 (0.0005) [2023-03-09 23:11:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 89223168. Throughput: 0: 9245.1. Samples: 89213228. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:11:58,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 23:11:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174264_89223168.pth... [2023-03-09 23:11:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000173728_88948736.pth [2023-03-09 23:12:01,281][820675] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-09 23:12:03,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9284.2, 300 sec: 9344.4). Total num frames: 89272320. Throughput: 0: 9253.4. Samples: 89270404. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:03,540][820373] Avg episode reward: [(0, '0.062')] [2023-03-09 23:12:05,533][820675] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-09 23:12:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 89317376. Throughput: 0: 9215.3. Samples: 89296968. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:08,539][820373] Avg episode reward: [(0, '0.060')] [2023-03-09 23:12:09,928][820675] Updated weights for policy 0, policy_version 174480 (0.0004) [2023-03-09 23:12:13,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 89366528. Throughput: 0: 9284.2. Samples: 89354236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:13,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 23:12:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174544_89366528.pth... [2023-03-09 23:12:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174000_89088000.pth [2023-03-09 23:12:14,313][820675] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-09 23:12:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 89411584. Throughput: 0: 9225.4. Samples: 89408436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:12:18,797][820675] Updated weights for policy 0, policy_version 174640 (0.0004) [2023-03-09 23:12:23,261][820675] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-09 23:12:23,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 89456640. Throughput: 0: 9202.5. Samples: 89436124. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:23,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 23:12:27,350][820675] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-09 23:12:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 89505792. Throughput: 0: 9308.0. Samples: 89494660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:28,539][820373] Avg episode reward: [(0, '0.207')] [2023-03-09 23:12:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174816_89505792.pth... [2023-03-09 23:12:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174264_89223168.pth [2023-03-09 23:12:31,746][820675] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-09 23:12:33,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 89554944. Throughput: 0: 9292.5. Samples: 89550920. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:33,540][820373] Avg episode reward: [(0, '0.020')] [2023-03-09 23:12:36,269][820675] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-09 23:12:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 89595904. Throughput: 0: 9314.3. Samples: 89578728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:38,539][820373] Avg episode reward: [(0, '0.209')] [2023-03-09 23:12:40,807][820675] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-09 23:12:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 89645056. Throughput: 0: 9315.9. Samples: 89632444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:43,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:12:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175088_89645056.pth... [2023-03-09 23:12:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174544_89366528.pth [2023-03-09 23:12:45,253][820675] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-09 23:12:48,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 89690112. Throughput: 0: 9283.5. Samples: 89688160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:12:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:12:49,600][820675] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-09 23:12:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 89739264. Throughput: 0: 9327.1. Samples: 89716688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:12:53,540][820373] Avg episode reward: [(0, '0.009')] [2023-03-09 23:12:54,017][820675] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-09 23:12:58,200][820675] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-09 23:12:58,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9330.5). Total num frames: 89784320. Throughput: 0: 9304.4. Samples: 89772932. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:12:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:12:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175360_89784320.pth... [2023-03-09 23:12:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000174816_89505792.pth [2023-03-09 23:13:02,471][820675] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-09 23:13:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9330.6). Total num frames: 89833472. Throughput: 0: 9394.8. Samples: 89831200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:13:06,720][820675] Updated weights for policy 0, policy_version 175520 (0.0005) [2023-03-09 23:13:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 89882624. Throughput: 0: 9445.0. Samples: 89861148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:08,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:13:10,908][820675] Updated weights for policy 0, policy_version 175600 (0.0004) [2023-03-09 23:13:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 89927680. Throughput: 0: 9404.5. Samples: 89917860. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:13:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175640_89927680.pth... [2023-03-09 23:13:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175088_89645056.pth [2023-03-09 23:13:15,299][820675] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-09 23:13:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 89976832. Throughput: 0: 9415.0. Samples: 89974592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:18,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 23:13:19,604][820675] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-09 23:13:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 90025984. Throughput: 0: 9428.9. Samples: 90003028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:23,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:13:23,695][820675] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-09 23:13:28,113][820675] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-09 23:13:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 90071040. Throughput: 0: 9562.5. Samples: 90062756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:28,539][820373] Avg episode reward: [(0, '0.011')] [2023-03-09 23:13:28,581][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175928_90075136.pth... [2023-03-09 23:13:28,582][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175360_89784320.pth [2023-03-09 23:13:32,373][820675] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-09 23:13:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 90120192. Throughput: 0: 9577.2. Samples: 90119136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:33,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 23:13:36,709][820675] Updated weights for policy 0, policy_version 176080 (0.0004) [2023-03-09 23:13:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 90169344. Throughput: 0: 9552.7. Samples: 90146560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:38,539][820373] Avg episode reward: [(0, '0.149')] [2023-03-09 23:13:40,892][820675] Updated weights for policy 0, policy_version 176160 (0.0005) [2023-03-09 23:13:43,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 90218496. Throughput: 0: 9638.4. Samples: 90206660. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:13:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176208_90218496.pth... [2023-03-09 23:13:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175640_89927680.pth [2023-03-09 23:13:44,974][820675] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-09 23:13:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 90263552. Throughput: 0: 9566.6. Samples: 90261696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:48,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:13:49,521][820675] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-09 23:13:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 90312704. Throughput: 0: 9565.3. Samples: 90291588. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:13:53,540][820373] Avg episode reward: [(0, '0.040')] [2023-03-09 23:13:53,944][820675] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-09 23:13:58,317][820675] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-09 23:13:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 90357760. Throughput: 0: 9509.8. Samples: 90345800. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:13:58,540][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 23:13:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176480_90357760.pth... [2023-03-09 23:13:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000175928_90075136.pth [2023-03-09 23:14:02,647][820675] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-09 23:14:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 90406912. Throughput: 0: 9516.4. Samples: 90402832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:03,540][820373] Avg episode reward: [(0, '7.311')] [2023-03-09 23:14:07,040][820675] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-09 23:14:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 90451968. Throughput: 0: 9516.3. Samples: 90431264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:08,539][820373] Avg episode reward: [(0, '0.792')] [2023-03-09 23:14:11,438][820675] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-09 23:14:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 90497024. Throughput: 0: 9398.2. Samples: 90485676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:13,540][820373] Avg episode reward: [(0, '0.219')] [2023-03-09 23:14:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176752_90497024.pth... [2023-03-09 23:14:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176208_90218496.pth [2023-03-09 23:14:16,071][820675] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-09 23:14:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 90546176. Throughput: 0: 9373.2. Samples: 90540928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:18,539][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 23:14:20,131][820675] Updated weights for policy 0, policy_version 176880 (0.0004) [2023-03-09 23:14:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 90591232. Throughput: 0: 9428.1. Samples: 90570824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:23,539][820373] Avg episode reward: [(0, '0.366')] [2023-03-09 23:14:24,451][820675] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-09 23:14:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 90640384. Throughput: 0: 9375.0. Samples: 90628536. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:28,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:14:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177032_90640384.pth... [2023-03-09 23:14:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176480_90357760.pth [2023-03-09 23:14:28,803][820675] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-09 23:14:33,324][820675] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-09 23:14:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 90685440. Throughput: 0: 9364.6. Samples: 90683104. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:14:37,722][820675] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-09 23:14:38,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 90730496. Throughput: 0: 9301.9. Samples: 90710172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:14:42,279][820675] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-09 23:14:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 90775552. Throughput: 0: 9334.7. Samples: 90765860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:43,539][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 23:14:43,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177296_90775552.pth... [2023-03-09 23:14:43,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000176752_90497024.pth [2023-03-09 23:14:46,653][820675] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-09 23:14:48,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 90824704. Throughput: 0: 9369.0. Samples: 90824436. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:48,539][820373] Avg episode reward: [(0, '0.067')] [2023-03-09 23:14:50,550][820675] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-09 23:14:53,539][820373] Fps is (10 sec: 10240.0, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 90877952. Throughput: 0: 9410.4. Samples: 90854732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:53,540][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:14:54,975][820675] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-09 23:14:58,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 90923008. Throughput: 0: 9445.6. Samples: 90910728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:14:58,540][820373] Avg episode reward: [(0, '0.095')] [2023-03-09 23:14:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177584_90923008.pth... [2023-03-09 23:14:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177032_90640384.pth [2023-03-09 23:14:59,427][820675] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-09 23:15:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 90968064. Throughput: 0: 9420.5. Samples: 90964852. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:03,540][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 23:15:03,853][820675] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-09 23:15:08,113][820675] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-09 23:15:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 91013120. Throughput: 0: 9393.5. Samples: 90993532. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:15:12,681][820675] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-09 23:15:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 91062272. Throughput: 0: 9349.7. Samples: 91049276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:13,540][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 23:15:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177856_91062272.pth... [2023-03-09 23:15:13,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177296_90775552.pth [2023-03-09 23:15:16,968][820675] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-09 23:15:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 91107328. Throughput: 0: 9354.5. Samples: 91104056. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:15:21,288][820675] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-09 23:15:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 91156480. Throughput: 0: 9405.7. Samples: 91133428. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:23,539][820373] Avg episode reward: [(0, '1.343')] [2023-03-09 23:15:25,663][820675] Updated weights for policy 0, policy_version 178080 (0.0004) [2023-03-09 23:15:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 91201536. Throughput: 0: 9421.0. Samples: 91189804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:28,540][820373] Avg episode reward: [(0, '0.076')] [2023-03-09 23:15:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178128_91201536.pth... [2023-03-09 23:15:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177584_90923008.pth [2023-03-09 23:15:30,028][820675] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-09 23:15:33,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 91246592. Throughput: 0: 9354.4. Samples: 91245384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:33,540][820373] Avg episode reward: [(0, '0.035')] [2023-03-09 23:15:34,515][820675] Updated weights for policy 0, policy_version 178240 (0.0004) [2023-03-09 23:15:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 91295744. Throughput: 0: 9288.9. Samples: 91272732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:38,540][820373] Avg episode reward: [(0, '0.122')] [2023-03-09 23:15:38,956][820675] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-09 23:15:43,376][820675] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-09 23:15:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 91340800. Throughput: 0: 9282.0. Samples: 91328416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:43,539][820373] Avg episode reward: [(0, '5.614')] [2023-03-09 23:15:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178400_91340800.pth... [2023-03-09 23:15:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000177856_91062272.pth [2023-03-09 23:15:47,722][820675] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-09 23:15:48,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 91385856. Throughput: 0: 9347.3. Samples: 91385480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:48,539][820373] Avg episode reward: [(0, '0.098')] [2023-03-09 23:15:52,415][820675] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-09 23:15:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 91430912. Throughput: 0: 9266.0. Samples: 91410504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:53,540][820373] Avg episode reward: [(0, '0.059')] [2023-03-09 23:15:56,974][820675] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-09 23:15:58,539][820373] Fps is (10 sec: 9011.0, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 91475968. Throughput: 0: 9218.9. Samples: 91464128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:15:58,540][820373] Avg episode reward: [(0, '0.193')] [2023-03-09 23:15:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178664_91475968.pth... [2023-03-09 23:15:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178128_91201536.pth [2023-03-09 23:16:01,109][820675] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-09 23:16:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 91525120. Throughput: 0: 9304.6. Samples: 91522764. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:16:03,540][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:16:05,552][820675] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-09 23:16:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 91570176. Throughput: 0: 9256.0. Samples: 91549948. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 23:16:08,540][820373] Avg episode reward: [(0, '0.011')] [2023-03-09 23:16:10,100][820675] Updated weights for policy 0, policy_version 178880 (0.0004) [2023-03-09 23:16:13,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 91615232. Throughput: 0: 9240.3. Samples: 91605616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:13,539][820373] Avg episode reward: [(0, '0.281')] [2023-03-09 23:16:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178936_91615232.pth... [2023-03-09 23:16:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178400_91340800.pth [2023-03-09 23:16:14,539][820675] Updated weights for policy 0, policy_version 178960 (0.0004) [2023-03-09 23:16:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 91664384. Throughput: 0: 9243.3. Samples: 91661332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:18,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:16:18,889][820675] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-09 23:16:23,348][820675] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-09 23:16:23,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 91709440. Throughput: 0: 9249.5. Samples: 91688960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:16:27,737][820675] Updated weights for policy 0, policy_version 179200 (0.0004) [2023-03-09 23:16:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 91758592. Throughput: 0: 9255.8. Samples: 91744928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:28,540][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 23:16:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179216_91758592.pth... [2023-03-09 23:16:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178664_91475968.pth [2023-03-09 23:16:32,197][820675] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-09 23:16:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 91803648. Throughput: 0: 9235.1. Samples: 91801060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:33,540][820373] Avg episode reward: [(0, '0.132')] [2023-03-09 23:16:36,417][820675] Updated weights for policy 0, policy_version 179360 (0.0004) [2023-03-09 23:16:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 91848704. Throughput: 0: 9284.1. Samples: 91828288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:38,539][820373] Avg episode reward: [(0, '0.170')] [2023-03-09 23:16:40,765][820675] Updated weights for policy 0, policy_version 179440 (0.0004) [2023-03-09 23:16:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 91897856. Throughput: 0: 9365.5. Samples: 91885576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:43,540][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:16:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179488_91897856.pth... [2023-03-09 23:16:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000178936_91615232.pth [2023-03-09 23:16:45,098][820675] Updated weights for policy 0, policy_version 179520 (0.0005) [2023-03-09 23:16:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 91942912. Throughput: 0: 9307.4. Samples: 91941596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:48,539][820373] Avg episode reward: [(0, '0.095')] [2023-03-09 23:16:49,444][820675] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-09 23:16:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 91992064. Throughput: 0: 9353.1. Samples: 91970836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:16:53,891][820675] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-09 23:16:58,248][820675] Updated weights for policy 0, policy_version 179760 (0.0004) [2023-03-09 23:16:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 92037120. Throughput: 0: 9326.7. Samples: 92025316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:16:58,539][820373] Avg episode reward: [(0, '5.300')] [2023-03-09 23:16:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179760_92037120.pth... [2023-03-09 23:16:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179216_91758592.pth [2023-03-09 23:17:02,640][820675] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-09 23:17:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 92086272. Throughput: 0: 9350.9. Samples: 92082120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:03,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:17:06,954][820675] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-09 23:17:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 92131328. Throughput: 0: 9375.5. Samples: 92110856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:08,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:17:11,548][820675] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-09 23:17:13,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 92176384. Throughput: 0: 9316.5. Samples: 92164168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:13,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:17:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180032_92176384.pth... [2023-03-09 23:17:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179488_91897856.pth [2023-03-09 23:17:15,945][820675] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-09 23:17:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 92225536. Throughput: 0: 9341.8. Samples: 92221440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:17:20,023][820675] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-09 23:17:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 92274688. Throughput: 0: 9452.3. Samples: 92253640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:23,539][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 23:17:24,403][820675] Updated weights for policy 0, policy_version 180240 (0.0004) [2023-03-09 23:17:28,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 92319744. Throughput: 0: 9388.9. Samples: 92308076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:28,540][820373] Avg episode reward: [(0, '0.116')] [2023-03-09 23:17:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180312_92319744.pth... [2023-03-09 23:17:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000179760_92037120.pth [2023-03-09 23:17:28,771][820675] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-09 23:17:32,908][820675] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-09 23:17:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 92368896. Throughput: 0: 9432.0. Samples: 92366036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:17:37,073][820675] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-09 23:17:38,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 92418048. Throughput: 0: 9441.9. Samples: 92395720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:17:41,236][820675] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-09 23:17:43,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 92467200. Throughput: 0: 9548.0. Samples: 92454976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:43,540][820373] Avg episode reward: [(0, '0.202')] [2023-03-09 23:17:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180600_92467200.pth... [2023-03-09 23:17:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180032_92176384.pth [2023-03-09 23:17:45,452][820675] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-09 23:17:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 92516352. Throughput: 0: 9568.2. Samples: 92512692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:48,540][820373] Avg episode reward: [(0, '0.008')] [2023-03-09 23:17:49,527][820675] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-09 23:17:53,396][820675] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-09 23:17:53,539][820373] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 92569600. Throughput: 0: 9649.6. Samples: 92545088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:53,539][820373] Avg episode reward: [(0, '0.141')] [2023-03-09 23:17:57,782][820675] Updated weights for policy 0, policy_version 180880 (0.0006) [2023-03-09 23:17:58,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 92614656. Throughput: 0: 9773.3. Samples: 92603968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:17:58,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:17:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180888_92614656.pth... [2023-03-09 23:17:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180312_92319744.pth [2023-03-09 23:18:02,310][820675] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-09 23:18:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 92659712. Throughput: 0: 9736.3. Samples: 92659572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:18:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:18:06,525][820675] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-09 23:18:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 92708864. Throughput: 0: 9634.6. Samples: 92687196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:18:08,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 23:18:10,624][820675] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-09 23:18:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9427.7). Total num frames: 92758016. Throughput: 0: 9750.3. Samples: 92746840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:18:13,539][820373] Avg episode reward: [(0, '0.073')] [2023-03-09 23:18:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181168_92758016.pth... [2023-03-09 23:18:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180600_92467200.pth [2023-03-09 23:18:15,083][820675] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-09 23:18:18,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9427.7). Total num frames: 92807168. Throughput: 0: 9711.8. Samples: 92803068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:18:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:18:19,360][820675] Updated weights for policy 0, policy_version 181280 (0.0006) [2023-03-09 23:18:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 92852224. Throughput: 0: 9690.9. Samples: 92831808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:23,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:18:23,647][820675] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-09 23:18:28,134][820675] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-09 23:18:28,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 92897280. Throughput: 0: 9617.3. Samples: 92887752. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:28,539][820373] Avg episode reward: [(0, '0.093')] [2023-03-09 23:18:28,566][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181448_92901376.pth... [2023-03-09 23:18:28,568][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000180888_92614656.pth [2023-03-09 23:18:32,505][820675] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-09 23:18:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 92946432. Throughput: 0: 9560.5. Samples: 92942912. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:33,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 23:18:36,842][820675] Updated weights for policy 0, policy_version 181600 (0.0004) [2023-03-09 23:18:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 92991488. Throughput: 0: 9501.4. Samples: 92972652. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:38,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 23:18:41,462][820675] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-09 23:18:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 93036544. Throughput: 0: 9352.4. Samples: 93024828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:18:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181712_93036544.pth... [2023-03-09 23:18:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181168_92758016.pth [2023-03-09 23:18:46,106][820675] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-09 23:18:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 93081600. Throughput: 0: 9350.0. Samples: 93080320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:18:50,240][820675] Updated weights for policy 0, policy_version 181840 (0.0004) [2023-03-09 23:18:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 93130752. Throughput: 0: 9393.3. Samples: 93109896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:53,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 23:18:54,743][820675] Updated weights for policy 0, policy_version 181920 (0.0004) [2023-03-09 23:18:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9386.1). Total num frames: 93175808. Throughput: 0: 9282.2. Samples: 93164540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:18:58,539][820373] Avg episode reward: [(0, '0.092')] [2023-03-09 23:18:58,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181984_93175808.pth... [2023-03-09 23:18:58,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181448_92901376.pth [2023-03-09 23:18:59,035][820675] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-09 23:19:03,277][820675] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-09 23:19:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 93224960. Throughput: 0: 9337.3. Samples: 93223248. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:19:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:19:07,638][820675] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-09 23:19:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 93274112. Throughput: 0: 9302.3. Samples: 93250412. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:19:08,539][820373] Avg episode reward: [(0, '0.061')] [2023-03-09 23:19:11,801][820675] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-09 23:19:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 93323264. Throughput: 0: 9382.5. Samples: 93309968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:19:13,540][820373] Avg episode reward: [(0, '0.077')] [2023-03-09 23:19:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182272_93323264.pth... [2023-03-09 23:19:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181712_93036544.pth [2023-03-09 23:19:15,906][820675] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-09 23:19:18,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 93372416. Throughput: 0: 9454.9. Samples: 93368384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:19:18,539][820373] Avg episode reward: [(0, '0.004')] [2023-03-09 23:19:20,167][820675] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-09 23:19:23,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 93417472. Throughput: 0: 9425.7. Samples: 93396808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 23:19:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:19:24,518][820675] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-09 23:19:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9427.7). Total num frames: 93466624. Throughput: 0: 9544.4. Samples: 93454328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:28,540][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:19:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182552_93466624.pth... [2023-03-09 23:19:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000181984_93175808.pth [2023-03-09 23:19:28,875][820675] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-09 23:19:33,220][820675] Updated weights for policy 0, policy_version 182640 (0.0004) [2023-03-09 23:19:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 93511680. Throughput: 0: 9567.2. Samples: 93510844. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:33,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:19:37,748][820675] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-09 23:19:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 93556736. Throughput: 0: 9502.6. Samples: 93537512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:19:42,143][820675] Updated weights for policy 0, policy_version 182800 (0.0006) [2023-03-09 23:19:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 93605888. Throughput: 0: 9533.8. Samples: 93593564. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:43,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 23:19:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182824_93605888.pth... [2023-03-09 23:19:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182272_93323264.pth [2023-03-09 23:19:46,502][820675] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-09 23:19:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 93650944. Throughput: 0: 9464.2. Samples: 93649136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:48,539][820373] Avg episode reward: [(0, '0.051')] [2023-03-09 23:19:50,846][820675] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-09 23:19:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 93696000. Throughput: 0: 9500.5. Samples: 93677936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:19:55,406][820675] Updated weights for policy 0, policy_version 183040 (0.0006) [2023-03-09 23:19:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9413.9). Total num frames: 93745152. Throughput: 0: 9396.8. Samples: 93732824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:19:58,539][820373] Avg episode reward: [(0, '0.298')] [2023-03-09 23:19:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183096_93745152.pth... [2023-03-09 23:19:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182552_93466624.pth [2023-03-09 23:19:59,688][820675] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-09 23:20:03,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 93790208. Throughput: 0: 9331.5. Samples: 93788304. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:20:04,103][820675] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-09 23:20:08,470][820675] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-09 23:20:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 93839360. Throughput: 0: 9342.6. Samples: 93817228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:08,539][820373] Avg episode reward: [(0, '0.034')] [2023-03-09 23:20:12,669][820675] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-09 23:20:13,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 93888512. Throughput: 0: 9362.6. Samples: 93875644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:13,550][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:20:13,554][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183376_93888512.pth... [2023-03-09 23:20:13,556][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000182824_93605888.pth [2023-03-09 23:20:16,758][820675] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-09 23:20:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 93933568. Throughput: 0: 9389.5. Samples: 93933372. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:18,539][820373] Avg episode reward: [(0, '0.080')] [2023-03-09 23:20:21,075][820675] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-09 23:20:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 93982720. Throughput: 0: 9438.4. Samples: 93962240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:20:25,610][820675] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-09 23:20:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 94027776. Throughput: 0: 9381.8. Samples: 94015744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:20:28,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:20:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183648_94027776.pth... [2023-03-09 23:20:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183096_93745152.pth [2023-03-09 23:20:30,173][820675] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-09 23:20:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 94072832. Throughput: 0: 9413.8. Samples: 94072756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:33,539][820373] Avg episode reward: [(0, '0.007')] [2023-03-09 23:20:34,358][820675] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-09 23:20:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 94121984. Throughput: 0: 9412.4. Samples: 94101496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:20:38,836][820675] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-09 23:20:43,458][820675] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-09 23:20:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 94167040. Throughput: 0: 9380.9. Samples: 94154964. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:20:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183920_94167040.pth... [2023-03-09 23:20:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183376_93888512.pth [2023-03-09 23:20:48,184][820675] Updated weights for policy 0, policy_version 184000 (0.0004) [2023-03-09 23:20:48,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 94208000. Throughput: 0: 9323.8. Samples: 94207876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:48,539][820373] Avg episode reward: [(0, '0.054')] [2023-03-09 23:20:52,610][820675] Updated weights for policy 0, policy_version 184080 (0.0004) [2023-03-09 23:20:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 94257152. Throughput: 0: 9293.7. Samples: 94235444. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:53,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:20:56,862][820675] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-09 23:20:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 94302208. Throughput: 0: 9254.1. Samples: 94292080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:20:58,539][820373] Avg episode reward: [(0, '2.273')] [2023-03-09 23:20:58,562][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184192_94306304.pth... [2023-03-09 23:20:58,564][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183648_94027776.pth [2023-03-09 23:21:01,001][820675] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-09 23:21:03,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 94355456. Throughput: 0: 9290.1. Samples: 94351424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:21:05,212][820675] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-09 23:21:08,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94400512. Throughput: 0: 9281.9. Samples: 94379924. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:08,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:21:09,595][820675] Updated weights for policy 0, policy_version 184400 (0.0006) [2023-03-09 23:21:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94449664. Throughput: 0: 9369.6. Samples: 94437376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:13,540][820373] Avg episode reward: [(0, '0.180')] [2023-03-09 23:21:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184472_94449664.pth... [2023-03-09 23:21:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000183920_94167040.pth [2023-03-09 23:21:13,916][820675] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-09 23:21:18,270][820675] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-09 23:21:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94494720. Throughput: 0: 9346.7. Samples: 94493360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:18,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:21:22,732][820675] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-09 23:21:23,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94543872. Throughput: 0: 9328.1. Samples: 94521260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:21:26,885][820675] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-09 23:21:28,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94588928. Throughput: 0: 9406.4. Samples: 94578252. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:28,540][820373] Avg episode reward: [(0, '0.081')] [2023-03-09 23:21:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184744_94588928.pth... [2023-03-09 23:21:28,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184192_94306304.pth [2023-03-09 23:21:31,156][820675] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-09 23:21:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 94638080. Throughput: 0: 9470.7. Samples: 94634056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 23:21:33,539][820373] Avg episode reward: [(0, '0.265')] [2023-03-09 23:21:35,909][820675] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-09 23:21:38,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 94679040. Throughput: 0: 9428.5. Samples: 94659724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:21:38,539][820373] Avg episode reward: [(0, '0.109')] [2023-03-09 23:21:40,302][820675] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-09 23:21:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 94732288. Throughput: 0: 9456.4. Samples: 94717620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:21:43,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:21:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185024_94732288.pth... [2023-03-09 23:21:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184472_94449664.pth [2023-03-09 23:21:44,271][820675] Updated weights for policy 0, policy_version 185040 (0.0004) [2023-03-09 23:21:48,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 94777344. Throughput: 0: 9461.0. Samples: 94777172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:21:48,539][820373] Avg episode reward: [(0, '5.859')] [2023-03-09 23:21:48,544][820675] Updated weights for policy 0, policy_version 185120 (0.0004) [2023-03-09 23:21:52,889][820675] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-09 23:21:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 94826496. Throughput: 0: 9467.8. Samples: 94805976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:21:53,539][820373] Avg episode reward: [(0, '0.271')] [2023-03-09 23:21:57,316][820675] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-09 23:21:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 94871552. Throughput: 0: 9412.9. Samples: 94860956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:21:58,539][820373] Avg episode reward: [(0, '0.209')] [2023-03-09 23:21:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185296_94871552.pth... [2023-03-09 23:21:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000184744_94588928.pth [2023-03-09 23:22:01,775][820675] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-09 23:22:03,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 94916608. Throughput: 0: 9396.7. Samples: 94916212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:06,308][820675] Updated weights for policy 0, policy_version 185440 (0.0004) [2023-03-09 23:22:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 94965760. Throughput: 0: 9378.6. Samples: 94943296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:08,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:22:10,574][820675] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-09 23:22:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 95010816. Throughput: 0: 9351.0. Samples: 94999048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185568_95010816.pth... [2023-03-09 23:22:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185024_94732288.pth [2023-03-09 23:22:14,806][820675] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-09 23:22:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 95059968. Throughput: 0: 9388.0. Samples: 95056516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:18,539][820373] Avg episode reward: [(0, '0.447')] [2023-03-09 23:22:19,252][820675] Updated weights for policy 0, policy_version 185680 (0.0004) [2023-03-09 23:22:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 95105024. Throughput: 0: 9438.1. Samples: 95084440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:23,539][820373] Avg episode reward: [(0, '0.452')] [2023-03-09 23:22:23,847][820675] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-09 23:22:28,018][820675] Updated weights for policy 0, policy_version 185840 (0.0004) [2023-03-09 23:22:28,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 95154176. Throughput: 0: 9408.6. Samples: 95141008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:28,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:28,546][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185848_95154176.pth... [2023-03-09 23:22:28,549][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185296_94871552.pth [2023-03-09 23:22:32,599][820675] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-09 23:22:33,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 95195136. Throughput: 0: 9288.3. Samples: 95195144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:37,025][820675] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-09 23:22:38,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 95248384. Throughput: 0: 9282.8. Samples: 95223700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:38,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:22:41,176][820675] Updated weights for policy 0, policy_version 186080 (0.0005) [2023-03-09 23:22:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 95289344. Throughput: 0: 9336.5. Samples: 95281100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:22:43,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:22:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186112_95289344.pth... [2023-03-09 23:22:43,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185568_95010816.pth [2023-03-09 23:22:45,974][820675] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-09 23:22:48,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 95334400. Throughput: 0: 9249.9. Samples: 95332460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:22:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:50,446][820675] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-09 23:22:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 95379456. Throughput: 0: 9273.8. Samples: 95360616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:22:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:22:54,974][820675] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-09 23:22:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 95424512. Throughput: 0: 9246.7. Samples: 95415152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:22:58,539][820373] Avg episode reward: [(0, '0.049')] [2023-03-09 23:22:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186376_95424512.pth... [2023-03-09 23:22:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000185848_95154176.pth [2023-03-09 23:22:59,422][820675] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-09 23:23:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 95473664. Throughput: 0: 9178.8. Samples: 95469564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:03,539][820373] Avg episode reward: [(0, '7.907')] [2023-03-09 23:23:03,923][820675] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-09 23:23:08,281][820675] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-09 23:23:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 95518720. Throughput: 0: 9195.5. Samples: 95498240. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:23:12,563][820675] Updated weights for policy 0, policy_version 186640 (0.0005) [2023-03-09 23:23:13,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9358.3). Total num frames: 95567872. Throughput: 0: 9210.6. Samples: 95555484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:13,540][820373] Avg episode reward: [(0, '0.147')] [2023-03-09 23:23:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186656_95567872.pth... [2023-03-09 23:23:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186112_95289344.pth [2023-03-09 23:23:16,846][820675] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-09 23:23:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 95612928. Throughput: 0: 9271.9. Samples: 95612380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:23:21,088][820675] Updated weights for policy 0, policy_version 186800 (0.0005) [2023-03-09 23:23:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 95662080. Throughput: 0: 9286.7. Samples: 95641600. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:23,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:23:25,469][820675] Updated weights for policy 0, policy_version 186880 (0.0006) [2023-03-09 23:23:28,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 95711232. Throughput: 0: 9286.8. Samples: 95699008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:28,539][820373] Avg episode reward: [(0, '0.334')] [2023-03-09 23:23:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186936_95711232.pth... [2023-03-09 23:23:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186376_95424512.pth [2023-03-09 23:23:29,560][820675] Updated weights for policy 0, policy_version 186960 (0.0004) [2023-03-09 23:23:33,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 95760384. Throughput: 0: 9421.2. Samples: 95756412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:33,539][820373] Avg episode reward: [(0, '0.084')] [2023-03-09 23:23:33,733][820675] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-09 23:23:38,235][820675] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-09 23:23:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 95805440. Throughput: 0: 9447.8. Samples: 95785768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:38,539][820373] Avg episode reward: [(0, '0.051')] [2023-03-09 23:23:42,499][820675] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-09 23:23:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 95854592. Throughput: 0: 9493.9. Samples: 95842376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:23:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187216_95854592.pth... [2023-03-09 23:23:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186656_95567872.pth [2023-03-09 23:23:46,775][820675] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-09 23:23:48,539][820373] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 95903744. Throughput: 0: 9595.5. Samples: 95901360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:23:50,980][820675] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-09 23:23:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 95948800. Throughput: 0: 9565.8. Samples: 95928700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:23:55,335][820675] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-09 23:23:58,539][820373] Fps is (10 sec: 9420.6, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 95997952. Throughput: 0: 9559.6. Samples: 95985664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:23:58,540][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:23:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187496_95997952.pth... [2023-03-09 23:23:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000186936_95711232.pth [2023-03-09 23:23:59,810][820675] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-09 23:24:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 96047104. Throughput: 0: 9569.5. Samples: 96043008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:03,539][820373] Avg episode reward: [(0, '0.006')] [2023-03-09 23:24:03,929][820675] Updated weights for policy 0, policy_version 187600 (0.0004) [2023-03-09 23:24:08,412][820675] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-09 23:24:08,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 96092160. Throughput: 0: 9553.5. Samples: 96071508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:08,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:24:12,763][820675] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-09 23:24:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 96137216. Throughput: 0: 9516.4. Samples: 96127244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:13,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:24:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187768_96137216.pth... [2023-03-09 23:24:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187216_95854592.pth [2023-03-09 23:24:17,235][820675] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-09 23:24:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 96186368. Throughput: 0: 9463.0. Samples: 96182248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:18,539][820373] Avg episode reward: [(0, '0.059')] [2023-03-09 23:24:21,723][820675] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-09 23:24:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 96227328. Throughput: 0: 9431.0. Samples: 96210164. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:23,539][820373] Avg episode reward: [(0, '0.024')] [2023-03-09 23:24:26,334][820675] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-09 23:24:28,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 96272384. Throughput: 0: 9341.6. Samples: 96262748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:28,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:24:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188032_96272384.pth... [2023-03-09 23:24:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187496_95997952.pth [2023-03-09 23:24:30,879][820675] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-09 23:24:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 96321536. Throughput: 0: 9247.6. Samples: 96317504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:33,539][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:24:35,026][820675] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-09 23:24:38,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 96370688. Throughput: 0: 9341.4. Samples: 96349064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:38,540][820373] Avg episode reward: [(0, '0.097')] [2023-03-09 23:24:39,367][820675] Updated weights for policy 0, policy_version 188240 (0.0004) [2023-03-09 23:24:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 96415744. Throughput: 0: 9284.5. Samples: 96403464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:43,539][820373] Avg episode reward: [(0, '0.033')] [2023-03-09 23:24:43,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188312_96415744.pth... [2023-03-09 23:24:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000187768_96137216.pth [2023-03-09 23:24:43,796][820675] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-09 23:24:48,286][820675] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-09 23:24:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.2, 300 sec: 9372.2). Total num frames: 96460800. Throughput: 0: 9253.3. Samples: 96459408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:48,539][820373] Avg episode reward: [(0, '0.012')] [2023-03-09 23:24:52,610][820675] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-09 23:24:53,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 96509952. Throughput: 0: 9214.1. Samples: 96486144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:24:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:24:56,835][820675] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-09 23:24:58,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 96555008. Throughput: 0: 9283.6. Samples: 96545008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:24:58,539][820373] Avg episode reward: [(0, '0.066')] [2023-03-09 23:24:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188584_96555008.pth... [2023-03-09 23:24:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188032_96272384.pth [2023-03-09 23:25:01,222][820675] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-09 23:25:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9372.2). Total num frames: 96604160. Throughput: 0: 9289.4. Samples: 96600272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:25:05,561][820675] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-09 23:25:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 96649216. Throughput: 0: 9307.0. Samples: 96628980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:25:10,020][820675] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-09 23:25:13,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 96694272. Throughput: 0: 9328.6. Samples: 96682536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:13,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:25:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188856_96694272.pth... [2023-03-09 23:25:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188312_96415744.pth [2023-03-09 23:25:14,922][820675] Updated weights for policy 0, policy_version 188880 (0.0004) [2023-03-09 23:25:18,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 96739328. Throughput: 0: 9283.0. Samples: 96735240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:18,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 23:25:19,320][820675] Updated weights for policy 0, policy_version 188960 (0.0006) [2023-03-09 23:25:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 96784384. Throughput: 0: 9221.1. Samples: 96764016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:23,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:25:23,729][820675] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-09 23:25:28,000][820675] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-09 23:25:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 96833536. Throughput: 0: 9275.4. Samples: 96820856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:28,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:25:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189128_96833536.pth... [2023-03-09 23:25:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188584_96555008.pth [2023-03-09 23:25:32,442][820675] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-09 23:25:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 96878592. Throughput: 0: 9239.6. Samples: 96875188. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:33,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 23:25:37,174][820675] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-09 23:25:38,539][820373] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 96919552. Throughput: 0: 9228.4. Samples: 96901420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:38,539][820373] Avg episode reward: [(0, '0.027')] [2023-03-09 23:25:41,678][820675] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-09 23:25:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 96968704. Throughput: 0: 9140.2. Samples: 96956316. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:43,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:25:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189392_96968704.pth... [2023-03-09 23:25:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000188856_96694272.pth [2023-03-09 23:25:46,261][820675] Updated weights for policy 0, policy_version 189440 (0.0004) [2023-03-09 23:25:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 97013760. Throughput: 0: 9109.4. Samples: 97010196. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:25:50,534][820675] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-09 23:25:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 97058816. Throughput: 0: 9101.0. Samples: 97038524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:25:55,100][820675] Updated weights for policy 0, policy_version 189600 (0.0004) [2023-03-09 23:25:58,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.8, 300 sec: 9316.7). Total num frames: 97103872. Throughput: 0: 9094.1. Samples: 97091768. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 23:25:58,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:25:58,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189656_97103872.pth... [2023-03-09 23:25:58,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189128_96833536.pth [2023-03-09 23:25:59,523][820675] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-09 23:26:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 97153024. Throughput: 0: 9195.2. Samples: 97149024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:03,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:26:03,933][820675] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-09 23:26:08,302][820675] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-09 23:26:08,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 97198080. Throughput: 0: 9187.7. Samples: 97177460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:08,539][820373] Avg episode reward: [(0, '0.032')] [2023-03-09 23:26:12,481][820675] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-09 23:26:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 97247232. Throughput: 0: 9206.3. Samples: 97235140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:13,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:26:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189936_97247232.pth... [2023-03-09 23:26:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189392_96968704.pth [2023-03-09 23:26:16,637][820675] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-09 23:26:18,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 97296384. Throughput: 0: 9303.9. Samples: 97293864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:26:20,578][820675] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-09 23:26:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 97345536. Throughput: 0: 9422.4. Samples: 97325428. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:23,539][820373] Avg episode reward: [(0, '0.107')] [2023-03-09 23:26:24,795][820675] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-09 23:26:28,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 97394688. Throughput: 0: 9501.1. Samples: 97383864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:28,540][820373] Avg episode reward: [(0, '0.120')] [2023-03-09 23:26:28,550][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190232_97398784.pth... [2023-03-09 23:26:28,552][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189656_97103872.pth [2023-03-09 23:26:28,913][820675] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-09 23:26:33,256][820675] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-09 23:26:33,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 97443840. Throughput: 0: 9618.4. Samples: 97443024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:33,539][820373] Avg episode reward: [(0, '6.350')] [2023-03-09 23:26:37,654][820675] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-09 23:26:38,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 97488896. Throughput: 0: 9583.8. Samples: 97469796. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:26:42,078][820675] Updated weights for policy 0, policy_version 190480 (0.0005) [2023-03-09 23:26:43,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 97538048. Throughput: 0: 9644.2. Samples: 97525760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:26:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190504_97538048.pth... [2023-03-09 23:26:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000189936_97247232.pth [2023-03-09 23:26:46,498][820675] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-09 23:26:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 97583104. Throughput: 0: 9601.9. Samples: 97581108. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:48,540][820373] Avg episode reward: [(0, '0.094')] [2023-03-09 23:26:50,948][820675] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-09 23:26:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 97628160. Throughput: 0: 9577.1. Samples: 97608428. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:53,539][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 23:26:55,254][820675] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-09 23:26:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 97677312. Throughput: 0: 9553.0. Samples: 97665024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:26:58,540][820373] Avg episode reward: [(0, '0.048')] [2023-03-09 23:26:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190776_97677312.pth... [2023-03-09 23:26:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190232_97398784.pth [2023-03-09 23:26:59,803][820675] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-09 23:27:03,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 97722368. Throughput: 0: 9512.3. Samples: 97721916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 23:27:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:27:04,071][820675] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-09 23:27:08,240][820675] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-09 23:27:08,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 97771520. Throughput: 0: 9445.5. Samples: 97750476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:08,539][820373] Avg episode reward: [(0, '0.104')] [2023-03-09 23:27:12,628][820675] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-09 23:27:13,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 97820672. Throughput: 0: 9423.0. Samples: 97807900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:13,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:27:13,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191056_97820672.pth... [2023-03-09 23:27:13,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190504_97538048.pth [2023-03-09 23:27:17,013][820675] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-09 23:27:18,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 97865728. Throughput: 0: 9304.0. Samples: 97861704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:18,540][820373] Avg episode reward: [(0, '0.003')] [2023-03-09 23:27:21,432][820675] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-09 23:27:23,539][820373] Fps is (10 sec: 9011.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 97910784. Throughput: 0: 9346.2. Samples: 97890376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:23,539][820373] Avg episode reward: [(0, '0.337')] [2023-03-09 23:27:25,754][820675] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-09 23:27:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 97959936. Throughput: 0: 9368.0. Samples: 97947320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:28,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 23:27:28,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191328_97959936.pth... [2023-03-09 23:27:28,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000190776_97677312.pth [2023-03-09 23:27:30,313][820675] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-09 23:27:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 98004992. Throughput: 0: 9340.9. Samples: 98001448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:33,539][820373] Avg episode reward: [(0, '1.053')] [2023-03-09 23:27:34,672][820675] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-09 23:27:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 98054144. Throughput: 0: 9358.8. Samples: 98029576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:38,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:27:38,930][820675] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-09 23:27:43,111][820675] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-09 23:27:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 98099200. Throughput: 0: 9423.8. Samples: 98089096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:27:43,573][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191608_98103296.pth... [2023-03-09 23:27:43,575][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191056_97820672.pth [2023-03-09 23:27:47,272][820675] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-09 23:27:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 98152448. Throughput: 0: 9474.3. Samples: 98148260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:48,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:27:51,692][820675] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-09 23:27:53,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 98197504. Throughput: 0: 9453.0. Samples: 98175860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:53,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:27:56,133][820675] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-09 23:27:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 98242560. Throughput: 0: 9414.0. Samples: 98231528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:27:58,539][820373] Avg episode reward: [(0, '0.018')] [2023-03-09 23:27:58,590][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191888_98246656.pth... [2023-03-09 23:27:58,592][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191328_97959936.pth [2023-03-09 23:28:00,253][820675] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-09 23:28:03,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 98295808. Throughput: 0: 9557.2. Samples: 98291776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:03,540][820373] Avg episode reward: [(0, '3.205')] [2023-03-09 23:28:04,337][820675] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-09 23:28:08,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 98340864. Throughput: 0: 9555.7. Samples: 98320384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:08,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:28:08,745][820675] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-09 23:28:13,118][820675] Updated weights for policy 0, policy_version 192160 (0.0004) [2023-03-09 23:28:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 98390016. Throughput: 0: 9541.3. Samples: 98376680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:13,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 23:28:13,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192168_98390016.pth... [2023-03-09 23:28:13,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191608_98103296.pth [2023-03-09 23:28:17,601][820675] Updated weights for policy 0, policy_version 192240 (0.0006) [2023-03-09 23:28:18,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 98435072. Throughput: 0: 9545.6. Samples: 98431000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:18,539][820373] Avg episode reward: [(0, '0.015')] [2023-03-09 23:28:22,123][820675] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-09 23:28:23,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 98480128. Throughput: 0: 9547.6. Samples: 98459216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:28:26,381][820675] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-09 23:28:28,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 98525184. Throughput: 0: 9468.0. Samples: 98515156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:28,539][820373] Avg episode reward: [(0, '0.005')] [2023-03-09 23:28:28,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192432_98525184.pth... [2023-03-09 23:28:28,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000191888_98246656.pth [2023-03-09 23:28:30,908][820675] Updated weights for policy 0, policy_version 192480 (0.0004) [2023-03-09 23:28:33,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 98574336. Throughput: 0: 9378.8. Samples: 98570304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:33,540][820373] Avg episode reward: [(0, '0.082')] [2023-03-09 23:28:35,220][820675] Updated weights for policy 0, policy_version 192560 (0.0004) [2023-03-09 23:28:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 98619392. Throughput: 0: 9398.2. Samples: 98598780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:38,540][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:28:39,815][820675] Updated weights for policy 0, policy_version 192640 (0.0004) [2023-03-09 23:28:43,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 98664448. Throughput: 0: 9360.3. Samples: 98652744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:43,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:28:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192704_98664448.pth... [2023-03-09 23:28:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192168_98390016.pth [2023-03-09 23:28:44,269][820675] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-09 23:28:48,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 98709504. Throughput: 0: 9207.8. Samples: 98706128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:28:48,959][820675] Updated weights for policy 0, policy_version 192800 (0.0004) [2023-03-09 23:28:53,365][820675] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-09 23:28:53,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 98754560. Throughput: 0: 9173.5. Samples: 98733192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:53,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:28:57,410][820675] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-09 23:28:58,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 98803712. Throughput: 0: 9233.2. Samples: 98792176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:28:58,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:28:58,544][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192976_98803712.pth... [2023-03-09 23:28:58,547][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192432_98525184.pth [2023-03-09 23:29:01,677][820675] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-09 23:29:03,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 98848768. Throughput: 0: 9283.9. Samples: 98848776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:03,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:06,289][820675] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-09 23:29:08,539][820373] Fps is (10 sec: 9421.0, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 98897920. Throughput: 0: 9250.1. Samples: 98875472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:08,539][820373] Avg episode reward: [(0, '0.002')] [2023-03-09 23:29:10,649][820675] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-09 23:29:13,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 98942976. Throughput: 0: 9239.1. Samples: 98930916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:13,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:29:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193248_98942976.pth... [2023-03-09 23:29:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192704_98664448.pth [2023-03-09 23:29:14,970][820675] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-09 23:29:18,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 98992128. Throughput: 0: 9284.3. Samples: 98988096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:18,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:19,303][820675] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-09 23:29:23,336][820675] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-09 23:29:23,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 99041280. Throughput: 0: 9351.1. Samples: 99019580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:23,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:27,626][820675] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-09 23:29:28,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 99086336. Throughput: 0: 9451.6. Samples: 99078064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:28,539][820373] Avg episode reward: [(0, '0.063')] [2023-03-09 23:29:28,541][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193528_99086336.pth... [2023-03-09 23:29:28,543][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000192976_98803712.pth [2023-03-09 23:29:32,114][820675] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-09 23:29:33,539][820373] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 99135488. Throughput: 0: 9463.2. Samples: 99131972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:33,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:36,498][820675] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-09 23:29:38,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 99180544. Throughput: 0: 9485.3. Samples: 99160032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:38,539][820373] Avg episode reward: [(0, '0.030')] [2023-03-09 23:29:40,888][820675] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-09 23:29:43,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99229696. Throughput: 0: 9414.2. Samples: 99215812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:43,540][820373] Avg episode reward: [(0, '0.019')] [2023-03-09 23:29:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193808_99229696.pth... [2023-03-09 23:29:43,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193248_98942976.pth [2023-03-09 23:29:45,326][820675] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-09 23:29:48,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 99274752. Throughput: 0: 9410.2. Samples: 99272236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:48,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:49,616][820675] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-09 23:29:53,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 99319808. Throughput: 0: 9419.0. Samples: 99299328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:29:54,313][820675] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-09 23:29:58,539][820373] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 99364864. Throughput: 0: 9371.6. Samples: 99352640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:29:58,540][820373] Avg episode reward: [(0, '0.050')] [2023-03-09 23:29:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194072_99364864.pth... [2023-03-09 23:29:58,546][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193528_99086336.pth [2023-03-09 23:29:58,847][820675] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-09 23:30:03,303][820675] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-09 23:30:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 99409920. Throughput: 0: 9330.0. Samples: 99407944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:03,539][820373] Avg episode reward: [(0, '0.065')] [2023-03-09 23:30:07,965][820675] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-09 23:30:08,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 99454976. Throughput: 0: 9222.0. Samples: 99434568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:08,539][820373] Avg episode reward: [(0, '0.047')] [2023-03-09 23:30:12,724][820675] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-09 23:30:13,539][820373] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 99495936. Throughput: 0: 9087.1. Samples: 99486984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:13,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:13,542][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194328_99495936.pth... [2023-03-09 23:30:13,544][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000193808_99229696.pth [2023-03-09 23:30:17,037][820675] Updated weights for policy 0, policy_version 194400 (0.0006) [2023-03-09 23:30:18,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 99545088. Throughput: 0: 9119.9. Samples: 99542368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:18,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:21,447][820675] Updated weights for policy 0, policy_version 194480 (0.0006) [2023-03-09 23:30:23,539][820373] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 99590144. Throughput: 0: 9104.3. Samples: 99569728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:23,539][820373] Avg episode reward: [(0, '0.175')] [2023-03-09 23:30:25,994][820675] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-09 23:30:28,539][820373] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 99635200. Throughput: 0: 9077.0. Samples: 99624276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:28,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:28,567][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194608_99639296.pth... [2023-03-09 23:30:28,568][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194072_99364864.pth [2023-03-09 23:30:30,358][820675] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-09 23:30:33,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9372.2). Total num frames: 99684352. Throughput: 0: 9132.2. Samples: 99683184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:33,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:34,574][820675] Updated weights for policy 0, policy_version 194720 (0.0005) [2023-03-09 23:30:38,539][820373] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 99733504. Throughput: 0: 9141.4. Samples: 99710692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:38,540][820373] Avg episode reward: [(0, '0.031')] [2023-03-09 23:30:38,637][820675] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-09 23:30:43,032][820675] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-09 23:30:43,539][820373] Fps is (10 sec: 9830.2, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 99782656. Throughput: 0: 9271.4. Samples: 99769852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:43,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:43,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194888_99782656.pth... [2023-03-09 23:30:43,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194328_99495936.pth [2023-03-09 23:30:47,095][820675] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-09 23:30:48,539][820373] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 99831808. Throughput: 0: 9387.8. Samples: 99830396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:48,539][820373] Avg episode reward: [(0, '0.001')] [2023-03-09 23:30:51,477][820675] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-09 23:30:53,539][820373] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 99876864. Throughput: 0: 9380.7. Samples: 99856700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:53,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:55,980][820675] Updated weights for policy 0, policy_version 195120 (0.0005) [2023-03-09 23:30:58,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 99921920. Throughput: 0: 9434.8. Samples: 99911552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:30:58,539][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:30:58,543][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000195160_99921920.pth... [2023-03-09 23:30:58,545][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194608_99639296.pth [2023-03-09 23:31:00,473][820675] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-09 23:31:03,539][820373] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 99966976. Throughput: 0: 9436.0. Samples: 99966988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 23:31:03,540][820373] Avg episode reward: [(0, '0.000')] [2023-03-09 23:31:04,886][820675] Updated weights for policy 0, policy_version 195280 (0.0006) [2023-03-09 23:31:07,047][820631] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-09 23:31:07,447][820631] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-09 23:31:07,447][820679] Stopping RolloutWorker_w2... [2023-03-09 23:31:07,448][820743] Stopping RolloutWorker_w5... [2023-03-09 23:31:07,448][820678] Stopping RolloutWorker_w3... [2023-03-09 23:31:07,448][820677] Stopping RolloutWorker_w1... [2023-03-09 23:31:07,448][820680] Stopping RolloutWorker_w4... [2023-03-09 23:31:07,448][820806] Stopping RolloutWorker_w7... [2023-03-09 23:31:07,448][820679] Loop rollout_proc2_evt_loop terminating... [2023-03-09 23:31:07,448][820743] Loop rollout_proc5_evt_loop terminating... [2023-03-09 23:31:07,448][820807] Stopping RolloutWorker_w6... [2023-03-09 23:31:07,448][820678] Loop rollout_proc3_evt_loop terminating... [2023-03-09 23:31:07,448][820676] Stopping RolloutWorker_w0... [2023-03-09 23:31:07,448][820677] Loop rollout_proc1_evt_loop terminating... [2023-03-09 23:31:07,448][820631] Stopping Batcher_0... [2023-03-09 23:31:07,448][820680] Loop rollout_proc4_evt_loop terminating... [2023-03-09 23:31:07,448][820373] Component RolloutWorker_w2 stopped! [2023-03-09 23:31:07,448][820806] Loop rollout_proc7_evt_loop terminating... [2023-03-09 23:31:07,448][820807] Loop rollout_proc6_evt_loop terminating... [2023-03-09 23:31:07,448][820631] Loop batcher_evt_loop terminating... [2023-03-09 23:31:07,448][820676] Loop rollout_proc0_evt_loop terminating... [2023-03-09 23:31:07,448][820373] Component RolloutWorker_w4 stopped! [2023-03-09 23:31:07,448][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-09 23:31:07,449][820373] Component RolloutWorker_w5 stopped! [2023-03-09 23:31:07,449][820373] Component RolloutWorker_w1 stopped! [2023-03-09 23:31:07,449][820373] Component RolloutWorker_w3 stopped! [2023-03-09 23:31:07,449][820373] Component RolloutWorker_w7 stopped! [2023-03-09 23:31:07,449][820373] Component RolloutWorker_w6 stopped! [2023-03-09 23:31:07,449][820373] Component Batcher_0 stopped! [2023-03-09 23:31:07,450][820373] Component RolloutWorker_w0 stopped! [2023-03-09 23:31:07,451][820631] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000194888_99782656.pth [2023-03-09 23:31:07,451][820631] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/pick-place-wall-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-09 23:31:07,454][820631] Stopping LearnerWorker_p0... [2023-03-09 23:31:07,454][820631] Loop learner_proc0_evt_loop terminating... [2023-03-09 23:31:07,454][820373] Component LearnerWorker_p0 stopped! [2023-03-09 23:31:07,501][820675] Weights refcount: 2 0 [2023-03-09 23:31:07,502][820675] Stopping InferenceWorker_p0-w0... [2023-03-09 23:31:07,503][820675] Loop inference_proc0-0_evt_loop terminating... [2023-03-09 23:31:07,503][820373] Component InferenceWorker_p0-w0 stopped! [2023-03-09 23:31:07,503][820373] Waiting for process learner_proc0 to stop... [2023-03-09 23:31:07,972][820373] Waiting for process inference_proc0-0 to join... [2023-03-09 23:31:08,012][820373] Waiting for process rollout_proc0 to join... [2023-03-09 23:31:08,012][820373] Waiting for process rollout_proc1 to join... [2023-03-09 23:31:08,013][820373] Waiting for process rollout_proc2 to join... [2023-03-09 23:31:08,013][820373] Waiting for process rollout_proc3 to join... [2023-03-09 23:31:08,013][820373] Waiting for process rollout_proc4 to join... [2023-03-09 23:31:08,014][820373] Waiting for process rollout_proc5 to join... [2023-03-09 23:31:08,014][820373] Waiting for process rollout_proc6 to join... [2023-03-09 23:31:08,014][820373] Waiting for process rollout_proc7 to join... [2023-03-09 23:31:08,015][820373] Batcher 0 profile tree view: batching: 17.7422, releasing_batches: 15.1311 [2023-03-09 23:31:08,015][820373] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0052 wait_policy_total: 3904.2469 update_model: 116.4124 weight_update: 0.0005 one_step: 0.0006 handle_policy_step: 5935.7681 deserialize: 245.3883, stack: 61.9350, obs_to_device_normalize: 1047.0882, forward: 2961.0858, send_messages: 459.7728 prepare_outputs: 642.9471 to_cpu: 99.2280 [2023-03-09 23:31:08,015][820373] Learner 0 profile tree view: misc: 0.0921, prepare_batch: 81.2863 train: 1043.1370 epoch_init: 0.3739, minibatch_init: 11.0654, losses_postprocess: 12.5668, kl_divergence: 3.9797, after_optimizer: 5.7757 calculate_losses: 425.3060 losses_init: 0.3507, forward_head: 204.9192, bptt_initial: 1.1722, bptt: 1.3620, tail: 104.7597, advantages_returns: 8.5704, losses: 91.3847 update: 569.5755 clip: 51.9718 [2023-03-09 23:31:08,015][820373] RolloutWorker_w0 profile tree view: wait_for_trajectories: 4.4985, enqueue_policy_requests: 162.5384, env_step: 6242.2414, overhead: 336.3842, complete_rollouts: 3.8263 save_policy_outputs: 374.4954 split_output_tensors: 183.0336 [2023-03-09 23:31:08,016][820373] RolloutWorker_w7 profile tree view: wait_for_trajectories: 4.2649, enqueue_policy_requests: 165.0089, env_step: 6257.4788, overhead: 342.4090, complete_rollouts: 3.8236 save_policy_outputs: 377.0048 split_output_tensors: 184.3826 [2023-03-09 23:31:08,016][820373] Loop Runner_EvtLoop terminating... [2023-03-09 23:31:08,016][820373] Runner profile tree view: main_loop: 10687.1545 [2023-03-09 23:31:08,016][820373] Collected {0: 100007936}, FPS: 9357.8