[2023-03-12 04:28:30,254][146380] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/config.json... [2023-03-12 04:28:30,268][146380] Rollout worker 0 uses device cpu [2023-03-12 04:28:30,268][146380] Rollout worker 1 uses device cpu [2023-03-12 04:28:30,268][146380] Rollout worker 2 uses device cpu [2023-03-12 04:28:30,269][146380] Rollout worker 3 uses device cpu [2023-03-12 04:28:30,269][146380] Rollout worker 4 uses device cpu [2023-03-12 04:28:30,269][146380] Rollout worker 5 uses device cpu [2023-03-12 04:28:30,269][146380] Rollout worker 6 uses device cpu [2023-03-12 04:28:30,269][146380] Rollout worker 7 uses device cpu [2023-03-12 04:28:30,269][146380] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-12 04:28:30,280][146380] InferenceWorker_p0-w0: min num requests: 2 [2023-03-12 04:28:30,296][146380] Starting all processes... [2023-03-12 04:28:30,296][146380] Starting process learner_proc0 [2023-03-12 04:28:30,346][146380] Starting all processes... [2023-03-12 04:28:30,383][146380] Starting process inference_proc0-0 [2023-03-12 04:28:30,383][146380] Starting process rollout_proc0 [2023-03-12 04:28:30,383][146380] Starting process rollout_proc1 [2023-03-12 04:28:30,383][146380] Starting process rollout_proc2 [2023-03-12 04:28:30,383][146380] Starting process rollout_proc3 [2023-03-12 04:28:30,384][146380] Starting process rollout_proc4 [2023-03-12 04:28:30,384][146380] Starting process rollout_proc5 [2023-03-12 04:28:30,384][146380] Starting process rollout_proc6 [2023-03-12 04:28:30,384][146380] Starting process rollout_proc7 [2023-03-12 04:28:31,785][146623] Starting seed is not provided [2023-03-12 04:28:31,785][146623] Initializing actor-critic model on device cpu [2023-03-12 04:28:31,785][146623] RunningMeanStd input shape: (39,) [2023-03-12 04:28:31,786][146623] RunningMeanStd input shape: (1,) [2023-03-12 04:28:31,879][146623] Created Actor Critic model with architecture: [2023-03-12 04:28:31,879][146623] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-12 04:28:31,900][146737] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-12 04:28:31,927][146668] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-12 04:28:32,097][146674] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-12 04:28:32,100][146670] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-12 04:28:32,176][146623] Using optimizer [2023-03-12 04:28:32,177][146623] No checkpoints found [2023-03-12 04:28:32,177][146623] Did not load from checkpoint, starting from scratch! [2023-03-12 04:28:32,177][146623] Initialized policy 0 weights for model version 0 [2023-03-12 04:28:32,178][146623] LearnerWorker_p0 finished initialization! [2023-03-12 04:28:32,241][146667] RunningMeanStd input shape: (39,) [2023-03-12 04:28:32,241][146667] RunningMeanStd input shape: (1,) [2023-03-12 04:28:32,264][146673] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-12 04:28:32,298][146380] Inference worker 0-0 is ready! [2023-03-12 04:28:32,298][146380] All inference workers are ready! Signal rollout workers to start! [2023-03-12 04:28:32,389][146669] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-12 04:28:32,471][146671] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-12 04:28:32,558][146672] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-12 04:28:32,719][146380] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 04:28:37,719][146380] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 04:28:37,900][146670] Decorrelating experience for 0 frames... [2023-03-12 04:28:37,907][146737] Decorrelating experience for 0 frames... [2023-03-12 04:28:37,909][146674] Decorrelating experience for 0 frames... [2023-03-12 04:28:37,916][146668] Decorrelating experience for 0 frames... [2023-03-12 04:28:37,923][146670] Decorrelating experience for 64 frames... [2023-03-12 04:28:37,930][146737] Decorrelating experience for 64 frames... [2023-03-12 04:28:37,931][146674] Decorrelating experience for 64 frames... [2023-03-12 04:28:37,938][146668] Decorrelating experience for 64 frames... [2023-03-12 04:28:37,939][146673] Decorrelating experience for 0 frames... [2023-03-12 04:28:37,961][146673] Decorrelating experience for 64 frames... [2023-03-12 04:28:37,973][146670] Decorrelating experience for 128 frames... [2023-03-12 04:28:37,979][146737] Decorrelating experience for 128 frames... [2023-03-12 04:28:37,981][146674] Decorrelating experience for 128 frames... [2023-03-12 04:28:37,988][146668] Decorrelating experience for 128 frames... [2023-03-12 04:28:38,011][146673] Decorrelating experience for 128 frames... [2023-03-12 04:28:38,049][146670] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,050][146669] Decorrelating experience for 0 frames... [2023-03-12 04:28:38,057][146737] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,057][146674] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,064][146668] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,072][146669] Decorrelating experience for 64 frames... [2023-03-12 04:28:38,087][146673] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,112][146671] Decorrelating experience for 0 frames... [2023-03-12 04:28:38,121][146669] Decorrelating experience for 128 frames... [2023-03-12 04:28:38,135][146671] Decorrelating experience for 64 frames... [2023-03-12 04:28:38,184][146671] Decorrelating experience for 128 frames... [2023-03-12 04:28:38,198][146669] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,211][146672] Decorrelating experience for 0 frames... [2023-03-12 04:28:38,233][146672] Decorrelating experience for 64 frames... [2023-03-12 04:28:38,261][146671] Decorrelating experience for 192 frames... [2023-03-12 04:28:38,283][146672] Decorrelating experience for 128 frames... [2023-03-12 04:28:38,360][146672] Decorrelating experience for 192 frames... [2023-03-12 04:28:42,720][146380] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 04:28:42,721][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000000_0.pth... [2023-03-12 04:28:43,663][146670] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,666][146737] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,671][146674] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,682][146668] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,701][146673] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,794][146737] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,795][146670] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,801][146674] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,809][146669] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,813][146668] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,831][146673] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,852][146671] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,938][146669] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,952][146737] Decorrelating experience for 384 frames... [2023-03-12 04:28:43,953][146670] Decorrelating experience for 384 frames... [2023-03-12 04:28:43,957][146672] Decorrelating experience for 256 frames... [2023-03-12 04:28:43,957][146674] Decorrelating experience for 384 frames... [2023-03-12 04:28:43,971][146668] Decorrelating experience for 384 frames... [2023-03-12 04:28:43,983][146671] Decorrelating experience for 320 frames... [2023-03-12 04:28:43,987][146673] Decorrelating experience for 384 frames... [2023-03-12 04:28:44,090][146672] Decorrelating experience for 320 frames... [2023-03-12 04:28:44,095][146669] Decorrelating experience for 384 frames... [2023-03-12 04:28:44,137][146670] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,138][146671] Decorrelating experience for 384 frames... [2023-03-12 04:28:44,138][146737] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,143][146674] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,155][146668] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,172][146673] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,246][146672] Decorrelating experience for 384 frames... [2023-03-12 04:28:44,279][146669] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,321][146671] Decorrelating experience for 448 frames... [2023-03-12 04:28:44,433][146672] Decorrelating experience for 448 frames... [2023-03-12 04:28:47,719][146380] Fps is (10 sec: 2867.2, 60 sec: 1911.5, 300 sec: 1911.5). Total num frames: 28672. Throughput: 0: 1814.9. Samples: 27224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:28:47,720][146380] Avg episode reward: [(0, '111.129')] [2023-03-12 04:28:48,772][146667] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-12 04:28:50,276][146380] Heartbeat connected on Batcher_0 [2023-03-12 04:28:50,278][146380] Heartbeat connected on LearnerWorker_p0 [2023-03-12 04:28:50,281][146380] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-12 04:28:50,286][146380] Heartbeat connected on RolloutWorker_w0 [2023-03-12 04:28:50,288][146380] Heartbeat connected on RolloutWorker_w1 [2023-03-12 04:28:50,289][146380] Heartbeat connected on RolloutWorker_w2 [2023-03-12 04:28:50,291][146380] Heartbeat connected on RolloutWorker_w3 [2023-03-12 04:28:50,293][146380] Heartbeat connected on RolloutWorker_w4 [2023-03-12 04:28:50,294][146380] Heartbeat connected on RolloutWorker_w5 [2023-03-12 04:28:50,296][146380] Heartbeat connected on RolloutWorker_w6 [2023-03-12 04:28:50,298][146380] Heartbeat connected on RolloutWorker_w7 [2023-03-12 04:28:52,719][146380] Fps is (10 sec: 7782.5, 60 sec: 3891.2, 300 sec: 3891.2). Total num frames: 77824. Throughput: 0: 2837.2. Samples: 56744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:28:52,720][146380] Avg episode reward: [(0, '459.552')] [2023-03-12 04:28:52,953][146667] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-12 04:28:57,248][146667] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-12 04:28:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 5079.0, 300 sec: 5079.0). Total num frames: 126976. Throughput: 0: 4590.1. Samples: 114752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:28:57,720][146380] Avg episode reward: [(0, '816.128')] [2023-03-12 04:28:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000248_126976.pth... [2023-03-12 04:28:57,726][146623] Saving new best policy, reward=816.128! [2023-03-12 04:29:01,870][146667] Updated weights for policy 0, policy_version 320 (0.0004) [2023-03-12 04:29:02,719][146380] Fps is (10 sec: 9011.1, 60 sec: 5597.9, 300 sec: 5597.9). Total num frames: 167936. Throughput: 0: 5600.0. Samples: 168000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:29:02,720][146380] Avg episode reward: [(0, '1458.811')] [2023-03-12 04:29:02,720][146623] Saving new best policy, reward=1458.811! [2023-03-12 04:29:06,497][146667] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-12 04:29:07,719][146380] Fps is (10 sec: 8601.6, 60 sec: 6085.5, 300 sec: 6085.5). Total num frames: 212992. Throughput: 0: 5564.4. Samples: 194756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:29:07,720][146380] Avg episode reward: [(0, '2076.212')] [2023-03-12 04:29:07,720][146623] Saving new best policy, reward=2076.212! [2023-03-12 04:29:11,311][146667] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-12 04:29:12,720][146380] Fps is (10 sec: 8601.6, 60 sec: 6348.8, 300 sec: 6348.8). Total num frames: 253952. Throughput: 0: 6145.8. Samples: 245832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:29:12,720][146380] Avg episode reward: [(0, '2389.551')] [2023-03-12 04:29:12,738][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000504_258048.pth... [2023-03-12 04:29:12,739][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000000_0.pth [2023-03-12 04:29:12,739][146623] Saving new best policy, reward=2389.551! [2023-03-12 04:29:16,126][146667] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-12 04:29:17,719][146380] Fps is (10 sec: 8601.6, 60 sec: 6644.6, 300 sec: 6644.6). Total num frames: 299008. Throughput: 0: 6595.3. Samples: 296788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:29:17,720][146380] Avg episode reward: [(0, '3377.563')] [2023-03-12 04:29:17,721][146623] Saving new best policy, reward=3377.563! [2023-03-12 04:29:21,262][146667] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-12 04:29:22,719][146380] Fps is (10 sec: 8192.1, 60 sec: 6717.4, 300 sec: 6717.4). Total num frames: 335872. Throughput: 0: 7111.9. Samples: 320036. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:29:22,720][146380] Avg episode reward: [(0, '3449.672')] [2023-03-12 04:29:22,720][146623] Saving new best policy, reward=3449.672! [2023-03-12 04:29:26,490][146667] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-12 04:29:27,720][146380] Fps is (10 sec: 7782.3, 60 sec: 6851.5, 300 sec: 6851.5). Total num frames: 376832. Throughput: 0: 8175.6. Samples: 367904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:29:27,720][146380] Avg episode reward: [(0, '3481.132')] [2023-03-12 04:29:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000736_376832.pth... [2023-03-12 04:29:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000248_126976.pth [2023-03-12 04:29:27,726][146623] Saving new best policy, reward=3481.132! [2023-03-12 04:29:31,798][146667] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-12 04:29:32,719][146380] Fps is (10 sec: 7782.4, 60 sec: 6894.9, 300 sec: 6894.9). Total num frames: 413696. Throughput: 0: 8589.7. Samples: 413760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:29:32,720][146380] Avg episode reward: [(0, '2583.858')] [2023-03-12 04:29:37,148][146667] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-12 04:29:37,719][146380] Fps is (10 sec: 7782.5, 60 sec: 7577.6, 300 sec: 6994.7). Total num frames: 454656. Throughput: 0: 8442.9. Samples: 436676. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:29:37,720][146380] Avg episode reward: [(0, '2148.370')] [2023-03-12 04:29:42,544][146667] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-12 04:29:42,719][146380] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 7021.7). Total num frames: 491520. Throughput: 0: 8185.5. Samples: 483100. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:29:42,720][146380] Avg episode reward: [(0, '2294.583')] [2023-03-12 04:29:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000960_491520.pth... [2023-03-12 04:29:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000504_258048.pth [2023-03-12 04:29:47,716][146667] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-12 04:29:47,719][146380] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 7099.7). Total num frames: 532480. Throughput: 0: 8034.9. Samples: 529568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:29:47,720][146380] Avg episode reward: [(0, '2745.445')] [2023-03-12 04:29:52,719][146380] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 7116.8). Total num frames: 569344. Throughput: 0: 7957.7. Samples: 552852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:29:52,720][146380] Avg episode reward: [(0, '2912.868')] [2023-03-12 04:29:53,075][146667] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-12 04:29:57,719][146380] Fps is (10 sec: 7782.3, 60 sec: 8055.5, 300 sec: 7180.0). Total num frames: 610304. Throughput: 0: 7886.8. Samples: 600740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:29:57,720][146380] Avg episode reward: [(0, '3012.997')] [2023-03-12 04:29:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001192_610304.pth... [2023-03-12 04:29:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000736_376832.pth [2023-03-12 04:29:58,071][146667] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-12 04:30:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8055.5, 300 sec: 7236.3). Total num frames: 651264. Throughput: 0: 7813.5. Samples: 648396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:30:02,720][146380] Avg episode reward: [(0, '2511.687')] [2023-03-12 04:30:03,185][146667] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-12 04:30:07,719][146380] Fps is (10 sec: 8192.0, 60 sec: 7987.2, 300 sec: 7286.6). Total num frames: 692224. Throughput: 0: 7841.9. Samples: 672920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:30:07,720][146380] Avg episode reward: [(0, '2536.593')] [2023-03-12 04:30:08,044][146667] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-12 04:30:12,720][146380] Fps is (10 sec: 8191.9, 60 sec: 7987.2, 300 sec: 7331.8). Total num frames: 733184. Throughput: 0: 7926.6. Samples: 724600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:30:12,720][146380] Avg episode reward: [(0, '3397.467')] [2023-03-12 04:30:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001432_733184.pth... [2023-03-12 04:30:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000000960_491520.pth [2023-03-12 04:30:12,924][146667] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-12 04:30:17,719][146380] Fps is (10 sec: 8192.0, 60 sec: 7918.9, 300 sec: 7372.8). Total num frames: 774144. Throughput: 0: 8001.0. Samples: 773804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:30:17,720][146380] Avg episode reward: [(0, '4248.620')] [2023-03-12 04:30:17,720][146623] Saving new best policy, reward=4248.620! [2023-03-12 04:30:17,925][146667] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-12 04:30:22,684][146667] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-12 04:30:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8055.5, 300 sec: 7447.3). Total num frames: 819200. Throughput: 0: 8046.8. Samples: 798784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:30:22,720][146380] Avg episode reward: [(0, '4191.201')] [2023-03-12 04:30:27,264][146667] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-12 04:30:27,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8055.5, 300 sec: 7479.7). Total num frames: 860160. Throughput: 0: 8197.3. Samples: 851976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:30:27,720][146380] Avg episode reward: [(0, '3933.647')] [2023-03-12 04:30:27,748][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001688_864256.pth... [2023-03-12 04:30:27,751][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001192_610304.pth [2023-03-12 04:30:31,872][146667] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-12 04:30:32,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8192.0, 300 sec: 7543.5). Total num frames: 905216. Throughput: 0: 8349.2. Samples: 905280. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:30:32,720][146380] Avg episode reward: [(0, '3977.062')] [2023-03-12 04:30:36,623][146667] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-12 04:30:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8260.3, 300 sec: 7602.2). Total num frames: 950272. Throughput: 0: 8405.3. Samples: 931092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:30:37,720][146380] Avg episode reward: [(0, '4298.290')] [2023-03-12 04:30:37,720][146623] Saving new best policy, reward=4298.290! [2023-03-12 04:30:41,461][146667] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-12 04:30:42,719][146380] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 7624.9). Total num frames: 991232. Throughput: 0: 8480.1. Samples: 982344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:30:42,720][146380] Avg episode reward: [(0, '4360.719')] [2023-03-12 04:30:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001936_991232.pth... [2023-03-12 04:30:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001432_733184.pth [2023-03-12 04:30:42,726][146623] Saving new best policy, reward=4360.719! [2023-03-12 04:30:46,233][146667] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-12 04:30:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 7676.2). Total num frames: 1036288. Throughput: 0: 8563.0. Samples: 1033732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:30:47,720][146380] Avg episode reward: [(0, '4477.740')] [2023-03-12 04:30:47,720][146623] Saving new best policy, reward=4477.740! [2023-03-12 04:30:50,961][146667] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-12 04:30:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 7694.6). Total num frames: 1077248. Throughput: 0: 8591.7. Samples: 1059548. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:30:52,720][146380] Avg episode reward: [(0, '4354.931')] [2023-03-12 04:30:55,687][146667] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-12 04:30:57,719][146380] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 7740.0). Total num frames: 1122304. Throughput: 0: 8605.2. Samples: 1111832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:30:57,720][146380] Avg episode reward: [(0, '4311.250')] [2023-03-12 04:30:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002192_1122304.pth... [2023-03-12 04:30:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001688_864256.pth [2023-03-12 04:31:00,208][146667] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-12 04:31:02,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8601.6, 300 sec: 7782.4). Total num frames: 1167360. Throughput: 0: 8726.4. Samples: 1166492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:02,720][146380] Avg episode reward: [(0, '4507.682')] [2023-03-12 04:31:02,720][146623] Saving new best policy, reward=4507.682! [2023-03-12 04:31:04,757][146667] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-12 04:31:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8669.9, 300 sec: 7822.0). Total num frames: 1212416. Throughput: 0: 8761.0. Samples: 1193028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:07,720][146380] Avg episode reward: [(0, '4416.189')] [2023-03-12 04:31:09,288][146667] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-12 04:31:12,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 7859.2). Total num frames: 1257472. Throughput: 0: 8801.1. Samples: 1248028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:12,720][146380] Avg episode reward: [(0, '4386.514')] [2023-03-12 04:31:12,737][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002464_1261568.pth... [2023-03-12 04:31:12,739][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000001936_991232.pth [2023-03-12 04:31:13,605][146667] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-12 04:31:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 7918.9). Total num frames: 1306624. Throughput: 0: 8907.7. Samples: 1306128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:31:17,720][146380] Avg episode reward: [(0, '4509.402')] [2023-03-12 04:31:17,720][146623] Saving new best policy, reward=4509.402! [2023-03-12 04:31:17,811][146667] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-12 04:31:22,118][146667] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-12 04:31:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 8942.9, 300 sec: 7975.2). Total num frames: 1355776. Throughput: 0: 8976.7. Samples: 1335044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:22,720][146380] Avg episode reward: [(0, '4492.260')] [2023-03-12 04:31:26,425][146667] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-12 04:31:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8004.8). Total num frames: 1400832. Throughput: 0: 9106.4. Samples: 1392132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:31:27,720][146380] Avg episode reward: [(0, '4509.310')] [2023-03-12 04:31:27,731][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002744_1404928.pth... [2023-03-12 04:31:27,733][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002192_1122304.pth [2023-03-12 04:31:31,039][146667] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-12 04:31:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8032.7). Total num frames: 1445888. Throughput: 0: 9149.3. Samples: 1445452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:31:32,720][146380] Avg episode reward: [(0, '4429.020')] [2023-03-12 04:31:35,529][146667] Updated weights for policy 0, policy_version 2880 (0.0005) [2023-03-12 04:31:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8059.2). Total num frames: 1490944. Throughput: 0: 9180.2. Samples: 1472656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:37,720][146380] Avg episode reward: [(0, '4453.551')] [2023-03-12 04:31:40,077][146667] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-12 04:31:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8084.2). Total num frames: 1536000. Throughput: 0: 9240.9. Samples: 1527672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:31:42,720][146380] Avg episode reward: [(0, '4437.297')] [2023-03-12 04:31:42,755][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003008_1540096.pth... [2023-03-12 04:31:42,757][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002464_1261568.pth [2023-03-12 04:31:44,649][146667] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-12 04:31:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8108.0). Total num frames: 1581056. Throughput: 0: 9194.6. Samples: 1580248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:31:47,720][146380] Avg episode reward: [(0, '4173.654')] [2023-03-12 04:31:49,350][146667] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-12 04:31:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8130.6). Total num frames: 1626112. Throughput: 0: 9174.8. Samples: 1605892. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:31:52,720][146380] Avg episode reward: [(0, '4274.458')] [2023-03-12 04:31:53,931][146667] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-12 04:31:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8152.0). Total num frames: 1671168. Throughput: 0: 9141.2. Samples: 1659384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:31:57,720][146380] Avg episode reward: [(0, '4257.888')] [2023-03-12 04:31:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003264_1671168.pth... [2023-03-12 04:31:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000002744_1404928.pth [2023-03-12 04:31:58,553][146667] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-12 04:32:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8172.5). Total num frames: 1716224. Throughput: 0: 9091.2. Samples: 1715232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:02,720][146380] Avg episode reward: [(0, '4408.305')] [2023-03-12 04:32:02,868][146667] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-12 04:32:07,143][146667] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-12 04:32:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8211.1). Total num frames: 1765376. Throughput: 0: 9101.7. Samples: 1744620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:07,720][146380] Avg episode reward: [(0, '4470.723')] [2023-03-12 04:32:11,715][146667] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-12 04:32:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8229.2). Total num frames: 1810432. Throughput: 0: 9039.8. Samples: 1798924. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:32:12,720][146380] Avg episode reward: [(0, '4523.507')] [2023-03-12 04:32:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003536_1810432.pth... [2023-03-12 04:32:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003008_1540096.pth [2023-03-12 04:32:12,726][146623] Saving new best policy, reward=4523.507! [2023-03-12 04:32:16,354][146667] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-12 04:32:17,719][146380] Fps is (10 sec: 8601.5, 60 sec: 9079.5, 300 sec: 8228.4). Total num frames: 1851392. Throughput: 0: 9026.1. Samples: 1851628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:17,720][146380] Avg episode reward: [(0, '4550.602')] [2023-03-12 04:32:17,737][146623] Saving new best policy, reward=4550.602! [2023-03-12 04:32:21,144][146667] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-12 04:32:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8245.4). Total num frames: 1896448. Throughput: 0: 8999.4. Samples: 1877628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:22,720][146380] Avg episode reward: [(0, '4514.524')] [2023-03-12 04:32:26,017][146667] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-12 04:32:27,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 8244.3). Total num frames: 1937408. Throughput: 0: 8893.8. Samples: 1927896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:32:27,720][146380] Avg episode reward: [(0, '4522.400')] [2023-03-12 04:32:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003784_1937408.pth... [2023-03-12 04:32:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003264_1671168.pth [2023-03-12 04:32:30,880][146667] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-12 04:32:32,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8874.7, 300 sec: 8243.2). Total num frames: 1978368. Throughput: 0: 8847.4. Samples: 1978380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:32,720][146380] Avg episode reward: [(0, '4566.900')] [2023-03-12 04:32:32,721][146623] Saving new best policy, reward=4566.900! [2023-03-12 04:32:35,672][146667] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-12 04:32:37,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8258.9). Total num frames: 2023424. Throughput: 0: 8843.1. Samples: 2003832. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:32:37,720][146380] Avg episode reward: [(0, '4531.556')] [2023-03-12 04:32:40,356][146667] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-12 04:32:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8273.9). Total num frames: 2068480. Throughput: 0: 8826.3. Samples: 2056568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:32:42,720][146380] Avg episode reward: [(0, '4559.105')] [2023-03-12 04:32:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004040_2068480.pth... [2023-03-12 04:32:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003536_1810432.pth [2023-03-12 04:32:44,995][146667] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-12 04:32:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8272.3). Total num frames: 2109440. Throughput: 0: 8761.6. Samples: 2109504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:47,720][146380] Avg episode reward: [(0, '4475.762')] [2023-03-12 04:32:49,721][146667] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-12 04:32:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8286.5). Total num frames: 2154496. Throughput: 0: 8677.8. Samples: 2135120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:32:52,720][146380] Avg episode reward: [(0, '4006.085')] [2023-03-12 04:32:54,487][146667] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-12 04:32:57,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8284.7). Total num frames: 2195456. Throughput: 0: 8630.1. Samples: 2187280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:32:57,720][146380] Avg episode reward: [(0, '3870.382')] [2023-03-12 04:32:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004288_2195456.pth... [2023-03-12 04:32:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000003784_1937408.pth [2023-03-12 04:32:59,309][146667] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-12 04:33:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8283.0). Total num frames: 2236416. Throughput: 0: 8556.7. Samples: 2236680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:02,720][146380] Avg episode reward: [(0, '4317.148')] [2023-03-12 04:33:04,260][146667] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-12 04:33:07,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8281.4). Total num frames: 2277376. Throughput: 0: 8520.8. Samples: 2261064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:07,720][146380] Avg episode reward: [(0, '4465.434')] [2023-03-12 04:33:09,359][146667] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-12 04:33:12,720][146380] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8279.8). Total num frames: 2318336. Throughput: 0: 8493.1. Samples: 2310084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:12,720][146380] Avg episode reward: [(0, '4466.404')] [2023-03-12 04:33:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004528_2318336.pth... [2023-03-12 04:33:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004040_2068480.pth [2023-03-12 04:33:14,379][146667] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-12 04:33:17,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8278.2). Total num frames: 2359296. Throughput: 0: 8465.1. Samples: 2359308. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:33:17,720][146380] Avg episode reward: [(0, '4469.543')] [2023-03-12 04:33:19,376][146667] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-12 04:33:22,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8276.7). Total num frames: 2400256. Throughput: 0: 8445.5. Samples: 2383880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:22,720][146380] Avg episode reward: [(0, '4435.875')] [2023-03-12 04:33:24,375][146667] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-12 04:33:27,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8275.3). Total num frames: 2441216. Throughput: 0: 8359.0. Samples: 2432724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:33:27,723][146380] Avg episode reward: [(0, '4471.193')] [2023-03-12 04:33:27,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004768_2441216.pth... [2023-03-12 04:33:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004288_2195456.pth [2023-03-12 04:33:29,490][146667] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-12 04:33:32,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8414.2). Total num frames: 2482176. Throughput: 0: 8263.0. Samples: 2481340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:32,730][146380] Avg episode reward: [(0, '4493.812')] [2023-03-12 04:33:34,516][146667] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-12 04:33:37,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8553.0). Total num frames: 2523136. Throughput: 0: 8225.2. Samples: 2505256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:33:37,720][146380] Avg episode reward: [(0, '4488.150')] [2023-03-12 04:33:39,517][146667] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-12 04:33:42,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8594.7). Total num frames: 2564096. Throughput: 0: 8168.4. Samples: 2554856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:42,730][146380] Avg episode reward: [(0, '4465.372')] [2023-03-12 04:33:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005008_2564096.pth... [2023-03-12 04:33:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004528_2318336.pth [2023-03-12 04:33:44,520][146667] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-12 04:33:47,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8566.9). Total num frames: 2605056. Throughput: 0: 8143.8. Samples: 2603152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:47,730][146380] Avg episode reward: [(0, '4455.972')] [2023-03-12 04:33:49,615][146667] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-12 04:33:52,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8539.1). Total num frames: 2646016. Throughput: 0: 8141.7. Samples: 2627440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:33:52,720][146380] Avg episode reward: [(0, '4464.762')] [2023-03-12 04:33:54,580][146667] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-12 04:33:57,720][146380] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8539.1). Total num frames: 2686976. Throughput: 0: 8147.3. Samples: 2676712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:33:57,720][146380] Avg episode reward: [(0, '4485.638')] [2023-03-12 04:33:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005248_2686976.pth... [2023-03-12 04:33:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000004768_2441216.pth [2023-03-12 04:33:59,626][146667] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-12 04:34:02,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8192.0, 300 sec: 8525.2). Total num frames: 2727936. Throughput: 0: 8122.3. Samples: 2724812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:02,730][146380] Avg episode reward: [(0, '4487.633')] [2023-03-12 04:34:04,700][146667] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-12 04:34:07,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8525.2). Total num frames: 2768896. Throughput: 0: 8123.1. Samples: 2749420. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:34:07,720][146380] Avg episode reward: [(0, '4502.422')] [2023-03-12 04:34:09,587][146667] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-12 04:34:12,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8192.0, 300 sec: 8511.3). Total num frames: 2809856. Throughput: 0: 8168.0. Samples: 2800284. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:34:12,720][146380] Avg episode reward: [(0, '4507.953')] [2023-03-12 04:34:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005488_2809856.pth... [2023-03-12 04:34:12,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005008_2564096.pth [2023-03-12 04:34:14,343][146667] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-12 04:34:17,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8192.0, 300 sec: 8525.2). Total num frames: 2850816. Throughput: 0: 8223.4. Samples: 2851392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:34:17,720][146380] Avg episode reward: [(0, '4522.946')] [2023-03-12 04:34:19,204][146667] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-12 04:34:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8539.1). Total num frames: 2895872. Throughput: 0: 8246.8. Samples: 2876360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:22,720][146380] Avg episode reward: [(0, '4539.081')] [2023-03-12 04:34:24,071][146667] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-12 04:34:27,720][146380] Fps is (10 sec: 8601.4, 60 sec: 8260.3, 300 sec: 8553.0). Total num frames: 2936832. Throughput: 0: 8305.1. Samples: 2928588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:27,720][146380] Avg episode reward: [(0, '4481.819')] [2023-03-12 04:34:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005736_2936832.pth... [2023-03-12 04:34:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005248_2686976.pth [2023-03-12 04:34:28,741][146667] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-12 04:34:32,719][146380] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8566.9). Total num frames: 2981888. Throughput: 0: 8372.7. Samples: 2979924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:34:32,720][146380] Avg episode reward: [(0, '4516.895')] [2023-03-12 04:34:33,572][146667] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-12 04:34:37,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8580.8). Total num frames: 3022848. Throughput: 0: 8405.7. Samples: 3005696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:37,720][146380] Avg episode reward: [(0, '4524.335')] [2023-03-12 04:34:38,236][146667] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-12 04:34:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8594.7). Total num frames: 3067904. Throughput: 0: 8484.5. Samples: 3058516. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:34:42,720][146380] Avg episode reward: [(0, '4542.173')] [2023-03-12 04:34:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005992_3067904.pth... [2023-03-12 04:34:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005488_2809856.pth [2023-03-12 04:34:42,886][146667] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-12 04:34:47,532][146667] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-12 04:34:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 8622.4). Total num frames: 3112960. Throughput: 0: 8592.0. Samples: 3111452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:47,720][146380] Avg episode reward: [(0, '4522.931')] [2023-03-12 04:34:52,234][146667] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-12 04:34:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 3158016. Throughput: 0: 8626.2. Samples: 3137600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:52,720][146380] Avg episode reward: [(0, '4527.180')] [2023-03-12 04:34:56,821][146667] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-12 04:34:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 3203072. Throughput: 0: 8677.5. Samples: 3190772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:34:57,720][146380] Avg episode reward: [(0, '4550.687')] [2023-03-12 04:34:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006256_3203072.pth... [2023-03-12 04:34:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005736_2936832.pth [2023-03-12 04:35:01,373][146667] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-12 04:35:02,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 3244032. Throughput: 0: 8733.2. Samples: 3244388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:02,720][146380] Avg episode reward: [(0, '4550.267')] [2023-03-12 04:35:05,779][146667] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-12 04:35:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 8678.0). Total num frames: 3293184. Throughput: 0: 8809.1. Samples: 3272768. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:35:07,720][146380] Avg episode reward: [(0, '4549.238')] [2023-03-12 04:35:10,209][146667] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-12 04:35:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 3338240. Throughput: 0: 8875.8. Samples: 3328000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:12,720][146380] Avg episode reward: [(0, '4551.649')] [2023-03-12 04:35:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006520_3338240.pth... [2023-03-12 04:35:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000005992_3067904.pth [2023-03-12 04:35:14,858][146667] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-12 04:35:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8691.9). Total num frames: 3383296. Throughput: 0: 8911.8. Samples: 3380956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:17,720][146380] Avg episode reward: [(0, '4518.065')] [2023-03-12 04:35:19,469][146667] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-12 04:35:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 3424256. Throughput: 0: 8933.1. Samples: 3407684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:22,720][146380] Avg episode reward: [(0, '4525.381')] [2023-03-12 04:35:24,187][146667] Updated weights for policy 0, policy_version 6720 (0.0004) [2023-03-12 04:35:27,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8691.8). Total num frames: 3469312. Throughput: 0: 8917.3. Samples: 3459796. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:35:27,720][146380] Avg episode reward: [(0, '4535.213')] [2023-03-12 04:35:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006776_3469312.pth... [2023-03-12 04:35:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006256_3203072.pth [2023-03-12 04:35:28,875][146667] Updated weights for policy 0, policy_version 6800 (0.0006) [2023-03-12 04:35:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8691.8). Total num frames: 3514368. Throughput: 0: 8925.2. Samples: 3513084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:35:32,720][146380] Avg episode reward: [(0, '4477.021')] [2023-03-12 04:35:33,393][146667] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-12 04:35:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8705.7). Total num frames: 3559424. Throughput: 0: 8937.1. Samples: 3539772. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:35:37,720][146380] Avg episode reward: [(0, '4496.461')] [2023-03-12 04:35:37,921][146667] Updated weights for policy 0, policy_version 6960 (0.0006) [2023-03-12 04:35:42,361][146667] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-12 04:35:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8705.7). Total num frames: 3604480. Throughput: 0: 8993.6. Samples: 3595484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:42,720][146380] Avg episode reward: [(0, '4387.821')] [2023-03-12 04:35:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007040_3604480.pth... [2023-03-12 04:35:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006520_3338240.pth [2023-03-12 04:35:46,981][146667] Updated weights for policy 0, policy_version 7120 (0.0006) [2023-03-12 04:35:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8719.6). Total num frames: 3649536. Throughput: 0: 8986.6. Samples: 3648784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:35:47,720][146380] Avg episode reward: [(0, '4351.094')] [2023-03-12 04:35:51,658][146667] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-12 04:35:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8719.6). Total num frames: 3694592. Throughput: 0: 8932.3. Samples: 3674720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:35:52,720][146380] Avg episode reward: [(0, '4494.535')] [2023-03-12 04:35:56,544][146667] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-12 04:35:57,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8705.7). Total num frames: 3735552. Throughput: 0: 8836.5. Samples: 3725644. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:35:57,720][146380] Avg episode reward: [(0, '4495.963')] [2023-03-12 04:35:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007296_3735552.pth... [2023-03-12 04:35:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000006776_3469312.pth [2023-03-12 04:36:01,414][146667] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-12 04:36:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8874.7, 300 sec: 8691.8). Total num frames: 3776512. Throughput: 0: 8790.1. Samples: 3776512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:36:02,720][146380] Avg episode reward: [(0, '4487.931')] [2023-03-12 04:36:06,124][146667] Updated weights for policy 0, policy_version 7440 (0.0005) [2023-03-12 04:36:07,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8691.8). Total num frames: 3821568. Throughput: 0: 8759.2. Samples: 3801848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:36:07,720][146380] Avg episode reward: [(0, '4390.312')] [2023-03-12 04:36:11,029][146667] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-12 04:36:12,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8664.1). Total num frames: 3862528. Throughput: 0: 8737.4. Samples: 3852980. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:36:12,720][146380] Avg episode reward: [(0, '4357.275')] [2023-03-12 04:36:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007544_3862528.pth... [2023-03-12 04:36:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007040_3604480.pth [2023-03-12 04:36:15,840][146667] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-12 04:36:17,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8636.3). Total num frames: 3903488. Throughput: 0: 8687.6. Samples: 3904024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:36:17,720][146380] Avg episode reward: [(0, '4453.514')] [2023-03-12 04:36:20,482][146667] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-12 04:36:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 3948544. Throughput: 0: 8698.4. Samples: 3931200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:36:22,720][146380] Avg episode reward: [(0, '4438.979')] [2023-03-12 04:36:25,119][146667] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-12 04:36:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 3993600. Throughput: 0: 8629.4. Samples: 3983808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:36:27,720][146380] Avg episode reward: [(0, '4475.598')] [2023-03-12 04:36:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007800_3993600.pth... [2023-03-12 04:36:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007296_3735552.pth [2023-03-12 04:36:29,980][146667] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-12 04:36:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 4034560. Throughput: 0: 8572.8. Samples: 4034560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:36:32,720][146380] Avg episode reward: [(0, '4403.160')] [2023-03-12 04:36:34,647][146667] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-12 04:36:37,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 4079616. Throughput: 0: 8577.8. Samples: 4060720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:36:37,720][146380] Avg episode reward: [(0, '4381.969')] [2023-03-12 04:36:39,371][146667] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-12 04:36:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 4124672. Throughput: 0: 8622.7. Samples: 4113668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:36:42,720][146380] Avg episode reward: [(0, '4419.152')] [2023-03-12 04:36:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008056_4124672.pth... [2023-03-12 04:36:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007544_3862528.pth [2023-03-12 04:36:43,794][146667] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-12 04:36:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8622.4). Total num frames: 4169728. Throughput: 0: 8736.5. Samples: 4169656. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:36:47,720][146380] Avg episode reward: [(0, '4344.817')] [2023-03-12 04:36:48,252][146667] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-12 04:36:52,719][146667] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-12 04:36:52,720][146380] Fps is (10 sec: 9420.8, 60 sec: 8738.1, 300 sec: 8636.3). Total num frames: 4218880. Throughput: 0: 8782.9. Samples: 4197080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:36:52,720][146380] Avg episode reward: [(0, '4464.141')] [2023-03-12 04:36:57,136][146667] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-12 04:36:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8636.3). Total num frames: 4263936. Throughput: 0: 8873.4. Samples: 4252284. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:36:57,720][146380] Avg episode reward: [(0, '4462.468')] [2023-03-12 04:36:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008328_4263936.pth... [2023-03-12 04:36:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000007800_3993600.pth [2023-03-12 04:37:01,645][146667] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-12 04:37:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8622.4). Total num frames: 4308992. Throughput: 0: 8963.4. Samples: 4307376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:02,720][146380] Avg episode reward: [(0, '4338.336')] [2023-03-12 04:37:05,977][146667] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-12 04:37:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 8942.9, 300 sec: 8636.3). Total num frames: 4358144. Throughput: 0: 8987.1. Samples: 4335620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:07,720][146380] Avg episode reward: [(0, '3997.348')] [2023-03-12 04:37:10,285][146667] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-12 04:37:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8650.2). Total num frames: 4403200. Throughput: 0: 9077.7. Samples: 4392304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:12,720][146380] Avg episode reward: [(0, '4329.278')] [2023-03-12 04:37:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008600_4403200.pth... [2023-03-12 04:37:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008056_4124672.pth [2023-03-12 04:37:14,585][146667] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-12 04:37:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 8664.1). Total num frames: 4452352. Throughput: 0: 9241.3. Samples: 4450420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:17,720][146380] Avg episode reward: [(0, '4473.906')] [2023-03-12 04:37:18,808][146667] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-12 04:37:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 8691.9). Total num frames: 4501504. Throughput: 0: 9303.5. Samples: 4479376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:22,720][146380] Avg episode reward: [(0, '4395.242')] [2023-03-12 04:37:23,055][146667] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-12 04:37:27,037][146667] Updated weights for policy 0, policy_version 8880 (0.0004) [2023-03-12 04:37:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 8719.6). Total num frames: 4550656. Throughput: 0: 9452.4. Samples: 4539024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:27,720][146380] Avg episode reward: [(0, '4386.843')] [2023-03-12 04:37:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008888_4550656.pth... [2023-03-12 04:37:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008328_4263936.pth [2023-03-12 04:37:31,133][146667] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-12 04:37:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 8733.5). Total num frames: 4599808. Throughput: 0: 9559.1. Samples: 4599816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:32,720][146380] Avg episode reward: [(0, '4504.813')] [2023-03-12 04:37:35,090][146667] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-12 04:37:37,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 8761.3). Total num frames: 4653056. Throughput: 0: 9646.1. Samples: 4631152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:37,720][146380] Avg episode reward: [(0, '4500.177')] [2023-03-12 04:37:39,275][146667] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-12 04:37:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 8775.2). Total num frames: 4698112. Throughput: 0: 9702.8. Samples: 4688912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:42,720][146380] Avg episode reward: [(0, '4473.579')] [2023-03-12 04:37:42,770][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009184_4702208.pth... [2023-03-12 04:37:42,773][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008600_4403200.pth [2023-03-12 04:37:43,667][146667] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-12 04:37:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 8789.0). Total num frames: 4747264. Throughput: 0: 9714.4. Samples: 4744524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:37:47,720][146380] Avg episode reward: [(0, '4436.324')] [2023-03-12 04:37:48,039][146667] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-12 04:37:52,446][146667] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-12 04:37:52,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 8802.9). Total num frames: 4792320. Throughput: 0: 9720.8. Samples: 4773056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:52,720][146380] Avg episode reward: [(0, '4357.085')] [2023-03-12 04:37:56,728][146667] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-12 04:37:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 8830.7). Total num frames: 4841472. Throughput: 0: 9714.6. Samples: 4829460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:37:57,720][146380] Avg episode reward: [(0, '4465.722')] [2023-03-12 04:37:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009456_4841472.pth... [2023-03-12 04:37:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000008888_4550656.pth [2023-03-12 04:38:01,131][146667] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-12 04:38:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 8844.6). Total num frames: 4886528. Throughput: 0: 9674.8. Samples: 4885788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:02,720][146380] Avg episode reward: [(0, '4500.823')] [2023-03-12 04:38:05,564][146667] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-12 04:38:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 8858.5). Total num frames: 4931584. Throughput: 0: 9640.5. Samples: 4913200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:07,720][146380] Avg episode reward: [(0, '4461.162')] [2023-03-12 04:38:09,887][146667] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-12 04:38:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 8886.2). Total num frames: 4980736. Throughput: 0: 9563.3. Samples: 4969372. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:38:12,720][146380] Avg episode reward: [(0, '4503.786')] [2023-03-12 04:38:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009728_4980736.pth... [2023-03-12 04:38:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009184_4702208.pth [2023-03-12 04:38:14,279][146667] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-12 04:38:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 8900.1). Total num frames: 5025792. Throughput: 0: 9466.1. Samples: 5025792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:38:17,720][146380] Avg episode reward: [(0, '4484.677')] [2023-03-12 04:38:18,754][146667] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-12 04:38:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 8914.0). Total num frames: 5070848. Throughput: 0: 9362.6. Samples: 5052468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:38:22,720][146380] Avg episode reward: [(0, '4406.034')] [2023-03-12 04:38:23,233][146667] Updated weights for policy 0, policy_version 9920 (0.0004) [2023-03-12 04:38:27,600][146667] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-12 04:38:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 8941.8). Total num frames: 5120000. Throughput: 0: 9308.1. Samples: 5107776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:38:27,720][146380] Avg episode reward: [(0, '4513.407')] [2023-03-12 04:38:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010000_5120000.pth... [2023-03-12 04:38:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009456_4841472.pth [2023-03-12 04:38:31,979][146667] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-12 04:38:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8955.7). Total num frames: 5165056. Throughput: 0: 9336.9. Samples: 5164684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:32,720][146380] Avg episode reward: [(0, '4388.590')] [2023-03-12 04:38:36,356][146667] Updated weights for policy 0, policy_version 10160 (0.0005) [2023-03-12 04:38:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 8969.5). Total num frames: 5210112. Throughput: 0: 9333.1. Samples: 5193044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:37,720][146380] Avg episode reward: [(0, '4487.603')] [2023-03-12 04:38:40,835][146667] Updated weights for policy 0, policy_version 10240 (0.0005) [2023-03-12 04:38:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 8997.3). Total num frames: 5259264. Throughput: 0: 9287.2. Samples: 5247384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:42,720][146380] Avg episode reward: [(0, '4487.460')] [2023-03-12 04:38:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010272_5259264.pth... [2023-03-12 04:38:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000009728_4980736.pth [2023-03-12 04:38:45,328][146667] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-12 04:38:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9011.2). Total num frames: 5304320. Throughput: 0: 9242.0. Samples: 5301676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:47,720][146380] Avg episode reward: [(0, '4378.877')] [2023-03-12 04:38:49,889][146667] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-12 04:38:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9025.1). Total num frames: 5349376. Throughput: 0: 9239.1. Samples: 5328960. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:38:52,720][146380] Avg episode reward: [(0, '4460.080')] [2023-03-12 04:38:54,434][146667] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-12 04:38:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9039.0). Total num frames: 5394432. Throughput: 0: 9202.3. Samples: 5383476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:38:57,720][146380] Avg episode reward: [(0, '4512.367')] [2023-03-12 04:38:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010536_5394432.pth... [2023-03-12 04:38:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010000_5120000.pth [2023-03-12 04:38:58,744][146667] Updated weights for policy 0, policy_version 10560 (0.0004) [2023-03-12 04:39:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9052.9). Total num frames: 5439488. Throughput: 0: 9194.8. Samples: 5439560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:02,720][146380] Avg episode reward: [(0, '4548.354')] [2023-03-12 04:39:03,254][146667] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-12 04:39:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9066.7). Total num frames: 5484544. Throughput: 0: 9230.6. Samples: 5467844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:39:07,720][146380] Avg episode reward: [(0, '4539.426')] [2023-03-12 04:39:07,728][146667] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-12 04:39:12,186][146667] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-12 04:39:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 5533696. Throughput: 0: 9201.6. Samples: 5521848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:39:12,720][146380] Avg episode reward: [(0, '4552.034')] [2023-03-12 04:39:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010808_5533696.pth... [2023-03-12 04:39:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010272_5259264.pth [2023-03-12 04:39:16,788][146667] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-12 04:39:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 5578752. Throughput: 0: 9128.9. Samples: 5575484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:17,720][146380] Avg episode reward: [(0, '4563.869')] [2023-03-12 04:39:21,217][146667] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-12 04:39:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 5623808. Throughput: 0: 9117.6. Samples: 5603336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:22,720][146380] Avg episode reward: [(0, '4553.431')] [2023-03-12 04:39:25,575][146667] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-12 04:39:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 5668864. Throughput: 0: 9167.5. Samples: 5659920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:27,720][146380] Avg episode reward: [(0, '4466.041')] [2023-03-12 04:39:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011072_5668864.pth... [2023-03-12 04:39:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010536_5394432.pth [2023-03-12 04:39:30,024][146667] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-12 04:39:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 5718016. Throughput: 0: 9177.6. Samples: 5714668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:32,720][146380] Avg episode reward: [(0, '4514.979')] [2023-03-12 04:39:34,454][146667] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-12 04:39:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 5763072. Throughput: 0: 9192.0. Samples: 5742600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:37,720][146380] Avg episode reward: [(0, '4551.808')] [2023-03-12 04:39:38,853][146667] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-12 04:39:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 5808128. Throughput: 0: 9230.1. Samples: 5798832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:42,720][146380] Avg episode reward: [(0, '4504.487')] [2023-03-12 04:39:42,750][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011352_5812224.pth... [2023-03-12 04:39:42,752][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000010808_5533696.pth [2023-03-12 04:39:43,200][146667] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-12 04:39:47,453][146667] Updated weights for policy 0, policy_version 11440 (0.0004) [2023-03-12 04:39:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 5857280. Throughput: 0: 9262.4. Samples: 5856368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:39:47,720][146380] Avg episode reward: [(0, '4525.208')] [2023-03-12 04:39:51,900][146667] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-12 04:39:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 5902336. Throughput: 0: 9246.4. Samples: 5883932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:39:52,720][146380] Avg episode reward: [(0, '4525.281')] [2023-03-12 04:39:56,261][146667] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-12 04:39:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 5951488. Throughput: 0: 9285.4. Samples: 5939692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:39:57,720][146380] Avg episode reward: [(0, '4508.374')] [2023-03-12 04:39:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011624_5951488.pth... [2023-03-12 04:39:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011072_5668864.pth [2023-03-12 04:40:00,790][146667] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-12 04:40:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 5996544. Throughput: 0: 9335.4. Samples: 5995576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:02,720][146380] Avg episode reward: [(0, '4537.453')] [2023-03-12 04:40:05,124][146667] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-12 04:40:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 6041600. Throughput: 0: 9331.8. Samples: 6023268. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:40:07,720][146380] Avg episode reward: [(0, '4487.104')] [2023-03-12 04:40:09,779][146667] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-12 04:40:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 6086656. Throughput: 0: 9243.1. Samples: 6075860. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:40:12,720][146380] Avg episode reward: [(0, '4509.409')] [2023-03-12 04:40:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011888_6086656.pth... [2023-03-12 04:40:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011352_5812224.pth [2023-03-12 04:40:14,424][146667] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-12 04:40:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 6131712. Throughput: 0: 9222.9. Samples: 6129696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:17,720][146380] Avg episode reward: [(0, '4526.948')] [2023-03-12 04:40:18,936][146667] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-12 04:40:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 6176768. Throughput: 0: 9193.3. Samples: 6156296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:22,720][146380] Avg episode reward: [(0, '4482.677')] [2023-03-12 04:40:23,648][146667] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-12 04:40:27,720][146380] Fps is (10 sec: 8601.4, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 6217728. Throughput: 0: 9115.6. Samples: 6209036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:27,720][146380] Avg episode reward: [(0, '4498.678')] [2023-03-12 04:40:27,756][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012152_6221824.pth... [2023-03-12 04:40:27,758][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011624_5951488.pth [2023-03-12 04:40:28,211][146667] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-12 04:40:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9163.9). Total num frames: 6262784. Throughput: 0: 8979.9. Samples: 6260464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:32,720][146380] Avg episode reward: [(0, '4520.957')] [2023-03-12 04:40:33,115][146667] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-12 04:40:37,719][146380] Fps is (10 sec: 8601.8, 60 sec: 9011.2, 300 sec: 9150.0). Total num frames: 6303744. Throughput: 0: 8931.5. Samples: 6285848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:40:37,720][146380] Avg episode reward: [(0, '4512.539')] [2023-03-12 04:40:37,899][146667] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-12 04:40:42,700][146667] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-12 04:40:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9150.0). Total num frames: 6348800. Throughput: 0: 8826.1. Samples: 6336864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:40:42,720][146380] Avg episode reward: [(0, '4538.346')] [2023-03-12 04:40:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012400_6348800.pth... [2023-03-12 04:40:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000011888_6086656.pth [2023-03-12 04:40:47,409][146667] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-12 04:40:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9136.2). Total num frames: 6389760. Throughput: 0: 8759.4. Samples: 6389748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:47,720][146380] Avg episode reward: [(0, '4446.567')] [2023-03-12 04:40:52,020][146667] Updated weights for policy 0, policy_version 12560 (0.0004) [2023-03-12 04:40:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9150.0). Total num frames: 6434816. Throughput: 0: 8715.0. Samples: 6415444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:52,720][146380] Avg episode reward: [(0, '4264.827')] [2023-03-12 04:40:56,404][146667] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-12 04:40:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 9163.9). Total num frames: 6479872. Throughput: 0: 8791.5. Samples: 6471480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:40:57,720][146380] Avg episode reward: [(0, '4517.974')] [2023-03-12 04:40:57,738][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012664_6483968.pth... [2023-03-12 04:40:57,739][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012152_6221824.pth [2023-03-12 04:41:00,708][146667] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-12 04:41:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 9177.8). Total num frames: 6529024. Throughput: 0: 8869.1. Samples: 6528808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:02,720][146380] Avg episode reward: [(0, '4521.079')] [2023-03-12 04:41:04,858][146667] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-12 04:41:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 8942.9, 300 sec: 9205.6). Total num frames: 6578176. Throughput: 0: 8921.6. Samples: 6557768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:07,720][146380] Avg episode reward: [(0, '4497.894')] [2023-03-12 04:41:09,232][146667] Updated weights for policy 0, policy_version 12880 (0.0004) [2023-03-12 04:41:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9219.5). Total num frames: 6623232. Throughput: 0: 9009.7. Samples: 6614472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:12,720][146380] Avg episode reward: [(0, '4481.581')] [2023-03-12 04:41:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012944_6627328.pth... [2023-03-12 04:41:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012400_6348800.pth [2023-03-12 04:41:13,627][146667] Updated weights for policy 0, policy_version 12960 (0.0003) [2023-03-12 04:41:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 6672384. Throughput: 0: 9107.6. Samples: 6670308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:17,720][146380] Avg episode reward: [(0, '4525.074')] [2023-03-12 04:41:17,976][146667] Updated weights for policy 0, policy_version 13040 (0.0004) [2023-03-12 04:41:22,108][146667] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-12 04:41:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9079.5, 300 sec: 9247.2). Total num frames: 6721536. Throughput: 0: 9202.0. Samples: 6699940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:22,720][146380] Avg episode reward: [(0, '4547.483')] [2023-03-12 04:41:26,350][146667] Updated weights for policy 0, policy_version 13200 (0.0004) [2023-03-12 04:41:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 6770688. Throughput: 0: 9366.7. Samples: 6758368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:41:27,720][146380] Avg episode reward: [(0, '4503.928')] [2023-03-12 04:41:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013224_6770688.pth... [2023-03-12 04:41:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012664_6483968.pth [2023-03-12 04:41:30,772][146667] Updated weights for policy 0, policy_version 13280 (0.0003) [2023-03-12 04:41:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 6815744. Throughput: 0: 9421.2. Samples: 6813704. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:41:32,720][146380] Avg episode reward: [(0, '4505.616')] [2023-03-12 04:41:35,203][146667] Updated weights for policy 0, policy_version 13360 (0.0003) [2023-03-12 04:41:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 6860800. Throughput: 0: 9467.6. Samples: 6841484. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:41:37,720][146380] Avg episode reward: [(0, '4486.947')] [2023-03-12 04:41:39,569][146667] Updated weights for policy 0, policy_version 13440 (0.0004) [2023-03-12 04:41:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 6909952. Throughput: 0: 9481.8. Samples: 6898160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:41:42,720][146380] Avg episode reward: [(0, '4542.583')] [2023-03-12 04:41:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013496_6909952.pth... [2023-03-12 04:41:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000012944_6627328.pth [2023-03-12 04:41:43,874][146667] Updated weights for policy 0, policy_version 13520 (0.0003) [2023-03-12 04:41:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 6955008. Throughput: 0: 9470.7. Samples: 6954988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:47,730][146380] Avg episode reward: [(0, '4513.595')] [2023-03-12 04:41:48,269][146667] Updated weights for policy 0, policy_version 13600 (0.0003) [2023-03-12 04:41:52,704][146667] Updated weights for policy 0, policy_version 13680 (0.0004) [2023-03-12 04:41:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 7004160. Throughput: 0: 9446.8. Samples: 6982876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:41:52,720][146380] Avg episode reward: [(0, '4560.168')] [2023-03-12 04:41:57,210][146667] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-12 04:41:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 7049216. Throughput: 0: 9389.3. Samples: 7036992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:41:57,720][146380] Avg episode reward: [(0, '4528.928')] [2023-03-12 04:41:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013768_7049216.pth... [2023-03-12 04:41:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013224_6770688.pth [2023-03-12 04:42:01,550][146667] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-12 04:42:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 7094272. Throughput: 0: 9413.3. Samples: 7093908. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:42:02,730][146380] Avg episode reward: [(0, '4473.675')] [2023-03-12 04:42:05,830][146667] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-12 04:42:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 7143424. Throughput: 0: 9383.9. Samples: 7122216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:42:07,720][146380] Avg episode reward: [(0, '4470.268')] [2023-03-12 04:42:09,964][146667] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-12 04:42:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 7192576. Throughput: 0: 9397.0. Samples: 7181232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:42:12,723][146380] Avg episode reward: [(0, '4466.280')] [2023-03-12 04:42:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014048_7192576.pth... [2023-03-12 04:42:12,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013496_6909952.pth [2023-03-12 04:42:14,107][146667] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-12 04:42:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 7241728. Throughput: 0: 9493.2. Samples: 7240900. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:42:17,720][146380] Avg episode reward: [(0, '4476.282')] [2023-03-12 04:42:18,217][146667] Updated weights for policy 0, policy_version 14160 (0.0004) [2023-03-12 04:42:22,286][146667] Updated weights for policy 0, policy_version 14240 (0.0004) [2023-03-12 04:42:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9302.8). Total num frames: 7294976. Throughput: 0: 9547.9. Samples: 7271140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:42:22,720][146380] Avg episode reward: [(0, '4482.178')] [2023-03-12 04:42:26,296][146667] Updated weights for policy 0, policy_version 14320 (0.0004) [2023-03-12 04:42:27,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9557.3, 300 sec: 9302.8). Total num frames: 7344128. Throughput: 0: 9639.1. Samples: 7331920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:42:27,720][146380] Avg episode reward: [(0, '4518.256')] [2023-03-12 04:42:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014344_7344128.pth... [2023-03-12 04:42:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000013768_7049216.pth [2023-03-12 04:42:30,334][146667] Updated weights for policy 0, policy_version 14400 (0.0004) [2023-03-12 04:42:32,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9288.9). Total num frames: 7393280. Throughput: 0: 9739.7. Samples: 7393272. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:42:32,720][146380] Avg episode reward: [(0, '4542.075')] [2023-03-12 04:42:34,396][146667] Updated weights for policy 0, policy_version 14480 (0.0004) [2023-03-12 04:42:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9316.7). Total num frames: 7446528. Throughput: 0: 9787.8. Samples: 7423328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:42:37,720][146380] Avg episode reward: [(0, '4097.968')] [2023-03-12 04:42:38,501][146667] Updated weights for policy 0, policy_version 14560 (0.0004) [2023-03-12 04:42:42,629][146667] Updated weights for policy 0, policy_version 14640 (0.0004) [2023-03-12 04:42:42,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9316.7). Total num frames: 7495680. Throughput: 0: 9919.2. Samples: 7483356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:42:42,720][146380] Avg episode reward: [(0, '4024.968')] [2023-03-12 04:42:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014640_7495680.pth... [2023-03-12 04:42:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014048_7192576.pth [2023-03-12 04:42:46,670][146667] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-12 04:42:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9330.6). Total num frames: 7544832. Throughput: 0: 9996.4. Samples: 7543748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:42:47,720][146380] Avg episode reward: [(0, '4542.159')] [2023-03-12 04:42:50,684][146667] Updated weights for policy 0, policy_version 14800 (0.0004) [2023-03-12 04:42:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9344.4). Total num frames: 7598080. Throughput: 0: 10031.8. Samples: 7573648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:42:52,720][146380] Avg episode reward: [(0, '4533.516')] [2023-03-12 04:42:54,704][146667] Updated weights for policy 0, policy_version 14880 (0.0004) [2023-03-12 04:42:57,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9358.3). Total num frames: 7647232. Throughput: 0: 10082.4. Samples: 7634940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:42:57,720][146380] Avg episode reward: [(0, '4539.445')] [2023-03-12 04:42:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014936_7647232.pth... [2023-03-12 04:42:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014344_7344128.pth [2023-03-12 04:42:58,798][146667] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-12 04:43:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9372.2). Total num frames: 7696384. Throughput: 0: 10112.0. Samples: 7695940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:02,720][146380] Avg episode reward: [(0, '4550.787')] [2023-03-12 04:43:02,792][146667] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-12 04:43:06,820][146667] Updated weights for policy 0, policy_version 15120 (0.0004) [2023-03-12 04:43:07,719][146380] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9386.1). Total num frames: 7749632. Throughput: 0: 10112.5. Samples: 7726204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:07,720][146380] Avg episode reward: [(0, '4573.201')] [2023-03-12 04:43:07,720][146623] Saving new best policy, reward=4573.201! [2023-03-12 04:43:10,870][146667] Updated weights for policy 0, policy_version 15200 (0.0004) [2023-03-12 04:43:12,720][146380] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9400.0). Total num frames: 7798784. Throughput: 0: 10113.4. Samples: 7787024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:43:12,720][146380] Avg episode reward: [(0, '4420.726')] [2023-03-12 04:43:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015232_7798784.pth... [2023-03-12 04:43:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014640_7495680.pth [2023-03-12 04:43:14,865][146667] Updated weights for policy 0, policy_version 15280 (0.0004) [2023-03-12 04:43:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9427.7). Total num frames: 7852032. Throughput: 0: 10122.6. Samples: 7848788. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:43:17,720][146380] Avg episode reward: [(0, '4490.480')] [2023-03-12 04:43:18,842][146667] Updated weights for policy 0, policy_version 15360 (0.0004) [2023-03-12 04:43:22,720][146380] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9427.7). Total num frames: 7901184. Throughput: 0: 10136.5. Samples: 7879472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:22,720][146380] Avg episode reward: [(0, '4399.254')] [2023-03-12 04:43:22,902][146667] Updated weights for policy 0, policy_version 15440 (0.0004) [2023-03-12 04:43:26,919][146667] Updated weights for policy 0, policy_version 15520 (0.0004) [2023-03-12 04:43:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9441.6). Total num frames: 7950336. Throughput: 0: 10145.7. Samples: 7939912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:27,720][146380] Avg episode reward: [(0, '4568.487')] [2023-03-12 04:43:27,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015536_7954432.pth... [2023-03-12 04:43:27,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000014936_7647232.pth [2023-03-12 04:43:30,984][146667] Updated weights for policy 0, policy_version 15600 (0.0004) [2023-03-12 04:43:32,719][146380] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 9469.4). Total num frames: 8003584. Throughput: 0: 10143.6. Samples: 8000208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:32,720][146380] Avg episode reward: [(0, '4497.531')] [2023-03-12 04:43:35,111][146667] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-12 04:43:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9469.4). Total num frames: 8052736. Throughput: 0: 10153.3. Samples: 8030548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:43:37,720][146380] Avg episode reward: [(0, '4496.477')] [2023-03-12 04:43:39,140][146667] Updated weights for policy 0, policy_version 15760 (0.0004) [2023-03-12 04:43:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 10103.5, 300 sec: 9483.3). Total num frames: 8101888. Throughput: 0: 10132.5. Samples: 8090904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:43:42,720][146380] Avg episode reward: [(0, '4539.251')] [2023-03-12 04:43:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015824_8101888.pth... [2023-03-12 04:43:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015232_7798784.pth [2023-03-12 04:43:43,223][146667] Updated weights for policy 0, policy_version 15840 (0.0004) [2023-03-12 04:43:47,339][146667] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-12 04:43:47,719][146380] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9497.2). Total num frames: 8151040. Throughput: 0: 10113.7. Samples: 8151056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:43:47,720][146380] Avg episode reward: [(0, '4560.134')] [2023-03-12 04:43:51,376][146667] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-12 04:43:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9524.9). Total num frames: 8204288. Throughput: 0: 10108.2. Samples: 8181072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:43:52,720][146380] Avg episode reward: [(0, '4553.567')] [2023-03-12 04:43:55,627][146667] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-12 04:43:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9524.9). Total num frames: 8249344. Throughput: 0: 10071.6. Samples: 8240244. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:43:57,720][146380] Avg episode reward: [(0, '4555.688')] [2023-03-12 04:43:57,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016120_8253440.pth... [2023-03-12 04:43:57,741][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015536_7954432.pth [2023-03-12 04:43:59,796][146667] Updated weights for policy 0, policy_version 16160 (0.0004) [2023-03-12 04:44:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 10035.2, 300 sec: 9538.8). Total num frames: 8298496. Throughput: 0: 9973.8. Samples: 8297608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:44:02,720][146380] Avg episode reward: [(0, '4547.500')] [2023-03-12 04:44:04,183][146667] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-12 04:44:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9538.8). Total num frames: 8347648. Throughput: 0: 9931.0. Samples: 8326368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:44:07,720][146380] Avg episode reward: [(0, '4544.572')] [2023-03-12 04:44:08,341][146667] Updated weights for policy 0, policy_version 16320 (0.0004) [2023-03-12 04:44:12,549][146667] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-12 04:44:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9552.7). Total num frames: 8396800. Throughput: 0: 9886.8. Samples: 8384816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:44:12,720][146380] Avg episode reward: [(0, '4535.205')] [2023-03-12 04:44:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016400_8396800.pth... [2023-03-12 04:44:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000015824_8101888.pth [2023-03-12 04:44:16,737][146667] Updated weights for policy 0, policy_version 16480 (0.0004) [2023-03-12 04:44:17,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9566.6). Total num frames: 8445952. Throughput: 0: 9850.8. Samples: 8443496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:44:17,730][146380] Avg episode reward: [(0, '4430.774')] [2023-03-12 04:44:20,952][146667] Updated weights for policy 0, policy_version 16560 (0.0004) [2023-03-12 04:44:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9580.5). Total num frames: 8495104. Throughput: 0: 9829.8. Samples: 8472888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:44:22,720][146380] Avg episode reward: [(0, '4330.189')] [2023-03-12 04:44:25,294][146667] Updated weights for policy 0, policy_version 16640 (0.0004) [2023-03-12 04:44:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9566.6). Total num frames: 8540160. Throughput: 0: 9754.7. Samples: 8529864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:44:27,723][146380] Avg episode reward: [(0, '4539.736')] [2023-03-12 04:44:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016680_8540160.pth... [2023-03-12 04:44:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016120_8253440.pth [2023-03-12 04:44:29,597][146667] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-12 04:44:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 8589312. Throughput: 0: 9682.1. Samples: 8586752. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:44:32,730][146380] Avg episode reward: [(0, '4338.836')] [2023-03-12 04:44:33,957][146667] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-12 04:44:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 8634368. Throughput: 0: 9621.2. Samples: 8614024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:44:37,720][146380] Avg episode reward: [(0, '4411.137')] [2023-03-12 04:44:38,426][146667] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-12 04:44:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 8679424. Throughput: 0: 9530.7. Samples: 8669124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:44:42,730][146380] Avg episode reward: [(0, '4344.562')] [2023-03-12 04:44:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016952_8679424.pth... [2023-03-12 04:44:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016400_8396800.pth [2023-03-12 04:44:42,940][146667] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-12 04:44:47,349][146667] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-12 04:44:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 8724480. Throughput: 0: 9486.4. Samples: 8724496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:44:47,730][146380] Avg episode reward: [(0, '4368.012')] [2023-03-12 04:44:51,720][146667] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-12 04:44:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 8773632. Throughput: 0: 9481.5. Samples: 8753036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:44:52,720][146380] Avg episode reward: [(0, '4556.395')] [2023-03-12 04:44:56,138][146667] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-12 04:44:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 8818688. Throughput: 0: 9406.6. Samples: 8808112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:44:57,720][146380] Avg episode reward: [(0, '4482.167')] [2023-03-12 04:44:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017224_8818688.pth... [2023-03-12 04:44:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016680_8540160.pth [2023-03-12 04:45:00,547][146667] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-12 04:45:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 8863744. Throughput: 0: 9339.2. Samples: 8863760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:02,720][146380] Avg episode reward: [(0, '4525.044')] [2023-03-12 04:45:04,957][146667] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-12 04:45:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 8912896. Throughput: 0: 9320.2. Samples: 8892296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:07,720][146380] Avg episode reward: [(0, '4533.984')] [2023-03-12 04:45:09,453][146667] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-12 04:45:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 8957952. Throughput: 0: 9241.6. Samples: 8945736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:12,720][146380] Avg episode reward: [(0, '4514.908')] [2023-03-12 04:45:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017496_8957952.pth... [2023-03-12 04:45:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000016952_8679424.pth [2023-03-12 04:45:13,984][146667] Updated weights for policy 0, policy_version 17520 (0.0004) [2023-03-12 04:45:17,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9580.5). Total num frames: 9003008. Throughput: 0: 9206.4. Samples: 9001040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:17,720][146380] Avg episode reward: [(0, '3756.088')] [2023-03-12 04:45:18,461][146667] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-12 04:45:22,720][146380] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9580.5). Total num frames: 9043968. Throughput: 0: 9190.4. Samples: 9027592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:22,720][146380] Avg episode reward: [(0, '4522.967')] [2023-03-12 04:45:23,212][146667] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-12 04:45:27,720][146380] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9580.5). Total num frames: 9089024. Throughput: 0: 9109.9. Samples: 9079068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:27,720][146380] Avg episode reward: [(0, '4510.721')] [2023-03-12 04:45:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017752_9089024.pth... [2023-03-12 04:45:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017224_8818688.pth [2023-03-12 04:45:27,920][146667] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-12 04:45:32,116][146667] Updated weights for policy 0, policy_version 17840 (0.0004) [2023-03-12 04:45:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 9138176. Throughput: 0: 9143.6. Samples: 9135960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:32,720][146380] Avg episode reward: [(0, '4554.738')] [2023-03-12 04:45:36,495][146667] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-12 04:45:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 9183232. Throughput: 0: 9132.3. Samples: 9163992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:37,720][146380] Avg episode reward: [(0, '4541.978')] [2023-03-12 04:45:40,892][146667] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-12 04:45:42,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9636.0). Total num frames: 9232384. Throughput: 0: 9155.6. Samples: 9220116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:42,720][146380] Avg episode reward: [(0, '4507.972')] [2023-03-12 04:45:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018032_9232384.pth... [2023-03-12 04:45:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017496_8957952.pth [2023-03-12 04:45:45,439][146667] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-12 04:45:47,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9622.1). Total num frames: 9273344. Throughput: 0: 9104.0. Samples: 9273440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:47,720][146380] Avg episode reward: [(0, '4515.853')] [2023-03-12 04:45:50,014][146667] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-12 04:45:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9636.0). Total num frames: 9322496. Throughput: 0: 9080.2. Samples: 9300904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:45:52,720][146380] Avg episode reward: [(0, '4399.564')] [2023-03-12 04:45:54,490][146667] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-12 04:45:57,720][146380] Fps is (10 sec: 9420.6, 60 sec: 9147.7, 300 sec: 9622.1). Total num frames: 9367552. Throughput: 0: 9100.8. Samples: 9355272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:45:57,720][146380] Avg episode reward: [(0, '4190.725')] [2023-03-12 04:45:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018296_9367552.pth... [2023-03-12 04:45:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000017752_9089024.pth [2023-03-12 04:45:59,046][146667] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-12 04:46:02,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 9412608. Throughput: 0: 9093.6. Samples: 9410252. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:46:02,720][146380] Avg episode reward: [(0, '4457.016')] [2023-03-12 04:46:03,485][146667] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-12 04:46:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9608.2). Total num frames: 9457664. Throughput: 0: 9117.5. Samples: 9437880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:46:07,720][146380] Avg episode reward: [(0, '4518.196')] [2023-03-12 04:46:07,778][146667] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-12 04:46:12,038][146667] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-12 04:46:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 9506816. Throughput: 0: 9260.3. Samples: 9495780. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:46:12,720][146380] Avg episode reward: [(0, '4514.793')] [2023-03-12 04:46:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018568_9506816.pth... [2023-03-12 04:46:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018032_9232384.pth [2023-03-12 04:46:16,331][146667] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-12 04:46:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9608.2). Total num frames: 9555968. Throughput: 0: 9270.2. Samples: 9553120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:46:17,720][146380] Avg episode reward: [(0, '4559.142')] [2023-03-12 04:46:20,591][146667] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-12 04:46:22,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 9601024. Throughput: 0: 9289.9. Samples: 9582040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:46:22,720][146380] Avg episode reward: [(0, '4533.721')] [2023-03-12 04:46:24,878][146667] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-12 04:46:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 9650176. Throughput: 0: 9319.1. Samples: 9639476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:46:27,720][146380] Avg episode reward: [(0, '4565.210')] [2023-03-12 04:46:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018848_9650176.pth... [2023-03-12 04:46:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018296_9367552.pth [2023-03-12 04:46:29,276][146667] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-12 04:46:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9608.2). Total num frames: 9695232. Throughput: 0: 9361.4. Samples: 9694704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:46:32,720][146380] Avg episode reward: [(0, '4563.323')] [2023-03-12 04:46:33,797][146667] Updated weights for policy 0, policy_version 18960 (0.0004) [2023-03-12 04:46:37,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 9740288. Throughput: 0: 9361.2. Samples: 9722160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:46:37,720][146380] Avg episode reward: [(0, '4557.057')] [2023-03-12 04:46:38,185][146667] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-12 04:46:42,508][146667] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-12 04:46:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9608.2). Total num frames: 9789440. Throughput: 0: 9397.6. Samples: 9778164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:46:42,720][146380] Avg episode reward: [(0, '4565.406')] [2023-03-12 04:46:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019120_9789440.pth... [2023-03-12 04:46:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018568_9506816.pth [2023-03-12 04:46:47,036][146667] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-12 04:46:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 9834496. Throughput: 0: 9398.4. Samples: 9833180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:46:47,720][146380] Avg episode reward: [(0, '4560.764')] [2023-03-12 04:46:51,625][146667] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-12 04:46:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 9879552. Throughput: 0: 9377.4. Samples: 9859864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:46:52,720][146380] Avg episode reward: [(0, '4562.281')] [2023-03-12 04:46:56,291][146667] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-12 04:46:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 9924608. Throughput: 0: 9258.8. Samples: 9912428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:46:57,720][146380] Avg episode reward: [(0, '4522.261')] [2023-03-12 04:46:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019384_9924608.pth... [2023-03-12 04:46:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000018848_9650176.pth [2023-03-12 04:47:00,921][146667] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-12 04:47:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9580.5). Total num frames: 9969664. Throughput: 0: 9184.0. Samples: 9966400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:02,720][146380] Avg episode reward: [(0, '4538.291')] [2023-03-12 04:47:05,389][146667] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-12 04:47:07,720][146380] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9552.7). Total num frames: 10010624. Throughput: 0: 9151.2. Samples: 9993844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:07,720][146380] Avg episode reward: [(0, '4493.253')] [2023-03-12 04:47:10,092][146667] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-12 04:47:12,720][146380] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9538.8). Total num frames: 10055680. Throughput: 0: 9032.4. Samples: 10045936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:12,720][146380] Avg episode reward: [(0, '4494.649')] [2023-03-12 04:47:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019640_10055680.pth... [2023-03-12 04:47:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019120_9789440.pth [2023-03-12 04:47:14,830][146667] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-12 04:47:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9511.0). Total num frames: 10100736. Throughput: 0: 8969.1. Samples: 10098312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:17,720][146380] Avg episode reward: [(0, '4505.637')] [2023-03-12 04:47:19,494][146667] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-12 04:47:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9483.3). Total num frames: 10141696. Throughput: 0: 8942.8. Samples: 10124584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:22,720][146380] Avg episode reward: [(0, '4516.811')] [2023-03-12 04:47:24,253][146667] Updated weights for policy 0, policy_version 19840 (0.0004) [2023-03-12 04:47:27,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9469.4). Total num frames: 10186752. Throughput: 0: 8841.2. Samples: 10176020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:27,720][146380] Avg episode reward: [(0, '4526.974')] [2023-03-12 04:47:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019896_10186752.pth... [2023-03-12 04:47:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019384_9924608.pth [2023-03-12 04:47:28,926][146667] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-12 04:47:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9427.7). Total num frames: 10227712. Throughput: 0: 8776.4. Samples: 10228120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:47:32,720][146380] Avg episode reward: [(0, '4537.482')] [2023-03-12 04:47:33,641][146667] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-12 04:47:37,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9413.9). Total num frames: 10272768. Throughput: 0: 8789.0. Samples: 10255368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:47:37,720][146380] Avg episode reward: [(0, '4539.425')] [2023-03-12 04:47:38,346][146667] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-12 04:47:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9400.0). Total num frames: 10317824. Throughput: 0: 8775.2. Samples: 10307312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:47:42,720][146380] Avg episode reward: [(0, '4557.195')] [2023-03-12 04:47:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020152_10317824.pth... [2023-03-12 04:47:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019640_10055680.pth [2023-03-12 04:47:42,927][146667] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-12 04:47:47,474][146667] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-12 04:47:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9372.2). Total num frames: 10362880. Throughput: 0: 8781.1. Samples: 10361552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:47,720][146380] Avg episode reward: [(0, '4454.689')] [2023-03-12 04:47:52,109][146667] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-12 04:47:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 9358.3). Total num frames: 10407936. Throughput: 0: 8766.9. Samples: 10388352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:52,720][146380] Avg episode reward: [(0, '4523.271')] [2023-03-12 04:47:56,679][146667] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-12 04:47:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9344.4). Total num frames: 10452992. Throughput: 0: 8791.3. Samples: 10441544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:47:57,720][146380] Avg episode reward: [(0, '4520.650')] [2023-03-12 04:47:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020416_10452992.pth... [2023-03-12 04:47:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000019896_10186752.pth [2023-03-12 04:48:01,247][146667] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-12 04:48:02,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 9316.7). Total num frames: 10498048. Throughput: 0: 8825.1. Samples: 10495440. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:48:02,720][146380] Avg episode reward: [(0, '4530.458')] [2023-03-12 04:48:05,802][146667] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-12 04:48:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9302.8). Total num frames: 10543104. Throughput: 0: 8844.6. Samples: 10522592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:48:07,720][146380] Avg episode reward: [(0, '4553.066')] [2023-03-12 04:48:10,336][146667] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-12 04:48:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9275.0). Total num frames: 10588160. Throughput: 0: 8906.9. Samples: 10576832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:12,720][146380] Avg episode reward: [(0, '4544.487')] [2023-03-12 04:48:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020680_10588160.pth... [2023-03-12 04:48:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020152_10317824.pth [2023-03-12 04:48:14,865][146667] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-12 04:48:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9261.1). Total num frames: 10633216. Throughput: 0: 8947.5. Samples: 10630756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:17,720][146380] Avg episode reward: [(0, '4541.165')] [2023-03-12 04:48:19,493][146667] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-12 04:48:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9247.2). Total num frames: 10678272. Throughput: 0: 8936.1. Samples: 10657492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:22,720][146380] Avg episode reward: [(0, '4530.925')] [2023-03-12 04:48:23,966][146667] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-12 04:48:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9219.5). Total num frames: 10723328. Throughput: 0: 8989.3. Samples: 10711832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:27,720][146380] Avg episode reward: [(0, '4538.138')] [2023-03-12 04:48:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020944_10723328.pth... [2023-03-12 04:48:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020416_10452992.pth [2023-03-12 04:48:28,487][146667] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-12 04:48:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 10768384. Throughput: 0: 9006.6. Samples: 10766848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:32,720][146380] Avg episode reward: [(0, '4510.640')] [2023-03-12 04:48:32,978][146667] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-12 04:48:37,531][146667] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-12 04:48:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 10813440. Throughput: 0: 9011.5. Samples: 10793868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:48:37,720][146380] Avg episode reward: [(0, '4425.658')] [2023-03-12 04:48:42,153][146667] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-12 04:48:42,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 10858496. Throughput: 0: 9014.8. Samples: 10847212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:48:42,720][146380] Avg episode reward: [(0, '4333.052')] [2023-03-12 04:48:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021208_10858496.pth... [2023-03-12 04:48:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020680_10588160.pth [2023-03-12 04:48:46,649][146667] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-12 04:48:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9150.0). Total num frames: 10903552. Throughput: 0: 9029.3. Samples: 10901760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:48:47,720][146380] Avg episode reward: [(0, '4530.176')] [2023-03-12 04:48:51,139][146667] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-12 04:48:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9150.0). Total num frames: 10948608. Throughput: 0: 9028.7. Samples: 10928884. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:48:52,720][146380] Avg episode reward: [(0, '4534.160')] [2023-03-12 04:48:55,525][146667] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-12 04:48:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 10993664. Throughput: 0: 9073.4. Samples: 10985136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:48:57,720][146380] Avg episode reward: [(0, '4546.201')] [2023-03-12 04:48:57,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021480_10997760.pth... [2023-03-12 04:48:57,741][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000020944_10723328.pth [2023-03-12 04:48:59,881][146667] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-12 04:49:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 11042816. Throughput: 0: 9122.6. Samples: 11041272. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:49:02,720][146380] Avg episode reward: [(0, '4524.199')] [2023-03-12 04:49:04,155][146667] Updated weights for policy 0, policy_version 21600 (0.0004) [2023-03-12 04:49:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 11091968. Throughput: 0: 9176.3. Samples: 11070424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:49:07,720][146380] Avg episode reward: [(0, '4518.186')] [2023-03-12 04:49:08,509][146667] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-12 04:49:12,680][146667] Updated weights for policy 0, policy_version 21760 (0.0004) [2023-03-12 04:49:12,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 11141120. Throughput: 0: 9246.0. Samples: 11127904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:49:12,720][146380] Avg episode reward: [(0, '4522.270')] [2023-03-12 04:49:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021760_11141120.pth... [2023-03-12 04:49:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021208_10858496.pth [2023-03-12 04:49:17,100][146667] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-12 04:49:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 11186176. Throughput: 0: 9273.1. Samples: 11184136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:49:17,720][146380] Avg episode reward: [(0, '4518.483')] [2023-03-12 04:49:21,596][146667] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-12 04:49:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 11231232. Throughput: 0: 9275.7. Samples: 11211276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:49:22,720][146380] Avg episode reward: [(0, '4494.145')] [2023-03-12 04:49:26,029][146667] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-12 04:49:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 11276288. Throughput: 0: 9331.6. Samples: 11267136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:49:27,720][146380] Avg episode reward: [(0, '4503.268')] [2023-03-12 04:49:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022024_11276288.pth... [2023-03-12 04:49:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021480_10997760.pth [2023-03-12 04:49:30,593][146667] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-12 04:49:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 11321344. Throughput: 0: 9290.4. Samples: 11319828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:49:32,720][146380] Avg episode reward: [(0, '4495.744')] [2023-03-12 04:49:35,314][146667] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-12 04:49:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 11366400. Throughput: 0: 9268.9. Samples: 11345984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:49:37,720][146380] Avg episode reward: [(0, '4511.720')] [2023-03-12 04:49:39,946][146667] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-12 04:49:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 11411456. Throughput: 0: 9202.1. Samples: 11399232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:49:42,720][146380] Avg episode reward: [(0, '4508.972')] [2023-03-12 04:49:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022288_11411456.pth... [2023-03-12 04:49:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000021760_11141120.pth [2023-03-12 04:49:44,609][146667] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-12 04:49:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 11452416. Throughput: 0: 9131.0. Samples: 11452168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:49:47,720][146380] Avg episode reward: [(0, '4488.343')] [2023-03-12 04:49:49,171][146667] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-12 04:49:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 11497472. Throughput: 0: 9089.9. Samples: 11479468. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:49:52,720][146380] Avg episode reward: [(0, '4489.453')] [2023-03-12 04:49:53,745][146667] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-12 04:49:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 11542528. Throughput: 0: 9001.6. Samples: 11532976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:49:57,720][146380] Avg episode reward: [(0, '4524.000')] [2023-03-12 04:49:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022544_11542528.pth... [2023-03-12 04:49:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022024_11276288.pth [2023-03-12 04:49:58,326][146667] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-12 04:50:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9066.7). Total num frames: 11587584. Throughput: 0: 8925.1. Samples: 11585764. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:50:02,720][146380] Avg episode reward: [(0, '4521.360')] [2023-03-12 04:50:03,012][146667] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-12 04:50:07,705][146667] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-12 04:50:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9066.7). Total num frames: 11632640. Throughput: 0: 8906.1. Samples: 11612052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:50:07,720][146380] Avg episode reward: [(0, '4500.594')] [2023-03-12 04:50:12,385][146667] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-12 04:50:12,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 9052.9). Total num frames: 11673600. Throughput: 0: 8835.1. Samples: 11664716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:50:12,720][146380] Avg episode reward: [(0, '4484.365')] [2023-03-12 04:50:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022800_11673600.pth... [2023-03-12 04:50:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022288_11411456.pth [2023-03-12 04:50:16,867][146667] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-12 04:50:17,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9066.7). Total num frames: 11718656. Throughput: 0: 8864.3. Samples: 11718720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:50:17,720][146380] Avg episode reward: [(0, '4474.334')] [2023-03-12 04:50:21,516][146667] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-12 04:50:22,720][146380] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 9066.7). Total num frames: 11763712. Throughput: 0: 8869.5. Samples: 11745112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:50:22,720][146380] Avg episode reward: [(0, '4495.599')] [2023-03-12 04:50:26,112][146667] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-12 04:50:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9052.9). Total num frames: 11808768. Throughput: 0: 8874.4. Samples: 11798580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:50:27,721][146380] Avg episode reward: [(0, '4414.733')] [2023-03-12 04:50:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023064_11808768.pth... [2023-03-12 04:50:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022544_11542528.pth [2023-03-12 04:50:30,834][146667] Updated weights for policy 0, policy_version 23120 (0.0006) [2023-03-12 04:50:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9052.9). Total num frames: 11853824. Throughput: 0: 8851.2. Samples: 11850472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:50:32,730][146380] Avg episode reward: [(0, '4428.644')] [2023-03-12 04:50:35,479][146667] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-12 04:50:37,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 9025.1). Total num frames: 11894784. Throughput: 0: 8834.8. Samples: 11877036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:50:37,720][146380] Avg episode reward: [(0, '4483.786')] [2023-03-12 04:50:40,242][146667] Updated weights for policy 0, policy_version 23280 (0.0005) [2023-03-12 04:50:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 9039.0). Total num frames: 11939840. Throughput: 0: 8791.8. Samples: 11928608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:50:42,730][146380] Avg episode reward: [(0, '4430.367')] [2023-03-12 04:50:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023320_11939840.pth... [2023-03-12 04:50:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000022800_11673600.pth [2023-03-12 04:50:44,946][146667] Updated weights for policy 0, policy_version 23360 (0.0006) [2023-03-12 04:50:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 9011.2). Total num frames: 11980800. Throughput: 0: 8780.2. Samples: 11980872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:50:47,720][146380] Avg episode reward: [(0, '4361.202')] [2023-03-12 04:50:49,654][146667] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-12 04:50:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 9011.2). Total num frames: 12025856. Throughput: 0: 8779.3. Samples: 12007120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:50:52,720][146380] Avg episode reward: [(0, '4424.063')] [2023-03-12 04:50:54,348][146667] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-12 04:50:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9011.2). Total num frames: 12070912. Throughput: 0: 8780.0. Samples: 12059816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:50:57,720][146380] Avg episode reward: [(0, '4483.019')] [2023-03-12 04:50:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023576_12070912.pth... [2023-03-12 04:50:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023064_11808768.pth [2023-03-12 04:50:58,953][146667] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-12 04:51:02,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8997.3). Total num frames: 12111872. Throughput: 0: 8732.4. Samples: 12111676. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:51:02,720][146380] Avg episode reward: [(0, '4473.678')] [2023-03-12 04:51:03,992][146667] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-12 04:51:07,720][146380] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8969.5). Total num frames: 12152832. Throughput: 0: 8678.4. Samples: 12135640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:51:07,720][146380] Avg episode reward: [(0, '4474.271')] [2023-03-12 04:51:08,908][146667] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-12 04:51:12,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8941.8). Total num frames: 12193792. Throughput: 0: 8598.9. Samples: 12185532. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:51:12,720][146380] Avg episode reward: [(0, '4472.417')] [2023-03-12 04:51:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023816_12193792.pth... [2023-03-12 04:51:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023320_11939840.pth [2023-03-12 04:51:13,875][146667] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-12 04:51:17,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8601.6, 300 sec: 8927.9). Total num frames: 12234752. Throughput: 0: 8541.0. Samples: 12234816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:51:17,720][146380] Avg episode reward: [(0, '4472.996')] [2023-03-12 04:51:18,770][146667] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-12 04:51:22,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8900.1). Total num frames: 12275712. Throughput: 0: 8497.2. Samples: 12259408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:51:22,720][146380] Avg episode reward: [(0, '4470.791')] [2023-03-12 04:51:23,724][146667] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-12 04:51:27,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8900.1). Total num frames: 12320768. Throughput: 0: 8467.6. Samples: 12309648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:51:27,720][146380] Avg episode reward: [(0, '4454.532')] [2023-03-12 04:51:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024064_12320768.pth... [2023-03-12 04:51:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023576_12070912.pth [2023-03-12 04:51:28,687][146667] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-12 04:51:32,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8872.4). Total num frames: 12357632. Throughput: 0: 8374.0. Samples: 12357704. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:51:32,720][146380] Avg episode reward: [(0, '4408.598')] [2023-03-12 04:51:33,819][146667] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-12 04:51:37,719][146380] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 8844.6). Total num frames: 12398592. Throughput: 0: 8337.1. Samples: 12382288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:51:37,720][146380] Avg episode reward: [(0, '4458.154')] [2023-03-12 04:51:38,740][146667] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-12 04:51:42,720][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8830.7). Total num frames: 12439552. Throughput: 0: 8274.0. Samples: 12432148. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:51:42,720][146380] Avg episode reward: [(0, '4460.057')] [2023-03-12 04:51:42,731][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024304_12443648.pth... [2023-03-12 04:51:42,733][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000023816_12193792.pth [2023-03-12 04:51:43,753][146667] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-12 04:51:47,719][146380] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8816.8). Total num frames: 12480512. Throughput: 0: 8208.6. Samples: 12481064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:51:47,720][146380] Avg episode reward: [(0, '4465.318')] [2023-03-12 04:51:48,707][146667] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-12 04:51:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8816.8). Total num frames: 12525568. Throughput: 0: 8227.6. Samples: 12505880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:51:52,720][146380] Avg episode reward: [(0, '4460.613')] [2023-03-12 04:51:53,688][146667] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-12 04:51:57,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8802.9). Total num frames: 12566528. Throughput: 0: 8211.5. Samples: 12555048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:51:57,720][146380] Avg episode reward: [(0, '4382.523')] [2023-03-12 04:51:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024544_12566528.pth... [2023-03-12 04:51:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024064_12320768.pth [2023-03-12 04:51:58,688][146667] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-12 04:52:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8802.9). Total num frames: 12607488. Throughput: 0: 8204.1. Samples: 12604000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:52:02,720][146380] Avg episode reward: [(0, '4447.985')] [2023-03-12 04:52:03,727][146667] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-12 04:52:07,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8789.0). Total num frames: 12648448. Throughput: 0: 8212.2. Samples: 12628956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:07,720][146380] Avg episode reward: [(0, '4466.586')] [2023-03-12 04:52:08,665][146667] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-12 04:52:12,720][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8775.2). Total num frames: 12689408. Throughput: 0: 8206.7. Samples: 12678948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:12,723][146380] Avg episode reward: [(0, '4474.559')] [2023-03-12 04:52:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024784_12689408.pth... [2023-03-12 04:52:12,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024304_12443648.pth [2023-03-12 04:52:13,490][146667] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-12 04:52:17,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8260.3, 300 sec: 8775.2). Total num frames: 12730368. Throughput: 0: 8279.9. Samples: 12730300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:17,720][146380] Avg episode reward: [(0, '4486.912')] [2023-03-12 04:52:18,367][146667] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-12 04:52:22,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8260.3, 300 sec: 8761.3). Total num frames: 12771328. Throughput: 0: 8281.4. Samples: 12754952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:22,720][146380] Avg episode reward: [(0, '4448.497')] [2023-03-12 04:52:23,302][146667] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-12 04:52:27,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 8775.2). Total num frames: 12816384. Throughput: 0: 8293.7. Samples: 12805364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:27,720][146380] Avg episode reward: [(0, '4429.068')] [2023-03-12 04:52:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025032_12816384.pth... [2023-03-12 04:52:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024544_12566528.pth [2023-03-12 04:52:28,087][146667] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-12 04:52:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8761.3). Total num frames: 12857344. Throughput: 0: 8338.1. Samples: 12856280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:32,720][146380] Avg episode reward: [(0, '4486.564')] [2023-03-12 04:52:33,004][146667] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-12 04:52:37,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8747.4). Total num frames: 12898304. Throughput: 0: 8340.5. Samples: 12881200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:52:37,720][146380] Avg episode reward: [(0, '4460.737')] [2023-03-12 04:52:37,882][146667] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-12 04:52:42,697][146667] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-12 04:52:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8747.4). Total num frames: 12943360. Throughput: 0: 8368.4. Samples: 12931624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:52:42,720][146380] Avg episode reward: [(0, '4511.347')] [2023-03-12 04:52:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025280_12943360.pth... [2023-03-12 04:52:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000024784_12689408.pth [2023-03-12 04:52:47,696][146667] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-12 04:52:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8733.5). Total num frames: 12984320. Throughput: 0: 8378.9. Samples: 12981052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:52:47,720][146380] Avg episode reward: [(0, '4494.940')] [2023-03-12 04:52:52,599][146667] Updated weights for policy 0, policy_version 25440 (0.0004) [2023-03-12 04:52:52,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8719.6). Total num frames: 13025280. Throughput: 0: 8391.1. Samples: 13006556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:52:52,720][146380] Avg episode reward: [(0, '4410.905')] [2023-03-12 04:52:57,510][146667] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-12 04:52:57,720][146380] Fps is (10 sec: 8191.9, 60 sec: 8328.5, 300 sec: 8705.7). Total num frames: 13066240. Throughput: 0: 8386.4. Samples: 13056336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:52:57,720][146380] Avg episode reward: [(0, '4494.307')] [2023-03-12 04:52:57,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025520_13066240.pth... [2023-03-12 04:52:57,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025032_12816384.pth [2023-03-12 04:53:02,353][146667] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-12 04:53:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8691.9). Total num frames: 13107200. Throughput: 0: 8375.7. Samples: 13107208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:53:02,720][146380] Avg episode reward: [(0, '4422.512')] [2023-03-12 04:53:07,366][146667] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-12 04:53:07,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8678.0). Total num frames: 13148160. Throughput: 0: 8373.9. Samples: 13131776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:53:07,720][146380] Avg episode reward: [(0, '4436.627')] [2023-03-12 04:53:12,370][146667] Updated weights for policy 0, policy_version 25760 (0.0004) [2023-03-12 04:53:12,720][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8664.1). Total num frames: 13189120. Throughput: 0: 8346.0. Samples: 13180936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:53:12,720][146380] Avg episode reward: [(0, '4493.874')] [2023-03-12 04:53:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025760_13189120.pth... [2023-03-12 04:53:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025280_12943360.pth [2023-03-12 04:53:17,219][146667] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-12 04:53:17,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8328.6, 300 sec: 8650.2). Total num frames: 13230080. Throughput: 0: 8326.4. Samples: 13230968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:53:17,720][146380] Avg episode reward: [(0, '4475.807')] [2023-03-12 04:53:22,116][146667] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-12 04:53:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8650.2). Total num frames: 13275136. Throughput: 0: 8332.4. Samples: 13256160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:53:22,720][146380] Avg episode reward: [(0, '4103.097')] [2023-03-12 04:53:27,134][146667] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-12 04:53:27,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8328.5, 300 sec: 8636.3). Total num frames: 13316096. Throughput: 0: 8303.1. Samples: 13305264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:53:27,720][146380] Avg episode reward: [(0, '4392.650')] [2023-03-12 04:53:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026008_13316096.pth... [2023-03-12 04:53:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025520_13066240.pth [2023-03-12 04:53:32,036][146667] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-12 04:53:32,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8622.4). Total num frames: 13357056. Throughput: 0: 8323.7. Samples: 13355620. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:53:32,720][146380] Avg episode reward: [(0, '4455.918')] [2023-03-12 04:53:36,939][146667] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-12 04:53:37,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 8608.5). Total num frames: 13398016. Throughput: 0: 8308.1. Samples: 13380420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:53:37,720][146380] Avg episode reward: [(0, '4469.905')] [2023-03-12 04:53:41,687][146667] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-12 04:53:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8608.5). Total num frames: 13443072. Throughput: 0: 8342.8. Samples: 13431760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:53:42,720][146380] Avg episode reward: [(0, '4488.734')] [2023-03-12 04:53:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026256_13443072.pth... [2023-03-12 04:53:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000025760_13189120.pth [2023-03-12 04:53:46,581][146667] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-12 04:53:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8328.5, 300 sec: 8594.7). Total num frames: 13484032. Throughput: 0: 8338.3. Samples: 13482432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:53:47,720][146380] Avg episode reward: [(0, '4503.188')] [2023-03-12 04:53:51,423][146667] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-12 04:53:52,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8328.5, 300 sec: 8580.8). Total num frames: 13524992. Throughput: 0: 8353.4. Samples: 13507680. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:53:52,720][146380] Avg episode reward: [(0, '4537.930')] [2023-03-12 04:53:56,240][146667] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-12 04:53:57,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8566.9). Total num frames: 13570048. Throughput: 0: 8389.4. Samples: 13558460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:53:57,720][146380] Avg episode reward: [(0, '4533.472')] [2023-03-12 04:53:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026504_13570048.pth... [2023-03-12 04:53:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026008_13316096.pth [2023-03-12 04:54:01,016][146667] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-12 04:54:02,719][146380] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8539.1). Total num frames: 13611008. Throughput: 0: 8435.1. Samples: 13610548. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:54:02,720][146380] Avg episode reward: [(0, '4492.043')] [2023-03-12 04:54:05,750][146667] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-12 04:54:07,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8396.8, 300 sec: 8511.4). Total num frames: 13651968. Throughput: 0: 8442.9. Samples: 13636092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:07,720][146380] Avg episode reward: [(0, '4518.771')] [2023-03-12 04:54:10,724][146667] Updated weights for policy 0, policy_version 26720 (0.0004) [2023-03-12 04:54:12,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8511.3). Total num frames: 13697024. Throughput: 0: 8452.4. Samples: 13685624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:12,720][146380] Avg episode reward: [(0, '4522.840')] [2023-03-12 04:54:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026752_13697024.pth... [2023-03-12 04:54:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026256_13443072.pth [2023-03-12 04:54:15,553][146667] Updated weights for policy 0, policy_version 26800 (0.0004) [2023-03-12 04:54:17,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 13737984. Throughput: 0: 8483.9. Samples: 13737396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:17,720][146380] Avg episode reward: [(0, '4552.096')] [2023-03-12 04:54:20,166][146667] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-12 04:54:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 13783040. Throughput: 0: 8522.1. Samples: 13763916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:54:22,720][146380] Avg episode reward: [(0, '3585.807')] [2023-03-12 04:54:24,900][146667] Updated weights for policy 0, policy_version 26960 (0.0005) [2023-03-12 04:54:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 13828096. Throughput: 0: 8534.7. Samples: 13815820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:54:27,720][146380] Avg episode reward: [(0, '3997.935')] [2023-03-12 04:54:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027008_13828096.pth... [2023-03-12 04:54:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026504_13570048.pth [2023-03-12 04:54:29,523][146667] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-12 04:54:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 13869056. Throughput: 0: 8591.8. Samples: 13869064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:54:32,720][146380] Avg episode reward: [(0, '4485.545')] [2023-03-12 04:54:34,356][146667] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-12 04:54:37,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 13910016. Throughput: 0: 8578.3. Samples: 13893704. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:54:37,720][146380] Avg episode reward: [(0, '4504.644')] [2023-03-12 04:54:39,324][146667] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-12 04:54:42,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 13955072. Throughput: 0: 8562.0. Samples: 13943748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:42,720][146380] Avg episode reward: [(0, '4515.599')] [2023-03-12 04:54:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027256_13955072.pth... [2023-03-12 04:54:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000026752_13697024.pth [2023-03-12 04:54:44,026][146667] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-12 04:54:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8469.7). Total num frames: 13996032. Throughput: 0: 8565.2. Samples: 13995980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:47,720][146380] Avg episode reward: [(0, '4525.603')] [2023-03-12 04:54:48,865][146667] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-12 04:54:52,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8469.7). Total num frames: 14041088. Throughput: 0: 8559.0. Samples: 14021248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:52,720][146380] Avg episode reward: [(0, '4493.246')] [2023-03-12 04:54:53,481][146667] Updated weights for policy 0, policy_version 27440 (0.0004) [2023-03-12 04:54:57,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8455.8). Total num frames: 14082048. Throughput: 0: 8628.8. Samples: 14073920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:54:57,720][146380] Avg episode reward: [(0, '4517.908')] [2023-03-12 04:54:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027512_14086144.pth... [2023-03-12 04:54:57,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027008_13828096.pth [2023-03-12 04:54:58,192][146667] Updated weights for policy 0, policy_version 27520 (0.0005) [2023-03-12 04:55:02,712][146667] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-12 04:55:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8469.7). Total num frames: 14131200. Throughput: 0: 8674.0. Samples: 14127724. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:02,720][146380] Avg episode reward: [(0, '4483.496')] [2023-03-12 04:55:07,213][146667] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-12 04:55:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8738.1, 300 sec: 8483.6). Total num frames: 14176256. Throughput: 0: 8686.5. Samples: 14154808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:07,720][146380] Avg episode reward: [(0, '4499.484')] [2023-03-12 04:55:11,722][146667] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-12 04:55:12,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8483.6). Total num frames: 14221312. Throughput: 0: 8741.4. Samples: 14209184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:12,720][146380] Avg episode reward: [(0, '4486.909')] [2023-03-12 04:55:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027776_14221312.pth... [2023-03-12 04:55:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027256_13955072.pth [2023-03-12 04:55:16,366][146667] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-12 04:55:17,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8483.6). Total num frames: 14266368. Throughput: 0: 8751.4. Samples: 14262876. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:17,720][146380] Avg episode reward: [(0, '4512.684')] [2023-03-12 04:55:20,803][146667] Updated weights for policy 0, policy_version 27920 (0.0004) [2023-03-12 04:55:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8483.6). Total num frames: 14311424. Throughput: 0: 8827.7. Samples: 14290952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:22,720][146380] Avg episode reward: [(0, '4503.936')] [2023-03-12 04:55:25,401][146667] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-12 04:55:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8483.6). Total num frames: 14356480. Throughput: 0: 8901.1. Samples: 14344296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:27,720][146380] Avg episode reward: [(0, '4489.616')] [2023-03-12 04:55:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028040_14356480.pth... [2023-03-12 04:55:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027512_14086144.pth [2023-03-12 04:55:30,052][146667] Updated weights for policy 0, policy_version 28080 (0.0005) [2023-03-12 04:55:32,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8483.6). Total num frames: 14397440. Throughput: 0: 8902.8. Samples: 14396604. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:55:32,720][146380] Avg episode reward: [(0, '4475.753')] [2023-03-12 04:55:34,913][146667] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-12 04:55:37,719][146380] Fps is (10 sec: 8192.1, 60 sec: 8806.4, 300 sec: 8469.7). Total num frames: 14438400. Throughput: 0: 8906.0. Samples: 14422016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:55:37,720][146380] Avg episode reward: [(0, '4503.841')] [2023-03-12 04:55:39,756][146667] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-12 04:55:42,719][146380] Fps is (10 sec: 8601.5, 60 sec: 8806.4, 300 sec: 8483.6). Total num frames: 14483456. Throughput: 0: 8842.8. Samples: 14471844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:55:42,720][146380] Avg episode reward: [(0, '4500.161')] [2023-03-12 04:55:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028288_14483456.pth... [2023-03-12 04:55:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000027776_14221312.pth [2023-03-12 04:55:44,583][146667] Updated weights for policy 0, policy_version 28320 (0.0005) [2023-03-12 04:55:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8469.7). Total num frames: 14524416. Throughput: 0: 8806.0. Samples: 14523996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:55:47,720][146380] Avg episode reward: [(0, '4472.704')] [2023-03-12 04:55:49,396][146667] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-12 04:55:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8469.7). Total num frames: 14569472. Throughput: 0: 8761.1. Samples: 14549056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:55:52,720][146380] Avg episode reward: [(0, '4503.801')] [2023-03-12 04:55:54,089][146667] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-12 04:55:57,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8469.7). Total num frames: 14610432. Throughput: 0: 8716.5. Samples: 14601428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:55:57,720][146380] Avg episode reward: [(0, '4511.969')] [2023-03-12 04:55:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028536_14610432.pth... [2023-03-12 04:55:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028040_14356480.pth [2023-03-12 04:55:58,888][146667] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-12 04:56:02,719][146380] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8469.7). Total num frames: 14651392. Throughput: 0: 8644.5. Samples: 14651880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:56:02,720][146380] Avg episode reward: [(0, '4503.576')] [2023-03-12 04:56:03,721][146667] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-12 04:56:07,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8483.6). Total num frames: 14696448. Throughput: 0: 8602.2. Samples: 14678052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:56:07,720][146380] Avg episode reward: [(0, '4508.996')] [2023-03-12 04:56:08,492][146667] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-12 04:56:12,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8483.6). Total num frames: 14737408. Throughput: 0: 8553.7. Samples: 14729212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:56:12,720][146380] Avg episode reward: [(0, '4504.667')] [2023-03-12 04:56:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028792_14741504.pth... [2023-03-12 04:56:12,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028288_14483456.pth [2023-03-12 04:56:13,204][146667] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-12 04:56:17,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8497.5). Total num frames: 14782464. Throughput: 0: 8526.6. Samples: 14780304. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:56:17,720][146380] Avg episode reward: [(0, '4514.542')] [2023-03-12 04:56:18,053][146667] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-12 04:56:22,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8483.6). Total num frames: 14823424. Throughput: 0: 8526.5. Samples: 14805708. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:56:22,720][146380] Avg episode reward: [(0, '4506.747')] [2023-03-12 04:56:22,968][146667] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-12 04:56:27,415][146667] Updated weights for policy 0, policy_version 29040 (0.0004) [2023-03-12 04:56:27,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8533.4, 300 sec: 8511.4). Total num frames: 14868480. Throughput: 0: 8598.4. Samples: 14858772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:56:27,720][146380] Avg episode reward: [(0, '4531.644')] [2023-03-12 04:56:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029040_14868480.pth... [2023-03-12 04:56:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028536_14610432.pth [2023-03-12 04:56:31,981][146667] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-12 04:56:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 14913536. Throughput: 0: 8641.1. Samples: 14912844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:56:32,720][146380] Avg episode reward: [(0, '4537.234')] [2023-03-12 04:56:36,837][146667] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-12 04:56:37,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 14954496. Throughput: 0: 8645.7. Samples: 14938112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:56:37,720][146380] Avg episode reward: [(0, '4537.834')] [2023-03-12 04:56:41,520][146667] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-12 04:56:42,720][146380] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 14999552. Throughput: 0: 8631.2. Samples: 14989832. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:56:42,720][146380] Avg episode reward: [(0, '4550.575')] [2023-03-12 04:56:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029296_14999552.pth... [2023-03-12 04:56:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000028792_14741504.pth [2023-03-12 04:56:46,353][146667] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-12 04:56:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 15040512. Throughput: 0: 8637.9. Samples: 15040584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:56:47,720][146380] Avg episode reward: [(0, '4526.556')] [2023-03-12 04:56:50,992][146667] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-12 04:56:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 15085568. Throughput: 0: 8663.4. Samples: 15067904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:56:52,720][146380] Avg episode reward: [(0, '4499.509')] [2023-03-12 04:56:55,808][146667] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-12 04:56:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 15130624. Throughput: 0: 8657.5. Samples: 15118800. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:56:57,720][146380] Avg episode reward: [(0, '4495.461')] [2023-03-12 04:56:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029552_15130624.pth... [2023-03-12 04:56:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029040_14868480.pth [2023-03-12 04:57:00,478][146667] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-12 04:57:02,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8553.0). Total num frames: 15171584. Throughput: 0: 8692.9. Samples: 15171484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:57:02,720][146380] Avg episode reward: [(0, '4455.830')] [2023-03-12 04:57:05,125][146667] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-12 04:57:07,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8566.9). Total num frames: 15216640. Throughput: 0: 8723.0. Samples: 15198244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:57:07,720][146380] Avg episode reward: [(0, '3921.851')] [2023-03-12 04:57:09,736][146667] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-12 04:57:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8580.8). Total num frames: 15261696. Throughput: 0: 8732.5. Samples: 15251736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:57:12,720][146380] Avg episode reward: [(0, '4078.941')] [2023-03-12 04:57:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029808_15261696.pth... [2023-03-12 04:57:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029296_14999552.pth [2023-03-12 04:57:14,208][146667] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-12 04:57:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8806.4, 300 sec: 8608.5). Total num frames: 15310848. Throughput: 0: 8764.4. Samples: 15307240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:57:17,720][146380] Avg episode reward: [(0, '4316.284')] [2023-03-12 04:57:18,632][146667] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-12 04:57:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8608.5). Total num frames: 15355904. Throughput: 0: 8818.8. Samples: 15334956. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:57:22,720][146380] Avg episode reward: [(0, '4533.982')] [2023-03-12 04:57:23,048][146667] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-12 04:57:27,578][146667] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-12 04:57:27,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8622.4). Total num frames: 15400960. Throughput: 0: 8885.6. Samples: 15389684. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 04:57:27,720][146380] Avg episode reward: [(0, '4538.314')] [2023-03-12 04:57:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030080_15400960.pth... [2023-03-12 04:57:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029552_15130624.pth [2023-03-12 04:57:32,031][146667] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-12 04:57:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8636.3). Total num frames: 15446016. Throughput: 0: 8982.6. Samples: 15444800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:57:32,720][146380] Avg episode reward: [(0, '4537.353')] [2023-03-12 04:57:36,391][146667] Updated weights for policy 0, policy_version 30240 (0.0004) [2023-03-12 04:57:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8650.2). Total num frames: 15495168. Throughput: 0: 9010.5. Samples: 15473376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:57:37,720][146380] Avg episode reward: [(0, '4562.596')] [2023-03-12 04:57:40,793][146667] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-12 04:57:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 8664.1). Total num frames: 15540224. Throughput: 0: 9106.3. Samples: 15528584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:57:42,720][146380] Avg episode reward: [(0, '4553.875')] [2023-03-12 04:57:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030352_15540224.pth... [2023-03-12 04:57:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000029808_15261696.pth [2023-03-12 04:57:45,245][146667] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-12 04:57:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8678.0). Total num frames: 15585280. Throughput: 0: 9168.0. Samples: 15584044. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:57:47,720][146380] Avg episode reward: [(0, '4544.756')] [2023-03-12 04:57:49,604][146667] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-12 04:57:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 8705.7). Total num frames: 15634432. Throughput: 0: 9209.9. Samples: 15612692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:57:52,720][146380] Avg episode reward: [(0, '4557.492')] [2023-03-12 04:57:53,940][146667] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-12 04:57:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 8719.6). Total num frames: 15679488. Throughput: 0: 9269.4. Samples: 15668860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:57:57,720][146380] Avg episode reward: [(0, '4561.929')] [2023-03-12 04:57:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030624_15679488.pth... [2023-03-12 04:57:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030080_15400960.pth [2023-03-12 04:57:58,494][146667] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-12 04:58:02,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 8733.5). Total num frames: 15724544. Throughput: 0: 9272.2. Samples: 15724492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:02,720][146380] Avg episode reward: [(0, '4560.239')] [2023-03-12 04:58:02,789][146667] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-12 04:58:07,081][146667] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-12 04:58:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 8761.3). Total num frames: 15773696. Throughput: 0: 9294.7. Samples: 15753216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:07,720][146380] Avg episode reward: [(0, '4578.414')] [2023-03-12 04:58:07,721][146623] Saving new best policy, reward=4578.414! [2023-03-12 04:58:11,312][146667] Updated weights for policy 0, policy_version 30880 (0.0004) [2023-03-12 04:58:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 8789.0). Total num frames: 15822848. Throughput: 0: 9354.4. Samples: 15810632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:12,720][146380] Avg episode reward: [(0, '4564.201')] [2023-03-12 04:58:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030904_15822848.pth... [2023-03-12 04:58:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030352_15540224.pth [2023-03-12 04:58:15,545][146667] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-12 04:58:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 8802.9). Total num frames: 15872000. Throughput: 0: 9423.8. Samples: 15868872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:17,720][146380] Avg episode reward: [(0, '4560.000')] [2023-03-12 04:58:19,793][146667] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-12 04:58:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 8816.8). Total num frames: 15917056. Throughput: 0: 9431.3. Samples: 15897784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:22,720][146380] Avg episode reward: [(0, '4566.316')] [2023-03-12 04:58:23,932][146667] Updated weights for policy 0, policy_version 31120 (0.0004) [2023-03-12 04:58:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 8858.5). Total num frames: 15970304. Throughput: 0: 9521.9. Samples: 15957068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:27,720][146380] Avg episode reward: [(0, '4554.787')] [2023-03-12 04:58:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031192_15970304.pth... [2023-03-12 04:58:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030624_15679488.pth [2023-03-12 04:58:28,103][146667] Updated weights for policy 0, policy_version 31200 (0.0004) [2023-03-12 04:58:32,603][146667] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-12 04:58:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 8872.4). Total num frames: 16015360. Throughput: 0: 9522.8. Samples: 16012572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:32,720][146380] Avg episode reward: [(0, '4556.433')] [2023-03-12 04:58:37,145][146667] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-12 04:58:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 8872.4). Total num frames: 16060416. Throughput: 0: 9495.9. Samples: 16040008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:37,720][146380] Avg episode reward: [(0, '4562.059')] [2023-03-12 04:58:41,508][146667] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-12 04:58:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 8886.2). Total num frames: 16105472. Throughput: 0: 9491.2. Samples: 16095964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:42,720][146380] Avg episode reward: [(0, '4574.168')] [2023-03-12 04:58:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031464_16109568.pth... [2023-03-12 04:58:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000030904_15822848.pth [2023-03-12 04:58:45,598][146667] Updated weights for policy 0, policy_version 31520 (0.0004) [2023-03-12 04:58:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 8927.9). Total num frames: 16158720. Throughput: 0: 9578.0. Samples: 16155500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:47,720][146380] Avg episode reward: [(0, '4536.099')] [2023-03-12 04:58:49,780][146667] Updated weights for policy 0, policy_version 31600 (0.0004) [2023-03-12 04:58:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 8927.9). Total num frames: 16203776. Throughput: 0: 9578.4. Samples: 16184244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:58:52,720][146380] Avg episode reward: [(0, '4583.490')] [2023-03-12 04:58:52,721][146623] Saving new best policy, reward=4583.490! [2023-03-12 04:58:54,235][146667] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-12 04:58:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9489.1, 300 sec: 8941.8). Total num frames: 16248832. Throughput: 0: 9534.1. Samples: 16239668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:58:57,720][146380] Avg episode reward: [(0, '4539.146')] [2023-03-12 04:58:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031736_16248832.pth... [2023-03-12 04:58:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031192_15970304.pth [2023-03-12 04:58:58,770][146667] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-12 04:59:02,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 8955.7). Total num frames: 16293888. Throughput: 0: 9445.0. Samples: 16293896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:02,720][146380] Avg episode reward: [(0, '4540.258')] [2023-03-12 04:59:03,256][146667] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-12 04:59:07,695][146667] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-12 04:59:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 8969.5). Total num frames: 16343040. Throughput: 0: 9407.8. Samples: 16321136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:07,720][146380] Avg episode reward: [(0, '4572.155')] [2023-03-12 04:59:12,181][146667] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-12 04:59:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8983.4). Total num frames: 16388096. Throughput: 0: 9306.9. Samples: 16375880. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:12,720][146380] Avg episode reward: [(0, '4568.412')] [2023-03-12 04:59:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032008_16388096.pth... [2023-03-12 04:59:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031464_16109568.pth [2023-03-12 04:59:16,764][146667] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-12 04:59:17,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 8983.4). Total num frames: 16433152. Throughput: 0: 9282.7. Samples: 16430292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:59:17,720][146380] Avg episode reward: [(0, '4566.633')] [2023-03-12 04:59:20,963][146667] Updated weights for policy 0, policy_version 32160 (0.0004) [2023-03-12 04:59:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8997.3). Total num frames: 16482304. Throughput: 0: 9325.3. Samples: 16459644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:59:22,720][146380] Avg episode reward: [(0, '4547.431')] [2023-03-12 04:59:25,214][146667] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-12 04:59:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9025.1). Total num frames: 16531456. Throughput: 0: 9376.1. Samples: 16517888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:59:27,720][146380] Avg episode reward: [(0, '4556.629')] [2023-03-12 04:59:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032288_16531456.pth... [2023-03-12 04:59:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000031736_16248832.pth [2023-03-12 04:59:29,406][146667] Updated weights for policy 0, policy_version 32320 (0.0004) [2023-03-12 04:59:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9039.0). Total num frames: 16576512. Throughput: 0: 9314.0. Samples: 16574632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:59:32,720][146380] Avg episode reward: [(0, '4557.574')] [2023-03-12 04:59:33,962][146667] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-12 04:59:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9039.0). Total num frames: 16621568. Throughput: 0: 9264.8. Samples: 16601160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:37,720][146380] Avg episode reward: [(0, '4556.566')] [2023-03-12 04:59:38,520][146667] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-12 04:59:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9052.9). Total num frames: 16666624. Throughput: 0: 9225.3. Samples: 16654808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:42,720][146380] Avg episode reward: [(0, '4551.053')] [2023-03-12 04:59:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032552_16666624.pth... [2023-03-12 04:59:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032008_16388096.pth [2023-03-12 04:59:43,137][146667] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-12 04:59:47,693][146667] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-12 04:59:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9052.9). Total num frames: 16711680. Throughput: 0: 9206.4. Samples: 16708184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:47,720][146380] Avg episode reward: [(0, '4553.289')] [2023-03-12 04:59:51,996][146667] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-12 04:59:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9066.7). Total num frames: 16756736. Throughput: 0: 9225.3. Samples: 16736276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 04:59:52,720][146380] Avg episode reward: [(0, '4554.837')] [2023-03-12 04:59:56,211][146667] Updated weights for policy 0, policy_version 32800 (0.0004) [2023-03-12 04:59:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9066.7). Total num frames: 16805888. Throughput: 0: 9306.7. Samples: 16794680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:59:57,720][146380] Avg episode reward: [(0, '4546.685')] [2023-03-12 04:59:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032824_16805888.pth... [2023-03-12 04:59:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032288_16531456.pth [2023-03-12 05:00:00,403][146667] Updated weights for policy 0, policy_version 32880 (0.0004) [2023-03-12 05:00:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9080.6). Total num frames: 16855040. Throughput: 0: 9399.2. Samples: 16853256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:02,720][146380] Avg episode reward: [(0, '4553.307')] [2023-03-12 05:00:04,664][146667] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-12 05:00:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9080.6). Total num frames: 16900096. Throughput: 0: 9386.7. Samples: 16882048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:07,720][146380] Avg episode reward: [(0, '4555.481')] [2023-03-12 05:00:09,060][146667] Updated weights for policy 0, policy_version 33040 (0.0006) [2023-03-12 05:00:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9094.5). Total num frames: 16949248. Throughput: 0: 9315.1. Samples: 16937068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:12,720][146380] Avg episode reward: [(0, '4553.075')] [2023-03-12 05:00:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033104_16949248.pth... [2023-03-12 05:00:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032552_16666624.pth [2023-03-12 05:00:13,535][146667] Updated weights for policy 0, policy_version 33120 (0.0006) [2023-03-12 05:00:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9094.5). Total num frames: 16994304. Throughput: 0: 9256.6. Samples: 16991180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:17,720][146380] Avg episode reward: [(0, '4537.098')] [2023-03-12 05:00:18,051][146667] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-12 05:00:22,487][146667] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-12 05:00:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 17039360. Throughput: 0: 9305.5. Samples: 17019908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:22,720][146380] Avg episode reward: [(0, '4538.558')] [2023-03-12 05:00:26,989][146667] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-12 05:00:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 17084416. Throughput: 0: 9318.5. Samples: 17074140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:27,720][146380] Avg episode reward: [(0, '4541.015')] [2023-03-12 05:00:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033368_17084416.pth... [2023-03-12 05:00:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000032824_16805888.pth [2023-03-12 05:00:31,243][146667] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-12 05:00:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 17133568. Throughput: 0: 9393.9. Samples: 17130908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:32,720][146380] Avg episode reward: [(0, '4535.787')] [2023-03-12 05:00:35,734][146667] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-12 05:00:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 17178624. Throughput: 0: 9376.3. Samples: 17158208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:37,720][146380] Avg episode reward: [(0, '4424.929')] [2023-03-12 05:00:40,076][146667] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-12 05:00:42,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9150.1). Total num frames: 17223680. Throughput: 0: 9338.0. Samples: 17214888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:42,720][146380] Avg episode reward: [(0, '4440.497')] [2023-03-12 05:00:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033640_17223680.pth... [2023-03-12 05:00:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033104_16949248.pth [2023-03-12 05:00:44,652][146667] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-12 05:00:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9150.0). Total num frames: 17268736. Throughput: 0: 9234.3. Samples: 17268800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:47,720][146380] Avg episode reward: [(0, '4486.056')] [2023-03-12 05:00:49,140][146667] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-12 05:00:52,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 17317888. Throughput: 0: 9196.3. Samples: 17295884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:52,720][146380] Avg episode reward: [(0, '4466.928')] [2023-03-12 05:00:53,525][146667] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-12 05:00:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 17362944. Throughput: 0: 9202.8. Samples: 17351196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:00:57,720][146380] Avg episode reward: [(0, '4500.324')] [2023-03-12 05:00:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033912_17362944.pth... [2023-03-12 05:00:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033368_17084416.pth [2023-03-12 05:00:58,048][146667] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-12 05:01:02,208][146667] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-12 05:01:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 17412096. Throughput: 0: 9288.5. Samples: 17409160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:01:02,720][146380] Avg episode reward: [(0, '4517.708')] [2023-03-12 05:01:06,502][146667] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-12 05:01:07,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 17457152. Throughput: 0: 9286.0. Samples: 17437780. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:01:07,720][146380] Avg episode reward: [(0, '4540.390')] [2023-03-12 05:01:10,952][146667] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-12 05:01:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 17502208. Throughput: 0: 9327.4. Samples: 17493872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:01:12,720][146380] Avg episode reward: [(0, '4530.371')] [2023-03-12 05:01:12,772][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034192_17506304.pth... [2023-03-12 05:01:12,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033640_17223680.pth [2023-03-12 05:01:15,498][146667] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-12 05:01:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 17547264. Throughput: 0: 9253.8. Samples: 17547328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:01:17,720][146380] Avg episode reward: [(0, '4545.904')] [2023-03-12 05:01:20,152][146667] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-12 05:01:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 17592320. Throughput: 0: 9232.0. Samples: 17573648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:01:22,720][146380] Avg episode reward: [(0, '4538.238')] [2023-03-12 05:01:24,676][146667] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-12 05:01:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 17637376. Throughput: 0: 9181.6. Samples: 17628060. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:01:27,720][146380] Avg episode reward: [(0, '4541.130')] [2023-03-12 05:01:27,773][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034456_17641472.pth... [2023-03-12 05:01:27,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000033912_17362944.pth [2023-03-12 05:01:29,131][146667] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-12 05:01:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 17682432. Throughput: 0: 9198.3. Samples: 17682724. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:01:32,720][146380] Avg episode reward: [(0, '4556.441')] [2023-03-12 05:01:33,643][146667] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-12 05:01:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 17727488. Throughput: 0: 9213.2. Samples: 17710476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:01:37,720][146380] Avg episode reward: [(0, '4563.079')] [2023-03-12 05:01:38,180][146667] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-12 05:01:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 17772544. Throughput: 0: 9181.1. Samples: 17764344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:01:42,720][146380] Avg episode reward: [(0, '4224.972')] [2023-03-12 05:01:42,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034720_17776640.pth... [2023-03-12 05:01:42,728][146667] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-12 05:01:42,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034192_17506304.pth [2023-03-12 05:01:47,229][146667] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-12 05:01:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 17821696. Throughput: 0: 9095.5. Samples: 17818456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:01:47,720][146380] Avg episode reward: [(0, '4254.985')] [2023-03-12 05:01:51,797][146667] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-12 05:01:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 17866752. Throughput: 0: 9069.4. Samples: 17845900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:01:52,720][146380] Avg episode reward: [(0, '3945.117')] [2023-03-12 05:01:56,392][146667] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-12 05:01:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 17911808. Throughput: 0: 9014.4. Samples: 17899520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:01:57,720][146380] Avg episode reward: [(0, '3914.341')] [2023-03-12 05:01:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034984_17911808.pth... [2023-03-12 05:01:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034456_17641472.pth [2023-03-12 05:02:00,843][146667] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-12 05:02:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9288.9). Total num frames: 17956864. Throughput: 0: 9032.5. Samples: 17953792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:02,720][146380] Avg episode reward: [(0, '4348.414')] [2023-03-12 05:02:05,143][146667] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-12 05:02:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 18006016. Throughput: 0: 9104.3. Samples: 17983340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:07,720][146380] Avg episode reward: [(0, '4452.812')] [2023-03-12 05:02:09,414][146667] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-12 05:02:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 18051072. Throughput: 0: 9165.9. Samples: 18040524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:12,720][146380] Avg episode reward: [(0, '4431.819')] [2023-03-12 05:02:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035256_18051072.pth... [2023-03-12 05:02:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034720_17776640.pth [2023-03-12 05:02:13,692][146667] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-12 05:02:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 18100224. Throughput: 0: 9260.0. Samples: 18099424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:17,720][146380] Avg episode reward: [(0, '4554.410')] [2023-03-12 05:02:17,873][146667] Updated weights for policy 0, policy_version 35360 (0.0004) [2023-03-12 05:02:22,031][146667] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-12 05:02:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 18149376. Throughput: 0: 9290.7. Samples: 18128556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:22,720][146380] Avg episode reward: [(0, '4564.179')] [2023-03-12 05:02:26,068][146667] Updated weights for policy 0, policy_version 35520 (0.0004) [2023-03-12 05:02:27,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 18202624. Throughput: 0: 9433.5. Samples: 18188852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:27,720][146380] Avg episode reward: [(0, '4533.625')] [2023-03-12 05:02:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035552_18202624.pth... [2023-03-12 05:02:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000034984_17911808.pth [2023-03-12 05:02:30,234][146667] Updated weights for policy 0, policy_version 35600 (0.0004) [2023-03-12 05:02:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 18247680. Throughput: 0: 9531.9. Samples: 18247392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:32,720][146380] Avg episode reward: [(0, '4529.263')] [2023-03-12 05:02:34,626][146667] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-12 05:02:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 18292736. Throughput: 0: 9535.5. Samples: 18275000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:37,720][146380] Avg episode reward: [(0, '4543.264')] [2023-03-12 05:02:39,000][146667] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-12 05:02:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 18341888. Throughput: 0: 9593.3. Samples: 18331220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:42,720][146380] Avg episode reward: [(0, '4544.781')] [2023-03-12 05:02:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035824_18341888.pth... [2023-03-12 05:02:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035256_18051072.pth [2023-03-12 05:02:43,349][146667] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-12 05:02:47,423][146667] Updated weights for policy 0, policy_version 35920 (0.0004) [2023-03-12 05:02:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 18391040. Throughput: 0: 9701.7. Samples: 18390368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:47,720][146380] Avg episode reward: [(0, '4548.491')] [2023-03-12 05:02:51,776][146667] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-12 05:02:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 18440192. Throughput: 0: 9667.2. Samples: 18418364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:02:52,720][146380] Avg episode reward: [(0, '4533.834')] [2023-03-12 05:02:56,139][146667] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-12 05:02:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 18485248. Throughput: 0: 9654.1. Samples: 18474956. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:02:57,723][146380] Avg episode reward: [(0, '4540.100')] [2023-03-12 05:02:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036104_18485248.pth... [2023-03-12 05:02:57,730][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035552_18202624.pth [2023-03-12 05:03:00,568][146667] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-12 05:03:02,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 18530304. Throughput: 0: 9575.1. Samples: 18530304. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:03:02,720][146380] Avg episode reward: [(0, '4458.385')] [2023-03-12 05:03:04,926][146667] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-12 05:03:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 18579456. Throughput: 0: 9565.2. Samples: 18558988. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:03:07,720][146380] Avg episode reward: [(0, '4491.576')] [2023-03-12 05:03:09,097][146667] Updated weights for policy 0, policy_version 36320 (0.0005) [2023-03-12 05:03:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9344.4). Total num frames: 18628608. Throughput: 0: 9529.9. Samples: 18617696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:03:12,720][146380] Avg episode reward: [(0, '4543.309')] [2023-03-12 05:03:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036384_18628608.pth... [2023-03-12 05:03:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000035824_18341888.pth [2023-03-12 05:03:13,261][146667] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-12 05:03:17,489][146667] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-12 05:03:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9358.3). Total num frames: 18677760. Throughput: 0: 9529.8. Samples: 18676232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:03:17,720][146380] Avg episode reward: [(0, '4519.908')] [2023-03-12 05:03:21,680][146667] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-12 05:03:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9344.4). Total num frames: 18726912. Throughput: 0: 9573.6. Samples: 18705812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:22,720][146380] Avg episode reward: [(0, '4425.328')] [2023-03-12 05:03:25,953][146667] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-12 05:03:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 18776064. Throughput: 0: 9611.3. Samples: 18763728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:27,720][146380] Avg episode reward: [(0, '4442.797')] [2023-03-12 05:03:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036672_18776064.pth... [2023-03-12 05:03:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036104_18485248.pth [2023-03-12 05:03:30,401][146667] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-12 05:03:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 18821120. Throughput: 0: 9517.6. Samples: 18818660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:32,720][146380] Avg episode reward: [(0, '4567.118')] [2023-03-12 05:03:34,814][146667] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-12 05:03:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 18866176. Throughput: 0: 9505.1. Samples: 18846092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:37,720][146380] Avg episode reward: [(0, '4514.385')] [2023-03-12 05:03:39,266][146667] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-12 05:03:42,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 18911232. Throughput: 0: 9479.8. Samples: 18901548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:42,720][146380] Avg episode reward: [(0, '3996.284')] [2023-03-12 05:03:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036936_18911232.pth... [2023-03-12 05:03:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036384_18628608.pth [2023-03-12 05:03:43,602][146667] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-12 05:03:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 18960384. Throughput: 0: 9557.6. Samples: 18960396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:47,720][146380] Avg episode reward: [(0, '4096.809')] [2023-03-12 05:03:47,767][146667] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-12 05:03:51,906][146667] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-12 05:03:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 19009536. Throughput: 0: 9577.4. Samples: 18989972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:52,720][146380] Avg episode reward: [(0, '4503.547')] [2023-03-12 05:03:56,015][146667] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-12 05:03:57,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 19062784. Throughput: 0: 9599.9. Samples: 19049692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:03:57,720][146380] Avg episode reward: [(0, '4520.918')] [2023-03-12 05:03:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037232_19062784.pth... [2023-03-12 05:03:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036672_18776064.pth [2023-03-12 05:04:00,077][146667] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-12 05:04:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9386.1). Total num frames: 19111936. Throughput: 0: 9640.7. Samples: 19110064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:02,720][146380] Avg episode reward: [(0, '4526.957')] [2023-03-12 05:04:04,116][146667] Updated weights for policy 0, policy_version 37360 (0.0004) [2023-03-12 05:04:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 19161088. Throughput: 0: 9662.3. Samples: 19140616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:04:07,720][146380] Avg episode reward: [(0, '4554.847')] [2023-03-12 05:04:08,198][146667] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-12 05:04:12,276][146667] Updated weights for policy 0, policy_version 37520 (0.0004) [2023-03-12 05:04:12,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 19214336. Throughput: 0: 9713.4. Samples: 19200832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:04:12,720][146380] Avg episode reward: [(0, '4557.686')] [2023-03-12 05:04:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037528_19214336.pth... [2023-03-12 05:04:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000036936_18911232.pth [2023-03-12 05:04:16,361][146667] Updated weights for policy 0, policy_version 37600 (0.0004) [2023-03-12 05:04:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 19263488. Throughput: 0: 9816.8. Samples: 19260416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:04:17,720][146380] Avg episode reward: [(0, '4504.850')] [2023-03-12 05:04:20,467][146667] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-12 05:04:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 19312640. Throughput: 0: 9891.1. Samples: 19291192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:04:22,720][146380] Avg episode reward: [(0, '4531.868')] [2023-03-12 05:04:24,489][146667] Updated weights for policy 0, policy_version 37760 (0.0004) [2023-03-12 05:04:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9441.6). Total num frames: 19361792. Throughput: 0: 10003.7. Samples: 19351716. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:04:27,720][146380] Avg episode reward: [(0, '4516.525')] [2023-03-12 05:04:27,746][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037824_19365888.pth... [2023-03-12 05:04:27,747][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037232_19062784.pth [2023-03-12 05:04:28,562][146667] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-12 05:04:32,687][146667] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-12 05:04:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9469.4). Total num frames: 19415040. Throughput: 0: 10015.8. Samples: 19411108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:32,720][146380] Avg episode reward: [(0, '4561.221')] [2023-03-12 05:04:36,753][146667] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-12 05:04:37,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9483.3). Total num frames: 19464192. Throughput: 0: 10036.2. Samples: 19441600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:37,720][146380] Avg episode reward: [(0, '4550.500')] [2023-03-12 05:04:40,858][146667] Updated weights for policy 0, policy_version 38080 (0.0004) [2023-03-12 05:04:42,719][146380] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9497.2). Total num frames: 19513344. Throughput: 0: 10042.7. Samples: 19501612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:42,720][146380] Avg episode reward: [(0, '4512.961')] [2023-03-12 05:04:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038112_19513344.pth... [2023-03-12 05:04:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037528_19214336.pth [2023-03-12 05:04:45,037][146667] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-12 05:04:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9511.1). Total num frames: 19562496. Throughput: 0: 10025.2. Samples: 19561196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:47,730][146380] Avg episode reward: [(0, '4565.885')] [2023-03-12 05:04:49,088][146667] Updated weights for policy 0, policy_version 38240 (0.0004) [2023-03-12 05:04:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9511.1). Total num frames: 19611648. Throughput: 0: 10013.7. Samples: 19591232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:04:52,720][146380] Avg episode reward: [(0, '4541.627')] [2023-03-12 05:04:53,225][146667] Updated weights for policy 0, policy_version 38320 (0.0004) [2023-03-12 05:04:57,347][146667] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-12 05:04:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9511.1). Total num frames: 19660800. Throughput: 0: 9992.3. Samples: 19650484. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:04:57,720][146380] Avg episode reward: [(0, '4564.505')] [2023-03-12 05:04:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038400_19660800.pth... [2023-03-12 05:04:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000037824_19365888.pth [2023-03-12 05:05:01,433][146667] Updated weights for policy 0, policy_version 38480 (0.0004) [2023-03-12 05:05:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9538.8). Total num frames: 19714048. Throughput: 0: 10004.2. Samples: 19710604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:05:02,720][146380] Avg episode reward: [(0, '4576.440')] [2023-03-12 05:05:05,515][146667] Updated weights for policy 0, policy_version 38560 (0.0004) [2023-03-12 05:05:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9538.8). Total num frames: 19763200. Throughput: 0: 9994.6. Samples: 19740948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:05:07,720][146380] Avg episode reward: [(0, '4563.582')] [2023-03-12 05:05:09,493][146667] Updated weights for policy 0, policy_version 38640 (0.0004) [2023-03-12 05:05:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9552.7). Total num frames: 19812352. Throughput: 0: 10016.5. Samples: 19802460. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:05:12,720][146380] Avg episode reward: [(0, '4561.960')] [2023-03-12 05:05:12,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038704_19816448.pth... [2023-03-12 05:05:12,742][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038112_19513344.pth [2023-03-12 05:05:13,556][146667] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-12 05:05:17,707][146667] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-12 05:05:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9580.5). Total num frames: 19865600. Throughput: 0: 10013.1. Samples: 19861700. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:05:17,720][146380] Avg episode reward: [(0, '4366.040')] [2023-03-12 05:05:21,801][146667] Updated weights for policy 0, policy_version 38880 (0.0004) [2023-03-12 05:05:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9594.4). Total num frames: 19914752. Throughput: 0: 10003.0. Samples: 19891736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:05:22,720][146380] Avg episode reward: [(0, '4075.697')] [2023-03-12 05:05:25,885][146667] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-12 05:05:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9594.4). Total num frames: 19963904. Throughput: 0: 10004.6. Samples: 19951820. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:05:27,730][146380] Avg episode reward: [(0, '4439.934')] [2023-03-12 05:05:27,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038992_19963904.pth... [2023-03-12 05:05:27,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038400_19660800.pth [2023-03-12 05:05:29,897][146667] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-12 05:05:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9608.2). Total num frames: 20013056. Throughput: 0: 10041.5. Samples: 20013064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:05:32,730][146380] Avg episode reward: [(0, '4528.178')] [2023-03-12 05:05:33,960][146667] Updated weights for policy 0, policy_version 39120 (0.0004) [2023-03-12 05:05:37,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9636.0). Total num frames: 20066304. Throughput: 0: 10052.1. Samples: 20043576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:05:37,720][146380] Avg episode reward: [(0, '4570.282')] [2023-03-12 05:05:37,966][146667] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-12 05:05:42,039][146667] Updated weights for policy 0, policy_version 39280 (0.0004) [2023-03-12 05:05:42,719][146380] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9649.9). Total num frames: 20115456. Throughput: 0: 10073.9. Samples: 20103808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:05:42,730][146380] Avg episode reward: [(0, '4553.386')] [2023-03-12 05:05:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039288_20115456.pth... [2023-03-12 05:05:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038704_19816448.pth [2023-03-12 05:05:46,421][146667] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-12 05:05:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9649.9). Total num frames: 20164608. Throughput: 0: 10004.3. Samples: 20160796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:05:47,730][146380] Avg episode reward: [(0, '4566.969')] [2023-03-12 05:05:50,823][146667] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-12 05:05:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 20209664. Throughput: 0: 9960.8. Samples: 20189184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:05:52,720][146380] Avg episode reward: [(0, '4561.309')] [2023-03-12 05:05:55,080][146667] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-12 05:05:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9898.7, 300 sec: 9636.0). Total num frames: 20254720. Throughput: 0: 9864.1. Samples: 20246344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:05:57,723][146380] Avg episode reward: [(0, '4553.277')] [2023-03-12 05:05:57,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039568_20258816.pth... [2023-03-12 05:05:57,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000038992_19963904.pth [2023-03-12 05:05:59,441][146667] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-12 05:06:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 20303872. Throughput: 0: 9799.5. Samples: 20302676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:02,730][146380] Avg episode reward: [(0, '4556.430')] [2023-03-12 05:06:03,819][146667] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-12 05:06:07,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 20348928. Throughput: 0: 9751.6. Samples: 20330560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:07,720][146380] Avg episode reward: [(0, '4541.565')] [2023-03-12 05:06:08,198][146667] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-12 05:06:12,503][146667] Updated weights for policy 0, policy_version 39840 (0.0005) [2023-03-12 05:06:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 20398080. Throughput: 0: 9679.2. Samples: 20387384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:06:12,720][146380] Avg episode reward: [(0, '4493.637')] [2023-03-12 05:06:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039840_20398080.pth... [2023-03-12 05:06:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039288_20115456.pth [2023-03-12 05:06:16,773][146667] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-12 05:06:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 20447232. Throughput: 0: 9574.9. Samples: 20443936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:06:17,720][146380] Avg episode reward: [(0, '4467.334')] [2023-03-12 05:06:21,055][146667] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-12 05:06:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 20492288. Throughput: 0: 9531.2. Samples: 20472480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:06:22,720][146380] Avg episode reward: [(0, '4512.089')] [2023-03-12 05:06:25,364][146667] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-12 05:06:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 20541440. Throughput: 0: 9468.1. Samples: 20529872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:06:27,720][146380] Avg episode reward: [(0, '4517.527')] [2023-03-12 05:06:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040120_20541440.pth... [2023-03-12 05:06:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039568_20258816.pth [2023-03-12 05:06:29,666][146667] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-12 05:06:32,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 20590592. Throughput: 0: 9480.6. Samples: 20587424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:06:32,720][146380] Avg episode reward: [(0, '4572.060')] [2023-03-12 05:06:33,920][146667] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-12 05:06:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 20635648. Throughput: 0: 9489.1. Samples: 20616192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:37,720][146380] Avg episode reward: [(0, '4568.382')] [2023-03-12 05:06:38,245][146667] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-12 05:06:42,544][146667] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-12 05:06:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 20684800. Throughput: 0: 9477.0. Samples: 20672812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:42,720][146380] Avg episode reward: [(0, '4528.679')] [2023-03-12 05:06:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040400_20684800.pth... [2023-03-12 05:06:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000039840_20398080.pth [2023-03-12 05:06:46,915][146667] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-12 05:06:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9705.4). Total num frames: 20729856. Throughput: 0: 9494.3. Samples: 20729920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:47,720][146380] Avg episode reward: [(0, '4517.104')] [2023-03-12 05:06:51,239][146667] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-12 05:06:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9719.3). Total num frames: 20779008. Throughput: 0: 9510.8. Samples: 20758544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:52,720][146380] Avg episode reward: [(0, '4550.527')] [2023-03-12 05:06:55,491][146667] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-12 05:06:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9733.2). Total num frames: 20828160. Throughput: 0: 9522.1. Samples: 20815880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:06:57,720][146380] Avg episode reward: [(0, '4555.788')] [2023-03-12 05:06:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040680_20828160.pth... [2023-03-12 05:06:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040120_20541440.pth [2023-03-12 05:06:59,753][146667] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-12 05:07:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9719.3). Total num frames: 20873216. Throughput: 0: 9541.0. Samples: 20873280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:07:02,720][146380] Avg episode reward: [(0, '4549.552')] [2023-03-12 05:07:04,073][146667] Updated weights for policy 0, policy_version 40800 (0.0004) [2023-03-12 05:07:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9733.2). Total num frames: 20922368. Throughput: 0: 9542.4. Samples: 20901888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:07:07,720][146380] Avg episode reward: [(0, '4554.116')] [2023-03-12 05:07:08,434][146667] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-12 05:07:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9719.3). Total num frames: 20967424. Throughput: 0: 9499.7. Samples: 20957360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:07:12,720][146380] Avg episode reward: [(0, '4510.313')] [2023-03-12 05:07:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040952_20967424.pth... [2023-03-12 05:07:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040400_20684800.pth [2023-03-12 05:07:12,891][146667] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-12 05:07:17,152][146667] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-12 05:07:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9719.3). Total num frames: 21016576. Throughput: 0: 9487.9. Samples: 21014380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:07:17,720][146380] Avg episode reward: [(0, '4548.186')] [2023-03-12 05:07:21,429][146667] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-12 05:07:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 21065728. Throughput: 0: 9498.8. Samples: 21043640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:07:22,720][146380] Avg episode reward: [(0, '4537.564')] [2023-03-12 05:07:25,668][146667] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-12 05:07:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 21110784. Throughput: 0: 9507.3. Samples: 21100640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:27,720][146380] Avg episode reward: [(0, '4528.549')] [2023-03-12 05:07:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041232_21110784.pth... [2023-03-12 05:07:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040680_20828160.pth [2023-03-12 05:07:30,005][146667] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-12 05:07:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9719.3). Total num frames: 21159936. Throughput: 0: 9489.1. Samples: 21156928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:32,720][146380] Avg episode reward: [(0, '4464.157')] [2023-03-12 05:07:34,403][146667] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-12 05:07:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 21204992. Throughput: 0: 9481.6. Samples: 21185216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:37,720][146380] Avg episode reward: [(0, '4383.749')] [2023-03-12 05:07:38,710][146667] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-12 05:07:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 21254144. Throughput: 0: 9466.3. Samples: 21241864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:42,720][146380] Avg episode reward: [(0, '4225.668')] [2023-03-12 05:07:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041512_21254144.pth... [2023-03-12 05:07:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000040952_20967424.pth [2023-03-12 05:07:43,072][146667] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-12 05:07:47,441][146667] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-12 05:07:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9691.6). Total num frames: 21299200. Throughput: 0: 9445.7. Samples: 21298336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:47,720][146380] Avg episode reward: [(0, '4543.023')] [2023-03-12 05:07:51,756][146667] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-12 05:07:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 21348352. Throughput: 0: 9446.8. Samples: 21326996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:52,720][146380] Avg episode reward: [(0, '4564.040')] [2023-03-12 05:07:56,113][146667] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-12 05:07:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9705.4). Total num frames: 21393408. Throughput: 0: 9469.0. Samples: 21383464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:07:57,720][146380] Avg episode reward: [(0, '4541.480')] [2023-03-12 05:07:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041784_21393408.pth... [2023-03-12 05:07:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041232_21110784.pth [2023-03-12 05:08:00,417][146667] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-12 05:08:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 21442560. Throughput: 0: 9458.8. Samples: 21440024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:02,720][146380] Avg episode reward: [(0, '4484.083')] [2023-03-12 05:08:04,834][146667] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-12 05:08:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9691.6). Total num frames: 21487616. Throughput: 0: 9415.5. Samples: 21467336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:07,720][146380] Avg episode reward: [(0, '4497.927')] [2023-03-12 05:08:09,227][146667] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-12 05:08:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 21532672. Throughput: 0: 9402.9. Samples: 21523772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:12,720][146380] Avg episode reward: [(0, '4046.860')] [2023-03-12 05:08:12,763][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042064_21536768.pth... [2023-03-12 05:08:12,765][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041512_21254144.pth [2023-03-12 05:08:13,660][146667] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-12 05:08:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 21581824. Throughput: 0: 9382.7. Samples: 21579148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:17,720][146380] Avg episode reward: [(0, '4005.664')] [2023-03-12 05:08:18,096][146667] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-12 05:08:22,472][146667] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-12 05:08:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9663.8). Total num frames: 21626880. Throughput: 0: 9365.1. Samples: 21606644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:22,720][146380] Avg episode reward: [(0, '4546.877')] [2023-03-12 05:08:26,851][146667] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-12 05:08:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9663.8). Total num frames: 21671936. Throughput: 0: 9375.0. Samples: 21663740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:27,720][146380] Avg episode reward: [(0, '4568.822')] [2023-03-12 05:08:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042336_21676032.pth... [2023-03-12 05:08:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000041784_21393408.pth [2023-03-12 05:08:31,235][146667] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-12 05:08:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 21721088. Throughput: 0: 9349.4. Samples: 21719060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:32,720][146380] Avg episode reward: [(0, '4367.215')] [2023-03-12 05:08:35,649][146667] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-12 05:08:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 21766144. Throughput: 0: 9335.8. Samples: 21747108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:37,720][146380] Avg episode reward: [(0, '4117.839')] [2023-03-12 05:08:40,156][146667] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-12 05:08:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9663.8). Total num frames: 21811200. Throughput: 0: 9292.3. Samples: 21801620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:42,720][146380] Avg episode reward: [(0, '4482.339')] [2023-03-12 05:08:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042600_21811200.pth... [2023-03-12 05:08:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042064_21536768.pth [2023-03-12 05:08:44,697][146667] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-12 05:08:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9649.9). Total num frames: 21856256. Throughput: 0: 9251.0. Samples: 21856320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:47,720][146380] Avg episode reward: [(0, '4494.339')] [2023-03-12 05:08:49,113][146667] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-12 05:08:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9636.0). Total num frames: 21905408. Throughput: 0: 9268.4. Samples: 21884412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:52,720][146380] Avg episode reward: [(0, '4574.955')] [2023-03-12 05:08:53,576][146667] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-12 05:08:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9622.1). Total num frames: 21950464. Throughput: 0: 9221.1. Samples: 21938724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:08:57,720][146380] Avg episode reward: [(0, '4568.739')] [2023-03-12 05:08:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042872_21950464.pth... [2023-03-12 05:08:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042336_21676032.pth [2023-03-12 05:08:58,058][146667] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-12 05:09:02,564][146667] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-12 05:09:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9608.2). Total num frames: 21995520. Throughput: 0: 9210.1. Samples: 21993604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:02,720][146380] Avg episode reward: [(0, '4563.911')] [2023-03-12 05:09:06,961][146667] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-12 05:09:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9580.5). Total num frames: 22040576. Throughput: 0: 9213.6. Samples: 22021256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:07,720][146380] Avg episode reward: [(0, '4444.104')] [2023-03-12 05:09:11,396][146667] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-12 05:09:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9566.6). Total num frames: 22085632. Throughput: 0: 9193.4. Samples: 22077440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:12,720][146380] Avg episode reward: [(0, '4559.175')] [2023-03-12 05:09:12,735][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043144_22089728.pth... [2023-03-12 05:09:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042600_21811200.pth [2023-03-12 05:09:15,856][146667] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-12 05:09:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9566.6). Total num frames: 22134784. Throughput: 0: 9175.5. Samples: 22131960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:17,720][146380] Avg episode reward: [(0, '4537.701')] [2023-03-12 05:09:20,252][146667] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-12 05:09:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9552.7). Total num frames: 22179840. Throughput: 0: 9168.6. Samples: 22159696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:22,720][146380] Avg episode reward: [(0, '4519.514')] [2023-03-12 05:09:24,563][146667] Updated weights for policy 0, policy_version 43360 (0.0004) [2023-03-12 05:09:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9538.8). Total num frames: 22228992. Throughput: 0: 9232.1. Samples: 22217064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:27,720][146380] Avg episode reward: [(0, '4524.987')] [2023-03-12 05:09:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043416_22228992.pth... [2023-03-12 05:09:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000042872_21950464.pth [2023-03-12 05:09:28,900][146667] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-12 05:09:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 22274048. Throughput: 0: 9280.1. Samples: 22273924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:32,720][146380] Avg episode reward: [(0, '4239.646')] [2023-03-12 05:09:33,258][146667] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-12 05:09:37,620][146667] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-12 05:09:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 22323200. Throughput: 0: 9272.8. Samples: 22301688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:37,720][146380] Avg episode reward: [(0, '4393.060')] [2023-03-12 05:09:41,963][146667] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-12 05:09:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 22368256. Throughput: 0: 9338.3. Samples: 22358948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:42,720][146380] Avg episode reward: [(0, '4444.139')] [2023-03-12 05:09:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043688_22368256.pth... [2023-03-12 05:09:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043144_22089728.pth [2023-03-12 05:09:46,352][146667] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-12 05:09:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 22417408. Throughput: 0: 9344.8. Samples: 22414120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:47,720][146380] Avg episode reward: [(0, '4466.663')] [2023-03-12 05:09:50,575][146667] Updated weights for policy 0, policy_version 43840 (0.0004) [2023-03-12 05:09:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 22466560. Throughput: 0: 9383.1. Samples: 22443496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:52,720][146380] Avg episode reward: [(0, '4406.615')] [2023-03-12 05:09:54,819][146667] Updated weights for policy 0, policy_version 43920 (0.0004) [2023-03-12 05:09:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 22511616. Throughput: 0: 9408.8. Samples: 22500836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:09:57,720][146380] Avg episode reward: [(0, '3889.642')] [2023-03-12 05:09:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043968_22511616.pth... [2023-03-12 05:09:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043416_22228992.pth [2023-03-12 05:09:59,205][146667] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-12 05:10:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 22560768. Throughput: 0: 9465.5. Samples: 22557908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:02,720][146380] Avg episode reward: [(0, '3755.362')] [2023-03-12 05:10:03,423][146667] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-12 05:10:07,573][146667] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-12 05:10:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 22609920. Throughput: 0: 9516.3. Samples: 22587928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:07,720][146380] Avg episode reward: [(0, '4301.750')] [2023-03-12 05:10:11,767][146667] Updated weights for policy 0, policy_version 44240 (0.0004) [2023-03-12 05:10:12,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 22659072. Throughput: 0: 9550.7. Samples: 22646848. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:12,720][146380] Avg episode reward: [(0, '4460.713')] [2023-03-12 05:10:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044256_22659072.pth... [2023-03-12 05:10:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043688_22368256.pth [2023-03-12 05:10:15,910][146667] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-12 05:10:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 22708224. Throughput: 0: 9602.2. Samples: 22706024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:17,720][146380] Avg episode reward: [(0, '4446.926')] [2023-03-12 05:10:20,260][146667] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-12 05:10:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 22757376. Throughput: 0: 9591.7. Samples: 22733316. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:22,720][146380] Avg episode reward: [(0, '4527.710')] [2023-03-12 05:10:24,422][146667] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-12 05:10:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 22802432. Throughput: 0: 9622.7. Samples: 22791972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:27,720][146380] Avg episode reward: [(0, '4556.449')] [2023-03-12 05:10:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044536_22802432.pth... [2023-03-12 05:10:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000043968_22511616.pth [2023-03-12 05:10:28,708][146667] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-12 05:10:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 22851584. Throughput: 0: 9659.6. Samples: 22848804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:32,720][146380] Avg episode reward: [(0, '4539.670')] [2023-03-12 05:10:33,037][146667] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-12 05:10:37,198][146667] Updated weights for policy 0, policy_version 44720 (0.0005) [2023-03-12 05:10:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 22900736. Throughput: 0: 9669.0. Samples: 22878600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:10:37,720][146380] Avg episode reward: [(0, '4541.390')] [2023-03-12 05:10:41,256][146667] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-12 05:10:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 22949888. Throughput: 0: 9718.4. Samples: 22938164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:42,720][146380] Avg episode reward: [(0, '4551.677')] [2023-03-12 05:10:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044824_22949888.pth... [2023-03-12 05:10:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044256_22659072.pth [2023-03-12 05:10:45,254][146667] Updated weights for policy 0, policy_version 44880 (0.0004) [2023-03-12 05:10:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 23003136. Throughput: 0: 9810.8. Samples: 22999396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:47,720][146380] Avg episode reward: [(0, '4509.092')] [2023-03-12 05:10:49,399][146667] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-12 05:10:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 23052288. Throughput: 0: 9794.9. Samples: 23028700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:52,720][146380] Avg episode reward: [(0, '4521.775')] [2023-03-12 05:10:53,466][146667] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-12 05:10:57,550][146667] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-12 05:10:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9483.3). Total num frames: 23101440. Throughput: 0: 9830.4. Samples: 23089216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:10:57,720][146380] Avg episode reward: [(0, '4564.682')] [2023-03-12 05:10:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045120_23101440.pth... [2023-03-12 05:10:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044536_22802432.pth [2023-03-12 05:11:01,628][146667] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-12 05:11:02,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 23150592. Throughput: 0: 9853.7. Samples: 23149440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:11:02,720][146380] Avg episode reward: [(0, '4556.153')] [2023-03-12 05:11:05,960][146667] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-12 05:11:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 23199744. Throughput: 0: 9863.5. Samples: 23177172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:07,720][146380] Avg episode reward: [(0, '4552.980')] [2023-03-12 05:11:10,268][146667] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-12 05:11:12,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9762.2, 300 sec: 9483.3). Total num frames: 23244800. Throughput: 0: 9824.6. Samples: 23234080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:12,720][146380] Avg episode reward: [(0, '4508.154')] [2023-03-12 05:11:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045400_23244800.pth... [2023-03-12 05:11:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000044824_22949888.pth [2023-03-12 05:11:14,619][146667] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-12 05:11:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9497.2). Total num frames: 23293952. Throughput: 0: 9825.1. Samples: 23290932. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:17,720][146380] Avg episode reward: [(0, '4569.183')] [2023-03-12 05:11:18,988][146667] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-12 05:11:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 23339008. Throughput: 0: 9777.8. Samples: 23318600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:22,720][146380] Avg episode reward: [(0, '4559.490')] [2023-03-12 05:11:23,304][146667] Updated weights for policy 0, policy_version 45600 (0.0004) [2023-03-12 05:11:27,615][146667] Updated weights for policy 0, policy_version 45680 (0.0004) [2023-03-12 05:11:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 23388160. Throughput: 0: 9725.5. Samples: 23375812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:27,720][146380] Avg episode reward: [(0, '4531.389')] [2023-03-12 05:11:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045680_23388160.pth... [2023-03-12 05:11:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045120_23101440.pth [2023-03-12 05:11:31,924][146667] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-12 05:11:32,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 23433216. Throughput: 0: 9640.6. Samples: 23433224. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:11:32,720][146380] Avg episode reward: [(0, '4544.316')] [2023-03-12 05:11:35,932][146667] Updated weights for policy 0, policy_version 45840 (0.0004) [2023-03-12 05:11:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9497.2). Total num frames: 23486464. Throughput: 0: 9669.9. Samples: 23463844. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:11:37,720][146380] Avg episode reward: [(0, '4518.601')] [2023-03-12 05:11:40,054][146667] Updated weights for policy 0, policy_version 45920 (0.0004) [2023-03-12 05:11:42,720][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9511.0). Total num frames: 23535616. Throughput: 0: 9648.4. Samples: 23523392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:11:42,720][146380] Avg episode reward: [(0, '4509.317')] [2023-03-12 05:11:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045968_23535616.pth... [2023-03-12 05:11:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045400_23244800.pth [2023-03-12 05:11:44,194][146667] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-12 05:11:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 23584768. Throughput: 0: 9640.2. Samples: 23583248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:11:47,720][146380] Avg episode reward: [(0, '4508.776')] [2023-03-12 05:11:48,423][146667] Updated weights for policy 0, policy_version 46080 (0.0004) [2023-03-12 05:11:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 23629824. Throughput: 0: 9650.6. Samples: 23611448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:11:52,720][146380] Avg episode reward: [(0, '4505.948')] [2023-03-12 05:11:52,733][146667] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-12 05:11:57,100][146667] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-12 05:11:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 23678976. Throughput: 0: 9636.7. Samples: 23667732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:11:57,720][146380] Avg episode reward: [(0, '4525.460')] [2023-03-12 05:11:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046248_23678976.pth... [2023-03-12 05:11:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045680_23388160.pth [2023-03-12 05:12:01,534][146667] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-12 05:12:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 23724032. Throughput: 0: 9617.3. Samples: 23723712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:12:02,720][146380] Avg episode reward: [(0, '4506.318')] [2023-03-12 05:12:05,823][146667] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-12 05:12:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9511.1). Total num frames: 23773184. Throughput: 0: 9638.8. Samples: 23752344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:07,720][146380] Avg episode reward: [(0, '4506.274')] [2023-03-12 05:12:10,162][146667] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-12 05:12:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 23818240. Throughput: 0: 9621.5. Samples: 23808780. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:12,720][146380] Avg episode reward: [(0, '4511.186')] [2023-03-12 05:12:12,775][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046528_23822336.pth... [2023-03-12 05:12:12,777][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000045968_23535616.pth [2023-03-12 05:12:14,551][146667] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-12 05:12:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 23867392. Throughput: 0: 9592.4. Samples: 23864880. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:17,720][146380] Avg episode reward: [(0, '4518.030')] [2023-03-12 05:12:18,948][146667] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-12 05:12:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 23912448. Throughput: 0: 9529.6. Samples: 23892676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:22,720][146380] Avg episode reward: [(0, '4511.406')] [2023-03-12 05:12:23,256][146667] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-12 05:12:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 23957504. Throughput: 0: 9464.9. Samples: 23949312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:27,720][146380] Avg episode reward: [(0, '4519.807')] [2023-03-12 05:12:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046800_23961600.pth... [2023-03-12 05:12:27,724][146667] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-12 05:12:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046248_23678976.pth [2023-03-12 05:12:32,158][146667] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-12 05:12:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 24006656. Throughput: 0: 9351.5. Samples: 24004064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:12:32,720][146380] Avg episode reward: [(0, '4528.730')] [2023-03-12 05:12:36,577][146667] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-12 05:12:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 24051712. Throughput: 0: 9340.8. Samples: 24031784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:12:37,720][146380] Avg episode reward: [(0, '4519.511')] [2023-03-12 05:12:40,912][146667] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-12 05:12:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 24100864. Throughput: 0: 9352.3. Samples: 24088584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:12:42,720][146380] Avg episode reward: [(0, '4544.882')] [2023-03-12 05:12:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047072_24100864.pth... [2023-03-12 05:12:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046528_23822336.pth [2023-03-12 05:12:45,351][146667] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-12 05:12:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 24145920. Throughput: 0: 9343.5. Samples: 24144172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:12:47,720][146380] Avg episode reward: [(0, '4538.869')] [2023-03-12 05:12:49,711][146667] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-12 05:12:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 24190976. Throughput: 0: 9331.5. Samples: 24172260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:12:52,720][146380] Avg episode reward: [(0, '4537.706')] [2023-03-12 05:12:54,076][146667] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-12 05:12:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 24240128. Throughput: 0: 9314.0. Samples: 24227912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:12:57,720][146380] Avg episode reward: [(0, '4532.056')] [2023-03-12 05:12:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047344_24240128.pth... [2023-03-12 05:12:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000046800_23961600.pth [2023-03-12 05:12:58,475][146667] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-12 05:13:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 24285184. Throughput: 0: 9340.1. Samples: 24285184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:13:02,720][146380] Avg episode reward: [(0, '4553.020')] [2023-03-12 05:13:02,827][146667] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-12 05:13:07,291][146667] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-12 05:13:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24334336. Throughput: 0: 9329.7. Samples: 24312512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:07,720][146380] Avg episode reward: [(0, '4566.896')] [2023-03-12 05:13:11,537][146667] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-12 05:13:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 24379392. Throughput: 0: 9330.1. Samples: 24369168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:12,720][146380] Avg episode reward: [(0, '4538.650')] [2023-03-12 05:13:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047616_24379392.pth... [2023-03-12 05:13:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047072_24100864.pth [2023-03-12 05:13:15,892][146667] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-12 05:13:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24428544. Throughput: 0: 9361.0. Samples: 24425308. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:17,720][146380] Avg episode reward: [(0, '4565.777')] [2023-03-12 05:13:20,270][146667] Updated weights for policy 0, policy_version 47760 (0.0004) [2023-03-12 05:13:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24473600. Throughput: 0: 9371.7. Samples: 24453512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:22,720][146380] Avg episode reward: [(0, '4560.190')] [2023-03-12 05:13:24,611][146667] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-12 05:13:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 24522752. Throughput: 0: 9375.4. Samples: 24510476. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:27,720][146380] Avg episode reward: [(0, '4572.444')] [2023-03-12 05:13:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047896_24522752.pth... [2023-03-12 05:13:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047344_24240128.pth [2023-03-12 05:13:29,033][146667] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-12 05:13:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24567808. Throughput: 0: 9369.4. Samples: 24565796. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:13:32,730][146380] Avg episode reward: [(0, '4393.377')] [2023-03-12 05:13:33,434][146667] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-12 05:13:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24612864. Throughput: 0: 9349.7. Samples: 24592996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:13:37,720][146380] Avg episode reward: [(0, '4512.281')] [2023-03-12 05:13:37,836][146667] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-12 05:13:42,187][146667] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-12 05:13:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 24662016. Throughput: 0: 9375.1. Samples: 24649792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:13:42,730][146380] Avg episode reward: [(0, '4565.021')] [2023-03-12 05:13:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048168_24662016.pth... [2023-03-12 05:13:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047616_24379392.pth [2023-03-12 05:13:46,591][146667] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-12 05:13:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24707072. Throughput: 0: 9350.0. Samples: 24705936. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:13:47,730][146380] Avg episode reward: [(0, '4567.515')] [2023-03-12 05:13:51,111][146667] Updated weights for policy 0, policy_version 48320 (0.0004) [2023-03-12 05:13:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 24752128. Throughput: 0: 9346.1. Samples: 24733088. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:13:52,720][146380] Avg episode reward: [(0, '4571.544')] [2023-03-12 05:13:55,520][146667] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-12 05:13:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 24797184. Throughput: 0: 9320.9. Samples: 24788608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:13:57,723][146380] Avg episode reward: [(0, '4541.056')] [2023-03-12 05:13:57,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048432_24797184.pth... [2023-03-12 05:13:57,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000047896_24522752.pth [2023-03-12 05:14:00,136][146667] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-12 05:14:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 24842240. Throughput: 0: 9265.1. Samples: 24842240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:14:02,730][146380] Avg episode reward: [(0, '4145.274')] [2023-03-12 05:14:04,615][146667] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-12 05:14:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 24891392. Throughput: 0: 9248.7. Samples: 24869704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:07,720][146380] Avg episode reward: [(0, '4277.295')] [2023-03-12 05:14:09,007][146667] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-12 05:14:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 24936448. Throughput: 0: 9212.4. Samples: 24925032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:12,720][146380] Avg episode reward: [(0, '4547.030')] [2023-03-12 05:14:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048704_24936448.pth... [2023-03-12 05:14:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048168_24662016.pth [2023-03-12 05:14:13,491][146667] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-12 05:14:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 24981504. Throughput: 0: 9222.4. Samples: 24980804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:17,730][146380] Avg episode reward: [(0, '4531.013')] [2023-03-12 05:14:17,879][146667] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-12 05:14:22,284][146667] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-12 05:14:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 25026560. Throughput: 0: 9235.1. Samples: 25008576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:22,720][146380] Avg episode reward: [(0, '4504.618')] [2023-03-12 05:14:26,687][146667] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-12 05:14:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 25075712. Throughput: 0: 9210.9. Samples: 25064284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:27,730][146380] Avg episode reward: [(0, '4446.931')] [2023-03-12 05:14:27,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048976_25075712.pth... [2023-03-12 05:14:27,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048432_24797184.pth [2023-03-12 05:14:31,065][146667] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-12 05:14:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 25120768. Throughput: 0: 9208.8. Samples: 25120332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:32,720][146380] Avg episode reward: [(0, '4566.083')] [2023-03-12 05:14:35,526][146667] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-12 05:14:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 25165824. Throughput: 0: 9218.7. Samples: 25147928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:37,720][146380] Avg episode reward: [(0, '4336.719')] [2023-03-12 05:14:39,940][146667] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-12 05:14:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 25214976. Throughput: 0: 9209.6. Samples: 25203040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:42,720][146380] Avg episode reward: [(0, '4406.362')] [2023-03-12 05:14:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049248_25214976.pth... [2023-03-12 05:14:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048704_24936448.pth [2023-03-12 05:14:44,328][146667] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-12 05:14:47,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 25260032. Throughput: 0: 9273.9. Samples: 25259568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:47,720][146380] Avg episode reward: [(0, '4552.221')] [2023-03-12 05:14:48,768][146667] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-12 05:14:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 25309184. Throughput: 0: 9283.8. Samples: 25287476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:52,720][146380] Avg episode reward: [(0, '4486.974')] [2023-03-12 05:14:53,125][146667] Updated weights for policy 0, policy_version 49440 (0.0005) [2023-03-12 05:14:57,410][146667] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-12 05:14:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 25354240. Throughput: 0: 9313.9. Samples: 25344160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:14:57,720][146380] Avg episode reward: [(0, '4540.228')] [2023-03-12 05:14:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049520_25354240.pth... [2023-03-12 05:14:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000048976_25075712.pth [2023-03-12 05:15:01,779][146667] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-12 05:15:02,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 25403392. Throughput: 0: 9321.5. Samples: 25400272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:15:02,720][146380] Avg episode reward: [(0, '4546.727')] [2023-03-12 05:15:06,251][146667] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-12 05:15:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 25448448. Throughput: 0: 9320.3. Samples: 25427988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:07,720][146380] Avg episode reward: [(0, '4535.414')] [2023-03-12 05:15:10,560][146667] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-12 05:15:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 25493504. Throughput: 0: 9342.0. Samples: 25484676. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:12,720][146380] Avg episode reward: [(0, '4553.393')] [2023-03-12 05:15:12,765][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049800_25497600.pth... [2023-03-12 05:15:12,767][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049248_25214976.pth [2023-03-12 05:15:14,947][146667] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-12 05:15:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 25542656. Throughput: 0: 9348.5. Samples: 25541016. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:17,720][146380] Avg episode reward: [(0, '4461.902')] [2023-03-12 05:15:19,139][146667] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-12 05:15:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 25591808. Throughput: 0: 9408.8. Samples: 25571324. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:22,720][146380] Avg episode reward: [(0, '4560.702')] [2023-03-12 05:15:23,247][146667] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-12 05:15:27,417][146667] Updated weights for policy 0, policy_version 50080 (0.0005) [2023-03-12 05:15:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 25640960. Throughput: 0: 9488.7. Samples: 25630032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:27,720][146380] Avg episode reward: [(0, '4324.528')] [2023-03-12 05:15:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050080_25640960.pth... [2023-03-12 05:15:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049520_25354240.pth [2023-03-12 05:15:31,565][146667] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-12 05:15:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 25690112. Throughput: 0: 9555.1. Samples: 25689548. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:15:32,720][146380] Avg episode reward: [(0, '4455.259')] [2023-03-12 05:15:35,773][146667] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-12 05:15:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 25739264. Throughput: 0: 9580.7. Samples: 25718608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:15:37,720][146380] Avg episode reward: [(0, '4530.606')] [2023-03-12 05:15:39,899][146667] Updated weights for policy 0, policy_version 50320 (0.0004) [2023-03-12 05:15:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 25788416. Throughput: 0: 9647.9. Samples: 25778316. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:15:42,720][146380] Avg episode reward: [(0, '4506.230')] [2023-03-12 05:15:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050368_25788416.pth... [2023-03-12 05:15:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000049800_25497600.pth [2023-03-12 05:15:44,001][146667] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-12 05:15:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 25841664. Throughput: 0: 9740.7. Samples: 25838604. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:15:47,720][146380] Avg episode reward: [(0, '4548.366')] [2023-03-12 05:15:48,055][146667] Updated weights for policy 0, policy_version 50480 (0.0004) [2023-03-12 05:15:52,133][146667] Updated weights for policy 0, policy_version 50560 (0.0004) [2023-03-12 05:15:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 25890816. Throughput: 0: 9795.9. Samples: 25868804. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:15:52,720][146380] Avg episode reward: [(0, '4533.981')] [2023-03-12 05:15:56,181][146667] Updated weights for policy 0, policy_version 50640 (0.0004) [2023-03-12 05:15:57,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9455.5). Total num frames: 25939968. Throughput: 0: 9878.2. Samples: 25929192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:15:57,720][146380] Avg episode reward: [(0, '4480.604')] [2023-03-12 05:15:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050664_25939968.pth... [2023-03-12 05:15:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050080_25640960.pth [2023-03-12 05:16:00,259][146667] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-12 05:16:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9469.4). Total num frames: 25993216. Throughput: 0: 9966.0. Samples: 25989488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:16:02,720][146380] Avg episode reward: [(0, '4493.557')] [2023-03-12 05:16:04,292][146667] Updated weights for policy 0, policy_version 50800 (0.0004) [2023-03-12 05:16:07,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9483.3). Total num frames: 26042368. Throughput: 0: 9964.2. Samples: 26019712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:16:07,720][146380] Avg episode reward: [(0, '4451.524')] [2023-03-12 05:16:08,469][146667] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-12 05:16:12,480][146667] Updated weights for policy 0, policy_version 50960 (0.0004) [2023-03-12 05:16:12,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9483.3). Total num frames: 26091520. Throughput: 0: 9996.6. Samples: 26079880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:12,720][146380] Avg episode reward: [(0, '4541.523')] [2023-03-12 05:16:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050960_26091520.pth... [2023-03-12 05:16:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050368_25788416.pth [2023-03-12 05:16:16,480][146667] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-12 05:16:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9497.2). Total num frames: 26140672. Throughput: 0: 10026.6. Samples: 26140744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:17,720][146380] Avg episode reward: [(0, '4548.846')] [2023-03-12 05:16:20,576][146667] Updated weights for policy 0, policy_version 51120 (0.0004) [2023-03-12 05:16:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9511.0). Total num frames: 26193920. Throughput: 0: 10056.2. Samples: 26171136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:22,720][146380] Avg episode reward: [(0, '4474.226')] [2023-03-12 05:16:24,696][146667] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-12 05:16:27,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9524.9). Total num frames: 26243072. Throughput: 0: 10056.3. Samples: 26230848. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:27,720][146380] Avg episode reward: [(0, '4544.851')] [2023-03-12 05:16:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051256_26243072.pth... [2023-03-12 05:16:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050664_25939968.pth [2023-03-12 05:16:28,879][146667] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-12 05:16:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9497.2). Total num frames: 26288128. Throughput: 0: 9972.4. Samples: 26287360. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:32,720][146380] Avg episode reward: [(0, '4541.581')] [2023-03-12 05:16:33,315][146667] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-12 05:16:37,669][146667] Updated weights for policy 0, policy_version 51440 (0.0005) [2023-03-12 05:16:37,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9497.2). Total num frames: 26337280. Throughput: 0: 9921.0. Samples: 26315248. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:16:37,720][146380] Avg episode reward: [(0, '4541.479')] [2023-03-12 05:16:42,000][146667] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-12 05:16:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9483.3). Total num frames: 26382336. Throughput: 0: 9843.8. Samples: 26372164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:16:42,720][146380] Avg episode reward: [(0, '4507.292')] [2023-03-12 05:16:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051528_26382336.pth... [2023-03-12 05:16:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000050960_26091520.pth [2023-03-12 05:16:46,212][146667] Updated weights for policy 0, policy_version 51600 (0.0004) [2023-03-12 05:16:47,719][146380] Fps is (10 sec: 9421.0, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 26431488. Throughput: 0: 9799.5. Samples: 26430464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:16:47,720][146380] Avg episode reward: [(0, '4509.816')] [2023-03-12 05:16:50,417][146667] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-12 05:16:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 26480640. Throughput: 0: 9781.3. Samples: 26459868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:16:52,720][146380] Avg episode reward: [(0, '4511.885')] [2023-03-12 05:16:54,518][146667] Updated weights for policy 0, policy_version 51760 (0.0004) [2023-03-12 05:16:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9511.0). Total num frames: 26529792. Throughput: 0: 9766.1. Samples: 26519356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:16:57,720][146380] Avg episode reward: [(0, '4558.464')] [2023-03-12 05:16:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051816_26529792.pth... [2023-03-12 05:16:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051256_26243072.pth [2023-03-12 05:16:58,580][146667] Updated weights for policy 0, policy_version 51840 (0.0004) [2023-03-12 05:17:02,636][146667] Updated weights for policy 0, policy_version 51920 (0.0004) [2023-03-12 05:17:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9524.9). Total num frames: 26583040. Throughput: 0: 9755.4. Samples: 26579736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:02,720][146380] Avg episode reward: [(0, '4542.484')] [2023-03-12 05:17:06,757][146667] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-12 05:17:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 26632192. Throughput: 0: 9745.4. Samples: 26609680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:07,720][146380] Avg episode reward: [(0, '4556.650')] [2023-03-12 05:17:10,938][146667] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-12 05:17:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 26681344. Throughput: 0: 9738.1. Samples: 26669064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:12,720][146380] Avg episode reward: [(0, '4486.782')] [2023-03-12 05:17:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052112_26681344.pth... [2023-03-12 05:17:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051528_26382336.pth [2023-03-12 05:17:15,080][146667] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-12 05:17:17,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9552.7). Total num frames: 26730496. Throughput: 0: 9780.5. Samples: 26727480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:17,720][146380] Avg episode reward: [(0, '4531.700')] [2023-03-12 05:17:19,290][146667] Updated weights for policy 0, policy_version 52240 (0.0004) [2023-03-12 05:17:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 26779648. Throughput: 0: 9819.0. Samples: 26757100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:22,720][146380] Avg episode reward: [(0, '4553.523')] [2023-03-12 05:17:23,436][146667] Updated weights for policy 0, policy_version 52320 (0.0004) [2023-03-12 05:17:27,514][146667] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-12 05:17:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 26828800. Throughput: 0: 9875.8. Samples: 26816576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:27,720][146380] Avg episode reward: [(0, '4567.033')] [2023-03-12 05:17:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052400_26828800.pth... [2023-03-12 05:17:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000051816_26529792.pth [2023-03-12 05:17:31,586][146667] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-12 05:17:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9580.5). Total num frames: 26877952. Throughput: 0: 9924.2. Samples: 26877056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:32,730][146380] Avg episode reward: [(0, '4573.106')] [2023-03-12 05:17:35,994][146667] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-12 05:17:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 26923008. Throughput: 0: 9881.4. Samples: 26904532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:37,720][146380] Avg episode reward: [(0, '4557.475')] [2023-03-12 05:17:40,522][146667] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-12 05:17:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 26968064. Throughput: 0: 9787.4. Samples: 26959788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:17:42,720][146380] Avg episode reward: [(0, '4448.007')] [2023-03-12 05:17:42,747][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052680_26972160.pth... [2023-03-12 05:17:42,749][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052112_26681344.pth [2023-03-12 05:17:44,944][146667] Updated weights for policy 0, policy_version 52720 (0.0005) [2023-03-12 05:17:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 27017216. Throughput: 0: 9678.5. Samples: 27015268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:17:47,730][146380] Avg episode reward: [(0, '4568.914')] [2023-03-12 05:17:49,351][146667] Updated weights for policy 0, policy_version 52800 (0.0005) [2023-03-12 05:17:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 27062272. Throughput: 0: 9618.2. Samples: 27042500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:17:52,720][146380] Avg episode reward: [(0, '4510.375')] [2023-03-12 05:17:53,751][146667] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-12 05:17:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 27107328. Throughput: 0: 9551.8. Samples: 27098896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:17:57,723][146380] Avg episode reward: [(0, '4575.855')] [2023-03-12 05:17:57,771][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052952_27111424.pth... [2023-03-12 05:17:57,773][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052400_26828800.pth [2023-03-12 05:17:58,213][146667] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-12 05:18:02,612][146667] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-12 05:18:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 27156480. Throughput: 0: 9474.6. Samples: 27153840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:18:02,730][146380] Avg episode reward: [(0, '4549.784')] [2023-03-12 05:18:06,984][146667] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-12 05:18:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 27201536. Throughput: 0: 9440.4. Samples: 27181916. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:18:07,720][146380] Avg episode reward: [(0, '4555.066')] [2023-03-12 05:18:11,411][146667] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-12 05:18:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 27246592. Throughput: 0: 9366.0. Samples: 27238048. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:18:12,720][146380] Avg episode reward: [(0, '4562.907')] [2023-03-12 05:18:12,735][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053224_27250688.pth... [2023-03-12 05:18:12,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052680_26972160.pth [2023-03-12 05:18:15,877][146667] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-12 05:18:17,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 27295744. Throughput: 0: 9242.1. Samples: 27292952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:18:17,720][146380] Avg episode reward: [(0, '4549.983')] [2023-03-12 05:18:20,316][146667] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-12 05:18:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 27340800. Throughput: 0: 9241.3. Samples: 27320392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:22,720][146380] Avg episode reward: [(0, '4552.764')] [2023-03-12 05:18:24,712][146667] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-12 05:18:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9552.7). Total num frames: 27385856. Throughput: 0: 9265.3. Samples: 27376728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:27,720][146380] Avg episode reward: [(0, '4564.501')] [2023-03-12 05:18:27,761][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053496_27389952.pth... [2023-03-12 05:18:27,763][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000052952_27111424.pth [2023-03-12 05:18:29,057][146667] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-12 05:18:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9566.6). Total num frames: 27435008. Throughput: 0: 9329.0. Samples: 27435072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:32,720][146380] Avg episode reward: [(0, '4509.066')] [2023-03-12 05:18:33,141][146667] Updated weights for policy 0, policy_version 53600 (0.0004) [2023-03-12 05:18:37,322][146667] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-12 05:18:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 27484160. Throughput: 0: 9370.9. Samples: 27464188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:37,720][146380] Avg episode reward: [(0, '4537.128')] [2023-03-12 05:18:41,484][146667] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-12 05:18:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 27533312. Throughput: 0: 9437.2. Samples: 27523572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:42,720][146380] Avg episode reward: [(0, '4495.701')] [2023-03-12 05:18:42,750][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053784_27537408.pth... [2023-03-12 05:18:42,751][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053224_27250688.pth [2023-03-12 05:18:45,657][146667] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-12 05:18:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27586560. Throughput: 0: 9528.8. Samples: 27582636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:47,720][146380] Avg episode reward: [(0, '4533.876')] [2023-03-12 05:18:49,698][146667] Updated weights for policy 0, policy_version 53920 (0.0004) [2023-03-12 05:18:52,719][146380] Fps is (10 sec: 9830.6, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27631616. Throughput: 0: 9580.2. Samples: 27613024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:18:52,720][146380] Avg episode reward: [(0, '4571.309')] [2023-03-12 05:18:54,040][146667] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-12 05:18:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 27680768. Throughput: 0: 9566.8. Samples: 27668552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:18:57,720][146380] Avg episode reward: [(0, '4575.610')] [2023-03-12 05:18:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054064_27680768.pth... [2023-03-12 05:18:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053496_27389952.pth [2023-03-12 05:18:58,555][146667] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-12 05:19:02,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27725824. Throughput: 0: 9569.4. Samples: 27723576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:19:02,720][146380] Avg episode reward: [(0, '4536.709')] [2023-03-12 05:19:03,062][146667] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-12 05:19:07,565][146667] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-12 05:19:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27770880. Throughput: 0: 9557.2. Samples: 27750464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:19:07,720][146380] Avg episode reward: [(0, '4557.021')] [2023-03-12 05:19:12,076][146667] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-12 05:19:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27815936. Throughput: 0: 9507.8. Samples: 27804580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:19:12,720][146380] Avg episode reward: [(0, '4544.820')] [2023-03-12 05:19:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054328_27815936.pth... [2023-03-12 05:19:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000053784_27537408.pth [2023-03-12 05:19:16,569][146667] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-12 05:19:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 27860992. Throughput: 0: 9450.1. Samples: 27860324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:19:17,720][146380] Avg episode reward: [(0, '4490.105')] [2023-03-12 05:19:20,976][146667] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-12 05:19:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 27906048. Throughput: 0: 9410.7. Samples: 27887668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:19:22,720][146380] Avg episode reward: [(0, '4484.776')] [2023-03-12 05:19:25,461][146667] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-12 05:19:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 27955200. Throughput: 0: 9318.9. Samples: 27942924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:27,720][146380] Avg episode reward: [(0, '4434.379')] [2023-03-12 05:19:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054600_27955200.pth... [2023-03-12 05:19:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054064_27680768.pth [2023-03-12 05:19:29,846][146667] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-12 05:19:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 28000256. Throughput: 0: 9258.0. Samples: 27999248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:32,720][146380] Avg episode reward: [(0, '4492.242')] [2023-03-12 05:19:34,236][146667] Updated weights for policy 0, policy_version 54720 (0.0005) [2023-03-12 05:19:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 28045312. Throughput: 0: 9211.7. Samples: 28027552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:37,720][146380] Avg episode reward: [(0, '4391.629')] [2023-03-12 05:19:38,648][146667] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-12 05:19:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 28094464. Throughput: 0: 9193.3. Samples: 28082248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:42,720][146380] Avg episode reward: [(0, '4403.251')] [2023-03-12 05:19:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054872_28094464.pth... [2023-03-12 05:19:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054328_27815936.pth [2023-03-12 05:19:43,109][146667] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-12 05:19:47,505][146667] Updated weights for policy 0, policy_version 54960 (0.0004) [2023-03-12 05:19:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9594.4). Total num frames: 28139520. Throughput: 0: 9214.8. Samples: 28138240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:47,720][146380] Avg episode reward: [(0, '4367.497')] [2023-03-12 05:19:51,680][146667] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-12 05:19:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9608.2). Total num frames: 28188672. Throughput: 0: 9266.2. Samples: 28167444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:52,720][146380] Avg episode reward: [(0, '4520.682')] [2023-03-12 05:19:55,804][146667] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-12 05:19:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9608.2). Total num frames: 28237824. Throughput: 0: 9376.6. Samples: 28226528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:19:57,720][146380] Avg episode reward: [(0, '4490.074')] [2023-03-12 05:19:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055152_28237824.pth... [2023-03-12 05:19:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054600_27955200.pth [2023-03-12 05:20:00,022][146667] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-12 05:20:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9622.1). Total num frames: 28286976. Throughput: 0: 9413.7. Samples: 28283940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:02,720][146380] Avg episode reward: [(0, '4549.473')] [2023-03-12 05:20:04,364][146667] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-12 05:20:07,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9622.1). Total num frames: 28332032. Throughput: 0: 9437.9. Samples: 28312376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:07,720][146380] Avg episode reward: [(0, '4491.569')] [2023-03-12 05:20:08,739][146667] Updated weights for policy 0, policy_version 55360 (0.0004) [2023-03-12 05:20:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 28381184. Throughput: 0: 9466.4. Samples: 28368912. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:12,720][146380] Avg episode reward: [(0, '4511.683')] [2023-03-12 05:20:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055432_28381184.pth... [2023-03-12 05:20:12,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000054872_28094464.pth [2023-03-12 05:20:12,985][146667] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-12 05:20:17,110][146667] Updated weights for policy 0, policy_version 55520 (0.0004) [2023-03-12 05:20:17,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 28430336. Throughput: 0: 9534.9. Samples: 28428320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:17,720][146380] Avg episode reward: [(0, '4503.159')] [2023-03-12 05:20:21,476][146667] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-12 05:20:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 28475392. Throughput: 0: 9537.5. Samples: 28456740. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:22,720][146380] Avg episode reward: [(0, '4560.736')] [2023-03-12 05:20:25,919][146667] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-12 05:20:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 28524544. Throughput: 0: 9555.9. Samples: 28512264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:27,720][146380] Avg episode reward: [(0, '4555.286')] [2023-03-12 05:20:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055712_28524544.pth... [2023-03-12 05:20:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055152_28237824.pth [2023-03-12 05:20:30,271][146667] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-12 05:20:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 28569600. Throughput: 0: 9577.1. Samples: 28569208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:20:32,720][146380] Avg episode reward: [(0, '4489.956')] [2023-03-12 05:20:34,644][146667] Updated weights for policy 0, policy_version 55840 (0.0005) [2023-03-12 05:20:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 28614656. Throughput: 0: 9539.4. Samples: 28596716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:20:37,720][146380] Avg episode reward: [(0, '4545.711')] [2023-03-12 05:20:39,066][146667] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-12 05:20:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 28663808. Throughput: 0: 9456.5. Samples: 28652072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:20:42,720][146380] Avg episode reward: [(0, '4539.198')] [2023-03-12 05:20:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055984_28663808.pth... [2023-03-12 05:20:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055432_28381184.pth [2023-03-12 05:20:43,420][146667] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-12 05:20:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9552.7). Total num frames: 28708864. Throughput: 0: 9440.1. Samples: 28708744. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:20:47,720][146380] Avg episode reward: [(0, '4489.942')] [2023-03-12 05:20:47,868][146667] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-12 05:20:52,288][146667] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-12 05:20:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9552.7). Total num frames: 28758016. Throughput: 0: 9415.0. Samples: 28736048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:20:52,720][146380] Avg episode reward: [(0, '4480.115')] [2023-03-12 05:20:56,741][146667] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-12 05:20:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 28803072. Throughput: 0: 9378.6. Samples: 28790948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:20:57,720][146380] Avg episode reward: [(0, '4585.344')] [2023-03-12 05:20:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056256_28803072.pth... [2023-03-12 05:20:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055712_28524544.pth [2023-03-12 05:20:57,727][146623] Saving new best policy, reward=4585.344! [2023-03-12 05:21:01,120][146667] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-12 05:21:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 28848128. Throughput: 0: 9317.7. Samples: 28847616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:02,720][146380] Avg episode reward: [(0, '4525.311')] [2023-03-12 05:21:05,476][146667] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-12 05:21:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 28897280. Throughput: 0: 9312.9. Samples: 28875820. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:07,720][146380] Avg episode reward: [(0, '4567.986')] [2023-03-12 05:21:09,803][146667] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-12 05:21:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 28942336. Throughput: 0: 9334.5. Samples: 28932316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:12,720][146380] Avg episode reward: [(0, '4514.702')] [2023-03-12 05:21:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056528_28942336.pth... [2023-03-12 05:21:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000055984_28663808.pth [2023-03-12 05:21:14,183][146667] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-12 05:21:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 28991488. Throughput: 0: 9314.4. Samples: 28988356. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:17,730][146380] Avg episode reward: [(0, '4566.159')] [2023-03-12 05:21:18,512][146667] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-12 05:21:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 29036544. Throughput: 0: 9323.7. Samples: 29016284. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:22,720][146380] Avg episode reward: [(0, '4522.055')] [2023-03-12 05:21:22,968][146667] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-12 05:21:27,446][146667] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-12 05:21:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 29081600. Throughput: 0: 9325.2. Samples: 29071704. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:27,730][146380] Avg episode reward: [(0, '4511.934')] [2023-03-12 05:21:27,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056800_29081600.pth... [2023-03-12 05:21:27,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056256_28803072.pth [2023-03-12 05:21:31,860][146667] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-12 05:21:32,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 29126656. Throughput: 0: 9289.1. Samples: 29126752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:32,720][146380] Avg episode reward: [(0, '4331.937')] [2023-03-12 05:21:36,248][146667] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-12 05:21:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 29175808. Throughput: 0: 9317.5. Samples: 29155336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:37,720][146380] Avg episode reward: [(0, '4460.094')] [2023-03-12 05:21:40,641][146667] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-12 05:21:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 29220864. Throughput: 0: 9338.8. Samples: 29211196. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:21:42,720][146380] Avg episode reward: [(0, '4504.459')] [2023-03-12 05:21:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057072_29220864.pth... [2023-03-12 05:21:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056528_28942336.pth [2023-03-12 05:21:45,176][146667] Updated weights for policy 0, policy_version 57120 (0.0005) [2023-03-12 05:21:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 29265920. Throughput: 0: 9295.6. Samples: 29265920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:21:47,720][146380] Avg episode reward: [(0, '4464.287')] [2023-03-12 05:21:49,680][146667] Updated weights for policy 0, policy_version 57200 (0.0005) [2023-03-12 05:21:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 29310976. Throughput: 0: 9257.0. Samples: 29292384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:21:52,720][146380] Avg episode reward: [(0, '4421.693')] [2023-03-12 05:21:54,038][146667] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-12 05:21:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 29360128. Throughput: 0: 9255.0. Samples: 29348792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:21:57,720][146380] Avg episode reward: [(0, '4550.211')] [2023-03-12 05:21:57,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057344_29360128.pth... [2023-03-12 05:21:57,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000056800_29081600.pth [2023-03-12 05:21:58,409][146667] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-12 05:22:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 29405184. Throughput: 0: 9264.3. Samples: 29405248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:02,720][146380] Avg episode reward: [(0, '4529.104')] [2023-03-12 05:22:02,771][146667] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-12 05:22:07,264][146667] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-12 05:22:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 29450240. Throughput: 0: 9278.5. Samples: 29433816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:07,720][146380] Avg episode reward: [(0, '4542.630')] [2023-03-12 05:22:11,817][146667] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-12 05:22:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 29495296. Throughput: 0: 9231.4. Samples: 29487116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:12,720][146380] Avg episode reward: [(0, '4411.582')] [2023-03-12 05:22:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057616_29499392.pth... [2023-03-12 05:22:12,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057072_29220864.pth [2023-03-12 05:22:16,311][146667] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-12 05:22:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 29544448. Throughput: 0: 9216.5. Samples: 29541496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:17,720][146380] Avg episode reward: [(0, '4548.247')] [2023-03-12 05:22:20,776][146667] Updated weights for policy 0, policy_version 57760 (0.0004) [2023-03-12 05:22:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 29589504. Throughput: 0: 9193.2. Samples: 29569032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:22,720][146380] Avg episode reward: [(0, '4547.699')] [2023-03-12 05:22:25,164][146667] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-12 05:22:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 29634560. Throughput: 0: 9196.3. Samples: 29625028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:27,720][146380] Avg episode reward: [(0, '4539.123')] [2023-03-12 05:22:27,772][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057888_29638656.pth... [2023-03-12 05:22:27,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057344_29360128.pth [2023-03-12 05:22:29,501][146667] Updated weights for policy 0, policy_version 57920 (0.0004) [2023-03-12 05:22:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 29683712. Throughput: 0: 9233.9. Samples: 29681444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:32,720][146380] Avg episode reward: [(0, '4492.331')] [2023-03-12 05:22:33,882][146667] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-12 05:22:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 29728768. Throughput: 0: 9256.7. Samples: 29708936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:37,720][146380] Avg episode reward: [(0, '4538.422')] [2023-03-12 05:22:38,433][146667] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-12 05:22:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 29773824. Throughput: 0: 9223.0. Samples: 29763828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:42,720][146380] Avg episode reward: [(0, '4532.588')] [2023-03-12 05:22:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058152_29773824.pth... [2023-03-12 05:22:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057616_29499392.pth [2023-03-12 05:22:42,836][146667] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-12 05:22:47,341][146667] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-12 05:22:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 29818880. Throughput: 0: 9192.0. Samples: 29818888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:47,720][146380] Avg episode reward: [(0, '4514.948')] [2023-03-12 05:22:51,761][146667] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-12 05:22:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 29868032. Throughput: 0: 9186.3. Samples: 29847200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:52,720][146380] Avg episode reward: [(0, '4533.639')] [2023-03-12 05:22:56,165][146667] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-12 05:22:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 29913088. Throughput: 0: 9231.0. Samples: 29902512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:22:57,720][146380] Avg episode reward: [(0, '4534.351')] [2023-03-12 05:22:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058424_29913088.pth... [2023-03-12 05:22:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000057888_29638656.pth [2023-03-12 05:23:00,592][146667] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-12 05:23:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 29958144. Throughput: 0: 9258.8. Samples: 29958144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:02,720][146380] Avg episode reward: [(0, '4546.810')] [2023-03-12 05:23:05,079][146667] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-12 05:23:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 30003200. Throughput: 0: 9247.4. Samples: 29985164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:07,720][146380] Avg episode reward: [(0, '4527.880')] [2023-03-12 05:23:09,565][146667] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-12 05:23:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 30048256. Throughput: 0: 9223.0. Samples: 30040064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:12,720][146380] Avg episode reward: [(0, '4532.562')] [2023-03-12 05:23:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058696_30052352.pth... [2023-03-12 05:23:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058152_29773824.pth [2023-03-12 05:23:14,083][146667] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-12 05:23:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 30097408. Throughput: 0: 9191.8. Samples: 30095076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:17,720][146380] Avg episode reward: [(0, '4527.043')] [2023-03-12 05:23:18,479][146667] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-12 05:23:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 30142464. Throughput: 0: 9188.3. Samples: 30122408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:22,720][146380] Avg episode reward: [(0, '4544.300')] [2023-03-12 05:23:22,897][146667] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-12 05:23:27,313][146667] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-12 05:23:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 30187520. Throughput: 0: 9224.4. Samples: 30178928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:27,720][146380] Avg episode reward: [(0, '4518.127')] [2023-03-12 05:23:27,745][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058968_30191616.pth... [2023-03-12 05:23:27,747][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058424_29913088.pth [2023-03-12 05:23:31,658][146667] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-12 05:23:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 30236672. Throughput: 0: 9251.9. Samples: 30235224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:23:32,720][146380] Avg episode reward: [(0, '4528.231')] [2023-03-12 05:23:36,077][146667] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-12 05:23:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 30281728. Throughput: 0: 9229.4. Samples: 30262524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:23:37,720][146380] Avg episode reward: [(0, '4553.462')] [2023-03-12 05:23:40,387][146667] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-12 05:23:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 30330880. Throughput: 0: 9249.2. Samples: 30318728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:23:42,720][146380] Avg episode reward: [(0, '4545.460')] [2023-03-12 05:23:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059240_30330880.pth... [2023-03-12 05:23:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058696_30052352.pth [2023-03-12 05:23:44,812][146667] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-12 05:23:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 30375936. Throughput: 0: 9265.0. Samples: 30375068. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:23:47,720][146380] Avg episode reward: [(0, '4540.823')] [2023-03-12 05:23:49,160][146667] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-12 05:23:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 30425088. Throughput: 0: 9313.1. Samples: 30404256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:23:52,720][146380] Avg episode reward: [(0, '4552.617')] [2023-03-12 05:23:53,443][146667] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-12 05:23:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 30470144. Throughput: 0: 9341.6. Samples: 30460436. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:23:57,720][146380] Avg episode reward: [(0, '4527.431')] [2023-03-12 05:23:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059512_30470144.pth... [2023-03-12 05:23:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000058968_30191616.pth [2023-03-12 05:23:57,864][146667] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-12 05:24:02,080][146667] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-12 05:24:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 30519296. Throughput: 0: 9391.6. Samples: 30517696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:24:02,720][146380] Avg episode reward: [(0, '4530.520')] [2023-03-12 05:24:06,275][146667] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-12 05:24:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 30568448. Throughput: 0: 9437.2. Samples: 30547084. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:24:07,720][146380] Avg episode reward: [(0, '4421.427')] [2023-03-12 05:24:10,389][146667] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-12 05:24:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 30617600. Throughput: 0: 9509.1. Samples: 30606836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:12,720][146380] Avg episode reward: [(0, '4326.796')] [2023-03-12 05:24:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059800_30617600.pth... [2023-03-12 05:24:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059240_30330880.pth [2023-03-12 05:24:14,417][146667] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-12 05:24:17,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 30666752. Throughput: 0: 9591.1. Samples: 30666824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:17,720][146380] Avg episode reward: [(0, '4286.279')] [2023-03-12 05:24:18,593][146667] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-12 05:24:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 30715904. Throughput: 0: 9620.0. Samples: 30695424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:22,720][146380] Avg episode reward: [(0, '4348.498')] [2023-03-12 05:24:22,951][146667] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-12 05:24:27,309][146667] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-12 05:24:27,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 30760960. Throughput: 0: 9631.7. Samples: 30752152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:27,720][146380] Avg episode reward: [(0, '4467.181')] [2023-03-12 05:24:27,763][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060088_30765056.pth... [2023-03-12 05:24:27,765][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059512_30470144.pth [2023-03-12 05:24:31,661][146667] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-12 05:24:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 30810112. Throughput: 0: 9630.6. Samples: 30808444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:32,720][146380] Avg episode reward: [(0, '4531.008')] [2023-03-12 05:24:36,059][146667] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-12 05:24:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 30855168. Throughput: 0: 9594.7. Samples: 30836016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:37,720][146380] Avg episode reward: [(0, '4518.067')] [2023-03-12 05:24:40,416][146667] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-12 05:24:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 30904320. Throughput: 0: 9592.6. Samples: 30892104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:42,720][146380] Avg episode reward: [(0, '4525.915')] [2023-03-12 05:24:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060360_30904320.pth... [2023-03-12 05:24:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000059800_30617600.pth [2023-03-12 05:24:44,775][146667] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-12 05:24:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 30949376. Throughput: 0: 9588.3. Samples: 30949168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:47,720][146380] Avg episode reward: [(0, '4510.507')] [2023-03-12 05:24:49,159][146667] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-12 05:24:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 30998528. Throughput: 0: 9556.2. Samples: 30977112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:52,720][146380] Avg episode reward: [(0, '4535.698')] [2023-03-12 05:24:53,461][146667] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-12 05:24:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 31043584. Throughput: 0: 9499.5. Samples: 31034316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:24:57,720][146380] Avg episode reward: [(0, '4552.096')] [2023-03-12 05:24:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060632_31043584.pth... [2023-03-12 05:24:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060088_30765056.pth [2023-03-12 05:24:57,814][146667] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-12 05:25:02,204][146667] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-12 05:25:02,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 31092736. Throughput: 0: 9400.9. Samples: 31089864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:02,720][146380] Avg episode reward: [(0, '4502.712')] [2023-03-12 05:25:06,609][146667] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-12 05:25:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 31137792. Throughput: 0: 9376.7. Samples: 31117376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:07,720][146380] Avg episode reward: [(0, '4526.404')] [2023-03-12 05:25:10,971][146667] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-12 05:25:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 31186944. Throughput: 0: 9383.2. Samples: 31174396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:12,720][146380] Avg episode reward: [(0, '4405.427')] [2023-03-12 05:25:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060912_31186944.pth... [2023-03-12 05:25:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060360_30904320.pth [2023-03-12 05:25:15,252][146667] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-12 05:25:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 31232000. Throughput: 0: 9412.5. Samples: 31232008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:17,720][146380] Avg episode reward: [(0, '4544.815')] [2023-03-12 05:25:19,512][146667] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-12 05:25:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 31281152. Throughput: 0: 9437.1. Samples: 31260684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:22,720][146380] Avg episode reward: [(0, '4526.278')] [2023-03-12 05:25:23,743][146667] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-12 05:25:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 31330304. Throughput: 0: 9468.1. Samples: 31318168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:27,720][146380] Avg episode reward: [(0, '4515.974')] [2023-03-12 05:25:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061192_31330304.pth... [2023-03-12 05:25:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060632_31043584.pth [2023-03-12 05:25:27,983][146667] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-12 05:25:32,289][146667] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-12 05:25:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 31379456. Throughput: 0: 9473.9. Samples: 31375496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:32,720][146380] Avg episode reward: [(0, '4510.161')] [2023-03-12 05:25:36,636][146667] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-12 05:25:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 31424512. Throughput: 0: 9488.5. Samples: 31404096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:37,720][146380] Avg episode reward: [(0, '4513.248')] [2023-03-12 05:25:40,909][146667] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-12 05:25:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 31473664. Throughput: 0: 9491.6. Samples: 31461440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:42,720][146380] Avg episode reward: [(0, '4505.728')] [2023-03-12 05:25:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061472_31473664.pth... [2023-03-12 05:25:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000060912_31186944.pth [2023-03-12 05:25:45,148][146667] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-12 05:25:47,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 31518720. Throughput: 0: 9531.5. Samples: 31518784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:47,720][146380] Avg episode reward: [(0, '4532.806')] [2023-03-12 05:25:49,471][146667] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-12 05:25:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 31567872. Throughput: 0: 9557.3. Samples: 31547456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:52,720][146380] Avg episode reward: [(0, '4521.386')] [2023-03-12 05:25:53,741][146667] Updated weights for policy 0, policy_version 61680 (0.0004) [2023-03-12 05:25:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 31617024. Throughput: 0: 9564.5. Samples: 31604800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:25:57,720][146380] Avg episode reward: [(0, '4474.395')] [2023-03-12 05:25:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061752_31617024.pth... [2023-03-12 05:25:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061192_31330304.pth [2023-03-12 05:25:58,052][146667] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-12 05:26:02,418][146667] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-12 05:26:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 31662080. Throughput: 0: 9552.5. Samples: 31661872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:02,720][146380] Avg episode reward: [(0, '4168.986')] [2023-03-12 05:26:06,768][146667] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-12 05:26:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 31711232. Throughput: 0: 9535.0. Samples: 31689760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:07,720][146380] Avg episode reward: [(0, '4345.176')] [2023-03-12 05:26:11,101][146667] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-12 05:26:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 31756288. Throughput: 0: 9519.4. Samples: 31746540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:12,720][146380] Avg episode reward: [(0, '4513.323')] [2023-03-12 05:26:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062024_31756288.pth... [2023-03-12 05:26:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061472_31473664.pth [2023-03-12 05:26:15,412][146667] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-12 05:26:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 31805440. Throughput: 0: 9512.0. Samples: 31803536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:17,720][146380] Avg episode reward: [(0, '4499.554')] [2023-03-12 05:26:19,712][146667] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-12 05:26:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 31850496. Throughput: 0: 9505.3. Samples: 31831836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:22,720][146380] Avg episode reward: [(0, '4462.450')] [2023-03-12 05:26:24,040][146667] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-12 05:26:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 31899648. Throughput: 0: 9483.0. Samples: 31888176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:27,720][146380] Avg episode reward: [(0, '4441.493')] [2023-03-12 05:26:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062304_31899648.pth... [2023-03-12 05:26:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000061752_31617024.pth [2023-03-12 05:26:28,388][146667] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-12 05:26:32,400][146667] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-12 05:26:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 31948800. Throughput: 0: 9546.5. Samples: 31948376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:32,720][146380] Avg episode reward: [(0, '4508.994')] [2023-03-12 05:26:36,490][146667] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-12 05:26:37,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 32002048. Throughput: 0: 9567.1. Samples: 31977976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:37,720][146380] Avg episode reward: [(0, '4524.286')] [2023-03-12 05:26:40,479][146667] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-12 05:26:42,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 32051200. Throughput: 0: 9648.5. Samples: 32038984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:42,720][146380] Avg episode reward: [(0, '4527.947')] [2023-03-12 05:26:42,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062600_32051200.pth... [2023-03-12 05:26:42,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062024_31756288.pth [2023-03-12 05:26:44,489][146667] Updated weights for policy 0, policy_version 62640 (0.0004) [2023-03-12 05:26:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 32104448. Throughput: 0: 9746.8. Samples: 32100480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:47,720][146380] Avg episode reward: [(0, '4500.897')] [2023-03-12 05:26:48,506][146667] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-12 05:26:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 32149504. Throughput: 0: 9770.8. Samples: 32129448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:52,720][146380] Avg episode reward: [(0, '4502.573')] [2023-03-12 05:26:52,837][146667] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-12 05:26:57,109][146667] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-12 05:26:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 32198656. Throughput: 0: 9781.6. Samples: 32186712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:26:57,720][146380] Avg episode reward: [(0, '4482.028')] [2023-03-12 05:26:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062888_32198656.pth... [2023-03-12 05:26:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062304_31899648.pth [2023-03-12 05:27:01,126][146667] Updated weights for policy 0, policy_version 62960 (0.0004) [2023-03-12 05:27:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 32251904. Throughput: 0: 9875.6. Samples: 32247936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:27:02,720][146380] Avg episode reward: [(0, '4486.495')] [2023-03-12 05:27:05,044][146667] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-12 05:27:07,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9511.1). Total num frames: 32301056. Throughput: 0: 9953.3. Samples: 32279732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:27:07,720][146380] Avg episode reward: [(0, '4516.588')] [2023-03-12 05:27:09,040][146667] Updated weights for policy 0, policy_version 63120 (0.0004) [2023-03-12 05:27:12,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9524.9). Total num frames: 32354304. Throughput: 0: 10063.5. Samples: 32341036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:27:12,720][146380] Avg episode reward: [(0, '4520.805')] [2023-03-12 05:27:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063192_32354304.pth... [2023-03-12 05:27:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062600_32051200.pth [2023-03-12 05:27:13,038][146667] Updated weights for policy 0, policy_version 63200 (0.0004) [2023-03-12 05:27:16,990][146667] Updated weights for policy 0, policy_version 63280 (0.0004) [2023-03-12 05:27:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9538.8). Total num frames: 32403456. Throughput: 0: 10103.6. Samples: 32403040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:27:17,720][146380] Avg episode reward: [(0, '4478.575')] [2023-03-12 05:27:21,002][146667] Updated weights for policy 0, policy_version 63360 (0.0004) [2023-03-12 05:27:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9566.6). Total num frames: 32456704. Throughput: 0: 10126.3. Samples: 32433660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:22,720][146380] Avg episode reward: [(0, '4531.813')] [2023-03-12 05:27:25,218][146667] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-12 05:27:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9552.7). Total num frames: 32501760. Throughput: 0: 10082.9. Samples: 32492716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:27,720][146380] Avg episode reward: [(0, '4502.691')] [2023-03-12 05:27:27,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063488_32505856.pth... [2023-03-12 05:27:27,741][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000062888_32198656.pth [2023-03-12 05:27:29,467][146667] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-12 05:27:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9566.6). Total num frames: 32550912. Throughput: 0: 9971.6. Samples: 32549204. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:32,720][146380] Avg episode reward: [(0, '4514.172')] [2023-03-12 05:27:33,789][146667] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-12 05:27:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9580.5). Total num frames: 32600064. Throughput: 0: 9982.0. Samples: 32578640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:37,720][146380] Avg episode reward: [(0, '4502.977')] [2023-03-12 05:27:38,083][146667] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-12 05:27:42,252][146667] Updated weights for policy 0, policy_version 63760 (0.0004) [2023-03-12 05:27:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9594.4). Total num frames: 32649216. Throughput: 0: 9982.5. Samples: 32635924. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:42,720][146380] Avg episode reward: [(0, '4507.934')] [2023-03-12 05:27:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063768_32649216.pth... [2023-03-12 05:27:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063192_32354304.pth [2023-03-12 05:27:46,432][146667] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-12 05:27:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9594.4). Total num frames: 32698368. Throughput: 0: 9941.7. Samples: 32695312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:47,720][146380] Avg episode reward: [(0, '4511.819')] [2023-03-12 05:27:50,533][146667] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-12 05:27:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9608.2). Total num frames: 32747520. Throughput: 0: 9895.9. Samples: 32725048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:52,720][146380] Avg episode reward: [(0, '4450.073')] [2023-03-12 05:27:54,828][146667] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-12 05:27:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9622.1). Total num frames: 32796672. Throughput: 0: 9834.2. Samples: 32783576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:27:57,720][146380] Avg episode reward: [(0, '4465.244')] [2023-03-12 05:27:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064056_32796672.pth... [2023-03-12 05:27:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063488_32505856.pth [2023-03-12 05:27:58,832][146667] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-12 05:28:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9636.0). Total num frames: 32845824. Throughput: 0: 9782.7. Samples: 32843260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:02,720][146380] Avg episode reward: [(0, '4244.225')] [2023-03-12 05:28:03,005][146667] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-12 05:28:07,321][146667] Updated weights for policy 0, policy_version 64240 (0.0006) [2023-03-12 05:28:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 32890880. Throughput: 0: 9761.4. Samples: 32872924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:07,720][146380] Avg episode reward: [(0, '4211.381')] [2023-03-12 05:28:11,707][146667] Updated weights for policy 0, policy_version 64320 (0.0006) [2023-03-12 05:28:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 32940032. Throughput: 0: 9678.1. Samples: 32928232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:12,720][146380] Avg episode reward: [(0, '4434.903')] [2023-03-12 05:28:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064336_32940032.pth... [2023-03-12 05:28:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000063768_32649216.pth [2023-03-12 05:28:16,080][146667] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-12 05:28:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 32985088. Throughput: 0: 9686.5. Samples: 32985096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:17,720][146380] Avg episode reward: [(0, '4530.524')] [2023-03-12 05:28:20,354][146667] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-12 05:28:22,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 33034240. Throughput: 0: 9669.5. Samples: 33013768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:22,720][146380] Avg episode reward: [(0, '4530.502')] [2023-03-12 05:28:24,677][146667] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-12 05:28:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 33083392. Throughput: 0: 9672.1. Samples: 33071168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:27,720][146380] Avg episode reward: [(0, '4530.746')] [2023-03-12 05:28:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064616_33083392.pth... [2023-03-12 05:28:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064056_32796672.pth [2023-03-12 05:28:28,731][146667] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-12 05:28:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 33132544. Throughput: 0: 9707.5. Samples: 33132152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:32,720][146380] Avg episode reward: [(0, '4517.048')] [2023-03-12 05:28:32,762][146667] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-12 05:28:36,934][146667] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-12 05:28:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 33181696. Throughput: 0: 9728.5. Samples: 33162832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:37,720][146380] Avg episode reward: [(0, '4532.670')] [2023-03-12 05:28:40,999][146667] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-12 05:28:42,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9691.6). Total num frames: 33234944. Throughput: 0: 9745.9. Samples: 33222140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:42,720][146380] Avg episode reward: [(0, '4511.698')] [2023-03-12 05:28:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064912_33234944.pth... [2023-03-12 05:28:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064336_32940032.pth [2023-03-12 05:28:45,133][146667] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-12 05:28:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9691.6). Total num frames: 33284096. Throughput: 0: 9714.8. Samples: 33280424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:47,720][146380] Avg episode reward: [(0, '4541.025')] [2023-03-12 05:28:49,430][146667] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-12 05:28:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 33333248. Throughput: 0: 9695.7. Samples: 33309232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:52,720][146380] Avg episode reward: [(0, '4511.778')] [2023-03-12 05:28:53,406][146667] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-12 05:28:57,615][146667] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-12 05:28:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 33382400. Throughput: 0: 9821.0. Samples: 33370176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:28:57,720][146380] Avg episode reward: [(0, '4432.672')] [2023-03-12 05:28:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065200_33382400.pth... [2023-03-12 05:28:57,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064616_33083392.pth [2023-03-12 05:29:01,894][146667] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-12 05:29:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 33427456. Throughput: 0: 9831.7. Samples: 33427520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:29:02,720][146380] Avg episode reward: [(0, '4549.208')] [2023-03-12 05:29:06,268][146667] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-12 05:29:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9691.6). Total num frames: 33476608. Throughput: 0: 9830.2. Samples: 33456128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:29:07,720][146380] Avg episode reward: [(0, '4502.722')] [2023-03-12 05:29:10,657][146667] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-12 05:29:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 33521664. Throughput: 0: 9787.6. Samples: 33511612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:29:12,720][146380] Avg episode reward: [(0, '4472.840')] [2023-03-12 05:29:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065472_33521664.pth... [2023-03-12 05:29:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000064912_33234944.pth [2023-03-12 05:29:14,981][146667] Updated weights for policy 0, policy_version 65520 (0.0005) [2023-03-12 05:29:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9677.7). Total num frames: 33570816. Throughput: 0: 9708.5. Samples: 33569036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:29:17,720][146380] Avg episode reward: [(0, '4485.203')] [2023-03-12 05:29:19,254][146667] Updated weights for policy 0, policy_version 65600 (0.0005) [2023-03-12 05:29:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 33615872. Throughput: 0: 9656.7. Samples: 33597384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:29:22,720][146380] Avg episode reward: [(0, '4527.736')] [2023-03-12 05:29:23,577][146667] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-12 05:29:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 33665024. Throughput: 0: 9594.2. Samples: 33653880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:27,720][146380] Avg episode reward: [(0, '4534.894')] [2023-03-12 05:29:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065752_33665024.pth... [2023-03-12 05:29:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065200_33382400.pth [2023-03-12 05:29:27,959][146667] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-12 05:29:32,336][146667] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-12 05:29:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 33710080. Throughput: 0: 9549.3. Samples: 33710144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:32,720][146380] Avg episode reward: [(0, '4486.202')] [2023-03-12 05:29:36,757][146667] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-12 05:29:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 33759232. Throughput: 0: 9524.9. Samples: 33737852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:37,720][146380] Avg episode reward: [(0, '4492.709')] [2023-03-12 05:29:41,154][146667] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-12 05:29:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 33804288. Throughput: 0: 9415.2. Samples: 33793860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:42,720][146380] Avg episode reward: [(0, '4534.706')] [2023-03-12 05:29:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066024_33804288.pth... [2023-03-12 05:29:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065472_33521664.pth [2023-03-12 05:29:45,454][146667] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-12 05:29:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 33853440. Throughput: 0: 9404.2. Samples: 33850708. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:47,720][146380] Avg episode reward: [(0, '4536.682')] [2023-03-12 05:29:49,816][146667] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-12 05:29:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 33898496. Throughput: 0: 9392.2. Samples: 33878776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:52,720][146380] Avg episode reward: [(0, '4539.344')] [2023-03-12 05:29:54,168][146667] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-12 05:29:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 33947648. Throughput: 0: 9418.1. Samples: 33935424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:29:57,720][146380] Avg episode reward: [(0, '4549.893')] [2023-03-12 05:29:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066304_33947648.pth... [2023-03-12 05:29:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000065752_33665024.pth [2023-03-12 05:29:58,583][146667] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-12 05:30:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 33992704. Throughput: 0: 9390.0. Samples: 33991588. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:30:02,720][146380] Avg episode reward: [(0, '4545.577')] [2023-03-12 05:30:02,913][146667] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-12 05:30:07,219][146667] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-12 05:30:07,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 34041856. Throughput: 0: 9384.1. Samples: 34019672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:07,720][146380] Avg episode reward: [(0, '4543.064')] [2023-03-12 05:30:11,553][146667] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-12 05:30:12,720][146380] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 34086912. Throughput: 0: 9396.2. Samples: 34076712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:12,720][146380] Avg episode reward: [(0, '4547.022')] [2023-03-12 05:30:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066576_34086912.pth... [2023-03-12 05:30:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066024_33804288.pth [2023-03-12 05:30:15,838][146667] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-12 05:30:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 34136064. Throughput: 0: 9432.3. Samples: 34134596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:17,720][146380] Avg episode reward: [(0, '4564.875')] [2023-03-12 05:30:19,959][146667] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-12 05:30:22,719][146380] Fps is (10 sec: 9830.6, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 34185216. Throughput: 0: 9484.9. Samples: 34164672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:22,720][146380] Avg episode reward: [(0, '4532.910')] [2023-03-12 05:30:23,976][146667] Updated weights for policy 0, policy_version 66800 (0.0004) [2023-03-12 05:30:27,720][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 34238464. Throughput: 0: 9608.4. Samples: 34226240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:27,723][146380] Avg episode reward: [(0, '4533.275')] [2023-03-12 05:30:27,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066872_34238464.pth... [2023-03-12 05:30:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066304_33947648.pth [2023-03-12 05:30:27,928][146667] Updated weights for policy 0, policy_version 66880 (0.0004) [2023-03-12 05:30:32,039][146667] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-12 05:30:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 34287616. Throughput: 0: 9691.9. Samples: 34286844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:32,720][146380] Avg episode reward: [(0, '4542.682')] [2023-03-12 05:30:35,977][146667] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-12 05:30:37,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 34340864. Throughput: 0: 9753.2. Samples: 34317672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:37,720][146380] Avg episode reward: [(0, '4552.517')] [2023-03-12 05:30:39,946][146667] Updated weights for policy 0, policy_version 67120 (0.0004) [2023-03-12 05:30:42,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 34390016. Throughput: 0: 9870.1. Samples: 34379580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:30:42,720][146380] Avg episode reward: [(0, '4541.248')] [2023-03-12 05:30:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067168_34390016.pth... [2023-03-12 05:30:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066576_34086912.pth [2023-03-12 05:30:44,011][146667] Updated weights for policy 0, policy_version 67200 (0.0004) [2023-03-12 05:30:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 34439168. Throughput: 0: 9946.2. Samples: 34439168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:30:47,720][146380] Avg episode reward: [(0, '4550.958')] [2023-03-12 05:30:48,241][146667] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-12 05:30:52,583][146667] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-12 05:30:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9733.2). Total num frames: 34488320. Throughput: 0: 9949.2. Samples: 34467384. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:30:52,720][146380] Avg episode reward: [(0, '4486.268')] [2023-03-12 05:30:56,923][146667] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-12 05:30:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 34533376. Throughput: 0: 9938.1. Samples: 34523924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:30:57,720][146380] Avg episode reward: [(0, '4511.690')] [2023-03-12 05:30:57,761][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067456_34537472.pth... [2023-03-12 05:30:57,762][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000066872_34238464.pth [2023-03-12 05:31:01,280][146667] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-12 05:31:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9733.2). Total num frames: 34582528. Throughput: 0: 9900.5. Samples: 34580120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:31:02,720][146380] Avg episode reward: [(0, '4539.943')] [2023-03-12 05:31:05,579][146667] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-12 05:31:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 34627584. Throughput: 0: 9873.1. Samples: 34608960. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:31:07,720][146380] Avg episode reward: [(0, '4544.759')] [2023-03-12 05:31:09,953][146667] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-12 05:31:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9733.2). Total num frames: 34676736. Throughput: 0: 9770.9. Samples: 34665932. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:31:12,720][146380] Avg episode reward: [(0, '4484.387')] [2023-03-12 05:31:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067728_34676736.pth... [2023-03-12 05:31:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067168_34390016.pth [2023-03-12 05:31:14,136][146667] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-12 05:31:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9747.1). Total num frames: 34725888. Throughput: 0: 9703.6. Samples: 34723508. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:31:17,720][146380] Avg episode reward: [(0, '4511.015')] [2023-03-12 05:31:18,432][146667] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-12 05:31:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 34770944. Throughput: 0: 9652.3. Samples: 34752024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 05:31:22,720][146380] Avg episode reward: [(0, '4544.833')] [2023-03-12 05:31:22,728][146667] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-12 05:31:27,031][146667] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-12 05:31:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9733.2). Total num frames: 34820096. Throughput: 0: 9550.4. Samples: 34809348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:27,720][146380] Avg episode reward: [(0, '4500.600')] [2023-03-12 05:31:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068008_34820096.pth... [2023-03-12 05:31:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067456_34537472.pth [2023-03-12 05:31:31,470][146667] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-12 05:31:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 34865152. Throughput: 0: 9467.8. Samples: 34865216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:32,720][146380] Avg episode reward: [(0, '4502.660')] [2023-03-12 05:31:35,824][146667] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-12 05:31:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 34914304. Throughput: 0: 9475.4. Samples: 34893776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:37,720][146380] Avg episode reward: [(0, '4517.496')] [2023-03-12 05:31:40,186][146667] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-12 05:31:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 34959360. Throughput: 0: 9464.3. Samples: 34949816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:42,720][146380] Avg episode reward: [(0, '4548.800')] [2023-03-12 05:31:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068280_34959360.pth... [2023-03-12 05:31:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000067728_34676736.pth [2023-03-12 05:31:44,576][146667] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-12 05:31:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9691.6). Total num frames: 35008512. Throughput: 0: 9466.0. Samples: 35006088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:47,720][146380] Avg episode reward: [(0, '4478.425')] [2023-03-12 05:31:48,883][146667] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-12 05:31:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 35053568. Throughput: 0: 9455.0. Samples: 35034436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:52,720][146380] Avg episode reward: [(0, '4507.821')] [2023-03-12 05:31:53,276][146667] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-12 05:31:57,661][146667] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-12 05:31:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9663.8). Total num frames: 35102720. Throughput: 0: 9433.6. Samples: 35090444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:31:57,723][146380] Avg episode reward: [(0, '4410.331')] [2023-03-12 05:31:57,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068560_35102720.pth... [2023-03-12 05:31:57,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068008_34820096.pth [2023-03-12 05:32:02,120][146667] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-12 05:32:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 35147776. Throughput: 0: 9388.4. Samples: 35145988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:02,730][146380] Avg episode reward: [(0, '4544.120')] [2023-03-12 05:32:06,460][146667] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-12 05:32:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 35192832. Throughput: 0: 9370.7. Samples: 35173704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:07,720][146380] Avg episode reward: [(0, '4516.299')] [2023-03-12 05:32:10,862][146667] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-12 05:32:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 35241984. Throughput: 0: 9344.8. Samples: 35229864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:12,730][146380] Avg episode reward: [(0, '4415.032')] [2023-03-12 05:32:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068832_35241984.pth... [2023-03-12 05:32:12,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068280_34959360.pth [2023-03-12 05:32:15,114][146667] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-12 05:32:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 35291136. Throughput: 0: 9395.4. Samples: 35288008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:17,720][146380] Avg episode reward: [(0, '4509.869')] [2023-03-12 05:32:19,377][146667] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-12 05:32:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 35336192. Throughput: 0: 9392.5. Samples: 35316440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:22,720][146380] Avg episode reward: [(0, '4493.652')] [2023-03-12 05:32:23,675][146667] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-12 05:32:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 35385344. Throughput: 0: 9410.1. Samples: 35373272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:27,720][146380] Avg episode reward: [(0, '4498.856')] [2023-03-12 05:32:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069112_35385344.pth... [2023-03-12 05:32:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068560_35102720.pth [2023-03-12 05:32:28,055][146667] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-12 05:32:32,404][146667] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-12 05:32:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 35430400. Throughput: 0: 9427.6. Samples: 35430332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:32,720][146380] Avg episode reward: [(0, '4490.293')] [2023-03-12 05:32:36,735][146667] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-12 05:32:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 35479552. Throughput: 0: 9429.9. Samples: 35458780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:37,720][146380] Avg episode reward: [(0, '4463.170')] [2023-03-12 05:32:41,081][146667] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-12 05:32:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 35524608. Throughput: 0: 9437.2. Samples: 35515120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:42,720][146380] Avg episode reward: [(0, '4504.852')] [2023-03-12 05:32:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069384_35524608.pth... [2023-03-12 05:32:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000068832_35241984.pth [2023-03-12 05:32:45,448][146667] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-12 05:32:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 35573760. Throughput: 0: 9450.6. Samples: 35571264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:32:47,720][146380] Avg episode reward: [(0, '4470.393')] [2023-03-12 05:32:49,810][146667] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-12 05:32:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 35618816. Throughput: 0: 9454.2. Samples: 35599144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:32:52,720][146380] Avg episode reward: [(0, '4356.377')] [2023-03-12 05:32:54,100][146667] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-12 05:32:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 35667968. Throughput: 0: 9514.3. Samples: 35658008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:32:57,720][146380] Avg episode reward: [(0, '4363.110')] [2023-03-12 05:32:57,750][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069672_35672064.pth... [2023-03-12 05:32:57,751][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069112_35385344.pth [2023-03-12 05:32:58,165][146667] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-12 05:33:02,179][146667] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-12 05:33:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 35721216. Throughput: 0: 9569.9. Samples: 35718656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:02,731][146380] Avg episode reward: [(0, '4502.640')] [2023-03-12 05:33:06,182][146667] Updated weights for policy 0, policy_version 69840 (0.0004) [2023-03-12 05:33:07,720][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 35770368. Throughput: 0: 9629.6. Samples: 35749772. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:07,720][146380] Avg episode reward: [(0, '4548.585')] [2023-03-12 05:33:10,400][146667] Updated weights for policy 0, policy_version 69920 (0.0004) [2023-03-12 05:33:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 35819520. Throughput: 0: 9657.1. Samples: 35807844. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:12,720][146380] Avg episode reward: [(0, '4559.352')] [2023-03-12 05:33:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069960_35819520.pth... [2023-03-12 05:33:12,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069384_35524608.pth [2023-03-12 05:33:14,678][146667] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-12 05:33:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 35868672. Throughput: 0: 9663.3. Samples: 35865180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:17,720][146380] Avg episode reward: [(0, '4557.059')] [2023-03-12 05:33:18,971][146667] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-12 05:33:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 35913728. Throughput: 0: 9661.3. Samples: 35893540. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:22,720][146380] Avg episode reward: [(0, '4451.023')] [2023-03-12 05:33:23,126][146667] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-12 05:33:27,468][146667] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-12 05:33:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 35962880. Throughput: 0: 9702.5. Samples: 35951732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:27,720][146380] Avg episode reward: [(0, '4445.449')] [2023-03-12 05:33:27,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070240_35962880.pth... [2023-03-12 05:33:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069672_35672064.pth [2023-03-12 05:33:31,810][146667] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-12 05:33:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 36012032. Throughput: 0: 9722.5. Samples: 36008776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:33:32,720][146380] Avg episode reward: [(0, '4547.575')] [2023-03-12 05:33:36,087][146667] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-12 05:33:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 36057088. Throughput: 0: 9744.1. Samples: 36037628. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:33:37,720][146380] Avg episode reward: [(0, '4535.812')] [2023-03-12 05:33:40,392][146667] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-12 05:33:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 36106240. Throughput: 0: 9717.2. Samples: 36095280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:33:42,720][146380] Avg episode reward: [(0, '4535.449')] [2023-03-12 05:33:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070520_36106240.pth... [2023-03-12 05:33:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000069960_35819520.pth [2023-03-12 05:33:44,589][146667] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-12 05:33:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 36155392. Throughput: 0: 9664.7. Samples: 36153568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:33:47,720][146380] Avg episode reward: [(0, '4541.991')] [2023-03-12 05:33:48,822][146667] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-12 05:33:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 36204544. Throughput: 0: 9631.7. Samples: 36183196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:33:52,720][146380] Avg episode reward: [(0, '4547.712')] [2023-03-12 05:33:52,892][146667] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-12 05:33:57,075][146667] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-12 05:33:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 36253696. Throughput: 0: 9667.9. Samples: 36242900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:33:57,720][146380] Avg episode reward: [(0, '4537.321')] [2023-03-12 05:33:57,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070808_36253696.pth... [2023-03-12 05:33:57,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070240_35962880.pth [2023-03-12 05:34:01,369][146667] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-12 05:34:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 36302848. Throughput: 0: 9652.8. Samples: 36299556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:34:02,720][146380] Avg episode reward: [(0, '4545.747')] [2023-03-12 05:34:05,620][146667] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-12 05:34:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 36352000. Throughput: 0: 9663.8. Samples: 36328412. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:34:07,720][146380] Avg episode reward: [(0, '4534.073')] [2023-03-12 05:34:09,818][146667] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-12 05:34:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 36401152. Throughput: 0: 9690.1. Samples: 36387788. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:34:12,720][146380] Avg episode reward: [(0, '4463.019')] [2023-03-12 05:34:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071096_36401152.pth... [2023-03-12 05:34:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070520_36106240.pth [2023-03-12 05:34:13,915][146667] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-12 05:34:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 36446208. Throughput: 0: 9720.7. Samples: 36446208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:17,720][146380] Avg episode reward: [(0, '4380.452')] [2023-03-12 05:34:18,215][146667] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-12 05:34:22,544][146667] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-12 05:34:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 36495360. Throughput: 0: 9716.7. Samples: 36474880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:22,720][146380] Avg episode reward: [(0, '4520.684')] [2023-03-12 05:34:26,883][146667] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-12 05:34:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 36544512. Throughput: 0: 9696.9. Samples: 36531640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:27,720][146380] Avg episode reward: [(0, '4515.434')] [2023-03-12 05:34:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071376_36544512.pth... [2023-03-12 05:34:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000070808_36253696.pth [2023-03-12 05:34:31,127][146667] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-12 05:34:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 36589568. Throughput: 0: 9690.3. Samples: 36589632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:32,720][146380] Avg episode reward: [(0, '4546.815')] [2023-03-12 05:34:35,165][146667] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-12 05:34:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9622.1). Total num frames: 36642816. Throughput: 0: 9699.2. Samples: 36619660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:37,720][146380] Avg episode reward: [(0, '4557.055')] [2023-03-12 05:34:39,293][146667] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-12 05:34:42,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9622.1). Total num frames: 36691968. Throughput: 0: 9691.6. Samples: 36679024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:42,720][146380] Avg episode reward: [(0, '4560.588')] [2023-03-12 05:34:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071664_36691968.pth... [2023-03-12 05:34:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071096_36401152.pth [2023-03-12 05:34:43,434][146667] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-12 05:34:47,412][146667] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-12 05:34:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 36741120. Throughput: 0: 9794.8. Samples: 36740320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:47,720][146380] Avg episode reward: [(0, '4522.548')] [2023-03-12 05:34:51,367][146667] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-12 05:34:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 36794368. Throughput: 0: 9838.5. Samples: 36771144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:52,720][146380] Avg episode reward: [(0, '4562.829')] [2023-03-12 05:34:55,375][146667] Updated weights for policy 0, policy_version 71920 (0.0004) [2023-03-12 05:34:57,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 36843520. Throughput: 0: 9874.7. Samples: 36832148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:34:57,720][146380] Avg episode reward: [(0, '4456.689')] [2023-03-12 05:34:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071960_36843520.pth... [2023-03-12 05:34:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071376_36544512.pth [2023-03-12 05:34:59,432][146667] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-12 05:35:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9677.7). Total num frames: 36896768. Throughput: 0: 9945.1. Samples: 36893736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:02,720][146380] Avg episode reward: [(0, '4506.063')] [2023-03-12 05:35:03,375][146667] Updated weights for policy 0, policy_version 72080 (0.0004) [2023-03-12 05:35:07,445][146667] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-12 05:35:07,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 36945920. Throughput: 0: 10001.8. Samples: 36924960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:07,720][146380] Avg episode reward: [(0, '4478.153')] [2023-03-12 05:35:11,753][146667] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-12 05:35:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 36995072. Throughput: 0: 10027.1. Samples: 36982860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:12,720][146380] Avg episode reward: [(0, '4554.585')] [2023-03-12 05:35:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072256_36995072.pth... [2023-03-12 05:35:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071664_36691968.pth [2023-03-12 05:35:16,113][146667] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-12 05:35:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9677.7). Total num frames: 37040128. Throughput: 0: 10008.0. Samples: 37039992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:17,720][146380] Avg episode reward: [(0, '4516.773')] [2023-03-12 05:35:20,386][146667] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-12 05:35:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9663.8). Total num frames: 37089280. Throughput: 0: 9980.9. Samples: 37068800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:22,720][146380] Avg episode reward: [(0, '4547.260')] [2023-03-12 05:35:24,644][146667] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-12 05:35:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9663.8). Total num frames: 37138432. Throughput: 0: 9936.2. Samples: 37126152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:27,720][146380] Avg episode reward: [(0, '4547.803')] [2023-03-12 05:35:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072536_37138432.pth... [2023-03-12 05:35:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000071960_36843520.pth [2023-03-12 05:35:28,800][146667] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-12 05:35:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 37187584. Throughput: 0: 9883.8. Samples: 37185092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:32,720][146380] Avg episode reward: [(0, '4557.473')] [2023-03-12 05:35:33,014][146667] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-12 05:35:37,250][146667] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-12 05:35:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9649.9). Total num frames: 37236736. Throughput: 0: 9852.5. Samples: 37214508. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:37,720][146380] Avg episode reward: [(0, '4490.275')] [2023-03-12 05:35:41,612][146667] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-12 05:35:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 37281792. Throughput: 0: 9740.4. Samples: 37270468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:35:42,720][146380] Avg episode reward: [(0, '4561.868')] [2023-03-12 05:35:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072816_37281792.pth... [2023-03-12 05:35:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072256_36995072.pth [2023-03-12 05:35:45,599][146667] Updated weights for policy 0, policy_version 72880 (0.0004) [2023-03-12 05:35:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9649.9). Total num frames: 37335040. Throughput: 0: 9742.1. Samples: 37332132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:35:47,720][146380] Avg episode reward: [(0, '4571.855')] [2023-03-12 05:35:49,619][146667] Updated weights for policy 0, policy_version 72960 (0.0004) [2023-03-12 05:35:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 37384192. Throughput: 0: 9738.2. Samples: 37363180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:35:52,720][146380] Avg episode reward: [(0, '4501.170')] [2023-03-12 05:35:53,747][146667] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-12 05:35:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 37433344. Throughput: 0: 9738.0. Samples: 37421068. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:35:57,720][146380] Avg episode reward: [(0, '4359.336')] [2023-03-12 05:35:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073112_37433344.pth... [2023-03-12 05:35:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072536_37138432.pth [2023-03-12 05:35:58,087][146667] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-12 05:36:02,361][146667] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-12 05:36:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 37478400. Throughput: 0: 9742.7. Samples: 37478412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:02,720][146380] Avg episode reward: [(0, '4494.518')] [2023-03-12 05:36:06,627][146667] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-12 05:36:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 37527552. Throughput: 0: 9739.6. Samples: 37507084. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:07,720][146380] Avg episode reward: [(0, '4548.033')] [2023-03-12 05:36:11,028][146667] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-12 05:36:12,720][146380] Fps is (10 sec: 9420.6, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 37572608. Throughput: 0: 9725.6. Samples: 37563804. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:12,720][146380] Avg episode reward: [(0, '4463.576')] [2023-03-12 05:36:12,761][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073392_37576704.pth... [2023-03-12 05:36:12,763][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000072816_37281792.pth [2023-03-12 05:36:15,308][146667] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-12 05:36:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 37621760. Throughput: 0: 9687.4. Samples: 37621024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:17,720][146380] Avg episode reward: [(0, '4533.799')] [2023-03-12 05:36:19,576][146667] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-12 05:36:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 37670912. Throughput: 0: 9668.9. Samples: 37649608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:22,720][146380] Avg episode reward: [(0, '4445.252')] [2023-03-12 05:36:23,788][146667] Updated weights for policy 0, policy_version 73600 (0.0004) [2023-03-12 05:36:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 37720064. Throughput: 0: 9718.2. Samples: 37707788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:36:27,720][146380] Avg episode reward: [(0, '4503.228')] [2023-03-12 05:36:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073672_37720064.pth... [2023-03-12 05:36:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073112_37433344.pth [2023-03-12 05:36:28,113][146667] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-12 05:36:32,399][146667] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-12 05:36:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 37765120. Throughput: 0: 9620.7. Samples: 37765064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:32,720][146380] Avg episode reward: [(0, '4475.734')] [2023-03-12 05:36:36,757][146667] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-12 05:36:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 37814272. Throughput: 0: 9550.7. Samples: 37792960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:37,720][146380] Avg episode reward: [(0, '4525.218')] [2023-03-12 05:36:41,033][146667] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-12 05:36:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 37859328. Throughput: 0: 9535.6. Samples: 37850172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:42,720][146380] Avg episode reward: [(0, '4541.540')] [2023-03-12 05:36:42,769][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073952_37863424.pth... [2023-03-12 05:36:42,770][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073392_37576704.pth [2023-03-12 05:36:45,247][146667] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-12 05:36:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 37908480. Throughput: 0: 9558.5. Samples: 37908544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:47,720][146380] Avg episode reward: [(0, '4542.115')] [2023-03-12 05:36:49,398][146667] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-12 05:36:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 37961728. Throughput: 0: 9572.4. Samples: 37937840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:52,720][146380] Avg episode reward: [(0, '4480.459')] [2023-03-12 05:36:53,521][146667] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-12 05:36:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 38006784. Throughput: 0: 9635.8. Samples: 37997412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:36:57,720][146380] Avg episode reward: [(0, '4549.633')] [2023-03-12 05:36:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074232_38006784.pth... [2023-03-12 05:36:57,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073672_37720064.pth [2023-03-12 05:36:57,791][146667] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-12 05:37:02,087][146667] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-12 05:37:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 38055936. Throughput: 0: 9633.9. Samples: 38054548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:02,720][146380] Avg episode reward: [(0, '4393.258')] [2023-03-12 05:37:06,385][146667] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-12 05:37:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 38105088. Throughput: 0: 9630.9. Samples: 38082996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:07,720][146380] Avg episode reward: [(0, '4558.132')] [2023-03-12 05:37:10,764][146667] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-12 05:37:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9691.5). Total num frames: 38150144. Throughput: 0: 9584.2. Samples: 38139076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:12,720][146380] Avg episode reward: [(0, '4554.158')] [2023-03-12 05:37:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074512_38150144.pth... [2023-03-12 05:37:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000073952_37863424.pth [2023-03-12 05:37:15,031][146667] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-12 05:37:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 38199296. Throughput: 0: 9574.9. Samples: 38195932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:17,720][146380] Avg episode reward: [(0, '4523.455')] [2023-03-12 05:37:19,407][146667] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-12 05:37:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 38244352. Throughput: 0: 9577.4. Samples: 38223944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:22,720][146380] Avg episode reward: [(0, '4538.863')] [2023-03-12 05:37:23,746][146667] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-12 05:37:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 38293504. Throughput: 0: 9580.2. Samples: 38281280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:27,720][146380] Avg episode reward: [(0, '4534.725')] [2023-03-12 05:37:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074792_38293504.pth... [2023-03-12 05:37:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074232_38006784.pth [2023-03-12 05:37:28,055][146667] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-12 05:37:32,328][146667] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-12 05:37:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 38342656. Throughput: 0: 9557.3. Samples: 38338624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:32,720][146380] Avg episode reward: [(0, '4529.428')] [2023-03-12 05:37:36,415][146667] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-12 05:37:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 38391808. Throughput: 0: 9581.9. Samples: 38369024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:37,720][146380] Avg episode reward: [(0, '4555.261')] [2023-03-12 05:37:40,349][146667] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-12 05:37:42,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 38440960. Throughput: 0: 9633.4. Samples: 38430916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:42,720][146380] Avg episode reward: [(0, '4549.589')] [2023-03-12 05:37:42,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075088_38445056.pth... [2023-03-12 05:37:42,741][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074512_38150144.pth [2023-03-12 05:37:44,306][146667] Updated weights for policy 0, policy_version 75120 (0.0004) [2023-03-12 05:37:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9747.1). Total num frames: 38494208. Throughput: 0: 9732.4. Samples: 38492504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:47,720][146380] Avg episode reward: [(0, '4495.676')] [2023-03-12 05:37:48,296][146667] Updated weights for policy 0, policy_version 75200 (0.0004) [2023-03-12 05:37:52,228][146667] Updated weights for policy 0, policy_version 75280 (0.0003) [2023-03-12 05:37:52,719][146380] Fps is (10 sec: 10649.7, 60 sec: 9762.1, 300 sec: 9761.0). Total num frames: 38547456. Throughput: 0: 9787.7. Samples: 38523444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:52,720][146380] Avg episode reward: [(0, '4466.021')] [2023-03-12 05:37:56,493][146667] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-12 05:37:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 38592512. Throughput: 0: 9867.0. Samples: 38583092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:37:57,720][146380] Avg episode reward: [(0, '4516.940')] [2023-03-12 05:37:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075376_38592512.pth... [2023-03-12 05:37:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000074792_38293504.pth [2023-03-12 05:38:00,825][146667] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-12 05:38:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 38641664. Throughput: 0: 9870.0. Samples: 38640084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:02,720][146380] Avg episode reward: [(0, '4577.100')] [2023-03-12 05:38:05,014][146667] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-12 05:38:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9733.2). Total num frames: 38690816. Throughput: 0: 9903.3. Samples: 38669592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:07,720][146380] Avg episode reward: [(0, '4389.005')] [2023-03-12 05:38:09,072][146667] Updated weights for policy 0, policy_version 75600 (0.0004) [2023-03-12 05:38:12,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 38744064. Throughput: 0: 9994.4. Samples: 38731028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:12,720][146380] Avg episode reward: [(0, '4538.857')] [2023-03-12 05:38:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075672_38744064.pth... [2023-03-12 05:38:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075088_38445056.pth [2023-03-12 05:38:13,043][146667] Updated weights for policy 0, policy_version 75680 (0.0004) [2023-03-12 05:38:17,091][146667] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-12 05:38:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9761.0). Total num frames: 38793216. Throughput: 0: 10063.4. Samples: 38791476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:17,720][146380] Avg episode reward: [(0, '4522.362')] [2023-03-12 05:38:21,209][146667] Updated weights for policy 0, policy_version 75840 (0.0005) [2023-03-12 05:38:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 38842368. Throughput: 0: 10048.6. Samples: 38821212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:22,720][146380] Avg episode reward: [(0, '4533.239')] [2023-03-12 05:38:25,373][146667] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-12 05:38:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 38891520. Throughput: 0: 9976.4. Samples: 38879852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:27,730][146380] Avg episode reward: [(0, '4563.299')] [2023-03-12 05:38:27,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075960_38891520.pth... [2023-03-12 05:38:27,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075376_38592512.pth [2023-03-12 05:38:29,505][146667] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-12 05:38:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9788.7). Total num frames: 38944768. Throughput: 0: 9970.8. Samples: 38941188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:32,730][146380] Avg episode reward: [(0, '4327.272')] [2023-03-12 05:38:33,533][146667] Updated weights for policy 0, policy_version 76080 (0.0004) [2023-03-12 05:38:37,505][146667] Updated weights for policy 0, policy_version 76160 (0.0004) [2023-03-12 05:38:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9788.7). Total num frames: 38993920. Throughput: 0: 9957.9. Samples: 38971548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:37,720][146380] Avg episode reward: [(0, '4411.945')] [2023-03-12 05:38:41,514][146667] Updated weights for policy 0, policy_version 76240 (0.0004) [2023-03-12 05:38:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9788.7). Total num frames: 39043072. Throughput: 0: 9991.7. Samples: 39032720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:42,730][146380] Avg episode reward: [(0, '4462.707')] [2023-03-12 05:38:42,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076264_39047168.pth... [2023-03-12 05:38:42,735][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075672_38744064.pth [2023-03-12 05:38:45,500][146667] Updated weights for policy 0, policy_version 76320 (0.0004) [2023-03-12 05:38:47,719][146380] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9802.6). Total num frames: 39096320. Throughput: 0: 10117.7. Samples: 39095380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:47,730][146380] Avg episode reward: [(0, '4562.903')] [2023-03-12 05:38:49,449][146667] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-12 05:38:52,719][146380] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 39149568. Throughput: 0: 10135.9. Samples: 39125708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:52,720][146380] Avg episode reward: [(0, '4581.312')] [2023-03-12 05:38:53,351][146667] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-12 05:38:57,290][146667] Updated weights for policy 0, policy_version 76560 (0.0004) [2023-03-12 05:38:57,719][146380] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9830.4). Total num frames: 39202816. Throughput: 0: 10160.1. Samples: 39188232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:38:57,720][146380] Avg episode reward: [(0, '4562.051')] [2023-03-12 05:38:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076568_39202816.pth... [2023-03-12 05:38:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000075960_38891520.pth [2023-03-12 05:39:01,228][146667] Updated weights for policy 0, policy_version 76640 (0.0004) [2023-03-12 05:39:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9830.4). Total num frames: 39251968. Throughput: 0: 10219.4. Samples: 39251348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:02,720][146380] Avg episode reward: [(0, '4542.637')] [2023-03-12 05:39:05,210][146667] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-12 05:39:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9844.3). Total num frames: 39305216. Throughput: 0: 10235.4. Samples: 39281804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:07,720][146380] Avg episode reward: [(0, '4554.745')] [2023-03-12 05:39:09,263][146667] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-12 05:39:12,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9858.2). Total num frames: 39354368. Throughput: 0: 10279.0. Samples: 39342408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:12,720][146380] Avg episode reward: [(0, '4563.687')] [2023-03-12 05:39:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076864_39354368.pth... [2023-03-12 05:39:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076264_39047168.pth [2023-03-12 05:39:13,276][146667] Updated weights for policy 0, policy_version 76880 (0.0004) [2023-03-12 05:39:17,324][146667] Updated weights for policy 0, policy_version 76960 (0.0004) [2023-03-12 05:39:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9872.1). Total num frames: 39407616. Throughput: 0: 10275.5. Samples: 39403584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:17,720][146380] Avg episode reward: [(0, '4430.370')] [2023-03-12 05:39:21,335][146667] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-12 05:39:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9872.1). Total num frames: 39456768. Throughput: 0: 10292.3. Samples: 39434700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:22,720][146380] Avg episode reward: [(0, '4538.015')] [2023-03-12 05:39:25,302][146667] Updated weights for policy 0, policy_version 77120 (0.0004) [2023-03-12 05:39:27,719][146380] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 9899.8). Total num frames: 39510016. Throughput: 0: 10284.9. Samples: 39495540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:27,720][146380] Avg episode reward: [(0, '4555.038')] [2023-03-12 05:39:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077168_39510016.pth... [2023-03-12 05:39:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076568_39202816.pth [2023-03-12 05:39:29,310][146667] Updated weights for policy 0, policy_version 77200 (0.0004) [2023-03-12 05:39:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9885.9). Total num frames: 39559168. Throughput: 0: 10248.1. Samples: 39556544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:32,730][146380] Avg episode reward: [(0, '4569.007')] [2023-03-12 05:39:33,393][146667] Updated weights for policy 0, policy_version 77280 (0.0004) [2023-03-12 05:39:37,553][146667] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-12 05:39:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 10240.0, 300 sec: 9885.9). Total num frames: 39608320. Throughput: 0: 10255.6. Samples: 39587212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:37,720][146380] Avg episode reward: [(0, '4523.521')] [2023-03-12 05:39:41,912][146667] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-12 05:39:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 10171.7, 300 sec: 9872.1). Total num frames: 39653376. Throughput: 0: 10133.5. Samples: 39644240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:42,730][146380] Avg episode reward: [(0, '4567.731')] [2023-03-12 05:39:42,750][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077456_39657472.pth... [2023-03-12 05:39:42,752][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000076864_39354368.pth [2023-03-12 05:39:46,120][146667] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-12 05:39:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9872.1). Total num frames: 39706624. Throughput: 0: 10027.8. Samples: 39702600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:47,730][146380] Avg episode reward: [(0, '4513.558')] [2023-03-12 05:39:50,312][146667] Updated weights for policy 0, policy_version 77600 (0.0004) [2023-03-12 05:39:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 39751680. Throughput: 0: 9988.2. Samples: 39731272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:52,720][146380] Avg episode reward: [(0, '4462.988')] [2023-03-12 05:39:54,675][146667] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-12 05:39:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 39800832. Throughput: 0: 9905.5. Samples: 39788156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:39:57,720][146380] Avg episode reward: [(0, '4491.948')] [2023-03-12 05:39:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077736_39800832.pth... [2023-03-12 05:39:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077168_39510016.pth [2023-03-12 05:39:58,974][146667] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-12 05:40:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 39845888. Throughput: 0: 9819.1. Samples: 39845444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:02,720][146380] Avg episode reward: [(0, '4565.565')] [2023-03-12 05:40:03,274][146667] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-12 05:40:07,705][146667] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-12 05:40:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 39895040. Throughput: 0: 9739.4. Samples: 39872972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:07,720][146380] Avg episode reward: [(0, '4560.077')] [2023-03-12 05:40:12,039][146667] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-12 05:40:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 39940096. Throughput: 0: 9634.9. Samples: 39929112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:12,720][146380] Avg episode reward: [(0, '4440.256')] [2023-03-12 05:40:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078008_39940096.pth... [2023-03-12 05:40:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077456_39657472.pth [2023-03-12 05:40:16,219][146667] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-12 05:40:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 39989248. Throughput: 0: 9582.1. Samples: 39987740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:17,720][146380] Avg episode reward: [(0, '4459.628')] [2023-03-12 05:40:20,535][146667] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-12 05:40:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40038400. Throughput: 0: 9531.9. Samples: 40016148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:22,720][146380] Avg episode reward: [(0, '4516.146')] [2023-03-12 05:40:24,617][146667] Updated weights for policy 0, policy_version 78240 (0.0003) [2023-03-12 05:40:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 40087552. Throughput: 0: 9582.7. Samples: 40075464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:27,720][146380] Avg episode reward: [(0, '4552.962')] [2023-03-12 05:40:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078296_40087552.pth... [2023-03-12 05:40:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000077736_39800832.pth [2023-03-12 05:40:28,850][146667] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-12 05:40:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 40136704. Throughput: 0: 9602.8. Samples: 40134728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:32,720][146380] Avg episode reward: [(0, '4523.279')] [2023-03-12 05:40:32,942][146667] Updated weights for policy 0, policy_version 78400 (0.0004) [2023-03-12 05:40:36,992][146667] Updated weights for policy 0, policy_version 78480 (0.0003) [2023-03-12 05:40:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 40185856. Throughput: 0: 9642.7. Samples: 40165192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:37,720][146380] Avg episode reward: [(0, '4544.390')] [2023-03-12 05:40:41,219][146667] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-12 05:40:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40235008. Throughput: 0: 9679.5. Samples: 40223732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:42,730][146380] Avg episode reward: [(0, '4555.031')] [2023-03-12 05:40:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078584_40235008.pth... [2023-03-12 05:40:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078008_39940096.pth [2023-03-12 05:40:45,448][146667] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-12 05:40:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 40284160. Throughput: 0: 9715.1. Samples: 40282624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:47,720][146380] Avg episode reward: [(0, '4547.393')] [2023-03-12 05:40:49,532][146667] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-12 05:40:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40333312. Throughput: 0: 9774.5. Samples: 40312824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:52,720][146380] Avg episode reward: [(0, '4405.565')] [2023-03-12 05:40:53,812][146667] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-12 05:40:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 40378368. Throughput: 0: 9789.4. Samples: 40369636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:40:57,720][146380] Avg episode reward: [(0, '4518.929')] [2023-03-12 05:40:57,736][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078872_40382464.pth... [2023-03-12 05:40:57,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078296_40087552.pth [2023-03-12 05:40:58,167][146667] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-12 05:41:02,554][146667] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-12 05:41:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40427520. Throughput: 0: 9735.0. Samples: 40425816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:41:02,720][146380] Avg episode reward: [(0, '4456.024')] [2023-03-12 05:41:06,712][146667] Updated weights for policy 0, policy_version 79040 (0.0004) [2023-03-12 05:41:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 40476672. Throughput: 0: 9742.6. Samples: 40454564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:41:07,720][146380] Avg episode reward: [(0, '4497.401')] [2023-03-12 05:41:10,844][146667] Updated weights for policy 0, policy_version 79120 (0.0004) [2023-03-12 05:41:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 40525824. Throughput: 0: 9737.1. Samples: 40513632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:12,720][146380] Avg episode reward: [(0, '4566.046')] [2023-03-12 05:41:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079152_40525824.pth... [2023-03-12 05:41:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078584_40235008.pth [2023-03-12 05:41:15,138][146667] Updated weights for policy 0, policy_version 79200 (0.0004) [2023-03-12 05:41:17,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40570880. Throughput: 0: 9700.3. Samples: 40571240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:17,720][146380] Avg episode reward: [(0, '4362.599')] [2023-03-12 05:41:19,437][146667] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-12 05:41:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 40620032. Throughput: 0: 9654.1. Samples: 40599624. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:22,720][146380] Avg episode reward: [(0, '4529.300')] [2023-03-12 05:41:23,832][146667] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-12 05:41:27,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 40669184. Throughput: 0: 9617.1. Samples: 40656500. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:27,720][146380] Avg episode reward: [(0, '4569.594')] [2023-03-12 05:41:27,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079432_40669184.pth... [2023-03-12 05:41:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000078872_40382464.pth [2023-03-12 05:41:28,103][146667] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-12 05:41:32,199][146667] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-12 05:41:32,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 40718336. Throughput: 0: 9619.6. Samples: 40715504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:32,720][146380] Avg episode reward: [(0, '4571.842')] [2023-03-12 05:41:36,492][146667] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-12 05:41:37,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 40763392. Throughput: 0: 9591.1. Samples: 40744424. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:37,720][146380] Avg episode reward: [(0, '4523.607')] [2023-03-12 05:41:40,884][146667] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-12 05:41:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 40812544. Throughput: 0: 9574.5. Samples: 40800488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:42,720][146380] Avg episode reward: [(0, '4575.309')] [2023-03-12 05:41:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079712_40812544.pth... [2023-03-12 05:41:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079152_40525824.pth [2023-03-12 05:41:45,208][146667] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-12 05:41:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9816.5). Total num frames: 40857600. Throughput: 0: 9596.6. Samples: 40857664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:47,720][146380] Avg episode reward: [(0, '4572.182')] [2023-03-12 05:41:49,379][146667] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-12 05:41:52,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 40906752. Throughput: 0: 9620.1. Samples: 40887468. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:52,720][146380] Avg episode reward: [(0, '4409.062')] [2023-03-12 05:41:53,643][146667] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-12 05:41:57,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 40955904. Throughput: 0: 9573.8. Samples: 40944452. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:41:57,720][146380] Avg episode reward: [(0, '4547.189')] [2023-03-12 05:41:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079992_40955904.pth... [2023-03-12 05:41:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079432_40669184.pth [2023-03-12 05:41:57,909][146667] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-12 05:42:02,119][146667] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-12 05:42:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 41005056. Throughput: 0: 9599.4. Samples: 41003212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:02,720][146380] Avg episode reward: [(0, '4561.506')] [2023-03-12 05:42:06,509][146667] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-12 05:42:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 41050112. Throughput: 0: 9593.2. Samples: 41031320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:07,720][146380] Avg episode reward: [(0, '4528.616')] [2023-03-12 05:42:10,860][146667] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-12 05:42:12,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 41099264. Throughput: 0: 9569.5. Samples: 41087128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:12,720][146380] Avg episode reward: [(0, '4419.401')] [2023-03-12 05:42:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080272_41099264.pth... [2023-03-12 05:42:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079712_40812544.pth [2023-03-12 05:42:15,190][146667] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-12 05:42:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 41148416. Throughput: 0: 9558.1. Samples: 41145620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:17,720][146380] Avg episode reward: [(0, '4368.732')] [2023-03-12 05:42:19,252][146667] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-12 05:42:22,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 41197568. Throughput: 0: 9586.9. Samples: 41175836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:22,720][146380] Avg episode reward: [(0, '4537.544')] [2023-03-12 05:42:23,353][146667] Updated weights for policy 0, policy_version 80480 (0.0004) [2023-03-12 05:42:27,492][146667] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-12 05:42:27,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 41246720. Throughput: 0: 9661.1. Samples: 41235236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:27,720][146380] Avg episode reward: [(0, '4547.215')] [2023-03-12 05:42:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080560_41246720.pth... [2023-03-12 05:42:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000079992_40955904.pth [2023-03-12 05:42:31,770][146667] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-12 05:42:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 41295872. Throughput: 0: 9675.4. Samples: 41293056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:32,720][146380] Avg episode reward: [(0, '4576.207')] [2023-03-12 05:42:36,068][146667] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-12 05:42:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 41340928. Throughput: 0: 9655.4. Samples: 41321960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:37,720][146380] Avg episode reward: [(0, '4542.940')] [2023-03-12 05:42:40,482][146667] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-12 05:42:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9816.5). Total num frames: 41390080. Throughput: 0: 9629.9. Samples: 41377800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:42,720][146380] Avg episode reward: [(0, '4537.201')] [2023-03-12 05:42:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080840_41390080.pth... [2023-03-12 05:42:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080272_41099264.pth [2023-03-12 05:42:44,921][146667] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-12 05:42:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9788.7). Total num frames: 41435136. Throughput: 0: 9578.9. Samples: 41434264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:47,720][146380] Avg episode reward: [(0, '4539.382')] [2023-03-12 05:42:49,113][146667] Updated weights for policy 0, policy_version 80960 (0.0005) [2023-03-12 05:42:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9802.6). Total num frames: 41484288. Throughput: 0: 9611.1. Samples: 41463820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:52,720][146380] Avg episode reward: [(0, '4575.249')] [2023-03-12 05:42:53,200][146667] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-12 05:42:57,555][146667] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-12 05:42:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9802.6). Total num frames: 41533440. Throughput: 0: 9657.1. Samples: 41521700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:42:57,720][146380] Avg episode reward: [(0, '4472.943')] [2023-03-12 05:42:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081120_41533440.pth... [2023-03-12 05:42:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080560_41246720.pth [2023-03-12 05:43:01,676][146667] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-12 05:43:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9802.6). Total num frames: 41582592. Throughput: 0: 9667.6. Samples: 41580660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:02,720][146380] Avg episode reward: [(0, '4479.808')] [2023-03-12 05:43:05,885][146667] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-12 05:43:07,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 41631744. Throughput: 0: 9656.5. Samples: 41610380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:07,720][146380] Avg episode reward: [(0, '4501.313')] [2023-03-12 05:43:10,076][146667] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-12 05:43:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 41680896. Throughput: 0: 9630.7. Samples: 41668616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:12,720][146380] Avg episode reward: [(0, '4475.301')] [2023-03-12 05:43:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081408_41680896.pth... [2023-03-12 05:43:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000080840_41390080.pth [2023-03-12 05:43:14,406][146667] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-12 05:43:17,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 41725952. Throughput: 0: 9598.5. Samples: 41724988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:17,720][146380] Avg episode reward: [(0, '4461.037')] [2023-03-12 05:43:18,766][146667] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-12 05:43:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 41775104. Throughput: 0: 9586.0. Samples: 41753332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:22,720][146380] Avg episode reward: [(0, '4508.092')] [2023-03-12 05:43:23,002][146667] Updated weights for policy 0, policy_version 81600 (0.0003) [2023-03-12 05:43:27,366][146667] Updated weights for policy 0, policy_version 81680 (0.0004) [2023-03-12 05:43:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9747.1). Total num frames: 41820160. Throughput: 0: 9636.2. Samples: 41811428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:27,720][146380] Avg episode reward: [(0, '4372.033')] [2023-03-12 05:43:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081680_41820160.pth... [2023-03-12 05:43:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081120_41533440.pth [2023-03-12 05:43:31,604][146667] Updated weights for policy 0, policy_version 81760 (0.0004) [2023-03-12 05:43:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9747.1). Total num frames: 41869312. Throughput: 0: 9641.8. Samples: 41868144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:32,720][146380] Avg episode reward: [(0, '3889.742')] [2023-03-12 05:43:35,940][146667] Updated weights for policy 0, policy_version 81840 (0.0006) [2023-03-12 05:43:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 41918464. Throughput: 0: 9612.6. Samples: 41896388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:43:37,720][146380] Avg episode reward: [(0, '4277.556')] [2023-03-12 05:43:40,340][146667] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-12 05:43:42,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 41963520. Throughput: 0: 9566.0. Samples: 41952168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:43:42,720][146380] Avg episode reward: [(0, '4549.722')] [2023-03-12 05:43:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081960_41963520.pth... [2023-03-12 05:43:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081408_41680896.pth [2023-03-12 05:43:44,740][146667] Updated weights for policy 0, policy_version 82000 (0.0005) [2023-03-12 05:43:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 42008576. Throughput: 0: 9509.3. Samples: 42008576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:43:47,720][146380] Avg episode reward: [(0, '4438.060')] [2023-03-12 05:43:49,055][146667] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-12 05:43:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 42057728. Throughput: 0: 9491.0. Samples: 42037476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:43:52,720][146380] Avg episode reward: [(0, '4196.114')] [2023-03-12 05:43:53,181][146667] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-12 05:43:57,318][146667] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-12 05:43:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 42106880. Throughput: 0: 9521.5. Samples: 42097084. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:43:57,720][146380] Avg episode reward: [(0, '4464.516')] [2023-03-12 05:43:57,753][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082248_42110976.pth... [2023-03-12 05:43:57,754][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081680_41820160.pth [2023-03-12 05:44:01,549][146667] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-12 05:44:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 42156032. Throughput: 0: 9570.1. Samples: 42155640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:02,730][146380] Avg episode reward: [(0, '4434.764')] [2023-03-12 05:44:05,991][146667] Updated weights for policy 0, policy_version 82400 (0.0006) [2023-03-12 05:44:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9649.9). Total num frames: 42201088. Throughput: 0: 9551.7. Samples: 42183160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:07,720][146380] Avg episode reward: [(0, '4579.901')] [2023-03-12 05:44:10,323][146667] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-12 05:44:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 42250240. Throughput: 0: 9518.8. Samples: 42239776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:12,730][146380] Avg episode reward: [(0, '4583.776')] [2023-03-12 05:44:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082520_42250240.pth... [2023-03-12 05:44:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000081960_41963520.pth [2023-03-12 05:44:14,489][146667] Updated weights for policy 0, policy_version 82560 (0.0003) [2023-03-12 05:44:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9636.0). Total num frames: 42299392. Throughput: 0: 9530.7. Samples: 42297024. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:17,730][146380] Avg episode reward: [(0, '4579.630')] [2023-03-12 05:44:18,950][146667] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-12 05:44:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 42344448. Throughput: 0: 9520.3. Samples: 42324800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:22,720][146380] Avg episode reward: [(0, '4575.143')] [2023-03-12 05:44:23,297][146667] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-12 05:44:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 42389504. Throughput: 0: 9536.6. Samples: 42381312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 05:44:27,723][146380] Avg episode reward: [(0, '4589.567')] [2023-03-12 05:44:27,732][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082800_42393600.pth... [2023-03-12 05:44:27,733][146667] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-12 05:44:27,734][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082248_42110976.pth [2023-03-12 05:44:27,734][146623] Saving new best policy, reward=4589.567! [2023-03-12 05:44:32,149][146667] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-12 05:44:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 42438656. Throughput: 0: 9502.2. Samples: 42436176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:32,730][146380] Avg episode reward: [(0, '4529.581')] [2023-03-12 05:44:36,504][146667] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-12 05:44:37,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 42483712. Throughput: 0: 9493.8. Samples: 42464696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:37,720][146380] Avg episode reward: [(0, '4575.538')] [2023-03-12 05:44:40,671][146667] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-12 05:44:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 42536960. Throughput: 0: 9474.5. Samples: 42523436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:42,723][146380] Avg episode reward: [(0, '4579.925')] [2023-03-12 05:44:42,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083080_42536960.pth... [2023-03-12 05:44:42,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082520_42250240.pth [2023-03-12 05:44:44,806][146667] Updated weights for policy 0, policy_version 83120 (0.0004) [2023-03-12 05:44:47,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 42586112. Throughput: 0: 9488.4. Samples: 42582616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:47,720][146380] Avg episode reward: [(0, '4511.123')] [2023-03-12 05:44:48,880][146667] Updated weights for policy 0, policy_version 83200 (0.0004) [2023-03-12 05:44:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 42631168. Throughput: 0: 9526.6. Samples: 42611856. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:52,720][146380] Avg episode reward: [(0, '4557.469')] [2023-03-12 05:44:53,149][146667] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-12 05:44:57,311][146667] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-12 05:44:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 42680320. Throughput: 0: 9589.7. Samples: 42671312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:44:57,720][146380] Avg episode reward: [(0, '4581.822')] [2023-03-12 05:44:57,736][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083368_42684416.pth... [2023-03-12 05:44:57,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000082800_42393600.pth [2023-03-12 05:45:01,370][146667] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-12 05:45:02,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 42733568. Throughput: 0: 9647.3. Samples: 42731152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:45:02,720][146380] Avg episode reward: [(0, '4598.157')] [2023-03-12 05:45:02,721][146623] Saving new best policy, reward=4598.157! [2023-03-12 05:45:05,430][146667] Updated weights for policy 0, policy_version 83520 (0.0004) [2023-03-12 05:45:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 42782720. Throughput: 0: 9697.3. Samples: 42761176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:45:07,720][146380] Avg episode reward: [(0, '4593.716')] [2023-03-12 05:45:09,534][146667] Updated weights for policy 0, policy_version 83600 (0.0004) [2023-03-12 05:45:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 42831872. Throughput: 0: 9748.8. Samples: 42820008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:45:12,720][146380] Avg episode reward: [(0, '4592.969')] [2023-03-12 05:45:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083656_42831872.pth... [2023-03-12 05:45:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083080_42536960.pth [2023-03-12 05:45:13,775][146667] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-12 05:45:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 42876928. Throughput: 0: 9796.1. Samples: 42877000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 05:45:17,720][146380] Avg episode reward: [(0, '4563.236')] [2023-03-12 05:45:18,157][146667] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-12 05:45:22,608][146667] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-12 05:45:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 42926080. Throughput: 0: 9797.6. Samples: 42905588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:22,720][146380] Avg episode reward: [(0, '4594.496')] [2023-03-12 05:45:27,017][146667] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-12 05:45:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.8, 300 sec: 9608.2). Total num frames: 42971136. Throughput: 0: 9714.5. Samples: 42960588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:27,720][146380] Avg episode reward: [(0, '4490.379')] [2023-03-12 05:45:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083928_42971136.pth... [2023-03-12 05:45:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083368_42684416.pth [2023-03-12 05:45:31,233][146667] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-12 05:45:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 43020288. Throughput: 0: 9682.7. Samples: 43018340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:32,720][146380] Avg episode reward: [(0, '4391.973')] [2023-03-12 05:45:35,646][146667] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-12 05:45:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 43065344. Throughput: 0: 9652.1. Samples: 43046200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:37,720][146380] Avg episode reward: [(0, '4561.234')] [2023-03-12 05:45:40,069][146667] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-12 05:45:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 43110400. Throughput: 0: 9572.9. Samples: 43102092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:42,720][146380] Avg episode reward: [(0, '4491.200')] [2023-03-12 05:45:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084208_43114496.pth... [2023-03-12 05:45:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083656_42831872.pth [2023-03-12 05:45:44,501][146667] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-12 05:45:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 43159552. Throughput: 0: 9468.3. Samples: 43157224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:47,720][146380] Avg episode reward: [(0, '4433.666')] [2023-03-12 05:45:48,908][146667] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-12 05:45:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 43204608. Throughput: 0: 9423.8. Samples: 43185248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:52,720][146380] Avg episode reward: [(0, '4460.436')] [2023-03-12 05:45:53,203][146667] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-12 05:45:57,526][146667] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-12 05:45:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 43253760. Throughput: 0: 9380.6. Samples: 43242136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:45:57,720][146380] Avg episode reward: [(0, '4580.226')] [2023-03-12 05:45:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084480_43253760.pth... [2023-03-12 05:45:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000083928_42971136.pth [2023-03-12 05:46:01,924][146667] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-12 05:46:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 43298816. Throughput: 0: 9374.1. Samples: 43298832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:46:02,720][146380] Avg episode reward: [(0, '4545.761')] [2023-03-12 05:46:06,244][146667] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-12 05:46:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 43347968. Throughput: 0: 9377.0. Samples: 43327552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:46:07,720][146380] Avg episode reward: [(0, '4537.913')] [2023-03-12 05:46:10,641][146667] Updated weights for policy 0, policy_version 84720 (0.0005) [2023-03-12 05:46:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 43393024. Throughput: 0: 9394.6. Samples: 43383344. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:12,720][146380] Avg episode reward: [(0, '4408.808')] [2023-03-12 05:46:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084752_43393024.pth... [2023-03-12 05:46:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084208_43114496.pth [2023-03-12 05:46:15,012][146667] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-12 05:46:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 43442176. Throughput: 0: 9359.3. Samples: 43439508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:17,720][146380] Avg episode reward: [(0, '4480.052')] [2023-03-12 05:46:19,324][146667] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-12 05:46:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 43487232. Throughput: 0: 9368.5. Samples: 43467784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:22,720][146380] Avg episode reward: [(0, '4576.816')] [2023-03-12 05:46:23,741][146667] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-12 05:46:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 43536384. Throughput: 0: 9379.4. Samples: 43524168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:27,720][146380] Avg episode reward: [(0, '4567.869')] [2023-03-12 05:46:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085032_43536384.pth... [2023-03-12 05:46:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084480_43253760.pth [2023-03-12 05:46:28,078][146667] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-12 05:46:32,226][146667] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-12 05:46:32,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 43585536. Throughput: 0: 9447.3. Samples: 43582352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:32,720][146380] Avg episode reward: [(0, '4567.848')] [2023-03-12 05:46:36,270][146667] Updated weights for policy 0, policy_version 85200 (0.0004) [2023-03-12 05:46:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 43634688. Throughput: 0: 9503.1. Samples: 43612888. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:37,720][146380] Avg episode reward: [(0, '4527.075')] [2023-03-12 05:46:40,629][146667] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-12 05:46:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 43679744. Throughput: 0: 9508.0. Samples: 43669996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:42,720][146380] Avg episode reward: [(0, '4526.300')] [2023-03-12 05:46:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085312_43679744.pth... [2023-03-12 05:46:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000084752_43393024.pth [2023-03-12 05:46:44,950][146667] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-12 05:46:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 43728896. Throughput: 0: 9549.2. Samples: 43728548. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:47,720][146380] Avg episode reward: [(0, '4440.406')] [2023-03-12 05:46:49,072][146667] Updated weights for policy 0, policy_version 85440 (0.0004) [2023-03-12 05:46:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 43782144. Throughput: 0: 9562.5. Samples: 43757864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:52,720][146380] Avg episode reward: [(0, '4567.233')] [2023-03-12 05:46:53,101][146667] Updated weights for policy 0, policy_version 85520 (0.0004) [2023-03-12 05:46:57,353][146667] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-12 05:46:57,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 43827200. Throughput: 0: 9669.6. Samples: 43818476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:46:57,720][146380] Avg episode reward: [(0, '4577.132')] [2023-03-12 05:46:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085600_43827200.pth... [2023-03-12 05:46:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085032_43536384.pth [2023-03-12 05:47:01,790][146667] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-12 05:47:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 43876352. Throughput: 0: 9638.8. Samples: 43873252. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 05:47:02,720][146380] Avg episode reward: [(0, '4574.366')] [2023-03-12 05:47:06,196][146667] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-12 05:47:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 43921408. Throughput: 0: 9629.4. Samples: 43901108. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:07,720][146380] Avg episode reward: [(0, '4537.441')] [2023-03-12 05:47:10,440][146667] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-12 05:47:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 43970560. Throughput: 0: 9666.8. Samples: 43959172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:12,720][146380] Avg episode reward: [(0, '4577.094')] [2023-03-12 05:47:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085880_43970560.pth... [2023-03-12 05:47:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085312_43679744.pth [2023-03-12 05:47:14,724][146667] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-12 05:47:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44015616. Throughput: 0: 9628.1. Samples: 44015616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:17,720][146380] Avg episode reward: [(0, '4585.338')] [2023-03-12 05:47:19,083][146667] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-12 05:47:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44064768. Throughput: 0: 9574.4. Samples: 44043736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:22,720][146380] Avg episode reward: [(0, '4520.395')] [2023-03-12 05:47:23,553][146667] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-12 05:47:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 44109824. Throughput: 0: 9537.2. Samples: 44099172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:27,720][146380] Avg episode reward: [(0, '4572.597')] [2023-03-12 05:47:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086152_44109824.pth... [2023-03-12 05:47:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085600_43827200.pth [2023-03-12 05:47:27,920][146667] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-12 05:47:32,067][146667] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-12 05:47:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44158976. Throughput: 0: 9532.6. Samples: 44157516. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:32,720][146380] Avg episode reward: [(0, '4562.365')] [2023-03-12 05:47:36,424][146667] Updated weights for policy 0, policy_version 86320 (0.0004) [2023-03-12 05:47:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 44204032. Throughput: 0: 9517.1. Samples: 44186132. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:37,720][146380] Avg episode reward: [(0, '4535.831')] [2023-03-12 05:47:40,824][146667] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-12 05:47:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44253184. Throughput: 0: 9396.0. Samples: 44241296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:42,720][146380] Avg episode reward: [(0, '4542.243')] [2023-03-12 05:47:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086432_44253184.pth... [2023-03-12 05:47:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000085880_43970560.pth [2023-03-12 05:47:45,068][146667] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-12 05:47:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44302336. Throughput: 0: 9474.4. Samples: 44299600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:47,720][146380] Avg episode reward: [(0, '4472.253')] [2023-03-12 05:47:49,254][146667] Updated weights for policy 0, policy_version 86560 (0.0004) [2023-03-12 05:47:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9552.7). Total num frames: 44351488. Throughput: 0: 9520.8. Samples: 44329544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:47:52,720][146380] Avg episode reward: [(0, '4525.301')] [2023-03-12 05:47:53,489][146667] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-12 05:47:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 44396544. Throughput: 0: 9509.4. Samples: 44387096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:47:57,720][146380] Avg episode reward: [(0, '4446.049')] [2023-03-12 05:47:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086712_44396544.pth... [2023-03-12 05:47:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086152_44109824.pth [2023-03-12 05:47:57,825][146667] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-12 05:48:02,174][146667] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-12 05:48:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 44445696. Throughput: 0: 9501.1. Samples: 44443164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:02,720][146380] Avg episode reward: [(0, '4502.245')] [2023-03-12 05:48:06,548][146667] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-12 05:48:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 44490752. Throughput: 0: 9489.0. Samples: 44470740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:07,720][146380] Avg episode reward: [(0, '4282.249')] [2023-03-12 05:48:10,647][146667] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-12 05:48:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44544000. Throughput: 0: 9585.0. Samples: 44530496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:12,720][146380] Avg episode reward: [(0, '4399.359')] [2023-03-12 05:48:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087000_44544000.pth... [2023-03-12 05:48:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086432_44253184.pth [2023-03-12 05:48:14,683][146667] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-12 05:48:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44593152. Throughput: 0: 9625.7. Samples: 44590672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:17,720][146380] Avg episode reward: [(0, '4446.438')] [2023-03-12 05:48:18,867][146667] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-12 05:48:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44638208. Throughput: 0: 9633.6. Samples: 44619644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:22,720][146380] Avg episode reward: [(0, '4583.600')] [2023-03-12 05:48:23,184][146667] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-12 05:48:27,487][146667] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-12 05:48:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44687360. Throughput: 0: 9652.7. Samples: 44675668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:27,720][146380] Avg episode reward: [(0, '4569.319')] [2023-03-12 05:48:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087280_44687360.pth... [2023-03-12 05:48:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000086712_44396544.pth [2023-03-12 05:48:31,861][146667] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-12 05:48:32,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44736512. Throughput: 0: 9621.3. Samples: 44732560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:32,720][146380] Avg episode reward: [(0, '4579.309')] [2023-03-12 05:48:36,204][146667] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-12 05:48:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44781568. Throughput: 0: 9590.0. Samples: 44761096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:37,720][146380] Avg episode reward: [(0, '4460.004')] [2023-03-12 05:48:40,626][146667] Updated weights for policy 0, policy_version 87520 (0.0005) [2023-03-12 05:48:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44826624. Throughput: 0: 9557.0. Samples: 44817160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:42,720][146380] Avg episode reward: [(0, '4323.317')] [2023-03-12 05:48:42,773][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087560_44830720.pth... [2023-03-12 05:48:42,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087000_44544000.pth [2023-03-12 05:48:44,967][146667] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-12 05:48:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44875776. Throughput: 0: 9544.4. Samples: 44872664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:47,720][146380] Avg episode reward: [(0, '4543.757')] [2023-03-12 05:48:49,295][146667] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-12 05:48:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 44924928. Throughput: 0: 9605.7. Samples: 44902996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:52,720][146380] Avg episode reward: [(0, '4546.831')] [2023-03-12 05:48:53,315][146667] Updated weights for policy 0, policy_version 87760 (0.0004) [2023-03-12 05:48:57,363][146667] Updated weights for policy 0, policy_version 87840 (0.0004) [2023-03-12 05:48:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 44974080. Throughput: 0: 9619.7. Samples: 44963384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:48:57,720][146380] Avg episode reward: [(0, '4556.918')] [2023-03-12 05:48:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087840_44974080.pth... [2023-03-12 05:48:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087280_44687360.pth [2023-03-12 05:49:01,480][146667] Updated weights for policy 0, policy_version 87920 (0.0004) [2023-03-12 05:49:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 45023232. Throughput: 0: 9614.1. Samples: 45023308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:02,720][146380] Avg episode reward: [(0, '4573.885')] [2023-03-12 05:49:05,555][146667] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-12 05:49:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 45076480. Throughput: 0: 9645.4. Samples: 45053688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:07,720][146380] Avg episode reward: [(0, '4566.502')] [2023-03-12 05:49:09,648][146667] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-12 05:49:12,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 45125632. Throughput: 0: 9727.6. Samples: 45113408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:12,720][146380] Avg episode reward: [(0, '4567.388')] [2023-03-12 05:49:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088136_45125632.pth... [2023-03-12 05:49:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087560_44830720.pth [2023-03-12 05:49:13,931][146667] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-12 05:49:17,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 45170688. Throughput: 0: 9725.7. Samples: 45170216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:17,720][146380] Avg episode reward: [(0, '4554.454')] [2023-03-12 05:49:18,303][146667] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-12 05:49:22,558][146667] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-12 05:49:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 45219840. Throughput: 0: 9737.1. Samples: 45199264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:22,720][146380] Avg episode reward: [(0, '4540.513')] [2023-03-12 05:49:26,848][146667] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-12 05:49:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 45268992. Throughput: 0: 9753.7. Samples: 45256076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:27,720][146380] Avg episode reward: [(0, '4540.062')] [2023-03-12 05:49:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088416_45268992.pth... [2023-03-12 05:49:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000087840_44974080.pth [2023-03-12 05:49:31,077][146667] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-12 05:49:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 45314048. Throughput: 0: 9808.5. Samples: 45314048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:32,720][146380] Avg episode reward: [(0, '4569.783')] [2023-03-12 05:49:35,445][146667] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-12 05:49:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 45363200. Throughput: 0: 9757.4. Samples: 45342080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:37,720][146380] Avg episode reward: [(0, '4562.943')] [2023-03-12 05:49:39,796][146667] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-12 05:49:42,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 45408256. Throughput: 0: 9677.0. Samples: 45398848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:42,720][146380] Avg episode reward: [(0, '4568.532')] [2023-03-12 05:49:42,781][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088696_45412352.pth... [2023-03-12 05:49:42,783][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088136_45125632.pth [2023-03-12 05:49:44,068][146667] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-12 05:49:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 45457408. Throughput: 0: 9623.4. Samples: 45456360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:47,720][146380] Avg episode reward: [(0, '4546.652')] [2023-03-12 05:49:48,345][146667] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-12 05:49:52,696][146667] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-12 05:49:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 45506560. Throughput: 0: 9564.9. Samples: 45484108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:52,720][146380] Avg episode reward: [(0, '4558.438')] [2023-03-12 05:49:57,064][146667] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-12 05:49:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 45551616. Throughput: 0: 9486.2. Samples: 45540288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:49:57,720][146380] Avg episode reward: [(0, '4571.934')] [2023-03-12 05:49:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088968_45551616.pth... [2023-03-12 05:49:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088416_45268992.pth [2023-03-12 05:50:01,383][146667] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-12 05:50:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 45600768. Throughput: 0: 9488.5. Samples: 45597200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:02,720][146380] Avg episode reward: [(0, '4568.534')] [2023-03-12 05:50:05,717][146667] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-12 05:50:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 45645824. Throughput: 0: 9478.1. Samples: 45625776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:07,720][146380] Avg episode reward: [(0, '4582.289')] [2023-03-12 05:50:10,119][146667] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-12 05:50:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 45690880. Throughput: 0: 9458.6. Samples: 45681712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:12,720][146380] Avg episode reward: [(0, '4497.798')] [2023-03-12 05:50:12,772][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089248_45694976.pth... [2023-03-12 05:50:12,773][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088696_45412352.pth [2023-03-12 05:50:14,506][146667] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-12 05:50:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 45740032. Throughput: 0: 9408.9. Samples: 45737448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:17,720][146380] Avg episode reward: [(0, '4566.136')] [2023-03-12 05:50:18,927][146667] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-12 05:50:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 45785088. Throughput: 0: 9400.1. Samples: 45765084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:22,720][146380] Avg episode reward: [(0, '4520.866')] [2023-03-12 05:50:23,292][146667] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-12 05:50:27,713][146667] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-12 05:50:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 45834240. Throughput: 0: 9402.3. Samples: 45821952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:27,720][146380] Avg episode reward: [(0, '4522.605')] [2023-03-12 05:50:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089520_45834240.pth... [2023-03-12 05:50:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000088968_45551616.pth [2023-03-12 05:50:32,008][146667] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-12 05:50:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 45879296. Throughput: 0: 9383.2. Samples: 45878604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:32,720][146380] Avg episode reward: [(0, '4513.994')] [2023-03-12 05:50:36,339][146667] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-12 05:50:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 45928448. Throughput: 0: 9402.3. Samples: 45907212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:50:37,720][146380] Avg episode reward: [(0, '4521.198')] [2023-03-12 05:50:40,811][146667] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-12 05:50:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 45973504. Throughput: 0: 9375.5. Samples: 45962188. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:50:42,720][146380] Avg episode reward: [(0, '4455.469')] [2023-03-12 05:50:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089792_45973504.pth... [2023-03-12 05:50:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089248_45694976.pth [2023-03-12 05:50:45,113][146667] Updated weights for policy 0, policy_version 89840 (0.0004) [2023-03-12 05:50:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 46022656. Throughput: 0: 9375.1. Samples: 46019080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:50:47,720][146380] Avg episode reward: [(0, '4572.765')] [2023-03-12 05:50:49,450][146667] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-12 05:50:50,829][146623] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000006 [2023-03-12 05:50:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 46067712. Throughput: 0: 9366.1. Samples: 46047252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:50:52,720][146380] Avg episode reward: [(0, '4570.338')] [2023-03-12 05:50:53,827][146667] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-12 05:50:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 46112768. Throughput: 0: 9381.6. Samples: 46103884. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:50:57,720][146380] Avg episode reward: [(0, '4564.331')] [2023-03-12 05:50:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090064_46112768.pth... [2023-03-12 05:50:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089520_45834240.pth [2023-03-12 05:50:58,249][146667] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-12 05:51:02,642][146667] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-12 05:51:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 46161920. Throughput: 0: 9364.9. Samples: 46158868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:02,720][146380] Avg episode reward: [(0, '4504.583')] [2023-03-12 05:51:07,002][146667] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-12 05:51:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 46206976. Throughput: 0: 9382.5. Samples: 46187296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:07,720][146380] Avg episode reward: [(0, '4516.487')] [2023-03-12 05:51:11,533][146667] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-12 05:51:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 46252032. Throughput: 0: 9349.1. Samples: 46242664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:12,720][146380] Avg episode reward: [(0, '4404.342')] [2023-03-12 05:51:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090336_46252032.pth... [2023-03-12 05:51:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000089792_45973504.pth [2023-03-12 05:51:16,116][146667] Updated weights for policy 0, policy_version 90400 (0.0004) [2023-03-12 05:51:17,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 46297088. Throughput: 0: 9288.8. Samples: 46296600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:17,720][146380] Avg episode reward: [(0, '4509.270')] [2023-03-12 05:51:20,551][146667] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-12 05:51:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 46342144. Throughput: 0: 9260.0. Samples: 46323912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:22,720][146380] Avg episode reward: [(0, '4566.348')] [2023-03-12 05:51:25,032][146667] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-12 05:51:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 46391296. Throughput: 0: 9262.9. Samples: 46379020. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:27,723][146380] Avg episode reward: [(0, '4570.225')] [2023-03-12 05:51:27,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090608_46391296.pth... [2023-03-12 05:51:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090064_46112768.pth [2023-03-12 05:51:29,473][146667] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-12 05:51:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 46436352. Throughput: 0: 9233.5. Samples: 46434588. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:51:32,730][146380] Avg episode reward: [(0, '4577.723')] [2023-03-12 05:51:33,932][146667] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-12 05:51:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 46481408. Throughput: 0: 9194.4. Samples: 46461000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:51:37,720][146380] Avg episode reward: [(0, '4545.784')] [2023-03-12 05:51:38,536][146667] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-12 05:51:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 46526464. Throughput: 0: 9119.0. Samples: 46514240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:51:42,724][146380] Avg episode reward: [(0, '4562.132')] [2023-03-12 05:51:42,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090872_46526464.pth... [2023-03-12 05:51:42,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090336_46252032.pth [2023-03-12 05:51:43,164][146667] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-12 05:51:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9441.6). Total num frames: 46567424. Throughput: 0: 9080.6. Samples: 46567496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:51:47,730][146380] Avg episode reward: [(0, '4539.877')] [2023-03-12 05:51:47,740][146667] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-12 05:51:52,205][146667] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-12 05:51:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9455.5). Total num frames: 46616576. Throughput: 0: 9079.6. Samples: 46595876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:51:52,720][146380] Avg episode reward: [(0, '4547.222')] [2023-03-12 05:51:56,681][146667] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-12 05:51:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9441.6). Total num frames: 46661632. Throughput: 0: 9052.9. Samples: 46650044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:51:57,724][146380] Avg episode reward: [(0, '4554.786')] [2023-03-12 05:51:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091136_46661632.pth... [2023-03-12 05:51:57,730][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090608_46391296.pth [2023-03-12 05:52:01,180][146667] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-12 05:52:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9441.6). Total num frames: 46706688. Throughput: 0: 9075.0. Samples: 46704976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:02,730][146380] Avg episode reward: [(0, '4547.192')] [2023-03-12 05:52:05,637][146667] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-12 05:52:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9427.7). Total num frames: 46751744. Throughput: 0: 9078.3. Samples: 46732436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:07,720][146380] Avg episode reward: [(0, '4521.152')] [2023-03-12 05:52:10,079][146667] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-12 05:52:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9427.7). Total num frames: 46796800. Throughput: 0: 9101.7. Samples: 46788596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:12,720][146380] Avg episode reward: [(0, '4524.517')] [2023-03-12 05:52:12,745][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091408_46800896.pth... [2023-03-12 05:52:12,748][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000090872_46526464.pth [2023-03-12 05:52:14,510][146667] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-12 05:52:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9427.7). Total num frames: 46845952. Throughput: 0: 9082.8. Samples: 46843312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:17,720][146380] Avg episode reward: [(0, '4571.930')] [2023-03-12 05:52:18,949][146667] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-12 05:52:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9427.7). Total num frames: 46891008. Throughput: 0: 9102.9. Samples: 46870632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:22,720][146380] Avg episode reward: [(0, '4528.435')] [2023-03-12 05:52:23,318][146667] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-12 05:52:27,429][146667] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-12 05:52:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9427.7). Total num frames: 46940160. Throughput: 0: 9216.7. Samples: 46928992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:27,720][146380] Avg episode reward: [(0, '4568.784')] [2023-03-12 05:52:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091680_46940160.pth... [2023-03-12 05:52:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091136_46661632.pth [2023-03-12 05:52:31,444][146667] Updated weights for policy 0, policy_version 91760 (0.0004) [2023-03-12 05:52:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 46993408. Throughput: 0: 9385.8. Samples: 46989856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:32,720][146380] Avg episode reward: [(0, '4560.501')] [2023-03-12 05:52:35,505][146667] Updated weights for policy 0, policy_version 91840 (0.0004) [2023-03-12 05:52:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 47042560. Throughput: 0: 9435.6. Samples: 47020476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:37,720][146380] Avg episode reward: [(0, '4564.198')] [2023-03-12 05:52:39,932][146667] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-12 05:52:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 47087616. Throughput: 0: 9471.7. Samples: 47076272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:42,720][146380] Avg episode reward: [(0, '4569.807')] [2023-03-12 05:52:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091968_47087616.pth... [2023-03-12 05:52:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091408_46800896.pth [2023-03-12 05:52:44,197][146667] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-12 05:52:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 47136768. Throughput: 0: 9532.3. Samples: 47133928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:47,720][146380] Avg episode reward: [(0, '4562.298')] [2023-03-12 05:52:48,532][146667] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-12 05:52:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 47181824. Throughput: 0: 9548.4. Samples: 47162116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:52,720][146380] Avg episode reward: [(0, '4562.298')] [2023-03-12 05:52:52,860][146667] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-12 05:52:57,362][146667] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-12 05:52:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 47226880. Throughput: 0: 9538.2. Samples: 47217816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:52:57,720][146380] Avg episode reward: [(0, '4574.156')] [2023-03-12 05:52:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092240_47226880.pth... [2023-03-12 05:52:57,723][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091680_46940160.pth [2023-03-12 05:53:01,741][146667] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-12 05:53:02,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 47276032. Throughput: 0: 9562.9. Samples: 47273644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:53:02,720][146380] Avg episode reward: [(0, '4574.539')] [2023-03-12 05:53:06,088][146667] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-12 05:53:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 47321088. Throughput: 0: 9583.4. Samples: 47301884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:53:07,720][146380] Avg episode reward: [(0, '4575.890')] [2023-03-12 05:53:10,545][146667] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-12 05:53:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47366144. Throughput: 0: 9521.4. Samples: 47357456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:53:12,720][146380] Avg episode reward: [(0, '4577.794')] [2023-03-12 05:53:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092512_47366144.pth... [2023-03-12 05:53:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000091968_47087616.pth [2023-03-12 05:53:15,049][146667] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-12 05:53:17,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 47411200. Throughput: 0: 9364.8. Samples: 47411272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:53:17,720][146380] Avg episode reward: [(0, '4566.721')] [2023-03-12 05:53:19,531][146667] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-12 05:53:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47460352. Throughput: 0: 9315.5. Samples: 47439672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:53:22,720][146380] Avg episode reward: [(0, '4511.488')] [2023-03-12 05:53:23,917][146667] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-12 05:53:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 47505408. Throughput: 0: 9304.8. Samples: 47494988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:27,720][146380] Avg episode reward: [(0, '4554.194')] [2023-03-12 05:53:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092784_47505408.pth... [2023-03-12 05:53:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092240_47226880.pth [2023-03-12 05:53:28,280][146667] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-12 05:53:32,689][146667] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-12 05:53:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 47554560. Throughput: 0: 9272.3. Samples: 47551180. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:32,720][146380] Avg episode reward: [(0, '4548.873')] [2023-03-12 05:53:37,076][146667] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-12 05:53:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 47599616. Throughput: 0: 9268.5. Samples: 47579200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:37,720][146380] Avg episode reward: [(0, '4508.123')] [2023-03-12 05:53:41,392][146667] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-12 05:53:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 47644672. Throughput: 0: 9298.3. Samples: 47636240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:42,720][146380] Avg episode reward: [(0, '4575.569')] [2023-03-12 05:53:42,735][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093064_47648768.pth... [2023-03-12 05:53:42,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092512_47366144.pth [2023-03-12 05:53:45,781][146667] Updated weights for policy 0, policy_version 93120 (0.0005) [2023-03-12 05:53:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 47693824. Throughput: 0: 9301.8. Samples: 47692224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:47,720][146380] Avg episode reward: [(0, '4584.692')] [2023-03-12 05:53:50,132][146667] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-12 05:53:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 47738880. Throughput: 0: 9296.6. Samples: 47720232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:52,720][146380] Avg episode reward: [(0, '4455.724')] [2023-03-12 05:53:54,455][146667] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-12 05:53:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 47788032. Throughput: 0: 9301.7. Samples: 47776032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:53:57,720][146380] Avg episode reward: [(0, '4179.171')] [2023-03-12 05:53:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093336_47788032.pth... [2023-03-12 05:53:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000092784_47505408.pth [2023-03-12 05:53:58,970][146667] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-12 05:54:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 47833088. Throughput: 0: 9344.8. Samples: 47831788. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:54:02,720][146380] Avg episode reward: [(0, '4466.820')] [2023-03-12 05:54:03,383][146667] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-12 05:54:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 47878144. Throughput: 0: 9331.6. Samples: 47859592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:54:07,720][146380] Avg episode reward: [(0, '4579.323')] [2023-03-12 05:54:07,782][146667] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-12 05:54:12,244][146667] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-12 05:54:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 47927296. Throughput: 0: 9334.1. Samples: 47915020. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:54:12,720][146380] Avg episode reward: [(0, '4574.478')] [2023-03-12 05:54:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093608_47927296.pth... [2023-03-12 05:54:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093064_47648768.pth [2023-03-12 05:54:16,625][146667] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-12 05:54:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 47972352. Throughput: 0: 9331.5. Samples: 47971096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:54:17,720][146380] Avg episode reward: [(0, '4542.175')] [2023-03-12 05:54:21,145][146667] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-12 05:54:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 48017408. Throughput: 0: 9298.8. Samples: 47997644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:22,720][146380] Avg episode reward: [(0, '4517.295')] [2023-03-12 05:54:25,531][146667] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-12 05:54:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 48062464. Throughput: 0: 9279.5. Samples: 48053816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:27,720][146380] Avg episode reward: [(0, '4458.105')] [2023-03-12 05:54:27,744][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093880_48066560.pth... [2023-03-12 05:54:27,746][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093336_47788032.pth [2023-03-12 05:54:29,937][146667] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-12 05:54:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 48111616. Throughput: 0: 9261.6. Samples: 48108996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:32,720][146380] Avg episode reward: [(0, '4481.215')] [2023-03-12 05:54:34,375][146667] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-12 05:54:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 48160768. Throughput: 0: 9268.0. Samples: 48137292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:37,720][146380] Avg episode reward: [(0, '4305.021')] [2023-03-12 05:54:38,488][146667] Updated weights for policy 0, policy_version 94080 (0.0004) [2023-03-12 05:54:42,586][146667] Updated weights for policy 0, policy_version 94160 (0.0004) [2023-03-12 05:54:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 48209920. Throughput: 0: 9368.7. Samples: 48197624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:42,720][146380] Avg episode reward: [(0, '4416.588')] [2023-03-12 05:54:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094160_48209920.pth... [2023-03-12 05:54:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093608_47927296.pth [2023-03-12 05:54:46,641][146667] Updated weights for policy 0, policy_version 94240 (0.0004) [2023-03-12 05:54:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 48259072. Throughput: 0: 9463.2. Samples: 48257632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:47,720][146380] Avg episode reward: [(0, '4503.731')] [2023-03-12 05:54:50,834][146667] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-12 05:54:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 48308224. Throughput: 0: 9498.1. Samples: 48287008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:52,720][146380] Avg episode reward: [(0, '4443.693')] [2023-03-12 05:54:55,281][146667] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-12 05:54:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 48353280. Throughput: 0: 9510.3. Samples: 48342984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:54:57,720][146380] Avg episode reward: [(0, '4313.222')] [2023-03-12 05:54:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094440_48353280.pth... [2023-03-12 05:54:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000093880_48066560.pth [2023-03-12 05:54:59,657][146667] Updated weights for policy 0, policy_version 94480 (0.0004) [2023-03-12 05:55:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 48402432. Throughput: 0: 9496.2. Samples: 48398424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:02,720][146380] Avg episode reward: [(0, '4503.313')] [2023-03-12 05:55:03,983][146667] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-12 05:55:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 48447488. Throughput: 0: 9546.9. Samples: 48427256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:07,720][146380] Avg episode reward: [(0, '4536.501')] [2023-03-12 05:55:08,361][146667] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-12 05:55:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 48492544. Throughput: 0: 9566.3. Samples: 48484300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:12,720][146380] Avg episode reward: [(0, '4527.910')] [2023-03-12 05:55:12,731][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094720_48496640.pth... [2023-03-12 05:55:12,732][146667] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-12 05:55:12,733][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094160_48209920.pth [2023-03-12 05:55:17,060][146667] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-12 05:55:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 48541696. Throughput: 0: 9585.0. Samples: 48540320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:17,720][146380] Avg episode reward: [(0, '4561.863')] [2023-03-12 05:55:21,086][146667] Updated weights for policy 0, policy_version 94880 (0.0004) [2023-03-12 05:55:22,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9358.3). Total num frames: 48594944. Throughput: 0: 9630.7. Samples: 48570672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:22,720][146380] Avg episode reward: [(0, '4566.658')] [2023-03-12 05:55:25,121][146667] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-12 05:55:27,720][146380] Fps is (10 sec: 10239.9, 60 sec: 9693.8, 300 sec: 9372.2). Total num frames: 48644096. Throughput: 0: 9651.4. Samples: 48631936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:27,720][146380] Avg episode reward: [(0, '4559.687')] [2023-03-12 05:55:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095008_48644096.pth... [2023-03-12 05:55:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094440_48353280.pth [2023-03-12 05:55:29,094][146667] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-12 05:55:32,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9372.2). Total num frames: 48693248. Throughput: 0: 9681.8. Samples: 48693312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:32,720][146380] Avg episode reward: [(0, '4566.827')] [2023-03-12 05:55:33,141][146667] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-12 05:55:37,156][146667] Updated weights for policy 0, policy_version 95200 (0.0004) [2023-03-12 05:55:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9400.0). Total num frames: 48746496. Throughput: 0: 9705.0. Samples: 48723732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:37,720][146380] Avg episode reward: [(0, '4532.717')] [2023-03-12 05:55:41,327][146667] Updated weights for policy 0, policy_version 95280 (0.0004) [2023-03-12 05:55:42,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9400.0). Total num frames: 48795648. Throughput: 0: 9787.6. Samples: 48783424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:42,720][146380] Avg episode reward: [(0, '4574.459')] [2023-03-12 05:55:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095304_48795648.pth... [2023-03-12 05:55:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000094720_48496640.pth [2023-03-12 05:55:45,628][146667] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-12 05:55:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 48840704. Throughput: 0: 9828.4. Samples: 48840704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:47,720][146380] Avg episode reward: [(0, '4567.258')] [2023-03-12 05:55:49,969][146667] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-12 05:55:52,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 48889856. Throughput: 0: 9820.2. Samples: 48869164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:52,720][146380] Avg episode reward: [(0, '4573.352')] [2023-03-12 05:55:54,263][146667] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-12 05:55:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 48934912. Throughput: 0: 9818.1. Samples: 48926116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:55:57,720][146380] Avg episode reward: [(0, '4572.478')] [2023-03-12 05:55:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095584_48939008.pth... [2023-03-12 05:55:57,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095008_48644096.pth [2023-03-12 05:55:58,569][146667] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-12 05:56:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 48984064. Throughput: 0: 9840.4. Samples: 48983136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:56:02,720][146380] Avg episode reward: [(0, '4563.635')] [2023-03-12 05:56:02,912][146667] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-12 05:56:07,298][146667] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-12 05:56:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 49029120. Throughput: 0: 9786.8. Samples: 49011076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:56:07,720][146380] Avg episode reward: [(0, '4573.006')] [2023-03-12 05:56:11,599][146667] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-12 05:56:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.2, 300 sec: 9427.7). Total num frames: 49078272. Throughput: 0: 9680.9. Samples: 49067576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:56:12,720][146380] Avg episode reward: [(0, '4566.054')] [2023-03-12 05:56:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095856_49078272.pth... [2023-03-12 05:56:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095304_48795648.pth [2023-03-12 05:56:15,964][146667] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-12 05:56:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9441.6). Total num frames: 49127424. Throughput: 0: 9567.0. Samples: 49123828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:17,720][146380] Avg episode reward: [(0, '4574.517')] [2023-03-12 05:56:20,306][146667] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-12 05:56:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 49172480. Throughput: 0: 9518.7. Samples: 49152072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:22,720][146380] Avg episode reward: [(0, '4569.330')] [2023-03-12 05:56:24,704][146667] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-12 05:56:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 49217536. Throughput: 0: 9454.2. Samples: 49208864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:27,720][146380] Avg episode reward: [(0, '4580.986')] [2023-03-12 05:56:27,738][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096136_49221632.pth... [2023-03-12 05:56:27,740][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095584_48939008.pth [2023-03-12 05:56:28,988][146667] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-12 05:56:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 49270784. Throughput: 0: 9487.1. Samples: 49267624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:32,720][146380] Avg episode reward: [(0, '4574.605')] [2023-03-12 05:56:33,018][146667] Updated weights for policy 0, policy_version 96240 (0.0004) [2023-03-12 05:56:37,123][146667] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-12 05:56:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 49319936. Throughput: 0: 9533.7. Samples: 49298180. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:37,720][146380] Avg episode reward: [(0, '4561.651')] [2023-03-12 05:56:41,202][146667] Updated weights for policy 0, policy_version 96400 (0.0004) [2023-03-12 05:56:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 49369088. Throughput: 0: 9598.0. Samples: 49358024. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:42,720][146380] Avg episode reward: [(0, '4567.819')] [2023-03-12 05:56:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096424_49369088.pth... [2023-03-12 05:56:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000095856_49078272.pth [2023-03-12 05:56:45,313][146667] Updated weights for policy 0, policy_version 96480 (0.0004) [2023-03-12 05:56:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 49418240. Throughput: 0: 9669.2. Samples: 49418252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:47,720][146380] Avg episode reward: [(0, '4529.052')] [2023-03-12 05:56:49,406][146667] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-12 05:56:52,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 49471488. Throughput: 0: 9700.7. Samples: 49447608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:52,720][146380] Avg episode reward: [(0, '4572.660')] [2023-03-12 05:56:53,539][146667] Updated weights for policy 0, policy_version 96640 (0.0004) [2023-03-12 05:56:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 49516544. Throughput: 0: 9773.4. Samples: 49507380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:56:57,720][146380] Avg episode reward: [(0, '4587.025')] [2023-03-12 05:56:57,730][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096720_49520640.pth... [2023-03-12 05:56:57,730][146667] Updated weights for policy 0, policy_version 96720 (0.0005) [2023-03-12 05:56:57,731][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096136_49221632.pth [2023-03-12 05:57:01,833][146667] Updated weights for policy 0, policy_version 96800 (0.0004) [2023-03-12 05:57:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 49569792. Throughput: 0: 9837.2. Samples: 49566500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:57:02,720][146380] Avg episode reward: [(0, '4505.196')] [2023-03-12 05:57:05,909][146667] Updated weights for policy 0, policy_version 96880 (0.0004) [2023-03-12 05:57:07,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9566.6). Total num frames: 49618944. Throughput: 0: 9882.8. Samples: 49596800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:57:07,720][146380] Avg episode reward: [(0, '4557.721')] [2023-03-12 05:57:10,056][146667] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-12 05:57:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9566.6). Total num frames: 49668096. Throughput: 0: 9935.2. Samples: 49655948. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 05:57:12,720][146380] Avg episode reward: [(0, '4394.422')] [2023-03-12 05:57:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097008_49668096.pth... [2023-03-12 05:57:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096424_49369088.pth [2023-03-12 05:57:14,202][146667] Updated weights for policy 0, policy_version 97040 (0.0005) [2023-03-12 05:57:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9580.5). Total num frames: 49717248. Throughput: 0: 9959.0. Samples: 49715780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:17,720][146380] Avg episode reward: [(0, '4350.615')] [2023-03-12 05:57:18,336][146667] Updated weights for policy 0, policy_version 97120 (0.0004) [2023-03-12 05:57:22,583][146667] Updated weights for policy 0, policy_version 97200 (0.0004) [2023-03-12 05:57:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9580.5). Total num frames: 49766400. Throughput: 0: 9899.8. Samples: 49743672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:22,720][146380] Avg episode reward: [(0, '4424.617')] [2023-03-12 05:57:26,733][146667] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-12 05:57:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9566.6). Total num frames: 49815552. Throughput: 0: 9895.8. Samples: 49803336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:27,720][146380] Avg episode reward: [(0, '4526.401')] [2023-03-12 05:57:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097296_49815552.pth... [2023-03-12 05:57:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000096720_49520640.pth [2023-03-12 05:57:30,925][146667] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-12 05:57:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9552.7). Total num frames: 49860608. Throughput: 0: 9831.7. Samples: 49860680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:32,720][146380] Avg episode reward: [(0, '4497.998')] [2023-03-12 05:57:35,484][146667] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-12 05:57:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9566.6). Total num frames: 49909760. Throughput: 0: 9788.6. Samples: 49888096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:37,720][146380] Avg episode reward: [(0, '4435.040')] [2023-03-12 05:57:39,909][146667] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-12 05:57:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 49954816. Throughput: 0: 9685.3. Samples: 49943216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:42,720][146380] Avg episode reward: [(0, '4445.098')] [2023-03-12 05:57:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097568_49954816.pth... [2023-03-12 05:57:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097008_49668096.pth [2023-03-12 05:57:44,308][146667] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-12 05:57:47,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 49999872. Throughput: 0: 9629.2. Samples: 49999812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:47,720][146380] Avg episode reward: [(0, '4562.679')] [2023-03-12 05:57:48,753][146667] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-12 05:57:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 50044928. Throughput: 0: 9563.2. Samples: 50027144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:52,720][146380] Avg episode reward: [(0, '4568.698')] [2023-03-12 05:57:53,191][146667] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-12 05:57:57,653][146667] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-12 05:57:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 50094080. Throughput: 0: 9464.8. Samples: 50081864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:57:57,720][146380] Avg episode reward: [(0, '4426.312')] [2023-03-12 05:57:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097840_50094080.pth... [2023-03-12 05:57:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097296_49815552.pth [2023-03-12 05:58:02,053][146667] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-12 05:58:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9552.7). Total num frames: 50139136. Throughput: 0: 9378.7. Samples: 50137820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:58:02,720][146380] Avg episode reward: [(0, '4570.057')] [2023-03-12 05:58:06,428][146667] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-12 05:58:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 50184192. Throughput: 0: 9379.6. Samples: 50165756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:58:07,720][146380] Avg episode reward: [(0, '4484.402')] [2023-03-12 05:58:10,864][146667] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-12 05:58:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 50233344. Throughput: 0: 9284.7. Samples: 50221148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 05:58:12,720][146380] Avg episode reward: [(0, '4527.617')] [2023-03-12 05:58:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098112_50233344.pth... [2023-03-12 05:58:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097568_49954816.pth [2023-03-12 05:58:15,273][146667] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-12 05:58:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 50278400. Throughput: 0: 9255.9. Samples: 50277196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:17,720][146380] Avg episode reward: [(0, '4560.580')] [2023-03-12 05:58:19,776][146667] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-12 05:58:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9552.7). Total num frames: 50323456. Throughput: 0: 9242.7. Samples: 50304020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:22,720][146380] Avg episode reward: [(0, '4565.714')] [2023-03-12 05:58:24,212][146667] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-12 05:58:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50368512. Throughput: 0: 9253.0. Samples: 50359600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:27,720][146380] Avg episode reward: [(0, '4565.688')] [2023-03-12 05:58:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098376_50368512.pth... [2023-03-12 05:58:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000097840_50094080.pth [2023-03-12 05:58:28,735][146667] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-12 05:58:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50413568. Throughput: 0: 9190.0. Samples: 50413360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:32,720][146380] Avg episode reward: [(0, '4562.044')] [2023-03-12 05:58:33,348][146667] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-12 05:58:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9538.8). Total num frames: 50458624. Throughput: 0: 9161.2. Samples: 50439396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:37,720][146380] Avg episode reward: [(0, '4523.099')] [2023-03-12 05:58:37,807][146667] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-12 05:58:42,269][146667] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-12 05:58:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50507776. Throughput: 0: 9191.3. Samples: 50495472. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:42,720][146380] Avg episode reward: [(0, '4490.719')] [2023-03-12 05:58:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098648_50507776.pth... [2023-03-12 05:58:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098112_50233344.pth [2023-03-12 05:58:46,776][146667] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-12 05:58:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50552832. Throughput: 0: 9158.0. Samples: 50549932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:47,720][146380] Avg episode reward: [(0, '4555.546')] [2023-03-12 05:58:51,185][146667] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-12 05:58:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 50597888. Throughput: 0: 9149.4. Samples: 50577480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:52,720][146380] Avg episode reward: [(0, '4561.073')] [2023-03-12 05:58:55,595][146667] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-12 05:58:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 50642944. Throughput: 0: 9169.9. Samples: 50633792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:58:57,720][146380] Avg episode reward: [(0, '4550.826')] [2023-03-12 05:58:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098912_50642944.pth... [2023-03-12 05:58:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098376_50368512.pth [2023-03-12 05:59:00,015][146667] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-12 05:59:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50692096. Throughput: 0: 9154.4. Samples: 50689144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:59:02,720][146380] Avg episode reward: [(0, '4561.854')] [2023-03-12 05:59:04,480][146667] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-12 05:59:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 50737152. Throughput: 0: 9166.1. Samples: 50716496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:59:07,720][146380] Avg episode reward: [(0, '4553.732')] [2023-03-12 05:59:08,992][146667] Updated weights for policy 0, policy_version 99120 (0.0006) [2023-03-12 05:59:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 50782208. Throughput: 0: 9144.1. Samples: 50771084. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 05:59:12,720][146380] Avg episode reward: [(0, '4554.226')] [2023-03-12 05:59:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099184_50782208.pth... [2023-03-12 05:59:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098648_50507776.pth [2023-03-12 05:59:13,480][146667] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-12 05:59:17,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 50827264. Throughput: 0: 9184.1. Samples: 50826644. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:17,720][146380] Avg episode reward: [(0, '4568.718')] [2023-03-12 05:59:17,883][146667] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-12 05:59:22,274][146667] Updated weights for policy 0, policy_version 99360 (0.0004) [2023-03-12 05:59:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 50876416. Throughput: 0: 9229.4. Samples: 50854720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:22,720][146380] Avg episode reward: [(0, '4572.034')] [2023-03-12 05:59:26,649][146667] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-12 05:59:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 50921472. Throughput: 0: 9216.3. Samples: 50910208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:27,720][146380] Avg episode reward: [(0, '4562.286')] [2023-03-12 05:59:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099456_50921472.pth... [2023-03-12 05:59:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000098912_50642944.pth [2023-03-12 05:59:31,066][146667] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-12 05:59:32,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9511.0). Total num frames: 50966528. Throughput: 0: 9253.4. Samples: 50966336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:32,720][146380] Avg episode reward: [(0, '4566.292')] [2023-03-12 05:59:35,498][146667] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-12 05:59:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 51015680. Throughput: 0: 9251.0. Samples: 50993776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:37,720][146380] Avg episode reward: [(0, '4585.255')] [2023-03-12 05:59:39,893][146667] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-12 05:59:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 51060736. Throughput: 0: 9248.5. Samples: 51049972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:42,720][146380] Avg episode reward: [(0, '4574.618')] [2023-03-12 05:59:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099728_51060736.pth... [2023-03-12 05:59:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099184_50782208.pth [2023-03-12 05:59:44,265][146667] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-12 05:59:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 51105792. Throughput: 0: 9259.1. Samples: 51105804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:47,720][146380] Avg episode reward: [(0, '4573.876')] [2023-03-12 05:59:48,652][146667] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-12 05:59:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 51150848. Throughput: 0: 9266.8. Samples: 51133500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:52,720][146380] Avg episode reward: [(0, '4570.762')] [2023-03-12 05:59:53,211][146667] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-12 05:59:57,580][146667] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-12 05:59:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 51200000. Throughput: 0: 9259.8. Samples: 51187776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 05:59:57,720][146380] Avg episode reward: [(0, '4569.833')] [2023-03-12 05:59:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100000_51200000.pth... [2023-03-12 05:59:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099456_50921472.pth [2023-03-12 06:00:01,949][146667] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-12 06:00:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 51245056. Throughput: 0: 9296.6. Samples: 51244992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:00:02,720][146380] Avg episode reward: [(0, '4579.474')] [2023-03-12 06:00:06,374][146667] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-12 06:00:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 51294208. Throughput: 0: 9291.4. Samples: 51272832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:00:07,720][146380] Avg episode reward: [(0, '4577.032')] [2023-03-12 06:00:10,819][146667] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-12 06:00:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 51339264. Throughput: 0: 9264.8. Samples: 51327124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:00:12,720][146380] Avg episode reward: [(0, '4569.281')] [2023-03-12 06:00:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100272_51339264.pth... [2023-03-12 06:00:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000099728_51060736.pth [2023-03-12 06:00:15,329][146667] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-12 06:00:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 51384320. Throughput: 0: 9247.6. Samples: 51382476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:17,720][146380] Avg episode reward: [(0, '4579.433')] [2023-03-12 06:00:19,725][146667] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-12 06:00:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9441.6). Total num frames: 51429376. Throughput: 0: 9255.5. Samples: 51410272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:22,720][146380] Avg episode reward: [(0, '4574.159')] [2023-03-12 06:00:24,198][146667] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-12 06:00:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 51474432. Throughput: 0: 9236.7. Samples: 51465624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:27,720][146380] Avg episode reward: [(0, '4579.766')] [2023-03-12 06:00:27,772][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100544_51478528.pth... [2023-03-12 06:00:27,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100000_51200000.pth [2023-03-12 06:00:28,660][146667] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-12 06:00:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 51523584. Throughput: 0: 9221.9. Samples: 51520788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:32,720][146380] Avg episode reward: [(0, '4578.166')] [2023-03-12 06:00:33,076][146667] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-12 06:00:37,126][146667] Updated weights for policy 0, policy_version 100720 (0.0004) [2023-03-12 06:00:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 51572736. Throughput: 0: 9266.7. Samples: 51550504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:37,720][146380] Avg episode reward: [(0, '4578.506')] [2023-03-12 06:00:41,169][146667] Updated weights for policy 0, policy_version 100800 (0.0004) [2023-03-12 06:00:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 51621888. Throughput: 0: 9410.1. Samples: 51611232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:42,720][146380] Avg episode reward: [(0, '4580.382')] [2023-03-12 06:00:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100824_51621888.pth... [2023-03-12 06:00:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100272_51339264.pth [2023-03-12 06:00:45,296][146667] Updated weights for policy 0, policy_version 100880 (0.0004) [2023-03-12 06:00:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 51671040. Throughput: 0: 9432.5. Samples: 51669456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:47,720][146380] Avg episode reward: [(0, '4569.976')] [2023-03-12 06:00:49,681][146667] Updated weights for policy 0, policy_version 100960 (0.0004) [2023-03-12 06:00:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 51720192. Throughput: 0: 9448.0. Samples: 51697992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:52,720][146380] Avg episode reward: [(0, '4544.228')] [2023-03-12 06:00:53,797][146667] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-12 06:00:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 51769344. Throughput: 0: 9579.0. Samples: 51758180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:00:57,720][146380] Avg episode reward: [(0, '4567.688')] [2023-03-12 06:00:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101112_51769344.pth... [2023-03-12 06:00:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100544_51478528.pth [2023-03-12 06:00:57,846][146667] Updated weights for policy 0, policy_version 101120 (0.0004) [2023-03-12 06:01:01,962][146667] Updated weights for policy 0, policy_version 101200 (0.0004) [2023-03-12 06:01:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 51818496. Throughput: 0: 9685.2. Samples: 51818308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:02,720][146380] Avg episode reward: [(0, '4567.473')] [2023-03-12 06:01:06,193][146667] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-12 06:01:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 51867648. Throughput: 0: 9703.0. Samples: 51846908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:07,720][146380] Avg episode reward: [(0, '4570.583')] [2023-03-12 06:01:10,636][146667] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-12 06:01:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 51912704. Throughput: 0: 9728.7. Samples: 51903416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:12,720][146380] Avg episode reward: [(0, '4572.812')] [2023-03-12 06:01:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101392_51912704.pth... [2023-03-12 06:01:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000100824_51621888.pth [2023-03-12 06:01:15,028][146667] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-12 06:01:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 51961856. Throughput: 0: 9746.5. Samples: 51959380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:17,720][146380] Avg episode reward: [(0, '4548.542')] [2023-03-12 06:01:19,335][146667] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-12 06:01:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 52006912. Throughput: 0: 9716.3. Samples: 51987736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:22,720][146380] Avg episode reward: [(0, '4541.026')] [2023-03-12 06:01:23,708][146667] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-12 06:01:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 52056064. Throughput: 0: 9613.7. Samples: 52043848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:27,720][146380] Avg episode reward: [(0, '4574.900')] [2023-03-12 06:01:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101672_52056064.pth... [2023-03-12 06:01:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101112_51769344.pth [2023-03-12 06:01:28,036][146667] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-12 06:01:32,324][146667] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-12 06:01:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 52101120. Throughput: 0: 9594.0. Samples: 52101184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:32,720][146380] Avg episode reward: [(0, '4411.506')] [2023-03-12 06:01:36,740][146667] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-12 06:01:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 52150272. Throughput: 0: 9573.8. Samples: 52128816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:37,720][146380] Avg episode reward: [(0, '4496.064')] [2023-03-12 06:01:41,066][146667] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-12 06:01:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 52195328. Throughput: 0: 9500.0. Samples: 52185680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:42,720][146380] Avg episode reward: [(0, '4508.412')] [2023-03-12 06:01:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101944_52195328.pth... [2023-03-12 06:01:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101392_51912704.pth [2023-03-12 06:01:45,442][146667] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-12 06:01:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 52244480. Throughput: 0: 9400.4. Samples: 52241328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:47,720][146380] Avg episode reward: [(0, '4567.760')] [2023-03-12 06:01:49,865][146667] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-12 06:01:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 52289536. Throughput: 0: 9383.3. Samples: 52269156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:52,720][146380] Avg episode reward: [(0, '4540.399')] [2023-03-12 06:01:54,260][146667] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-12 06:01:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52334592. Throughput: 0: 9379.2. Samples: 52325480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:01:57,720][146380] Avg episode reward: [(0, '4547.225')] [2023-03-12 06:01:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102216_52334592.pth... [2023-03-12 06:01:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101672_52056064.pth [2023-03-12 06:01:58,649][146667] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-12 06:02:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52383744. Throughput: 0: 9418.5. Samples: 52383212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:02:02,720][146380] Avg episode reward: [(0, '4474.735')] [2023-03-12 06:02:02,836][146667] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-12 06:02:07,004][146667] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-12 06:02:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52432896. Throughput: 0: 9437.6. Samples: 52412428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:02:07,720][146380] Avg episode reward: [(0, '4510.657')] [2023-03-12 06:02:11,445][146667] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-12 06:02:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 52477952. Throughput: 0: 9446.8. Samples: 52468952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:02:12,720][146380] Avg episode reward: [(0, '4252.974')] [2023-03-12 06:02:12,780][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102504_52482048.pth... [2023-03-12 06:02:12,781][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000101944_52195328.pth [2023-03-12 06:02:15,860][146667] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-12 06:02:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 52527104. Throughput: 0: 9407.5. Samples: 52524524. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:17,720][146380] Avg episode reward: [(0, '4161.948')] [2023-03-12 06:02:20,225][146667] Updated weights for policy 0, policy_version 102640 (0.0006) [2023-03-12 06:02:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 52572160. Throughput: 0: 9418.1. Samples: 52552628. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:22,720][146380] Avg episode reward: [(0, '4465.358')] [2023-03-12 06:02:24,573][146667] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-12 06:02:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 52621312. Throughput: 0: 9414.2. Samples: 52609320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:27,720][146380] Avg episode reward: [(0, '4293.260')] [2023-03-12 06:02:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102776_52621312.pth... [2023-03-12 06:02:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102216_52334592.pth [2023-03-12 06:02:28,815][146667] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-12 06:02:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 52670464. Throughput: 0: 9450.1. Samples: 52666584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:32,720][146380] Avg episode reward: [(0, '4555.074')] [2023-03-12 06:02:33,133][146667] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-12 06:02:37,445][146667] Updated weights for policy 0, policy_version 102960 (0.0006) [2023-03-12 06:02:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 52715520. Throughput: 0: 9468.8. Samples: 52695252. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:37,720][146380] Avg episode reward: [(0, '4487.501')] [2023-03-12 06:02:41,769][146667] Updated weights for policy 0, policy_version 103040 (0.0006) [2023-03-12 06:02:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 52764672. Throughput: 0: 9488.3. Samples: 52752456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:42,720][146380] Avg episode reward: [(0, '4463.587')] [2023-03-12 06:02:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103056_52764672.pth... [2023-03-12 06:02:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102504_52482048.pth [2023-03-12 06:02:46,200][146667] Updated weights for policy 0, policy_version 103120 (0.0006) [2023-03-12 06:02:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52809728. Throughput: 0: 9448.1. Samples: 52808376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:47,720][146380] Avg episode reward: [(0, '4519.726')] [2023-03-12 06:02:50,572][146667] Updated weights for policy 0, policy_version 103200 (0.0006) [2023-03-12 06:02:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 52858880. Throughput: 0: 9418.2. Samples: 52836248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:52,720][146380] Avg episode reward: [(0, '4563.615')] [2023-03-12 06:02:54,774][146667] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-12 06:02:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 52903936. Throughput: 0: 9467.0. Samples: 52894968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:02:57,720][146380] Avg episode reward: [(0, '4556.576')] [2023-03-12 06:02:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103328_52903936.pth... [2023-03-12 06:02:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000102776_52621312.pth [2023-03-12 06:02:59,113][146667] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-12 06:03:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 52953088. Throughput: 0: 9456.9. Samples: 52950084. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:02,730][146380] Avg episode reward: [(0, '4556.743')] [2023-03-12 06:03:03,580][146667] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-12 06:03:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 52998144. Throughput: 0: 9445.3. Samples: 52977664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:07,720][146380] Avg episode reward: [(0, '4561.691')] [2023-03-12 06:03:07,971][146667] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-12 06:03:12,093][146667] Updated weights for policy 0, policy_version 103600 (0.0004) [2023-03-12 06:03:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 53047296. Throughput: 0: 9468.6. Samples: 53035408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:12,720][146380] Avg episode reward: [(0, '4555.291')] [2023-03-12 06:03:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103608_53047296.pth... [2023-03-12 06:03:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103056_52764672.pth [2023-03-12 06:03:16,352][146667] Updated weights for policy 0, policy_version 103680 (0.0006) [2023-03-12 06:03:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 53096448. Throughput: 0: 9493.5. Samples: 53093792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:17,720][146380] Avg episode reward: [(0, '4536.156')] [2023-03-12 06:03:20,532][146667] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-12 06:03:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 53145600. Throughput: 0: 9507.6. Samples: 53123096. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:22,720][146380] Avg episode reward: [(0, '4538.502')] [2023-03-12 06:03:24,784][146667] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-12 06:03:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 53190656. Throughput: 0: 9528.3. Samples: 53181228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:27,720][146380] Avg episode reward: [(0, '4541.318')] [2023-03-12 06:03:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103888_53190656.pth... [2023-03-12 06:03:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103328_52903936.pth [2023-03-12 06:03:29,169][146667] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-12 06:03:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 53235712. Throughput: 0: 9498.0. Samples: 53235784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:32,720][146380] Avg episode reward: [(0, '4542.986')] [2023-03-12 06:03:33,553][146667] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-12 06:03:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 53284864. Throughput: 0: 9536.7. Samples: 53265400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:37,720][146380] Avg episode reward: [(0, '4542.938')] [2023-03-12 06:03:37,856][146667] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-12 06:03:42,284][146667] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-12 06:03:42,720][146380] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 53329920. Throughput: 0: 9483.5. Samples: 53321728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:42,720][146380] Avg episode reward: [(0, '4547.809')] [2023-03-12 06:03:42,744][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104168_53334016.pth... [2023-03-12 06:03:42,747][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103608_53047296.pth [2023-03-12 06:03:46,756][146667] Updated weights for policy 0, policy_version 104240 (0.0005) [2023-03-12 06:03:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 53379072. Throughput: 0: 9468.4. Samples: 53376164. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:47,720][146380] Avg episode reward: [(0, '4549.589')] [2023-03-12 06:03:51,312][146667] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-12 06:03:52,719][146380] Fps is (10 sec: 9421.0, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 53424128. Throughput: 0: 9465.1. Samples: 53403592. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:52,720][146380] Avg episode reward: [(0, '4564.359')] [2023-03-12 06:03:55,873][146667] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-12 06:03:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 53469184. Throughput: 0: 9368.0. Samples: 53456968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:03:57,720][146380] Avg episode reward: [(0, '4556.477')] [2023-03-12 06:03:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104432_53469184.pth... [2023-03-12 06:03:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000103888_53190656.pth [2023-03-12 06:04:00,361][146667] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-12 06:04:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 53514240. Throughput: 0: 9312.7. Samples: 53512864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:04:02,720][146380] Avg episode reward: [(0, '4549.462')] [2023-03-12 06:04:04,663][146667] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-12 06:04:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 53559296. Throughput: 0: 9289.2. Samples: 53541112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:04:07,720][146380] Avg episode reward: [(0, '4551.734')] [2023-03-12 06:04:09,055][146667] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-12 06:04:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 53604352. Throughput: 0: 9215.9. Samples: 53595944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:04:12,720][146380] Avg episode reward: [(0, '4547.511')] [2023-03-12 06:04:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104696_53604352.pth... [2023-03-12 06:04:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104168_53334016.pth [2023-03-12 06:04:13,845][146667] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-12 06:04:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9400.0). Total num frames: 53649408. Throughput: 0: 9154.2. Samples: 53647724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:17,720][146380] Avg episode reward: [(0, '4552.896')] [2023-03-12 06:04:18,475][146667] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-12 06:04:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9400.0). Total num frames: 53694464. Throughput: 0: 9081.1. Samples: 53674048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:22,720][146380] Avg episode reward: [(0, '4518.470')] [2023-03-12 06:04:23,089][146667] Updated weights for policy 0, policy_version 104880 (0.0005) [2023-03-12 06:04:27,712][146667] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-12 06:04:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9400.0). Total num frames: 53739520. Throughput: 0: 9012.7. Samples: 53727296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:27,720][146380] Avg episode reward: [(0, '4565.331')] [2023-03-12 06:04:27,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104960_53739520.pth... [2023-03-12 06:04:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104432_53469184.pth [2023-03-12 06:04:32,216][146667] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-12 06:04:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9386.1). Total num frames: 53784576. Throughput: 0: 9007.6. Samples: 53781504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:32,720][146380] Avg episode reward: [(0, '4459.972')] [2023-03-12 06:04:36,969][146667] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-12 06:04:37,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9372.2). Total num frames: 53825536. Throughput: 0: 8978.1. Samples: 53807608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:37,720][146380] Avg episode reward: [(0, '4392.761')] [2023-03-12 06:04:41,637][146667] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-12 06:04:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9372.2). Total num frames: 53870592. Throughput: 0: 8942.9. Samples: 53859400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:42,720][146380] Avg episode reward: [(0, '4465.068')] [2023-03-12 06:04:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105216_53870592.pth... [2023-03-12 06:04:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104696_53604352.pth [2023-03-12 06:04:46,274][146667] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-12 06:04:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9372.2). Total num frames: 53915648. Throughput: 0: 8876.9. Samples: 53912324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:47,720][146380] Avg episode reward: [(0, '4356.341')] [2023-03-12 06:04:50,916][146667] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-12 06:04:52,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9344.4). Total num frames: 53956608. Throughput: 0: 8858.3. Samples: 53939736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:52,720][146380] Avg episode reward: [(0, '4363.181')] [2023-03-12 06:04:55,541][146667] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-12 06:04:57,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9344.4). Total num frames: 54001664. Throughput: 0: 8808.1. Samples: 53992308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:04:57,720][146380] Avg episode reward: [(0, '4521.723')] [2023-03-12 06:04:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105472_54001664.pth... [2023-03-12 06:04:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000104960_53739520.pth [2023-03-12 06:05:00,296][146667] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-12 06:05:02,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 9330.5). Total num frames: 54046720. Throughput: 0: 8804.4. Samples: 54043924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:02,720][146380] Avg episode reward: [(0, '4526.007')] [2023-03-12 06:05:05,010][146667] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-12 06:05:07,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 9316.7). Total num frames: 54087680. Throughput: 0: 8807.7. Samples: 54070396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:07,720][146380] Avg episode reward: [(0, '4561.810')] [2023-03-12 06:05:09,623][146667] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-12 06:05:12,720][146380] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 9316.7). Total num frames: 54132736. Throughput: 0: 8806.0. Samples: 54123568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:12,720][146380] Avg episode reward: [(0, '4567.171')] [2023-03-12 06:05:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105728_54132736.pth... [2023-03-12 06:05:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105216_53870592.pth [2023-03-12 06:05:14,220][146667] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-12 06:05:17,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 9316.7). Total num frames: 54177792. Throughput: 0: 8806.4. Samples: 54177792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:17,720][146380] Avg episode reward: [(0, '4536.440')] [2023-03-12 06:05:18,748][146667] Updated weights for policy 0, policy_version 105840 (0.0004) [2023-03-12 06:05:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9316.7). Total num frames: 54222848. Throughput: 0: 8822.0. Samples: 54204600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:22,720][146380] Avg episode reward: [(0, '4509.445')] [2023-03-12 06:05:23,273][146667] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-12 06:05:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9302.8). Total num frames: 54267904. Throughput: 0: 8890.3. Samples: 54259464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:27,724][146380] Avg episode reward: [(0, '4526.722')] [2023-03-12 06:05:27,744][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106000_54272000.pth... [2023-03-12 06:05:27,744][146667] Updated weights for policy 0, policy_version 106000 (0.0006) [2023-03-12 06:05:27,745][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105472_54001664.pth [2023-03-12 06:05:32,218][146667] Updated weights for policy 0, policy_version 106080 (0.0004) [2023-03-12 06:05:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 9302.8). Total num frames: 54317056. Throughput: 0: 8925.1. Samples: 54313952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:32,720][146380] Avg episode reward: [(0, '4477.370')] [2023-03-12 06:05:36,631][146667] Updated weights for policy 0, policy_version 106160 (0.0004) [2023-03-12 06:05:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9288.9). Total num frames: 54362112. Throughput: 0: 8930.7. Samples: 54341620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:37,720][146380] Avg episode reward: [(0, '4571.237')] [2023-03-12 06:05:41,028][146667] Updated weights for policy 0, policy_version 106240 (0.0004) [2023-03-12 06:05:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9288.9). Total num frames: 54411264. Throughput: 0: 9013.5. Samples: 54397916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:42,720][146380] Avg episode reward: [(0, '4452.905')] [2023-03-12 06:05:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106272_54411264.pth... [2023-03-12 06:05:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000105728_54132736.pth [2023-03-12 06:05:45,300][146667] Updated weights for policy 0, policy_version 106320 (0.0003) [2023-03-12 06:05:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9275.0). Total num frames: 54456320. Throughput: 0: 9134.9. Samples: 54454996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:47,720][146380] Avg episode reward: [(0, '4432.610')] [2023-03-12 06:05:49,755][146667] Updated weights for policy 0, policy_version 106400 (0.0004) [2023-03-12 06:05:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9261.1). Total num frames: 54501376. Throughput: 0: 9148.5. Samples: 54482080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:52,720][146380] Avg episode reward: [(0, '4399.753')] [2023-03-12 06:05:54,224][146667] Updated weights for policy 0, policy_version 106480 (0.0004) [2023-03-12 06:05:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 54550528. Throughput: 0: 9204.2. Samples: 54537756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:05:57,720][146380] Avg episode reward: [(0, '4241.124')] [2023-03-12 06:05:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106544_54550528.pth... [2023-03-12 06:05:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106000_54272000.pth [2023-03-12 06:05:58,586][146667] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-12 06:06:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 54595584. Throughput: 0: 9266.5. Samples: 54594784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:02,720][146380] Avg episode reward: [(0, '4332.144')] [2023-03-12 06:06:02,905][146667] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-12 06:06:07,361][146667] Updated weights for policy 0, policy_version 106720 (0.0006) [2023-03-12 06:06:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 54640640. Throughput: 0: 9282.3. Samples: 54622304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:07,720][146380] Avg episode reward: [(0, '4427.303')] [2023-03-12 06:06:11,810][146667] Updated weights for policy 0, policy_version 106800 (0.0006) [2023-03-12 06:06:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 54689792. Throughput: 0: 9289.8. Samples: 54677504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:12,720][146380] Avg episode reward: [(0, '4474.503')] [2023-03-12 06:06:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106816_54689792.pth... [2023-03-12 06:06:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106272_54411264.pth [2023-03-12 06:06:16,171][146667] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-12 06:06:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 54734848. Throughput: 0: 9328.8. Samples: 54733748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:17,720][146380] Avg episode reward: [(0, '4463.119')] [2023-03-12 06:06:20,510][146667] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-12 06:06:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 54784000. Throughput: 0: 9346.2. Samples: 54762200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:22,720][146380] Avg episode reward: [(0, '4341.742')] [2023-03-12 06:06:24,777][146667] Updated weights for policy 0, policy_version 107040 (0.0006) [2023-03-12 06:06:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 54829056. Throughput: 0: 9360.3. Samples: 54819132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:27,720][146380] Avg episode reward: [(0, '4423.854')] [2023-03-12 06:06:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107088_54829056.pth... [2023-03-12 06:06:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106544_54550528.pth [2023-03-12 06:06:29,349][146667] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-12 06:06:32,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 54874112. Throughput: 0: 9270.9. Samples: 54872188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:32,720][146380] Avg episode reward: [(0, '4281.432')] [2023-03-12 06:06:33,900][146667] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-12 06:06:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 54919168. Throughput: 0: 9269.6. Samples: 54899212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:37,720][146380] Avg episode reward: [(0, '4264.574')] [2023-03-12 06:06:38,319][146667] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-12 06:06:42,696][146667] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-12 06:06:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 54968320. Throughput: 0: 9289.6. Samples: 54955788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:42,720][146380] Avg episode reward: [(0, '4352.955')] [2023-03-12 06:06:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107360_54968320.pth... [2023-03-12 06:06:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000106816_54689792.pth [2023-03-12 06:06:47,215][146667] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-12 06:06:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 55013376. Throughput: 0: 9234.3. Samples: 55010328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:47,720][146380] Avg episode reward: [(0, '4367.685')] [2023-03-12 06:06:51,503][146667] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-12 06:06:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 55058432. Throughput: 0: 9254.6. Samples: 55038760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:52,720][146380] Avg episode reward: [(0, '4570.261')] [2023-03-12 06:06:55,809][146667] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-12 06:06:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 55107584. Throughput: 0: 9296.2. Samples: 55095832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:06:57,720][146380] Avg episode reward: [(0, '4493.055')] [2023-03-12 06:06:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107632_55107584.pth... [2023-03-12 06:06:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107088_54829056.pth [2023-03-12 06:07:00,146][146667] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-12 06:07:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 55152640. Throughput: 0: 9309.0. Samples: 55152652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:02,720][146380] Avg episode reward: [(0, '4489.759')] [2023-03-12 06:07:04,532][146667] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-12 06:07:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 55197696. Throughput: 0: 9296.4. Samples: 55180536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:07,720][146380] Avg episode reward: [(0, '4564.505')] [2023-03-12 06:07:09,020][146667] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-12 06:07:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 55246848. Throughput: 0: 9249.6. Samples: 55235364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:12,720][146380] Avg episode reward: [(0, '4484.841')] [2023-03-12 06:07:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107904_55246848.pth... [2023-03-12 06:07:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107360_54968320.pth [2023-03-12 06:07:13,364][146667] Updated weights for policy 0, policy_version 107920 (0.0004) [2023-03-12 06:07:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 55291904. Throughput: 0: 9292.8. Samples: 55290364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:17,720][146380] Avg episode reward: [(0, '4550.549')] [2023-03-12 06:07:17,993][146667] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-12 06:07:22,513][146667] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-12 06:07:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 55336960. Throughput: 0: 9294.4. Samples: 55317460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:22,720][146380] Avg episode reward: [(0, '4512.552')] [2023-03-12 06:07:26,991][146667] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-12 06:07:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 55382016. Throughput: 0: 9252.3. Samples: 55372140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:27,720][146380] Avg episode reward: [(0, '4279.419')] [2023-03-12 06:07:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108168_55382016.pth... [2023-03-12 06:07:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107632_55107584.pth [2023-03-12 06:07:31,279][146667] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-12 06:07:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 55431168. Throughput: 0: 9294.3. Samples: 55428572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:32,720][146380] Avg episode reward: [(0, '4493.819')] [2023-03-12 06:07:35,705][146667] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-12 06:07:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 55476224. Throughput: 0: 9272.9. Samples: 55456040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:37,720][146380] Avg episode reward: [(0, '4536.933')] [2023-03-12 06:07:39,947][146667] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-12 06:07:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 55525376. Throughput: 0: 9292.0. Samples: 55513972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:42,720][146380] Avg episode reward: [(0, '4562.390')] [2023-03-12 06:07:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108448_55525376.pth... [2023-03-12 06:07:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000107904_55246848.pth [2023-03-12 06:07:44,193][146667] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-12 06:07:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 55574528. Throughput: 0: 9307.9. Samples: 55571508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:47,720][146380] Avg episode reward: [(0, '4504.771')] [2023-03-12 06:07:48,455][146667] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-12 06:07:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 55619584. Throughput: 0: 9319.6. Samples: 55599916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:52,720][146380] Avg episode reward: [(0, '4451.747')] [2023-03-12 06:07:52,800][146667] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-12 06:07:57,077][146667] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-12 06:07:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 55668736. Throughput: 0: 9384.8. Samples: 55657680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:07:57,720][146380] Avg episode reward: [(0, '4525.556')] [2023-03-12 06:07:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108728_55668736.pth... [2023-03-12 06:07:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108168_55382016.pth [2023-03-12 06:08:01,421][146667] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-12 06:08:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9219.5). Total num frames: 55717888. Throughput: 0: 9413.1. Samples: 55713952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:02,720][146380] Avg episode reward: [(0, '4399.384')] [2023-03-12 06:08:05,644][146667] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-12 06:08:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9205.6). Total num frames: 55762944. Throughput: 0: 9462.4. Samples: 55743268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:07,720][146380] Avg episode reward: [(0, '4529.354')] [2023-03-12 06:08:09,917][146667] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-12 06:08:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9205.6). Total num frames: 55812096. Throughput: 0: 9542.3. Samples: 55801544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:12,720][146380] Avg episode reward: [(0, '4471.259')] [2023-03-12 06:08:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109008_55812096.pth... [2023-03-12 06:08:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108448_55525376.pth [2023-03-12 06:08:14,118][146667] Updated weights for policy 0, policy_version 109040 (0.0006) [2023-03-12 06:08:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9205.6). Total num frames: 55861248. Throughput: 0: 9581.4. Samples: 55859736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:17,720][146380] Avg episode reward: [(0, '4523.356')] [2023-03-12 06:08:18,368][146667] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-12 06:08:22,605][146667] Updated weights for policy 0, policy_version 109200 (0.0005) [2023-03-12 06:08:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9219.5). Total num frames: 55910400. Throughput: 0: 9609.4. Samples: 55888464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:22,720][146380] Avg episode reward: [(0, '4343.531')] [2023-03-12 06:08:26,799][146667] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-12 06:08:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9233.4). Total num frames: 55959552. Throughput: 0: 9628.7. Samples: 55947264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:27,720][146380] Avg episode reward: [(0, '4414.690')] [2023-03-12 06:08:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109296_55959552.pth... [2023-03-12 06:08:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000108728_55668736.pth [2023-03-12 06:08:30,989][146667] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-12 06:08:32,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9233.4). Total num frames: 56008704. Throughput: 0: 9647.5. Samples: 56005644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:32,720][146380] Avg episode reward: [(0, '4560.948')] [2023-03-12 06:08:35,138][146667] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-12 06:08:37,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9247.2). Total num frames: 56057856. Throughput: 0: 9674.4. Samples: 56035264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:37,720][146380] Avg episode reward: [(0, '4423.871')] [2023-03-12 06:08:39,297][146667] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-12 06:08:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9247.2). Total num frames: 56107008. Throughput: 0: 9708.9. Samples: 56094580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:42,720][146380] Avg episode reward: [(0, '4513.059')] [2023-03-12 06:08:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109584_56107008.pth... [2023-03-12 06:08:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109008_55812096.pth [2023-03-12 06:08:43,475][146667] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-12 06:08:47,616][146667] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-12 06:08:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9261.1). Total num frames: 56156160. Throughput: 0: 9766.6. Samples: 56153448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:47,720][146380] Avg episode reward: [(0, '4516.675')] [2023-03-12 06:08:51,722][146667] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-12 06:08:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9275.0). Total num frames: 56205312. Throughput: 0: 9784.3. Samples: 56183560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:52,720][146380] Avg episode reward: [(0, '4565.353')] [2023-03-12 06:08:56,005][146667] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-12 06:08:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9275.0). Total num frames: 56250368. Throughput: 0: 9775.4. Samples: 56241436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:08:57,720][146380] Avg episode reward: [(0, '4566.969')] [2023-03-12 06:08:57,757][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109872_56254464.pth... [2023-03-12 06:08:57,759][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109296_55959552.pth [2023-03-12 06:09:00,491][146667] Updated weights for policy 0, policy_version 109920 (0.0004) [2023-03-12 06:09:02,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9625.6, 300 sec: 9275.0). Total num frames: 56295424. Throughput: 0: 9683.6. Samples: 56295496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:02,720][146380] Avg episode reward: [(0, '4557.582')] [2023-03-12 06:09:04,981][146667] Updated weights for policy 0, policy_version 110000 (0.0004) [2023-03-12 06:09:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9275.0). Total num frames: 56340480. Throughput: 0: 9670.2. Samples: 56323624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:07,720][146380] Avg episode reward: [(0, '4535.799')] [2023-03-12 06:09:09,584][146667] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-12 06:09:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 56385536. Throughput: 0: 9557.3. Samples: 56377340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:12,720][146380] Avg episode reward: [(0, '4567.389')] [2023-03-12 06:09:12,756][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110136_56389632.pth... [2023-03-12 06:09:12,757][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109584_56107008.pth [2023-03-12 06:09:14,137][146667] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-12 06:09:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9288.9). Total num frames: 56434688. Throughput: 0: 9467.3. Samples: 56431672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:17,720][146380] Avg episode reward: [(0, '4561.705')] [2023-03-12 06:09:18,495][146667] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-12 06:09:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 56479744. Throughput: 0: 9422.7. Samples: 56459284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:22,720][146380] Avg episode reward: [(0, '4562.484')] [2023-03-12 06:09:23,148][146667] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-12 06:09:27,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 56520704. Throughput: 0: 9287.4. Samples: 56512512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:27,720][146380] Avg episode reward: [(0, '4538.485')] [2023-03-12 06:09:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110392_56520704.pth... [2023-03-12 06:09:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000109872_56254464.pth [2023-03-12 06:09:27,790][146667] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-12 06:09:32,392][146667] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-12 06:09:32,719][146380] Fps is (10 sec: 8601.5, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 56565760. Throughput: 0: 9162.5. Samples: 56565760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:32,720][146380] Avg episode reward: [(0, '4557.902')] [2023-03-12 06:09:37,033][146667] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-12 06:09:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 56610816. Throughput: 0: 9067.1. Samples: 56591580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:37,720][146380] Avg episode reward: [(0, '4552.704')] [2023-03-12 06:09:41,559][146667] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-12 06:09:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 56655872. Throughput: 0: 8986.6. Samples: 56645832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:42,720][146380] Avg episode reward: [(0, '4522.294')] [2023-03-12 06:09:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110656_56655872.pth... [2023-03-12 06:09:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110136_56389632.pth [2023-03-12 06:09:46,172][146667] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-12 06:09:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9302.8). Total num frames: 56700928. Throughput: 0: 8986.5. Samples: 56699888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:47,720][146380] Avg episode reward: [(0, '4565.142')] [2023-03-12 06:09:50,716][146667] Updated weights for policy 0, policy_version 110800 (0.0005) [2023-03-12 06:09:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9302.8). Total num frames: 56745984. Throughput: 0: 8935.7. Samples: 56725732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:52,720][146380] Avg episode reward: [(0, '4552.834')] [2023-03-12 06:09:55,236][146667] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-12 06:09:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9302.8). Total num frames: 56791040. Throughput: 0: 8949.2. Samples: 56780056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:09:57,720][146380] Avg episode reward: [(0, '4553.712')] [2023-03-12 06:09:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110920_56791040.pth... [2023-03-12 06:09:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110392_56520704.pth [2023-03-12 06:09:59,925][146667] Updated weights for policy 0, policy_version 110960 (0.0004) [2023-03-12 06:10:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9316.7). Total num frames: 56836096. Throughput: 0: 8947.5. Samples: 56834308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:02,720][146380] Avg episode reward: [(0, '4489.989')] [2023-03-12 06:10:04,364][146667] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-12 06:10:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9316.7). Total num frames: 56881152. Throughput: 0: 8929.1. Samples: 56861092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:07,720][146380] Avg episode reward: [(0, '4552.765')] [2023-03-12 06:10:08,869][146667] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-12 06:10:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9316.7). Total num frames: 56926208. Throughput: 0: 8954.8. Samples: 56915480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:12,720][146380] Avg episode reward: [(0, '4499.149')] [2023-03-12 06:10:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111184_56926208.pth... [2023-03-12 06:10:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110656_56655872.pth [2023-03-12 06:10:13,531][146667] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-12 06:10:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9316.7). Total num frames: 56971264. Throughput: 0: 8945.3. Samples: 56968300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:17,730][146380] Avg episode reward: [(0, '4515.828')] [2023-03-12 06:10:18,117][146667] Updated weights for policy 0, policy_version 111280 (0.0003) [2023-03-12 06:10:22,719][146380] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 9302.8). Total num frames: 57012224. Throughput: 0: 8971.0. Samples: 56995272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:22,720][146380] Avg episode reward: [(0, '4542.054')] [2023-03-12 06:10:22,801][146667] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-12 06:10:27,373][146667] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-12 06:10:27,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9288.9). Total num frames: 57057280. Throughput: 0: 8949.7. Samples: 57048568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:27,720][146380] Avg episode reward: [(0, '4534.298')] [2023-03-12 06:10:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111440_57057280.pth... [2023-03-12 06:10:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000110920_56791040.pth [2023-03-12 06:10:32,045][146667] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-12 06:10:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9288.9). Total num frames: 57102336. Throughput: 0: 8914.0. Samples: 57101016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:32,720][146380] Avg episode reward: [(0, '4432.905')] [2023-03-12 06:10:36,733][146667] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-12 06:10:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9275.0). Total num frames: 57147392. Throughput: 0: 8916.5. Samples: 57126976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:37,720][146380] Avg episode reward: [(0, '4473.745')] [2023-03-12 06:10:41,359][146667] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-12 06:10:42,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9261.1). Total num frames: 57188352. Throughput: 0: 8891.4. Samples: 57180168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:42,720][146380] Avg episode reward: [(0, '4468.101')] [2023-03-12 06:10:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111696_57188352.pth... [2023-03-12 06:10:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111184_56926208.pth [2023-03-12 06:10:46,076][146667] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-12 06:10:47,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9261.1). Total num frames: 57233408. Throughput: 0: 8862.2. Samples: 57233108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:47,720][146380] Avg episode reward: [(0, '4522.370')] [2023-03-12 06:10:50,634][146667] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-12 06:10:52,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 9247.2). Total num frames: 57278464. Throughput: 0: 8852.3. Samples: 57259448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:52,720][146380] Avg episode reward: [(0, '4543.167')] [2023-03-12 06:10:55,242][146667] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-12 06:10:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 9247.2). Total num frames: 57323520. Throughput: 0: 8822.2. Samples: 57312480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:10:57,720][146380] Avg episode reward: [(0, '4498.151')] [2023-03-12 06:10:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111960_57323520.pth... [2023-03-12 06:10:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111440_57057280.pth [2023-03-12 06:10:59,833][146667] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-12 06:11:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9247.2). Total num frames: 57368576. Throughput: 0: 8866.7. Samples: 57367304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:11:02,720][146380] Avg episode reward: [(0, '4554.771')] [2023-03-12 06:11:04,312][146667] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-12 06:11:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9233.4). Total num frames: 57413632. Throughput: 0: 8855.6. Samples: 57393776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:11:07,720][146380] Avg episode reward: [(0, '4557.190')] [2023-03-12 06:11:08,872][146667] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-12 06:11:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9233.4). Total num frames: 57458688. Throughput: 0: 8875.4. Samples: 57447960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:11:12,720][146380] Avg episode reward: [(0, '4564.273')] [2023-03-12 06:11:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112224_57458688.pth... [2023-03-12 06:11:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111696_57188352.pth [2023-03-12 06:11:13,439][146667] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-12 06:11:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9219.5). Total num frames: 57503744. Throughput: 0: 8925.0. Samples: 57502640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:11:17,720][146380] Avg episode reward: [(0, '4565.804')] [2023-03-12 06:11:17,937][146667] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-12 06:11:22,264][146667] Updated weights for policy 0, policy_version 112400 (0.0004) [2023-03-12 06:11:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 57552896. Throughput: 0: 8966.8. Samples: 57530480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:22,720][146380] Avg episode reward: [(0, '4571.880')] [2023-03-12 06:11:26,548][146667] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-12 06:11:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 57597952. Throughput: 0: 9063.5. Samples: 57588028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:27,720][146380] Avg episode reward: [(0, '4547.220')] [2023-03-12 06:11:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112496_57597952.pth... [2023-03-12 06:11:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000111960_57323520.pth [2023-03-12 06:11:30,825][146667] Updated weights for policy 0, policy_version 112560 (0.0004) [2023-03-12 06:11:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9247.2). Total num frames: 57647104. Throughput: 0: 9161.9. Samples: 57645392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:32,720][146380] Avg episode reward: [(0, '4572.350')] [2023-03-12 06:11:35,132][146667] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-12 06:11:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 57696256. Throughput: 0: 9206.6. Samples: 57673744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:37,720][146380] Avg episode reward: [(0, '4581.784')] [2023-03-12 06:11:39,337][146667] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-12 06:11:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 57745408. Throughput: 0: 9335.8. Samples: 57732592. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:42,720][146380] Avg episode reward: [(0, '4577.910')] [2023-03-12 06:11:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112784_57745408.pth... [2023-03-12 06:11:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112224_57458688.pth [2023-03-12 06:11:43,531][146667] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-12 06:11:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 57790464. Throughput: 0: 9397.6. Samples: 57790196. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:47,720][146380] Avg episode reward: [(0, '4572.602')] [2023-03-12 06:11:47,796][146667] Updated weights for policy 0, policy_version 112880 (0.0004) [2023-03-12 06:11:52,024][146667] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-12 06:11:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 57839616. Throughput: 0: 9454.0. Samples: 57819208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:52,720][146380] Avg episode reward: [(0, '4568.206')] [2023-03-12 06:11:56,133][146667] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-12 06:11:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 57888768. Throughput: 0: 9568.5. Samples: 57878544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:11:57,720][146380] Avg episode reward: [(0, '4569.190')] [2023-03-12 06:11:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113064_57888768.pth... [2023-03-12 06:11:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112496_57597952.pth [2023-03-12 06:12:00,300][146667] Updated weights for policy 0, policy_version 113120 (0.0004) [2023-03-12 06:12:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 57937920. Throughput: 0: 9622.9. Samples: 57935672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:12:02,720][146380] Avg episode reward: [(0, '4570.199')] [2023-03-12 06:12:04,868][146667] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-12 06:12:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9275.0). Total num frames: 57982976. Throughput: 0: 9601.8. Samples: 57962560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:12:07,720][146380] Avg episode reward: [(0, '4544.273')] [2023-03-12 06:12:09,399][146667] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-12 06:12:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9275.0). Total num frames: 58028032. Throughput: 0: 9517.5. Samples: 58016316. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:12:12,720][146380] Avg episode reward: [(0, '4519.209')] [2023-03-12 06:12:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113336_58028032.pth... [2023-03-12 06:12:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000112784_57745408.pth [2023-03-12 06:12:14,005][146667] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-12 06:12:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9275.0). Total num frames: 58073088. Throughput: 0: 9448.4. Samples: 58070572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:12:17,720][146380] Avg episode reward: [(0, '4519.024')] [2023-03-12 06:12:18,523][146667] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-12 06:12:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 58118144. Throughput: 0: 9421.9. Samples: 58097728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:12:22,720][146380] Avg episode reward: [(0, '4397.425')] [2023-03-12 06:12:23,052][146667] Updated weights for policy 0, policy_version 113520 (0.0005) [2023-03-12 06:12:27,529][146667] Updated weights for policy 0, policy_version 113600 (0.0005) [2023-03-12 06:12:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 58163200. Throughput: 0: 9315.4. Samples: 58151784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:27,720][146380] Avg episode reward: [(0, '4372.230')] [2023-03-12 06:12:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113600_58163200.pth... [2023-03-12 06:12:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113064_57888768.pth [2023-03-12 06:12:32,030][146667] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-12 06:12:32,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 58208256. Throughput: 0: 9273.8. Samples: 58207516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:32,720][146380] Avg episode reward: [(0, '4528.413')] [2023-03-12 06:12:36,433][146667] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-12 06:12:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 58253312. Throughput: 0: 9252.6. Samples: 58235576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:37,720][146380] Avg episode reward: [(0, '4525.640')] [2023-03-12 06:12:40,960][146667] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-12 06:12:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 58298368. Throughput: 0: 9142.8. Samples: 58289972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:42,720][146380] Avg episode reward: [(0, '4333.814')] [2023-03-12 06:12:42,760][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113872_58302464.pth... [2023-03-12 06:12:42,761][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113336_58028032.pth [2023-03-12 06:12:45,430][146667] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-12 06:12:47,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9247.2). Total num frames: 58347520. Throughput: 0: 9083.6. Samples: 58344436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:47,720][146380] Avg episode reward: [(0, '4533.839')] [2023-03-12 06:12:49,869][146667] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-12 06:12:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 58392576. Throughput: 0: 9102.2. Samples: 58372160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:52,720][146380] Avg episode reward: [(0, '4536.044')] [2023-03-12 06:12:54,288][146667] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-12 06:12:57,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 58437632. Throughput: 0: 9153.8. Samples: 58428236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:12:57,720][146380] Avg episode reward: [(0, '4538.312')] [2023-03-12 06:12:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114136_58437632.pth... [2023-03-12 06:12:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113600_58163200.pth [2023-03-12 06:12:58,711][146667] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-12 06:13:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 58486784. Throughput: 0: 9201.6. Samples: 58484644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:02,720][146380] Avg episode reward: [(0, '4530.461')] [2023-03-12 06:13:03,000][146667] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-12 06:13:07,405][146667] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-12 06:13:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 58531840. Throughput: 0: 9206.6. Samples: 58512024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:07,720][146380] Avg episode reward: [(0, '4573.772')] [2023-03-12 06:13:11,813][146667] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-12 06:13:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 58580992. Throughput: 0: 9265.2. Samples: 58568720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:12,720][146380] Avg episode reward: [(0, '4579.889')] [2023-03-12 06:13:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114416_58580992.pth... [2023-03-12 06:13:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000113872_58302464.pth [2023-03-12 06:13:16,192][146667] Updated weights for policy 0, policy_version 114480 (0.0005) [2023-03-12 06:13:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 58626048. Throughput: 0: 9276.2. Samples: 58624944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:17,720][146380] Avg episode reward: [(0, '4565.529')] [2023-03-12 06:13:20,369][146667] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-12 06:13:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 58675200. Throughput: 0: 9313.9. Samples: 58654700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:22,720][146380] Avg episode reward: [(0, '4532.628')] [2023-03-12 06:13:24,622][146667] Updated weights for policy 0, policy_version 114640 (0.0004) [2023-03-12 06:13:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 58720256. Throughput: 0: 9377.3. Samples: 58711948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:27,720][146380] Avg episode reward: [(0, '4518.660')] [2023-03-12 06:13:27,773][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114696_58724352.pth... [2023-03-12 06:13:27,774][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114136_58437632.pth [2023-03-12 06:13:29,179][146667] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-12 06:13:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9191.7). Total num frames: 58769408. Throughput: 0: 9365.3. Samples: 58765872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:32,720][146380] Avg episode reward: [(0, '4528.392')] [2023-03-12 06:13:33,466][146667] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-12 06:13:37,560][146667] Updated weights for policy 0, policy_version 114880 (0.0004) [2023-03-12 06:13:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 58818560. Throughput: 0: 9425.9. Samples: 58796324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:37,720][146380] Avg episode reward: [(0, '4566.708')] [2023-03-12 06:13:41,675][146667] Updated weights for policy 0, policy_version 114960 (0.0004) [2023-03-12 06:13:42,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9191.7). Total num frames: 58867712. Throughput: 0: 9505.0. Samples: 58855960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:42,720][146380] Avg episode reward: [(0, '4583.394')] [2023-03-12 06:13:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114976_58867712.pth... [2023-03-12 06:13:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114416_58580992.pth [2023-03-12 06:13:45,657][146667] Updated weights for policy 0, policy_version 115040 (0.0004) [2023-03-12 06:13:47,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9191.7). Total num frames: 58916864. Throughput: 0: 9606.3. Samples: 58916928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:47,720][146380] Avg episode reward: [(0, '4538.706')] [2023-03-12 06:13:49,777][146667] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-12 06:13:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9625.6, 300 sec: 9219.5). Total num frames: 58970112. Throughput: 0: 9668.1. Samples: 58947088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:52,720][146380] Avg episode reward: [(0, '4541.895')] [2023-03-12 06:13:53,812][146667] Updated weights for policy 0, policy_version 115200 (0.0003) [2023-03-12 06:13:57,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9693.9, 300 sec: 9233.4). Total num frames: 59019264. Throughput: 0: 9759.2. Samples: 59007884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:13:57,720][146380] Avg episode reward: [(0, '4470.385')] [2023-03-12 06:13:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115272_59019264.pth... [2023-03-12 06:13:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114696_58724352.pth [2023-03-12 06:13:57,820][146667] Updated weights for policy 0, policy_version 115280 (0.0004) [2023-03-12 06:14:01,871][146667] Updated weights for policy 0, policy_version 115360 (0.0004) [2023-03-12 06:14:02,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9261.1). Total num frames: 59072512. Throughput: 0: 9858.4. Samples: 59068572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:02,720][146380] Avg episode reward: [(0, '4468.492')] [2023-03-12 06:14:05,878][146667] Updated weights for policy 0, policy_version 115440 (0.0004) [2023-03-12 06:14:07,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9275.0). Total num frames: 59121664. Throughput: 0: 9894.0. Samples: 59099928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:07,720][146380] Avg episode reward: [(0, '4538.057')] [2023-03-12 06:14:09,930][146667] Updated weights for policy 0, policy_version 115520 (0.0004) [2023-03-12 06:14:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9275.0). Total num frames: 59170816. Throughput: 0: 9953.2. Samples: 59159844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:12,720][146380] Avg episode reward: [(0, '4520.806')] [2023-03-12 06:14:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115568_59170816.pth... [2023-03-12 06:14:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000114976_58867712.pth [2023-03-12 06:14:13,990][146667] Updated weights for policy 0, policy_version 115600 (0.0004) [2023-03-12 06:14:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9302.8). Total num frames: 59224064. Throughput: 0: 10108.5. Samples: 59220756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:17,720][146380] Avg episode reward: [(0, '4549.722')] [2023-03-12 06:14:18,044][146667] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-12 06:14:22,132][146667] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-12 06:14:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9330.5). Total num frames: 59273216. Throughput: 0: 10103.9. Samples: 59251000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:22,720][146380] Avg episode reward: [(0, '4532.248')] [2023-03-12 06:14:26,157][146667] Updated weights for policy 0, policy_version 115840 (0.0004) [2023-03-12 06:14:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9344.4). Total num frames: 59322368. Throughput: 0: 10126.9. Samples: 59311672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:27,720][146380] Avg episode reward: [(0, '4548.975')] [2023-03-12 06:14:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115864_59322368.pth... [2023-03-12 06:14:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115272_59019264.pth [2023-03-12 06:14:30,169][146667] Updated weights for policy 0, policy_version 115920 (0.0004) [2023-03-12 06:14:32,719][146380] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9372.2). Total num frames: 59375616. Throughput: 0: 10129.3. Samples: 59372748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:32,720][146380] Avg episode reward: [(0, '4499.566')] [2023-03-12 06:14:34,162][146667] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-12 06:14:37,719][146380] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9386.1). Total num frames: 59424768. Throughput: 0: 10161.4. Samples: 59404352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:37,720][146380] Avg episode reward: [(0, '4539.034')] [2023-03-12 06:14:38,224][146667] Updated weights for policy 0, policy_version 116080 (0.0003) [2023-03-12 06:14:42,464][146667] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-12 06:14:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9400.0). Total num frames: 59473920. Throughput: 0: 10124.3. Samples: 59463480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:42,720][146380] Avg episode reward: [(0, '4584.454')] [2023-03-12 06:14:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116160_59473920.pth... [2023-03-12 06:14:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115568_59170816.pth [2023-03-12 06:14:46,870][146667] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-12 06:14:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9400.0). Total num frames: 59518976. Throughput: 0: 10010.6. Samples: 59519048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:47,720][146380] Avg episode reward: [(0, '4569.782')] [2023-03-12 06:14:51,226][146667] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-12 06:14:52,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9413.9). Total num frames: 59568128. Throughput: 0: 9949.7. Samples: 59547664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:52,720][146380] Avg episode reward: [(0, '4530.951')] [2023-03-12 06:14:55,598][146667] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-12 06:14:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9413.9). Total num frames: 59613184. Throughput: 0: 9873.0. Samples: 59604128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:14:57,720][146380] Avg episode reward: [(0, '4557.289')] [2023-03-12 06:14:57,783][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116440_59617280.pth... [2023-03-12 06:14:57,785][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000115864_59322368.pth [2023-03-12 06:14:59,996][146667] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-12 06:15:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9427.7). Total num frames: 59662336. Throughput: 0: 9751.5. Samples: 59659572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:15:02,720][146380] Avg episode reward: [(0, '4564.548')] [2023-03-12 06:15:04,338][146667] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-12 06:15:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 59707392. Throughput: 0: 9706.7. Samples: 59687804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:15:07,720][146380] Avg episode reward: [(0, '4583.392')] [2023-03-12 06:15:08,758][146667] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-12 06:15:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9441.6). Total num frames: 59756544. Throughput: 0: 9614.4. Samples: 59744320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:15:12,720][146380] Avg episode reward: [(0, '4581.485')] [2023-03-12 06:15:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116712_59756544.pth... [2023-03-12 06:15:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116160_59473920.pth [2023-03-12 06:15:13,054][146667] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-12 06:15:17,406][146667] Updated weights for policy 0, policy_version 116800 (0.0004) [2023-03-12 06:15:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 59801600. Throughput: 0: 9523.4. Samples: 59801300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:15:17,720][146380] Avg episode reward: [(0, '4496.245')] [2023-03-12 06:15:21,826][146667] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-12 06:15:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 59850752. Throughput: 0: 9431.6. Samples: 59828776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:15:22,720][146380] Avg episode reward: [(0, '4070.343')] [2023-03-12 06:15:26,245][146667] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-12 06:15:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 59895808. Throughput: 0: 9349.7. Samples: 59884216. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:27,720][146380] Avg episode reward: [(0, '4210.161')] [2023-03-12 06:15:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116984_59895808.pth... [2023-03-12 06:15:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116440_59617280.pth [2023-03-12 06:15:30,601][146667] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-12 06:15:32,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 59940864. Throughput: 0: 9375.1. Samples: 59940928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:32,720][146380] Avg episode reward: [(0, '4522.498')] [2023-03-12 06:15:34,919][146667] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-12 06:15:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 59990016. Throughput: 0: 9375.2. Samples: 59969548. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:37,720][146380] Avg episode reward: [(0, '4528.277')] [2023-03-12 06:15:39,266][146667] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-12 06:15:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 60035072. Throughput: 0: 9388.2. Samples: 60026596. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:42,720][146380] Avg episode reward: [(0, '4570.567')] [2023-03-12 06:15:42,752][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117264_60039168.pth... [2023-03-12 06:15:42,754][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116712_59756544.pth [2023-03-12 06:15:43,612][146667] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-12 06:15:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 60084224. Throughput: 0: 9391.9. Samples: 60082208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:47,720][146380] Avg episode reward: [(0, '4568.648')] [2023-03-12 06:15:47,981][146667] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-12 06:15:52,345][146667] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-12 06:15:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 60129280. Throughput: 0: 9390.5. Samples: 60110376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:52,720][146380] Avg episode reward: [(0, '4579.385')] [2023-03-12 06:15:56,709][146667] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-12 06:15:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 60178432. Throughput: 0: 9387.6. Samples: 60166760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:15:57,720][146380] Avg episode reward: [(0, '4573.548')] [2023-03-12 06:15:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117536_60178432.pth... [2023-03-12 06:15:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000116984_59895808.pth [2023-03-12 06:16:01,165][146667] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-12 06:16:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 60223488. Throughput: 0: 9336.3. Samples: 60221432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:02,720][146380] Avg episode reward: [(0, '4479.442')] [2023-03-12 06:16:05,670][146667] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-12 06:16:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 60268544. Throughput: 0: 9334.9. Samples: 60248844. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:07,720][146380] Avg episode reward: [(0, '4455.207')] [2023-03-12 06:16:10,073][146667] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-12 06:16:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 60313600. Throughput: 0: 9357.2. Samples: 60305288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:12,720][146380] Avg episode reward: [(0, '4556.766')] [2023-03-12 06:16:12,750][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117808_60317696.pth... [2023-03-12 06:16:12,752][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117264_60039168.pth [2023-03-12 06:16:14,512][146667] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-12 06:16:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 60362752. Throughput: 0: 9301.1. Samples: 60359480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:17,720][146380] Avg episode reward: [(0, '4533.358')] [2023-03-12 06:16:19,009][146667] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-12 06:16:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 60407808. Throughput: 0: 9284.0. Samples: 60387328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:22,720][146380] Avg episode reward: [(0, '4517.246')] [2023-03-12 06:16:23,437][146667] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-12 06:16:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 60452864. Throughput: 0: 9272.2. Samples: 60443844. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:16:27,720][146380] Avg episode reward: [(0, '4483.389')] [2023-03-12 06:16:27,752][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118080_60456960.pth... [2023-03-12 06:16:27,752][146667] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-12 06:16:27,753][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117536_60178432.pth [2023-03-12 06:16:32,133][146667] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-12 06:16:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 60502016. Throughput: 0: 9278.5. Samples: 60499740. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:32,720][146380] Avg episode reward: [(0, '4282.783')] [2023-03-12 06:16:36,534][146667] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-12 06:16:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 60547072. Throughput: 0: 9268.7. Samples: 60527468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:37,720][146380] Avg episode reward: [(0, '4491.865')] [2023-03-12 06:16:40,861][146667] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-12 06:16:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 60596224. Throughput: 0: 9272.0. Samples: 60584000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:42,720][146380] Avg episode reward: [(0, '4572.514')] [2023-03-12 06:16:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118352_60596224.pth... [2023-03-12 06:16:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000117808_60317696.pth [2023-03-12 06:16:45,032][146667] Updated weights for policy 0, policy_version 118400 (0.0003) [2023-03-12 06:16:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 60645376. Throughput: 0: 9374.8. Samples: 60643296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:47,720][146380] Avg episode reward: [(0, '4556.030')] [2023-03-12 06:16:49,139][146667] Updated weights for policy 0, policy_version 118480 (0.0004) [2023-03-12 06:16:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 60694528. Throughput: 0: 9445.5. Samples: 60673892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:52,720][146380] Avg episode reward: [(0, '4573.872')] [2023-03-12 06:16:53,372][146667] Updated weights for policy 0, policy_version 118560 (0.0004) [2023-03-12 06:16:57,712][146667] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-12 06:16:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 60743680. Throughput: 0: 9469.2. Samples: 60731400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:16:57,722][146380] Avg episode reward: [(0, '4542.472')] [2023-03-12 06:16:57,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118640_60743680.pth... [2023-03-12 06:16:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118080_60456960.pth [2023-03-12 06:17:01,993][146667] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-12 06:17:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9511.0). Total num frames: 60788736. Throughput: 0: 9526.7. Samples: 60788180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:02,720][146380] Avg episode reward: [(0, '4570.889')] [2023-03-12 06:17:06,332][146667] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-12 06:17:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 60837888. Throughput: 0: 9538.2. Samples: 60816548. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:07,720][146380] Avg episode reward: [(0, '4565.502')] [2023-03-12 06:17:10,717][146667] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-12 06:17:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 60882944. Throughput: 0: 9516.2. Samples: 60872072. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:12,720][146380] Avg episode reward: [(0, '4565.334')] [2023-03-12 06:17:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118912_60882944.pth... [2023-03-12 06:17:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118352_60596224.pth [2023-03-12 06:17:15,125][146667] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-12 06:17:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 60932096. Throughput: 0: 9545.9. Samples: 60929304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:17,720][146380] Avg episode reward: [(0, '4519.724')] [2023-03-12 06:17:19,320][146667] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-12 06:17:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 60981248. Throughput: 0: 9582.6. Samples: 60958684. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:22,720][146380] Avg episode reward: [(0, '4570.012')] [2023-03-12 06:17:23,608][146667] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-12 06:17:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 61026304. Throughput: 0: 9593.3. Samples: 61015700. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:17:27,723][146380] Avg episode reward: [(0, '4565.952')] [2023-03-12 06:17:27,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119192_61026304.pth... [2023-03-12 06:17:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118640_60743680.pth [2023-03-12 06:17:27,804][146667] Updated weights for policy 0, policy_version 119200 (0.0004) [2023-03-12 06:17:32,208][146667] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-12 06:17:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 61075456. Throughput: 0: 9532.4. Samples: 61072252. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:32,720][146380] Avg episode reward: [(0, '4499.079')] [2023-03-12 06:17:36,576][146667] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-12 06:17:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 61120512. Throughput: 0: 9485.0. Samples: 61100716. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:37,720][146380] Avg episode reward: [(0, '4543.877')] [2023-03-12 06:17:40,860][146667] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-12 06:17:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 61169664. Throughput: 0: 9467.7. Samples: 61157448. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:42,720][146380] Avg episode reward: [(0, '4336.639')] [2023-03-12 06:17:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119472_61169664.pth... [2023-03-12 06:17:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000118912_60882944.pth [2023-03-12 06:17:45,128][146667] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-12 06:17:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 61218816. Throughput: 0: 9490.9. Samples: 61215272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:47,720][146380] Avg episode reward: [(0, '4237.650')] [2023-03-12 06:17:49,336][146667] Updated weights for policy 0, policy_version 119600 (0.0004) [2023-03-12 06:17:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 61267968. Throughput: 0: 9508.6. Samples: 61244436. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:52,720][146380] Avg episode reward: [(0, '4524.222')] [2023-03-12 06:17:53,527][146667] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-12 06:17:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 61313024. Throughput: 0: 9573.9. Samples: 61302896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:17:57,720][146380] Avg episode reward: [(0, '4543.128')] [2023-03-12 06:17:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119752_61313024.pth... [2023-03-12 06:17:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119192_61026304.pth [2023-03-12 06:17:57,832][146667] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-12 06:18:02,180][146667] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-12 06:18:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 61362176. Throughput: 0: 9561.7. Samples: 61359580. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:02,720][146380] Avg episode reward: [(0, '4568.039')] [2023-03-12 06:18:06,557][146667] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-12 06:18:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 61407232. Throughput: 0: 9529.1. Samples: 61387496. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:07,720][146380] Avg episode reward: [(0, '4570.514')] [2023-03-12 06:18:10,844][146667] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-12 06:18:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 61456384. Throughput: 0: 9521.5. Samples: 61444168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:12,720][146380] Avg episode reward: [(0, '4574.371')] [2023-03-12 06:18:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120032_61456384.pth... [2023-03-12 06:18:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119472_61169664.pth [2023-03-12 06:18:15,225][146667] Updated weights for policy 0, policy_version 120080 (0.0005) [2023-03-12 06:18:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 61501440. Throughput: 0: 9535.9. Samples: 61501368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:17,720][146380] Avg episode reward: [(0, '4522.006')] [2023-03-12 06:18:19,544][146667] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-12 06:18:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 61550592. Throughput: 0: 9531.3. Samples: 61529624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:22,720][146380] Avg episode reward: [(0, '4523.580')] [2023-03-12 06:18:23,877][146667] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-12 06:18:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 61595648. Throughput: 0: 9506.4. Samples: 61585236. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:18:27,720][146380] Avg episode reward: [(0, '4570.156')] [2023-03-12 06:18:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120304_61595648.pth... [2023-03-12 06:18:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000119752_61313024.pth [2023-03-12 06:18:28,352][146667] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-12 06:18:32,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 61640704. Throughput: 0: 9461.2. Samples: 61641024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:32,720][146380] Avg episode reward: [(0, '4485.523')] [2023-03-12 06:18:32,724][146667] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-12 06:18:37,037][146667] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-12 06:18:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 61689856. Throughput: 0: 9444.5. Samples: 61669440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:37,720][146380] Avg episode reward: [(0, '4573.760')] [2023-03-12 06:18:41,391][146667] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-12 06:18:42,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 61739008. Throughput: 0: 9414.2. Samples: 61726536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:42,720][146380] Avg episode reward: [(0, '4580.998')] [2023-03-12 06:18:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120584_61739008.pth... [2023-03-12 06:18:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120032_61456384.pth [2023-03-12 06:18:45,787][146667] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-12 06:18:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 61784064. Throughput: 0: 9406.2. Samples: 61782860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:47,720][146380] Avg episode reward: [(0, '4567.967')] [2023-03-12 06:18:50,092][146667] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-12 06:18:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 61833216. Throughput: 0: 9417.2. Samples: 61811272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:52,720][146380] Avg episode reward: [(0, '4553.421')] [2023-03-12 06:18:54,411][146667] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-12 06:18:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9511.0). Total num frames: 61878272. Throughput: 0: 9409.7. Samples: 61867604. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:18:57,720][146380] Avg episode reward: [(0, '4561.440')] [2023-03-12 06:18:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120856_61878272.pth... [2023-03-12 06:18:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120304_61595648.pth [2023-03-12 06:18:58,720][146667] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-12 06:19:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9511.0). Total num frames: 61927424. Throughput: 0: 9399.1. Samples: 61924328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:02,720][146380] Avg episode reward: [(0, '4562.195')] [2023-03-12 06:19:03,112][146667] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-12 06:19:07,426][146667] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-12 06:19:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 61972480. Throughput: 0: 9394.2. Samples: 61952364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:07,720][146380] Avg episode reward: [(0, '4565.099')] [2023-03-12 06:19:11,731][146667] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-12 06:19:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 62021632. Throughput: 0: 9426.2. Samples: 62009416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:12,720][146380] Avg episode reward: [(0, '4578.856')] [2023-03-12 06:19:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121136_62021632.pth... [2023-03-12 06:19:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120584_61739008.pth [2023-03-12 06:19:16,092][146667] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-12 06:19:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 62066688. Throughput: 0: 9455.9. Samples: 62066540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:17,720][146380] Avg episode reward: [(0, '4579.095')] [2023-03-12 06:19:20,421][146667] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-12 06:19:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 62115840. Throughput: 0: 9453.2. Samples: 62094836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:22,720][146380] Avg episode reward: [(0, '4590.916')] [2023-03-12 06:19:24,880][146667] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-12 06:19:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 62160896. Throughput: 0: 9400.3. Samples: 62149548. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:27,720][146380] Avg episode reward: [(0, '4542.611')] [2023-03-12 06:19:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121408_62160896.pth... [2023-03-12 06:19:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000120856_61878272.pth [2023-03-12 06:19:29,328][146667] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-12 06:19:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 62205952. Throughput: 0: 9395.6. Samples: 62205664. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:19:32,720][146380] Avg episode reward: [(0, '4535.974')] [2023-03-12 06:19:33,808][146667] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-12 06:19:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 62251008. Throughput: 0: 9355.5. Samples: 62232272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:19:37,720][146380] Avg episode reward: [(0, '4412.893')] [2023-03-12 06:19:38,301][146667] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-12 06:19:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 62296064. Throughput: 0: 9323.1. Samples: 62287144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:19:42,720][146380] Avg episode reward: [(0, '4381.179')] [2023-03-12 06:19:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121672_62296064.pth... [2023-03-12 06:19:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121136_62021632.pth [2023-03-12 06:19:42,795][146667] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-12 06:19:47,061][146667] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-12 06:19:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 62345216. Throughput: 0: 9321.8. Samples: 62343808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:19:47,720][146380] Avg episode reward: [(0, '4423.994')] [2023-03-12 06:19:51,298][146667] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-12 06:19:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 62394368. Throughput: 0: 9343.9. Samples: 62372840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:19:52,720][146380] Avg episode reward: [(0, '4398.565')] [2023-03-12 06:19:55,537][146667] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-12 06:19:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9413.9). Total num frames: 62439424. Throughput: 0: 9369.1. Samples: 62431024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:19:57,720][146380] Avg episode reward: [(0, '4456.361')] [2023-03-12 06:19:57,733][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121960_62443520.pth... [2023-03-12 06:19:57,734][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121408_62160896.pth [2023-03-12 06:19:59,935][146667] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-12 06:20:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 62488576. Throughput: 0: 9332.0. Samples: 62486480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:02,720][146380] Avg episode reward: [(0, '4376.144')] [2023-03-12 06:20:04,393][146667] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-12 06:20:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 62533632. Throughput: 0: 9312.0. Samples: 62513876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:07,720][146380] Avg episode reward: [(0, '4453.798')] [2023-03-12 06:20:08,696][146667] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-12 06:20:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 62582784. Throughput: 0: 9359.4. Samples: 62570720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:12,720][146380] Avg episode reward: [(0, '4426.372')] [2023-03-12 06:20:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122232_62582784.pth... [2023-03-12 06:20:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121672_62296064.pth [2023-03-12 06:20:13,065][146667] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-12 06:20:17,452][146667] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-12 06:20:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 62627840. Throughput: 0: 9371.4. Samples: 62627376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:17,720][146380] Avg episode reward: [(0, '4465.554')] [2023-03-12 06:20:21,728][146667] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-12 06:20:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 62676992. Throughput: 0: 9416.7. Samples: 62656024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:22,720][146380] Avg episode reward: [(0, '4541.829')] [2023-03-12 06:20:26,060][146667] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-12 06:20:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 62722048. Throughput: 0: 9451.9. Samples: 62712480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:27,720][146380] Avg episode reward: [(0, '4547.542')] [2023-03-12 06:20:27,736][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122512_62726144.pth... [2023-03-12 06:20:27,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000121960_62443520.pth [2023-03-12 06:20:30,298][146667] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-12 06:20:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 62771200. Throughput: 0: 9477.1. Samples: 62770276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:32,720][146380] Avg episode reward: [(0, '4501.242')] [2023-03-12 06:20:34,551][146667] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-12 06:20:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 62820352. Throughput: 0: 9485.1. Samples: 62799668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:37,720][146380] Avg episode reward: [(0, '4546.445')] [2023-03-12 06:20:38,657][146667] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-12 06:20:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 62869504. Throughput: 0: 9521.1. Samples: 62859476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:42,720][146380] Avg episode reward: [(0, '4583.349')] [2023-03-12 06:20:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122792_62869504.pth... [2023-03-12 06:20:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122232_62582784.pth [2023-03-12 06:20:42,920][146667] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-12 06:20:47,053][146667] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-12 06:20:47,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 62918656. Throughput: 0: 9575.5. Samples: 62917380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:47,720][146380] Avg episode reward: [(0, '4575.672')] [2023-03-12 06:20:51,123][146667] Updated weights for policy 0, policy_version 122960 (0.0004) [2023-03-12 06:20:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 62967808. Throughput: 0: 9633.9. Samples: 62947400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:52,720][146380] Avg episode reward: [(0, '4558.452')] [2023-03-12 06:20:55,394][146667] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-12 06:20:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 63016960. Throughput: 0: 9646.9. Samples: 63004832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:20:57,720][146380] Avg episode reward: [(0, '4535.953')] [2023-03-12 06:20:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123080_63016960.pth... [2023-03-12 06:20:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122512_62726144.pth [2023-03-12 06:20:59,744][146667] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-12 06:21:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 63062016. Throughput: 0: 9660.1. Samples: 63062080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:02,720][146380] Avg episode reward: [(0, '4564.806')] [2023-03-12 06:21:04,072][146667] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-12 06:21:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 63111168. Throughput: 0: 9659.4. Samples: 63090696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:07,720][146380] Avg episode reward: [(0, '4565.515')] [2023-03-12 06:21:08,337][146667] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-12 06:21:12,579][146667] Updated weights for policy 0, policy_version 123360 (0.0004) [2023-03-12 06:21:12,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 63160320. Throughput: 0: 9700.4. Samples: 63149000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:12,720][146380] Avg episode reward: [(0, '4554.079')] [2023-03-12 06:21:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123360_63160320.pth... [2023-03-12 06:21:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000122792_62869504.pth [2023-03-12 06:21:17,022][146667] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-12 06:21:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 63205376. Throughput: 0: 9648.6. Samples: 63204464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:17,720][146380] Avg episode reward: [(0, '4522.881')] [2023-03-12 06:21:21,214][146667] Updated weights for policy 0, policy_version 123520 (0.0004) [2023-03-12 06:21:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 63254528. Throughput: 0: 9654.3. Samples: 63234112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:22,720][146380] Avg episode reward: [(0, '4515.830')] [2023-03-12 06:21:25,401][146667] Updated weights for policy 0, policy_version 123600 (0.0003) [2023-03-12 06:21:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9497.2). Total num frames: 63303680. Throughput: 0: 9610.0. Samples: 63291928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:27,720][146380] Avg episode reward: [(0, '4554.182')] [2023-03-12 06:21:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123640_63303680.pth... [2023-03-12 06:21:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123080_63016960.pth [2023-03-12 06:21:29,605][146667] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-12 06:21:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 63352832. Throughput: 0: 9636.2. Samples: 63351008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:21:32,720][146380] Avg episode reward: [(0, '4555.481')] [2023-03-12 06:21:33,781][146667] Updated weights for policy 0, policy_version 123760 (0.0004) [2023-03-12 06:21:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 63401984. Throughput: 0: 9630.2. Samples: 63380760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:21:37,720][146380] Avg episode reward: [(0, '4564.266')] [2023-03-12 06:21:38,044][146667] Updated weights for policy 0, policy_version 123840 (0.0004) [2023-03-12 06:21:42,340][146667] Updated weights for policy 0, policy_version 123920 (0.0003) [2023-03-12 06:21:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 63447040. Throughput: 0: 9606.8. Samples: 63437140. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:21:42,720][146380] Avg episode reward: [(0, '4501.405')] [2023-03-12 06:21:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123920_63447040.pth... [2023-03-12 06:21:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123360_63160320.pth [2023-03-12 06:21:46,624][146667] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-12 06:21:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 63496192. Throughput: 0: 9625.4. Samples: 63495224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:21:47,720][146380] Avg episode reward: [(0, '4511.683')] [2023-03-12 06:21:50,725][146667] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-12 06:21:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 63545344. Throughput: 0: 9649.6. Samples: 63524928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:21:52,720][146380] Avg episode reward: [(0, '4439.740')] [2023-03-12 06:21:55,061][146667] Updated weights for policy 0, policy_version 124160 (0.0005) [2023-03-12 06:21:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 63594496. Throughput: 0: 9627.1. Samples: 63582220. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:21:57,720][146380] Avg episode reward: [(0, '4493.016')] [2023-03-12 06:21:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124208_63594496.pth... [2023-03-12 06:21:57,730][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123640_63303680.pth [2023-03-12 06:21:59,288][146667] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-12 06:22:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 63643648. Throughput: 0: 9707.3. Samples: 63641292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:02,720][146380] Avg episode reward: [(0, '4505.553')] [2023-03-12 06:22:03,408][146667] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-12 06:22:07,589][146667] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-12 06:22:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 63692800. Throughput: 0: 9721.2. Samples: 63671568. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:07,720][146380] Avg episode reward: [(0, '4578.268')] [2023-03-12 06:22:12,072][146667] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-12 06:22:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 63737856. Throughput: 0: 9663.0. Samples: 63726764. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:12,720][146380] Avg episode reward: [(0, '4548.516')] [2023-03-12 06:22:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124488_63737856.pth... [2023-03-12 06:22:12,737][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000123920_63447040.pth [2023-03-12 06:22:16,404][146667] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-12 06:22:17,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 63787008. Throughput: 0: 9617.3. Samples: 63783788. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:17,720][146380] Avg episode reward: [(0, '4482.069')] [2023-03-12 06:22:20,555][146667] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-12 06:22:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 63836160. Throughput: 0: 9621.9. Samples: 63813744. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:22,720][146380] Avg episode reward: [(0, '4489.430')] [2023-03-12 06:22:24,834][146667] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-12 06:22:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 63885312. Throughput: 0: 9660.3. Samples: 63871856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:27,720][146380] Avg episode reward: [(0, '4500.939')] [2023-03-12 06:22:27,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124776_63885312.pth... [2023-03-12 06:22:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124208_63594496.pth [2023-03-12 06:22:28,975][146667] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-12 06:22:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 63934464. Throughput: 0: 9692.4. Samples: 63931380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:32,720][146380] Avg episode reward: [(0, '4534.306')] [2023-03-12 06:22:33,036][146667] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-12 06:22:37,193][146667] Updated weights for policy 0, policy_version 124960 (0.0003) [2023-03-12 06:22:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 63983616. Throughput: 0: 9699.5. Samples: 63961408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:22:37,720][146380] Avg episode reward: [(0, '4566.128')] [2023-03-12 06:22:41,337][146667] Updated weights for policy 0, policy_version 125040 (0.0004) [2023-03-12 06:22:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9538.8). Total num frames: 64032768. Throughput: 0: 9739.3. Samples: 64020488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:22:42,720][146380] Avg episode reward: [(0, '4569.022')] [2023-03-12 06:22:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125064_64032768.pth... [2023-03-12 06:22:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124488_63737856.pth [2023-03-12 06:22:45,378][146667] Updated weights for policy 0, policy_version 125120 (0.0003) [2023-03-12 06:22:47,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9538.8). Total num frames: 64081920. Throughput: 0: 9768.4. Samples: 64080868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:22:47,720][146380] Avg episode reward: [(0, '4573.610')] [2023-03-12 06:22:49,551][146667] Updated weights for policy 0, policy_version 125200 (0.0003) [2023-03-12 06:22:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 64131072. Throughput: 0: 9744.6. Samples: 64110076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:22:52,720][146380] Avg episode reward: [(0, '4537.437')] [2023-03-12 06:22:53,794][146667] Updated weights for policy 0, policy_version 125280 (0.0003) [2023-03-12 06:22:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 64180224. Throughput: 0: 9804.2. Samples: 64167952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:22:57,720][146380] Avg episode reward: [(0, '4565.932')] [2023-03-12 06:22:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125352_64180224.pth... [2023-03-12 06:22:57,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000124776_63885312.pth [2023-03-12 06:22:58,159][146667] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-12 06:23:02,625][146667] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-12 06:23:02,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 64225280. Throughput: 0: 9751.3. Samples: 64222596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:02,720][146380] Avg episode reward: [(0, '4552.710')] [2023-03-12 06:23:07,231][146667] Updated weights for policy 0, policy_version 125520 (0.0006) [2023-03-12 06:23:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 64270336. Throughput: 0: 9686.8. Samples: 64249648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:07,720][146380] Avg episode reward: [(0, '4506.063')] [2023-03-12 06:23:11,721][146667] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-12 06:23:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 64315392. Throughput: 0: 9584.9. Samples: 64303176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:12,720][146380] Avg episode reward: [(0, '4507.754')] [2023-03-12 06:23:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125616_64315392.pth... [2023-03-12 06:23:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125064_64032768.pth [2023-03-12 06:23:16,227][146667] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-12 06:23:17,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 64360448. Throughput: 0: 9499.3. Samples: 64358848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:17,720][146380] Avg episode reward: [(0, '4572.739')] [2023-03-12 06:23:20,580][146667] Updated weights for policy 0, policy_version 125760 (0.0006) [2023-03-12 06:23:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 64405504. Throughput: 0: 9453.7. Samples: 64386824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:22,720][146380] Avg episode reward: [(0, '4544.749')] [2023-03-12 06:23:25,092][146667] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-12 06:23:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 64450560. Throughput: 0: 9353.6. Samples: 64441400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:27,720][146380] Avg episode reward: [(0, '4489.314')] [2023-03-12 06:23:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125880_64450560.pth... [2023-03-12 06:23:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125352_64180224.pth [2023-03-12 06:23:29,560][146667] Updated weights for policy 0, policy_version 125920 (0.0005) [2023-03-12 06:23:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 64499712. Throughput: 0: 9237.9. Samples: 64496576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:32,720][146380] Avg episode reward: [(0, '4546.971')] [2023-03-12 06:23:33,934][146667] Updated weights for policy 0, policy_version 126000 (0.0006) [2023-03-12 06:23:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 64544768. Throughput: 0: 9214.0. Samples: 64524708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:23:37,720][146380] Avg episode reward: [(0, '4494.470')] [2023-03-12 06:23:38,376][146667] Updated weights for policy 0, policy_version 126080 (0.0006) [2023-03-12 06:23:42,568][146667] Updated weights for policy 0, policy_version 126160 (0.0004) [2023-03-12 06:23:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 64593920. Throughput: 0: 9194.3. Samples: 64581696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:23:42,720][146380] Avg episode reward: [(0, '4563.736')] [2023-03-12 06:23:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126160_64593920.pth... [2023-03-12 06:23:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125616_64315392.pth [2023-03-12 06:23:46,845][146667] Updated weights for policy 0, policy_version 126240 (0.0003) [2023-03-12 06:23:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 64643072. Throughput: 0: 9259.4. Samples: 64639268. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:23:47,720][146380] Avg episode reward: [(0, '4565.301')] [2023-03-12 06:23:50,971][146667] Updated weights for policy 0, policy_version 126320 (0.0003) [2023-03-12 06:23:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 64692224. Throughput: 0: 9335.1. Samples: 64669728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:23:52,720][146380] Avg episode reward: [(0, '4557.964')] [2023-03-12 06:23:55,232][146667] Updated weights for policy 0, policy_version 126400 (0.0003) [2023-03-12 06:23:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 64737280. Throughput: 0: 9443.7. Samples: 64728140. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:23:57,720][146380] Avg episode reward: [(0, '4565.685')] [2023-03-12 06:23:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126448_64741376.pth... [2023-03-12 06:23:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000125880_64450560.pth [2023-03-12 06:23:59,462][146667] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-12 06:24:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 64786432. Throughput: 0: 9501.7. Samples: 64786424. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:02,720][146380] Avg episode reward: [(0, '4576.137')] [2023-03-12 06:24:03,580][146667] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-12 06:24:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 64835584. Throughput: 0: 9530.0. Samples: 64815676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:07,720][146380] Avg episode reward: [(0, '4573.126')] [2023-03-12 06:24:07,750][146667] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-12 06:24:11,880][146667] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-12 06:24:12,719][146380] Fps is (10 sec: 10239.9, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 64888832. Throughput: 0: 9648.3. Samples: 64875572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:12,730][146380] Avg episode reward: [(0, '4577.599')] [2023-03-12 06:24:12,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126736_64888832.pth... [2023-03-12 06:24:12,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126160_64593920.pth [2023-03-12 06:24:15,908][146667] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-12 06:24:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 64937984. Throughput: 0: 9753.4. Samples: 64935480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:17,730][146380] Avg episode reward: [(0, '4559.745')] [2023-03-12 06:24:20,035][146667] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-12 06:24:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 64987136. Throughput: 0: 9797.2. Samples: 64965584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:22,720][146380] Avg episode reward: [(0, '4566.918')] [2023-03-12 06:24:24,138][146667] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-12 06:24:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9594.4). Total num frames: 65036288. Throughput: 0: 9867.7. Samples: 65025740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:27,723][146380] Avg episode reward: [(0, '4538.356')] [2023-03-12 06:24:27,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127024_65036288.pth... [2023-03-12 06:24:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126448_64741376.pth [2023-03-12 06:24:28,242][146667] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-12 06:24:32,410][146667] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-12 06:24:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 65085440. Throughput: 0: 9904.7. Samples: 65084980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:32,730][146380] Avg episode reward: [(0, '4565.269')] [2023-03-12 06:24:36,616][146667] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-12 06:24:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9622.1). Total num frames: 65134592. Throughput: 0: 9874.8. Samples: 65114092. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 06:24:37,720][146380] Avg episode reward: [(0, '4556.123')] [2023-03-12 06:24:40,994][146667] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-12 06:24:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 65179648. Throughput: 0: 9836.9. Samples: 65170800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:24:42,723][146380] Avg episode reward: [(0, '4522.824')] [2023-03-12 06:24:42,757][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127312_65183744.pth... [2023-03-12 06:24:42,759][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000126736_64888832.pth [2023-03-12 06:24:45,249][146667] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-12 06:24:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 65228800. Throughput: 0: 9825.9. Samples: 65228588. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:24:47,730][146380] Avg episode reward: [(0, '4569.167')] [2023-03-12 06:24:49,588][146667] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-12 06:24:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9622.1). Total num frames: 65277952. Throughput: 0: 9796.1. Samples: 65256500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:24:52,720][146380] Avg episode reward: [(0, '4486.698')] [2023-03-12 06:24:53,756][146667] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-12 06:24:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9622.1). Total num frames: 65327104. Throughput: 0: 9762.4. Samples: 65314880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:24:57,720][146380] Avg episode reward: [(0, '4441.797')] [2023-03-12 06:24:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127592_65327104.pth... [2023-03-12 06:24:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127024_65036288.pth [2023-03-12 06:24:58,048][146667] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-12 06:25:02,280][146667] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-12 06:25:02,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 65376256. Throughput: 0: 9709.9. Samples: 65372428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:02,720][146380] Avg episode reward: [(0, '4494.346')] [2023-03-12 06:25:06,434][146667] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-12 06:25:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 65425408. Throughput: 0: 9702.5. Samples: 65402196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:07,720][146380] Avg episode reward: [(0, '4493.942')] [2023-03-12 06:25:10,533][146667] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-12 06:25:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 65474560. Throughput: 0: 9695.4. Samples: 65462032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:12,720][146380] Avg episode reward: [(0, '4589.191')] [2023-03-12 06:25:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127880_65474560.pth... [2023-03-12 06:25:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127312_65183744.pth [2023-03-12 06:25:14,647][146667] Updated weights for policy 0, policy_version 127920 (0.0004) [2023-03-12 06:25:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 65523712. Throughput: 0: 9696.3. Samples: 65521312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:17,720][146380] Avg episode reward: [(0, '4564.098')] [2023-03-12 06:25:18,801][146667] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-12 06:25:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 65572864. Throughput: 0: 9723.5. Samples: 65551648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:22,720][146380] Avg episode reward: [(0, '4584.433')] [2023-03-12 06:25:22,963][146667] Updated weights for policy 0, policy_version 128080 (0.0004) [2023-03-12 06:25:27,179][146667] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-12 06:25:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 65622016. Throughput: 0: 9755.4. Samples: 65609792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:27,720][146380] Avg episode reward: [(0, '4564.014')] [2023-03-12 06:25:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128168_65622016.pth... [2023-03-12 06:25:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127592_65327104.pth [2023-03-12 06:25:31,331][146667] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-12 06:25:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 65671168. Throughput: 0: 9773.7. Samples: 65668404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:32,720][146380] Avg episode reward: [(0, '4587.931')] [2023-03-12 06:25:35,537][146667] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-12 06:25:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 65720320. Throughput: 0: 9813.7. Samples: 65698116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:37,720][146380] Avg episode reward: [(0, '4579.901')] [2023-03-12 06:25:39,699][146667] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-12 06:25:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 65769472. Throughput: 0: 9821.0. Samples: 65756824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:25:42,720][146380] Avg episode reward: [(0, '4577.017')] [2023-03-12 06:25:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128456_65769472.pth... [2023-03-12 06:25:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000127880_65474560.pth [2023-03-12 06:25:43,849][146667] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-12 06:25:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 65818624. Throughput: 0: 9858.9. Samples: 65816080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:25:47,720][146380] Avg episode reward: [(0, '4573.847')] [2023-03-12 06:25:47,978][146667] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-12 06:25:52,211][146667] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-12 06:25:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 65867776. Throughput: 0: 9852.5. Samples: 65845556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:25:52,720][146380] Avg episode reward: [(0, '4573.399')] [2023-03-12 06:25:56,360][146667] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-12 06:25:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 65916928. Throughput: 0: 9835.9. Samples: 65904648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:25:57,720][146380] Avg episode reward: [(0, '4570.523')] [2023-03-12 06:25:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128744_65916928.pth... [2023-03-12 06:25:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128168_65622016.pth [2023-03-12 06:26:00,573][146667] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-12 06:26:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 65966080. Throughput: 0: 9820.0. Samples: 65963212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:02,720][146380] Avg episode reward: [(0, '4580.420')] [2023-03-12 06:26:04,856][146667] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-12 06:26:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 66011136. Throughput: 0: 9757.3. Samples: 65990728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:07,720][146380] Avg episode reward: [(0, '4563.177')] [2023-03-12 06:26:09,268][146667] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-12 06:26:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 66056192. Throughput: 0: 9725.1. Samples: 66047420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:12,720][146380] Avg episode reward: [(0, '4574.480')] [2023-03-12 06:26:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129016_66056192.pth... [2023-03-12 06:26:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128456_65769472.pth [2023-03-12 06:26:13,720][146667] Updated weights for policy 0, policy_version 129040 (0.0006) [2023-03-12 06:26:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 66105344. Throughput: 0: 9672.4. Samples: 66103660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:17,720][146380] Avg episode reward: [(0, '4493.765')] [2023-03-12 06:26:18,016][146667] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-12 06:26:22,432][146667] Updated weights for policy 0, policy_version 129200 (0.0006) [2023-03-12 06:26:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 66150400. Throughput: 0: 9613.1. Samples: 66130704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:22,720][146380] Avg episode reward: [(0, '4559.430')] [2023-03-12 06:26:26,703][146667] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-12 06:26:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 66199552. Throughput: 0: 9572.6. Samples: 66187592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:27,720][146380] Avg episode reward: [(0, '4574.152')] [2023-03-12 06:26:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129296_66199552.pth... [2023-03-12 06:26:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000128744_65916928.pth [2023-03-12 06:26:31,061][146667] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-12 06:26:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 66248704. Throughput: 0: 9533.2. Samples: 66245076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:32,720][146380] Avg episode reward: [(0, '4572.008')] [2023-03-12 06:26:34,727][146623] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000008 [2023-03-12 06:26:35,135][146667] Updated weights for policy 0, policy_version 129440 (0.0003) [2023-03-12 06:26:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9649.9). Total num frames: 66293760. Throughput: 0: 9549.6. Samples: 66275288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:37,720][146380] Avg episode reward: [(0, '4576.323')] [2023-03-12 06:26:39,416][146667] Updated weights for policy 0, policy_version 129520 (0.0003) [2023-03-12 06:26:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9649.9). Total num frames: 66342912. Throughput: 0: 9503.6. Samples: 66332312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:26:42,720][146380] Avg episode reward: [(0, '4564.769')] [2023-03-12 06:26:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129576_66342912.pth... [2023-03-12 06:26:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129016_66056192.pth [2023-03-12 06:26:43,796][146667] Updated weights for policy 0, policy_version 129600 (0.0005) [2023-03-12 06:26:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 66387968. Throughput: 0: 9435.9. Samples: 66387828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:26:47,720][146380] Avg episode reward: [(0, '4565.518')] [2023-03-12 06:26:48,325][146667] Updated weights for policy 0, policy_version 129680 (0.0006) [2023-03-12 06:26:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 66433024. Throughput: 0: 9418.0. Samples: 66414540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:26:52,720][146380] Avg episode reward: [(0, '4534.725')] [2023-03-12 06:26:52,792][146667] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-12 06:26:57,071][146667] Updated weights for policy 0, policy_version 129840 (0.0003) [2023-03-12 06:26:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 66482176. Throughput: 0: 9417.3. Samples: 66471200. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:26:57,720][146380] Avg episode reward: [(0, '4531.522')] [2023-03-12 06:26:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129848_66482176.pth... [2023-03-12 06:26:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129296_66199552.pth [2023-03-12 06:27:01,299][146667] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-12 06:27:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 66531328. Throughput: 0: 9448.5. Samples: 66528844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:02,720][146380] Avg episode reward: [(0, '4455.480')] [2023-03-12 06:27:05,453][146667] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-12 06:27:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 66580480. Throughput: 0: 9518.2. Samples: 66559024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:07,720][146380] Avg episode reward: [(0, '4540.258')] [2023-03-12 06:27:09,676][146667] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-12 06:27:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9636.0). Total num frames: 66629632. Throughput: 0: 9547.4. Samples: 66617224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:12,720][146380] Avg episode reward: [(0, '4571.895')] [2023-03-12 06:27:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130136_66629632.pth... [2023-03-12 06:27:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129576_66342912.pth [2023-03-12 06:27:13,915][146667] Updated weights for policy 0, policy_version 130160 (0.0004) [2023-03-12 06:27:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9636.0). Total num frames: 66678784. Throughput: 0: 9567.7. Samples: 66675624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:17,720][146380] Avg episode reward: [(0, '4565.388')] [2023-03-12 06:27:18,081][146667] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-12 06:27:22,170][146667] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-12 06:27:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 66727936. Throughput: 0: 9557.2. Samples: 66705360. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:22,720][146380] Avg episode reward: [(0, '4572.098')] [2023-03-12 06:27:26,376][146667] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-12 06:27:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 66777088. Throughput: 0: 9603.5. Samples: 66764468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:27,720][146380] Avg episode reward: [(0, '4575.913')] [2023-03-12 06:27:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130424_66777088.pth... [2023-03-12 06:27:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000129848_66482176.pth [2023-03-12 06:27:30,514][146667] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-12 06:27:32,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 66826240. Throughput: 0: 9679.4. Samples: 66823404. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:32,720][146380] Avg episode reward: [(0, '4568.916')] [2023-03-12 06:27:34,646][146667] Updated weights for policy 0, policy_version 130560 (0.0004) [2023-03-12 06:27:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 66875392. Throughput: 0: 9755.2. Samples: 66853524. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:37,720][146380] Avg episode reward: [(0, '4523.039')] [2023-03-12 06:27:38,868][146667] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-12 06:27:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 66924544. Throughput: 0: 9796.1. Samples: 66912024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:42,720][146380] Avg episode reward: [(0, '4541.160')] [2023-03-12 06:27:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130712_66924544.pth... [2023-03-12 06:27:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130136_66629632.pth [2023-03-12 06:27:43,037][146667] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-12 06:27:47,205][146667] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-12 06:27:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 66973696. Throughput: 0: 9820.4. Samples: 66970760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:27:47,720][146380] Avg episode reward: [(0, '4574.208')] [2023-03-12 06:27:51,334][146667] Updated weights for policy 0, policy_version 130880 (0.0004) [2023-03-12 06:27:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 67022848. Throughput: 0: 9811.6. Samples: 67000544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:27:52,720][146380] Avg episode reward: [(0, '4564.497')] [2023-03-12 06:27:55,609][146667] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-12 06:27:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 67072000. Throughput: 0: 9816.0. Samples: 67058944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:27:57,720][146380] Avg episode reward: [(0, '4549.271')] [2023-03-12 06:27:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131000_67072000.pth... [2023-03-12 06:27:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130424_66777088.pth [2023-03-12 06:27:59,779][146667] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-12 06:28:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 67121152. Throughput: 0: 9828.0. Samples: 67117884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:02,720][146380] Avg episode reward: [(0, '4478.397')] [2023-03-12 06:28:03,862][146667] Updated weights for policy 0, policy_version 131120 (0.0004) [2023-03-12 06:28:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 67170304. Throughput: 0: 9831.5. Samples: 67147776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:07,720][146380] Avg episode reward: [(0, '4571.763')] [2023-03-12 06:28:08,063][146667] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-12 06:28:12,209][146667] Updated weights for policy 0, policy_version 131280 (0.0004) [2023-03-12 06:28:12,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9691.6). Total num frames: 67219456. Throughput: 0: 9832.4. Samples: 67206928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:12,720][146380] Avg episode reward: [(0, '4573.677')] [2023-03-12 06:28:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131288_67219456.pth... [2023-03-12 06:28:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000130712_66924544.pth [2023-03-12 06:28:16,456][146667] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-12 06:28:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 67268608. Throughput: 0: 9813.0. Samples: 67264988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:17,720][146380] Avg episode reward: [(0, '4479.760')] [2023-03-12 06:28:20,569][146667] Updated weights for policy 0, policy_version 131440 (0.0004) [2023-03-12 06:28:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 67317760. Throughput: 0: 9806.5. Samples: 67294816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:22,720][146380] Avg episode reward: [(0, '4527.247')] [2023-03-12 06:28:24,813][146667] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-12 06:28:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 67366912. Throughput: 0: 9815.0. Samples: 67353700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:27,726][146380] Avg episode reward: [(0, '4563.207')] [2023-03-12 06:28:27,730][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131576_67366912.pth... [2023-03-12 06:28:27,732][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131000_67072000.pth [2023-03-12 06:28:28,919][146667] Updated weights for policy 0, policy_version 131600 (0.0004) [2023-03-12 06:28:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9719.3). Total num frames: 67411968. Throughput: 0: 9777.5. Samples: 67410748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:32,730][146380] Avg episode reward: [(0, '4574.338')] [2023-03-12 06:28:33,397][146667] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-12 06:28:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67457024. Throughput: 0: 9732.1. Samples: 67438488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:37,720][146380] Avg episode reward: [(0, '4577.415')] [2023-03-12 06:28:37,787][146667] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-12 06:28:42,066][146667] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-12 06:28:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67506176. Throughput: 0: 9684.5. Samples: 67494744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:42,720][146380] Avg episode reward: [(0, '4569.453')] [2023-03-12 06:28:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131848_67506176.pth... [2023-03-12 06:28:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131288_67219456.pth [2023-03-12 06:28:46,238][146667] Updated weights for policy 0, policy_version 131920 (0.0004) [2023-03-12 06:28:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67555328. Throughput: 0: 9685.1. Samples: 67553712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:28:47,720][146380] Avg episode reward: [(0, '4569.692')] [2023-03-12 06:28:50,407][146667] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-12 06:28:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 67604480. Throughput: 0: 9686.1. Samples: 67583652. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:28:52,720][146380] Avg episode reward: [(0, '4560.594')] [2023-03-12 06:28:54,575][146667] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-12 06:28:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 67653632. Throughput: 0: 9680.3. Samples: 67642540. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:28:57,720][146380] Avg episode reward: [(0, '4552.252')] [2023-03-12 06:28:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132136_67653632.pth... [2023-03-12 06:28:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131576_67366912.pth [2023-03-12 06:28:58,717][146667] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-12 06:29:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 67702784. Throughput: 0: 9709.5. Samples: 67701916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:02,720][146380] Avg episode reward: [(0, '4571.098')] [2023-03-12 06:29:02,850][146667] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-12 06:29:07,090][146667] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-12 06:29:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67751936. Throughput: 0: 9698.5. Samples: 67731248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:07,720][146380] Avg episode reward: [(0, '4515.696')] [2023-03-12 06:29:11,205][146667] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-12 06:29:12,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67801088. Throughput: 0: 9694.8. Samples: 67789964. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:12,720][146380] Avg episode reward: [(0, '4530.327')] [2023-03-12 06:29:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132424_67801088.pth... [2023-03-12 06:29:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000131848_67506176.pth [2023-03-12 06:29:15,416][146667] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-12 06:29:17,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67850240. Throughput: 0: 9734.8. Samples: 67848816. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:17,720][146380] Avg episode reward: [(0, '4575.426')] [2023-03-12 06:29:19,606][146667] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-12 06:29:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67899392. Throughput: 0: 9762.1. Samples: 67877784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:22,720][146380] Avg episode reward: [(0, '4534.954')] [2023-03-12 06:29:23,869][146667] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-12 06:29:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 67948544. Throughput: 0: 9811.0. Samples: 67936240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:27,720][146380] Avg episode reward: [(0, '4579.748')] [2023-03-12 06:29:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132712_67948544.pth... [2023-03-12 06:29:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132136_67653632.pth [2023-03-12 06:29:27,986][146667] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-12 06:29:32,238][146667] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-12 06:29:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 67997696. Throughput: 0: 9792.3. Samples: 67994368. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:32,720][146380] Avg episode reward: [(0, '4567.143')] [2023-03-12 06:29:36,360][146667] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-12 06:29:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68046848. Throughput: 0: 9789.8. Samples: 68024192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:37,720][146380] Avg episode reward: [(0, '4565.625')] [2023-03-12 06:29:40,624][146667] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-12 06:29:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68096000. Throughput: 0: 9780.7. Samples: 68082672. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:42,720][146380] Avg episode reward: [(0, '4576.851')] [2023-03-12 06:29:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133000_68096000.pth... [2023-03-12 06:29:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132424_67801088.pth [2023-03-12 06:29:44,712][146667] Updated weights for policy 0, policy_version 133040 (0.0005) [2023-03-12 06:29:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68145152. Throughput: 0: 9780.6. Samples: 68142044. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:47,720][146380] Avg episode reward: [(0, '4573.098')] [2023-03-12 06:29:48,874][146667] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-12 06:29:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68194304. Throughput: 0: 9788.8. Samples: 68171744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:29:52,720][146380] Avg episode reward: [(0, '4574.478')] [2023-03-12 06:29:52,976][146667] Updated weights for policy 0, policy_version 133200 (0.0004) [2023-03-12 06:29:57,082][146667] Updated weights for policy 0, policy_version 133280 (0.0005) [2023-03-12 06:29:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68243456. Throughput: 0: 9811.7. Samples: 68231492. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:29:57,720][146380] Avg episode reward: [(0, '4527.212')] [2023-03-12 06:29:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133288_68243456.pth... [2023-03-12 06:29:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000132712_67948544.pth [2023-03-12 06:30:01,267][146667] Updated weights for policy 0, policy_version 133360 (0.0005) [2023-03-12 06:30:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68292608. Throughput: 0: 9823.3. Samples: 68290864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:02,720][146380] Avg episode reward: [(0, '4572.190')] [2023-03-12 06:30:05,387][146667] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-12 06:30:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68341760. Throughput: 0: 9844.7. Samples: 68320796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:07,720][146380] Avg episode reward: [(0, '4586.994')] [2023-03-12 06:30:09,615][146667] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-12 06:30:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68390912. Throughput: 0: 9832.4. Samples: 68378696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:12,720][146380] Avg episode reward: [(0, '4556.451')] [2023-03-12 06:30:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133576_68390912.pth... [2023-03-12 06:30:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133000_68096000.pth [2023-03-12 06:30:13,828][146667] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-12 06:30:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 68440064. Throughput: 0: 9824.6. Samples: 68436476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:17,720][146380] Avg episode reward: [(0, '4566.690')] [2023-03-12 06:30:18,129][146667] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-12 06:30:22,407][146667] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-12 06:30:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 68485120. Throughput: 0: 9795.3. Samples: 68464980. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:22,720][146380] Avg episode reward: [(0, '4453.633')] [2023-03-12 06:30:26,604][146667] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-12 06:30:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 68534272. Throughput: 0: 9789.9. Samples: 68523220. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:27,720][146380] Avg episode reward: [(0, '4543.830')] [2023-03-12 06:30:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133856_68534272.pth... [2023-03-12 06:30:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133288_68243456.pth [2023-03-12 06:30:31,004][146667] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-12 06:30:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 68579328. Throughput: 0: 9717.7. Samples: 68579340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:32,720][146380] Avg episode reward: [(0, '4571.883')] [2023-03-12 06:30:35,556][146667] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-12 06:30:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 68624384. Throughput: 0: 9654.7. Samples: 68606204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:37,720][146380] Avg episode reward: [(0, '4558.031')] [2023-03-12 06:30:40,097][146667] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-12 06:30:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 68669440. Throughput: 0: 9530.6. Samples: 68660368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:42,720][146380] Avg episode reward: [(0, '4540.550')] [2023-03-12 06:30:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134120_68669440.pth... [2023-03-12 06:30:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133576_68390912.pth [2023-03-12 06:30:44,574][146667] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-12 06:30:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 68718592. Throughput: 0: 9469.8. Samples: 68717004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:47,720][146380] Avg episode reward: [(0, '4538.100')] [2023-03-12 06:30:48,720][146667] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-12 06:30:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 68767744. Throughput: 0: 9465.8. Samples: 68746756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:30:52,720][146380] Avg episode reward: [(0, '4575.603')] [2023-03-12 06:30:52,950][146667] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-12 06:30:57,119][146667] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-12 06:30:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 68816896. Throughput: 0: 9478.1. Samples: 68805212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:30:57,720][146380] Avg episode reward: [(0, '4573.285')] [2023-03-12 06:30:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134408_68816896.pth... [2023-03-12 06:30:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000133856_68534272.pth [2023-03-12 06:31:01,282][146667] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-12 06:31:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 68866048. Throughput: 0: 9500.9. Samples: 68864016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:02,720][146380] Avg episode reward: [(0, '4547.902')] [2023-03-12 06:31:05,749][146667] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-12 06:31:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 68911104. Throughput: 0: 9463.2. Samples: 68890824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:07,720][146380] Avg episode reward: [(0, '4573.888')] [2023-03-12 06:31:10,237][146667] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-12 06:31:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9663.8). Total num frames: 68956160. Throughput: 0: 9383.7. Samples: 68945488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:12,720][146380] Avg episode reward: [(0, '4568.483')] [2023-03-12 06:31:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134680_68956160.pth... [2023-03-12 06:31:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134120_68669440.pth [2023-03-12 06:31:14,739][146667] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-12 06:31:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9663.8). Total num frames: 69001216. Throughput: 0: 9355.0. Samples: 69000316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:17,720][146380] Avg episode reward: [(0, '4580.748')] [2023-03-12 06:31:19,231][146667] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-12 06:31:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9649.9). Total num frames: 69046272. Throughput: 0: 9373.0. Samples: 69027988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:22,720][146380] Avg episode reward: [(0, '4577.637')] [2023-03-12 06:31:23,692][146667] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-12 06:31:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9636.0). Total num frames: 69091328. Throughput: 0: 9381.1. Samples: 69082520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:27,720][146380] Avg episode reward: [(0, '4540.096')] [2023-03-12 06:31:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134944_69091328.pth... [2023-03-12 06:31:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134408_68816896.pth [2023-03-12 06:31:28,280][146667] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-12 06:31:32,696][146667] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-12 06:31:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9649.9). Total num frames: 69140480. Throughput: 0: 9337.0. Samples: 69137168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:32,720][146380] Avg episode reward: [(0, '4571.801')] [2023-03-12 06:31:37,160][146667] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-12 06:31:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9636.0). Total num frames: 69185536. Throughput: 0: 9295.5. Samples: 69165056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:37,720][146380] Avg episode reward: [(0, '4573.412')] [2023-03-12 06:31:41,573][146667] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-12 06:31:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9636.0). Total num frames: 69230592. Throughput: 0: 9217.5. Samples: 69220000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:42,720][146380] Avg episode reward: [(0, '4562.925')] [2023-03-12 06:31:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135216_69230592.pth... [2023-03-12 06:31:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134680_68956160.pth [2023-03-12 06:31:46,031][146667] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-12 06:31:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9636.0). Total num frames: 69275648. Throughput: 0: 9147.4. Samples: 69275648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:47,720][146380] Avg episode reward: [(0, '4564.167')] [2023-03-12 06:31:50,555][146667] Updated weights for policy 0, policy_version 135360 (0.0005) [2023-03-12 06:31:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9622.1). Total num frames: 69320704. Throughput: 0: 9140.0. Samples: 69302124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:52,720][146380] Avg episode reward: [(0, '4532.050')] [2023-03-12 06:31:55,056][146667] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-12 06:31:57,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 69365760. Throughput: 0: 9146.2. Samples: 69357064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:31:57,720][146380] Avg episode reward: [(0, '4496.419')] [2023-03-12 06:31:57,741][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135488_69369856.pth... [2023-03-12 06:31:57,744][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000134944_69091328.pth [2023-03-12 06:31:59,548][146667] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-12 06:32:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 69414912. Throughput: 0: 9141.8. Samples: 69411696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:02,720][146380] Avg episode reward: [(0, '4569.475')] [2023-03-12 06:32:03,925][146667] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-12 06:32:07,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9594.4). Total num frames: 69459968. Throughput: 0: 9152.5. Samples: 69439852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:07,720][146380] Avg episode reward: [(0, '4584.043')] [2023-03-12 06:32:08,392][146667] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-12 06:32:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9580.5). Total num frames: 69505024. Throughput: 0: 9191.1. Samples: 69496120. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:12,720][146380] Avg episode reward: [(0, '4581.880')] [2023-03-12 06:32:12,789][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135760_69509120.pth... [2023-03-12 06:32:12,790][146667] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-12 06:32:12,791][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135216_69230592.pth [2023-03-12 06:32:16,850][146667] Updated weights for policy 0, policy_version 135840 (0.0004) [2023-03-12 06:32:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 69558272. Throughput: 0: 9281.1. Samples: 69554816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:17,720][146380] Avg episode reward: [(0, '4582.904')] [2023-03-12 06:32:20,931][146667] Updated weights for policy 0, policy_version 135920 (0.0004) [2023-03-12 06:32:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 69607424. Throughput: 0: 9331.2. Samples: 69584960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:22,720][146380] Avg episode reward: [(0, '4571.431')] [2023-03-12 06:32:25,204][146667] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-12 06:32:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 69652480. Throughput: 0: 9386.3. Samples: 69642384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:27,720][146380] Avg episode reward: [(0, '4575.918')] [2023-03-12 06:32:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136040_69652480.pth... [2023-03-12 06:32:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135488_69369856.pth [2023-03-12 06:32:29,648][146667] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-12 06:32:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 69701632. Throughput: 0: 9381.1. Samples: 69697796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:32,720][146380] Avg episode reward: [(0, '4573.793')] [2023-03-12 06:32:34,063][146667] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-12 06:32:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 69746688. Throughput: 0: 9415.6. Samples: 69725828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:37,720][146380] Avg episode reward: [(0, '4579.096')] [2023-03-12 06:32:38,496][146667] Updated weights for policy 0, policy_version 136240 (0.0005) [2023-03-12 06:32:42,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 69791744. Throughput: 0: 9415.8. Samples: 69780776. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:42,720][146380] Avg episode reward: [(0, '4584.300')] [2023-03-12 06:32:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136312_69791744.pth... [2023-03-12 06:32:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000135760_69509120.pth [2023-03-12 06:32:42,979][146667] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-12 06:32:47,328][146667] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-12 06:32:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 69836800. Throughput: 0: 9448.2. Samples: 69836864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:47,720][146380] Avg episode reward: [(0, '4541.661')] [2023-03-12 06:32:51,707][146667] Updated weights for policy 0, policy_version 136480 (0.0004) [2023-03-12 06:32:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 69885952. Throughput: 0: 9453.3. Samples: 69865248. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:52,720][146380] Avg episode reward: [(0, '4570.876')] [2023-03-12 06:32:56,092][146667] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-12 06:32:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 69931008. Throughput: 0: 9441.4. Samples: 69920984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:32:57,720][146380] Avg episode reward: [(0, '4573.917')] [2023-03-12 06:32:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136584_69931008.pth... [2023-03-12 06:32:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136040_69652480.pth [2023-03-12 06:33:00,584][146667] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-12 06:33:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 69976064. Throughput: 0: 9362.5. Samples: 69976128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:02,720][146380] Avg episode reward: [(0, '4584.376')] [2023-03-12 06:33:05,016][146667] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-12 06:33:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 70025216. Throughput: 0: 9308.7. Samples: 70003852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:07,720][146380] Avg episode reward: [(0, '4577.457')] [2023-03-12 06:33:09,479][146667] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-12 06:33:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 70070272. Throughput: 0: 9237.0. Samples: 70058048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:12,720][146380] Avg episode reward: [(0, '4539.852')] [2023-03-12 06:33:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136856_70070272.pth... [2023-03-12 06:33:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136312_69791744.pth [2023-03-12 06:33:14,021][146667] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-12 06:33:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 70115328. Throughput: 0: 9231.8. Samples: 70113228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:17,720][146380] Avg episode reward: [(0, '4549.073')] [2023-03-12 06:33:18,461][146667] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-12 06:33:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 70160384. Throughput: 0: 9219.7. Samples: 70140716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:22,720][146380] Avg episode reward: [(0, '4529.713')] [2023-03-12 06:33:22,849][146667] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-12 06:33:27,275][146667] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-12 06:33:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 70209536. Throughput: 0: 9247.6. Samples: 70196916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:27,720][146380] Avg episode reward: [(0, '4541.749')] [2023-03-12 06:33:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137128_70209536.pth... [2023-03-12 06:33:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136584_69931008.pth [2023-03-12 06:33:31,649][146667] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-12 06:33:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 70254592. Throughput: 0: 9244.7. Samples: 70252876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:32,720][146380] Avg episode reward: [(0, '4583.734')] [2023-03-12 06:33:36,112][146667] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-12 06:33:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 70299648. Throughput: 0: 9218.9. Samples: 70280100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:37,720][146380] Avg episode reward: [(0, '4480.831')] [2023-03-12 06:33:40,414][146667] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-12 06:33:42,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 70348800. Throughput: 0: 9235.4. Samples: 70336576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:42,720][146380] Avg episode reward: [(0, '4580.019')] [2023-03-12 06:33:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137400_70348800.pth... [2023-03-12 06:33:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000136856_70070272.pth [2023-03-12 06:33:44,724][146667] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-12 06:33:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 70397952. Throughput: 0: 9285.0. Samples: 70393952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:47,720][146380] Avg episode reward: [(0, '4572.590')] [2023-03-12 06:33:48,984][146667] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-12 06:33:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 70443008. Throughput: 0: 9317.5. Samples: 70423140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:52,720][146380] Avg episode reward: [(0, '4568.603')] [2023-03-12 06:33:53,302][146667] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-12 06:33:57,632][146667] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-12 06:33:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 70492160. Throughput: 0: 9373.9. Samples: 70479872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:33:57,720][146380] Avg episode reward: [(0, '4572.918')] [2023-03-12 06:33:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137680_70492160.pth... [2023-03-12 06:33:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137128_70209536.pth [2023-03-12 06:34:02,009][146667] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-12 06:34:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 70537216. Throughput: 0: 9403.8. Samples: 70536400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:34:02,720][146380] Avg episode reward: [(0, '4577.101')] [2023-03-12 06:34:06,453][146667] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-12 06:34:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 70582272. Throughput: 0: 9392.6. Samples: 70563384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:07,720][146380] Avg episode reward: [(0, '4573.733')] [2023-03-12 06:34:10,828][146667] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-12 06:34:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 70631424. Throughput: 0: 9387.2. Samples: 70619340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:12,720][146380] Avg episode reward: [(0, '4576.750')] [2023-03-12 06:34:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137952_70631424.pth... [2023-03-12 06:34:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137400_70348800.pth [2023-03-12 06:34:15,022][146667] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-12 06:34:17,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 70680576. Throughput: 0: 9446.6. Samples: 70677972. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:17,720][146380] Avg episode reward: [(0, '4503.106')] [2023-03-12 06:34:19,339][146667] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-12 06:34:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 70725632. Throughput: 0: 9475.1. Samples: 70706480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:22,720][146380] Avg episode reward: [(0, '4575.294')] [2023-03-12 06:34:23,625][146667] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-12 06:34:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 70774784. Throughput: 0: 9488.4. Samples: 70763556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:27,720][146380] Avg episode reward: [(0, '4586.590')] [2023-03-12 06:34:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138232_70774784.pth... [2023-03-12 06:34:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137680_70492160.pth [2023-03-12 06:34:27,937][146667] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-12 06:34:32,235][146667] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-12 06:34:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 70823936. Throughput: 0: 9482.0. Samples: 70820640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:32,720][146380] Avg episode reward: [(0, '4573.763')] [2023-03-12 06:34:36,558][146667] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-12 06:34:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 70868992. Throughput: 0: 9460.8. Samples: 70848876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:37,720][146380] Avg episode reward: [(0, '4576.925')] [2023-03-12 06:34:40,856][146667] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-12 06:34:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 70918144. Throughput: 0: 9470.1. Samples: 70906028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:42,720][146380] Avg episode reward: [(0, '4571.858')] [2023-03-12 06:34:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138512_70918144.pth... [2023-03-12 06:34:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000137952_70631424.pth [2023-03-12 06:34:45,172][146667] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-12 06:34:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 70963200. Throughput: 0: 9484.7. Samples: 70963212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:47,720][146380] Avg episode reward: [(0, '4571.202')] [2023-03-12 06:34:49,605][146667] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-12 06:34:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 71012352. Throughput: 0: 9497.3. Samples: 70990764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:52,720][146380] Avg episode reward: [(0, '4588.649')] [2023-03-12 06:34:54,033][146667] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-12 06:34:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 71057408. Throughput: 0: 9502.5. Samples: 71046952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:34:57,720][146380] Avg episode reward: [(0, '4539.039')] [2023-03-12 06:34:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138784_71057408.pth... [2023-03-12 06:34:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138232_70774784.pth [2023-03-12 06:34:58,171][146667] Updated weights for policy 0, policy_version 138800 (0.0004) [2023-03-12 06:35:02,657][146667] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-12 06:35:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 71106560. Throughput: 0: 9454.4. Samples: 71103420. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:35:02,720][146380] Avg episode reward: [(0, '4508.788')] [2023-03-12 06:35:07,263][146667] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-12 06:35:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 71147520. Throughput: 0: 9436.8. Samples: 71131136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:35:07,720][146380] Avg episode reward: [(0, '4444.997')] [2023-03-12 06:35:11,630][146667] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-12 06:35:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 71196672. Throughput: 0: 9372.3. Samples: 71185308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:12,720][146380] Avg episode reward: [(0, '4453.623')] [2023-03-12 06:35:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139056_71196672.pth... [2023-03-12 06:35:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138512_70918144.pth [2023-03-12 06:35:15,842][146667] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-12 06:35:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 71245824. Throughput: 0: 9408.5. Samples: 71244024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:17,720][146380] Avg episode reward: [(0, '4501.259')] [2023-03-12 06:35:20,207][146667] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-12 06:35:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 71290880. Throughput: 0: 9391.2. Samples: 71271480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:22,720][146380] Avg episode reward: [(0, '3964.935')] [2023-03-12 06:35:24,770][146667] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-12 06:35:27,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 71335936. Throughput: 0: 9303.6. Samples: 71324688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:27,720][146380] Avg episode reward: [(0, '4182.275')] [2023-03-12 06:35:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139328_71335936.pth... [2023-03-12 06:35:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000138784_71057408.pth [2023-03-12 06:35:29,501][146667] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-12 06:35:32,719][146380] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 71376896. Throughput: 0: 9193.0. Samples: 71376896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:32,720][146380] Avg episode reward: [(0, '3975.351')] [2023-03-12 06:35:34,304][146667] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-12 06:35:37,719][146380] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 71421952. Throughput: 0: 9147.6. Samples: 71402404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:37,720][146380] Avg episode reward: [(0, '3895.391')] [2023-03-12 06:35:38,858][146667] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-12 06:35:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 71467008. Throughput: 0: 9110.8. Samples: 71456940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:42,720][146380] Avg episode reward: [(0, '4199.934')] [2023-03-12 06:35:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139584_71467008.pth... [2023-03-12 06:35:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139056_71196672.pth [2023-03-12 06:35:43,324][146667] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-12 06:35:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 71512064. Throughput: 0: 9058.5. Samples: 71511052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:47,720][146380] Avg episode reward: [(0, '4243.001')] [2023-03-12 06:35:47,974][146667] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-12 06:35:52,590][146667] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-12 06:35:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9288.9). Total num frames: 71557120. Throughput: 0: 9013.2. Samples: 71536732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:52,720][146380] Avg episode reward: [(0, '4334.898')] [2023-03-12 06:35:57,210][146667] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-12 06:35:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 71602176. Throughput: 0: 8992.8. Samples: 71589984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:35:57,720][146380] Avg episode reward: [(0, '4250.634')] [2023-03-12 06:35:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139848_71602176.pth... [2023-03-12 06:35:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139328_71335936.pth [2023-03-12 06:36:01,833][146667] Updated weights for policy 0, policy_version 139920 (0.0004) [2023-03-12 06:36:02,719][146380] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9261.1). Total num frames: 71643136. Throughput: 0: 8878.3. Samples: 71643548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:02,720][146380] Avg episode reward: [(0, '4387.287')] [2023-03-12 06:36:06,257][146667] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-12 06:36:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 71692288. Throughput: 0: 8896.2. Samples: 71671808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:07,720][146380] Avg episode reward: [(0, '4549.071')] [2023-03-12 06:36:10,715][146667] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-12 06:36:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9275.0). Total num frames: 71737344. Throughput: 0: 8932.1. Samples: 71726632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:12,720][146380] Avg episode reward: [(0, '4584.373')] [2023-03-12 06:36:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140112_71737344.pth... [2023-03-12 06:36:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139584_71467008.pth [2023-03-12 06:36:15,211][146667] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-12 06:36:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9275.0). Total num frames: 71782400. Throughput: 0: 9001.3. Samples: 71781956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:17,720][146380] Avg episode reward: [(0, '4563.519')] [2023-03-12 06:36:19,624][146667] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-12 06:36:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9275.0). Total num frames: 71827456. Throughput: 0: 9051.0. Samples: 71809700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:22,720][146380] Avg episode reward: [(0, '4581.588')] [2023-03-12 06:36:24,041][146667] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-12 06:36:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9275.0). Total num frames: 71876608. Throughput: 0: 9062.3. Samples: 71864744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:27,720][146380] Avg episode reward: [(0, '4561.427')] [2023-03-12 06:36:27,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140384_71876608.pth... [2023-03-12 06:36:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000139848_71602176.pth [2023-03-12 06:36:28,526][146667] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-12 06:36:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 71921664. Throughput: 0: 9085.3. Samples: 71919892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:32,720][146380] Avg episode reward: [(0, '4528.439')] [2023-03-12 06:36:32,989][146667] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-12 06:36:37,372][146667] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-12 06:36:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 71966720. Throughput: 0: 9130.0. Samples: 71947584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:37,720][146380] Avg episode reward: [(0, '4568.603')] [2023-03-12 06:36:41,897][146667] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-12 06:36:42,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 72011776. Throughput: 0: 9184.4. Samples: 72003280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:42,720][146380] Avg episode reward: [(0, '4575.343')] [2023-03-12 06:36:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140648_72011776.pth... [2023-03-12 06:36:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140112_71737344.pth [2023-03-12 06:36:46,370][146667] Updated weights for policy 0, policy_version 140720 (0.0004) [2023-03-12 06:36:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 72060928. Throughput: 0: 9202.8. Samples: 72057676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:47,720][146380] Avg episode reward: [(0, '4576.038')] [2023-03-12 06:36:50,768][146667] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-12 06:36:52,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 72105984. Throughput: 0: 9194.7. Samples: 72085568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:52,720][146380] Avg episode reward: [(0, '4571.074')] [2023-03-12 06:36:54,909][146667] Updated weights for policy 0, policy_version 140880 (0.0004) [2023-03-12 06:36:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 72155136. Throughput: 0: 9272.9. Samples: 72143912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:36:57,720][146380] Avg episode reward: [(0, '4584.832')] [2023-03-12 06:36:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140928_72155136.pth... [2023-03-12 06:36:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140384_71876608.pth [2023-03-12 06:36:59,298][146667] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-12 06:37:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 72204288. Throughput: 0: 9320.7. Samples: 72201388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:02,720][146380] Avg episode reward: [(0, '4531.309')] [2023-03-12 06:37:03,533][146667] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-12 06:37:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 72249344. Throughput: 0: 9326.2. Samples: 72229380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:07,720][146380] Avg episode reward: [(0, '4559.351')] [2023-03-12 06:37:07,908][146667] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-12 06:37:12,412][146667] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-12 06:37:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72294400. Throughput: 0: 9336.4. Samples: 72284884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:12,720][146380] Avg episode reward: [(0, '4572.329')] [2023-03-12 06:37:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141200_72294400.pth... [2023-03-12 06:37:12,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140648_72011776.pth [2023-03-12 06:37:16,875][146667] Updated weights for policy 0, policy_version 141280 (0.0006) [2023-03-12 06:37:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72339456. Throughput: 0: 9325.1. Samples: 72339520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:17,720][146380] Avg episode reward: [(0, '4572.602')] [2023-03-12 06:37:21,409][146667] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-12 06:37:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72384512. Throughput: 0: 9312.0. Samples: 72366624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:22,720][146380] Avg episode reward: [(0, '4582.203')] [2023-03-12 06:37:25,898][146667] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-12 06:37:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72433664. Throughput: 0: 9291.3. Samples: 72421388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:27,720][146380] Avg episode reward: [(0, '4541.702')] [2023-03-12 06:37:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141472_72433664.pth... [2023-03-12 06:37:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000140928_72155136.pth [2023-03-12 06:37:30,309][146667] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-12 06:37:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72478720. Throughput: 0: 9314.5. Samples: 72476828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:32,720][146380] Avg episode reward: [(0, '4513.163')] [2023-03-12 06:37:34,764][146667] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-12 06:37:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72523776. Throughput: 0: 9301.1. Samples: 72504116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:37,720][146380] Avg episode reward: [(0, '4531.781')] [2023-03-12 06:37:39,330][146667] Updated weights for policy 0, policy_version 141680 (0.0005) [2023-03-12 06:37:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72568832. Throughput: 0: 9212.3. Samples: 72558464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:42,720][146380] Avg episode reward: [(0, '4566.317')] [2023-03-12 06:37:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141736_72568832.pth... [2023-03-12 06:37:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141200_72294400.pth [2023-03-12 06:37:43,796][146667] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-12 06:37:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72617984. Throughput: 0: 9232.6. Samples: 72616856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:47,720][146380] Avg episode reward: [(0, '4567.146')] [2023-03-12 06:37:47,846][146667] Updated weights for policy 0, policy_version 141840 (0.0003) [2023-03-12 06:37:52,178][146667] Updated weights for policy 0, policy_version 141920 (0.0004) [2023-03-12 06:37:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 72667136. Throughput: 0: 9261.1. Samples: 72646128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:52,720][146380] Avg episode reward: [(0, '4568.185')] [2023-03-12 06:37:56,653][146667] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-12 06:37:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72712192. Throughput: 0: 9245.8. Samples: 72700944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:37:57,720][146380] Avg episode reward: [(0, '4554.974')] [2023-03-12 06:37:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142016_72712192.pth... [2023-03-12 06:37:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141472_72433664.pth [2023-03-12 06:38:01,072][146667] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-12 06:38:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 72757248. Throughput: 0: 9280.9. Samples: 72757160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:02,720][146380] Avg episode reward: [(0, '4535.934')] [2023-03-12 06:38:05,509][146667] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-12 06:38:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72806400. Throughput: 0: 9282.2. Samples: 72784324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:07,720][146380] Avg episode reward: [(0, '4473.753')] [2023-03-12 06:38:09,998][146667] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-12 06:38:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72851456. Throughput: 0: 9285.6. Samples: 72839240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:12,720][146380] Avg episode reward: [(0, '4531.123')] [2023-03-12 06:38:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142288_72851456.pth... [2023-03-12 06:38:12,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000141736_72568832.pth [2023-03-12 06:38:14,466][146667] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-12 06:38:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72896512. Throughput: 0: 9293.2. Samples: 72895024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:17,720][146380] Avg episode reward: [(0, '4570.894')] [2023-03-12 06:38:18,878][146667] Updated weights for policy 0, policy_version 142400 (0.0004) [2023-03-12 06:38:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 72941568. Throughput: 0: 9295.6. Samples: 72922420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:22,720][146380] Avg episode reward: [(0, '4566.973')] [2023-03-12 06:38:23,293][146667] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-12 06:38:27,565][146667] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-12 06:38:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 72990720. Throughput: 0: 9334.0. Samples: 72978496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:27,720][146380] Avg episode reward: [(0, '4572.234')] [2023-03-12 06:38:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142560_72990720.pth... [2023-03-12 06:38:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142016_72712192.pth [2023-03-12 06:38:32,067][146667] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-12 06:38:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 73035776. Throughput: 0: 9282.4. Samples: 73034564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:32,720][146380] Avg episode reward: [(0, '4565.492')] [2023-03-12 06:38:36,469][146667] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-12 06:38:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 73080832. Throughput: 0: 9246.8. Samples: 73062232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:37,720][146380] Avg episode reward: [(0, '4539.114')] [2023-03-12 06:38:40,937][146667] Updated weights for policy 0, policy_version 142800 (0.0005) [2023-03-12 06:38:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 73129984. Throughput: 0: 9261.3. Samples: 73117704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:42,720][146380] Avg episode reward: [(0, '4474.900')] [2023-03-12 06:38:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142832_73129984.pth... [2023-03-12 06:38:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142288_72851456.pth [2023-03-12 06:38:45,388][146667] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-12 06:38:47,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 73175040. Throughput: 0: 9224.7. Samples: 73172272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:47,720][146380] Avg episode reward: [(0, '4564.329')] [2023-03-12 06:38:49,848][146667] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-12 06:38:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 73220096. Throughput: 0: 9230.3. Samples: 73199688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:52,720][146380] Avg episode reward: [(0, '4582.998')] [2023-03-12 06:38:54,301][146667] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-12 06:38:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 73265152. Throughput: 0: 9246.6. Samples: 73255340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:38:57,720][146380] Avg episode reward: [(0, '4449.048')] [2023-03-12 06:38:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143096_73265152.pth... [2023-03-12 06:38:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142560_72990720.pth [2023-03-12 06:38:58,678][146667] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-12 06:39:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 73314304. Throughput: 0: 9249.8. Samples: 73311264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:39:02,720][146380] Avg episode reward: [(0, '4489.325')] [2023-03-12 06:39:03,056][146667] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-12 06:39:07,396][146667] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-12 06:39:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 73359360. Throughput: 0: 9293.8. Samples: 73340640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:39:07,720][146380] Avg episode reward: [(0, '4514.563')] [2023-03-12 06:39:11,889][146667] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-12 06:39:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 73404416. Throughput: 0: 9271.9. Samples: 73395732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:39:12,720][146380] Avg episode reward: [(0, '4526.351')] [2023-03-12 06:39:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143368_73404416.pth... [2023-03-12 06:39:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000142832_73129984.pth [2023-03-12 06:39:16,412][146667] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-12 06:39:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 73453568. Throughput: 0: 9235.3. Samples: 73450152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:39:17,720][146380] Avg episode reward: [(0, '4533.488')] [2023-03-12 06:39:20,632][146667] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-12 06:39:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 73498624. Throughput: 0: 9270.6. Samples: 73479408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:22,720][146380] Avg episode reward: [(0, '4551.967')] [2023-03-12 06:39:24,885][146667] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-12 06:39:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 73547776. Throughput: 0: 9300.7. Samples: 73536236. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:27,720][146380] Avg episode reward: [(0, '4503.764')] [2023-03-12 06:39:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143648_73547776.pth... [2023-03-12 06:39:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143096_73265152.pth [2023-03-12 06:39:29,319][146667] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-12 06:39:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 73596928. Throughput: 0: 9364.4. Samples: 73593668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:32,730][146380] Avg episode reward: [(0, '4559.810')] [2023-03-12 06:39:33,498][146667] Updated weights for policy 0, policy_version 143760 (0.0004) [2023-03-12 06:39:37,562][146667] Updated weights for policy 0, policy_version 143840 (0.0004) [2023-03-12 06:39:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 73646080. Throughput: 0: 9416.5. Samples: 73623432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:37,720][146380] Avg episode reward: [(0, '4537.321')] [2023-03-12 06:39:41,807][146667] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-12 06:39:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 73695232. Throughput: 0: 9502.3. Samples: 73682944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:42,731][146380] Avg episode reward: [(0, '4575.807')] [2023-03-12 06:39:42,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143936_73695232.pth... [2023-03-12 06:39:42,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143368_73404416.pth [2023-03-12 06:39:46,011][146667] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-12 06:39:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 73744384. Throughput: 0: 9558.8. Samples: 73741408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:47,720][146380] Avg episode reward: [(0, '4531.710')] [2023-03-12 06:39:50,244][146667] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-12 06:39:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 73789440. Throughput: 0: 9533.9. Samples: 73769664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:52,720][146380] Avg episode reward: [(0, '4578.240')] [2023-03-12 06:39:54,473][146667] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-12 06:39:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9261.1). Total num frames: 73838592. Throughput: 0: 9613.7. Samples: 73828348. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:39:57,720][146380] Avg episode reward: [(0, '4580.763')] [2023-03-12 06:39:57,785][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144224_73842688.pth... [2023-03-12 06:39:57,787][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143648_73547776.pth [2023-03-12 06:39:58,676][146667] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-12 06:40:02,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9288.9). Total num frames: 73887744. Throughput: 0: 9639.7. Samples: 73883940. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:40:02,720][146380] Avg episode reward: [(0, '4563.363')] [2023-03-12 06:40:03,183][146667] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-12 06:40:07,644][146667] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-12 06:40:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 73932800. Throughput: 0: 9609.0. Samples: 73911812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:40:07,720][146380] Avg episode reward: [(0, '4536.726')] [2023-03-12 06:40:12,110][146667] Updated weights for policy 0, policy_version 144480 (0.0005) [2023-03-12 06:40:12,720][146380] Fps is (10 sec: 9011.0, 60 sec: 9557.3, 300 sec: 9261.1). Total num frames: 73977856. Throughput: 0: 9561.7. Samples: 73966516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:40:12,720][146380] Avg episode reward: [(0, '4536.265')] [2023-03-12 06:40:12,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144488_73977856.pth... [2023-03-12 06:40:12,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000143936_73695232.pth [2023-03-12 06:40:16,544][146667] Updated weights for policy 0, policy_version 144560 (0.0004) [2023-03-12 06:40:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 74022912. Throughput: 0: 9528.4. Samples: 74022448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:40:17,720][146380] Avg episode reward: [(0, '4575.231')] [2023-03-12 06:40:21,024][146667] Updated weights for policy 0, policy_version 144640 (0.0003) [2023-03-12 06:40:22,719][146380] Fps is (10 sec: 9011.4, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 74067968. Throughput: 0: 9472.4. Samples: 74049692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:40:22,720][146380] Avg episode reward: [(0, '4571.300')] [2023-03-12 06:40:25,474][146667] Updated weights for policy 0, policy_version 144720 (0.0003) [2023-03-12 06:40:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 74117120. Throughput: 0: 9375.3. Samples: 74104832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:27,720][146380] Avg episode reward: [(0, '4567.780')] [2023-03-12 06:40:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144760_74117120.pth... [2023-03-12 06:40:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144224_73842688.pth [2023-03-12 06:40:29,869][146667] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-12 06:40:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 74162176. Throughput: 0: 9307.7. Samples: 74160256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:32,730][146380] Avg episode reward: [(0, '4542.854')] [2023-03-12 06:40:34,331][146667] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-12 06:40:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 74207232. Throughput: 0: 9287.3. Samples: 74187592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:37,720][146380] Avg episode reward: [(0, '4591.069')] [2023-03-12 06:40:38,724][146667] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-12 06:40:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 74256384. Throughput: 0: 9239.0. Samples: 74244104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:42,720][146380] Avg episode reward: [(0, '4576.076')] [2023-03-12 06:40:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145032_74256384.pth... [2023-03-12 06:40:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144488_73977856.pth [2023-03-12 06:40:43,103][146667] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-12 06:40:47,158][146667] Updated weights for policy 0, policy_version 145120 (0.0004) [2023-03-12 06:40:47,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 74305536. Throughput: 0: 9316.6. Samples: 74303188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:47,720][146380] Avg episode reward: [(0, '4568.476')] [2023-03-12 06:40:51,344][146667] Updated weights for policy 0, policy_version 145200 (0.0004) [2023-03-12 06:40:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 74354688. Throughput: 0: 9349.7. Samples: 74332548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:52,720][146380] Avg episode reward: [(0, '4572.165')] [2023-03-12 06:40:55,524][146667] Updated weights for policy 0, policy_version 145280 (0.0004) [2023-03-12 06:40:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74399744. Throughput: 0: 9442.2. Samples: 74391412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:40:57,720][146380] Avg episode reward: [(0, '4568.945')] [2023-03-12 06:40:57,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145320_74403840.pth... [2023-03-12 06:40:57,730][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000144760_74117120.pth [2023-03-12 06:40:59,948][146667] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-12 06:41:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74448896. Throughput: 0: 9430.0. Samples: 74446800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:02,720][146380] Avg episode reward: [(0, '4577.521')] [2023-03-12 06:41:04,329][146667] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-12 06:41:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74493952. Throughput: 0: 9434.0. Samples: 74474220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:07,720][146380] Avg episode reward: [(0, '4576.624')] [2023-03-12 06:41:08,812][146667] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-12 06:41:12,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 74539008. Throughput: 0: 9442.2. Samples: 74529732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:12,720][146380] Avg episode reward: [(0, '4571.738')] [2023-03-12 06:41:12,776][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145592_74543104.pth... [2023-03-12 06:41:12,777][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145032_74256384.pth [2023-03-12 06:41:13,228][146667] Updated weights for policy 0, policy_version 145600 (0.0004) [2023-03-12 06:41:17,714][146667] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-12 06:41:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 74588160. Throughput: 0: 9422.9. Samples: 74584288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:17,730][146380] Avg episode reward: [(0, '4563.659')] [2023-03-12 06:41:22,113][146667] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-12 06:41:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 74633216. Throughput: 0: 9449.1. Samples: 74612800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:22,720][146380] Avg episode reward: [(0, '4565.928')] [2023-03-12 06:41:26,642][146667] Updated weights for policy 0, policy_version 145840 (0.0005) [2023-03-12 06:41:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74678272. Throughput: 0: 9403.6. Samples: 74667268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:27,723][146380] Avg episode reward: [(0, '4472.488')] [2023-03-12 06:41:27,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145856_74678272.pth... [2023-03-12 06:41:27,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145320_74403840.pth [2023-03-12 06:41:31,204][146667] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-12 06:41:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74723328. Throughput: 0: 9289.2. Samples: 74721200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:32,720][146380] Avg episode reward: [(0, '4435.661')] [2023-03-12 06:41:35,730][146667] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-12 06:41:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74768384. Throughput: 0: 9233.2. Samples: 74748044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:37,720][146380] Avg episode reward: [(0, '4422.483')] [2023-03-12 06:41:39,927][146667] Updated weights for policy 0, policy_version 146080 (0.0004) [2023-03-12 06:41:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74817536. Throughput: 0: 9231.8. Samples: 74806844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:42,720][146380] Avg episode reward: [(0, '4521.062')] [2023-03-12 06:41:42,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146128_74817536.pth... [2023-03-12 06:41:42,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145592_74543104.pth [2023-03-12 06:41:44,085][146667] Updated weights for policy 0, policy_version 146160 (0.0004) [2023-03-12 06:41:47,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 74866688. Throughput: 0: 9269.5. Samples: 74863928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:47,720][146380] Avg episode reward: [(0, '4573.625')] [2023-03-12 06:41:48,528][146667] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-12 06:41:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 74911744. Throughput: 0: 9270.6. Samples: 74891396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:52,720][146380] Avg episode reward: [(0, '4502.696')] [2023-03-12 06:41:52,960][146667] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-12 06:41:57,210][146667] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-12 06:41:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 74960896. Throughput: 0: 9309.8. Samples: 74948672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:41:57,720][146380] Avg episode reward: [(0, '4578.294')] [2023-03-12 06:41:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146408_74960896.pth... [2023-03-12 06:41:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000145856_74678272.pth [2023-03-12 06:42:01,690][146667] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-12 06:42:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75005952. Throughput: 0: 9325.1. Samples: 75003916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:02,720][146380] Avg episode reward: [(0, '4568.046')] [2023-03-12 06:42:06,124][146667] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-12 06:42:07,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75051008. Throughput: 0: 9301.6. Samples: 75031372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:07,720][146380] Avg episode reward: [(0, '4571.817')] [2023-03-12 06:42:10,644][146667] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-12 06:42:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75096064. Throughput: 0: 9316.4. Samples: 75086504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:12,720][146380] Avg episode reward: [(0, '4562.367')] [2023-03-12 06:42:12,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146672_75096064.pth... [2023-03-12 06:42:12,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146128_74817536.pth [2023-03-12 06:42:15,087][146667] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-12 06:42:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 75141120. Throughput: 0: 9333.2. Samples: 75141192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:17,720][146380] Avg episode reward: [(0, '4559.976')] [2023-03-12 06:42:19,516][146667] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-12 06:42:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75190272. Throughput: 0: 9361.8. Samples: 75169324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:22,720][146380] Avg episode reward: [(0, '4584.263')] [2023-03-12 06:42:23,959][146667] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-12 06:42:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75235328. Throughput: 0: 9266.7. Samples: 75223844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:42:27,720][146380] Avg episode reward: [(0, '4572.870')] [2023-03-12 06:42:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146944_75235328.pth... [2023-03-12 06:42:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146408_74960896.pth [2023-03-12 06:42:28,529][146667] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-12 06:42:32,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75280384. Throughput: 0: 9235.5. Samples: 75279524. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:32,720][146380] Avg episode reward: [(0, '4586.853')] [2023-03-12 06:42:32,922][146667] Updated weights for policy 0, policy_version 147040 (0.0006) [2023-03-12 06:42:37,420][146667] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-12 06:42:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75325440. Throughput: 0: 9231.0. Samples: 75306792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:37,720][146380] Avg episode reward: [(0, '4579.223')] [2023-03-12 06:42:41,914][146667] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-12 06:42:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 75370496. Throughput: 0: 9168.5. Samples: 75361256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:42,720][146380] Avg episode reward: [(0, '4580.276')] [2023-03-12 06:42:42,749][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147216_75374592.pth... [2023-03-12 06:42:42,750][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146672_75096064.pth [2023-03-12 06:42:46,324][146667] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-12 06:42:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 75419648. Throughput: 0: 9153.9. Samples: 75415840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:47,720][146380] Avg episode reward: [(0, '4532.803')] [2023-03-12 06:42:50,785][146667] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-12 06:42:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 75464704. Throughput: 0: 9174.9. Samples: 75444240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:52,720][146380] Avg episode reward: [(0, '4580.653')] [2023-03-12 06:42:55,224][146667] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-12 06:42:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 75509760. Throughput: 0: 9179.3. Samples: 75499572. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:42:57,720][146380] Avg episode reward: [(0, '4580.269')] [2023-03-12 06:42:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147480_75509760.pth... [2023-03-12 06:42:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000146944_75235328.pth [2023-03-12 06:42:59,666][146667] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-12 06:43:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 75554816. Throughput: 0: 9193.8. Samples: 75554912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:02,720][146380] Avg episode reward: [(0, '4582.433')] [2023-03-12 06:43:04,056][146667] Updated weights for policy 0, policy_version 147600 (0.0006) [2023-03-12 06:43:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 75603968. Throughput: 0: 9203.8. Samples: 75583496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:07,720][146380] Avg episode reward: [(0, '4566.982')] [2023-03-12 06:43:08,543][146667] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-12 06:43:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 75649024. Throughput: 0: 9208.6. Samples: 75638232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:12,720][146380] Avg episode reward: [(0, '4573.822')] [2023-03-12 06:43:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147752_75649024.pth... [2023-03-12 06:43:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147216_75374592.pth [2023-03-12 06:43:12,977][146667] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-12 06:43:17,425][146667] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-12 06:43:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 75694080. Throughput: 0: 9205.8. Samples: 75693784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:17,720][146380] Avg episode reward: [(0, '4577.326')] [2023-03-12 06:43:21,876][146667] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-12 06:43:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 75739136. Throughput: 0: 9214.0. Samples: 75721424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:22,720][146380] Avg episode reward: [(0, '4580.240')] [2023-03-12 06:43:26,223][146667] Updated weights for policy 0, policy_version 148000 (0.0006) [2023-03-12 06:43:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 75788288. Throughput: 0: 9238.1. Samples: 75776972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:27,720][146380] Avg episode reward: [(0, '4574.793')] [2023-03-12 06:43:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148024_75788288.pth... [2023-03-12 06:43:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147480_75509760.pth [2023-03-12 06:43:30,353][146667] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-12 06:43:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 75837440. Throughput: 0: 9352.7. Samples: 75836712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 06:43:32,720][146380] Avg episode reward: [(0, '4569.467')] [2023-03-12 06:43:34,440][146667] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-12 06:43:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 75886592. Throughput: 0: 9377.5. Samples: 75866228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:43:37,720][146380] Avg episode reward: [(0, '4580.040')] [2023-03-12 06:43:38,579][146667] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-12 06:43:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 75935744. Throughput: 0: 9484.9. Samples: 75926392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:43:42,720][146380] Avg episode reward: [(0, '4582.153')] [2023-03-12 06:43:42,738][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148320_75939840.pth... [2023-03-12 06:43:42,738][146667] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-12 06:43:42,739][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000147752_75649024.pth [2023-03-12 06:43:46,822][146667] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-12 06:43:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 75988992. Throughput: 0: 9569.5. Samples: 75985540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:43:47,720][146380] Avg episode reward: [(0, '4576.800')] [2023-03-12 06:43:50,979][146667] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-12 06:43:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 76038144. Throughput: 0: 9597.2. Samples: 76015372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:43:52,720][146380] Avg episode reward: [(0, '4578.349')] [2023-03-12 06:43:55,147][146667] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-12 06:43:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 76083200. Throughput: 0: 9689.8. Samples: 76074272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:43:57,720][146380] Avg episode reward: [(0, '4540.848')] [2023-03-12 06:43:57,737][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148608_76087296.pth... [2023-03-12 06:43:57,738][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148024_75788288.pth [2023-03-12 06:43:59,485][146667] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-12 06:44:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 76132352. Throughput: 0: 9733.3. Samples: 76131784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:02,720][146380] Avg episode reward: [(0, '4573.672')] [2023-03-12 06:44:03,665][146667] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-12 06:44:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 76181504. Throughput: 0: 9769.1. Samples: 76161032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:07,720][146380] Avg episode reward: [(0, '4530.487')] [2023-03-12 06:44:07,926][146667] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-12 06:44:12,172][146667] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-12 06:44:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9413.9). Total num frames: 76230656. Throughput: 0: 9810.2. Samples: 76218432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:12,720][146380] Avg episode reward: [(0, '4535.005')] [2023-03-12 06:44:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148888_76230656.pth... [2023-03-12 06:44:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148320_75939840.pth [2023-03-12 06:44:16,358][146667] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-12 06:44:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 76279808. Throughput: 0: 9788.7. Samples: 76277204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:17,720][146380] Avg episode reward: [(0, '4507.817')] [2023-03-12 06:44:20,454][146667] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-12 06:44:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9427.7). Total num frames: 76328960. Throughput: 0: 9810.2. Samples: 76307688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:22,720][146380] Avg episode reward: [(0, '4575.737')] [2023-03-12 06:44:24,832][146667] Updated weights for policy 0, policy_version 149120 (0.0006) [2023-03-12 06:44:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9413.9). Total num frames: 76374016. Throughput: 0: 9709.0. Samples: 76363296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:27,720][146380] Avg episode reward: [(0, '4583.643')] [2023-03-12 06:44:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149168_76374016.pth... [2023-03-12 06:44:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148608_76087296.pth [2023-03-12 06:44:29,299][146667] Updated weights for policy 0, policy_version 149200 (0.0006) [2023-03-12 06:44:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 76419072. Throughput: 0: 9634.0. Samples: 76419072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:44:32,720][146380] Avg episode reward: [(0, '4575.348')] [2023-03-12 06:44:33,689][146667] Updated weights for policy 0, policy_version 149280 (0.0006) [2023-03-12 06:44:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 76468224. Throughput: 0: 9589.1. Samples: 76446880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:44:37,720][146380] Avg episode reward: [(0, '4581.147')] [2023-03-12 06:44:38,076][146667] Updated weights for policy 0, policy_version 149360 (0.0006) [2023-03-12 06:44:42,202][146667] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-12 06:44:42,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9400.0). Total num frames: 76517376. Throughput: 0: 9570.7. Samples: 76504952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:44:42,720][146380] Avg episode reward: [(0, '4581.481')] [2023-03-12 06:44:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149448_76517376.pth... [2023-03-12 06:44:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000148888_76230656.pth [2023-03-12 06:44:46,500][146667] Updated weights for policy 0, policy_version 149520 (0.0004) [2023-03-12 06:44:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 76562432. Throughput: 0: 9570.4. Samples: 76562452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:44:47,720][146380] Avg episode reward: [(0, '4574.063')] [2023-03-12 06:44:50,842][146667] Updated weights for policy 0, policy_version 149600 (0.0004) [2023-03-12 06:44:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 76611584. Throughput: 0: 9553.8. Samples: 76590952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:44:52,720][146380] Avg episode reward: [(0, '4577.098')] [2023-03-12 06:44:55,140][146667] Updated weights for policy 0, policy_version 149680 (0.0004) [2023-03-12 06:44:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 76660736. Throughput: 0: 9536.3. Samples: 76647564. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:44:57,720][146380] Avg episode reward: [(0, '4532.438')] [2023-03-12 06:44:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149728_76660736.pth... [2023-03-12 06:44:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149168_76374016.pth [2023-03-12 06:44:59,342][146667] Updated weights for policy 0, policy_version 149760 (0.0003) [2023-03-12 06:45:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 76709888. Throughput: 0: 9538.4. Samples: 76706432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:02,720][146380] Avg episode reward: [(0, '4546.148')] [2023-03-12 06:45:03,516][146667] Updated weights for policy 0, policy_version 149840 (0.0004) [2023-03-12 06:45:07,671][146667] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-12 06:45:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9427.8). Total num frames: 76759040. Throughput: 0: 9508.4. Samples: 76735568. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:07,720][146380] Avg episode reward: [(0, '4581.723')] [2023-03-12 06:45:11,800][146667] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-12 06:45:12,720][146380] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 76808192. Throughput: 0: 9606.4. Samples: 76795584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:12,720][146380] Avg episode reward: [(0, '4571.895')] [2023-03-12 06:45:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150016_76808192.pth... [2023-03-12 06:45:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149448_76517376.pth [2023-03-12 06:45:15,938][146667] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-12 06:45:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 76857344. Throughput: 0: 9672.9. Samples: 76854352. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:17,720][146380] Avg episode reward: [(0, '4587.185')] [2023-03-12 06:45:20,351][146667] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-12 06:45:22,719][146380] Fps is (10 sec: 9421.0, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 76902400. Throughput: 0: 9667.7. Samples: 76881928. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:22,720][146380] Avg episode reward: [(0, '4540.883')] [2023-03-12 06:45:24,716][146667] Updated weights for policy 0, policy_version 150240 (0.0006) [2023-03-12 06:45:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 76951552. Throughput: 0: 9623.1. Samples: 76937992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:27,720][146380] Avg episode reward: [(0, '4582.010')] [2023-03-12 06:45:27,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150296_76951552.pth... [2023-03-12 06:45:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000149728_76660736.pth [2023-03-12 06:45:28,926][146667] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-12 06:45:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 77000704. Throughput: 0: 9676.3. Samples: 76997884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:32,720][146380] Avg episode reward: [(0, '4574.573')] [2023-03-12 06:45:33,003][146667] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-12 06:45:37,092][146667] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-12 06:45:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 77049856. Throughput: 0: 9710.6. Samples: 77027928. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 06:45:37,720][146380] Avg episode reward: [(0, '4572.080')] [2023-03-12 06:45:41,168][146667] Updated weights for policy 0, policy_version 150560 (0.0004) [2023-03-12 06:45:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 77099008. Throughput: 0: 9788.6. Samples: 77088052. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:45:42,720][146380] Avg episode reward: [(0, '4576.796')] [2023-03-12 06:45:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150584_77099008.pth... [2023-03-12 06:45:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150016_76808192.pth [2023-03-12 06:45:45,294][146667] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-12 06:45:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 77148160. Throughput: 0: 9815.5. Samples: 77148128. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:45:47,720][146380] Avg episode reward: [(0, '4562.914')] [2023-03-12 06:45:49,384][146667] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-12 06:45:52,719][146380] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 77201408. Throughput: 0: 9826.1. Samples: 77177744. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:45:52,720][146380] Avg episode reward: [(0, '4577.725')] [2023-03-12 06:45:53,482][146667] Updated weights for policy 0, policy_version 150800 (0.0004) [2023-03-12 06:45:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 77246464. Throughput: 0: 9803.2. Samples: 77236728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:45:57,720][146380] Avg episode reward: [(0, '4567.538')] [2023-03-12 06:45:57,742][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150880_77250560.pth... [2023-03-12 06:45:57,742][146667] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-12 06:45:57,744][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150296_76951552.pth [2023-03-12 06:46:02,029][146667] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-12 06:46:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9497.2). Total num frames: 77295616. Throughput: 0: 9789.2. Samples: 77294868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:02,720][146380] Avg episode reward: [(0, '4573.619')] [2023-03-12 06:46:06,410][146667] Updated weights for policy 0, policy_version 151040 (0.0004) [2023-03-12 06:46:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9497.2). Total num frames: 77340672. Throughput: 0: 9801.9. Samples: 77323012. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:07,720][146380] Avg episode reward: [(0, '4578.536')] [2023-03-12 06:46:10,872][146667] Updated weights for policy 0, policy_version 151120 (0.0003) [2023-03-12 06:46:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9497.2). Total num frames: 77389824. Throughput: 0: 9769.1. Samples: 77377600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:12,720][146380] Avg episode reward: [(0, '4579.286')] [2023-03-12 06:46:12,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151152_77389824.pth... [2023-03-12 06:46:12,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150584_77099008.pth [2023-03-12 06:46:15,121][146667] Updated weights for policy 0, policy_version 151200 (0.0004) [2023-03-12 06:46:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 77438976. Throughput: 0: 9745.8. Samples: 77436444. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:17,720][146380] Avg episode reward: [(0, '4579.168')] [2023-03-12 06:46:19,178][146667] Updated weights for policy 0, policy_version 151280 (0.0004) [2023-03-12 06:46:22,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9524.9). Total num frames: 77488128. Throughput: 0: 9741.1. Samples: 77466276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:22,720][146380] Avg episode reward: [(0, '4572.460')] [2023-03-12 06:46:23,510][146667] Updated weights for policy 0, policy_version 151360 (0.0004) [2023-03-12 06:46:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 77533184. Throughput: 0: 9681.6. Samples: 77523724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:27,720][146380] Avg episode reward: [(0, '4577.726')] [2023-03-12 06:46:27,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151432_77533184.pth... [2023-03-12 06:46:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000150880_77250560.pth [2023-03-12 06:46:27,802][146667] Updated weights for policy 0, policy_version 151440 (0.0004) [2023-03-12 06:46:32,043][146667] Updated weights for policy 0, policy_version 151520 (0.0003) [2023-03-12 06:46:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 77582336. Throughput: 0: 9622.6. Samples: 77581144. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:32,720][146380] Avg episode reward: [(0, '4588.915')] [2023-03-12 06:46:36,194][146667] Updated weights for policy 0, policy_version 151600 (0.0004) [2023-03-12 06:46:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 77631488. Throughput: 0: 9625.9. Samples: 77610912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:37,720][146380] Avg episode reward: [(0, '4579.527')] [2023-03-12 06:46:40,524][146667] Updated weights for policy 0, policy_version 151680 (0.0003) [2023-03-12 06:46:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 77680640. Throughput: 0: 9586.0. Samples: 77668100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 06:46:42,720][146380] Avg episode reward: [(0, '4579.452')] [2023-03-12 06:46:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151720_77680640.pth... [2023-03-12 06:46:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151152_77389824.pth [2023-03-12 06:46:44,693][146667] Updated weights for policy 0, policy_version 151760 (0.0004) [2023-03-12 06:46:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 77725696. Throughput: 0: 9575.4. Samples: 77725760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:46:47,720][146380] Avg episode reward: [(0, '4543.640')] [2023-03-12 06:46:48,989][146667] Updated weights for policy 0, policy_version 151840 (0.0004) [2023-03-12 06:46:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 77778944. Throughput: 0: 9615.9. Samples: 77755728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:46:52,720][146380] Avg episode reward: [(0, '4576.654')] [2023-03-12 06:46:53,117][146667] Updated weights for policy 0, policy_version 151920 (0.0003) [2023-03-12 06:46:57,354][146667] Updated weights for policy 0, policy_version 152000 (0.0003) [2023-03-12 06:46:57,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 77824000. Throughput: 0: 9697.8. Samples: 77814000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:46:57,720][146380] Avg episode reward: [(0, '4583.043')] [2023-03-12 06:46:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152000_77824000.pth... [2023-03-12 06:46:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151432_77533184.pth [2023-03-12 06:47:01,557][146667] Updated weights for policy 0, policy_version 152080 (0.0004) [2023-03-12 06:47:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 77873152. Throughput: 0: 9690.5. Samples: 77872516. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:02,720][146380] Avg episode reward: [(0, '4590.051')] [2023-03-12 06:47:05,780][146667] Updated weights for policy 0, policy_version 152160 (0.0003) [2023-03-12 06:47:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 77922304. Throughput: 0: 9669.6. Samples: 77901408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:07,720][146380] Avg episode reward: [(0, '4580.601')] [2023-03-12 06:47:09,917][146667] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-12 06:47:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 77971456. Throughput: 0: 9707.3. Samples: 77960552. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:12,720][146380] Avg episode reward: [(0, '4577.501')] [2023-03-12 06:47:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152288_77971456.pth... [2023-03-12 06:47:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000151720_77680640.pth [2023-03-12 06:47:14,089][146667] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-12 06:47:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 78020608. Throughput: 0: 9711.9. Samples: 78018180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:17,720][146380] Avg episode reward: [(0, '4581.817')] [2023-03-12 06:47:18,486][146667] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-12 06:47:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 78065664. Throughput: 0: 9656.2. Samples: 78045440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:22,720][146380] Avg episode reward: [(0, '4576.807')] [2023-03-12 06:47:22,909][146667] Updated weights for policy 0, policy_version 152480 (0.0006) [2023-03-12 06:47:27,265][146667] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-12 06:47:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 78114816. Throughput: 0: 9650.7. Samples: 78102380. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:27,720][146380] Avg episode reward: [(0, '4578.007')] [2023-03-12 06:47:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152568_78114816.pth... [2023-03-12 06:47:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152000_77824000.pth [2023-03-12 06:47:31,780][146667] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-12 06:47:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 78159872. Throughput: 0: 9573.9. Samples: 78156584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:32,720][146380] Avg episode reward: [(0, '4570.744')] [2023-03-12 06:47:36,139][146667] Updated weights for policy 0, policy_version 152720 (0.0006) [2023-03-12 06:47:37,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 78204928. Throughput: 0: 9535.2. Samples: 78184812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:37,720][146380] Avg episode reward: [(0, '4575.085')] [2023-03-12 06:47:40,494][146667] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-12 06:47:42,720][146380] Fps is (10 sec: 9011.0, 60 sec: 9489.0, 300 sec: 9594.4). Total num frames: 78249984. Throughput: 0: 9503.9. Samples: 78241680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:47:42,720][146380] Avg episode reward: [(0, '4573.915')] [2023-03-12 06:47:42,748][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152840_78254080.pth... [2023-03-12 06:47:42,750][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152288_77971456.pth [2023-03-12 06:47:44,959][146667] Updated weights for policy 0, policy_version 152880 (0.0006) [2023-03-12 06:47:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 78299136. Throughput: 0: 9409.4. Samples: 78295940. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:47:47,720][146380] Avg episode reward: [(0, '4587.912')] [2023-03-12 06:47:49,419][146667] Updated weights for policy 0, policy_version 152960 (0.0006) [2023-03-12 06:47:52,720][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 78348288. Throughput: 0: 9400.4. Samples: 78324428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:47:52,720][146380] Avg episode reward: [(0, '4574.900')] [2023-03-12 06:47:53,608][146667] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-12 06:47:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 78393344. Throughput: 0: 9361.2. Samples: 78381808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:47:57,720][146380] Avg episode reward: [(0, '4578.906')] [2023-03-12 06:47:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153112_78393344.pth... [2023-03-12 06:47:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152568_78114816.pth [2023-03-12 06:47:57,955][146667] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-12 06:48:02,264][146667] Updated weights for policy 0, policy_version 153200 (0.0004) [2023-03-12 06:48:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 78442496. Throughput: 0: 9348.0. Samples: 78438840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:02,720][146380] Avg episode reward: [(0, '4576.102')] [2023-03-12 06:48:06,589][146667] Updated weights for policy 0, policy_version 153280 (0.0003) [2023-03-12 06:48:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 78487552. Throughput: 0: 9371.0. Samples: 78467136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:07,720][146380] Avg episode reward: [(0, '4569.226')] [2023-03-12 06:48:10,782][146667] Updated weights for policy 0, policy_version 153360 (0.0005) [2023-03-12 06:48:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9636.0). Total num frames: 78536704. Throughput: 0: 9411.0. Samples: 78525876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:12,720][146380] Avg episode reward: [(0, '4584.054')] [2023-03-12 06:48:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153392_78536704.pth... [2023-03-12 06:48:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000152840_78254080.pth [2023-03-12 06:48:14,901][146667] Updated weights for policy 0, policy_version 153440 (0.0004) [2023-03-12 06:48:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 78585856. Throughput: 0: 9510.1. Samples: 78584540. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:17,720][146380] Avg episode reward: [(0, '4538.988')] [2023-03-12 06:48:19,216][146667] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-12 06:48:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9649.9). Total num frames: 78635008. Throughput: 0: 9513.3. Samples: 78612912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:22,720][146380] Avg episode reward: [(0, '4528.810')] [2023-03-12 06:48:23,477][146667] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-12 06:48:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9636.0). Total num frames: 78680064. Throughput: 0: 9541.1. Samples: 78671028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:27,720][146380] Avg episode reward: [(0, '4455.049')] [2023-03-12 06:48:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153672_78680064.pth... [2023-03-12 06:48:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153112_78393344.pth [2023-03-12 06:48:27,828][146667] Updated weights for policy 0, policy_version 153680 (0.0004) [2023-03-12 06:48:32,019][146667] Updated weights for policy 0, policy_version 153760 (0.0005) [2023-03-12 06:48:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 78729216. Throughput: 0: 9606.7. Samples: 78728244. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:32,720][146380] Avg episode reward: [(0, '4556.119')] [2023-03-12 06:48:36,278][146667] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-12 06:48:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.4, 300 sec: 9636.0). Total num frames: 78778368. Throughput: 0: 9608.4. Samples: 78756804. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:37,720][146380] Avg episode reward: [(0, '4533.822')] [2023-03-12 06:48:40,428][146667] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-12 06:48:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 78827520. Throughput: 0: 9633.1. Samples: 78815296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:42,720][146380] Avg episode reward: [(0, '4586.443')] [2023-03-12 06:48:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153960_78827520.pth... [2023-03-12 06:48:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153392_78536704.pth [2023-03-12 06:48:44,661][146667] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-12 06:48:47,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 78876672. Throughput: 0: 9666.4. Samples: 78873828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 06:48:47,720][146380] Avg episode reward: [(0, '4454.960')] [2023-03-12 06:48:48,907][146667] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-12 06:48:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 78925824. Throughput: 0: 9683.5. Samples: 78902892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:48:52,720][146380] Avg episode reward: [(0, '4538.235')] [2023-03-12 06:48:53,117][146667] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-12 06:48:57,294][146667] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-12 06:48:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 78974976. Throughput: 0: 9667.0. Samples: 78960892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:48:57,720][146380] Avg episode reward: [(0, '4537.505')] [2023-03-12 06:48:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154248_78974976.pth... [2023-03-12 06:48:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153672_78680064.pth [2023-03-12 06:49:01,537][146667] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-12 06:49:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79020032. Throughput: 0: 9678.0. Samples: 79020048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:02,720][146380] Avg episode reward: [(0, '4570.492')] [2023-03-12 06:49:05,876][146667] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-12 06:49:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 79069184. Throughput: 0: 9672.4. Samples: 79048172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:07,720][146380] Avg episode reward: [(0, '4580.895')] [2023-03-12 06:49:10,336][146667] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-12 06:49:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 79114240. Throughput: 0: 9591.0. Samples: 79102620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:12,720][146380] Avg episode reward: [(0, '4591.430')] [2023-03-12 06:49:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154520_79114240.pth... [2023-03-12 06:49:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000153960_78827520.pth [2023-03-12 06:49:14,726][146667] Updated weights for policy 0, policy_version 154560 (0.0006) [2023-03-12 06:49:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 79163392. Throughput: 0: 9598.2. Samples: 79160164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:17,730][146380] Avg episode reward: [(0, '4552.416')] [2023-03-12 06:49:18,919][146667] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-12 06:49:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79212544. Throughput: 0: 9623.5. Samples: 79189860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:22,720][146380] Avg episode reward: [(0, '4582.577')] [2023-03-12 06:49:23,075][146667] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-12 06:49:27,241][146667] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-12 06:49:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 79261696. Throughput: 0: 9628.2. Samples: 79248564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:27,724][146380] Avg episode reward: [(0, '4589.857')] [2023-03-12 06:49:27,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154808_79261696.pth... [2023-03-12 06:49:27,730][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154248_78974976.pth [2023-03-12 06:49:31,377][146667] Updated weights for policy 0, policy_version 154880 (0.0004) [2023-03-12 06:49:32,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 79310848. Throughput: 0: 9640.6. Samples: 79307656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:32,720][146380] Avg episode reward: [(0, '4541.897')] [2023-03-12 06:49:35,701][146667] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-12 06:49:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79355904. Throughput: 0: 9622.2. Samples: 79335892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:37,720][146380] Avg episode reward: [(0, '4575.253')] [2023-03-12 06:49:40,106][146667] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-12 06:49:42,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 79400960. Throughput: 0: 9580.6. Samples: 79392020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:42,720][146380] Avg episode reward: [(0, '4532.608')] [2023-03-12 06:49:42,785][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155088_79405056.pth... [2023-03-12 06:49:42,786][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154520_79114240.pth [2023-03-12 06:49:44,555][146667] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-12 06:49:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.4, 300 sec: 9622.1). Total num frames: 79450112. Throughput: 0: 9475.0. Samples: 79446420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:47,720][146380] Avg episode reward: [(0, '4582.072')] [2023-03-12 06:49:49,036][146667] Updated weights for policy 0, policy_version 155200 (0.0004) [2023-03-12 06:49:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 79495168. Throughput: 0: 9478.4. Samples: 79474700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:52,720][146380] Avg episode reward: [(0, '4567.136')] [2023-03-12 06:49:53,467][146667] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-12 06:49:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 79540224. Throughput: 0: 9492.8. Samples: 79529796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:49:57,720][146380] Avg episode reward: [(0, '4497.284')] [2023-03-12 06:49:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155352_79540224.pth... [2023-03-12 06:49:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000154808_79261696.pth [2023-03-12 06:49:57,849][146667] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-12 06:50:01,958][146667] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-12 06:50:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 79589376. Throughput: 0: 9533.8. Samples: 79589184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:02,720][146380] Avg episode reward: [(0, '4581.205')] [2023-03-12 06:50:06,079][146667] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-12 06:50:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 79638528. Throughput: 0: 9532.6. Samples: 79618828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:07,720][146380] Avg episode reward: [(0, '4581.450')] [2023-03-12 06:50:10,272][146667] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-12 06:50:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 79687680. Throughput: 0: 9534.1. Samples: 79677600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:12,720][146380] Avg episode reward: [(0, '4529.831')] [2023-03-12 06:50:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155640_79687680.pth... [2023-03-12 06:50:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155088_79405056.pth [2023-03-12 06:50:14,415][146667] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-12 06:50:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79740928. Throughput: 0: 9546.9. Samples: 79737268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:17,730][146380] Avg episode reward: [(0, '4546.202')] [2023-03-12 06:50:18,537][146667] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-12 06:50:22,677][146667] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-12 06:50:22,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79790080. Throughput: 0: 9575.4. Samples: 79766784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:22,720][146380] Avg episode reward: [(0, '4582.252')] [2023-03-12 06:50:26,823][146667] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-12 06:50:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79839232. Throughput: 0: 9657.4. Samples: 79826604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:27,730][146380] Avg episode reward: [(0, '4579.671')] [2023-03-12 06:50:27,734][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155936_79839232.pth... [2023-03-12 06:50:27,736][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155352_79540224.pth [2023-03-12 06:50:30,995][146667] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-12 06:50:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 79888384. Throughput: 0: 9745.5. Samples: 79884968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:32,720][146380] Avg episode reward: [(0, '4574.226')] [2023-03-12 06:50:35,139][146667] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-12 06:50:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 79937536. Throughput: 0: 9782.8. Samples: 79914928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:37,720][146380] Avg episode reward: [(0, '4589.859')] [2023-03-12 06:50:39,314][146667] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-12 06:50:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9622.1). Total num frames: 79986688. Throughput: 0: 9871.8. Samples: 79974028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:42,720][146380] Avg episode reward: [(0, '4583.798')] [2023-03-12 06:50:42,731][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156224_79986688.pth... [2023-03-12 06:50:42,734][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155640_79687680.pth [2023-03-12 06:50:43,476][146667] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-12 06:50:47,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.8, 300 sec: 9594.4). Total num frames: 80031744. Throughput: 0: 9836.1. Samples: 80031808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:47,720][146380] Avg episode reward: [(0, '4584.954')] [2023-03-12 06:50:47,759][146667] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-12 06:50:51,918][146667] Updated weights for policy 0, policy_version 156400 (0.0004) [2023-03-12 06:50:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 80080896. Throughput: 0: 9828.1. Samples: 80061092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:52,720][146380] Avg episode reward: [(0, '4582.893')] [2023-03-12 06:50:56,158][146667] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-12 06:50:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9608.2). Total num frames: 80130048. Throughput: 0: 9819.5. Samples: 80119480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:50:57,720][146380] Avg episode reward: [(0, '4460.646')] [2023-03-12 06:50:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156504_80130048.pth... [2023-03-12 06:50:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000155936_79839232.pth [2023-03-12 06:51:00,402][146667] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-12 06:51:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9622.1). Total num frames: 80179200. Throughput: 0: 9770.4. Samples: 80176936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:02,720][146380] Avg episode reward: [(0, '4583.028')] [2023-03-12 06:51:04,729][146667] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-12 06:51:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 80224256. Throughput: 0: 9758.0. Samples: 80205892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:07,720][146380] Avg episode reward: [(0, '4540.160')] [2023-03-12 06:51:09,045][146667] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-12 06:51:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 80273408. Throughput: 0: 9669.6. Samples: 80261736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:12,720][146380] Avg episode reward: [(0, '4591.346')] [2023-03-12 06:51:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156784_80273408.pth... [2023-03-12 06:51:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156224_79986688.pth [2023-03-12 06:51:13,328][146667] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-12 06:51:17,572][146667] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-12 06:51:17,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 80322560. Throughput: 0: 9667.8. Samples: 80320020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:17,720][146380] Avg episode reward: [(0, '4536.644')] [2023-03-12 06:51:21,793][146667] Updated weights for policy 0, policy_version 156960 (0.0004) [2023-03-12 06:51:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 80371712. Throughput: 0: 9657.7. Samples: 80349524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:22,720][146380] Avg episode reward: [(0, '4547.099')] [2023-03-12 06:51:25,913][146667] Updated weights for policy 0, policy_version 157040 (0.0004) [2023-03-12 06:51:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 80420864. Throughput: 0: 9656.8. Samples: 80408584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:27,720][146380] Avg episode reward: [(0, '4585.681')] [2023-03-12 06:51:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157072_80420864.pth... [2023-03-12 06:51:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156504_80130048.pth [2023-03-12 06:51:30,223][146667] Updated weights for policy 0, policy_version 157120 (0.0004) [2023-03-12 06:51:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 80465920. Throughput: 0: 9636.6. Samples: 80465456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:32,720][146380] Avg episode reward: [(0, '4570.779')] [2023-03-12 06:51:34,521][146667] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-12 06:51:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 80515072. Throughput: 0: 9633.3. Samples: 80494592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:37,720][146380] Avg episode reward: [(0, '4445.236')] [2023-03-12 06:51:38,795][146667] Updated weights for policy 0, policy_version 157280 (0.0004) [2023-03-12 06:51:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 80560128. Throughput: 0: 9600.1. Samples: 80551484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:42,720][146380] Avg episode reward: [(0, '4362.513')] [2023-03-12 06:51:42,780][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157352_80564224.pth... [2023-03-12 06:51:42,782][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000156784_80273408.pth [2023-03-12 06:51:43,228][146667] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-12 06:51:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.4, 300 sec: 9580.5). Total num frames: 80605184. Throughput: 0: 9518.1. Samples: 80605248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:47,720][146380] Avg episode reward: [(0, '4461.986')] [2023-03-12 06:51:47,778][146667] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-12 06:51:52,297][146667] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-12 06:51:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 80650240. Throughput: 0: 9479.3. Samples: 80632460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:52,720][146380] Avg episode reward: [(0, '4540.396')] [2023-03-12 06:51:56,866][146667] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-12 06:51:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 80695296. Throughput: 0: 9452.6. Samples: 80687104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:51:57,720][146380] Avg episode reward: [(0, '4556.637')] [2023-03-12 06:51:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157608_80695296.pth... [2023-03-12 06:51:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157072_80420864.pth [2023-03-12 06:52:01,420][146667] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-12 06:52:02,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 80740352. Throughput: 0: 9342.3. Samples: 80740424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:02,720][146380] Avg episode reward: [(0, '4539.652')] [2023-03-12 06:52:06,004][146667] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-12 06:52:07,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 80785408. Throughput: 0: 9284.5. Samples: 80767328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:07,720][146380] Avg episode reward: [(0, '4554.545')] [2023-03-12 06:52:10,528][146667] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-12 06:52:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 80830464. Throughput: 0: 9185.7. Samples: 80821940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:12,720][146380] Avg episode reward: [(0, '4582.797')] [2023-03-12 06:52:12,779][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157880_80834560.pth... [2023-03-12 06:52:12,781][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157352_80564224.pth [2023-03-12 06:52:15,028][146667] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-12 06:52:17,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 80875520. Throughput: 0: 9114.0. Samples: 80875584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:17,720][146380] Avg episode reward: [(0, '4584.058')] [2023-03-12 06:52:19,504][146667] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-12 06:52:22,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 80924672. Throughput: 0: 9095.7. Samples: 80903900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:22,720][146380] Avg episode reward: [(0, '4546.679')] [2023-03-12 06:52:23,960][146667] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-12 06:52:27,720][146380] Fps is (10 sec: 9420.6, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 80969728. Throughput: 0: 9041.8. Samples: 80958364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:27,720][146380] Avg episode reward: [(0, '4539.598')] [2023-03-12 06:52:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158144_80969728.pth... [2023-03-12 06:52:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157608_80695296.pth [2023-03-12 06:52:28,424][146667] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-12 06:52:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 81014784. Throughput: 0: 9101.0. Samples: 81014792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:32,720][146380] Avg episode reward: [(0, '4582.079')] [2023-03-12 06:52:32,817][146667] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-12 06:52:37,273][146667] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-12 06:52:37,719][146380] Fps is (10 sec: 9421.0, 60 sec: 9147.7, 300 sec: 9538.8). Total num frames: 81063936. Throughput: 0: 9108.2. Samples: 81042328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:37,720][146380] Avg episode reward: [(0, '4584.573')] [2023-03-12 06:52:41,685][146667] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-12 06:52:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9524.9). Total num frames: 81108992. Throughput: 0: 9122.1. Samples: 81097600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:42,720][146380] Avg episode reward: [(0, '4581.214')] [2023-03-12 06:52:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158416_81108992.pth... [2023-03-12 06:52:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000157880_80834560.pth [2023-03-12 06:52:46,172][146667] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-12 06:52:47,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9511.1). Total num frames: 81154048. Throughput: 0: 9154.8. Samples: 81152392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:47,720][146380] Avg episode reward: [(0, '4537.877')] [2023-03-12 06:52:50,692][146667] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-12 06:52:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9511.1). Total num frames: 81199104. Throughput: 0: 9157.2. Samples: 81179404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:52,720][146380] Avg episode reward: [(0, '4502.403')] [2023-03-12 06:52:55,192][146667] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-12 06:52:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9497.2). Total num frames: 81244160. Throughput: 0: 9158.2. Samples: 81234060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:52:57,720][146380] Avg episode reward: [(0, '4481.412')] [2023-03-12 06:52:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158680_81244160.pth... [2023-03-12 06:52:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158144_80969728.pth [2023-03-12 06:52:59,791][146667] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-12 06:53:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9497.2). Total num frames: 81289216. Throughput: 0: 9185.8. Samples: 81288944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:53:02,720][146380] Avg episode reward: [(0, '4534.105')] [2023-03-12 06:53:04,125][146667] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-12 06:53:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9483.3). Total num frames: 81334272. Throughput: 0: 9175.3. Samples: 81316788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:07,720][146380] Avg episode reward: [(0, '4552.304')] [2023-03-12 06:53:08,636][146667] Updated weights for policy 0, policy_version 158880 (0.0004) [2023-03-12 06:53:12,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 81383424. Throughput: 0: 9174.2. Samples: 81371200. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:12,720][146380] Avg episode reward: [(0, '4593.325')] [2023-03-12 06:53:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158952_81383424.pth... [2023-03-12 06:53:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158416_81108992.pth [2023-03-12 06:53:13,142][146667] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-12 06:53:17,703][146667] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-12 06:53:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 81428480. Throughput: 0: 9121.3. Samples: 81425248. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:17,720][146380] Avg episode reward: [(0, '4536.217')] [2023-03-12 06:53:21,984][146667] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-12 06:53:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9469.4). Total num frames: 81473536. Throughput: 0: 9129.6. Samples: 81453160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:22,720][146380] Avg episode reward: [(0, '4477.196')] [2023-03-12 06:53:26,436][146667] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-12 06:53:27,720][146380] Fps is (10 sec: 9011.0, 60 sec: 9147.7, 300 sec: 9455.5). Total num frames: 81518592. Throughput: 0: 9162.3. Samples: 81509904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:27,720][146380] Avg episode reward: [(0, '4466.966')] [2023-03-12 06:53:27,771][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159224_81522688.pth... [2023-03-12 06:53:27,772][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158680_81244160.pth [2023-03-12 06:53:30,913][146667] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-12 06:53:32,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 81567744. Throughput: 0: 9145.4. Samples: 81563936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:32,720][146380] Avg episode reward: [(0, '4534.688')] [2023-03-12 06:53:35,180][146667] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-12 06:53:37,719][146380] Fps is (10 sec: 9830.6, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 81616896. Throughput: 0: 9209.3. Samples: 81593820. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:37,720][146380] Avg episode reward: [(0, '4539.599')] [2023-03-12 06:53:39,361][146667] Updated weights for policy 0, policy_version 159440 (0.0004) [2023-03-12 06:53:42,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9441.6). Total num frames: 81661952. Throughput: 0: 9297.2. Samples: 81652432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:42,720][146380] Avg episode reward: [(0, '4566.247')] [2023-03-12 06:53:42,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159504_81666048.pth... [2023-03-12 06:53:42,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000158952_81383424.pth [2023-03-12 06:53:43,552][146667] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-12 06:53:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 81711104. Throughput: 0: 9381.5. Samples: 81711112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:47,720][146380] Avg episode reward: [(0, '4533.852')] [2023-03-12 06:53:47,754][146667] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-12 06:53:52,035][146667] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-12 06:53:52,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 81760256. Throughput: 0: 9401.1. Samples: 81739840. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:52,720][146380] Avg episode reward: [(0, '4578.433')] [2023-03-12 06:53:56,285][146667] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-12 06:53:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 81809408. Throughput: 0: 9469.3. Samples: 81797320. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:53:57,720][146380] Avg episode reward: [(0, '4535.057')] [2023-03-12 06:53:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159784_81809408.pth... [2023-03-12 06:53:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159224_81522688.pth [2023-03-12 06:54:00,546][146667] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-12 06:54:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 81858560. Throughput: 0: 9556.3. Samples: 81855284. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:54:02,720][146380] Avg episode reward: [(0, '4574.244')] [2023-03-12 06:54:04,881][146667] Updated weights for policy 0, policy_version 159920 (0.0004) [2023-03-12 06:54:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 81903616. Throughput: 0: 9556.6. Samples: 81883208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 06:54:07,720][146380] Avg episode reward: [(0, '4572.594')] [2023-03-12 06:54:09,300][146667] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-12 06:54:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 81948672. Throughput: 0: 9530.0. Samples: 81938752. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:12,720][146380] Avg episode reward: [(0, '4583.905')] [2023-03-12 06:54:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160056_81948672.pth... [2023-03-12 06:54:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159504_81666048.pth [2023-03-12 06:54:13,792][146667] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-12 06:54:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 81993728. Throughput: 0: 9543.2. Samples: 81993380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:17,720][146380] Avg episode reward: [(0, '4571.526')] [2023-03-12 06:54:18,358][146667] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-12 06:54:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 82038784. Throughput: 0: 9470.1. Samples: 82019976. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:22,720][146380] Avg episode reward: [(0, '4537.062')] [2023-03-12 06:54:22,773][146667] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-12 06:54:27,202][146667] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-12 06:54:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 82087936. Throughput: 0: 9407.1. Samples: 82075752. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:27,720][146380] Avg episode reward: [(0, '4516.420')] [2023-03-12 06:54:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160328_82087936.pth... [2023-03-12 06:54:27,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000159784_81809408.pth [2023-03-12 06:54:31,657][146667] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-12 06:54:32,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 82132992. Throughput: 0: 9347.1. Samples: 82131732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:32,720][146380] Avg episode reward: [(0, '4586.246')] [2023-03-12 06:54:36,085][146667] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-12 06:54:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 82178048. Throughput: 0: 9316.8. Samples: 82159096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:37,720][146380] Avg episode reward: [(0, '4586.133')] [2023-03-12 06:54:40,514][146667] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-12 06:54:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 82223104. Throughput: 0: 9273.9. Samples: 82214644. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:42,720][146380] Avg episode reward: [(0, '4577.993')] [2023-03-12 06:54:42,747][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160600_82227200.pth... [2023-03-12 06:54:42,749][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160056_81948672.pth [2023-03-12 06:54:45,022][146667] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-12 06:54:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 82268160. Throughput: 0: 9176.6. Samples: 82268232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:47,720][146380] Avg episode reward: [(0, '4584.204')] [2023-03-12 06:54:49,600][146667] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-12 06:54:52,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9400.0). Total num frames: 82313216. Throughput: 0: 9164.4. Samples: 82295608. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:52,720][146380] Avg episode reward: [(0, '4541.611')] [2023-03-12 06:54:54,156][146667] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-12 06:54:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9386.1). Total num frames: 82358272. Throughput: 0: 9135.6. Samples: 82349856. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:54:57,720][146380] Avg episode reward: [(0, '4513.798')] [2023-03-12 06:54:57,728][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160864_82362368.pth... [2023-03-12 06:54:57,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160328_82087936.pth [2023-03-12 06:54:58,664][146667] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-12 06:55:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9386.1). Total num frames: 82407424. Throughput: 0: 9125.7. Samples: 82404036. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:55:02,720][146380] Avg episode reward: [(0, '4473.845')] [2023-03-12 06:55:03,140][146667] Updated weights for policy 0, policy_version 160960 (0.0005) [2023-03-12 06:55:07,532][146667] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-12 06:55:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9372.2). Total num frames: 82452480. Throughput: 0: 9157.7. Samples: 82432072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:55:07,720][146380] Avg episode reward: [(0, '4581.713')] [2023-03-12 06:55:11,919][146667] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-12 06:55:12,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 82497536. Throughput: 0: 9157.2. Samples: 82487828. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 06:55:12,720][146380] Avg episode reward: [(0, '4582.922')] [2023-03-12 06:55:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161128_82497536.pth... [2023-03-12 06:55:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160600_82227200.pth [2023-03-12 06:55:16,360][146667] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-12 06:55:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 82546688. Throughput: 0: 9143.1. Samples: 82543172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:17,720][146380] Avg episode reward: [(0, '4506.729')] [2023-03-12 06:55:20,817][146667] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-12 06:55:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 82591744. Throughput: 0: 9159.3. Samples: 82571264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:22,720][146380] Avg episode reward: [(0, '4584.138')] [2023-03-12 06:55:25,302][146667] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-12 06:55:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 82636800. Throughput: 0: 9139.9. Samples: 82625940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:27,720][146380] Avg episode reward: [(0, '4579.450')] [2023-03-12 06:55:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161400_82636800.pth... [2023-03-12 06:55:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000160864_82362368.pth [2023-03-12 06:55:29,773][146667] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-12 06:55:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 82681856. Throughput: 0: 9160.7. Samples: 82680464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:32,720][146380] Avg episode reward: [(0, '4511.527')] [2023-03-12 06:55:34,300][146667] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-12 06:55:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 82726912. Throughput: 0: 9158.4. Samples: 82707736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:37,720][146380] Avg episode reward: [(0, '4515.263')] [2023-03-12 06:55:38,824][146667] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-12 06:55:42,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 82771968. Throughput: 0: 9154.3. Samples: 82761800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:42,720][146380] Avg episode reward: [(0, '4589.049')] [2023-03-12 06:55:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161664_82771968.pth... [2023-03-12 06:55:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161128_82497536.pth [2023-03-12 06:55:43,340][146667] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-12 06:55:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 82817024. Throughput: 0: 9178.9. Samples: 82817088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:47,720][146380] Avg episode reward: [(0, '4550.059')] [2023-03-12 06:55:47,774][146667] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-12 06:55:52,176][146667] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-12 06:55:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 82866176. Throughput: 0: 9174.9. Samples: 82844944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:52,720][146380] Avg episode reward: [(0, '4548.333')] [2023-03-12 06:55:56,632][146667] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-12 06:55:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 82911232. Throughput: 0: 9163.2. Samples: 82900172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:55:57,720][146380] Avg episode reward: [(0, '4549.587')] [2023-03-12 06:55:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161936_82911232.pth... [2023-03-12 06:55:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161400_82636800.pth [2023-03-12 06:56:01,065][146667] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-12 06:56:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 82956288. Throughput: 0: 9169.9. Samples: 82955816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:02,720][146380] Avg episode reward: [(0, '4548.314')] [2023-03-12 06:56:05,584][146667] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-12 06:56:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 83001344. Throughput: 0: 9142.7. Samples: 82982688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:07,720][146380] Avg episode reward: [(0, '4419.181')] [2023-03-12 06:56:10,107][146667] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-12 06:56:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 83046400. Throughput: 0: 9140.1. Samples: 83037244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:12,720][146380] Avg episode reward: [(0, '4456.451')] [2023-03-12 06:56:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162200_83046400.pth... [2023-03-12 06:56:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161664_82771968.pth [2023-03-12 06:56:14,567][146667] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-12 06:56:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 83095552. Throughput: 0: 9139.6. Samples: 83091744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:17,720][146380] Avg episode reward: [(0, '4501.191')] [2023-03-12 06:56:19,088][146667] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-12 06:56:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 83140608. Throughput: 0: 9154.4. Samples: 83119684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:22,720][146380] Avg episode reward: [(0, '4549.131')] [2023-03-12 06:56:23,565][146667] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-12 06:56:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 83185664. Throughput: 0: 9175.6. Samples: 83174700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:27,720][146380] Avg episode reward: [(0, '4589.784')] [2023-03-12 06:56:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162472_83185664.pth... [2023-03-12 06:56:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000161936_82911232.pth [2023-03-12 06:56:27,961][146667] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-12 06:56:32,393][146667] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-12 06:56:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 83230720. Throughput: 0: 9191.8. Samples: 83230720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:32,720][146380] Avg episode reward: [(0, '4540.276')] [2023-03-12 06:56:36,867][146667] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-12 06:56:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 83275776. Throughput: 0: 9179.7. Samples: 83258032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:37,720][146380] Avg episode reward: [(0, '4583.822')] [2023-03-12 06:56:41,307][146667] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-12 06:56:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 83324928. Throughput: 0: 9167.6. Samples: 83312712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:42,720][146380] Avg episode reward: [(0, '4585.392')] [2023-03-12 06:56:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162744_83324928.pth... [2023-03-12 06:56:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162200_83046400.pth [2023-03-12 06:56:45,767][146667] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-12 06:56:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 83369984. Throughput: 0: 9151.2. Samples: 83367620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:47,720][146380] Avg episode reward: [(0, '4462.471')] [2023-03-12 06:56:50,215][146667] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-12 06:56:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 83415040. Throughput: 0: 9171.4. Samples: 83395400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:52,720][146380] Avg episode reward: [(0, '4465.975')] [2023-03-12 06:56:54,661][146667] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-12 06:56:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 83464192. Throughput: 0: 9208.7. Samples: 83451636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:56:57,720][146380] Avg episode reward: [(0, '4508.245')] [2023-03-12 06:56:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163016_83464192.pth... [2023-03-12 06:56:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162472_83185664.pth [2023-03-12 06:56:58,909][146667] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-12 06:57:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 83513344. Throughput: 0: 9305.4. Samples: 83510488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:02,720][146380] Avg episode reward: [(0, '4581.356')] [2023-03-12 06:57:03,020][146667] Updated weights for policy 0, policy_version 163120 (0.0004) [2023-03-12 06:57:07,096][146667] Updated weights for policy 0, policy_version 163200 (0.0004) [2023-03-12 06:57:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 83562496. Throughput: 0: 9359.7. Samples: 83540872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:07,720][146380] Avg episode reward: [(0, '4587.778')] [2023-03-12 06:57:11,293][146667] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-12 06:57:12,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 83611648. Throughput: 0: 9439.2. Samples: 83599464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:12,720][146380] Avg episode reward: [(0, '4573.774')] [2023-03-12 06:57:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163304_83611648.pth... [2023-03-12 06:57:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000162744_83324928.pth [2023-03-12 06:57:15,477][146667] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-12 06:57:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 83660800. Throughput: 0: 9517.8. Samples: 83659020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:17,720][146380] Avg episode reward: [(0, '4583.553')] [2023-03-12 06:57:19,624][146667] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-12 06:57:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 83709952. Throughput: 0: 9563.1. Samples: 83688372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:22,720][146380] Avg episode reward: [(0, '4555.028')] [2023-03-12 06:57:23,790][146667] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-12 06:57:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9302.8). Total num frames: 83759104. Throughput: 0: 9648.4. Samples: 83746888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:27,720][146380] Avg episode reward: [(0, '4586.404')] [2023-03-12 06:57:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163592_83759104.pth... [2023-03-12 06:57:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163016_83464192.pth [2023-03-12 06:57:27,961][146667] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-12 06:57:32,313][146667] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-12 06:57:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9288.9). Total num frames: 83804160. Throughput: 0: 9702.5. Samples: 83804232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:32,720][146380] Avg episode reward: [(0, '4542.994')] [2023-03-12 06:57:36,707][146667] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-12 06:57:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9302.8). Total num frames: 83853312. Throughput: 0: 9709.3. Samples: 83832320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:37,720][146380] Avg episode reward: [(0, '4558.784')] [2023-03-12 06:57:40,820][146667] Updated weights for policy 0, policy_version 163840 (0.0004) [2023-03-12 06:57:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9316.7). Total num frames: 83902464. Throughput: 0: 9759.0. Samples: 83890792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:42,720][146380] Avg episode reward: [(0, '4586.131')] [2023-03-12 06:57:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163872_83902464.pth... [2023-03-12 06:57:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163304_83611648.pth [2023-03-12 06:57:45,108][146667] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-12 06:57:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9316.7). Total num frames: 83947520. Throughput: 0: 9712.0. Samples: 83947528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:47,720][146380] Avg episode reward: [(0, '4564.159')] [2023-03-12 06:57:49,485][146667] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-12 06:57:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9330.6). Total num frames: 83996672. Throughput: 0: 9673.8. Samples: 83976192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:52,720][146380] Avg episode reward: [(0, '4573.815')] [2023-03-12 06:57:53,992][146667] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-12 06:57:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9330.5). Total num frames: 84041728. Throughput: 0: 9572.9. Samples: 84030244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:57:57,720][146380] Avg episode reward: [(0, '4590.880')] [2023-03-12 06:57:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164144_84041728.pth... [2023-03-12 06:57:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163592_83759104.pth [2023-03-12 06:57:58,466][146667] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-12 06:58:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9330.5). Total num frames: 84086784. Throughput: 0: 9472.5. Samples: 84085284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:02,720][146380] Avg episode reward: [(0, '4545.113')] [2023-03-12 06:58:02,959][146667] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-12 06:58:07,489][146667] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-12 06:58:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 84131840. Throughput: 0: 9429.2. Samples: 84112688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:07,720][146380] Avg episode reward: [(0, '4548.467')] [2023-03-12 06:58:11,779][146667] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-12 06:58:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 84180992. Throughput: 0: 9373.9. Samples: 84168712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:12,720][146380] Avg episode reward: [(0, '4595.875')] [2023-03-12 06:58:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164416_84180992.pth... [2023-03-12 06:58:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000163872_83902464.pth [2023-03-12 06:58:16,008][146667] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-12 06:58:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 84230144. Throughput: 0: 9385.4. Samples: 84226576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:17,720][146380] Avg episode reward: [(0, '4580.076')] [2023-03-12 06:58:20,237][146667] Updated weights for policy 0, policy_version 164560 (0.0004) [2023-03-12 06:58:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 84275200. Throughput: 0: 9403.5. Samples: 84255480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:22,720][146380] Avg episode reward: [(0, '4542.953')] [2023-03-12 06:58:24,449][146667] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-12 06:58:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 84324352. Throughput: 0: 9399.8. Samples: 84313784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:27,720][146380] Avg episode reward: [(0, '4586.364')] [2023-03-12 06:58:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164696_84324352.pth... [2023-03-12 06:58:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164144_84041728.pth [2023-03-12 06:58:28,729][146667] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-12 06:58:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 84373504. Throughput: 0: 9426.8. Samples: 84371736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:32,720][146380] Avg episode reward: [(0, '4582.511')] [2023-03-12 06:58:32,931][146667] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-12 06:58:37,167][146667] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-12 06:58:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 84422656. Throughput: 0: 9433.0. Samples: 84400676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:37,720][146380] Avg episode reward: [(0, '4582.374')] [2023-03-12 06:58:41,366][146667] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-12 06:58:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 84471808. Throughput: 0: 9539.5. Samples: 84459520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:42,720][146380] Avg episode reward: [(0, '4584.694')] [2023-03-12 06:58:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164984_84471808.pth... [2023-03-12 06:58:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164416_84180992.pth [2023-03-12 06:58:45,500][146667] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-12 06:58:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 84520960. Throughput: 0: 9622.5. Samples: 84518296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:47,720][146380] Avg episode reward: [(0, '4585.786')] [2023-03-12 06:58:49,729][146667] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-12 06:58:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 84570112. Throughput: 0: 9659.9. Samples: 84547384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:52,720][146380] Avg episode reward: [(0, '4595.939')] [2023-03-12 06:58:53,909][146667] Updated weights for policy 0, policy_version 165200 (0.0004) [2023-03-12 06:58:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 84615168. Throughput: 0: 9711.9. Samples: 84605748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:58:57,720][146380] Avg episode reward: [(0, '4518.573')] [2023-03-12 06:58:57,749][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165272_84619264.pth... [2023-03-12 06:58:57,751][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164696_84324352.pth [2023-03-12 06:58:58,186][146667] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-12 06:59:02,479][146667] Updated weights for policy 0, policy_version 165360 (0.0005) [2023-03-12 06:59:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9358.3). Total num frames: 84664320. Throughput: 0: 9701.9. Samples: 84663164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:02,720][146380] Avg episode reward: [(0, '4467.185')] [2023-03-12 06:59:07,061][146667] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-12 06:59:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9358.3). Total num frames: 84709376. Throughput: 0: 9642.9. Samples: 84689408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:07,720][146380] Avg episode reward: [(0, '4443.676')] [2023-03-12 06:59:11,569][146667] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-12 06:59:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 84754432. Throughput: 0: 9562.3. Samples: 84744088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:12,720][146380] Avg episode reward: [(0, '4480.022')] [2023-03-12 06:59:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165536_84754432.pth... [2023-03-12 06:59:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000164984_84471808.pth [2023-03-12 06:59:16,167][146667] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-12 06:59:17,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 84799488. Throughput: 0: 9467.6. Samples: 84797780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:17,720][146380] Avg episode reward: [(0, '4431.512')] [2023-03-12 06:59:20,713][146667] Updated weights for policy 0, policy_version 165680 (0.0005) [2023-03-12 06:59:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 84844544. Throughput: 0: 9417.9. Samples: 84824480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:22,720][146380] Avg episode reward: [(0, '4475.074')] [2023-03-12 06:59:25,132][146667] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-12 06:59:27,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 84889600. Throughput: 0: 9338.5. Samples: 84879752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:27,720][146380] Avg episode reward: [(0, '4331.433')] [2023-03-12 06:59:27,736][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165800_84889600.pth... [2023-03-12 06:59:27,739][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165272_84619264.pth [2023-03-12 06:59:29,824][146667] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-12 06:59:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 84934656. Throughput: 0: 9199.7. Samples: 84932284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:32,720][146380] Avg episode reward: [(0, '4386.025')] [2023-03-12 06:59:34,389][146667] Updated weights for policy 0, policy_version 165920 (0.0006) [2023-03-12 06:59:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 84979712. Throughput: 0: 9154.1. Samples: 84959316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:37,720][146380] Avg episode reward: [(0, '4551.564')] [2023-03-12 06:59:38,836][146667] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-12 06:59:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 85028864. Throughput: 0: 9113.5. Samples: 85015856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:42,720][146380] Avg episode reward: [(0, '4526.388')] [2023-03-12 06:59:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166072_85028864.pth... [2023-03-12 06:59:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165536_84754432.pth [2023-03-12 06:59:43,138][146667] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-12 06:59:47,455][146667] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-12 06:59:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 85073920. Throughput: 0: 9115.4. Samples: 85073356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:47,720][146380] Avg episode reward: [(0, '4582.486')] [2023-03-12 06:59:51,964][146667] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-12 06:59:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9358.3). Total num frames: 85118976. Throughput: 0: 9130.4. Samples: 85100276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:52,720][146380] Avg episode reward: [(0, '4471.572')] [2023-03-12 06:59:56,360][146667] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-12 06:59:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 85168128. Throughput: 0: 9150.3. Samples: 85155852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 06:59:57,720][146380] Avg episode reward: [(0, '4477.243')] [2023-03-12 06:59:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166344_85168128.pth... [2023-03-12 06:59:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000165800_84889600.pth [2023-03-12 07:00:00,612][146667] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-12 07:00:02,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 85217280. Throughput: 0: 9232.8. Samples: 85213256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:02,720][146380] Avg episode reward: [(0, '4542.404')] [2023-03-12 07:00:04,786][146667] Updated weights for policy 0, policy_version 166480 (0.0004) [2023-03-12 07:00:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 85262336. Throughput: 0: 9296.1. Samples: 85242804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:07,720][146380] Avg episode reward: [(0, '4514.743')] [2023-03-12 07:00:09,100][146667] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-12 07:00:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 85311488. Throughput: 0: 9321.4. Samples: 85299216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:12,720][146380] Avg episode reward: [(0, '4519.207')] [2023-03-12 07:00:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166624_85311488.pth... [2023-03-12 07:00:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166072_85028864.pth [2023-03-12 07:00:13,581][146667] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-12 07:00:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 85356544. Throughput: 0: 9362.6. Samples: 85353600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:17,720][146380] Avg episode reward: [(0, '4589.567')] [2023-03-12 07:00:18,104][146667] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-12 07:00:22,462][146667] Updated weights for policy 0, policy_version 166800 (0.0003) [2023-03-12 07:00:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 85401600. Throughput: 0: 9373.4. Samples: 85381120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:22,720][146380] Avg episode reward: [(0, '4583.622')] [2023-03-12 07:00:26,658][146667] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-12 07:00:27,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 85450752. Throughput: 0: 9404.3. Samples: 85439048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:27,720][146380] Avg episode reward: [(0, '4590.081')] [2023-03-12 07:00:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166896_85450752.pth... [2023-03-12 07:00:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166344_85168128.pth [2023-03-12 07:00:30,852][146667] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-12 07:00:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 85499904. Throughput: 0: 9439.4. Samples: 85498128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:32,720][146380] Avg episode reward: [(0, '4533.825')] [2023-03-12 07:00:35,077][146667] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-12 07:00:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 85549056. Throughput: 0: 9486.7. Samples: 85527180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:37,720][146380] Avg episode reward: [(0, '4470.848')] [2023-03-12 07:00:39,262][146667] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-12 07:00:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 85598208. Throughput: 0: 9558.7. Samples: 85585992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:42,720][146380] Avg episode reward: [(0, '4553.435')] [2023-03-12 07:00:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167184_85598208.pth... [2023-03-12 07:00:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166624_85311488.pth [2023-03-12 07:00:43,394][146667] Updated weights for policy 0, policy_version 167200 (0.0004) [2023-03-12 07:00:47,677][146667] Updated weights for policy 0, policy_version 167280 (0.0004) [2023-03-12 07:00:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 85647360. Throughput: 0: 9566.5. Samples: 85643748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:47,720][146380] Avg episode reward: [(0, '4583.864')] [2023-03-12 07:00:52,135][146667] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-12 07:00:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 85692416. Throughput: 0: 9537.7. Samples: 85672000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:52,720][146380] Avg episode reward: [(0, '4545.133')] [2023-03-12 07:00:56,639][146667] Updated weights for policy 0, policy_version 167440 (0.0005) [2023-03-12 07:00:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 85737472. Throughput: 0: 9491.3. Samples: 85726324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:00:57,720][146380] Avg episode reward: [(0, '4551.506')] [2023-03-12 07:00:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167456_85737472.pth... [2023-03-12 07:00:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000166896_85450752.pth [2023-03-12 07:01:01,109][146667] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-12 07:01:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 85782528. Throughput: 0: 9506.2. Samples: 85781380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:02,720][146380] Avg episode reward: [(0, '4560.330')] [2023-03-12 07:01:05,596][146667] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-12 07:01:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 85827584. Throughput: 0: 9497.4. Samples: 85808504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:07,720][146380] Avg episode reward: [(0, '4535.930')] [2023-03-12 07:01:10,132][146667] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-12 07:01:12,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 85872640. Throughput: 0: 9431.7. Samples: 85863476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:12,720][146380] Avg episode reward: [(0, '4553.576')] [2023-03-12 07:01:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167720_85872640.pth... [2023-03-12 07:01:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167184_85598208.pth [2023-03-12 07:01:14,633][146667] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-12 07:01:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 85921792. Throughput: 0: 9325.3. Samples: 85917768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:17,720][146380] Avg episode reward: [(0, '4480.841')] [2023-03-12 07:01:19,027][146667] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-12 07:01:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 85966848. Throughput: 0: 9314.9. Samples: 85946352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:22,720][146380] Avg episode reward: [(0, '4517.398')] [2023-03-12 07:01:23,573][146667] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-12 07:01:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 86011904. Throughput: 0: 9193.8. Samples: 85999712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:27,720][146380] Avg episode reward: [(0, '4557.463')] [2023-03-12 07:01:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167992_86011904.pth... [2023-03-12 07:01:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167456_85737472.pth [2023-03-12 07:01:28,042][146667] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-12 07:01:32,458][146667] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-12 07:01:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 86056960. Throughput: 0: 9153.0. Samples: 86055632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:32,720][146380] Avg episode reward: [(0, '4555.783')] [2023-03-12 07:01:36,960][146667] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-12 07:01:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9413.9). Total num frames: 86102016. Throughput: 0: 9141.8. Samples: 86083380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:37,720][146380] Avg episode reward: [(0, '4496.807')] [2023-03-12 07:01:41,553][146667] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-12 07:01:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9413.9). Total num frames: 86147072. Throughput: 0: 9121.2. Samples: 86136776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:42,720][146380] Avg episode reward: [(0, '4502.790')] [2023-03-12 07:01:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168256_86147072.pth... [2023-03-12 07:01:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167720_85872640.pth [2023-03-12 07:01:45,943][146667] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-12 07:01:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9427.7). Total num frames: 86196224. Throughput: 0: 9153.7. Samples: 86193296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:47,720][146380] Avg episode reward: [(0, '4512.809')] [2023-03-12 07:01:50,241][146667] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-12 07:01:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9413.9). Total num frames: 86241280. Throughput: 0: 9178.8. Samples: 86221548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:52,720][146380] Avg episode reward: [(0, '4583.139')] [2023-03-12 07:01:54,777][146667] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-12 07:01:57,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9400.0). Total num frames: 86286336. Throughput: 0: 9162.7. Samples: 86275796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:01:57,720][146380] Avg episode reward: [(0, '4551.338')] [2023-03-12 07:01:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168528_86286336.pth... [2023-03-12 07:01:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000167992_86011904.pth [2023-03-12 07:01:59,297][146667] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-12 07:02:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9386.1). Total num frames: 86331392. Throughput: 0: 9179.0. Samples: 86330824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:02,720][146380] Avg episode reward: [(0, '4533.462')] [2023-03-12 07:02:03,805][146667] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-12 07:02:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9372.2). Total num frames: 86376448. Throughput: 0: 9139.2. Samples: 86357616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:07,720][146380] Avg episode reward: [(0, '4586.096')] [2023-03-12 07:02:08,229][146667] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-12 07:02:12,413][146667] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-12 07:02:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 86425600. Throughput: 0: 9231.8. Samples: 86415144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:12,720][146380] Avg episode reward: [(0, '4584.912')] [2023-03-12 07:02:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168800_86425600.pth... [2023-03-12 07:02:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168256_86147072.pth [2023-03-12 07:02:16,677][146667] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-12 07:02:17,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 86474752. Throughput: 0: 9275.8. Samples: 86473044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:17,720][146380] Avg episode reward: [(0, '4589.775')] [2023-03-12 07:02:20,920][146667] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-12 07:02:22,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 86523904. Throughput: 0: 9307.6. Samples: 86502220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:22,720][146380] Avg episode reward: [(0, '4487.421')] [2023-03-12 07:02:25,288][146667] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-12 07:02:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 86568960. Throughput: 0: 9372.4. Samples: 86558532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:27,720][146380] Avg episode reward: [(0, '4554.635')] [2023-03-12 07:02:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169080_86568960.pth... [2023-03-12 07:02:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168528_86286336.pth [2023-03-12 07:02:29,703][146667] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-12 07:02:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 86618112. Throughput: 0: 9363.7. Samples: 86614664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:32,720][146380] Avg episode reward: [(0, '4594.009')] [2023-03-12 07:02:33,904][146667] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-12 07:02:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 86667264. Throughput: 0: 9391.4. Samples: 86644160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:37,720][146380] Avg episode reward: [(0, '4487.523')] [2023-03-12 07:02:38,080][146667] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-12 07:02:42,342][146667] Updated weights for policy 0, policy_version 169360 (0.0004) [2023-03-12 07:02:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 86712320. Throughput: 0: 9501.7. Samples: 86703372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:42,720][146380] Avg episode reward: [(0, '4519.079')] [2023-03-12 07:02:42,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169360_86712320.pth... [2023-03-12 07:02:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000168800_86425600.pth [2023-03-12 07:02:46,900][146667] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-12 07:02:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 86757376. Throughput: 0: 9480.3. Samples: 86757440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:02:47,720][146380] Avg episode reward: [(0, '4364.862')] [2023-03-12 07:02:51,118][146667] Updated weights for policy 0, policy_version 169520 (0.0004) [2023-03-12 07:02:52,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 86806528. Throughput: 0: 9523.0. Samples: 86786152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:02:52,720][146380] Avg episode reward: [(0, '4547.054')] [2023-03-12 07:02:55,491][146667] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-12 07:02:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 86851584. Throughput: 0: 9513.1. Samples: 86843232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:02:57,720][146380] Avg episode reward: [(0, '4518.124')] [2023-03-12 07:02:57,784][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169640_86855680.pth... [2023-03-12 07:02:57,786][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169080_86568960.pth [2023-03-12 07:03:00,021][146667] Updated weights for policy 0, policy_version 169680 (0.0006) [2023-03-12 07:03:02,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 86900736. Throughput: 0: 9460.1. Samples: 86898748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:02,720][146380] Avg episode reward: [(0, '4515.939')] [2023-03-12 07:03:04,355][146667] Updated weights for policy 0, policy_version 169760 (0.0004) [2023-03-12 07:03:07,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 86949888. Throughput: 0: 9425.8. Samples: 86926380. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:07,720][146380] Avg episode reward: [(0, '4451.284')] [2023-03-12 07:03:08,510][146667] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-12 07:03:12,631][146667] Updated weights for policy 0, policy_version 169920 (0.0004) [2023-03-12 07:03:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 86999040. Throughput: 0: 9506.9. Samples: 86986340. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:12,720][146380] Avg episode reward: [(0, '4405.396')] [2023-03-12 07:03:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169920_86999040.pth... [2023-03-12 07:03:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169360_86712320.pth [2023-03-12 07:03:17,040][146667] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-12 07:03:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 87044096. Throughput: 0: 9522.3. Samples: 87043168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:17,720][146380] Avg episode reward: [(0, '4376.387')] [2023-03-12 07:03:21,600][146667] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-12 07:03:22,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87089152. Throughput: 0: 9453.0. Samples: 87069548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:22,720][146380] Avg episode reward: [(0, '4543.034')] [2023-03-12 07:03:26,039][146667] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-12 07:03:27,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 87134208. Throughput: 0: 9366.1. Samples: 87124848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:27,720][146380] Avg episode reward: [(0, '4542.140')] [2023-03-12 07:03:27,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170184_87134208.pth... [2023-03-12 07:03:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169640_86855680.pth [2023-03-12 07:03:30,441][146667] Updated weights for policy 0, policy_version 170240 (0.0006) [2023-03-12 07:03:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 87183360. Throughput: 0: 9395.5. Samples: 87180236. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:32,720][146380] Avg episode reward: [(0, '4541.848')] [2023-03-12 07:03:34,874][146667] Updated weights for policy 0, policy_version 170320 (0.0006) [2023-03-12 07:03:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 87228416. Throughput: 0: 9380.5. Samples: 87208272. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:37,720][146380] Avg episode reward: [(0, '4579.354')] [2023-03-12 07:03:39,157][146667] Updated weights for policy 0, policy_version 170400 (0.0004) [2023-03-12 07:03:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87277568. Throughput: 0: 9380.3. Samples: 87265344. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:42,720][146380] Avg episode reward: [(0, '4591.059')] [2023-03-12 07:03:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170464_87277568.pth... [2023-03-12 07:03:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000169920_86999040.pth [2023-03-12 07:03:43,536][146667] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-12 07:03:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 87322624. Throughput: 0: 9394.7. Samples: 87321512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:47,720][146380] Avg episode reward: [(0, '4592.092')] [2023-03-12 07:03:47,944][146667] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-12 07:03:52,421][146667] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-12 07:03:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 87367680. Throughput: 0: 9384.3. Samples: 87348672. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:03:52,720][146380] Avg episode reward: [(0, '4593.686')] [2023-03-12 07:03:56,839][146667] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-12 07:03:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 87412736. Throughput: 0: 9289.5. Samples: 87404368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:03:57,720][146380] Avg episode reward: [(0, '4588.028')] [2023-03-12 07:03:57,731][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170736_87416832.pth... [2023-03-12 07:03:57,733][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170184_87134208.pth [2023-03-12 07:04:01,335][146667] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-12 07:04:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 87461888. Throughput: 0: 9249.2. Samples: 87459384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:02,720][146380] Avg episode reward: [(0, '4564.029')] [2023-03-12 07:04:05,479][146667] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-12 07:04:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 87511040. Throughput: 0: 9319.9. Samples: 87488944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:07,720][146380] Avg episode reward: [(0, '4546.731')] [2023-03-12 07:04:09,705][146667] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-12 07:04:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 87560192. Throughput: 0: 9402.7. Samples: 87547968. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:12,720][146380] Avg episode reward: [(0, '4574.832')] [2023-03-12 07:04:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171016_87560192.pth... [2023-03-12 07:04:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170464_87277568.pth [2023-03-12 07:04:13,782][146667] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-12 07:04:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87609344. Throughput: 0: 9497.7. Samples: 87607632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:17,720][146380] Avg episode reward: [(0, '4488.182')] [2023-03-12 07:04:17,963][146667] Updated weights for policy 0, policy_version 171120 (0.0005) [2023-03-12 07:04:22,489][146667] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-12 07:04:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87654400. Throughput: 0: 9475.4. Samples: 87634664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:22,720][146380] Avg episode reward: [(0, '4477.637')] [2023-03-12 07:04:26,945][146667] Updated weights for policy 0, policy_version 171280 (0.0004) [2023-03-12 07:04:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87699456. Throughput: 0: 9434.5. Samples: 87689896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:27,720][146380] Avg episode reward: [(0, '4510.391')] [2023-03-12 07:04:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171288_87699456.pth... [2023-03-12 07:04:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000170736_87416832.pth [2023-03-12 07:04:31,373][146667] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-12 07:04:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 87748608. Throughput: 0: 9410.7. Samples: 87744992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:32,720][146380] Avg episode reward: [(0, '4508.563')] [2023-03-12 07:04:35,828][146667] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-12 07:04:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87793664. Throughput: 0: 9433.6. Samples: 87773184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:37,720][146380] Avg episode reward: [(0, '4478.000')] [2023-03-12 07:04:40,252][146667] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-12 07:04:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 87838720. Throughput: 0: 9417.7. Samples: 87828164. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:42,720][146380] Avg episode reward: [(0, '4602.519')] [2023-03-12 07:04:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171560_87838720.pth... [2023-03-12 07:04:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171016_87560192.pth [2023-03-12 07:04:42,726][146623] Saving new best policy, reward=4602.519! [2023-03-12 07:04:44,752][146667] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-12 07:04:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 87883776. Throughput: 0: 9430.9. Samples: 87883772. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:47,720][146380] Avg episode reward: [(0, '4590.736')] [2023-03-12 07:04:49,048][146667] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-12 07:04:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 87932928. Throughput: 0: 9419.7. Samples: 87912832. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:52,720][146380] Avg episode reward: [(0, '4581.434')] [2023-03-12 07:04:53,168][146667] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-12 07:04:57,356][146667] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-12 07:04:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 87982080. Throughput: 0: 9419.7. Samples: 87971856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:04:57,720][146380] Avg episode reward: [(0, '4594.677')] [2023-03-12 07:04:57,757][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171848_87986176.pth... [2023-03-12 07:04:57,759][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171288_87699456.pth [2023-03-12 07:05:01,577][146667] Updated weights for policy 0, policy_version 171920 (0.0004) [2023-03-12 07:05:02,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 88031232. Throughput: 0: 9398.0. Samples: 88030544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:02,720][146380] Avg episode reward: [(0, '4551.948')] [2023-03-12 07:05:05,713][146667] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-12 07:05:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 88080384. Throughput: 0: 9451.4. Samples: 88059976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:07,720][146380] Avg episode reward: [(0, '4598.688')] [2023-03-12 07:05:09,826][146667] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-12 07:05:12,720][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 88133632. Throughput: 0: 9558.0. Samples: 88120008. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:12,720][146380] Avg episode reward: [(0, '4579.033')] [2023-03-12 07:05:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172136_88133632.pth... [2023-03-12 07:05:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171560_87838720.pth [2023-03-12 07:05:13,962][146667] Updated weights for policy 0, policy_version 172160 (0.0004) [2023-03-12 07:05:17,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 88182784. Throughput: 0: 9639.5. Samples: 88178768. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:17,720][146380] Avg episode reward: [(0, '4595.355')] [2023-03-12 07:05:18,099][146667] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-12 07:05:22,230][146667] Updated weights for policy 0, policy_version 172320 (0.0004) [2023-03-12 07:05:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 88231936. Throughput: 0: 9695.6. Samples: 88209484. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:22,720][146380] Avg episode reward: [(0, '4595.191')] [2023-03-12 07:05:26,363][146667] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-12 07:05:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9427.7). Total num frames: 88281088. Throughput: 0: 9787.9. Samples: 88268620. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:27,720][146380] Avg episode reward: [(0, '4591.212')] [2023-03-12 07:05:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172424_88281088.pth... [2023-03-12 07:05:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000171848_87986176.pth [2023-03-12 07:05:30,530][146667] Updated weights for policy 0, policy_version 172480 (0.0004) [2023-03-12 07:05:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9427.7). Total num frames: 88330240. Throughput: 0: 9860.3. Samples: 88327484. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:32,720][146380] Avg episode reward: [(0, '4598.563')] [2023-03-12 07:05:34,709][146667] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-12 07:05:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9427.7). Total num frames: 88379392. Throughput: 0: 9861.5. Samples: 88356600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:37,720][146380] Avg episode reward: [(0, '4587.560')] [2023-03-12 07:05:38,875][146667] Updated weights for policy 0, policy_version 172640 (0.0005) [2023-03-12 07:05:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9427.7). Total num frames: 88428544. Throughput: 0: 9875.6. Samples: 88416256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:42,720][146380] Avg episode reward: [(0, '4585.525')] [2023-03-12 07:05:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172712_88428544.pth... [2023-03-12 07:05:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172136_88133632.pth [2023-03-12 07:05:43,008][146667] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-12 07:05:47,177][146667] Updated weights for policy 0, policy_version 172800 (0.0004) [2023-03-12 07:05:47,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9441.6). Total num frames: 88477696. Throughput: 0: 9879.3. Samples: 88475112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:47,720][146380] Avg episode reward: [(0, '4582.079')] [2023-03-12 07:05:51,305][146667] Updated weights for policy 0, policy_version 172880 (0.0004) [2023-03-12 07:05:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9455.5). Total num frames: 88526848. Throughput: 0: 9891.1. Samples: 88505076. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:52,720][146380] Avg episode reward: [(0, '4589.144')] [2023-03-12 07:05:55,474][146667] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-12 07:05:57,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9469.4). Total num frames: 88576000. Throughput: 0: 9861.5. Samples: 88563776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:05:57,720][146380] Avg episode reward: [(0, '4586.978')] [2023-03-12 07:05:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173000_88576000.pth... [2023-03-12 07:05:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172424_88281088.pth [2023-03-12 07:05:59,662][146667] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-12 07:06:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9483.3). Total num frames: 88625152. Throughput: 0: 9876.3. Samples: 88623204. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:06:02,720][146380] Avg episode reward: [(0, '4585.921')] [2023-03-12 07:06:03,750][146667] Updated weights for policy 0, policy_version 173120 (0.0004) [2023-03-12 07:06:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9497.2). Total num frames: 88674304. Throughput: 0: 9862.2. Samples: 88653284. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:07,720][146380] Avg episode reward: [(0, '4580.931')] [2023-03-12 07:06:07,898][146667] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-12 07:06:12,082][146667] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-12 07:06:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 88723456. Throughput: 0: 9840.9. Samples: 88711460. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:12,720][146380] Avg episode reward: [(0, '4584.602')] [2023-03-12 07:06:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173288_88723456.pth... [2023-03-12 07:06:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000172712_88428544.pth [2023-03-12 07:06:16,223][146667] Updated weights for policy 0, policy_version 173360 (0.0004) [2023-03-12 07:06:17,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9511.1). Total num frames: 88772608. Throughput: 0: 9864.5. Samples: 88771384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:17,720][146380] Avg episode reward: [(0, '4590.062')] [2023-03-12 07:06:20,424][146667] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-12 07:06:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9524.9). Total num frames: 88821760. Throughput: 0: 9869.1. Samples: 88800708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:22,720][146380] Avg episode reward: [(0, '4597.580')] [2023-03-12 07:06:24,677][146667] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-12 07:06:27,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 88870912. Throughput: 0: 9820.4. Samples: 88858176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:27,720][146380] Avg episode reward: [(0, '4595.449')] [2023-03-12 07:06:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173576_88870912.pth... [2023-03-12 07:06:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173000_88576000.pth [2023-03-12 07:06:28,921][146667] Updated weights for policy 0, policy_version 173600 (0.0004) [2023-03-12 07:06:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9538.8). Total num frames: 88915968. Throughput: 0: 9784.4. Samples: 88915408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:32,720][146380] Avg episode reward: [(0, '4584.693')] [2023-03-12 07:06:33,355][146667] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-12 07:06:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 88961024. Throughput: 0: 9721.5. Samples: 88942544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:37,720][146380] Avg episode reward: [(0, '4593.791')] [2023-03-12 07:06:37,827][146667] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-12 07:06:42,414][146667] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-12 07:06:42,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 89006080. Throughput: 0: 9615.7. Samples: 88996484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:42,720][146380] Avg episode reward: [(0, '4498.097')] [2023-03-12 07:06:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173840_89006080.pth... [2023-03-12 07:06:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173288_88723456.pth [2023-03-12 07:06:46,908][146667] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-12 07:06:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 89051136. Throughput: 0: 9511.0. Samples: 89051200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:47,720][146380] Avg episode reward: [(0, '4421.864')] [2023-03-12 07:06:51,344][146667] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-12 07:06:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 89100288. Throughput: 0: 9465.4. Samples: 89079228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:52,720][146380] Avg episode reward: [(0, '4500.655')] [2023-03-12 07:06:55,793][146667] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-12 07:06:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 89145344. Throughput: 0: 9380.9. Samples: 89133600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:06:57,720][146380] Avg episode reward: [(0, '4545.885')] [2023-03-12 07:06:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174112_89145344.pth... [2023-03-12 07:06:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173576_88870912.pth [2023-03-12 07:07:00,241][146667] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-12 07:07:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 89190400. Throughput: 0: 9294.1. Samples: 89189620. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:07:02,720][146380] Avg episode reward: [(0, '4584.568')] [2023-03-12 07:07:04,698][146667] Updated weights for policy 0, policy_version 174240 (0.0005) [2023-03-12 07:07:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 89235456. Throughput: 0: 9243.9. Samples: 89216684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:07:07,720][146380] Avg episode reward: [(0, '4514.888')] [2023-03-12 07:07:09,171][146667] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-12 07:07:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 89280512. Throughput: 0: 9200.7. Samples: 89272208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:12,720][146380] Avg episode reward: [(0, '4586.254')] [2023-03-12 07:07:12,755][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174384_89284608.pth... [2023-03-12 07:07:12,757][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000173840_89006080.pth [2023-03-12 07:07:13,659][146667] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-12 07:07:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 89329664. Throughput: 0: 9137.4. Samples: 89326592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:17,720][146380] Avg episode reward: [(0, '4572.766')] [2023-03-12 07:07:18,135][146667] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-12 07:07:22,528][146667] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-12 07:07:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9511.1). Total num frames: 89374720. Throughput: 0: 9150.2. Samples: 89354304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:22,720][146380] Avg episode reward: [(0, '4586.641')] [2023-03-12 07:07:26,966][146667] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-12 07:07:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9497.2). Total num frames: 89419776. Throughput: 0: 9189.1. Samples: 89409996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:27,720][146380] Avg episode reward: [(0, '4599.725')] [2023-03-12 07:07:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174648_89419776.pth... [2023-03-12 07:07:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174112_89145344.pth [2023-03-12 07:07:31,412][146667] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-12 07:07:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 89468928. Throughput: 0: 9199.1. Samples: 89465160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:32,720][146380] Avg episode reward: [(0, '4592.351')] [2023-03-12 07:07:35,749][146667] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-12 07:07:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 89513984. Throughput: 0: 9207.9. Samples: 89493584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:37,720][146380] Avg episode reward: [(0, '4596.241')] [2023-03-12 07:07:40,021][146667] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-12 07:07:42,720][146380] Fps is (10 sec: 9011.0, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 89559040. Throughput: 0: 9271.4. Samples: 89550812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:42,720][146380] Avg episode reward: [(0, '4597.272')] [2023-03-12 07:07:42,778][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174928_89563136.pth... [2023-03-12 07:07:42,780][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174384_89284608.pth [2023-03-12 07:07:44,591][146667] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-12 07:07:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 89608192. Throughput: 0: 9223.0. Samples: 89604656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:47,720][146380] Avg episode reward: [(0, '4590.734')] [2023-03-12 07:07:49,013][146667] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-12 07:07:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 89653248. Throughput: 0: 9246.3. Samples: 89632768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:52,720][146380] Avg episode reward: [(0, '4595.370')] [2023-03-12 07:07:53,545][146667] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-12 07:07:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9483.3). Total num frames: 89698304. Throughput: 0: 9227.7. Samples: 89687456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:07:57,720][146380] Avg episode reward: [(0, '4555.386')] [2023-03-12 07:07:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175192_89698304.pth... [2023-03-12 07:07:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174648_89419776.pth [2023-03-12 07:07:57,992][146667] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-12 07:08:02,465][146667] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-12 07:08:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 89743360. Throughput: 0: 9238.4. Samples: 89742320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:08:02,720][146380] Avg episode reward: [(0, '4584.845')] [2023-03-12 07:08:06,830][146667] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-12 07:08:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 89792512. Throughput: 0: 9253.9. Samples: 89770728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:08:07,720][146380] Avg episode reward: [(0, '4592.675')] [2023-03-12 07:08:11,257][146667] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-12 07:08:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 89837568. Throughput: 0: 9240.5. Samples: 89825816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:08:12,720][146380] Avg episode reward: [(0, '4550.354')] [2023-03-12 07:08:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175464_89837568.pth... [2023-03-12 07:08:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000174928_89563136.pth [2023-03-12 07:08:15,669][146667] Updated weights for policy 0, policy_version 175520 (0.0004) [2023-03-12 07:08:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 89882624. Throughput: 0: 9258.1. Samples: 89881776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:17,720][146380] Avg episode reward: [(0, '4535.173')] [2023-03-12 07:08:20,172][146667] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-12 07:08:22,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 89927680. Throughput: 0: 9220.3. Samples: 89908496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:22,720][146380] Avg episode reward: [(0, '4539.894')] [2023-03-12 07:08:24,696][146667] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-12 07:08:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 89972736. Throughput: 0: 9170.7. Samples: 89963492. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:27,720][146380] Avg episode reward: [(0, '4591.767')] [2023-03-12 07:08:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175728_89972736.pth... [2023-03-12 07:08:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175192_89698304.pth [2023-03-12 07:08:29,264][146667] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-12 07:08:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9455.5). Total num frames: 90017792. Throughput: 0: 9180.8. Samples: 90017792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:32,720][146380] Avg episode reward: [(0, '4548.262')] [2023-03-12 07:08:33,732][146667] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-12 07:08:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 90066944. Throughput: 0: 9159.5. Samples: 90044944. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:37,720][146380] Avg episode reward: [(0, '4593.503')] [2023-03-12 07:08:38,157][146667] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-12 07:08:42,596][146667] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-12 07:08:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9455.5). Total num frames: 90112000. Throughput: 0: 9164.8. Samples: 90099872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:42,720][146380] Avg episode reward: [(0, '4600.918')] [2023-03-12 07:08:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176000_90112000.pth... [2023-03-12 07:08:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175464_89837568.pth [2023-03-12 07:08:46,995][146667] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-12 07:08:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9455.5). Total num frames: 90157056. Throughput: 0: 9201.2. Samples: 90156376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:47,720][146380] Avg episode reward: [(0, '4590.344')] [2023-03-12 07:08:51,144][146667] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-12 07:08:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9469.4). Total num frames: 90206208. Throughput: 0: 9223.6. Samples: 90185792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:52,720][146380] Avg episode reward: [(0, '4592.418')] [2023-03-12 07:08:55,338][146667] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-12 07:08:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 90255360. Throughput: 0: 9308.4. Samples: 90244696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:08:57,720][146380] Avg episode reward: [(0, '4589.541')] [2023-03-12 07:08:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176280_90255360.pth... [2023-03-12 07:08:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000175728_89972736.pth [2023-03-12 07:08:59,576][146667] Updated weights for policy 0, policy_version 176320 (0.0004) [2023-03-12 07:09:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 90300416. Throughput: 0: 9311.6. Samples: 90300796. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:09:02,720][146380] Avg episode reward: [(0, '4592.609')] [2023-03-12 07:09:04,062][146667] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-12 07:09:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 90349568. Throughput: 0: 9346.5. Samples: 90329088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:09:07,720][146380] Avg episode reward: [(0, '4550.368')] [2023-03-12 07:09:08,526][146667] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-12 07:09:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9441.6). Total num frames: 90394624. Throughput: 0: 9370.6. Samples: 90385168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:09:12,720][146380] Avg episode reward: [(0, '4597.777')] [2023-03-12 07:09:12,732][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176560_90398720.pth... [2023-03-12 07:09:12,732][146667] Updated weights for policy 0, policy_version 176560 (0.0004) [2023-03-12 07:09:12,733][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176000_90112000.pth [2023-03-12 07:09:16,916][146667] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-12 07:09:17,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 90443776. Throughput: 0: 9466.5. Samples: 90443784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 07:09:17,720][146380] Avg episode reward: [(0, '4549.096')] [2023-03-12 07:09:21,151][146667] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-12 07:09:22,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 90492928. Throughput: 0: 9502.2. Samples: 90472544. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:22,720][146380] Avg episode reward: [(0, '4560.885')] [2023-03-12 07:09:25,282][146667] Updated weights for policy 0, policy_version 176800 (0.0004) [2023-03-12 07:09:27,720][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 90542080. Throughput: 0: 9591.7. Samples: 90531500. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:27,720][146380] Avg episode reward: [(0, '4598.154')] [2023-03-12 07:09:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176840_90542080.pth... [2023-03-12 07:09:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176280_90255360.pth [2023-03-12 07:09:29,448][146667] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-12 07:09:32,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9483.3). Total num frames: 90591232. Throughput: 0: 9656.9. Samples: 90590936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:32,720][146380] Avg episode reward: [(0, '4595.192')] [2023-03-12 07:09:33,757][146667] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-12 07:09:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 90640384. Throughput: 0: 9633.2. Samples: 90619284. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:37,720][146380] Avg episode reward: [(0, '4558.881')] [2023-03-12 07:09:37,901][146667] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-12 07:09:42,063][146667] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-12 07:09:42,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 90689536. Throughput: 0: 9630.4. Samples: 90678064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:42,727][146380] Avg episode reward: [(0, '4581.288')] [2023-03-12 07:09:42,730][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177128_90689536.pth... [2023-03-12 07:09:42,732][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176560_90398720.pth [2023-03-12 07:09:46,259][146667] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-12 07:09:47,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9511.0). Total num frames: 90738688. Throughput: 0: 9685.0. Samples: 90736620. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:47,730][146380] Avg episode reward: [(0, '4594.889')] [2023-03-12 07:09:50,375][146667] Updated weights for policy 0, policy_version 177280 (0.0004) [2023-03-12 07:09:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 90787840. Throughput: 0: 9731.0. Samples: 90766984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:52,720][146380] Avg episode reward: [(0, '4588.001')] [2023-03-12 07:09:54,580][146667] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-12 07:09:57,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 90836992. Throughput: 0: 9792.5. Samples: 90825828. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:09:57,720][146380] Avg episode reward: [(0, '4584.097')] [2023-03-12 07:09:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177416_90836992.pth... [2023-03-12 07:09:57,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000176840_90542080.pth [2023-03-12 07:09:58,701][146667] Updated weights for policy 0, policy_version 177440 (0.0004) [2023-03-12 07:10:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9511.0). Total num frames: 90886144. Throughput: 0: 9813.0. Samples: 90885368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:10:02,720][146380] Avg episode reward: [(0, '4543.384')] [2023-03-12 07:10:02,831][146667] Updated weights for policy 0, policy_version 177520 (0.0004) [2023-03-12 07:10:07,031][146667] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-12 07:10:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9497.2). Total num frames: 90935296. Throughput: 0: 9832.0. Samples: 90914984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:10:07,720][146380] Avg episode reward: [(0, '4585.182')] [2023-03-12 07:10:11,461][146667] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-12 07:10:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 90980352. Throughput: 0: 9774.0. Samples: 90971332. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:10:12,720][146380] Avg episode reward: [(0, '4586.009')] [2023-03-12 07:10:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177696_90980352.pth... [2023-03-12 07:10:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177128_90689536.pth [2023-03-12 07:10:15,824][146667] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-12 07:10:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 91029504. Throughput: 0: 9698.8. Samples: 91027380. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:10:17,720][146380] Avg episode reward: [(0, '4579.211')] [2023-03-12 07:10:20,252][146667] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-12 07:10:22,720][146380] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 91074560. Throughput: 0: 9675.2. Samples: 91054668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 07:10:22,720][146380] Avg episode reward: [(0, '4576.280')] [2023-03-12 07:10:24,661][146667] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-12 07:10:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91119616. Throughput: 0: 9619.4. Samples: 91110936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:27,720][146380] Avg episode reward: [(0, '4571.532')] [2023-03-12 07:10:27,740][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177976_91123712.pth... [2023-03-12 07:10:27,742][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177416_90836992.pth [2023-03-12 07:10:28,946][146667] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-12 07:10:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91168768. Throughput: 0: 9603.5. Samples: 91168776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:32,720][146380] Avg episode reward: [(0, '4562.893')] [2023-03-12 07:10:33,242][146667] Updated weights for policy 0, policy_version 178080 (0.0006) [2023-03-12 07:10:37,441][146667] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-12 07:10:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91217920. Throughput: 0: 9556.3. Samples: 91197020. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:37,720][146380] Avg episode reward: [(0, '4583.306')] [2023-03-12 07:10:41,608][146667] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-12 07:10:42,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91267072. Throughput: 0: 9558.3. Samples: 91255952. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:42,720][146380] Avg episode reward: [(0, '4589.505')] [2023-03-12 07:10:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178256_91267072.pth... [2023-03-12 07:10:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177696_90980352.pth [2023-03-12 07:10:45,822][146667] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-12 07:10:47,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91316224. Throughput: 0: 9544.5. Samples: 91314868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:47,720][146380] Avg episode reward: [(0, '4581.773')] [2023-03-12 07:10:49,961][146667] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-12 07:10:52,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91365376. Throughput: 0: 9548.6. Samples: 91344672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:52,720][146380] Avg episode reward: [(0, '4578.368')] [2023-03-12 07:10:54,151][146667] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-12 07:10:57,719][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91414528. Throughput: 0: 9592.2. Samples: 91402980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:10:57,720][146380] Avg episode reward: [(0, '4582.039')] [2023-03-12 07:10:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178544_91414528.pth... [2023-03-12 07:10:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000177976_91123712.pth [2023-03-12 07:10:58,370][146667] Updated weights for policy 0, policy_version 178560 (0.0004) [2023-03-12 07:11:02,564][146667] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-12 07:11:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91463680. Throughput: 0: 9650.0. Samples: 91461632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:02,720][146380] Avg episode reward: [(0, '4585.017')] [2023-03-12 07:11:06,969][146667] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-12 07:11:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 91508736. Throughput: 0: 9655.4. Samples: 91489160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:07,720][146380] Avg episode reward: [(0, '4588.867')] [2023-03-12 07:11:11,381][146667] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-12 07:11:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 91557888. Throughput: 0: 9656.8. Samples: 91545492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:12,720][146380] Avg episode reward: [(0, '4585.471')] [2023-03-12 07:11:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178824_91557888.pth... [2023-03-12 07:11:12,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178256_91267072.pth [2023-03-12 07:11:15,769][146667] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-12 07:11:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 91602944. Throughput: 0: 9611.9. Samples: 91601312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:17,720][146380] Avg episode reward: [(0, '4587.522')] [2023-03-12 07:11:20,197][146667] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-12 07:11:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 91652096. Throughput: 0: 9595.4. Samples: 91628812. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:22,720][146380] Avg episode reward: [(0, '4585.334')] [2023-03-12 07:11:24,223][146667] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-12 07:11:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 91701248. Throughput: 0: 9624.2. Samples: 91689040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 07:11:27,720][146380] Avg episode reward: [(0, '4581.676')] [2023-03-12 07:11:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179104_91701248.pth... [2023-03-12 07:11:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178544_91414528.pth [2023-03-12 07:11:28,316][146667] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-12 07:11:32,423][146667] Updated weights for policy 0, policy_version 179200 (0.0004) [2023-03-12 07:11:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 91750400. Throughput: 0: 9656.8. Samples: 91749424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:32,720][146380] Avg episode reward: [(0, '4587.113')] [2023-03-12 07:11:36,764][146667] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-12 07:11:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 91799552. Throughput: 0: 9649.6. Samples: 91778904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:37,720][146380] Avg episode reward: [(0, '4545.957')] [2023-03-12 07:11:41,169][146667] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-12 07:11:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 91844608. Throughput: 0: 9577.2. Samples: 91833952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:42,720][146380] Avg episode reward: [(0, '4589.360')] [2023-03-12 07:11:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179384_91844608.pth... [2023-03-12 07:11:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000178824_91557888.pth [2023-03-12 07:11:45,343][146667] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-12 07:11:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 91893760. Throughput: 0: 9573.7. Samples: 91892448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:47,720][146380] Avg episode reward: [(0, '4590.832')] [2023-03-12 07:11:49,485][146667] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-12 07:11:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 91942912. Throughput: 0: 9629.7. Samples: 91922496. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:52,720][146380] Avg episode reward: [(0, '4584.950')] [2023-03-12 07:11:53,580][146667] Updated weights for policy 0, policy_version 179600 (0.0004) [2023-03-12 07:11:57,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 91992064. Throughput: 0: 9709.9. Samples: 91982436. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:11:57,720][146380] Avg episode reward: [(0, '4587.322')] [2023-03-12 07:11:57,751][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179680_91996160.pth... [2023-03-12 07:11:57,752][146667] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-12 07:11:57,753][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179104_91701248.pth [2023-03-12 07:12:01,881][146667] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-12 07:12:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 92041216. Throughput: 0: 9777.1. Samples: 92041280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:02,720][146380] Avg episode reward: [(0, '4592.896')] [2023-03-12 07:12:06,332][146667] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-12 07:12:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 92090368. Throughput: 0: 9797.4. Samples: 92069696. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:07,720][146380] Avg episode reward: [(0, '4580.419')] [2023-03-12 07:12:10,685][146667] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-12 07:12:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 92135424. Throughput: 0: 9691.5. Samples: 92125160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:12,720][146380] Avg episode reward: [(0, '4578.037')] [2023-03-12 07:12:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179952_92135424.pth... [2023-03-12 07:12:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179384_91844608.pth [2023-03-12 07:12:15,012][146667] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-12 07:12:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 92184576. Throughput: 0: 9602.7. Samples: 92181548. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:17,720][146380] Avg episode reward: [(0, '4588.167')] [2023-03-12 07:12:19,430][146667] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-12 07:12:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 92229632. Throughput: 0: 9562.5. Samples: 92209216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:22,720][146380] Avg episode reward: [(0, '4590.085')] [2023-03-12 07:12:23,869][146667] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-12 07:12:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9511.0). Total num frames: 92274688. Throughput: 0: 9570.8. Samples: 92264636. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:27,720][146380] Avg episode reward: [(0, '4581.065')] [2023-03-12 07:12:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180224_92274688.pth... [2023-03-12 07:12:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179680_91996160.pth [2023-03-12 07:12:28,277][146667] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-12 07:12:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9511.0). Total num frames: 92319744. Throughput: 0: 9497.1. Samples: 92319816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:12:32,720][146380] Avg episode reward: [(0, '4584.885')] [2023-03-12 07:12:32,788][146667] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-12 07:12:37,138][146667] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-12 07:12:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 92368896. Throughput: 0: 9461.2. Samples: 92348252. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:12:37,720][146380] Avg episode reward: [(0, '4584.140')] [2023-03-12 07:12:41,593][146667] Updated weights for policy 0, policy_version 180480 (0.0005) [2023-03-12 07:12:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9511.0). Total num frames: 92413952. Throughput: 0: 9353.4. Samples: 92403340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:12:42,720][146380] Avg episode reward: [(0, '4588.955')] [2023-03-12 07:12:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180496_92413952.pth... [2023-03-12 07:12:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000179952_92135424.pth [2023-03-12 07:12:46,017][146667] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-12 07:12:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 92459008. Throughput: 0: 9284.3. Samples: 92459072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:12:47,720][146380] Avg episode reward: [(0, '4582.975')] [2023-03-12 07:12:50,484][146667] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-12 07:12:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 92508160. Throughput: 0: 9265.3. Samples: 92486636. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:12:52,720][146380] Avg episode reward: [(0, '4581.325')] [2023-03-12 07:12:54,977][146667] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-12 07:12:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 92553216. Throughput: 0: 9243.8. Samples: 92541132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:12:57,720][146380] Avg episode reward: [(0, '4586.241')] [2023-03-12 07:12:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180768_92553216.pth... [2023-03-12 07:12:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180224_92274688.pth [2023-03-12 07:12:59,435][146667] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-12 07:13:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 92598272. Throughput: 0: 9225.3. Samples: 92596688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:02,720][146380] Avg episode reward: [(0, '4577.000')] [2023-03-12 07:13:03,859][146667] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-12 07:13:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9511.0). Total num frames: 92643328. Throughput: 0: 9215.1. Samples: 92623896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:07,720][146380] Avg episode reward: [(0, '4547.690')] [2023-03-12 07:13:08,239][146667] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-12 07:13:12,603][146667] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-12 07:13:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 92692480. Throughput: 0: 9243.8. Samples: 92680608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:12,720][146380] Avg episode reward: [(0, '4587.802')] [2023-03-12 07:13:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181040_92692480.pth... [2023-03-12 07:13:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180496_92413952.pth [2023-03-12 07:13:17,014][146667] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-12 07:13:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9524.9). Total num frames: 92737536. Throughput: 0: 9263.5. Samples: 92736672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:17,720][146380] Avg episode reward: [(0, '4586.135')] [2023-03-12 07:13:21,182][146667] Updated weights for policy 0, policy_version 181200 (0.0004) [2023-03-12 07:13:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9538.8). Total num frames: 92786688. Throughput: 0: 9288.1. Samples: 92766216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:22,720][146380] Avg episode reward: [(0, '4579.853')] [2023-03-12 07:13:25,293][146667] Updated weights for policy 0, policy_version 181280 (0.0004) [2023-03-12 07:13:27,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 92835840. Throughput: 0: 9379.6. Samples: 92825420. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:27,720][146380] Avg episode reward: [(0, '4577.111')] [2023-03-12 07:13:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181320_92835840.pth... [2023-03-12 07:13:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000180768_92553216.pth [2023-03-12 07:13:29,623][146667] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-12 07:13:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 92884992. Throughput: 0: 9384.1. Samples: 92881356. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:32,720][146380] Avg episode reward: [(0, '4588.606')] [2023-03-12 07:13:34,026][146667] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-12 07:13:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 92930048. Throughput: 0: 9400.1. Samples: 92909640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 07:13:37,720][146380] Avg episode reward: [(0, '4587.022')] [2023-03-12 07:13:38,260][146667] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-12 07:13:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 92975104. Throughput: 0: 9461.8. Samples: 92966912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:13:42,720][146380] Avg episode reward: [(0, '4543.502')] [2023-03-12 07:13:42,768][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181600_92979200.pth... [2023-03-12 07:13:42,769][146667] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-12 07:13:42,769][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181040_92692480.pth [2023-03-12 07:13:47,233][146667] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-12 07:13:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 93024256. Throughput: 0: 9429.4. Samples: 93021012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:13:47,720][146380] Avg episode reward: [(0, '4553.698')] [2023-03-12 07:13:51,506][146667] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-12 07:13:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 93069312. Throughput: 0: 9458.1. Samples: 93049512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:13:52,720][146380] Avg episode reward: [(0, '4586.943')] [2023-03-12 07:13:56,016][146667] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-12 07:13:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 93114368. Throughput: 0: 9437.0. Samples: 93105272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:13:57,720][146380] Avg episode reward: [(0, '4582.922')] [2023-03-12 07:13:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181864_93114368.pth... [2023-03-12 07:13:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181320_92835840.pth [2023-03-12 07:14:00,337][146667] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-12 07:14:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 93163520. Throughput: 0: 9476.8. Samples: 93163128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:02,720][146380] Avg episode reward: [(0, '4597.309')] [2023-03-12 07:14:04,497][146667] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-12 07:14:07,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9552.7). Total num frames: 93212672. Throughput: 0: 9466.4. Samples: 93192204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:07,720][146380] Avg episode reward: [(0, '4588.255')] [2023-03-12 07:14:08,824][146667] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-12 07:14:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 93257728. Throughput: 0: 9395.7. Samples: 93248224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:12,720][146380] Avg episode reward: [(0, '4579.268')] [2023-03-12 07:14:12,764][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182152_93261824.pth... [2023-03-12 07:14:12,767][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181600_92979200.pth [2023-03-12 07:14:13,195][146667] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-12 07:14:17,595][146667] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-12 07:14:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 93306880. Throughput: 0: 9403.2. Samples: 93304500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:17,720][146380] Avg episode reward: [(0, '4587.099')] [2023-03-12 07:14:22,089][146667] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-12 07:14:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 93351936. Throughput: 0: 9379.5. Samples: 93331716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:22,720][146380] Avg episode reward: [(0, '4580.970')] [2023-03-12 07:14:26,527][146667] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-12 07:14:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 93396992. Throughput: 0: 9341.8. Samples: 93387292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:27,720][146380] Avg episode reward: [(0, '4593.715')] [2023-03-12 07:14:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182416_93396992.pth... [2023-03-12 07:14:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000181864_93114368.pth [2023-03-12 07:14:30,924][146667] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-12 07:14:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 93446144. Throughput: 0: 9366.6. Samples: 93442508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:32,720][146380] Avg episode reward: [(0, '4552.401')] [2023-03-12 07:14:35,365][146667] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-12 07:14:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 93491200. Throughput: 0: 9360.4. Samples: 93470728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:37,720][146380] Avg episode reward: [(0, '4589.619')] [2023-03-12 07:14:39,916][146667] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-12 07:14:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 93536256. Throughput: 0: 9316.3. Samples: 93524508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:42,720][146380] Avg episode reward: [(0, '4589.084')] [2023-03-12 07:14:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182688_93536256.pth... [2023-03-12 07:14:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182152_93261824.pth [2023-03-12 07:14:44,365][146667] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-12 07:14:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 93581312. Throughput: 0: 9279.9. Samples: 93580724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:14:47,720][146380] Avg episode reward: [(0, '4591.488')] [2023-03-12 07:14:48,792][146667] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-12 07:14:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9455.5). Total num frames: 93626368. Throughput: 0: 9232.3. Samples: 93607660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:14:52,720][146380] Avg episode reward: [(0, '4585.425')] [2023-03-12 07:14:53,252][146667] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-12 07:14:57,720][146667] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-12 07:14:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 93675520. Throughput: 0: 9222.4. Samples: 93663232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:14:57,720][146380] Avg episode reward: [(0, '4589.444')] [2023-03-12 07:14:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182960_93675520.pth... [2023-03-12 07:14:57,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182416_93396992.pth [2023-03-12 07:15:02,132][146667] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-12 07:15:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9441.6). Total num frames: 93720576. Throughput: 0: 9201.1. Samples: 93718548. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:02,720][146380] Avg episode reward: [(0, '4591.604')] [2023-03-12 07:15:06,537][146667] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-12 07:15:07,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9441.6). Total num frames: 93765632. Throughput: 0: 9213.8. Samples: 93746336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:07,720][146380] Avg episode reward: [(0, '4582.690')] [2023-03-12 07:15:10,984][146667] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-12 07:15:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 93810688. Throughput: 0: 9215.6. Samples: 93801992. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:12,720][146380] Avg episode reward: [(0, '4584.684')] [2023-03-12 07:15:12,770][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183232_93814784.pth... [2023-03-12 07:15:12,771][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182688_93536256.pth [2023-03-12 07:15:15,368][146667] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-12 07:15:17,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9441.6). Total num frames: 93859840. Throughput: 0: 9237.8. Samples: 93858208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:17,720][146380] Avg episode reward: [(0, '4593.701')] [2023-03-12 07:15:19,689][146667] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-12 07:15:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9441.6). Total num frames: 93904896. Throughput: 0: 9242.0. Samples: 93886616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:22,720][146380] Avg episode reward: [(0, '4587.216')] [2023-03-12 07:15:24,205][146667] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-12 07:15:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 93949952. Throughput: 0: 9249.9. Samples: 93940752. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:27,720][146380] Avg episode reward: [(0, '4590.403')] [2023-03-12 07:15:27,756][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183504_93954048.pth... [2023-03-12 07:15:27,758][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000182960_93675520.pth [2023-03-12 07:15:28,666][146667] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-12 07:15:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9427.7). Total num frames: 93999104. Throughput: 0: 9224.5. Samples: 93995828. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:32,720][146380] Avg episode reward: [(0, '4595.901')] [2023-03-12 07:15:33,105][146667] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-12 07:15:37,397][146667] Updated weights for policy 0, policy_version 183680 (0.0004) [2023-03-12 07:15:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9413.9). Total num frames: 94044160. Throughput: 0: 9247.7. Samples: 94023808. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:37,720][146380] Avg episode reward: [(0, '4543.658')] [2023-03-12 07:15:41,638][146667] Updated weights for policy 0, policy_version 183760 (0.0004) [2023-03-12 07:15:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 94093312. Throughput: 0: 9312.3. Samples: 94082284. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:42,720][146380] Avg episode reward: [(0, '4587.451')] [2023-03-12 07:15:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183776_94093312.pth... [2023-03-12 07:15:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183232_93814784.pth [2023-03-12 07:15:45,976][146667] Updated weights for policy 0, policy_version 183840 (0.0004) [2023-03-12 07:15:47,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 94142464. Throughput: 0: 9353.0. Samples: 94139432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:47,720][146380] Avg episode reward: [(0, '4589.288')] [2023-03-12 07:15:50,158][146667] Updated weights for policy 0, policy_version 183920 (0.0003) [2023-03-12 07:15:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 94187520. Throughput: 0: 9381.5. Samples: 94168504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 07:15:52,720][146380] Avg episode reward: [(0, '4586.765')] [2023-03-12 07:15:54,563][146667] Updated weights for policy 0, policy_version 184000 (0.0004) [2023-03-12 07:15:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 94236672. Throughput: 0: 9410.0. Samples: 94225444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:15:57,720][146380] Avg episode reward: [(0, '4596.054')] [2023-03-12 07:15:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184056_94236672.pth... [2023-03-12 07:15:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183504_93954048.pth [2023-03-12 07:15:58,793][146667] Updated weights for policy 0, policy_version 184080 (0.0003) [2023-03-12 07:16:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 94281728. Throughput: 0: 9421.6. Samples: 94282180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:02,720][146380] Avg episode reward: [(0, '4591.629')] [2023-03-12 07:16:03,176][146667] Updated weights for policy 0, policy_version 184160 (0.0004) [2023-03-12 07:16:07,608][146667] Updated weights for policy 0, policy_version 184240 (0.0006) [2023-03-12 07:16:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 94330880. Throughput: 0: 9417.4. Samples: 94310400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:07,720][146380] Avg episode reward: [(0, '4552.341')] [2023-03-12 07:16:11,956][146667] Updated weights for policy 0, policy_version 184320 (0.0004) [2023-03-12 07:16:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 94375936. Throughput: 0: 9447.6. Samples: 94365892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:12,720][146380] Avg episode reward: [(0, '4589.990')] [2023-03-12 07:16:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184328_94375936.pth... [2023-03-12 07:16:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000183776_94093312.pth [2023-03-12 07:16:16,368][146667] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-12 07:16:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 94425088. Throughput: 0: 9472.6. Samples: 94422096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:17,720][146380] Avg episode reward: [(0, '4543.754')] [2023-03-12 07:16:20,641][146667] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-12 07:16:22,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 94470144. Throughput: 0: 9488.9. Samples: 94450808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:22,720][146380] Avg episode reward: [(0, '4549.296')] [2023-03-12 07:16:25,149][146667] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-12 07:16:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 94515200. Throughput: 0: 9413.7. Samples: 94505900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:27,720][146380] Avg episode reward: [(0, '4591.217')] [2023-03-12 07:16:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184600_94515200.pth... [2023-03-12 07:16:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184056_94236672.pth [2023-03-12 07:16:29,489][146667] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-12 07:16:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 94564352. Throughput: 0: 9425.1. Samples: 94563560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:32,720][146380] Avg episode reward: [(0, '4454.215')] [2023-03-12 07:16:33,694][146667] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-12 07:16:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 94613504. Throughput: 0: 9426.3. Samples: 94592688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:37,720][146380] Avg episode reward: [(0, '4548.429')] [2023-03-12 07:16:38,021][146667] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-12 07:16:42,412][146667] Updated weights for policy 0, policy_version 184880 (0.0006) [2023-03-12 07:16:42,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 94658560. Throughput: 0: 9409.7. Samples: 94648880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:42,720][146380] Avg episode reward: [(0, '4582.271')] [2023-03-12 07:16:42,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184880_94658560.pth... [2023-03-12 07:16:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184328_94375936.pth [2023-03-12 07:16:46,858][146667] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-12 07:16:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 94707712. Throughput: 0: 9368.1. Samples: 94703744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:47,720][146380] Avg episode reward: [(0, '4498.771')] [2023-03-12 07:16:51,244][146667] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-12 07:16:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 94752768. Throughput: 0: 9376.7. Samples: 94732352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:52,720][146380] Avg episode reward: [(0, '4541.268')] [2023-03-12 07:16:55,658][146667] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-12 07:16:57,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 94797824. Throughput: 0: 9370.8. Samples: 94787580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:16:57,720][146380] Avg episode reward: [(0, '4546.699')] [2023-03-12 07:16:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185152_94797824.pth... [2023-03-12 07:16:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184600_94515200.pth [2023-03-12 07:17:00,056][146667] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-12 07:17:02,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 94846976. Throughput: 0: 9378.3. Samples: 94844120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:02,720][146380] Avg episode reward: [(0, '4581.144')] [2023-03-12 07:17:04,419][146667] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-12 07:17:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 94892032. Throughput: 0: 9353.1. Samples: 94871696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:07,720][146380] Avg episode reward: [(0, '4510.337')] [2023-03-12 07:17:08,768][146667] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-12 07:17:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 94941184. Throughput: 0: 9397.8. Samples: 94928800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:12,720][146380] Avg episode reward: [(0, '4505.802')] [2023-03-12 07:17:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185432_94941184.pth... [2023-03-12 07:17:12,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000184880_94658560.pth [2023-03-12 07:17:13,157][146667] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-12 07:17:17,612][146667] Updated weights for policy 0, policy_version 185520 (0.0006) [2023-03-12 07:17:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 94986240. Throughput: 0: 9335.7. Samples: 94983668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:17,720][146380] Avg episode reward: [(0, '4492.342')] [2023-03-12 07:17:22,103][146667] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-12 07:17:22,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 95031296. Throughput: 0: 9293.1. Samples: 95010880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:22,720][146380] Avg episode reward: [(0, '4509.200')] [2023-03-12 07:17:26,503][146667] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-12 07:17:27,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 95076352. Throughput: 0: 9289.2. Samples: 95066892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:27,720][146380] Avg episode reward: [(0, '4584.645')] [2023-03-12 07:17:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185696_95076352.pth... [2023-03-12 07:17:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185152_94797824.pth [2023-03-12 07:17:30,919][146667] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-12 07:17:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 95125504. Throughput: 0: 9297.6. Samples: 95122136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:32,720][146380] Avg episode reward: [(0, '4596.494')] [2023-03-12 07:17:35,258][146667] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-12 07:17:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95170560. Throughput: 0: 9294.2. Samples: 95150592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:37,720][146380] Avg episode reward: [(0, '4584.270')] [2023-03-12 07:17:39,601][146667] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-12 07:17:42,720][146380] Fps is (10 sec: 9011.0, 60 sec: 9284.2, 300 sec: 9344.4). Total num frames: 95215616. Throughput: 0: 9325.4. Samples: 95207224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:42,720][146380] Avg episode reward: [(0, '4594.139')] [2023-03-12 07:17:42,762][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185976_95219712.pth... [2023-03-12 07:17:42,763][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185432_94941184.pth [2023-03-12 07:17:44,044][146667] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-12 07:17:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95264768. Throughput: 0: 9282.2. Samples: 95261820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:47,730][146380] Avg episode reward: [(0, '4587.605')] [2023-03-12 07:17:48,515][146667] Updated weights for policy 0, policy_version 186080 (0.0005) [2023-03-12 07:17:52,719][146380] Fps is (10 sec: 9421.0, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95309824. Throughput: 0: 9295.4. Samples: 95289988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:52,720][146380] Avg episode reward: [(0, '4552.279')] [2023-03-12 07:17:52,872][146667] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-12 07:17:57,326][146667] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-12 07:17:57,719][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95354880. Throughput: 0: 9278.5. Samples: 95346332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:17:57,720][146380] Avg episode reward: [(0, '4584.893')] [2023-03-12 07:17:57,788][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186248_95358976.pth... [2023-03-12 07:17:57,790][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185696_95076352.pth [2023-03-12 07:18:01,853][146667] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-12 07:18:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 95404032. Throughput: 0: 9255.4. Samples: 95400160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:02,720][146380] Avg episode reward: [(0, '4587.311')] [2023-03-12 07:18:06,212][146667] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-12 07:18:07,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95449088. Throughput: 0: 9284.3. Samples: 95428672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:07,720][146380] Avg episode reward: [(0, '4592.441')] [2023-03-12 07:18:10,597][146667] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-12 07:18:12,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 95494144. Throughput: 0: 9281.9. Samples: 95484576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:12,720][146380] Avg episode reward: [(0, '4592.031')] [2023-03-12 07:18:12,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186512_95494144.pth... [2023-03-12 07:18:12,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000185976_95219712.pth [2023-03-12 07:18:14,976][146667] Updated weights for policy 0, policy_version 186560 (0.0005) [2023-03-12 07:18:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95543296. Throughput: 0: 9299.6. Samples: 95540616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:17,720][146380] Avg episode reward: [(0, '4582.666')] [2023-03-12 07:18:19,376][146667] Updated weights for policy 0, policy_version 186640 (0.0005) [2023-03-12 07:18:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 95588352. Throughput: 0: 9293.1. Samples: 95568780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:22,720][146380] Avg episode reward: [(0, '4584.939')] [2023-03-12 07:18:23,797][146667] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-12 07:18:27,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 95633408. Throughput: 0: 9263.3. Samples: 95624072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:27,720][146380] Avg episode reward: [(0, '4588.069')] [2023-03-12 07:18:27,725][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186784_95633408.pth... [2023-03-12 07:18:27,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186248_95358976.pth [2023-03-12 07:18:28,273][146667] Updated weights for policy 0, policy_version 186800 (0.0005) [2023-03-12 07:18:32,655][146667] Updated weights for policy 0, policy_version 186880 (0.0005) [2023-03-12 07:18:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 95682560. Throughput: 0: 9281.1. Samples: 95679472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:32,720][146380] Avg episode reward: [(0, '4592.896')] [2023-03-12 07:18:37,101][146667] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-12 07:18:37,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 95727616. Throughput: 0: 9274.4. Samples: 95707336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:37,720][146380] Avg episode reward: [(0, '4545.387')] [2023-03-12 07:18:41,456][146667] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-12 07:18:42,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 95772672. Throughput: 0: 9275.4. Samples: 95763728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:42,720][146380] Avg episode reward: [(0, '4593.693')] [2023-03-12 07:18:42,742][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187064_95776768.pth... [2023-03-12 07:18:42,744][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186512_95494144.pth [2023-03-12 07:18:45,816][146667] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-12 07:18:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 95821824. Throughput: 0: 9318.4. Samples: 95819488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:47,720][146380] Avg episode reward: [(0, '4587.525')] [2023-03-12 07:18:50,330][146667] Updated weights for policy 0, policy_version 187200 (0.0006) [2023-03-12 07:18:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 95866880. Throughput: 0: 9284.3. Samples: 95846464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:52,720][146380] Avg episode reward: [(0, '4592.440')] [2023-03-12 07:18:54,669][146667] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-12 07:18:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 95916032. Throughput: 0: 9315.0. Samples: 95903752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:18:57,720][146380] Avg episode reward: [(0, '4544.022')] [2023-03-12 07:18:57,726][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187336_95916032.pth... [2023-03-12 07:18:57,728][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000186784_95633408.pth [2023-03-12 07:18:58,871][146667] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-12 07:19:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 95965184. Throughput: 0: 9368.3. Samples: 95962192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:19:02,720][146380] Avg episode reward: [(0, '4587.676')] [2023-03-12 07:19:03,019][146667] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-12 07:19:07,205][146667] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-12 07:19:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 96014336. Throughput: 0: 9414.8. Samples: 95992448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:19:07,720][146380] Avg episode reward: [(0, '4593.549')] [2023-03-12 07:19:11,310][146667] Updated weights for policy 0, policy_version 187600 (0.0004) [2023-03-12 07:19:12,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 96063488. Throughput: 0: 9493.3. Samples: 96051272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:12,720][146380] Avg episode reward: [(0, '4585.338')] [2023-03-12 07:19:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187624_96063488.pth... [2023-03-12 07:19:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187064_95776768.pth [2023-03-12 07:19:15,722][146667] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-12 07:19:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 96108544. Throughput: 0: 9521.9. Samples: 96107956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:17,720][146380] Avg episode reward: [(0, '4561.658')] [2023-03-12 07:19:19,963][146667] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-12 07:19:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 96157696. Throughput: 0: 9547.1. Samples: 96136956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:22,720][146380] Avg episode reward: [(0, '4547.971')] [2023-03-12 07:19:24,202][146667] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-12 07:19:27,720][146380] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9358.3). Total num frames: 96206848. Throughput: 0: 9575.5. Samples: 96194624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:27,720][146380] Avg episode reward: [(0, '4586.889')] [2023-03-12 07:19:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187904_96206848.pth... [2023-03-12 07:19:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187336_95916032.pth [2023-03-12 07:19:28,399][146667] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-12 07:19:32,470][146667] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-12 07:19:32,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 96256000. Throughput: 0: 9673.1. Samples: 96254776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:32,720][146380] Avg episode reward: [(0, '4592.766')] [2023-03-12 07:19:36,865][146667] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-12 07:19:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 96301056. Throughput: 0: 9700.6. Samples: 96282992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:37,720][146380] Avg episode reward: [(0, '4587.237')] [2023-03-12 07:19:41,279][146667] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-12 07:19:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 96350208. Throughput: 0: 9654.0. Samples: 96338184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:42,720][146380] Avg episode reward: [(0, '4579.424')] [2023-03-12 07:19:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188184_96350208.pth... [2023-03-12 07:19:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187624_96063488.pth [2023-03-12 07:19:45,672][146667] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-12 07:19:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 96395264. Throughput: 0: 9621.8. Samples: 96395172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:47,720][146380] Avg episode reward: [(0, '4590.222')] [2023-03-12 07:19:50,130][146667] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-12 07:19:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 96440320. Throughput: 0: 9544.8. Samples: 96421964. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:52,720][146380] Avg episode reward: [(0, '4583.960')] [2023-03-12 07:19:54,629][146667] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-12 07:19:57,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 96489472. Throughput: 0: 9464.7. Samples: 96477184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:19:57,720][146380] Avg episode reward: [(0, '4511.563')] [2023-03-12 07:19:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188456_96489472.pth... [2023-03-12 07:19:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000187904_96206848.pth [2023-03-12 07:19:58,954][146667] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-12 07:20:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 96534528. Throughput: 0: 9451.1. Samples: 96533256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:20:02,720][146380] Avg episode reward: [(0, '4583.203')] [2023-03-12 07:20:03,379][146667] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-12 07:20:07,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 96579584. Throughput: 0: 9417.8. Samples: 96560756. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:20:07,720][146380] Avg episode reward: [(0, '4591.383')] [2023-03-12 07:20:07,834][146667] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-12 07:20:12,232][146667] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-12 07:20:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 96628736. Throughput: 0: 9374.0. Samples: 96616456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:20:12,720][146380] Avg episode reward: [(0, '4594.287')] [2023-03-12 07:20:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188728_96628736.pth... [2023-03-12 07:20:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188184_96350208.pth [2023-03-12 07:20:16,715][146667] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-12 07:20:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 96673792. Throughput: 0: 9262.8. Samples: 96671600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 07:20:17,720][146380] Avg episode reward: [(0, '4592.249')] [2023-03-12 07:20:21,057][146667] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-12 07:20:22,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 96718848. Throughput: 0: 9249.4. Samples: 96699216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:22,720][146380] Avg episode reward: [(0, '4592.572')] [2023-03-12 07:20:25,479][146667] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-12 07:20:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 96768000. Throughput: 0: 9279.8. Samples: 96755776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:27,720][146380] Avg episode reward: [(0, '4589.473')] [2023-03-12 07:20:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189000_96768000.pth... [2023-03-12 07:20:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188456_96489472.pth [2023-03-12 07:20:29,796][146667] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-12 07:20:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 96813056. Throughput: 0: 9270.0. Samples: 96812320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:32,731][146380] Avg episode reward: [(0, '4588.701')] [2023-03-12 07:20:34,221][146667] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-12 07:20:37,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 96858112. Throughput: 0: 9286.0. Samples: 96839832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:37,720][146380] Avg episode reward: [(0, '4590.674')] [2023-03-12 07:20:38,625][146667] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-12 07:20:42,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 96907264. Throughput: 0: 9285.7. Samples: 96895040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:42,720][146380] Avg episode reward: [(0, '4581.303')] [2023-03-12 07:20:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189272_96907264.pth... [2023-03-12 07:20:42,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000188728_96628736.pth [2023-03-12 07:20:43,095][146667] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-12 07:20:47,601][146667] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-12 07:20:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 96952320. Throughput: 0: 9268.4. Samples: 96950336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:47,720][146380] Avg episode reward: [(0, '4588.196')] [2023-03-12 07:20:52,029][146667] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-12 07:20:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 96997376. Throughput: 0: 9254.9. Samples: 96977228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:52,720][146380] Avg episode reward: [(0, '4586.406')] [2023-03-12 07:20:56,540][146667] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-12 07:20:57,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 97042432. Throughput: 0: 9245.9. Samples: 97032520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:20:57,720][146380] Avg episode reward: [(0, '4548.693')] [2023-03-12 07:20:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189536_97042432.pth... [2023-03-12 07:20:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189000_96768000.pth [2023-03-12 07:21:00,963][146667] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-12 07:21:02,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 97087488. Throughput: 0: 9243.6. Samples: 97087560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:02,720][146380] Avg episode reward: [(0, '4584.698')] [2023-03-12 07:21:05,432][146667] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-12 07:21:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 97136640. Throughput: 0: 9251.6. Samples: 97115540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:07,720][146380] Avg episode reward: [(0, '4584.192')] [2023-03-12 07:21:09,969][146667] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-12 07:21:12,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 97181696. Throughput: 0: 9193.4. Samples: 97169480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:12,720][146380] Avg episode reward: [(0, '4590.954')] [2023-03-12 07:21:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189808_97181696.pth... [2023-03-12 07:21:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189272_96907264.pth [2023-03-12 07:21:14,380][146667] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-12 07:21:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 97226752. Throughput: 0: 9193.9. Samples: 97226044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:17,720][146380] Avg episode reward: [(0, '4594.596')] [2023-03-12 07:21:18,737][146667] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-12 07:21:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 97275904. Throughput: 0: 9208.2. Samples: 97254200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:22,720][146380] Avg episode reward: [(0, '4586.439')] [2023-03-12 07:21:23,138][146667] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-12 07:21:27,360][146667] Updated weights for policy 0, policy_version 190080 (0.0004) [2023-03-12 07:21:27,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 97320960. Throughput: 0: 9231.6. Samples: 97310460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:27,720][146380] Avg episode reward: [(0, '4588.573')] [2023-03-12 07:21:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190080_97320960.pth... [2023-03-12 07:21:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189536_97042432.pth [2023-03-12 07:21:31,744][146667] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-12 07:21:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 97370112. Throughput: 0: 9272.2. Samples: 97367584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:32,720][146380] Avg episode reward: [(0, '4548.302')] [2023-03-12 07:21:35,856][146667] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-12 07:21:37,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 97419264. Throughput: 0: 9344.4. Samples: 97397724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:37,720][146380] Avg episode reward: [(0, '4594.680')] [2023-03-12 07:21:39,989][146667] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-12 07:21:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 97468416. Throughput: 0: 9446.4. Samples: 97457608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:42,720][146380] Avg episode reward: [(0, '4586.586')] [2023-03-12 07:21:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190368_97468416.pth... [2023-03-12 07:21:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000189808_97181696.pth [2023-03-12 07:21:44,033][146667] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-12 07:21:47,719][146380] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 97521664. Throughput: 0: 9557.3. Samples: 97517640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:47,720][146380] Avg episode reward: [(0, '4595.214')] [2023-03-12 07:21:48,125][146667] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-12 07:21:52,451][146667] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-12 07:21:52,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 97566720. Throughput: 0: 9594.5. Samples: 97547292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:52,720][146380] Avg episode reward: [(0, '4549.651')] [2023-03-12 07:21:56,821][146667] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-12 07:21:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 97615872. Throughput: 0: 9638.3. Samples: 97603204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:21:57,720][146380] Avg episode reward: [(0, '4590.047')] [2023-03-12 07:21:57,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190656_97615872.pth... [2023-03-12 07:21:57,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190080_97320960.pth [2023-03-12 07:22:00,954][146667] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-12 07:22:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 97665024. Throughput: 0: 9698.5. Samples: 97662476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:02,720][146380] Avg episode reward: [(0, '4586.164')] [2023-03-12 07:22:05,058][146667] Updated weights for policy 0, policy_version 190800 (0.0004) [2023-03-12 07:22:07,719][146380] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 97714176. Throughput: 0: 9735.6. Samples: 97692304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:07,720][146380] Avg episode reward: [(0, '4593.562')] [2023-03-12 07:22:09,376][146667] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-12 07:22:12,720][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 97759232. Throughput: 0: 9735.5. Samples: 97748556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:12,720][146380] Avg episode reward: [(0, '4588.164')] [2023-03-12 07:22:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190936_97759232.pth... [2023-03-12 07:22:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190368_97468416.pth [2023-03-12 07:22:13,840][146667] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-12 07:22:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 97804288. Throughput: 0: 9706.1. Samples: 97804360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:17,720][146380] Avg episode reward: [(0, '4590.258')] [2023-03-12 07:22:18,195][146667] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-12 07:22:22,589][146667] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-12 07:22:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 97853440. Throughput: 0: 9672.2. Samples: 97832972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:22,720][146380] Avg episode reward: [(0, '4588.858')] [2023-03-12 07:22:26,979][146667] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-12 07:22:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9400.0). Total num frames: 97898496. Throughput: 0: 9578.6. Samples: 97888644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:27,720][146380] Avg episode reward: [(0, '4577.143')] [2023-03-12 07:22:27,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191208_97898496.pth... [2023-03-12 07:22:27,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190656_97615872.pth [2023-03-12 07:22:31,362][146667] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-12 07:22:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 97947648. Throughput: 0: 9474.3. Samples: 97943984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:32,720][146380] Avg episode reward: [(0, '4587.186')] [2023-03-12 07:22:35,759][146667] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-12 07:22:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 97992704. Throughput: 0: 9443.2. Samples: 97972236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:37,720][146380] Avg episode reward: [(0, '4595.502')] [2023-03-12 07:22:40,215][146667] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-12 07:22:42,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 98037760. Throughput: 0: 9434.3. Samples: 98027748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:42,720][146380] Avg episode reward: [(0, '4582.247')] [2023-03-12 07:22:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191480_98037760.pth... [2023-03-12 07:22:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000190936_97759232.pth [2023-03-12 07:22:44,641][146667] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-12 07:22:47,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 98082816. Throughput: 0: 9347.7. Samples: 98083124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:47,720][146380] Avg episode reward: [(0, '4588.613')] [2023-03-12 07:22:49,058][146667] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-12 07:22:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 98131968. Throughput: 0: 9315.5. Samples: 98111500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:52,720][146380] Avg episode reward: [(0, '4597.269')] [2023-03-12 07:22:53,400][146667] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-12 07:22:57,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 98177024. Throughput: 0: 9316.2. Samples: 98167784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:22:57,720][146380] Avg episode reward: [(0, '4591.284')] [2023-03-12 07:22:57,752][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191760_98181120.pth... [2023-03-12 07:22:57,752][146667] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-12 07:22:57,753][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191208_97898496.pth [2023-03-12 07:23:02,115][146667] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-12 07:23:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 98226176. Throughput: 0: 9327.4. Samples: 98224092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:02,720][146380] Avg episode reward: [(0, '4587.939')] [2023-03-12 07:23:06,517][146667] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-12 07:23:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 98271232. Throughput: 0: 9302.3. Samples: 98251576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:07,720][146380] Avg episode reward: [(0, '4584.491')] [2023-03-12 07:23:10,877][146667] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-12 07:23:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 98320384. Throughput: 0: 9322.6. Samples: 98308160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:12,720][146380] Avg episode reward: [(0, '4593.705')] [2023-03-12 07:23:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192032_98320384.pth... [2023-03-12 07:23:12,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191480_98037760.pth [2023-03-12 07:23:15,334][146667] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-12 07:23:17,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 98365440. Throughput: 0: 9322.1. Samples: 98363480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:17,720][146380] Avg episode reward: [(0, '4584.839')] [2023-03-12 07:23:19,771][146667] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-12 07:23:22,720][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 98410496. Throughput: 0: 9305.7. Samples: 98390992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:22,720][146380] Avg episode reward: [(0, '4598.259')] [2023-03-12 07:23:24,264][146667] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-12 07:23:27,720][146380] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 98455552. Throughput: 0: 9301.1. Samples: 98446300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:27,720][146380] Avg episode reward: [(0, '4593.450')] [2023-03-12 07:23:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192296_98455552.pth... [2023-03-12 07:23:27,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000191760_98181120.pth [2023-03-12 07:23:28,752][146667] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-12 07:23:32,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 98504704. Throughput: 0: 9280.3. Samples: 98500736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:32,720][146380] Avg episode reward: [(0, '4587.552')] [2023-03-12 07:23:33,145][146667] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-12 07:23:37,509][146667] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-12 07:23:37,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 98549760. Throughput: 0: 9284.2. Samples: 98529288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:37,720][146380] Avg episode reward: [(0, '4588.956')] [2023-03-12 07:23:41,845][146667] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-12 07:23:42,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 98594816. Throughput: 0: 9295.1. Samples: 98586064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:42,720][146380] Avg episode reward: [(0, '4587.489')] [2023-03-12 07:23:42,727][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192576_98598912.pth... [2023-03-12 07:23:42,729][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192032_98320384.pth [2023-03-12 07:23:46,298][146667] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-12 07:23:47,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 98643968. Throughput: 0: 9280.4. Samples: 98641708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:47,720][146380] Avg episode reward: [(0, '4581.243')] [2023-03-12 07:23:50,617][146667] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-12 07:23:52,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 98689024. Throughput: 0: 9303.0. Samples: 98670212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:52,720][146380] Avg episode reward: [(0, '4588.012')] [2023-03-12 07:23:55,003][146667] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-12 07:23:57,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 98738176. Throughput: 0: 9284.5. Samples: 98725960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:23:57,720][146380] Avg episode reward: [(0, '4587.094')] [2023-03-12 07:23:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192848_98738176.pth... [2023-03-12 07:23:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192296_98455552.pth [2023-03-12 07:23:59,426][146667] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-12 07:24:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 98783232. Throughput: 0: 9297.2. Samples: 98781852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:02,720][146380] Avg episode reward: [(0, '4600.303')] [2023-03-12 07:24:03,823][146667] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-12 07:24:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 98832384. Throughput: 0: 9314.7. Samples: 98810152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:07,720][146380] Avg episode reward: [(0, '4585.951')] [2023-03-12 07:24:08,144][146667] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-12 07:24:12,481][146667] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-12 07:24:12,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 98877440. Throughput: 0: 9340.3. Samples: 98866612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:12,720][146380] Avg episode reward: [(0, '4549.653')] [2023-03-12 07:24:12,724][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193120_98877440.pth... [2023-03-12 07:24:12,727][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192576_98598912.pth [2023-03-12 07:24:16,891][146667] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-12 07:24:17,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 98922496. Throughput: 0: 9372.7. Samples: 98922508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:17,720][146380] Avg episode reward: [(0, '4590.055')] [2023-03-12 07:24:21,376][146667] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-12 07:24:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 98971648. Throughput: 0: 9346.3. Samples: 98949872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:22,720][146380] Avg episode reward: [(0, '4581.002')] [2023-03-12 07:24:25,684][146667] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-12 07:24:27,720][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 99016704. Throughput: 0: 9348.6. Samples: 99006752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:27,720][146380] Avg episode reward: [(0, '4583.931')] [2023-03-12 07:24:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193392_99016704.pth... [2023-03-12 07:24:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000192848_98738176.pth [2023-03-12 07:24:30,001][146667] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-12 07:24:32,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 99065856. Throughput: 0: 9359.7. Samples: 99062896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:32,720][146380] Avg episode reward: [(0, '4596.377')] [2023-03-12 07:24:34,268][146667] Updated weights for policy 0, policy_version 193520 (0.0004) [2023-03-12 07:24:37,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 99115008. Throughput: 0: 9387.9. Samples: 99092668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:37,720][146380] Avg episode reward: [(0, '4587.572')] [2023-03-12 07:24:38,432][146667] Updated weights for policy 0, policy_version 193600 (0.0003) [2023-03-12 07:24:42,698][146667] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-12 07:24:42,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 99164160. Throughput: 0: 9444.3. Samples: 99150956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:24:42,720][146380] Avg episode reward: [(0, '4593.052')] [2023-03-12 07:24:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193680_99164160.pth... [2023-03-12 07:24:42,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193120_98877440.pth [2023-03-12 07:24:46,951][146667] Updated weights for policy 0, policy_version 193760 (0.0004) [2023-03-12 07:24:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99209216. Throughput: 0: 9495.5. Samples: 99209148. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:24:47,720][146380] Avg episode reward: [(0, '4602.833')] [2023-03-12 07:24:47,743][146623] Saving new best policy, reward=4602.833! [2023-03-12 07:24:51,124][146667] Updated weights for policy 0, policy_version 193840 (0.0004) [2023-03-12 07:24:52,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 99258368. Throughput: 0: 9519.6. Samples: 99238532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:24:52,720][146380] Avg episode reward: [(0, '4591.887')] [2023-03-12 07:24:55,515][146667] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-12 07:24:57,719][146380] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99303424. Throughput: 0: 9518.8. Samples: 99294956. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:24:57,720][146380] Avg episode reward: [(0, '4588.122')] [2023-03-12 07:24:57,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193952_99303424.pth... [2023-03-12 07:24:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193392_99016704.pth [2023-03-12 07:24:59,956][146667] Updated weights for policy 0, policy_version 194000 (0.0006) [2023-03-12 07:25:02,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 99352576. Throughput: 0: 9508.0. Samples: 99350368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:02,720][146380] Avg episode reward: [(0, '4597.523')] [2023-03-12 07:25:04,357][146667] Updated weights for policy 0, policy_version 194080 (0.0006) [2023-03-12 07:25:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99397632. Throughput: 0: 9509.7. Samples: 99377808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:07,720][146380] Avg episode reward: [(0, '4588.447')] [2023-03-12 07:25:08,799][146667] Updated weights for policy 0, policy_version 194160 (0.0006) [2023-03-12 07:25:12,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99442688. Throughput: 0: 9475.5. Samples: 99433148. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:12,720][146380] Avg episode reward: [(0, '4596.605')] [2023-03-12 07:25:12,722][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194224_99442688.pth... [2023-03-12 07:25:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193680_99164160.pth [2023-03-12 07:25:13,228][146667] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-12 07:25:17,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99487744. Throughput: 0: 9447.0. Samples: 99488008. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:17,720][146380] Avg episode reward: [(0, '4589.775')] [2023-03-12 07:25:17,757][146667] Updated weights for policy 0, policy_version 194320 (0.0006) [2023-03-12 07:25:22,225][146667] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-12 07:25:22,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99536896. Throughput: 0: 9405.3. Samples: 99515904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:22,720][146380] Avg episode reward: [(0, '4591.278')] [2023-03-12 07:25:26,641][146667] Updated weights for policy 0, policy_version 194480 (0.0006) [2023-03-12 07:25:27,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 99581952. Throughput: 0: 9330.1. Samples: 99570812. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:27,720][146380] Avg episode reward: [(0, '4592.321')] [2023-03-12 07:25:27,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194496_99581952.pth... [2023-03-12 07:25:27,726][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000193952_99303424.pth [2023-03-12 07:25:31,094][146667] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-12 07:25:32,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 99627008. Throughput: 0: 9277.3. Samples: 99626624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:32,720][146380] Avg episode reward: [(0, '4581.175')] [2023-03-12 07:25:35,549][146667] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-12 07:25:37,719][146380] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 99672064. Throughput: 0: 9236.9. Samples: 99654192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:37,720][146380] Avg episode reward: [(0, '4591.726')] [2023-03-12 07:25:40,020][146667] Updated weights for policy 0, policy_version 194720 (0.0006) [2023-03-12 07:25:42,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 99721216. Throughput: 0: 9198.0. Samples: 99708868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:42,720][146380] Avg episode reward: [(0, '4532.903')] [2023-03-12 07:25:42,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194768_99721216.pth... [2023-03-12 07:25:42,724][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194224_99442688.pth [2023-03-12 07:25:44,393][146667] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-12 07:25:47,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 99766272. Throughput: 0: 9211.7. Samples: 99764892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 07:25:47,720][146380] Avg episode reward: [(0, '4588.632')] [2023-03-12 07:25:48,844][146667] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-12 07:25:52,719][146380] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 99811328. Throughput: 0: 9207.7. Samples: 99792156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:25:52,720][146380] Avg episode reward: [(0, '4589.151')] [2023-03-12 07:25:53,316][146667] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-12 07:25:57,569][146667] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-12 07:25:57,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 99860480. Throughput: 0: 9223.4. Samples: 99848200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:25:57,720][146380] Avg episode reward: [(0, '4555.460')] [2023-03-12 07:25:57,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000195040_99860480.pth... [2023-03-12 07:25:57,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194496_99581952.pth [2023-03-12 07:26:01,819][146667] Updated weights for policy 0, policy_version 195120 (0.0004) [2023-03-12 07:26:02,719][146380] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 99909632. Throughput: 0: 9300.2. Samples: 99906516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:26:02,720][146380] Avg episode reward: [(0, '4586.594')] [2023-03-12 07:26:06,033][146667] Updated weights for policy 0, policy_version 195200 (0.0004) [2023-03-12 07:26:07,719][146380] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 99954688. Throughput: 0: 9331.2. Samples: 99935808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:26:07,720][146380] Avg episode reward: [(0, '4588.257')] [2023-03-12 07:26:10,445][146667] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-12 07:26:12,646][146623] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 07:26:12,719][146380] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 100003840. Throughput: 0: 9351.4. Samples: 99991624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 07:26:12,720][146380] Avg episode reward: [(0, '4592.511')] [2023-03-12 07:26:12,723][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000195320_100003840.pth... [2023-03-12 07:26:12,725][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000194768_99721216.pth [2023-03-12 07:26:13,078][146623] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 07:26:13,079][146673] Stopping RolloutWorker_w5... [2023-03-12 07:26:13,079][146670] Stopping RolloutWorker_w2... [2023-03-12 07:26:13,079][146672] Stopping RolloutWorker_w4... [2023-03-12 07:26:13,079][146669] Stopping RolloutWorker_w1... [2023-03-12 07:26:13,079][146668] Stopping RolloutWorker_w0... [2023-03-12 07:26:13,079][146673] Loop rollout_proc5_evt_loop terminating... [2023-03-12 07:26:13,079][146671] Stopping RolloutWorker_w3... [2023-03-12 07:26:13,079][146737] Stopping RolloutWorker_w7... [2023-03-12 07:26:13,079][146674] Stopping RolloutWorker_w6... [2023-03-12 07:26:13,079][146670] Loop rollout_proc2_evt_loop terminating... [2023-03-12 07:26:13,080][146669] Loop rollout_proc1_evt_loop terminating... [2023-03-12 07:26:13,080][146672] Loop rollout_proc4_evt_loop terminating... [2023-03-12 07:26:13,080][146668] Loop rollout_proc0_evt_loop terminating... [2023-03-12 07:26:13,080][146737] Loop rollout_proc7_evt_loop terminating... [2023-03-12 07:26:13,080][146671] Loop rollout_proc3_evt_loop terminating... [2023-03-12 07:26:13,080][146674] Loop rollout_proc6_evt_loop terminating... [2023-03-12 07:26:13,079][146380] Component RolloutWorker_w5 stopped! [2023-03-12 07:26:13,080][146380] Component RolloutWorker_w3 stopped! [2023-03-12 07:26:13,080][146623] Stopping Batcher_0... [2023-03-12 07:26:13,080][146380] Component RolloutWorker_w2 stopped! [2023-03-12 07:26:13,080][146623] Loop batcher_evt_loop terminating... [2023-03-12 07:26:13,080][146380] Component RolloutWorker_w4 stopped! [2023-03-12 07:26:13,081][146380] Component RolloutWorker_w1 stopped! [2023-03-12 07:26:13,081][146380] Component RolloutWorker_w0 stopped! [2023-03-12 07:26:13,081][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 07:26:13,081][146380] Component RolloutWorker_w7 stopped! [2023-03-12 07:26:13,081][146380] Component RolloutWorker_w6 stopped! [2023-03-12 07:26:13,081][146380] Component Batcher_0 stopped! [2023-03-12 07:26:13,084][146623] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000195040_99860480.pth [2023-03-12 07:26:13,085][146623] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-open-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 07:26:13,087][146623] Stopping LearnerWorker_p0... [2023-03-12 07:26:13,087][146623] Loop learner_proc0_evt_loop terminating... [2023-03-12 07:26:13,087][146380] Component LearnerWorker_p0 stopped! [2023-03-12 07:26:13,132][146667] Weights refcount: 2 0 [2023-03-12 07:26:13,133][146667] Stopping InferenceWorker_p0-w0... [2023-03-12 07:26:13,133][146667] Loop inference_proc0-0_evt_loop terminating... [2023-03-12 07:26:13,133][146380] Component InferenceWorker_p0-w0 stopped! [2023-03-12 07:26:13,134][146380] Waiting for process learner_proc0 to stop... [2023-03-12 07:26:13,506][146380] Waiting for process inference_proc0-0 to join... [2023-03-12 07:26:13,521][146380] Waiting for process rollout_proc0 to join... [2023-03-12 07:26:13,522][146380] Waiting for process rollout_proc1 to join... [2023-03-12 07:26:13,522][146380] Waiting for process rollout_proc2 to join... [2023-03-12 07:26:13,522][146380] Waiting for process rollout_proc3 to join... [2023-03-12 07:26:13,522][146380] Waiting for process rollout_proc4 to join... [2023-03-12 07:26:13,522][146380] Waiting for process rollout_proc5 to join... [2023-03-12 07:26:13,523][146380] Waiting for process rollout_proc6 to join... [2023-03-12 07:26:13,523][146380] Waiting for process rollout_proc7 to join... [2023-03-12 07:26:13,523][146380] Batcher 0 profile tree view: batching: 17.8524, releasing_batches: 15.4043 [2023-03-12 07:26:13,523][146380] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 4264.7926 update_model: 108.7762 weight_update: 0.0005 one_step: 0.0005 handle_policy_step: 5592.2409 deserialize: 233.0040, stack: 59.6329, obs_to_device_normalize: 1019.9238, forward: 2779.5455, send_messages: 393.4666 prepare_outputs: 623.7607 to_cpu: 97.4376 [2023-03-12 07:26:13,523][146380] Learner 0 profile tree view: misc: 0.0974, prepare_batch: 93.3306 train: 1204.9736 epoch_init: 0.3782, minibatch_init: 12.4870, losses_postprocess: 12.5684, kl_divergence: 4.4322, after_optimizer: 5.0906 calculate_losses: 494.4384 losses_init: 0.3527, forward_head: 243.5489, bptt_initial: 1.3093, bptt: 1.2681, tail: 116.5336, advantages_returns: 9.0605, losses: 107.6668 update: 658.9242 clip: 58.1234 [2023-03-12 07:26:13,524][146380] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.6388, enqueue_policy_requests: 125.7239, env_step: 7736.2950, overhead: 310.1017, complete_rollouts: 3.0646 save_policy_outputs: 321.6856 split_output_tensors: 157.9958 [2023-03-12 07:26:13,524][146380] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.7815, enqueue_policy_requests: 124.7950, env_step: 7750.5733, overhead: 299.9145, complete_rollouts: 3.2991 save_policy_outputs: 321.3242 split_output_tensors: 159.2823 [2023-03-12 07:26:13,524][146380] Loop Runner_EvtLoop terminating... [2023-03-12 07:26:13,524][146380] Runner profile tree view: main_loop: 10663.2288 [2023-03-12 07:26:13,524][146380] Collected {0: 100007936}, FPS: 9378.8